| *** rfolco_ has quit IRC | 00:00 | |
| openstackgerrit | A change was merged to openstack-infra/reviewstats: Fix CSV output https://review.openstack.org/60102 | 00:01 |
|---|---|---|
| openstackgerrit | A change was merged to openstack-infra/reviewstats: update swift core https://review.openstack.org/60053 | 00:01 |
| *** rongze has quit IRC | 00:02 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Remove tempest coverage job https://review.openstack.org/59775 | 00:03 |
| clarkb | jeblair: mordred: fungi: ^ I made a tiny edit to mtreinish's change, I plan to push through in a bit if no one else reviews | 00:03 |
| *** rcleere has quit IRC | 00:03 | |
| *** rnirmal has joined #openstack-infra | 00:04 | |
| *** openstackgerrit has quit IRC | 00:06 | |
| *** rfolco_ has joined #openstack-infra | 00:06 | |
| *** openstackgerrit has joined #openstack-infra | 00:06 | |
| *** alexpilotti has joined #openstack-infra | 00:07 | |
| *** thomasem has joined #openstack-infra | 00:08 | |
| *** loq_mac has quit IRC | 00:08 | |
| *** sarob has quit IRC | 00:11 | |
| *** sarob has joined #openstack-infra | 00:11 | |
| *** rfolco_ has quit IRC | 00:12 | |
| jeblair | clarkb: +4 https://review.openstack.org/#/c/59046/ | 00:13 |
| clarkb | jeblair: ty, I will try to remember to approve this evening when no meetings are happening | 00:13 |
| *** rfolco_ has joined #openstack-infra | 00:13 | |
| jeblair | clarkb: aprvd coverage change | 00:14 |
| openstackgerrit | Joshua Harlow proposed a change to openstack-infra/gerritlib: Add connection attempt limit https://review.openstack.org/52986 | 00:15 |
| *** rnirmal has quit IRC | 00:15 | |
| clarkb | jeblair: I have approved the companion change to d-g | 00:15 |
| *** thomasem has quit IRC | 00:15 | |
| openstackgerrit | A change was merged to openstack-infra/config: Remove tempest coverage job https://review.openstack.org/59775 | 00:16 |
| *** sarob has quit IRC | 00:16 | |
| openstackgerrit | A change was merged to openstack-infra/jeepyb: Ignore E125 and H flake8 violations. https://review.openstack.org/59802 | 00:18 |
| *** pete5 has quit IRC | 00:18 | |
| *** mriedem has joined #openstack-infra | 00:18 | |
| *** dstufft has quit IRC | 00:18 | |
| *** rfolco_ has quit IRC | 00:20 | |
| *** CaptTofu has joined #openstack-infra | 00:20 | |
| *** dstufft has joined #openstack-infra | 00:21 | |
| *** matsuhashi has joined #openstack-infra | 00:21 | |
| openstackgerrit | Joshua Harlow proposed a change to openstack-infra/gerritlib: Add connection attempt limit https://review.openstack.org/52986 | 00:23 |
| *** mfer has joined #openstack-infra | 00:24 | |
| *** esker has joined #openstack-infra | 00:27 | |
| *** alexpilotti has quit IRC | 00:28 | |
| *** andreaf has quit IRC | 00:30 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Remove queries for bugs 1225024 and 1225664 https://review.openstack.org/59816 | 00:30 |
| uvirtbot | Launchpad bug 1225024 in tempest "tempest.api.compute.admin.test_hosts.HostsAdminTestXML.test_list_hosts_with_zone[gate] unexpected conductor service" [Undecided,Incomplete] https://launchpad.net/bugs/1225024 | 00:30 |
| uvirtbot | Launchpad bug 1225664 in devstack "Swift: No space left on device" [Undecided,Fix committed] https://launchpad.net/bugs/1225664 | 00:30 |
| *** andreaf has joined #openstack-infra | 00:31 | |
| *** rfolco_ has joined #openstack-infra | 00:31 | |
| *** esker has quit IRC | 00:31 | |
| *** dcramer_ has joined #openstack-infra | 00:33 | |
| *** mfer has quit IRC | 00:38 | |
| *** fifieldt_ has joined #openstack-infra | 00:38 | |
| *** mfer has joined #openstack-infra | 00:38 | |
| *** mfer has quit IRC | 00:39 | |
| dcramer_ | jeblair: So at long last, clouddocs-maven-plugin is a project on stackforge: https://git.openstack.org/cgit/stackforge/clouddocs-maven-plugin/ Now I need permission to approve reviews. I'll have a couple of others for this repo as well. | 00:41 |
| *** reed has quit IRC | 00:43 | |
| *** dims has joined #openstack-infra | 00:44 | |
| *** dripton has quit IRC | 00:44 | |
| *** MarkAtwood has quit IRC | 00:44 | |
| *** dims has quit IRC | 00:45 | |
| *** reed has joined #openstack-infra | 00:45 | |
| *** reed has quit IRC | 00:45 | |
| *** reed has joined #openstack-infra | 00:45 | |
| *** dripton has joined #openstack-infra | 00:47 | |
| zaro | clarkb: where is is the configuration for our on-demand jenkins slaves? | 00:49 |
| clarkb | zaro: in openstack-infra/config/modules/openstack_project/files/nodepool/scripts do it | 00:50 |
| zaro | clarkb: i want to add buck to it. | 00:50 |
| clarkb | zaro: we don't want buck on the on demand slaves | 00:50 |
| fungi | dcramer_: i can add you as the initial core reviewer, presumably? | 00:50 |
| clarkb | zaro: adding buck should happen in openstack-infra/config/modules/jenkins/manifests/slave.pp | 00:50 |
| fungi | dcramer_: you should now be able. also you can add/remove additional gerrit users to the core group at https://review.openstack.org/#/admin/groups/207,members | 00:51 |
| zaro | clarkb: no packages are available for buck :( | 00:52 |
| zaro | clarkb: can i do with exec command? | 00:52 |
| zaro | clarkb: the steps is to git clone, ant build, then create some soft links to the executable. | 00:53 |
| clarkb | ugh | 00:54 |
| clarkb | it isn't maven isntallable or something like that? | 00:54 |
| zaro | no, you need to build with ant. | 00:54 |
| clarkb | if not then yes, you need a vcsrepo to clone, then exec to ant build | 00:54 |
| *** jgrimm has quit IRC | 00:55 | |
| zaro | do you know if ant is available or does it need to be installed? | 00:56 |
| fungi | i believe there are ubuntu packages for ant | 00:56 |
| clarkb | I don't know, you can check the list of packages in slave.pp | 00:56 |
| * fungi confirms | 00:56 | |
| fungi | http://packages.ubuntu.com/precise/ant | 00:57 |
| fungi | 1.8.2 | 00:57 |
| clarkb | btw I am going to single +2 approve simple changes (like doc changes) | 00:58 |
| zaro | fungi: huh? does that mean that it's there by default or is it something that needs to be added to the slave.pp? | 00:58 |
| zaro | clarkb: is this a new policy? | 00:58 |
| fungi | just checked on one, and it's installed too http://paste.openstack.org/show/54465/ | 00:58 |
| fungi | zaro: it's an "emergency" policy because we're drowning in changes which need review/approval | 00:59 |
| clarkb | zaro: no, the queue is just so huge that I want to move things through it | 00:59 |
| zaro | fungi: would the best practice be to add ant to slave.pp anyway? or just leave it out | 01:02 |
| zaro | ? | 01:02 |
| fungi | zaro: i suspect it's already being installed as a dependency of something else, if it's not explicitly listed | 01:03 |
| *** markwash has quit IRC | 01:03 | |
| clarkb | if we do need it for buck explicitly I would add it that way we can document what it is for | 01:03 |
| clarkb | and no surprises when $otherthing changes | 01:03 |
| zaro | i would agree that it's be to explicitly add. | 01:04 |
| fungi | that's a worthwhile reason, agreed | 01:04 |
| openstackgerrit | A change was merged to openstack-infra/zuul: Document zuul_url breaking change https://review.openstack.org/60028 | 01:04 |
| zaro | cool. thanks gents. out for dinner now. see ya. | 01:05 |
| *** Abhishe__ has quit IRC | 01:07 | |
| openstackgerrit | A change was merged to openstack-infra/config: create a selection of jobs to not use config drive https://review.openstack.org/60061 | 01:09 |
| clarkb | http://logs.openstack.org/00/60100/1/check/check-requirements-integration-dsvm/d4e873e/console.html d2to1 seems to still be a problem | 01:12 |
| openstackgerrit | A change was merged to openstack-infra/config: Enable neutron on heat-slow experimental job https://review.openstack.org/60084 | 01:12 |
| openstackgerrit | A change was merged to openstack-infra/config: Make havana devstack/tempest jobs non-voting https://review.openstack.org/60092 | 01:13 |
| fungi | clarkb: yeah, saw that | 01:13 |
| fungi | clarkb: and including d2to1 in the global requirements list did not cause it to be discovered by glance's preferred (oldish) version of oslo.messaging | 01:14 |
| clarkb | this is very weird | 01:15 |
| fungi | and the revert of the change mordred thought might be causing that to emerge was punted from the gate by the error it was hoping to quell | 01:15 |
| fungi | i'm sure fixing glance's requirements list to refer to an o.m which does not need d2to1 would "fix" it, but it wouldn't really *fix* it | 01:16 |
| clarkb | right | 01:17 |
| fungi | so where i think we're at is that pypi-mirror on the current state of openstack/requirements master branch does not add d2to1 to the tree, and even putting d2to1 in the global requirements seems not to change that | 01:19 |
| fungi | i'll see if jenkins can tell me the last time that job succeeded | 01:20 |
| *** krotscheck has quit IRC | 01:21 | |
| fungi | latest successful run was https://jenkins01.openstack.org/job/check-requirements-integration-dsvm/4/console | 01:22 |
| *** flaper87 is now known as flaper87|afk | 01:22 | |
| fungi | and this seems to be the earliest failure unless jenkins purged earlier ones https://jenkins02.openstack.org/job/check-requirements-integration-dsvm/6/console | 01:23 |
| fungi | so sometime between 12:50 and 15:44 roughly | 01:24 |
| fungi | i'm going to filter my irc log for gerritbot notifications and see what merged today before 15:44 | 01:26 |
| *** mfer has joined #openstack-infra | 01:26 | |
| fungi | (well, yesterday now that utc midnight is behind us) | 01:26 |
| *** ryanpetrello has joined #openstack-infra | 01:27 | |
| *** esker has joined #openstack-infra | 01:27 | |
| *** prad has quit IRC | 01:28 | |
| *** rongze has joined #openstack-infra | 01:28 | |
| *** rfolco_ has quit IRC | 01:31 | |
| clarkb | oh you know what | 01:31 |
| *** matsuhashi has quit IRC | 01:31 | |
| * clarkb has a hunch that is being tracked down | 01:31 | |
| dcramer_ | fungi: Thanks! | 01:32 |
| *** esker has quit IRC | 01:32 | |
| *** rongze has quit IRC | 01:33 | |
| *** matsuhas_ has joined #openstack-infra | 01:33 | |
| clarkb | fungi: did we recently switch to pypi-mirror? | 01:33 |
| clarkb | or has it been in use for a while? (to build the mirror on the slave) | 01:34 |
| fungi | clarkb: that's what i was hoping to discover in my blank staring at datas here | 01:34 |
| clarkb | hmm november 16th so that can't be it | 01:34 |
| mordred | it's been in use for a while | 01:34 |
| fungi | 06:03:06 openstack-dev/pbr: Use wheels for installation https://review.openstack.org/48803 | 01:35 |
| mordred | fungi: that's the last one before things broke? | 01:35 |
| fungi | that's maybe on the cusp of something which wouldn't have kicked in until a mirror rebuild, but i really think it would have impacted the 12:50 run if it had been the cause | 01:35 |
| *** Mithrandir has quit IRC | 01:35 | |
| mordred | we also just reverted it | 01:35 |
| fungi | right, and it didn't help | 01:36 |
| fungi | after that, skipping a couple of elastic-recheck query changes, we have | 01:36 |
| fungi | 12:39:30 openstack/requirements: Allow Django 1.5 and 1.6 https://review.openstack.org/59920 | 01:36 |
| *** Mithrandir has joined #openstack-infra | 01:36 | |
| fungi | we know what that did, and i don't think it was responsible for this | 01:36 |
| fungi | 12:39:36 openstack/requirements: Bump python-savannaclient version to >= 0.4.0 https://review.openstack.org/59657 | 01:36 |
| clarkb | could zaro's change have side effected something weirdly? | 01:36 |
| *** nosnos has joined #openstack-infra | 01:36 | |
| fungi | clarkb: maybe, but there were successful runs long after it went into affect | 01:37 |
| fungi | er, effect | 01:37 |
| fungi | anyway, after that savannaclient requirement change, there's nothing else reported of interest before we started getting the d2to1-induced braindeadedness in the requirements integration job | 01:38 |
| *** prad_ has joined #openstack-infra | 01:38 | |
| fungi | could it have changed the order in which things were processed to expose a latent problem there? | 01:39 |
| *** sjing has joined #openstack-infra | 01:39 | |
| fungi | that feels far-fetched to me, but... | 01:39 |
| *** dims has joined #openstack-infra | 01:39 | |
| *** bingbu has joined #openstack-infra | 01:40 | |
| fungi | anyway, i think i've satisfied my curiosity that this bug didn't spontaneously spring from one of those changes merging | 01:40 |
| *** herndon_ has joined #openstack-infra | 01:41 | |
| fungi | though there were no mirror rebuild triggering changes before the django one, so the window of potential breakage (if we assume it was introduced by a mirror run) extends to the time when the periodic mirror jobs kicked off | 01:43 |
| clarkb | even further back | 01:44 |
| clarkb | since the periodic mirror jobs wouldn't be affected | 01:44 |
| fungi | really? why not? | 01:44 |
| clarkb | (this is glance trying to install against the built mirror) | 01:44 |
| *** prad_ has quit IRC | 01:45 | |
| clarkb | mirror job itself can talk to the world so d2to1 would be pulled in if necessary | 01:45 |
| fungi | right, but that job ran successfully as recently as 12:50 utc | 01:45 |
| clarkb | which job? the periodic-mirror-python2X or pbr integration? | 01:45 |
| fungi | the requirements integration job last successfully ran at 12:50 | 01:46 |
| clarkb | gotcha | 01:46 |
| fungi | so something happened after that (or took effect after that) to cause this to begin cropping up | 01:46 |
| fungi | i punted to maybe a mirror run dragging something in, but that job shouldn't use the mirror | 01:47 |
| openstackgerrit | Mathieu Gagné proposed a change to openstack-infra/config: gerritbot: Watch stable/havana on puppet-openstack projects https://review.openstack.org/60127 | 01:47 |
| clarkb | fungi: right, I think it is something self contained to how we build the mirror in the integration test | 01:48 |
| *** dcramer_ has quit IRC | 01:49 | |
| *** prad_ has joined #openstack-infra | 01:52 | |
| fungi | so, taking the behavior completely from that angle, i can see why glance's tarball dependency on oslo.messaging==1.2.0a11 while falsely claiming a desire for >=1.2.0a11 would cause the mirror script not to add d2to1 | 01:53 |
| *** reed has quit IRC | 01:53 | |
| fungi | *however* the question becomes, why now? | 01:53 |
| fungi | it's been that way, so... | 01:53 |
| fungi | best guess is something else was more directly depending on d2to1 up until today | 01:54 |
| clarkb | I think that is a good guess | 01:54 |
| fungi | a second (or third or more) order transitive dependency potentially | 01:54 |
| fungi | or, we were accidentally pointing the job at not-the-local-mirror so it was finding d2to1 when it wanted it | 01:55 |
| fungi | but i don't see anything which would have taken effect to bring about that change in behavior coincident to the time we witnessed | 01:56 |
| *** fifieldt_ has quit IRC | 01:56 | |
| clarkb | that would seem more likely if the wheels stuff being reverted fixed our problems (because that change changed how we configure pip and pydistutils | 01:56 |
| *** fifieldt_ has joined #openstack-infra | 01:56 | |
| fungi | right | 01:57 |
| fungi | i'm hoping something more concrete springs to mind, because i'm rapidly running out of brain cells for tonight | 01:58 |
| clarkb | I think transitive d2to1 somewhere is most likely | 01:58 |
| *** guohliu has joined #openstack-infra | 02:00 | |
| *** ^d has quit IRC | 02:01 | |
| *** boris-42 has quit IRC | 02:02 | |
| *** prad_ has quit IRC | 02:05 | |
| *** melwitt has left #openstack-infra | 02:05 | |
| *** dcramer_ has joined #openstack-infra | 02:05 | |
| clarkb | fungi: fwiw I am finding it incredibly difficult to be motivated to fix anything right now | 02:06 |
| clarkb | I think the dentist did that to me | 02:06 |
| fungi | clarkb: understandable | 02:06 |
| *** mrodden has joined #openstack-infra | 02:06 | |
| fungi | they take out small chunks of your soul with their demonic power tools | 02:06 |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Rename #openstack-metering to #openstack-ceilometer https://review.openstack.org/59046 | 02:07 |
| clarkb | I am reapproving that ^ fixed a merge conflict | 02:07 |
| fungi | anyway, i'm going to suggest that our previous mirror-building assumptions were based on an additive principle, whereby projects depending on older stuff was fine because we didn't remove it, just added newer things | 02:07 |
| fungi | that coupled with the idea that we could ignore tarball links in requirements lists when building "the one mirror" | 02:09 |
| fungi | because, at least at one point, whatever they needed had been listed and added | 02:10 |
| *** markwash has joined #openstack-infra | 02:10 | |
| fungi | the new "buildamirror from-scratch![tm]" makes the assumption that things really use the versions they're claiming, and tarball links break that assumption | 02:10 |
| openstackgerrit | A change was merged to openstack-infra/config: Rename #openstack-metering to #openstack-ceilometer https://review.openstack.org/59046 | 02:10 |
| fungi | i can see where wheels of prereleases in pypi, so we can throw away all the tarball links, will help tremendously here | 02:11 |
| fungi | but we're obviously not there yet | 02:12 |
| harlowja | qq for u guys, when enabling coverage job in jenkins, are the outputs of coverage at a known browsable location? | 02:13 |
| lifeless | is https://review.openstack.org/#/c/60063/ urgent? | 02:13 |
| lifeless | (assuming it probably is as i's a revert) | 02:13 |
| harlowja | *not in jenkins, i mean in zuul (or review.openstack.org) - my fault | 02:14 |
| fungi | harlowja: they're... findable at least, but you need to know the sha of the commit which triggered them | 02:14 |
| harlowja | kk | 02:14 |
| harlowja | not posted on the review? | 02:14 |
| fungi | lifeless: it *was* urgent, except it failed to merge due to the bug it was hoped to fix, so now less urgent | 02:15 |
| fungi | lifeless: it's basically the bug we were discussing just above | 02:15 |
| clarkb | harlowja: no because they run after merge | 02:15 |
| lifeless | so if it doesn't solve the bug, we shouldn't land it, right? | 02:15 |
| clarkb | you can run them pre merge if you like as well but we don't do that much | 02:15 |
| clarkb | (we need to look at that again imo) | 02:15 |
| harlowja | ah, k, clarkb logs.openstack.org/$hash_here (?) | 02:16 |
| fungi | lifeless: we may still want to revert it, but not just now | 02:16 |
| clarkb | harlowja: logs.openstack.org/FIRSTTWOCHARSOFHASH/ENTIREHASH | 02:16 |
| harlowja | kk | 02:16 |
| fungi | harlowja: there's an additional layer, because there are too many hashes, so directory browsing gets very impossible | 02:16 |
| harlowja | sure, makes sense | 02:16 |
| lifeless | fungi: want to remove your +2 ? | 02:16 |
| fungi | lifeless: i'm pondering | 02:16 |
| *** openstack has joined #openstack-infra | 02:17 | |
| fungi | lifeless: yeah, i -1'd it just now, but see you did as well. cool | 02:18 |
| *** herndon_ has quit IRC | 02:21 | |
| lifeless | clarkb: fungi: do you need more eyes on the pbr thing? | 02:23 |
| openstackgerrit | Pranesh Pandurangan proposed a change to openstack-infra/config: Added new project, entropy Entropy is a framework for creating audit and repair scripts for openstack https://review.openstack.org/60132 | 02:23 |
| clarkb | lifeless: I am about ready to sleep on it | 02:23 |
| clarkb | I have pizza for dinner that is going cold | 02:23 |
| lifeless | how wide spread is the impact? | 02:23 |
| fungi | lifeless: fresh eyes in a hemisphere where it is not sleepytime would be very, very welcome | 02:23 |
| clarkb | lifeless: right now only openstack/requirements and pbr are affected iirc | 02:24 |
| lifeless | ok | 02:24 |
| clarkb | though everything will be hurting if we need another requirements change in real quick like we had with django | 02:24 |
| fungi | lifeless: for now, it blocks only new patches to openstack/requirements, openstack-dev/pbr and openstack-infra/{jeepyb,pypi-mirror} i believe | 02:24 |
| *** openstackgerrit has quit IRC | 02:24 | |
| *** openstackgerrit has joined #openstack-infra | 02:24 | |
| fungi | lifeless: the only failing job from this is check-requirements-integration-dsvm | 02:25 |
| fungi | so projects which depend on that for gating are impacted | 02:25 |
| fungi | we don't know how far beyond that job the potential impact spreads, but there is a good chance it only affects the integration test script | 02:26 |
| *** esker has joined #openstack-infra | 02:27 | |
| fungi | in particular, we're attempting to suss out why it seems that a fresh pypi-mirror run no longer adds d2to1 (which glance indirectly still needs because of a tarball link dependency on an older oslo.messaging which declared a setup_requires on it), but was not suffering from this prior to ~noon utc yesterday | 02:27 |
| fungi | our best guess, as described a few minutes ago in scrollback, is that up until that time some second-order transitive dependency declared a requirement on d2to but a newer version stopped doing so and now the mirror script no longer thinks it needs to be pulled in | 02:29 |
| fungi | er, on d2to1 | 02:29 |
| *** oubiwann_ has joined #openstack-infra | 02:30 | |
| lifeless | so the options are | 02:31 |
| lifeless | a) transitive dep fail, there is a bug | 02:31 |
| fungi | at least following the code, there's nothing in pypi-mirror which would ignore glance's declared requirement of oslo.messaging>=1.2.0a11 (current versions of which no longer want d2to1) and instead process the tarball link it carries to 1.2.0a11 itself (which wants d2to1) | 02:31 |
| lifeless | b) known limitation rears it's head and we should add d2to1 explicitly somewhere | 02:31 |
| *** esker has quit IRC | 02:32 | |
| fungi | i think it's likely to be a combination of both... | 02:32 |
| fungi | we could consider the behavior "a" something undesirable, and just go fix glance (we expect this to become moot when we get wheels uploading to pypi) | 02:32 |
| fungi | i tried "b" adding d2to1 explicitly to global-requirements.txt in openstack/requirements though and that change failed on the same error, so i'm not *positive* i've followed the code as accurately as i'd hoped | 02:33 |
| *** esker has joined #openstack-infra | 02:34 | |
| fungi | but, running out of steam | 02:34 |
| *** bingbu has quit IRC | 02:34 | |
| fungi | and not so urgent i'm going to pull an all-nighter and then be useless tomorrow | 02:34 |
| *** jcooley_ has joined #openstack-infra | 02:35 | |
| *** ryanpetrello has quit IRC | 02:35 | |
| *** matsuhas_ has quit IRC | 02:35 | |
| *** esker has quit IRC | 02:35 | |
| *** sjing has quit IRC | 02:35 | |
| *** ryanpetrello has joined #openstack-infra | 02:36 | |
| *** esker has joined #openstack-infra | 02:36 | |
| *** dims has quit IRC | 02:37 | |
| * fungi still has advisories which need writing up and security fixes to test. don't want those to miss the stable release boat next week | 02:37 | |
| *** sjing has joined #openstack-infra | 02:38 | |
| *** sandy__ has quit IRC | 02:43 | |
| openstackgerrit | A change was merged to openstack-infra/config: Enable requirement update proposal jobs https://review.openstack.org/59855 | 02:43 |
| *** Ryan_Lane has joined #openstack-infra | 02:44 | |
| *** DennyZhang has joined #openstack-infra | 02:46 | |
| *** Ryan_Lane has quit IRC | 02:49 | |
| *** mfer has quit IRC | 02:50 | |
| *** ryanpetrello has quit IRC | 02:51 | |
| *** rongze has joined #openstack-infra | 02:53 | |
| *** vkozhukalov has joined #openstack-infra | 02:55 | |
| *** mfer has joined #openstack-infra | 02:55 | |
| *** rongze_ has joined #openstack-infra | 02:55 | |
| *** jamesmcarthur has joined #openstack-infra | 02:56 | |
| *** mrodden has quit IRC | 02:57 | |
| *** rongze has quit IRC | 02:58 | |
| *** sandy__ has joined #openstack-infra | 02:59 | |
| openstackgerrit | Mathieu Gagné proposed a change to openstack-infra/config: Mark puppet-unit-3.2/3 jobs as voting https://review.openstack.org/60140 | 02:59 |
| openstackgerrit | lifeless proposed a change to openstack-infra/reviewstats: Use six to handle cpickle. https://review.openstack.org/60114 | 03:09 |
| *** HenryG has quit IRC | 03:11 | |
| openstackgerrit | A change was merged to openstack-infra/reviewstats: Remove text blobs from CSV output https://review.openstack.org/60103 | 03:14 |
| *** mfer has quit IRC | 03:15 | |
| *** chandankumar has joined #openstack-infra | 03:17 | |
| *** jcooley_ has quit IRC | 03:17 | |
| *** markwash has quit IRC | 03:18 | |
| *** mfer has joined #openstack-infra | 03:20 | |
| *** sdake_ has quit IRC | 03:21 | |
| *** dripton has quit IRC | 03:21 | |
| *** CaptTofu has quit IRC | 03:24 | |
| *** resker has joined #openstack-infra | 03:33 | |
| *** esker has quit IRC | 03:35 | |
| *** CaptTofu has joined #openstack-infra | 03:36 | |
| *** mfer has quit IRC | 03:38 | |
| *** mfer has joined #openstack-infra | 03:39 | |
| *** mfer has quit IRC | 03:41 | |
| *** DennyZhang has quit IRC | 03:42 | |
| *** DennyZha` has joined #openstack-infra | 03:42 | |
| *** sarob has joined #openstack-infra | 03:45 | |
| *** Ryan_Lane has joined #openstack-infra | 03:45 | |
| *** mriedem has quit IRC | 03:47 | |
| *** Ryan_Lane has quit IRC | 03:50 | |
| *** dcramer_ has quit IRC | 03:53 | |
| *** matsuhashi has joined #openstack-infra | 04:14 | |
| *** michchap_ has joined #openstack-infra | 04:24 | |
| *** michchap has quit IRC | 04:26 | |
| *** sdake_ has joined #openstack-infra | 04:29 | |
| *** MarkAtwood has joined #openstack-infra | 04:30 | |
| fungi | bug https://bugs.launchpad.net/bugs/1257931 | 04:32 |
| uvirtbot | Launchpad bug 1257931 in openstack-ci "recent import of stevedore to stackforge failed to import the git repo" [Undecided,New] | 04:32 |
| *** fifieldt has quit IRC | 04:33 | |
| fungi | makes me think mordred's manage-projects refactor didn't completely eradicate that issue | 04:34 |
| openstackgerrit | A change was merged to openstack-infra/devstack-gate: Drop TEMPEST_LARGE_OPS_NUMBER by 33% to 100 https://review.openstack.org/60000 | 04:34 |
| clarkb | doesn't look like it | 04:35 |
| clarkb | I wonder if we are also hitting a puppet exec timeout | 04:35 |
| *** rongze_ has quit IRC | 04:35 | |
| *** michchap has joined #openstack-infra | 04:35 | |
| *** CaptTofu has quit IRC | 04:36 | |
| *** CaptTofu has joined #openstack-infra | 04:36 | |
| *** michchap_ has quit IRC | 04:38 | |
| *** oubiwann_ has quit IRC | 04:40 | |
| *** mfer has joined #openstack-infra | 04:44 | |
| *** markwash has joined #openstack-infra | 04:45 | |
| *** Ryan_Lane has joined #openstack-infra | 04:46 | |
| *** mfer has quit IRC | 04:48 | |
| *** pcrews has quit IRC | 04:51 | |
| *** Ryan_Lane has quit IRC | 04:51 | |
| *** amotoki has joined #openstack-infra | 04:53 | |
| *** sarob has quit IRC | 04:59 | |
| *** marun has joined #openstack-infra | 05:03 | |
| *** aardvark has joined #openstack-infra | 05:15 | |
| *** mgagne1 has joined #openstack-infra | 05:15 | |
| *** mgagne1 has quit IRC | 05:15 | |
| *** mgagne1 has joined #openstack-infra | 05:15 | |
| *** mgagne has quit IRC | 05:17 | |
| *** wusui has quit IRC | 05:18 | |
| *** fifieldt_ has quit IRC | 05:21 | |
| *** DennyZha` has quit IRC | 05:24 | |
| *** changbl has joined #openstack-infra | 05:25 | |
| *** sarob has joined #openstack-infra | 05:27 | |
| *** sarob has quit IRC | 05:28 | |
| *** sarob has joined #openstack-infra | 05:28 | |
| *** jamesmcarthur has quit IRC | 05:29 | |
| *** sarob has quit IRC | 05:30 | |
| *** sarob has joined #openstack-infra | 05:32 | |
| *** sarob has quit IRC | 05:33 | |
| *** sarob has joined #openstack-infra | 05:34 | |
| *** dkliban_ has joined #openstack-infra | 05:35 | |
| *** sarob has quit IRC | 05:39 | |
| *** talluri has joined #openstack-infra | 05:43 | |
| *** nicedice has quit IRC | 05:46 | |
| *** Ryan_Lane has joined #openstack-infra | 05:47 | |
| *** sdake_ has quit IRC | 05:49 | |
| *** Ryan_Lane has quit IRC | 05:51 | |
| *** mrodden has joined #openstack-infra | 05:52 | |
| *** yamahata_ has quit IRC | 05:55 | |
| *** DennyZha` has joined #openstack-infra | 05:57 | |
| *** DennyZha` has quit IRC | 06:01 | |
| openstackgerrit | A change was merged to openstack-infra/devstack-gate: Rip out the tempest coverage runs from devstack-gate https://review.openstack.org/59777 | 06:03 |
| *** paul-- has quit IRC | 06:06 | |
| *** matsuhashi has quit IRC | 06:14 | |
| *** matsuhashi has joined #openstack-infra | 06:14 | |
| *** rpodolyaka1 has joined #openstack-infra | 06:17 | |
| *** rcleere has joined #openstack-infra | 06:19 | |
| *** guohliu has quit IRC | 06:29 | |
| *** guohliu has joined #openstack-infra | 06:30 | |
| *** Abhishek has joined #openstack-infra | 06:34 | |
| *** guohliu has quit IRC | 06:35 | |
| *** slong_ has quit IRC | 06:35 | |
| *** slong_ has joined #openstack-infra | 06:36 | |
| *** guohliu has joined #openstack-infra | 06:36 | |
| *** jkyle has quit IRC | 06:37 | |
| *** rcleere has quit IRC | 06:41 | |
| *** Ryan_Lane has joined #openstack-infra | 06:44 | |
| *** jkyle has joined #openstack-infra | 06:44 | |
| openstackgerrit | Stuart Warren proposed a change to openstack-infra/jenkins-job-builder: Add Mercurial plugin feature to jenkins-job-builder https://review.openstack.org/60066 | 06:44 |
| *** vkozhukalov has quit IRC | 06:48 | |
| *** Ryan_Lane has quit IRC | 06:50 | |
| *** pblaho has joined #openstack-infra | 06:50 | |
| *** rongze has joined #openstack-infra | 06:54 | |
| *** Abhishek has quit IRC | 06:56 | |
| *** jpich has joined #openstack-infra | 07:00 | |
| *** paul-- has joined #openstack-infra | 07:01 | |
| *** gyee has quit IRC | 07:06 | |
| *** Ryan_Lane has joined #openstack-infra | 07:09 | |
| *** rpodolyaka1 has quit IRC | 07:11 | |
| *** SergeyLukjanov has joined #openstack-infra | 07:12 | |
| *** denis_makogon has joined #openstack-infra | 07:15 | |
| openstackgerrit | Stuart Warren proposed a change to openstack-infra/jenkins-job-builder: Add Mercurial plugin feature to jenkins-job-builder https://review.openstack.org/60066 | 07:15 |
| *** matsuhashi has quit IRC | 07:17 | |
| *** Ryan_Lane has quit IRC | 07:19 | |
| openstackgerrit | Max Rydahl Andersen proposed a change to openstack-infra/jenkins-job-builder: add private-repository to maven-target https://review.openstack.org/60161 | 07:22 |
| openstackgerrit | QianLin proposed a change to openstack-infra/nodepool: Fix the issue which raise FloatingIpPoolNotFound https://review.openstack.org/54331 | 07:23 |
| *** nati_ueno has quit IRC | 07:24 | |
| *** jcoufal has joined #openstack-infra | 07:30 | |
| *** boris-42 has joined #openstack-infra | 07:35 | |
| *** SergeyLukjanov has quit IRC | 07:41 | |
| openstackgerrit | Max Rydahl Andersen proposed a change to openstack-infra/jenkins-job-builder: add private-repository to maven-target https://review.openstack.org/60161 | 07:43 |
| *** SergeyLukjanov has joined #openstack-infra | 07:48 | |
| *** jpich has quit IRC | 07:56 | |
| *** dkliban_ has quit IRC | 08:04 | |
| *** k4n0 has joined #openstack-infra | 08:07 | |
| *** harlowja has quit IRC | 08:08 | |
| *** paul-- has quit IRC | 08:08 | |
| k4n0 | Hey guys, i have odd situation here, for my review https://review.openstack.org/#/c/59860/, all python 2.6 unit tests are failing, but all python 2.7 pass. Seems to be some bug on the CI side | 08:08 |
| *** flaper87|afk is now known as flaper87 | 08:09 | |
| *** DinaBelova has joined #openstack-infra | 08:10 | |
| *** che-arne has quit IRC | 08:12 | |
| openstackgerrit | Andreas Jaeger proposed a change to openstack-infra/config: Add workInProgress Gerrit ACL for Documentation https://review.openstack.org/60171 | 08:12 |
| *** osanchez has joined #openstack-infra | 08:15 | |
| *** nati_ueno has joined #openstack-infra | 08:15 | |
| openstackgerrit | Max Rydahl Andersen proposed a change to openstack-infra/jenkins-job-builder: add private-repository to maven-target https://review.openstack.org/60161 | 08:22 |
| *** vipul is now known as vipul-away | 08:27 | |
| *** DinaBelova has quit IRC | 08:27 | |
| *** Ryan_Lane has joined #openstack-infra | 08:29 | |
| *** vkozhukalov has joined #openstack-infra | 08:32 | |
| *** hashar has joined #openstack-infra | 08:34 | |
| *** salv-orlando has joined #openstack-infra | 08:34 | |
| *** SergeyLukjanov has quit IRC | 08:36 | |
| *** dizquierdo has joined #openstack-infra | 08:37 | |
| *** Ryan_Lane has quit IRC | 08:37 | |
| *** vipul-away is now known as vipul | 08:37 | |
| *** nprivalova has joined #openstack-infra | 08:38 | |
| *** SlickNik has quit IRC | 08:39 | |
| *** SlickNik has joined #openstack-infra | 08:40 | |
| *** Ryan_Lane has joined #openstack-infra | 08:42 | |
| *** denis_makogon has quit IRC | 08:47 | |
| *** mancdaz_away is now known as mancdaz | 08:47 | |
| *** sjing has quit IRC | 08:49 | |
| *** MarkAtwood has quit IRC | 08:50 | |
| *** MarkAtwood has joined #openstack-infra | 08:52 | |
| *** MarkAtwood has quit IRC | 08:52 | |
| *** boris-42 has quit IRC | 08:57 | |
| *** nati_ueno has quit IRC | 08:57 | |
| *** boris-42 has joined #openstack-infra | 09:16 | |
| *** yamahata_ has joined #openstack-infra | 09:16 | |
| *** nati_ueno has joined #openstack-infra | 09:22 | |
| *** jpich has joined #openstack-infra | 09:24 | |
| *** inkerra has quit IRC | 09:29 | |
| *** jcoufal has quit IRC | 09:30 | |
| *** k4n0 has left #openstack-infra | 09:32 | |
| *** Ryan_Lane has quit IRC | 09:32 | |
| *** fbo_away is now known as fbo | 09:33 | |
| *** avishayb has joined #openstack-infra | 09:35 | |
| *** rossella_s has joined #openstack-infra | 09:40 | |
| *** Ryan_Lane has joined #openstack-infra | 09:53 | |
| *** markmcclain has joined #openstack-infra | 09:54 | |
| *** johnthetubaguy has joined #openstack-infra | 09:56 | |
| *** jcoufal has joined #openstack-infra | 09:58 | |
| *** yamahata_ has quit IRC | 09:58 | |
| *** nprivalova has quit IRC | 09:58 | |
| *** markmcclain has quit IRC | 09:59 | |
| *** Ryan_Lane has quit IRC | 09:59 | |
| *** johnthetubaguy1 has joined #openstack-infra | 09:59 | |
| *** johnthetubaguy has quit IRC | 10:00 | |
| *** Ryan_Lane has joined #openstack-infra | 10:00 | |
| *** Ryan_Lane has quit IRC | 10:01 | |
| *** Ryan_Lane has joined #openstack-infra | 10:03 | |
| *** Ryan_Lane has quit IRC | 10:03 | |
| *** nati_ueno has quit IRC | 10:06 | |
| *** mancdaz is now known as mancdaz_away | 10:07 | |
| *** osanchez has quit IRC | 10:09 | |
| *** nprivalova has joined #openstack-infra | 10:09 | |
| *** mancdaz_away is now known as mancdaz | 10:12 | |
| *** derekh has joined #openstack-infra | 10:13 | |
| *** che-arne has joined #openstack-infra | 10:25 | |
| *** michchap has quit IRC | 10:30 | |
| *** michchap has joined #openstack-infra | 10:31 | |
| *** che-arne has quit IRC | 10:31 | |
| *** nprivalova has quit IRC | 10:32 | |
| *** rfolco has joined #openstack-infra | 10:45 | |
| *** Ryan_Lane has joined #openstack-infra | 10:45 | |
| openstackgerrit | Max Rydahl Andersen proposed a change to openstack-infra/jenkins-job-builder: add private-repository to maven-target https://review.openstack.org/60161 | 10:47 |
| *** boris-42 has quit IRC | 10:47 | |
| *** hashar has quit IRC | 10:51 | |
| *** dizquierdo has quit IRC | 10:53 | |
| *** markmc has joined #openstack-infra | 10:55 | |
| *** nprivalova has joined #openstack-infra | 10:58 | |
| *** yamahata_ has joined #openstack-infra | 11:01 | |
| *** boris-42 has joined #openstack-infra | 11:02 | |
| *** Ryan_Lane has quit IRC | 11:09 | |
| *** rongze has quit IRC | 11:12 | |
| openstackgerrit | Jaroslav Henner proposed a change to openstack-infra/jenkins-job-builder: Add seealso to batch_tasks from promoted_build. https://review.openstack.org/57473 | 11:13 |
| *** hashar has joined #openstack-infra | 11:14 | |
| *** mdenny has quit IRC | 11:15 | |
| *** yamahata_ has quit IRC | 11:15 | |
| *** senk has joined #openstack-infra | 11:21 | |
| *** guohliu has quit IRC | 11:22 | |
| *** senk has quit IRC | 11:25 | |
| *** senk has joined #openstack-infra | 11:25 | |
| *** senk has quit IRC | 11:26 | |
| *** hashar has quit IRC | 11:31 | |
| *** Ryan_Lane has joined #openstack-infra | 11:31 | |
| *** HenryG has joined #openstack-infra | 11:32 | |
| *** jcoufal has quit IRC | 11:36 | |
| *** wenlock has joined #openstack-infra | 11:36 | |
| *** senk has joined #openstack-infra | 11:44 | |
| *** osanchez has joined #openstack-infra | 11:46 | |
| *** ArxCruz has joined #openstack-infra | 11:48 | |
| *** senk has quit IRC | 11:49 | |
| *** senk has joined #openstack-infra | 11:49 | |
| *** jamesmcarthur has joined #openstack-infra | 11:53 | |
| *** fbo is now known as fbo_away | 11:54 | |
| *** rongze has joined #openstack-infra | 11:57 | |
| *** weshay has joined #openstack-infra | 11:58 | |
| *** weshay has quit IRC | 12:02 | |
| *** weshay has joined #openstack-infra | 12:02 | |
| *** Ryan_Lane has quit IRC | 12:04 | |
| *** weshay has quit IRC | 12:11 | |
| *** weshay has joined #openstack-infra | 12:11 | |
| *** rongze has quit IRC | 12:17 | |
| *** senk has quit IRC | 12:20 | |
| *** rongze has joined #openstack-infra | 12:35 | |
| *** hashar has joined #openstack-infra | 12:36 | |
| *** thomasem has joined #openstack-infra | 12:37 | |
| *** jamesmcarthur has quit IRC | 12:41 | |
| *** rongze_ has joined #openstack-infra | 12:41 | |
| *** rongze has quit IRC | 12:42 | |
| *** nosnos has quit IRC | 12:45 | |
| *** talluri has quit IRC | 12:45 | |
| *** talluri has joined #openstack-infra | 12:46 | |
| *** dizquierdo has joined #openstack-infra | 12:46 | |
| *** talluri has quit IRC | 12:50 | |
| *** dims has joined #openstack-infra | 12:51 | |
| *** CaptTofu has quit IRC | 12:51 | |
| *** CaptTofu has joined #openstack-infra | 12:51 | |
| *** xchu has joined #openstack-infra | 12:59 | |
| *** senk has joined #openstack-infra | 12:59 | |
| *** senk has quit IRC | 13:03 | |
| *** senk has joined #openstack-infra | 13:03 | |
| *** salv-orlando_ has joined #openstack-infra | 13:06 | |
| *** avishayb has quit IRC | 13:07 | |
| *** dkranz has quit IRC | 13:08 | |
| *** avishayb has joined #openstack-infra | 13:08 | |
| *** dolphm has joined #openstack-infra | 13:08 | |
| *** salv-orlando has quit IRC | 13:09 | |
| *** salv-orlando_ is now known as salv-orlando | 13:09 | |
| *** resker has quit IRC | 13:10 | |
| *** esker has joined #openstack-infra | 13:10 | |
| *** prad has joined #openstack-infra | 13:13 | |
| *** Ryan_Lane has joined #openstack-infra | 13:14 | |
| *** loq_mac has joined #openstack-infra | 13:14 | |
| *** esker has quit IRC | 13:15 | |
| *** DinaBelova has joined #openstack-infra | 13:15 | |
| *** paul-- has joined #openstack-infra | 13:16 | |
| openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/storyboard: Added basic popup messages https://review.openstack.org/59706 | 13:16 |
| *** prad has quit IRC | 13:18 | |
| *** tma996 has joined #openstack-infra | 13:18 | |
| *** paul-- has quit IRC | 13:21 | |
| *** yamahata_ has joined #openstack-infra | 13:25 | |
| *** CaptTofu has quit IRC | 13:25 | |
| *** CaptTofu has joined #openstack-infra | 13:25 | |
| *** yamahata_ has quit IRC | 13:26 | |
| *** yamahata_ has joined #openstack-infra | 13:26 | |
| *** loq_mac has quit IRC | 13:26 | |
| *** SergeyLukjanov has joined #openstack-infra | 13:26 | |
| *** avishayb has quit IRC | 13:28 | |
| *** fbo_away is now known as fbo | 13:29 | |
| *** mattymo has joined #openstack-infra | 13:32 | |
| sdague | storyboard question (for whenever people are up): do we have a CD version of it up anywhere? (like sbbeta.openstack.org?) | 13:34 |
| *** CaptTofu has quit IRC | 13:35 | |
| SergeyLukjanov | sdague, hey | 13:35 |
| SergeyLukjanov | sdague, there are plans for doing it | 13:35 |
| *** CaptTofu has joined #openstack-infra | 13:35 | |
| *** changbl has quit IRC | 13:35 | |
| sdague | SergeyLukjanov: cool, let me know when it happens. I'd love to play with it | 13:35 |
| SergeyLukjanov | sdague, sure | 13:36 |
| sdague | while I don't think I'll end up a significant contributor, I'd like to start being able to write tooling against the rest api early to make sure that it could do the things I need. | 13:37 |
| sdague | so it should provide some good feedback | 13:37 |
| openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/storyboard: Added basic popup messages https://review.openstack.org/59706 | 13:38 |
| *** avishayb has joined #openstack-infra | 13:39 | |
| * jd__ read "CD version" as "CD-ROM version", you should have seen his face | 13:43 | |
| SergeyLukjanov | jd__ :) | 13:43 |
| SergeyLukjanov | sdague, plan for nearest future is to have CD for current storyboard PoC, but it'll require rewrite, so, feedback will be very useful | 13:44 |
| *** dkranz has joined #openstack-infra | 13:44 | |
| *** fbo is now known as fbo_away | 13:45 | |
| *** dkranz has quit IRC | 13:50 | |
| sdague | jd__: yes, I think we should make slackstack | 13:52 |
| sdague | and send it out on 53 floppies | 13:52 |
| jd__ | haha | 13:52 |
| SergeyLukjanov | is it still possible to buy usb floppy drive? | 13:52 |
| *** fbo_away is now known as fbo | 13:54 | |
| sdague | http://www.amazon.com/Sabrent-External-Floppy-Drive-FL-UDRV/dp/B00E9MD700/ref=sr_1_1?ie=UTF8&qid=1386251654&sr=8-1&keywords=usb+floppy+drive | 13:54 |
| sdague | yes | 13:54 |
| SergeyLukjanov | heh | 13:55 |
| *** smarcet has joined #openstack-infra | 13:55 | |
| mordred | zomg. that would be an awesome thing for a summit - a floppy-based installation system | 13:55 |
| *** NikitaKonovalov has joined #openstack-infra | 13:56 | |
| SergeyLukjanov | and vintage series on 5.25'' floppies | 13:56 |
| mordred | ++ | 13:56 |
| openstackgerrit | Martin Mágr proposed a change to openstack-infra/config: Add packstack to gerritbot https://review.openstack.org/60240 | 13:58 |
| *** Ryan_Lane has quit IRC | 13:58 | |
| sdague | or 8.5" | 13:58 |
| sdague | I had one of those for a while, though no reader | 13:59 |
| sdague | found it in a supply closet in the physics dept in college | 13:59 |
| *** dprince has joined #openstack-infra | 13:59 | |
| *** jcoufal has joined #openstack-infra | 14:03 | |
| *** senk has quit IRC | 14:04 | |
| *** senk has joined #openstack-infra | 14:12 | |
| *** yamahata_ has quit IRC | 14:12 | |
| sdague | mordred: well, I figured out why I couldn't update my profile. In some version of the rewrite of that page, they started using urls that load javascript and have affiliation in the url | 14:12 |
| sdague | which adblock doesn't like | 14:12 |
| *** yamahata_ has joined #openstack-infra | 14:12 | |
| *** julim has joined #openstack-infra | 14:12 | |
| mordred | nice | 14:12 |
| *** dims has quit IRC | 14:12 | |
| sdague | sadly - http://www.openstack.org/foundation/technical-committee/ isn't updated from that data | 14:12 |
| *** fbo is now known as fbo_away | 14:12 | |
| *** Ryan_Lane has joined #openstack-infra | 14:12 | |
| *** dims has joined #openstack-infra | 14:12 | |
| *** mriedem has joined #openstack-infra | 14:12 | |
| *** heyongli has joined #openstack-infra | 14:12 | |
| *** ruhe has joined #openstack-infra | 14:12 | |
| mordred | sdague, SergeyLukjanov: I know that neither of you have the power over this - but: | 14:12 |
| mordred | http://www.mirantis.com/blog/over-1500-donated-bare-metal-servers-mirantis-softlayer-and-ibm-new-benefits-for-the-openstack-community/ | 14:12 |
| mordred | it would be really neat if softlayer would donate 1500 servers to openstack ci - we could really use it | 14:12 |
| SergeyLukjanov | sdague, storyboard discussions are living in #storyboard channel | 14:12 |
| SergeyLukjanov | mordred, yep, it looks pretty easy to utilize all of them :) | 14:12 |
| mordred | SergeyLukjanov: we're very good at using all of the servers :) | 14:13 |
| sdague | mordred: yeh, honestly, before I left the softlayer folks said they were going to provide that. But they were really slow in getting back about anything. | 14:13 |
| mordred | maybe I should follow up - would it be worth pinging todd? | 14:14 |
| *** fbo_away is now known as fbo | 14:15 | |
| sdague | he's in a different enough area, I don't think so. mriedem do you know who's community active that moved over into one of the softlayer teams? | 14:16 |
| *** senk has quit IRC | 14:16 | |
| sdague | at least mriedem would have access to org charts to figure it out | 14:16 |
| *** dolphm has quit IRC | 14:16 | |
| mriedem | sdague: talking about mjfork? | 14:16 |
| mriedem | sdague: mjfork moved to softlayer | 14:16 |
| sdague | yeh, he's in one of those teams | 14:16 |
| sdague | mriedem: I thought someone that actually was doing more code did to | 14:17 |
| mriedem | sdague: i just read about the mirantis + softlayer infra thing yesterday. maybe brian cline? | 14:17 |
| mriedem | briancline: ping! | 14:17 |
| mriedem | worlds are colliding! | 14:18 |
| sdague | briancline is new to me | 14:18 |
| mriedem | me too as of yesterday when he was asking me questions in the internal forums | 14:18 |
| mriedem | but he comes from softlayer and is apparently in this channel | 14:19 |
| *** afazekas has quit IRC | 14:20 | |
| sdague | mriedem: well, if you could run down a contact it would be awesome. mjfork told me they'd be happy to add resources to the pool, but actually carving off the api creds seems to have gotten lost | 14:21 |
| *** loq_mac has joined #openstack-infra | 14:21 | |
| openstackgerrit | A change was merged to openstack-infra/reviewstats: Use six to handle cpickle. https://review.openstack.org/60114 | 14:22 |
| *** prad has joined #openstack-infra | 14:23 | |
| mriedem | sdague: yeah, i'll run down brian cline and michael fork | 14:23 |
| *** dolphm has joined #openstack-infra | 14:25 | |
| mriedem | well you're probably not going to like what i'm hearing | 14:29 |
| mriedem | sounds like the mirantis article is a bit messed up | 14:29 |
| *** oubiwann_ has joined #openstack-infra | 14:29 | |
| mriedem | sdague: mordred: i guess in "SoftLayer will supply the infrastructure to conduct OpenStack benchmark testing using over 1,500 bare metal servers in order to improve scalability and perform other previously impossible OpenStack testing." | 14:30 |
| mriedem | "will supply" is not correct o-) | 14:30 |
| sdague | heh | 14:30 |
| sdague | what... news on the internet not correct :) | 14:31 |
| mriedem | http://paste.openstack.org/show/54513/ | 14:31 |
| *** markmcclain has joined #openstack-infra | 14:32 | |
| mordred | nice | 14:32 |
| sdague | ah... sigh | 14:32 |
| *** pabelanger has quit IRC | 14:32 | |
| mriedem | yeah, ibm f*cks up again | 14:32 |
| mriedem | yay! | 14:32 |
| sdague | pr machines and their lack of caring about reality | 14:33 |
| *** loquacities has joined #openstack-infra | 14:33 | |
| sdague | so, that being said, mjfork did say they'd be interested in contributing something previously (maybe not 1500 servers) | 14:33 |
| sdague | so it would be good to ask him if that's still on the table | 14:33 |
| sdague | and if so, how to move forward, and if not, we can drop it | 14:34 |
| *** loquacities has quit IRC | 14:34 | |
| mordred | hell, just getting a rack added to the lifeless pool would be awesome- 1500 added to the lifeless pool would, well, be really really awesome | 14:34 |
| *** loquacities has joined #openstack-infra | 14:34 | |
| mriedem | sdague: mjfork said he's working on something but can't commit to anything | 14:35 |
| *** loq_mac has quit IRC | 14:35 | |
| *** mancdaz is now known as mancdaz_away | 14:35 | |
| *** johnthetubaguy1 is now known as johnthetubaguy | 14:35 | |
| *** dkranz has joined #openstack-infra | 14:36 | |
| sdague | mriedem: cool | 14:37 |
| sdague | mriedem: would be nice to know when he'd figure it out by, just so we know when to annoy him again | 14:37 |
| mriedem | he said he wished you wouldn't have brought it up :) | 14:37 |
| fungi | sdague--for a while i've wanted a side project named openslack. close enough | 14:38 |
| sdague | heh | 14:40 |
| sdague | well he's not on IRC, so I can't hit him directly | 14:40 |
| *** jamesmcarthur has joined #openstack-infra | 14:40 | |
| mattymo | fungi, will you have time in the next hour or so to discuss moving the rest of Fuel to Stackforge? We're split across fuel-web, fuel-main, fuel-ostf, but our main puppet section is still in github | 14:40 |
| mriedem | sdague: having other people from ibm in irc would make my life a lot easier | 14:41 |
| fungi | mattymo: i can discuss a little. i've overcommitted myself though so i need to pretend to be scarce and get some actual work done too ;) | 14:41 |
| sdague | fwiw, I did legitimately look for his nick in #openstack before poking yuo | 14:41 |
| zul | mordred: so what do we need to do go to get mox3 in gerrit? | 14:41 |
| mriedem | sdague: i think once he moved to softlayer he's been off openstack a bit | 14:42 |
| mattymo | fungi, so you're going to pretend to listen to my request? :) | 14:42 |
| mordred | zul: just a patch to put it in. we've decided that we are going to keep usin git? | 14:42 |
| mriedem | s/a bit// | 14:42 |
| zul | mordred: yeah | 14:43 |
| *** amotoki_ has joined #openstack-infra | 14:44 | |
| *** dolphm has quit IRC | 14:48 | |
| *** dolphm has joined #openstack-infra | 14:48 | |
| *** yaguang has joined #openstack-infra | 14:48 | |
| openstackgerrit | Roman Prykhodchenko proposed a change to openstack-infra/config: Adds devstack-gate tests for Ironic https://review.openstack.org/53917 | 14:48 |
| fungi | mattymo: nah, it won't take much time to talk through--what specifically do you need to get clarification on? | 14:49 |
| *** loquacities has quit IRC | 14:49 | |
| *** markmcclain has quit IRC | 14:49 | |
| *** loq_mac has joined #openstack-infra | 14:50 | |
| *** sdague has left #openstack-infra | 14:53 | |
| *** dolphm has quit IRC | 14:53 | |
| *** sdague has joined #openstack-infra | 14:53 | |
| *** mfer has joined #openstack-infra | 14:53 | |
| *** osanchez has quit IRC | 14:53 | |
| *** osanchez has joined #openstack-infra | 14:53 | |
| HenryG | Does gerrit have a way of ordering the review queue by priority of the bug(s) they reference? | 14:54 |
| fungi | HenryG: gerrit knows nothing about bug priorities | 14:54 |
| *** dcramer_ has joined #openstack-infra | 14:54 | |
| fungi | HenryG: the closest we have is http://status.openstack.org/reviews/ | 14:55 |
| *** loq_mac has quit IRC | 14:56 | |
| *** fbo is now known as fbo_away | 14:56 | |
| *** jcoufal has quit IRC | 14:56 | |
| *** katyafervent has quit IRC | 14:57 | |
| mattymo | fungi, we had some concerns about moving fuel library to stackforge previously | 14:57 |
| mattymo | but now we've really accelerated our dev cycle with gerrit, gate, formal review process, notifications, irc bots, etc... it's awesome | 14:58 |
| fungi | mattymo: great! | 14:58 |
| fungi | i'm glad it's working outy | 14:58 |
| mattymo | yeah I thought I hated gerrit but you learn to love it | 14:58 |
| fungi | er, out | 14:58 |
| mattymo | the original concern about moving Fuel to Stackforge was it directly conflicts with puppet-openstack | 14:58 |
| sdague | jamesmcarthur: so I sorted out the affiliation page | 14:58 |
| fungi | i hate gerrit with every fiber of my being, but it's still a great tool | 14:58 |
| mattymo | we're slowly refactoring Fuel to use upstream puppet modules, but this process is drawn out (and I'm doing it alone) and we won't get there till probably May | 14:59 |
| sdague | turns out, some combination of updates to that page + updates to adblock, means adblock blocks the js load. It might be good to try to detect that to warn folks | 14:59 |
| sdague | jamesmcarthur: I'd still like to get http://www.openstack.org/foundation/technical-committee/ updated with the new profile | 14:59 |
| *** loq_mac has joined #openstack-infra | 14:59 | |
| fungi | mattymo: sounds like a good synergy though. once you get there, you're not the only one taking care of all that puppet | 14:59 |
| mattymo | fungi, I was wondering if we could simply move https://github.com/Mirantis/fuel to stackforge with the pledge that we'll move to a modular format as our dev cycle permits and play nicer with the other puppet groups | 14:59 |
| *** dripton has joined #openstack-infra | 15:01 | |
| mattymo | I believe a good date for that change is early next week, but we want to get some sort of infra sign-off first so we can find a "stopping point" before the move | 15:01 |
| fungi | mattymo: i wouldn't anticipate any objections to that plan. the only people who are likely to care at all will be infra (because we have to review the patches to import it) and maybe the openstack puppet community, but you make a good argument for working with them to dissipate that over time | 15:01 |
| mattymo | fungi, who all would be gatekeepers besides yourself? | 15:02 |
| mattymo | for the initial repo creation | 15:02 |
| *** loq_mac has quit IRC | 15:02 | |
| *** sdake has quit IRC | 15:02 | |
| *** loq_mac has joined #openstack-infra | 15:03 | |
| fungi | me, clarkb, jeblair and mordred are the core reviewers for infra | 15:03 |
| *** sdake has joined #openstack-infra | 15:03 | |
| mattymo | fungi, should I start this process with a proposed date and an email to openstack-infra? | 15:03 |
| *** ryanpetrello has joined #openstack-infra | 15:04 | |
| fungi | mattymo: if you're hoping for rapid turn-around on the review, we can't really promise anything as far as prioritizing stackforge reviews (we're a bit behind still). i don't think it would take too terribly long though. e-mail can't hurt (the openstack-infra@lists.openstack.org ml is probably your best bet) | 15:04 |
| mattymo | ok great | 15:04 |
| mattymo | that's enough info | 15:05 |
| mattymo | thanks | 15:05 |
| fungi | my pleasure | 15:05 |
| *** loq_mac has quit IRC | 15:07 | |
| *** heyongli has quit IRC | 15:07 | |
| *** pblaho has quit IRC | 15:08 | |
| *** Ryan_Lane has quit IRC | 15:09 | |
| *** senk has joined #openstack-infra | 15:12 | |
| *** afazekas has joined #openstack-infra | 15:13 | |
| *** Ryan_Lane has joined #openstack-infra | 15:14 | |
| *** Ryan_Lane has quit IRC | 15:15 | |
| *** NikitaKonovalov has quit IRC | 15:15 | |
| *** yamahata_ has quit IRC | 15:17 | |
| *** senk has quit IRC | 15:17 | |
| *** yamahata_ has joined #openstack-infra | 15:17 | |
| *** senk has joined #openstack-infra | 15:17 | |
| *** xchu has quit IRC | 15:17 | |
| *** yolanda has quit IRC | 15:19 | |
| *** senk has quit IRC | 15:20 | |
| *** avishayb has quit IRC | 15:20 | |
| *** Ryan_Lane has joined #openstack-infra | 15:21 | |
| *** fbo_away is now known as fbo | 15:22 | |
| *** NikitaKonovalov has joined #openstack-infra | 15:23 | |
| *** sandy__ has quit IRC | 15:23 | |
| *** marun has quit IRC | 15:23 | |
| *** alcabrera has joined #openstack-infra | 15:23 | |
| *** datsun180b has joined #openstack-infra | 15:23 | |
| *** jergerber has joined #openstack-infra | 15:27 | |
| *** avishayb has joined #openstack-infra | 15:27 | |
| *** Ryan_Lane has quit IRC | 15:29 | |
| *** jgrimm has joined #openstack-infra | 15:31 | |
| *** sandy__ has joined #openstack-infra | 15:35 | |
| *** senk has joined #openstack-infra | 15:40 | |
| *** sarob has joined #openstack-infra | 15:43 | |
| *** senk has quit IRC | 15:45 | |
| mikal | So... My team has an internal debate at the moment. Should turbo-hipster only report on changes if tests fail? Or should it always report? | 15:45 |
| fungi | mikal: smokestack always reports, so if that's the pattern you want to follow... | 15:46 |
| jeblair | mikal: if it's infrastructure is reliable, it should always report -- even if it fails on a nondeterministic bug, that's helpful because it helps expose them. | 15:46 |
| jeblair | mikal: (and always reporting will help people who want to know whether it has run; otherwise they might wait a long time) | 15:47 |
| anteaya | mikal: I do agree for report the findings of the tests | 15:47 |
| anteaya | s/do/too | 15:47 |
| mikal | Yeah, the concern is that people will get annoyed with lots of bots say "me too!" | 15:47 |
| mikal | I worry about reviewers blocking reviews waiting for comments that never come | 15:47 |
| mikal | But I am trying to represent the other side here fairly too | 15:48 |
| jeblair | mikal: (my opinion; we don't have a policy or anything) | 15:48 |
| jeblair | mikal: "too many things have tested this patch!" will be an interesting thing to hear from a developer! | 15:48 |
| *** mancdaz_away is now known as mancdaz | 15:50 | |
| *** NikitaKonovalov has quit IRC | 15:51 | |
| mikal | jeblair: I do think we're running into that scenario -- there are lots of CI systems being written at the moment | 15:51 |
| mikal | We can deal with that when we get there though | 15:51 |
| jeblair | mikal: yes, i do wish we could better represent that in gerrit. | 15:53 |
| *** SergeyLukjanov has quit IRC | 15:54 | |
| *** DinaBelova has quit IRC | 15:54 | |
| openstackgerrit | A change was merged to openstack-infra/config: Zuul: set gear log level to INFO https://review.openstack.org/60095 | 15:56 |
| jeblair | lifeless: i'm not sure if you read post-merge gerrit comments, but i left you some more info there ^ | 15:56 |
| *** yaguang has quit IRC | 15:57 | |
| *** rcleere has joined #openstack-infra | 15:57 | |
| *** jcooley_ has joined #openstack-infra | 15:58 | |
| fungi | mordred: i've got some additional analysis in bug 1257931 now, so we can see where things might still be racy | 15:58 |
| uvirtbot | Launchpad bug 1257931 in openstack-ci "recent import of stevedore to stackforge failed to import the git repo" [High,In progress] https://launchpad.net/bugs/1257931 | 15:58 |
| openstackgerrit | A change was merged to openstack-infra/config: Nodepool: cache all gerrit repos https://review.openstack.org/60040 | 15:59 |
| openstackgerrit | A change was merged to openstack-infra/config: Add zuul pack-refs cron https://review.openstack.org/59543 | 15:59 |
| *** jcooley_ has quit IRC | 15:59 | |
| jeblair | fungi: do we have logs from those manage-projects runs? istr its logs may be getting useful | 15:59 |
| *** vkozhukalov has quit IRC | 16:00 | |
| fungi | jeblair: yeah, i'm starting to dig into them now and find if we got real detail for those | 16:00 |
| mordred | fungi: spectacular | 16:00 |
| fungi | i'm mainly just surprised that those are the only handful of affected projects so far, given all the ones we've added in the past week or so | 16:01 |
| *** dkliban_ has joined #openstack-infra | 16:03 | |
| *** pabelanger has joined #openstack-infra | 16:03 | |
| *** wenlock_ has joined #openstack-infra | 16:04 | |
| jeblair | fungi: also, keep in mind clark's sleep after group creation patch merged on 2013-12-04 19:07:13 UTC | 16:04 |
| anteaya | I'm trying to get gerrit query to return results based on topic, if I want all the topics beginning with bp/ so far topic:bp, topic:bp/ and topic:bp/* all fail to return the results I am looking to see | 16:05 |
| jeblair | fungi: which is likely after these creations | 16:05 |
| fungi | oh, yep | 16:05 |
| anteaya | thoughts on what I should be using for syntax? | 16:05 |
| *** mrodden has quit IRC | 16:05 | |
| *** jcooley_ has joined #openstack-infra | 16:06 | |
| anteaya | I'm working off this page: https://gerrit.googlecode.com/svn/documentation/2.1.6/cmd-query.html | 16:06 |
| *** hashar has quit IRC | 16:06 | |
| *** yamahata_ has quit IRC | 16:06 | |
| fungi | anteaya: well, for starters, that's not the version of gerrit we're running | 16:06 |
| *** rnirmal has joined #openstack-infra | 16:06 | |
| jeblair | anteaya: topic:^bp/.* | 16:07 |
| anteaya | jeblair: thanks | 16:07 |
| jeblair | anteaya: https://review.openstack.org/Documentation/user-search.html | 16:07 |
| anteaya | fungi: ah, good to know | 16:07 |
| anteaya | jeblair: thanks, will click | 16:07 |
| fungi | jeblair beat me to the url | 16:07 |
| anteaya | he is fast that way | 16:07 |
| *** wenlock has quit IRC | 16:07 | |
| *** wenlock_ is now known as wenlock | 16:08 | |
| fungi | is there any default behavior for logging.getLogger("foo") without passing any configuration? | 16:09 |
| fungi | like, does it just dump to syslog by default? | 16:09 |
| fungi | because if so, i'm not finding any log for manage-projects | 16:10 |
| *** boris-42 has quit IRC | 16:11 | |
| *** miqui has joined #openstack-infra | 16:11 | |
| *** herndon has joined #openstack-infra | 16:12 | |
| *** jcooley_ has quit IRC | 16:12 | |
| *** jcooley_ has joined #openstack-infra | 16:13 | |
| *** rossella_s has quit IRC | 16:15 | |
| *** pabelanger has quit IRC | 16:15 | |
| *** changbl has joined #openstack-infra | 16:17 | |
| sdague | fungi: it's definitely not syslog by default | 16:18 |
| *** jcooley_ has quit IRC | 16:18 | |
| *** mgagne1 is now known as mgagne | 16:18 | |
| jeblair | fungi: i believe the app needs to do some kind of configuration. calling logging.basicConfig is a good start (that will dump it to stderr) | 16:18 |
| jeblair | fungi: it looks like manage-projects does basicConfig at level ERROR by default (unless you pass in -v) | 16:19 |
| fungi | okay, that's what i was vague on. so basicConfig will spew on stderr at least | 16:20 |
| *** mrodden has joined #openstack-infra | 16:20 | |
| fungi | i suspect puppet agent does not actually regurgitate stderr from children however | 16:20 |
| jeblair | it might be stdout. i'm not certain about that. | 16:21 |
| *** nprivalova has quit IRC | 16:22 | |
| jeblair | fungi: it's stderr. | 16:22 |
| *** ndipanov has quit IRC | 16:24 | |
| *** pabelanger has joined #openstack-infra | 16:28 | |
| *** ^d has joined #openstack-infra | 16:29 | |
| *** ^d has joined #openstack-infra | 16:29 | |
| *** che-arne has joined #openstack-infra | 16:30 | |
| *** SergeyLukjanov has joined #openstack-infra | 16:30 | |
| SpamapS | hmm.. shouldn't "Partial-Bug: #xxxxx" result in a note on the bug about the review? https://review.openstack.org/#/c/60079 did not. | 16:30 |
| *** SergeyLukjanov is now known as _SergeyLukjanov | 16:31 | |
| *** _SergeyLukjanov is now known as SergeyLukjanov | 16:31 | |
| jeblair | SpamapS: tripleo mappings in jeepyb need updating | 16:32 |
| maurosr | hey someone know if I can get all the env vars from the tests log? | 16:32 |
| *** SergeyLukjanov is now known as _SergeyLukjanov | 16:32 | |
| SpamapS | jeblair: ah ty | 16:33 |
| *** _SergeyLukjanov is now known as SergeyLukjanov | 16:33 | |
| jeblair | SpamapS: in progress | 16:33 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/jeepyb: Update tripleo project name mappings https://review.openstack.org/60278 | 16:33 |
| *** dolphm has joined #openstack-infra | 16:34 | |
| *** tma996 has quit IRC | 16:35 | |
| *** pcrews has joined #openstack-infra | 16:37 | |
| *** rongze_ has quit IRC | 16:37 | |
| fungi | well, either the puppet agent is swallowing the stderr from manage-projects or there wasn't any error output when those projects were added. also, we're running manage-projects *a lot* | 16:39 |
| fungi | since we have a recursively managed directly we're ensuring absent, puppet thinks it should refresh manage-projects on every agent run | 16:40 |
| fungi | plus the cron job which runs it every half hour | 16:41 |
| fungi | we're basically running manage-projects 6 times an hour, give or take | 16:41 |
| jeblair | fungi: wow, you'd think that would mean run it if it _changes_, not run it if things are still absent. | 16:41 |
| fungi | very much seems to mean the latter | 16:42 |
| fungi | i'm going to try and clean this up real quick with a change. hopefully this will help | 16:42 |
| fungi | and also i'll repair the three affected stackforge projects | 16:42 |
| *** pete5 has joined #openstack-infra | 16:43 | |
| SpamapS | jeblair: oh even more ty! | 16:44 |
| *** syerrapragada1 has joined #openstack-infra | 16:46 | |
| *** senk has joined #openstack-infra | 16:49 | |
| *** syerrapragada has quit IRC | 16:49 | |
| *** syerrapragada has joined #openstack-infra | 16:50 | |
| ruhe | can someone point me to a script/config which mirrors all the gerrit commits (and change requests) to github? | 16:50 |
| fungi | ruhe: it's a built-in feature of gerrit | 16:50 |
| *** senk1 has joined #openstack-infra | 16:51 | |
| fungi | ruhe: gerrit has a replication config file which can contain patterns of various git remotes where you want things replicated | 16:51 |
| *** jcooley_ has joined #openstack-infra | 16:51 | |
| ruhe | fungi: thank you! | 16:52 |
| *** rossella_s has joined #openstack-infra | 16:52 | |
| sdague | jeblair: have things calmed down enough that you'd be up for landing the er web console flip over? | 16:52 |
| *** syerrapragada1 has quit IRC | 16:52 | |
| fungi | ruhe: https://review.openstack.org/Documentation/config-replication.html | 16:52 |
| jeblair | sdague: yes! | 16:52 |
| *** senk has quit IRC | 16:53 | |
| jeblair | sdague: oh, we need to land this first, yeah? https://review.openstack.org/#/c/59289/ | 16:53 |
| *** reaperhulk has joined #openstack-infra | 16:54 | |
| sdague | jeblair: yes | 16:54 |
| sdague | that should be non destructive to the environment | 16:54 |
| *** jcooley_ has quit IRC | 16:54 | |
| sdague | so if you just push go on that, let that land, then the config change should bring everything up on it | 16:54 |
| *** jcooley_ has joined #openstack-infra | 16:55 | |
| *** dolphm has quit IRC | 16:55 | |
| fungi | zaro: interestingly, i'm finding no references to gerrit's replication config in the 2.7 docs... did that change significantly? | 16:56 |
| *** jcooley_ has quit IRC | 16:57 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: add support for installing the web dashboard https://review.openstack.org/59289 | 16:57 |
| *** jbryce has joined #openstack-infra | 16:57 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Cleanup graphite graph https://review.openstack.org/59829 | 16:57 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Remove check jobs from graphite graph https://review.openstack.org/59830 | 16:57 |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add more gate jobs to graphite graph https://review.openstack.org/59831 | 16:57 |
| fungi | zaro: nevermind. seems it became a plugin... http://gerrit-documentation.googlecode.com/svn/ReleaseNotes/ReleaseNotes-2.5.html#replication | 16:57 |
| mordred | fungi: we're going to have to learn more about plugins aren't we | 16:57 |
| fungi | zaro: obviously we'll want to add that, i suspect | 16:57 |
| *** jcooley_ has joined #openstack-infra | 16:57 | |
| fungi | yup | 16:58 |
| *** avishayb has quit IRC | 16:58 | |
| *** andreaf has quit IRC | 17:00 | |
| *** mdenny has joined #openstack-infra | 17:01 | |
| *** andreaf has joined #openstack-infra | 17:01 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: make ResultSet actually inherit from list https://review.openstack.org/59805 | 17:01 |
| *** fbo is now known as fbo_away | 17:01 | |
| *** jcooley_ has quit IRC | 17:02 | |
| jeblair | i'm updating the devstack-precise nodepool images in az1 and the bare-precise in rax-ord to get the new cached git repos | 17:03 |
| *** gyee has joined #openstack-infra | 17:03 | |
| *** rnirmal has quit IRC | 17:05 | |
| *** rnirmal has joined #openstack-infra | 17:05 | |
| *** jcooley_ has joined #openstack-infra | 17:06 | |
| *** markmc has quit IRC | 17:06 | |
| fungi | excellent | 17:07 |
| pleia2 | good morning | 17:07 |
| zaro | morning pleia2 | 17:07 |
| *** syerrapragada1 has joined #openstack-infra | 17:07 | |
| zaro | good morning as weel | 17:08 |
| *** dolphm has joined #openstack-infra | 17:08 | |
| *** krtaylor has quit IRC | 17:09 | |
| *** CaptTofu has quit IRC | 17:10 | |
| *** senk1 has quit IRC | 17:10 | |
| *** CaptTofu has joined #openstack-infra | 17:10 | |
| *** jswarren has joined #openstack-infra | 17:10 | |
| *** syerrapragada has quit IRC | 17:10 | |
| *** jswarren has quit IRC | 17:11 | |
| *** dolphm has quit IRC | 17:11 | |
| *** CaptTofu has quit IRC | 17:12 | |
| *** CaptTofu has joined #openstack-infra | 17:12 | |
| *** jswarren has joined #openstack-infra | 17:12 | |
| *** jamesmcarthur has quit IRC | 17:12 | |
| *** julim has quit IRC | 17:16 | |
| *** julim has joined #openstack-infra | 17:17 | |
| *** dolphm has joined #openstack-infra | 17:19 | |
| *** jamesmcarthur has joined #openstack-infra | 17:21 | |
| jeblair | sdague: https://review.openstack.org/#/c/59294/ aprvd | 17:23 |
| *** reaperhulk has left #openstack-infra | 17:24 | |
| openstackgerrit | A change was merged to openstack-infra/config: move to elastic-recheck web console in share https://review.openstack.org/59294 | 17:25 |
| *** johnthetubaguy has quit IRC | 17:26 | |
| *** pcrews_ has joined #openstack-infra | 17:26 | |
| fungi | okay, so to reduce the manage-projects churn, i'm first going to need to add a --sync-upstream option which does nothing but call sync_upstream() for projects, since that's why we have a cronjob firing manage-projects twice an hour right now | 17:26 |
| *** chandankumar has quit IRC | 17:26 | |
| jeblair | fungi: is 'fix up something that failed during the last run' something that we want the cron to do too? | 17:27 |
| fungi | that's possible | 17:27 |
| mordred | that's what the recent patches were aimed at allowing to happen | 17:27 |
| jeblair | fungi: i thought that may have been some of the reasoning for the cron, but i'm not certain. | 17:27 |
| fungi | if "eventually consistent" is something we're shooting for | 17:27 |
| mordred | it's for both | 17:27 |
| mordred | because github | 17:27 |
| fungi | okay, so maybe just fix the puppet stupidity where it thinks recursively absent content is something to refresh the manage-projects exec for on every run | 17:28 |
| fungi | mordred: do you expect manage-projects to operate sanely if two copies of it run simultaneously? | 17:28 |
| mordred | fungi: hrm. probably not, no | 17:29 |
| fungi | otherwise we may want a locking mechanism so that the cron job and puppet-triggerred runs don't step on one another | 17:29 |
| mordred | it does git branch resetting | 17:29 |
| *** rcleere has quit IRC | 17:32 | |
| *** rcleere has joined #openstack-infra | 17:33 | |
| *** dolphm has quit IRC | 17:34 | |
| *** mancdaz is now known as mancdaz_away | 17:35 | |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack-infra/config: Fix Savanna d-g jobs https://review.openstack.org/60296 | 17:36 |
| *** markwash has quit IRC | 17:38 | |
| *** sarob has quit IRC | 17:39 | |
| *** sarob has joined #openstack-infra | 17:40 | |
| mgagne | fungi: there should already be a lock mechanism for puppet | 17:40 |
| mgagne | fungi: unless you are not referring to puppet itself but something triggered by puppet and a cron | 17:40 |
| mgagne | fungi: nvm, I should read more than 2 lines of backlog | 17:41 |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack-infra/config: Add gate-climate-devstack-dsvm https://review.openstack.org/58702 | 17:41 |
| mordred | mgagne: :) | 17:42 |
| zaro | clarkb: yah! i can finally get into my owa email. | 17:43 |
| *** sarob has quit IRC | 17:44 | |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack-infra/config: Fix Savanna d-g jobs https://review.openstack.org/60296 | 17:46 |
| jeblair | fungi: does launchpad parameter exist in projects.yaml? i have forgotten the status of that move. | 17:47 |
| *** jcooley_ has quit IRC | 17:47 | |
| *** osanchez has quit IRC | 17:47 | |
| *** jcooley_ has joined #openstack-infra | 17:48 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/jeepyb: Update tripleo project name mappings https://review.openstack.org/60278 | 17:48 |
| openstackgerrit | Ruslan Kamaldinov proposed a change to openstack-infra/config: Add #heat to eavesdrop https://review.openstack.org/60298 | 17:48 |
| *** sarob has joined #openstack-infra | 17:49 | |
| *** krtaylor has joined #openstack-infra | 17:50 | |
| fungi | jeblair: good question. doesn't look like any are in there yet, though i believe it's supposed to work | 17:51 |
| *** NikitaKonovalov has joined #openstack-infra | 17:52 | |
| fungi | speaking of projects.yaml and alphabetization, i just noticed we merged at least one more out-of-order entry to it this week | 17:52 |
| *** jcooley_ has quit IRC | 17:52 | |
| fungi | i keep forgetting to check for that | 17:53 |
| jeblair | fungi: i am bad at remembering to check that. :( | 17:53 |
| clarkb | morning | 17:55 |
| pleia2 | humans are bad at that | 17:55 |
| clarkb | zaro: good to know, I will try it on my end too | 17:55 |
| pleia2 | morning clarkb | 17:55 |
| *** jcooley_ has joined #openstack-infra | 17:56 | |
| *** senk has joined #openstack-infra | 17:56 | |
| *** sarob has quit IRC | 17:57 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/jeepyb: Update tripleo project name mappings https://review.openstack.org/60278 | 17:58 |
| *** sarob has joined #openstack-infra | 17:58 | |
| jeblair | most difficult change i've written in quite some time! | 17:58 |
| jeblair | if anyone is looking for somewhat low-hanging-fruit, finishing the move of this info to projects.yaml would be well appreciated! | 17:58 |
| SergeyLukjanov | jeblair, it'll require some freeze for projects.yaml | 17:59 |
| zaro | clarkb: bad part is that we now have to read all those | 17:59 |
| jeblair | SergeyLukjanov: we can do that | 17:59 |
| *** ArxCruz has quit IRC | 17:59 | |
| SergeyLukjanov | what do you think about moving launchpad mappings out of the jeepyb too? | 17:59 |
| SergeyLukjanov | it should be moved to another file | 18:00 |
| jeblair | SergeyLukjanov: yes, i think it should all move to projects.yaml | 18:00 |
| fungi | i believe the way you coded it, we can incrementally add launchpad and direct release mappings for individual projects into projects.yaml if desired, and those will override the ones listed in jeepyb's code | 18:00 |
| SergeyLukjanov | my patch that *should* read settings from projects.yaml was landed, but it should be tested more before using | 18:00 |
| fungi | and then just remove those data structures from the code at the end | 18:01 |
| SergeyLukjanov | fungi, yup | 18:01 |
| *** senk has quit IRC | 18:01 | |
| SergeyLukjanov | fungi, I'm thinking about how to test it to be sure that it'll work ok | 18:01 |
| jeblair | SergeyLukjanov: how about moving -infra proects to projects.yaml ? | 18:01 |
| fungi | we do like to dogfood our own changes before inflicting them on the rest of the project sometimes. sounds like a good idea to me | 18:02 |
| *** nati_ueno has joined #openstack-infra | 18:02 | |
| SergeyLukjanov | good idea, I'll do it tonight | 18:02 |
| *** sarob has quit IRC | 18:02 | |
| sdague | jeblair: so apparently something was not right with that change - http://status.openstack.org/elastic-recheck/ | 18:03 |
| *** rossella_s has quit IRC | 18:03 | |
| *** reed has joined #openstack-infra | 18:03 | |
| sdague | server 500 error | 18:03 |
| jeblair | sdague: yes, i think there's some confusion in the puppet config | 18:03 |
| jeblair | sdague: the elastic_recheck module is not used on static.o.o, because we don't run the irc bot there. | 18:04 |
| *** senk has joined #openstack-infra | 18:04 | |
| openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: Add support for batch_tasks. https://review.openstack.org/57469 | 18:04 |
| sdague | jeblair: ah... oops | 18:04 |
| sdague | wait, how did it make the graphs? | 18:04 |
| sdague | it has to be over there | 18:04 |
| jeblair | sdague: we may want to extend the elastic_recheck module to have elastic_recheck::bot and elastic_recheck::graphs or something | 18:04 |
| jeblair | sdague: we just install the elastic_recheck package from the repo, without the other supporting stuff. | 18:05 |
| jeblair | sdague: (not using the e_r puppet module) | 18:05 |
| sdague | jeblair: right, so that's ok | 18:05 |
| jeblair | sdague: yeah, but it doesn't get /var/lib/elastic_recheck created because that's in the module | 18:06 |
| sdague | ah... oops | 18:06 |
| sdague | ok, I'm going to eat some lunch, then try to fix it | 18:07 |
| jeblair | sdague: ok. i think splitting the module into the bot, dashboard, and common components is the way to go, that way we can have it on different servers as now, or colocate as needed. | 18:07 |
| sdague | yep | 18:07 |
| *** vkozhukalov has joined #openstack-infra | 18:08 | |
| *** jbryce has quit IRC | 18:09 | |
| jeblair | a job is running on an az1 node built from the new image, and it seems to be functioning | 18:10 |
| *** derekh has quit IRC | 18:10 | |
| *** ArxCruz has joined #openstack-infra | 18:11 | |
| *** jerryz has joined #openstack-infra | 18:12 | |
| *** markwash has joined #openstack-infra | 18:12 | |
| fungi | mgagne: weird puppet question... if i have a directory with recurse/replace/purge true and then subscribe an exec to that directory, is it expected that the exec will get a triggered refresh on every puppet agent run even when there are no files actually added/changed/removed in that dir? | 18:12 |
| clarkb | sdague: jeblair: I like that plan | 18:12 |
| *** harlowja has joined #openstack-infra | 18:14 | |
| mgagne | fungi: damn, that's one good question... I'll have to dig for that one. | 18:15 |
| fungi | mgagne: the docs are a little vague on that point, but it seems to be the behavior we're getting | 18:15 |
| mgagne | fungi: is it what you are expecting? | 18:15 |
| fungi | mgagne: we want to run a command when contents of a puppet-managed directory change | 18:16 |
| fungi | mgagne: and not run it when the contents don't change | 18:16 |
| fungi | mgagne: but with recurse/replace/purge true puppet seems to remove all contents, add them back again, and then counts that as a change to trigger refresh on teh exec we subscribed | 18:17 |
| mgagne | fungi: The doc I usually use doesn't convert this use case: http://ai.stanford.edu/~llao/puppet/puppet-trainning.html | 18:17 |
| *** ryanpetrello has quit IRC | 18:17 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Have gerrit-git-prep clone from /opt/git if it exists https://review.openstack.org/60304 | 18:17 |
| *** nicedice has joined #openstack-infra | 18:18 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Have gerrit-git-prep clone from /opt/git if it exists https://review.openstack.org/60304 | 18:18 |
| clarkb | fungi: that is really interesting behavior from purge | 18:18 |
| mgagne | fungi: I have a sandwich and a mouse in the other hand and I'm in a meeting. I'll check asap | 18:19 |
| *** shardy is now known as shardy_afk | 18:19 | |
| fungi | mgagne: there's no rush. i'll keep poking at it, just didn't know whether that was known behavior | 18:19 |
| jeblair | mgagne: i read that as a sandwich and a mousse. | 18:19 |
| jeblair | which sounds like an interesting meeting. | 18:20 |
| mgagne | jeblair: a moose sandwich =) | 18:20 |
| *** yolanda has joined #openstack-infra | 18:22 | |
| *** dizquierdo has quit IRC | 18:23 | |
| fungi | mgagne: nevermind--i missed a critical bit of detail | 18:24 |
| *** Hefeweizen has quit IRC | 18:24 | |
| fungi | seems that i was looking at the one run where it started managing this directory and removed all (well, most) of the unneeded contents, but then it kept re-triggering because without force it will refuse to remove empty directories | 18:25 |
| fungi | so apparently when it tries and fails to remove something, that triggers a refresh on subscribers | 18:25 |
| clarkb | fungi: did I miss an option when I made that change? | 18:25 |
| mgagne | fungi: oh, true https://github.com/puppetlabs/puppet/blob/master/lib/puppet/type/file.rb#L184 | 18:26 |
| fungi | clarkb: i think you have to use force if you want directories removed | 18:26 |
| lifeless | jeblair: I do when they stand out, but I get 80 + gerrit mails a day - I don't read the majority of tem | 18:26 |
| lifeless | jeblair: so thanks for pointing that out | 18:26 |
| clarkb | fungi: which dir is this? the gerrit acl dir? | 18:27 |
| fungi | clarkb: yeah | 18:27 |
| clarkb | I think you are correct, sorry about missing that | 18:27 |
| fungi | clarkb: on every agent run it's trying to remove the heat-api and openstack-ci directories | 18:27 |
| fungi | clarkb: no worries. i think i've done the exact same thing elsewhere | 18:27 |
| fungi | or at least i know i already had to look that behavior up once | 18:27 |
| clarkb | fungi: we should probably add force to the other purges to avoid this problem in the future (though they don't contain dirs iirc) | 18:28 |
| fungi | i'd just never seen its effects where subscribers to the directory were concerned | 18:28 |
| *** sarob has joined #openstack-infra | 18:28 | |
| fungi | clarkb: can do. cahnge inbound in moments | 18:29 |
| fungi | clarkb: seems we were already doing it in modules/asterisk/manifests/function/customdir.pp but nowhere else | 18:32 |
| *** sarob has quit IRC | 18:33 | |
| clarkb | pabelanger and russellb and jeblair know how to puppet | 18:34 |
| *** melwitt has joined #openstack-infra | 18:34 | |
| *** dkranz has quit IRC | 18:35 | |
| russellb | i do? | 18:35 |
| clarkb | russellb: you wrote the asterisk stuff I thought :) | 18:35 |
| russellb | i did | 18:35 |
| russellb | i stumbled my way through it :) | 18:36 |
| *** dkranz has joined #openstack-infra | 18:36 | |
| pabelanger | clarkb: fungi: Yup, that is how I do it today with asterisk, if the content of a folder changes, I notify a server to reload a specific module | 18:36 |
| lifeless | jeblair: I need to start organising (or delegating organisation of) the tripleo midcycle meetup soonish; would like to know what you thought of my question in the infra mid cycle meetup thread | 18:37 |
| fungi | pabelanger: yeah, and if force isn't set and there are cruft subdirectories then that will reload every time the agent run and fails to remove them | 18:37 |
| pabelanger | fungi: where is the code? | 18:38 |
| *** krotscheck has joined #openstack-infra | 18:39 | |
| pabelanger | fungi: so, if I understand you have files in the directory that is not manage by puppet? | 18:39 |
| fungi | pabelanger: yes, and want puppet to remove them | 18:40 |
| jeblair | lifeless: colocating may be a good idea. what i'm struggling with now is the possibility of infra, tripleo, and storyboard meetups all drawing for our attention (along with other similarly timed events) | 18:40 |
| pabelanger | fungi: purge => true, recurse => true | 18:40 |
| fungi | pabelanger: in cases where there may have previously been subdirectories under it managed by puppet which were subsequently deleted from the repository some tim elater | 18:41 |
| pabelanger | And force of course | 18:41 |
| lifeless | jeblair: yeah, thats precisely it | 18:41 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Use force when purging https://review.openstack.org/60313 | 18:42 |
| jeblair | lifeless: at this point, i need to sift through the responses and see what kind of meetup would help achieve our goals. not having one is an option too (there are a few events where some of us will be together, so we can try to put more emphasis on those) | 18:42 |
| fungi | pabelanger: yep, we arrived at that as the solution ^ | 18:42 |
| *** che-arne has quit IRC | 18:42 | |
| sdague | oh, man, we dup the er stuff all over again in static.pp | 18:43 |
| pabelanger | fungi: There is a performance hit from puppets POV with that, just a heads up | 18:44 |
| pabelanger | so, expect puppet to run longer on nodes | 18:44 |
| fungi | pabelanger: i'll keep an eye out for it. thanks! | 18:44 |
| *** sdake has quit IRC | 18:44 | |
| *** sdake has joined #openstack-infra | 18:45 | |
| jeblair | lifeless: i'll try to be more concrete next week. | 18:45 |
| fungi | pabelanger: if it becomes a problem, i guess we can fall back on manually removing empty directories | 18:45 |
| pabelanger | fungi: it's more with recursive directories that puppet knows about. For example, that's why I didn't example it under the asterisk logic | 18:46 |
| pabelanger | I was having puppet issues with load | 18:46 |
| lifeless | jeblair: thanks! | 18:46 |
| pabelanger | but that might have changed with the version we are using now, ever tested it again | 18:46 |
| fungi | pabelanger: force, specifically, was causing higher load? | 18:47 |
| pabelanger | right | 18:47 |
| pabelanger | because it would have to search and compare to know puppet files / directories before deleting | 18:47 |
| pabelanger | IIRC | 18:47 |
| fungi | pabelanger: i would expect purge to be the culprit for that | 18:48 |
| pabelanger | maybe the puppetlabs guys can comment, like I said, it's been a while since I tested that | 18:48 |
| *** dkranz has quit IRC | 18:48 | |
| pabelanger | well, I think if purge is on, and force is off, it won't actually delete a folder | 18:48 |
| pabelanger | and go past the first layer | 18:48 |
| pabelanger | fungi: it was the checksum process | 18:49 |
| pabelanger | that is what it was | 18:49 |
| fungi | it seems to purge file contents successfully within those subdirectories, just leaves the empty directories behind and throws an error about them | 18:49 |
| *** Abhishe__ has joined #openstack-infra | 18:51 | |
| clarkb | is pbr integration testing still a problem? | 18:52 |
| lifeless | I did not get time to look into it | 18:52 |
| lifeless | so I expect so | 18:53 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/config: factor out bot code to elastic_recheck::bot https://review.openstack.org/60318 | 18:54 |
| sdague | jeblair: so I only split out ::bot | 18:54 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Switch rax nodes to performance flavors https://review.openstack.org/60319 | 18:54 |
| sdague | because the er config is a bit too muddled for a cleaner separation. I'll clean some on the er side for that at some point. | 18:55 |
| jeblair | fungi, clarkb: would you please review https://review.openstack.org/#/c/60304/ and https://review.openstack.org/#/c/60319/ ? watching those roll out should keep me occupied for a while | 18:55 |
| jeblair | fungi, clarkb: and i want the g-g-p change to be included in the image rebuilds that will be triggered. | 18:56 |
| fungi | clarkb: yeah, most recent run still fails on glance->oslo.messaging->d2to1 https://jenkins01.openstack.org/job/check-requirements-integration-dsvm/6/consoleText | 18:56 |
| jeblair | hrm, actually, there may not be image rebuilds triggered; i may have to do that manually. | 18:56 |
| jeblair | sdague: ack | 18:56 |
| clarkb | jeblair: sdague: is there any concern putting ssh keys on static.o.o since jenkins can get ot static.o.o? | 18:57 |
| clarkb | oh nevermind releasestatus already does that | 18:58 |
| clarkb | ignore me | 18:58 |
| sdague | clarkb: good question, but I saw other keys, so I didn't even think twice about it | 18:58 |
| jeblair | clarkb, sdague: i was just looking at that, and i don't really like that we're adding keys there that aren't used | 18:58 |
| clarkb | jeblair: I agree | 18:58 |
| *** sarob has joined #openstack-infra | 18:58 | |
| *** yolanda has quit IRC | 18:58 | |
| sdague | yeh, so I think we need to do some er cleanup before that's going to be easy to separate | 18:59 |
| *** Loquacity has quit IRC | 18:59 | |
| sdague | but, my brain is a little foggy atm. Going to go for a walk to reenergize | 18:59 |
| clarkb | jeblair: I just approved the g-g-p change, should I wait on the nodepool config change or is it ok to approve that now too? | 19:00 |
| jeblair | sdague: i don't think it's as bad as you think. i think you can already remove a lot of stuff from the init.pp file that you just moved into bot.pp, including the keys. | 19:00 |
| *** Loquacity has joined #openstack-infra | 19:00 | |
| jeblair | sdague: will leave a comment for when you are reenergized :) | 19:00 |
| clarkb | nodepool config change ahs my +2 | 19:01 |
| fungi | clarkb: i'm taking longer than i should to figure out where the name-filter parameter was introduced into nodepool's parser, but feel free to skip me | 19:01 |
| openstackgerrit | A change was merged to openstack-infra/config: Have gerrit-git-prep clone from /opt/git if it exists https://review.openstack.org/60304 | 19:01 |
| clarkb | fungi: no no, you should do that :) | 19:01 |
| clarkb | mordred wrote the change, recent git log should show it | 19:01 |
| *** dkranz has joined #openstack-infra | 19:02 | |
| jeblair | fungi: and i restarted nodepool yesterday, so running nodepool should support it | 19:02 |
| clarkb | 28a1c41400d40cf9eecdfd102b98b8ffa43052a4 is the commit sha | 19:02 |
| fungi | yup, lgtm | 19:03 |
| *** sarob has quit IRC | 19:03 | |
| fungi | i just didn't remember it because i hadn't reviewed that change | 19:03 |
| fungi | that's what i get for falling behind | 19:03 |
| *** sarob has joined #openstack-infra | 19:03 | |
| jeblair | fungi, clarkb: | performance2-120 | 120 GB Performance | 122880 | 40 | 1200 | | 32 | 10000.0 | N/A | | 19:04 |
| fungi | right on | 19:05 |
| openstackgerrit | A change was merged to openstack-infra/config: Switch rax nodes to performance flavors https://review.openstack.org/60319 | 19:05 |
| clarkb | jeblair: I should move all of the elasticsearch stuff to those flavors :) | 19:05 |
| clarkb | 0.90.3 is holding up well so far, don't think we quite need to update at least not yet | 19:06 |
| jeblair | http://paste.openstack.org/show/54542/ full list for easy reference | 19:06 |
| clarkb | hmm the disk is different, would need to move the data to cinder block volumes | 19:07 |
| clarkb | anyways good to know thanks for pasting that | 19:07 |
| *** sdake_ has joined #openstack-infra | 19:07 | |
| jeblair | clarkb: ssd cinder volumes? :) | 19:07 |
| *** derekh has joined #openstack-infra | 19:08 | |
| *** sarob has quit IRC | 19:08 | |
| *** ^d has quit IRC | 19:08 | |
| *** ^d has joined #openstack-infra | 19:08 | |
| *** NikitaKonovalov has quit IRC | 19:10 | |
| openstackgerrit | lifeless proposed a change to openstack-infra/reviewstats: Add a bug statistics tool. https://review.openstack.org/58903 | 19:13 |
| *** thomasm_ has joined #openstack-infra | 19:13 | |
| *** thomasem has quit IRC | 19:14 | |
| jeblair | BadRequest: Instance type's disk is too small for requested image. (HTTP 400) (Request-ID: req-64298f0b-ccdc-47da-ae83-fae3e6fcb926) | 19:15 |
| jeblair | okay, so, that makes sense. i'll kick off new image builds | 19:15 |
| fungi | right, probably need a separate base image? | 19:15 |
| jog0 | I assume someone is aware http://status.openstack.org/elastic-recheck/ is 500 erroring | 19:15 |
| *** yolanda has joined #openstack-infra | 19:16 | |
| jeblair | jog0: yeah, sdague was working on fixing it, but he stepped out. if you like we can revert the change that broke it | 19:16 |
| lifeless | I wish one could -1 a review comment | 19:16 |
| mgagne | lifeless: is there a reddit plugin for gerrit adding upvote/downvote for comemnts? =) | 19:17 |
| fungi | lifeless: i'm willing to bet you want to -1 one of my comments ;) | 19:17 |
| lifeless | fungi: no | 19:18 |
| lifeless | fungi: thing in solum | 19:18 |
| fungi | ahh | 19:18 |
| lifeless | there is a suggestion that there be data in the DB that isn't exposed in the API | 19:18 |
| lifeless | with the comment | 19:18 |
| lifeless | 'if a platform operator needs this they should read the DB directly. | 19:18 |
| lifeless | Which sends a huge raft of warning signals down my spine | 19:19 |
| lifeless | next we'll be expecting operators to log into machines to manually analyse problems | 19:19 |
| *** jbryce has joined #openstack-infra | 19:19 | |
| clarkb | lifeless: that is what gerrit does :) | 19:19 |
| lifeless | *thats not how scale works* | 19:19 |
| clarkb | and it is painful | 19:20 |
| openstackgerrit | Darragh O'Reilly proposed a change to openstack-infra/os-loganalyze: Provide a script that starts a simple WSGI server https://review.openstack.org/60325 | 19:20 |
| lifeless | yup | 19:20 |
| fungi | we hateses it | 19:20 |
| clarkb | fungi: I am staring at pbr integration test test logs and ugh | 19:20 |
| clarkb | python setup.py sdist works (which makes sense) then we take that sdist and try to install it in a different virtualenv and that fails | 19:20 |
| fungi | clarkb: right. so returning to last night's question, do we fix glance and just bank on wheel uploads to pypi soon? or do we make pypi-mirror deal with tarball urls, or option three none of the above? | 19:21 |
| *** ^d has quit IRC | 19:21 | |
| jog0 | jeblair: yeah that would be helpful. unless sdague finishes lunch soon | 19:21 |
| clarkb | fungi: I am leaning towards deal with tarball urls | 19:22 |
| clarkb | (we should also fix glance, but that doesn't fix the larger problem) | 19:22 |
| fungi | clarkb: an optional --dont-ignore-tarball-urls flag to pypi mirror which we can run with in the integration test and then kiwf asap when wheel uploads arrive? | 19:23 |
| jog0 | jeblair: now that that page is the e-r repo can we in theory make a test to make sure that page at least renders and doesn't return a 500? | 19:23 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Revert "move to elastic-recheck web console in share" https://review.openstack.org/60326 | 19:23 |
| jog0 | jeblair: oh never mind | 19:23 |
| jeblair | jog0: ? | 19:23 |
| jeblair | jog0: oh, i see. | 19:23 |
| jog0 | jeblair: I thought it was a bad e-r patch not a config .. ignore me | 19:23 |
| jeblair | jog0: there's your revert ^ | 19:23 |
| clarkb | fungi: I am not sure why they would be exclusive | 19:23 |
| mtreinish | fungi: hey a quick question, how do I update the meeting ical feed? | 19:24 |
| mtreinish | we're changing the qa meeting time | 19:24 |
| jeblair | mtreinish: ask ttx | 19:24 |
| *** pabelanger has quit IRC | 19:25 | |
| clarkb | fungi: actually wait. This is a symptom of broken dependencies right? do we expect anyone to use tarball links at all anymore? | 19:25 |
| *** derekh has quit IRC | 19:25 | |
| clarkb | I guess we do for oslo | 19:25 |
| mtreinish | jeblair: ok thanks | 19:25 |
| fungi | clarkb: we expect them to until we upload wheels for prereleases to pypi, then we want to remove them with extreme prejudice | 19:25 |
| mtreinish | I guess it's a bit late for ttx right now | 19:25 |
| clarkb | mordred: are you around? want to talk pbr integration testing and wheels and tarballs | 19:25 |
| fungi | mtreinish: yeah, i have no details on that ical feed. i think he may be the only one managing it | 19:26 |
| *** pabelanger has joined #openstack-infra | 19:26 | |
| fungi | clarkb: which is why if we do add tarball url support to pypi-mirror, i'd like to see it removed again (either via revert or by hiding the code path behind a switch) | 19:27 |
| mikal | One last question before I turn on turbo hipster commenting on reviews... | 19:27 |
| clarkb | fungi: gotcha (I remember now that wheels require new pip which won't install alpha releases by default which means we can avoid tarball releases) | 19:27 |
| mikal | We can't expose the logs of runs yet because of security concerns, so instead we're going to zero vote on everything with a comment. Is that ok with people? | 19:27 |
| fungi | clarkb: because i expect it to add complexity (though maybe not--maybe we just turn off the filter which ignores them) | 19:27 |
| *** jerryz has quit IRC | 19:27 | |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack-infra/config: Use launchpad prop to store link to the lp project https://review.openstack.org/60329 | 19:28 |
| fungi | mikal: only if the comment includes instructions for what form they need to mail you for a paper copy of the logs? ;) | 19:28 |
| clarkb | mikal: I would be ok with that if the comment included info on why it isn't a +/-1 | 19:28 |
| *** yolanda has quit IRC | 19:28 | |
| jeblair | mikal: i think publicly accessible logs are a pretty strong requirement; it's basically not actionable information for a developer | 19:28 |
| mikal | Yeah, it will say "test failed" with a log URL. The log URL (for now) redirects to a page explaining our concerns. | 19:28 |
| mikal | And who to contact to get help. | 19:29 |
| mikal | We're working on fixing this, but I don't want to block on it | 19:29 |
| *** jerryz has joined #openstack-infra | 19:29 | |
| clarkb | jeblair: I definitely agree especially with -1s | 19:29 |
| mikal | Yeah, which is why we're going to zero vote for now | 19:29 |
| *** jerryz has quit IRC | 19:29 | |
| mikal | We feel we can't -1 without public logs | 19:29 |
| clarkb | but a 0 is something anyone can do to provide whatever info | 19:29 |
| mikal | Our problem is this is real user data, so we're worried about leaking things in the logs | 19:29 |
| jeblair | mikal: i won't throw a fit if you start doing this experimentally, but i don't think it's tenable in the long run. but it sounds like you know that, so. :) | 19:30 |
| mikal | jeblair: yes, we agree here | 19:30 |
| krtaylor | speaking of public logs, is there any space to copy results up to a log server? | 19:30 |
| clarkb | no | 19:30 |
| mikal | Its about timing... Do we block while we fix the log thing or not? | 19:30 |
| clarkb | :( unless fungi found the fountain of disk the other day | 19:30 |
| *** jerryz has joined #openstack-infra | 19:31 | |
| krtaylor | hehheh | 19:31 |
| fungi | clarkb: no, but i've gotten very, very good with pvmove | 19:31 |
| clarkb | krtaylor: we are limited to 1TB block devices and can only have a total of 10TB | 19:31 |
| *** rpodolyaka1 has joined #openstack-infra | 19:31 | |
| SergeyLukjanov | where is the elastic-recheck bug tracker? | 19:31 |
| SergeyLukjanov | I mean which LP project used for it? | 19:31 |
| mikal | clarkb: until you get to swift... Which I will hassle Josh about. | 19:31 |
| clarkb | SergeyLukjanov: openstack-ci | 19:31 |
| SergeyLukjanov | ok, thx | 19:31 |
| krtaylor | ok, I am also concerned with making our results available vs seeing any results at all, timely that mikal asked | 19:32 |
| jeblair | mikal: yeah, if/when he's ready to work on that, poke him to hop on irc, and we can make a blueprint or etherpad or whatever to make sure he has what he needs | 19:32 |
| fungi | clarkb: as soon as i'm done dissecting this manage-projects traceback/exception, i've got 1tb more to shuffle onto new cinder volumes and then the last of the 0.5tb volumes can be removed (so the server will be using only 1tb volumes at that point) | 19:32 |
| mikal | jeblair: yeah... I was mean and force him to work on TH first though | 19:33 |
| mikal | jeblair: we're in a pretty target rich environment and its hard to get everything done | 19:33 |
| dprince | sdague: any ideas on the grenade failure here: https://review.openstack.org/#/c/53874/ | 19:34 |
| clarkb | fungi: woot | 19:34 |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack-infra/config: Use launchpad prop to store link to the lp project https://review.openstack.org/60329 | 19:34 |
| clarkb | fungi: also http://git.openstack.org/cgit/openstack/requirements/tree/dev-requirements.txt says we can use older oslo.messaging | 19:34 |
| clarkb | fungi: so if we were to try and fix that in glance we would have to fix it in requiremetns first which currently is broken | 19:34 |
| fungi | clarkb: well, that's annoying | 19:35 |
| fungi | i mean, annoying i didn't spot it before, anyway | 19:35 |
| openstackgerrit | Sergey Lukjanov proposed a change to openstack-infra/jeepyb: Remove openstack-infra projects mappings to LP https://review.openstack.org/60332 | 19:35 |
| fungi | clarkb: so if we do have pypi-mirror deal with tarball urls, then that would be the place to have it look for them at any rate | 19:36 |
| clarkb | fungi: right, I think we will have to make pypi-mirror smarter first if we want to do this in a gat efriendly way | 19:36 |
| fungi | so that it would be consistent with what we're enforcing | 19:36 |
| briancline | mriedem: sdague: pong! (by pigeon carrier, sorry) | 19:37 |
| clarkb | I will look at adding that flag to pypi-mirror | 19:37 |
| fungi | briancline: they were just trying to convince you to join the tripleo bare-metal cloud with lots of shiny-fast hardware i think | 19:38 |
| *** yolanda has joined #openstack-infra | 19:39 | |
| *** jpich has quit IRC | 19:40 | |
| *** yolanda has quit IRC | 19:41 | |
| SergeyLukjanov | jeblair, fungi, I've moved mappings to lp of openstack-infra projects to the project.yaml (https://review.openstack.org/#/c/60329/ and https://review.openstack.org/#/c/60332/) | 19:42 |
| briancline | fungi: for openstack CI? | 19:43 |
| fungi | briancline: yep | 19:44 |
| fungi | SergeyLukjanov: awesome! taking a look | 19:44 |
| SergeyLukjanov | I've moved only mappings, the next step is move release options | 19:44 |
| *** jcooley_ has quit IRC | 19:44 | |
| SergeyLukjanov | and other projects :) | 19:44 |
| fungi | SergeyLukjanov: it's a great first step so we can make sure it's working like we expect | 19:45 |
| SergeyLukjanov | fungi, I hope it'll work ;) | 19:45 |
| briancline | fungi: I'll ask about it -- it was something I personally really wanted to do as far back as 14 months ago, but as is usually the case, other stuff came up and it fell off everyone's radar | 19:46 |
| *** jcoufal has joined #openstack-infra | 19:46 | |
| fungi | briancline: i know how it is. if you manage to get it to happen, it'll be quite exciting though! | 19:46 |
| briancline | we did contribute some resources to Swift to do their global clustering testing, so it certainly seems reasonable to me, I just have to push for approval. I'll move it back up the list for sure | 19:47 |
| *** hashar has joined #openstack-infra | 19:48 | |
| fungi | mordred: so i think i found why manage-projects breakage is happening. steps seem to be "first init a repo, then if there's an upstream defined clone it there" (except git will patently refuse to do the latter--directory already exists) | 19:48 |
| fungi | at least that's what the debug output says is happening. i'm starting to follow the source now to confirm | 19:49 |
| briancline | mordred: fungi: sdague: just to get an idea, what quantity and caliber of CI resources are we talking? (can take it offline if needed) | 19:50 |
| fungi | briancline: probably a larger discussion, and possibly better in the context of what the tripleo team is already managing for the first zone/region of the bare-metal cloud | 19:51 |
| fungi | i believe sdague stepped out for a bit, so i don't want to speak for whatever he wanted to discuss though | 19:52 |
| openstackgerrit | A change was merged to openstack-infra/config: Revert "move to elastic-recheck web console in share" https://review.openstack.org/60326 | 19:54 |
| clarkb | fungi: I am starting to grok this problem much better now. Biggest issue is that we are not installing each project to get the actual dependencies. This coupled with not installing any tarball deps to get transitive dependencies means we end up with an incomplete mirror (I think all of this has been said, but it is really clicking in my head now) | 19:55 |
| clarkb | fungi: though, if that is the problem, why did explicitly stating d2to1 is a dependency not help? | 19:55 |
| briancline | fungi: no worries, I'll shoot out an email | 19:55 |
| *** ^demon has joined #openstack-infra | 19:55 | |
| *** ^demon has joined #openstack-infra | 19:55 | |
| *** ^demon is now known as ^d | 19:56 | |
| fungi | clarkb: yep, that's what i was trying (but probably failing) to point out | 19:56 |
| fungi | clarkb: and agreed, not sure why my attempt to add d2to1 to the global reqs didn't "fix" it | 19:56 |
| fungi | which means maybe we're wrong | 19:56 |
| clarkb | unless maybe the mirror is being built with the wrong version of global reqs | 19:57 |
| ttx | mtreinish: if you update the meetings wiki page, I'll get a notification and update the feed | 19:57 |
| fungi | mordred: red herring on the manage-projects thing. if i'm clearing git repos to re-run it, i have to remember to delete the /var/lib/jeepyb repo copies now too | 19:57 |
| *** elasticio has joined #openstack-infra | 19:57 | |
| *** jcooley_ has joined #openstack-infra | 20:01 | |
| clarkb | it uses the requirements repo put in place by devstack-gate so I don't think that hunch is the problem | 20:01 |
| mriedem | briancline: hey, i was also talking with michael fork this morning, so you might want to circle back with him | 20:04 |
| *** jerryz_ has joined #openstack-infra | 20:04 | |
| mtreinish | ttx: ok thanks, I've already updated the wiki | 20:04 |
| *** jerryz has quit IRC | 20:07 | |
| *** melwitt has quit IRC | 20:08 | |
| *** melwitt1 has joined #openstack-infra | 20:08 | |
| clarkb | fungi: I think I see the problem | 20:09 |
| *** adalbas has quit IRC | 20:09 | |
| *** rfolco has quit IRC | 20:09 | |
| fungi | clarkb: i'm on the edge of my seat | 20:10 |
| *** atiwari has joined #openstack-infra | 20:10 | |
| *** dolphm has joined #openstack-infra | 20:10 | |
| *** dstanek_afk has joined #openstack-infra | 20:10 | |
| *** dstanek_afk has quit IRC | 20:10 | |
| clarkb | fungi: getting a link together | 20:11 |
| clarkb | fungi: http://git.openstack.org/cgit/openstack-infra/pypi-mirror/tree/pypi_mirror/cmd/run_mirror.py#n214 branch processing there coupled with http://git.openstack.org/cgit/openstack-dev/pbr/tree/tools/integration.sh#n116 means we are not testing using the version of the repo put in place by devstack-gate | 20:13 |
| sdague | briancline: back now. | 20:13 |
| clarkb | fungi: which is fail sauce | 20:13 |
| clarkb | fungi: and I think is going to take some unravelling to fix. I am starving though, going to grab some food then tackle that | 20:13 |
| fungi | oh, that's... okay | 20:13 |
| clarkb | fungi: ya | 20:13 |
| *** jerryz has joined #openstack-infra | 20:13 | |
| fungi | right | 20:13 |
| sdague | so, honestly, a starting point would probably be an account with some small quota on it for us to play around. Because current CI is all openstack clouds, so we'd have to write some automation against softlayer to make it fit our model | 20:14 |
| *** sarob has joined #openstack-infra | 20:14 | |
| *** ^d is now known as ^demon|lunch | 20:14 | |
| clarkb | current idea in my head is maybe add and argument to run-mirror that just runs in the cwd rather than doing branch manipulation | 20:14 |
| sdague | dprince: I was talking that through with maurosr this morning on -qa | 20:14 |
| clarkb | fungi: but I am open to other ideas | 20:14 |
| sdague | I think there is a complicated lock step we have to do, he's off working on the order. | 20:15 |
| fungi | clarkb: i'll need to ponder that | 20:15 |
| sdague | there was some confusion about how zuul did refs and why we have to do things a certain way | 20:15 |
| fungi | clarkb: but sounds like an acceptable alternative | 20:15 |
| *** denis_makogon has joined #openstack-infra | 20:16 | |
| *** julim has quit IRC | 20:16 | |
| dprince | sdague: okay. well hopefully that is progress. I looked over the logs myself and wasn't quite sure why it wasn't working | 20:16 |
| *** jerryz_ has quit IRC | 20:17 | |
| jeblair | clarkb, fungi on line 225 of run-mirror, there is 'if not self.args.no_update:' | 20:19 |
| jeblair | clarkb, fungi: once i unravel the double negative, i wonder if that would help us... | 20:19 |
| *** sarob has quit IRC | 20:19 | |
| fungi | ha | 20:19 |
| *** gyee has quit IRC | 20:19 | |
| jeblair | fungi: so maybe add '--no-update' to http://git.openstack.org/cgit/openstack-dev/pbr/tree/tools/integration.sh#n116 ? | 20:20 |
| jeblair | performance run of postgres-full in progress at: https://jenkins02.openstack.org/job/check-tempest-dsvm-postgres-full/799/ | 20:22 |
| *** adalbas has joined #openstack-infra | 20:23 | |
| fungi | okay, finally all cleaned up from the manage-projects freakout. repositories on review, zuul and all the git servers appear operable | 20:24 |
| *** senk has quit IRC | 20:25 | |
| *** senk has joined #openstack-infra | 20:25 | |
| *** Abhishe__ has quit IRC | 20:25 | |
| sdague | dprince: yeh, I haven't had time to dive into it. Honestly we need to get a few more folks that grok the upgrade pieces. It's a pretty skeleton crew of us on it right now | 20:27 |
| briancline | mriedem: awesome, will do | 20:33 |
| *** jcooley_ has quit IRC | 20:35 | |
| fungi | clarkb: right, so that script was originally intended to get a requirements list from a branch of a project (or iterating through all branches) and update a mirror... trying to run it to gate a change to the list of requirements means that we need to stop retrieving that separately from git and use the one which gets set up for the test instead | 20:36 |
| ArxCruz | ALL: When I ran tox -efull I'm getting this error on tempest: http://paste.openstack.org/show/54546/ does anyone know what's wrong? there's a lot of \xfd\x12\xc4\xe0\xb3)\x01@i@^t code there | 20:36 |
| fungi | ArxCruz: it looks like discover might be breaking | 20:38 |
| *** jcooley_ has joined #openstack-infra | 20:41 | |
| fungi | clarkb: and looking closer, i think i agree with jeblair that --no-update seems to skip resetting to the branch | 20:41 |
| *** dprince has quit IRC | 20:41 | |
| clarkb | will look after food | 20:41 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Switch some infra jobs to use bare precise nodes https://review.openstack.org/60344 | 20:44 |
| ArxCruz | fungi: just pip install discover ? I already did it and the error remains :( | 20:44 |
| SpamapS | clarkb: https://review.openstack.org/#/c/60100/ .. I don't really know what to do to move this forward. recheck no bug? Investigate d2to1? | 20:46 |
| openstackgerrit | A change was merged to openstack-infra/reviewstats: Add a bug statistics tool. https://review.openstack.org/58903 | 20:48 |
| *** adalbas has quit IRC | 20:49 | |
| *** hashar has quit IRC | 20:49 | |
| *** senk has quit IRC | 20:50 | |
| *** ywu has joined #openstack-infra | 20:50 | |
| jeblair | fungi, clarkb, mordred, sdague: https://jenkins02.openstack.org/job/check-tempest-dsvm-postgres-full/799/ took 35 minutes on a rackspace performance node (quick look at history suggest that job takes ~40mins on hpcloud and ~50 on rax standard +/- 5 mins) | 20:54 |
| *** ^demon|lunch is now known as ^d | 20:55 | |
| fungi | ArxCruz: i'm thinking testr.run discover might be throwing an exception or something. just a guess but seems like that's exhibited similar behavior in the past | 20:56 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Switch some infra jobs to use bare precise nodes https://review.openstack.org/60344 | 20:56 |
| *** julim has joined #openstack-infra | 20:56 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/devstack-gate: Use the ephemeral disk on rackspace performance nodes https://review.openstack.org/60347 | 20:57 |
| *** Abhishek_ has joined #openstack-infra | 20:57 | |
| *** rpodolyaka1 has left #openstack-infra | 20:58 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/devstack-gate: Use the ephemeral disk on rackspace performance nodes https://review.openstack.org/60347 | 20:59 |
| *** jcooley_ has quit IRC | 20:59 | |
| *** datsun180b has quit IRC | 21:01 | |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: Setup builds for openstack Gerrit ver 2.8 https://review.openstack.org/60348 | 21:03 |
| jeblair | clarkb, fungi: also, bare-precise nodes seem to be able to run nova-pep8: https://jenkins01.openstack.org/job/dev-nova-pep8/4/console | 21:03 |
| *** melwitt1 is now known as melwitt | 21:03 | |
| clarkb | jeblair: woot | 21:04 |
| clarkb | SpamapS: I am working on it now. Found at least one problem with the test that may have allowed the breakage through | 21:04 |
| clarkb | SpamapS: going to correct that then force d2to1 in I think | 21:05 |
| SpamapS | clarkb: oh cool thanks. Let me know if there is anything I can do. | 21:05 |
| * SpamapS breaking stuff as usual | 21:05 | |
| *** lcestari has quit IRC | 21:07 | |
| *** dkranz has quit IRC | 21:08 | |
| *** senk has joined #openstack-infra | 21:08 | |
| *** krtaylor has quit IRC | 21:11 | |
| *** alcabrera has quit IRC | 21:11 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-dev/pbr: Build mirror using proper requirements. https://review.openstack.org/60349 | 21:12 |
| openstackgerrit | Clark Boylan proposed a change to openstack-dev/pbr: Force d2to1 into the integration test mirror. https://review.openstack.org/60350 | 21:12 |
| clarkb | I think the order on that is wrong, but I wanted to see what happens when d2to1 isn't forced into the mirror. I will rebase and flip the order if the test for 60349 fails | 21:12 |
| *** senk has quit IRC | 21:13 | |
| *** senk has joined #openstack-infra | 21:13 | |
| jeblair | clarkb: one of those is running on a rax performance node. considering the run time is _so long_ i'm interested in the results there.. :) | 21:14 |
| *** hennystupbebe has joined #openstack-infra | 21:14 | |
| jeblair | clarkb: oh, which suggests to me: i think you should write two more copies of those changes (with new change ids) in the other order and go ahead and push them up | 21:14 |
| clarkb | jeblair: will do | 21:15 |
| jeblair | clarkb: that way, both alternatives will be tested in approx 1 hour (instead of 2) and you can abandon whichever you don't like. | 21:15 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: Setup builds for openstack Gerrit ver 2.8 https://review.openstack.org/60348 | 21:15 |
| openstackgerrit | Clark Boylan proposed a change to openstack-dev/pbr: Force d2to1 into the integration test mirror. https://review.openstack.org/60351 | 21:15 |
| openstackgerrit | Clark Boylan proposed a change to openstack-dev/pbr: Build mirror using proper requirements. https://review.openstack.org/60352 | 21:15 |
| clarkb | jeblair: ^ there we go | 21:16 |
| *** hennystupbebe has quit IRC | 21:16 | |
| *** FallenPegasus has joined #openstack-infra | 21:16 | |
| clarkb | SpamapS: ^ should get d2to1 sorted | 21:17 |
| *** smarcet has left #openstack-infra | 21:17 | |
| jeblair | clarkb: want to do one with both changes squashed? | 21:17 |
| clarkb | jeblair: sure | 21:18 |
| *** FallenPegasus has quit IRC | 21:18 | |
| *** FallenPegasus has joined #openstack-infra | 21:19 | |
| *** dkranz has joined #openstack-infra | 21:19 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-dev/pbr: Build mirror using proper requirements. https://review.openstack.org/60354 | 21:20 |
| clarkb | and squashed ^ | 21:20 |
| *** dolphm has quit IRC | 21:22 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/zuul: Remove unecessary debug message https://review.openstack.org/60355 | 21:22 |
| *** gyee has joined #openstack-infra | 21:23 | |
| notmyname | jeblair: clarkb: I need to tag swift-bench so it goes through the -infra process to get pushed to pypi. This is the first time this repo has been "released". Anything to watch out for? | 21:28 |
| jeblair | notmyname: let's double check that openstackci has perms on pypi and the jobs are setup in zuul | 21:29 |
| clarkb | notmyname: make sure you have tagged the correct commit before pushing it. And make sure that commit is upstream (so no accidental local commits getting tagged_ | 21:29 |
| notmyname | clarkb: of course :-) that's no different than normal releases | 21:29 |
| jeblair | notmyname: swift-bench lacks the necessary jenkins jobs for this to happen | 21:30 |
| notmyname | jeblair: ok, what needs to be done from my side? | 21:30 |
| jeblair | notmyname: pypi looks good though | 21:30 |
| jeblair | notmyname: i'll hack out a change real quick | 21:30 |
| *** fifieldt has joined #openstack-infra | 21:32 | |
| jeblair | notmyname: does swift-bench have sphinx docs? | 21:32 |
| notmyname | jeblair: no it does not, right now | 21:33 |
| *** FallenPegasus has quit IRC | 21:33 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Run swift-bench build/release jobs https://review.openstack.org/60356 | 21:34 |
| *** pabelanger has quit IRC | 21:34 | |
| jeblair | notmyname: the acls in gerrit also look good, so the only thing lacking should be that ^ | 21:34 |
| *** dkranz has quit IRC | 21:35 | |
| * clarkb reviews | 21:35 | |
| notmyname | thanks | 21:35 |
| jeblair | ack; i see an error | 21:35 |
| clarkb | hmm did I miss it? | 21:35 |
| clarkb | shame on me | 21:35 |
| jeblair | (which i think the test will catch) | 21:35 |
| sdague | jeblair: awesome | 21:35 |
| clarkb | do you need to include another set of templates? | 21:36 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Run swift-bench build/release jobs https://review.openstack.org/60356 | 21:36 |
| clarkb | nevermind I see it now | 21:36 |
| sdague | jeblair: so can we flip our rax quota to performance nodes? | 21:36 |
| clarkb | python-swift-bench | 21:36 |
| clarkb | sdague: I think we have | 21:36 |
| lifeless | question: I have two new projects to make; is it better to wait for a git tree to be ready, or can we push one up once it's there? | 21:36 |
| clarkb | sdague: what we need to do is let rax run gate jobs | 21:36 |
| jeblair | sdague, clarkb: indeed we have; i expect most of the standard nodes will have aged out now | 21:36 |
| clarkb | lifeless: if you can push one up via review then now is fine. If you don't want to bootstrap in gerrit I would wait | 21:37 |
| jeblair | sdague, clarkb: i think we want to get the use-ephemeral-disk change merged first; we're running with no swap right now. | 21:37 |
| *** yamahata_ has joined #openstack-infra | 21:37 | |
| clarkb | jeblair: that should be fine | 21:38 |
| *** jswarren has quit IRC | 21:38 | |
| clarkb | hpcloud doesn't give us swap but d-g sorts it out right? | 21:38 |
| jeblair | clarkb: yes, but only on hpcloud -- the change is to d-g to also do that on rax | 21:38 |
| jeblair | clarkb: cause they have different disk names :( | 21:38 |
| * clarkb looks | 21:38 | |
| jeblair | clarkb: https://review.openstack.org/#/c/60347/ (it's testing) | 21:39 |
| clarkb | jeblair: I think there is a tyop | 21:39 |
| lifeless | clarkb: it's the split out from nova of scheduler | 21:40 |
| *** sdake has quit IRC | 21:40 | |
| lifeless | clarkb: so we're looking at filter-tree stuff | 21:40 |
| clarkb | lifeless: I would wait then | 21:40 |
| openstackgerrit | A change was merged to openstack-infra/config: Run swift-bench build/release jobs https://review.openstack.org/60356 | 21:40 |
| lifeless | clarkb: for the api; probably a new tree for the client, as there is just marshalling code for that | 21:40 |
| clarkb | otherwise one of us needs to force push the contents into the project | 21:40 |
| *** sdake has joined #openstack-infra | 21:40 | |
| *** miqui has quit IRC | 21:40 | |
| *** sdake has quit IRC | 21:40 | |
| *** sdake has joined #openstack-infra | 21:40 | |
| clarkb | and really there is little value if having an empty project then doing a force push | 21:40 |
| notmyname | jeblair: is the post-mirror-python33 right? we don't support py33 at all | 21:42 |
| jeblair | notmyname: since other things may be updated i think it's good to update all the mirrors | 21:43 |
| fungi | notmyname: doesn't matter. just kicks off another run of the python33 mirror job in case you did, and in case you pulled in different dependencies on py33 than another python rev | 21:43 |
| jeblair | lifeless: let me know if you want me to do the filter-branch | 21:44 |
| lifeless | jeblair: there is a nova volunteer to do it, may I point them at you for advice? | 21:44 |
| lifeless | jeblair: your advice could be 'let me do it' :) | 21:44 |
| jeblair | lifeless: sure :) | 21:44 |
| lifeless | thanks! | 21:44 |
| *** dkranz has joined #openstack-infra | 21:47 | |
| sdague | jeblair: https://review.openstack.org/#/c/60318/ can yuo look back in there | 21:50 |
| sdague | while the vars aren't used directly, they are passed to the template | 21:50 |
| clarkb | jeblair: did you see my comment on https://review.openstack.org/#/c/60347/ | 21:51 |
| clarkb | sdague: we can check in the template if vars are defined before using them | 21:51 |
| notmyname | jeblair: thanks. does that mean it's ready to tag now? | 21:51 |
| clarkb | and only dump data in there if the data is available | 21:51 |
| jeblair | sdague: i reverted the config change, you may want to rebase that on an un-revert | 21:52 |
| clarkb | notmyname: I would wait until top of the hour (to make sure puppet applies that on zuul first) | 21:52 |
| sdague | jeblair: will do | 21:52 |
| *** gyee has quit IRC | 21:52 | |
| notmyname | clarkb: ok. I wanted to push one more commit anyway. thanks | 21:52 |
| jeblair | notmyname: looks like the config is in place, so you should be good to go, but let's use that extra commit you want to push to make sure it's building tarballs correctly | 21:53 |
| notmyname | jeblair: thanks | 21:53 |
| jeblair | notmyname: after it merges, you should see a swift-bench dir at http://tarballs.openstack.org/ | 21:54 |
| jeblair | notmyname: if not: problem. | 21:54 |
| notmyname | jeblair: thanks. I'll check when it lands | 21:54 |
| *** gyee has joined #openstack-infra | 21:55 | |
| *** pabelanger has joined #openstack-infra | 21:56 | |
| openstackgerrit | Pranesh Pandurangan proposed a change to openstack-infra/config: Fixed typo in zuul layout file https://review.openstack.org/60363 | 21:56 |
| *** atiwari has quit IRC | 21:56 | |
| *** mfer has quit IRC | 21:56 | |
| openstackgerrit | Pranesh Pandurangan proposed a change to openstack-infra/config: Fix more typos in zuul layout file https://review.openstack.org/60365 | 21:57 |
| *** SergeyLukjanov has quit IRC | 21:58 | |
| *** SergeyLukjanov has joined #openstack-infra | 21:59 | |
| fungi | i'm starting to think that experience contributing to existing openstack or stackforge projects should be a prerequisite for adding a project to stackforge | 22:01 |
| fungi | "adding your project to stackforge" should pretty much never be your first experience pushing a change to gerrit | 22:01 |
| clarkb | ++ | 22:01 |
| sdague | jeblair: did that revert go through? | 22:01 |
| jeblair | sdague: yes | 22:01 |
| clarkb | but being inclusive is a good thing too | 22:01 |
| sdague | ok, git rebase is getting all weird on me | 22:02 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/devstack-gate: Use the ephemeral disk on rackspace performance nodes https://review.openstack.org/60347 | 22:02 |
| openstackgerrit | Pranesh Pandurangan proposed a change to openstack-infra/config: Added new project, entropy https://review.openstack.org/60132 | 22:03 |
| *** melwitt has quit IRC | 22:04 | |
| *** melwitt1 has joined #openstack-infra | 22:04 | |
| *** melwitt has joined #openstack-infra | 22:05 | |
| *** melwitt1 has quit IRC | 22:05 | |
| *** jamesmcarthur has quit IRC | 22:05 | |
| fungi | sdague: in what ways? is it finding repeated patterns and merging in the wrong places? | 22:06 |
| fungi | fwiw i've had gnu patch do the same to me in the past | 22:07 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/zuul: Document zuul client https://review.openstack.org/60366 | 22:07 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/config: move to elastic-recheck web console in share https://review.openstack.org/60318 | 22:07 |
| sdague | fungi: I think I got it | 22:07 |
| sdague | I had to trigger another revert | 22:07 |
| *** DennyZhang has joined #openstack-infra | 22:10 | |
| jeblair | sdague: i'm still not excited by all the extra stuff ending up on static.o.o.. i'm confused about why the base class needs to write the config file? | 22:10 |
| *** denis_makogon has quit IRC | 22:10 | |
| jeblair | sdague: why not have the bot class write that? | 22:10 |
| jeblair | sdague: it doesn't look like we have a config file on static now | 22:10 |
| *** denis_makogon has joined #openstack-infra | 22:10 | |
| clarkb | looks like forcing d2to1 in is going to be required | 22:10 |
| clarkb | since that is the case, I almost prefer the squashed commit | 22:11 |
| *** jcooley_ has joined #openstack-infra | 22:12 | |
| jeblair | clarkb: (looks like the two changes in that pair took ~same amount of time on a rax performance and hpcloud node) | 22:13 |
| notmyname | jeblair: how long should it take for swift-bench to show up in tarballs? | 22:13 |
| openstackgerrit | A change was merged to openstack-infra/jeepyb: Update tripleo project name mappings https://review.openstack.org/60278 | 22:13 |
| sdague | jeblair: ah, true, I'll flip that | 22:14 |
| jeblair | notmyname: like a minute. it's there now: http://tarballs.openstack.org/swift-bench/ | 22:14 |
| *** jbryce has quit IRC | 22:14 | |
| notmyname | jeblair: great! | 22:14 |
| notmyname | jeblair: so that means' everything is good, right? | 22:14 |
| openstackgerrit | Pranesh Pandurangan proposed a change to openstack-infra/config: Added new project, entropy https://review.openstack.org/60132 | 22:15 |
| jeblair | notmyname: i think so. i'd say go for it! | 22:15 |
| notmyname | jeblair: great. thanks for your help (and clarkb) :-) | 22:15 |
| jeblair | notmyname: np | 22:16 |
| *** ruhe has quit IRC | 22:17 | |
| *** jcoufal has quit IRC | 22:17 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/config: move to elastic-recheck web console in share https://review.openstack.org/60318 | 22:18 |
| *** jgrimm has quit IRC | 22:18 | |
| sdague | ok, the only question I have in there is the include in ::bot | 22:18 |
| sdague | so see if I got that right | 22:18 |
| openstackgerrit | A change was merged to openstack-infra/zuul: Document zuul client https://review.openstack.org/60366 | 22:18 |
| clarkb | fungi: jeblair: btw after reading a bunch of run_mirror.py I think we should try limping along until wheels happen. Doing special fancy stuff for tarballs will be a pain since ideally we don't put the tarballs on the mirror instead we just have their dependencies in the mirror | 22:20 |
| sdague | clarkb: when you get a chance, can you swing back around and see if I answered you here correctly - https://review.openstack.org/#/c/59822/ (it didn't trigger a reset on your -1 so you might not see it) | 22:21 |
| clarkb | sdague: looking | 22:22 |
| fungi | clarkb: right, one of the basic assumptions in that integration job is that our projects don't depend explicitly on more than one version of our other projects at a time, and declaring one thing with a requirements spec while actually using a different version via a tarball link breaks that very badly | 22:22 |
| notmyname | jeblair: ok, I've tagged and pushed the tag (signed of course) to gerrit | 22:23 |
| *** elasticio has quit IRC | 22:23 | |
| jeblair | notmyname: you can see progress here http://status.openstack.org/zuul/ | 22:23 |
| notmyname | thanks | 22:23 |
| notmyname | it takes an hour to push to a mirror? | 22:23 |
| clarkb | sdague: for __getattr__ isn't hit an instanec of Hit? if so you can just add __getitem__ to the Hit class | 22:24 |
| jeblair | notmyname: https://pypi.python.org/pypi/swift-bench/1.0 looks like a thing | 22:24 |
| fungi | clarkb: i'd be in favor of force-merging an openstack/requirements change for dev-requirements.txt to up the oslo.messaging tarball rev, then follow with updates to the requirements files of affected projects | 22:24 |
| sdague | clarkb: I suppose I could, I just wasn't treating hit like a dictionary :) | 22:24 |
| clarkb | sdague: for _hits, _hits is literally used nowhere else and is private. I don't see what it gives us | 22:24 |
| sdague | clarkb: it's used in the face_discover | 22:25 |
| fungi | notmyname: it doesn't take an hour to push it to the mirror, it takes an hour to regenerate, satisfy and download all dependencies throughout our project requirements and then update the mirror with the results | 22:25 |
| notmyname | ok :-) | 22:25 |
| jeblair | notmyname: that ^, but why 27 is 1 hour and 26 and 33 are 15 minutes is a good question... | 22:25 |
| clarkb | sdague: can you link to that? I don't see it | 22:25 |
| sdague | oh actually, sorry you are right | 22:26 |
| jeblair | or at least 2.6 vs 2.7... seems strange to me. | 22:26 |
| sdague | I went around on this a few iterations | 22:26 |
| sdague | and confused myself | 22:26 |
| fungi | jeblair: my guess is that 2.7 is working and 2.6 and 3.3 are spontaneously breaking but maybe not returning a nonzero result | 22:26 |
| fungi | (and so bailing early) | 22:26 |
| clarkb | sdague: both changes would be cleanup and the __getattr__ vs __getiem__ doesn't really bother me. Was just a thought | 22:26 |
| jeblair | fungi: of course! :) | 22:26 |
| clarkb | sdague: _hits concerned me more because it appeared to be dead code | 22:26 |
| sdague | yep, you are right | 22:27 |
| *** DennyZhang has quit IRC | 22:27 | |
| fungi | i'm looking to see if my theory on mirror26 failures holds any merit | 22:27 |
| fungi | the recent job history at https://review.openstack.org/#/c/60132/2 suggests it does actually return nonzero (most of the time) | 22:28 |
| fungi | er, wrong paste buffer | 22:28 |
| fungi | https://jenkins.openstack.org/job/post-mirror-python26/ | 22:28 |
| fungi | actually, 2.6 seems to be consistently failing, 2.7 and 3.3 seem to be consistently passing | 22:29 |
| *** thomasm_ has quit IRC | 22:29 | |
| fungi | nope, the consistent failures for 2.6 appear to be 50-minute job timeouts | 22:30 |
| fungi | er, 60-minute | 22:30 |
| clarkb | jeblair: fungi: I have abandoned the two pbr changes that are in the wrong order, that leaves us with the two changes in the proper order or the squashed change | 22:30 |
| fungi | cool | 22:30 |
| *** sarob has joined #openstack-infra | 22:31 | |
| *** changbl has quit IRC | 22:32 | |
| klrmn | lifeless / clarkb: is there a way to get testr / subunit to collect and report the stdout and/or do something with —verbose? | 22:34 |
| clarkb | klrmn: I think lifeless left acomment showing you how to do it | 22:35 |
| jeblair | sdague: i'm not positive about that include. i would think it should work, but clarkb did something else in the etherpad-lite module (expecting you to include etherpad_lite and include etherpad_line::foo | 22:35 |
| openstackgerrit | A change was merged to openstack-infra/config: gerritbot: Watch stable/havana on puppet-openstack projects https://review.openstack.org/60127 | 22:35 |
| clarkb | klrmn: testr run --subunit | $SUBUNITPARSER one parser that comes with subunit is subunit2pyunit so you can do testr run --subunit | subunit2pyunit | 22:35 |
| jeblair | sdague: if no one has a definite answer on that, i'm okay trying it and fixing it if needed. | 22:36 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: implementation of FacetSet for client side nested facets https://review.openstack.org/59822 | 22:36 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: port check_success to facets https://review.openstack.org/59832 | 22:36 |
| clarkb | klrmn: is the desire just to have every test listed as it runs? | 22:36 |
| klrmn | clarkb: i have my resources telling me how long they take to set things up outputting to stdout | 22:36 |
| sdague | clarkb: ok, I fixed both of your comments. | 22:37 |
| klrmn | clarkb: but it would be really nice to know that something is actually happening | 22:37 |
| lifeless | klrmn: hi | 22:37 |
| *** SergeyLukjanov has quit IRC | 22:37 | |
| clarkb | klrmn: do you want to see that data realtime or just look at it post run? (I really don't know why so many people want to watch data spew all over their terminals :P) | 22:37 |
| lifeless | klrmn: testr only processes things that are encapsulated in subunit; other content is passed through | 22:38 |
| *** mriedem has quit IRC | 22:38 | |
| *** SergeyLukjanov has joined #openstack-infra | 22:38 | |
| *** rnirmal has quit IRC | 22:38 | |
| lifeless | klrmn: it's up to the runner to do the encapsulation (thats what subunit.run does, for python unittests, for instance) | 22:38 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/config: move to elastic-recheck web console in share https://review.openstack.org/60318 | 22:38 |
| *** adalbas has joined #openstack-infra | 22:39 | |
| sdague | jeblair: ok, purged that last left over bit in static.pp | 22:39 |
| klrmn | clarkb: when you have a test suite that takes hours to run, it's better to know that it got hung up an hour in than it is to wake up in the morning and discover it's still spinnging | 22:39 |
| klrmn | spinning even | 22:39 |
| clarkb | klrmn: test timeouts combat that problem | 22:40 |
| jeblair | clarkb: i wish timeouts worked for zuul | 22:41 |
| clarkb | jeblair: I think we can make them work by making threads daemon threads or by using the forceful timeout | 22:42 |
| clarkb | iirc zuul's test suite has non daemon threads so one of them dying doesn't kill everything else | 22:42 |
| klrmn | lifeless: i seem to be kinda slow at figuring out how to swap out the various parts of things | 22:42 |
| *** SergeyLukjanov has quit IRC | 22:42 | |
| openstackgerrit | A change was merged to openstack-infra/config: Fix Savanna d-g jobs https://review.openstack.org/60296 | 22:43 |
| lifeless | klrmn: No, I suspect you're working in a corner that isn't super well serviced today | 22:44 |
| lifeless | klrmn: what do you want to see, ideally? | 22:44 |
| *** adalbas has quit IRC | 22:44 | |
| klrmn | lifeless: it should be noted that most of my tests use selenium and a UI, which introduces a *lot* of variable latency | 22:45 |
| lifeless | klrmn: are you collaborating with tim ansell's subunit runner for selenium ? | 22:45 |
| *** yamahata_ has quit IRC | 22:45 | |
| klrmn | lifeless: i'm looking at needing to profile my tests to figure out what the hell is taking so long | 22:45 |
| klrmn | lifeless: i had no idea that even existed, and also have no idea how difficult it would be to retrofit it into my project | 22:46 |
| klrmn | lifeless: google didn't bring me anything in searching for 'python selenium subunit | 22:47 |
| lifeless | https://github.com/mithro/runner-testharness.js | 22:48 |
| *** openstackgerrit has quit IRC | 22:48 | |
| *** openstackgerrit has joined #openstack-infra | 22:48 | |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: implementation of FacetSet for client side nested facets https://review.openstack.org/59822 | 22:49 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/elastic-recheck: port check_success to facets https://review.openstack.org/59832 | 22:49 |
| klrmn | lifeless: i think i have sub-classed enough to use the TestLoader from testresources with SubUnitTestProgram (but if there's an example out there i should look at or use instead, this'd be a great time) | 22:49 |
| clarkb | jeblair: fungi: the pbr tools/integration.sh test fixes have all reported their check results back. The squash commit failed in the postgres test due to known bugs. The other two passed. I think we should pick one set and approve them | 22:49 |
| fungi | clarkb: do you have a preference for one? | 22:50 |
| klrmn | lifeless: it is unclear if i should be using SubunitTestRunner or some other library's TestRunner | 22:50 |
| notmyname | I like the graph at the top of http://status.openstack.org/elastic-recheck/ | 22:50 |
| lifeless | klrmn: are your tests python code or js code? | 22:50 |
| klrmn | lifeless: python | 22:50 |
| jeblair | notmyname: jog0 did that ^ | 22:50 |
| lifeless | klrmn: then subunit.run should be fine | 22:51 |
| clarkb | fungi: slight preference for the squash as chances it hits more non deterministic failures are lower, but the two commits are more easiliy git bisectable | 22:51 |
| jeblair | clarkb: i also lean toward playing the odds and going with squash | 22:51 |
| clarkb | jeblair: wfm | 22:51 |
| fungi | i'm not too concerned about being able to bisect between those two adjacent changes, really | 22:51 |
| notmyname | jog0: nice work. what about summing them together (in some fancy baysean statistics way) to give an overall patch failure rate? | 22:52 |
| clarkb | notmyname: note for the summing that half of them are check and the other half gate. Don't want to add those two sets together | 22:52 |
| klrmn | lifeless: is there a way to use subunit.run with testresources.OptimisingTestSuite | 22:53 |
| klrmn | without subclassing SubunitTestProgram to replace the Loader sent to ._do_discovery? | 22:53 |
| lifeless | klrmn: yes, the load_tests hook | 22:54 |
| lifeless | but http://bugs.python.org/issue16662 will interact with the obvious approach for that | 22:55 |
| *** senk has quit IRC | 22:55 | |
| klrmn | lifeless: there are hooks? in which project? where is the documentation? | 22:56 |
| lifeless | klrmn: upstream python | 22:56 |
| fungi | clarkb: reviewed and approved 60354 (hopefully that was the right one) | 22:56 |
| *** adalbas has joined #openstack-infra | 22:56 | |
| fungi | clarkb: seemed to be the combination of the other two at any rate | 22:56 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/config: move to elastic-recheck web console in share https://review.openstack.org/60318 | 22:57 |
| clarkb | fungi: that was the one, thanks | 22:57 |
| *** sarob has quit IRC | 22:57 | |
| *** sarob has joined #openstack-infra | 22:58 | |
| *** sandy__ has quit IRC | 22:59 | |
| *** sarob_ has joined #openstack-infra | 23:01 | |
| *** sarob has quit IRC | 23:01 | |
| *** nati_uen_ has joined #openstack-infra | 23:04 | |
| clarkb | sdague: https://review.openstack.org/#/c/60149/ didn't that break everything right around havana feature freeze? | 23:06 |
| clarkb | anteaya: ^ | 23:06 |
| *** nati_ueno has quit IRC | 23:07 | |
| sdague | clarkb: yes... but just because it added more load to the neutron q / db system | 23:07 |
| *** rcleere has quit IRC | 23:07 | |
| sdague | so it all deadlocked | 23:07 |
| *** oubiwann_ has quit IRC | 23:07 | |
| openstackgerrit | Elizabeth Krumbach Joseph proposed a change to openstack-infra/config: Configure pretty formatting for README files https://review.openstack.org/60375 | 23:08 |
| clarkb | sdague: should we avoid enabling it on stable/havana then? | 23:08 |
| sdague | clarkb: oh, yes, for sure | 23:08 |
| clarkb | I am semi ok with dealing with pain on master | 23:08 |
| sdague | but that's a master change | 23:08 |
| * clarkb leaves a comment | 23:08 | |
| clarkb | sdague: it is both | 23:09 |
| sdague | oh | 23:09 |
| sdague | yeh, definitely not havana | 23:09 |
| *** SergeyLukjanov has joined #openstack-infra | 23:11 | |
| *** sandy__ has joined #openstack-infra | 23:12 | |
| *** mriedem has joined #openstack-infra | 23:13 | |
| *** jcooley_ has quit IRC | 23:14 | |
| *** jcoufal-mob has joined #openstack-infra | 23:16 | |
| clarkb | sdague: source the .tox venv then do `python setup.py egg_info` and see if you get a better stacktrace | 23:16 |
| clarkb | er | 23:16 |
| clarkb | wow | 23:16 |
| clarkb | sdague: ignroe me | 23:16 |
| openstackgerrit | Sean Dague proposed a change to openstack-infra/config: move to elastic-recheck web console in share https://review.openstack.org/60318 | 23:17 |
| sdague | heh | 23:17 |
| sdague | ok | 23:17 |
| *** SergeyLukjanov has quit IRC | 23:18 | |
| openstackgerrit | A change was merged to openstack-infra/config: Use launchpad prop to store link to the lp project https://review.openstack.org/60329 | 23:19 |
| *** mattymo has quit IRC | 23:19 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/devstack-gate: Use the ephemeral disk on rackspace performance nodes https://review.openstack.org/60347 | 23:19 |
| *** dolphm has joined #openstack-infra | 23:20 | |
| *** mattymo has joined #openstack-infra | 23:20 | |
| fungi | heh... -n vs -z is definitely a world of difference | 23:22 |
| jeblair | fungi: yeah, but it didn't break hpcloud, which i don't understand. thus the -x and WIP. | 23:23 |
| openstackgerrit | lifeless proposed a change to openstack-infra/config: Add Gantt repositories. https://review.openstack.org/60380 | 23:23 |
| *** melwitt has quit IRC | 23:23 | |
| * fungi nods. i'm curious to see what it spews now | 23:23 | |
| *** jcooley_ has joined #openstack-infra | 23:23 | |
| *** melwitt has joined #openstack-infra | 23:24 | |
| *** jcoufal-mob has quit IRC | 23:24 | |
| *** prad has quit IRC | 23:25 | |
| *** dolphm has quit IRC | 23:25 | |
| fungi | probably on everyone's mind, but i find it amusing that rackspace performance nodes are running as fast as hpcloud's legacy region, and hpcloud's new region runs as slow as non-performance rackspace | 23:25 |
| *** dkranz has quit IRC | 23:25 | |
| fungi | wondering whether those numbers will hold steady | 23:25 |
| jeblair | fungi: it had occurred to me. that may in fact be the thing that prompted me to pick this up. :) | 23:26 |
| *** vkozhukalov has quit IRC | 23:26 | |
| fungi | i wondered | 23:26 |
| *** sarob_ has quit IRC | 23:31 | |
| *** sarob has joined #openstack-infra | 23:31 | |
| *** krtaylor has joined #openstack-infra | 23:31 | |
| *** nati_uen_ has quit IRC | 23:34 | |
| fungi | mordred: we haven't reverted anything that https://review.openstack.org/58153 needs, right? | 23:34 |
| *** nati_ueno has joined #openstack-infra | 23:34 | |
| *** sarob_ has joined #openstack-infra | 23:34 | |
| *** sarob_ has joined #openstack-infra | 23:35 | |
| jeblair | I have squatted gantt on launchpad, pypi and #openstack-gantt on freenode | 23:35 |
| jeblair | (and python-ganttclient) | 23:35 |
| fungi | clearly i'm behind on my ml reading | 23:35 |
| *** sarob has quit IRC | 23:35 | |
| clarkb | gantt? | 23:36 |
| jeblair | fungi, clarkb: 23:26 < openstackgerrit> lifeless proposed a change to openstack-infra/config: Add Gantt repositories. https://review.openstack.org/60380 | 23:36 |
| fungi | oho | 23:36 |
| fungi | i should look up from my keyboard a little more often apparently | 23:36 |
| lifeless | jeblair: awesome, thank you! | 23:36 |
| jeblair | lifeless: np, much easier to do this earlier rather than later. :) | 23:37 |
| *** denis_makogon has quit IRC | 23:38 | |
| jeblair | lifeless: has anyone given lauren or jonathan a heads up on this yet? | 23:40 |
| openstackgerrit | A change was merged to openstack-infra/config: Add gate-manila-devstack job https://review.openstack.org/57987 | 23:40 |
| lifeless | jeblair: nup | 23:41 |
| lifeless | it's not well thought out, just a holding name for code | 23:41 |
| lifeless | if it is feasible long term, cool | 23:41 |
| *** asalkeld has joined #openstack-infra | 23:41 | |
| notmyname | this is just getting silly https://review.openstack.org/#/c/60343/ | 23:41 |
| openstackgerrit | A change was merged to openstack-infra/config: Initial configuration for python-barbicanclient https://review.openstack.org/60101 | 23:42 |
| *** jcooley_ has quit IRC | 23:42 | |
| jeblair | lifeless: i'll send an email and cc you, russelb; any other nova folks? we can let them know it's early days, but they still might be interested. | 23:42 |
| lifeless | jeblair: thats very kind; thank you. I was just about to offer to do it myself. | 23:43 |
| *** jcooley_ has joined #openstack-infra | 23:43 | |
| lifeless | jeblair: the name was put forward in the nova IRC meeting my morning, so I think nova are sufficiently notified | 23:44 |
| asalkeld | Hi, how do I track down a readthedocs.org upload? I got this in: https://github.com/openstack-infra/config/commit/55eac64f376b2f5dd73ac4e169f05617197d7e24 but still no docs | 23:46 |
| asalkeld | the docs are getting built: http://docs-draft.openstack.org/24/58424/5/gate/gate-solum-docs/686f2c4/doc/build/html/ | 23:46 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: Setup builds for openstack Gerrit ver 2.8 https://review.openstack.org/60348 | 23:46 |
| asalkeld | but nothing here: https://readthedocs.org/projects/solum/ | 23:47 |
| *** openstackgerrit has quit IRC | 23:47 | |
| *** openstackgerrit has joined #openstack-infra | 23:47 | |
| jeblair | asalkeld: logs.openstack.org/SHORT_SHA where SHORT_SHA is the last 7 chars of the git commit you're interested in (note, it's the merge commit if that's applicable) | 23:47 |
| asalkeld | ok | 23:47 |
| clarkb | I think it might be firsttwocharsofsha/entiresha now | 23:48 |
| jeblair | asalkeld: whoops ^ sorry | 23:48 |
| jeblair | there's a git subcommand to do that automatically somewhere... | 23:49 |
| asalkeld | so: https://github.com/stackforge/solum/commit/ca1f3ccdbea8744a089197af6d802ac28b25d9e2 -> http://logs.openstack.org/ca1f3ccdbea8744a089197af6d802ac28b25d9e2 | 23:51 |
| asalkeld | 404 | 23:51 |
| jeblair | asalkeld: http://logs.openstack.org/ca/ca1f3ccdbea8744a089197af6d802ac28b25d9e2/ | 23:51 |
| asalkeld | aaa | 23:52 |
| jeblair | asalkeld: sorry, it's the first 2 chars of the sha, then the sha | 23:52 |
| jeblair | asalkeld: and it looks like there was no run of the rtfd hook | 23:52 |
| asalkeld | yeah, only coverage | 23:52 |
| lifeless | jeblair: a while ago I naively pushed up a commit adding me to having root access on -infra machines. | 23:52 |
| *** herndon has quit IRC | 23:52 | |
| lifeless | jeblair: and you said ' hey we'd love to have you eventually, but this probably isn't the time for it yet' | 23:53 |
| lifeless | jeblair: which was entirely appropriate as I didn't want that :) | 23:53 |
| jeblair | lifeless: excellent, we almost never give root access to people who don't want it. :) | 23:53 |
| lifeless | jeblair: however, I would like that at some point, to get wider coverage for ops things; could you, when you have a minute, let me know if there is anything I should be doing that I'm not, to head down that path | 23:54 |
| *** geekinutah has left #openstack-infra | 23:54 | |
| jeblair | lifeless: root is (theoretically) a subset of -core (though currently a complete subset in practice) | 23:55 |
| *** jcooley_ has quit IRC | 23:55 | |
| sdague | jeblair: so, with any luck, https://review.openstack.org/#/c/60318/ is right now. Once that lands I'll build up a patch to reorder the graphs on the page by hits | 23:55 |
| jeblair | lifeless: i think the main thing to do would be to become familiar/comfortable with the infra/config repo and puppet changes there... | 23:55 |
| lifeless | jeblair: righto; so I have a parallel copy of that infra deployed, and review in that tree daily | 23:56 |
| *** senk has joined #openstack-infra | 23:56 | |
| fungi | that sounds fairly familiar | 23:56 |
| lifeless | I need to do a bunch of updates to my copy though :( | 23:56 |
| fungi | lifeless: by the way, those were excellent docs you put together for deploying all the bits | 23:57 |
| lifeless | fungi: thank you | 23:57 |
| fungi | i have steered several people to them already | 23:57 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!