clarkb | fungi: nice | 00:00 |
---|---|---|
anteaya | well at least we know | 00:00 |
fungi | the vcsrepo docs imply that we want "present" | 00:01 |
*** zz_avozza is now known as avozza | 00:02 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-meetbot: Use present with vcsrepo bzr https://review.openstack.org/153427 | 00:05 |
fungi | clarkb: morganfainberg: nibalizer: ^ | 00:05 |
morganfainberg | ah. | 00:05 |
jeblair | how does the apply test not catch that? | 00:06 |
morganfainberg | good question | 00:06 |
mordred | jeblair: because puppet | 00:06 |
morganfainberg | and the new version supports latest | 00:06 |
morganfainberg | i'm sure | 00:06 |
jeblair | fungi: i mean, it should pretty much be running the command you ran to get that error, right? | 00:06 |
clarkb | I think because puppet accepts latest as a state but the provider doesn't and it isn't executing the provider | 00:07 |
morganfainberg | ^^ | 00:07 |
clarkb | jeblair: no apply test runs in noop mode | 00:07 |
mordred | clarkb: o_0 | 00:07 |
fungi | well, except i ran --noop | 00:07 |
clarkb | fungi: oh | 00:07 |
fungi | and got that exact error | 00:07 |
fungi | i'm trying again with out --noop just to make sure it's the same | 00:07 |
mordred | SpamapS: it's possible that you could exclude the devstack-cache element and still work on the problem | 00:07 |
mordred | SpamapS: devstack-cache is cloning every repo in the system | 00:08 |
mordred | SpamapS: on the other hand, once you do it once, the dib cache will make it nicer next time :) | 00:08 |
clarkb | mordred: should 153354 be WIP? | 00:08 |
*** reed has quit IRC | 00:08 | |
jeblair | i will give someone a cookie if they can make the apply tests work as well as they did with puppet2 | 00:08 |
jeblair | (this offer is not restricted to solutions that use puppet) | 00:09 |
anteaya | cookies and cats | 00:09 |
fungi | yeah, same error without --noop too so this isn't some weird noop behavior | 00:09 |
* anteaya wonders what her currency should be | 00:09 | |
pleia2 | anteaya: not lizards | 00:10 |
jeblair | if it helps, i will bake the excellent recipe in clifford stoll's "The Cuckoo's Egg" | 00:10 |
jeblair | which is the only book on computer hacking on my cookbook shelf | 00:10 |
anteaya | pleia2: ah but canada has so many | 00:12 |
anteaya | snowflakes? | 00:12 |
fungi | pleia2: it _should_ be lizards, as their local rarity makes them a valuable commodity | 00:12 |
fungi | as compared to snowflakes | 00:12 |
anteaya | yes the value of lizards is much higher | 00:12 |
*** andreykurilin_ has joined #openstack-infra | 00:12 | |
pleia2 | I was thinking about it the other way around :) | 00:13 |
anteaya | jeblair: sounds delicious | 00:13 |
*** vilobhmm has joined #openstack-infra | 00:13 | |
clarkb | jogo: you still ready to have nova functional voting? | 00:13 |
anteaya | snowflakes are prettier | 00:13 |
jeblair | you know what they say "it takes lizards to make lizards" | 00:13 |
clarkb | jogo: because its happening :) | 00:13 |
anteaya | do they say that? | 00:14 |
* anteaya must have missed that meeting | 00:14 | |
*** dangers is now known as dangers_away | 00:15 | |
*** abhirc has joined #openstack-infra | 00:16 | |
anteaya | clarkb: ha ha ha | 00:16 |
*** sabeen has quit IRC | 00:16 | |
jogo | clarkb: yes! | 00:17 |
clarkb | hrm 153227 | 00:17 |
clarkb | I kinda wish that we would maybe have more of a discussion every time we change the way we list dependencies | 00:18 |
* pleia2 frowns at 144166 | 00:19 | |
pleia2 | not sure how anything gets merged into d-g :\ | 00:19 |
pleia2 | for fun it fails a different one each time | 00:19 |
clarkb | "it was decided" ok | 00:19 |
clarkb | pleia2: if at first you don't succeed "recheck" | 00:20 |
clarkb | pleia2: but ya :( | 00:20 |
openstackgerrit | Merged openstack-infra/puppet-meetbot: Use present with vcsrepo bzr https://review.openstack.org/153427 | 00:21 |
openstackgerrit | Merged openstack-infra/project-config: Make novaclient-dsvm-functional gating for novaclient https://review.openstack.org/153331 | 00:21 |
*** annegent_ has joined #openstack-infra | 00:22 | |
clarkb | mordred: does pbr need to grok any of what 153227 is doing? | 00:23 |
*** annegent_ has quit IRC | 00:24 | |
*** _shaps__ has joined #openstack-infra | 00:25 | |
*** Sukhdev has joined #openstack-infra | 00:26 | |
* mordred looks | 00:27 | |
*** _shaps_ has quit IRC | 00:27 | |
mordred | clarkb: no | 00:27 |
mordred | clarkb: but if it's a feature we want - it should be something that it groks - potentially related to pip feature tags | 00:28 |
clarkb | mordred: I guess the next thing is do we really want to keep doing this sort of thing and modify how these checks work? | 00:28 |
mordred | or extras, rather | 00:28 |
clarkb | mordred: I honestly don't understand why this is any better and think it is only going to be more prone to pip ordering issues | 00:28 |
clarkb | mordred: especially if globbing returns files in different orders on different platforms (but I don't know if that is the case) | 00:28 |
fungi | requirements.d ?!? | 00:28 |
clarkb | fungi: yes we have so many dependencies we need an entire directory to hold them | 00:28 |
clarkb | fungi: it was decided | 00:29 |
fungi | neat! | 00:29 |
mordred | well, and we want to avoid "unneeded" depends | 00:29 |
JayF | Are pep8 jobs broken overall? I'm getting a traceback in pep8 itself on this test run: http://logs.openstack.org/17/153417/1/check/gate-ironic-python-agent-pep8/364729b/console.html | 00:29 |
fungi | is requirements.d becoming a common pythonism, or are we becoming even more snowflake than when we just used regular requirements.txt files? | 00:29 |
mordred | I think we've surpassed the point where we need to re-examine distro packaging | 00:30 |
clarkb | fungi: I think its snowflaking hard | 00:30 |
mordred | yah | 00:30 |
clarkb | fungi: which is why I am somewhat sarcastically repeating that it has been decided | 00:30 |
mordred | this is re-inventing all of the complexity of dpkg without the other things | 00:30 |
*** markvoelker has quit IRC | 00:30 | |
fungi | mordred: which other things? you mean the working? | 00:30 |
*** gondoi is now known as zz_gondoi | 00:31 | |
*** markvoelker has joined #openstack-infra | 00:31 | |
clarkb | JayF: I havne't seen pep8 fail everywhere. stuff is merging | 00:31 |
*** zz_gondoi is now known as gondoi | 00:31 | |
clarkb | JayF: if I had to guess you aren't properlly pinning flake8 | 00:31 |
openstackgerrit | Merged openstack-infra/project-config: Add ACL to create branch/tags in proliantutils. https://review.openstack.org/153132 | 00:31 |
mordred | I just -2d that | 00:31 |
mordred | btw | 00:31 |
JayF | clarkb: hrm. I think we're using what's in global requirements | 00:31 |
*** dims__ has quit IRC | 00:31 | |
mordred | fungi: yah | 00:32 |
jeblair | wait... | 00:32 |
JayF | clarkb: We don't appear to have flake8 specifically in our requirements at all. https://github.com/openstack/ironic-python-agent/blob/master/requirements.txt https://github.com/openstack/ironic-python-agent/blob/master/test-requirements.txt | 00:33 |
jeblair | pleia2: stable branches should not be voting on d-g | 00:33 |
JayF | clarkb: If you can help me know the right thing; I can make it that way :) | 00:33 |
clarkb | JayF: ya I am trying to figure this out | 00:33 |
JayF | ty | 00:33 |
jeblair | pleia2: if you want to track down how that happened, we can unwind it | 00:33 |
clarkb | jeblair: https://github.com/openstack/ironic-python-agent/blob/master/test-requirements.txt#L4 hacking depends on flake8 and pep8 | 00:34 |
pleia2 | jeblair: sure, having a look | 00:34 |
clarkb | er JayF ^ | 00:34 |
JayF | clarkb: I know that; Just unsure what the best way is to go forward. Should I add a flake8+pep8 pin to test-requirements.txt that matches what's in global reqs? | 00:34 |
*** wenlock has quit IRC | 00:34 | |
clarkb | JayF: no I don't think so | 00:35 |
*** markvoelker has quit IRC | 00:35 | |
*** rfolco has joined #openstack-infra | 00:35 | |
mordred | clarkb JayF: hacking has the flake8/pep8 pin | 00:35 |
mordred | that's why it's listed first | 00:36 |
clarkb | JayF: its also possible that your code tickles a bug in the linters | 00:36 |
JayF | So maybe this is some crazy one time failure and I should recheck? | 00:36 |
JayF | if it doesn't happen again pretend it never did? | 00:36 |
clarkb | JayF: I would see if passes locally | 00:36 |
clarkb | JayF: just tox -repep8 | 00:36 |
mordred | oslotest is in requirements | 00:36 |
JayF | yeah that won't take long, 1s | 00:36 |
mordred | is it possible it's pulling in hacking? | 00:36 |
jeblair | pleia2: it may have been before clean-check | 00:37 |
*** camunoz has joined #openstack-infra | 00:37 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/puppet-meetbot: Correct source for plugins directory https://review.openstack.org/153431 | 00:37 |
clarkb | mordred: the verison came out looking good though 0.8.1 | 00:37 |
jeblair | pleia2: i think with clean-check, we may need to either make "-nv" (non-voting) versions of all those jobs, or move them to experimental | 00:37 |
fungi | morganfainberg: clarkb: jeblair: clearly any resources which depend on a vcsrepo source just aren't tested in the apply test ^ | 00:37 |
jeblair | pleia2: probably the -nv variants would be best | 00:37 |
clarkb | jeblair: I think those jobs only run against d-g | 00:38 |
mrodden | http://logs.openstack.org/17/153417/1/check/gate-ironic-python-agent-pep8/364729b/console.html#_2015-02-05_23_07_52_835 lineno is topline of the file? | 00:38 |
clarkb | jeblair: so safe to make them non voting (double check of course) | 00:38 |
clarkb | pleia2: ^ | 00:38 |
fungi | (which is probably half our puppet) | 00:38 |
pleia2 | jeblair: ah, that was some time ago | 00:38 |
morganfainberg | fungi, that one there is likely my bad - sorry for the copy/paste error :( | 00:38 |
jeblair | clarkb: "check-tempest-dsvm-full-juno" is the one that's currently failing | 00:38 |
clarkb | fungi: exciting | 00:38 |
JayF | clarkb: https://gist.github.com/jayofdoom/54181f10892a278b5221 fails identically locally | 00:38 |
clarkb | oh tempest uses that job too | 00:39 |
clarkb | JayF: my money is one your code tickling a bug in pep8 | 00:39 |
morganfainberg | fungi, :( i really am not trying to make your life hard! I swear! | 00:39 |
mrodden | probably in one of the checks | 00:39 |
*** achanda has quit IRC | 00:39 | |
JayF | clarkb: added a pip freeze from the venv inside the gist | 00:39 |
fungi | morganfainberg: nope, your contribution is appreciated! | 00:39 |
openstackgerrit | K Jonathan Harker proposed openstack-infra/jenkins-job-builder: The email publisher needs a list of recipients https://review.openstack.org/153432 | 00:39 |
mrodden | if not noqa(self.lines[lineno - 1]) seems like bad code form IMO | 00:39 |
JayF | pep8==1.4.5 and flake8==2.0 | 00:39 |
clarkb | JayF: ya thats what the gate job used | 00:40 |
fungi | morganfainberg: i am more annoyed by puppet and our apply job not catching seriously broken changes | 00:40 |
morganfainberg | yeah but that is clearly copy/paste error from previous patchset- prior to the move to the new repo/module | 00:40 |
mordred | fungi: ++ | 00:40 |
morganfainberg | fungi, so two fold - apply job suckage and copy/pasta issues | 00:40 |
morganfainberg | i can take the blame for the latter. | 00:40 |
*** syerrapragada has quit IRC | 00:40 | |
JayF | clarkb: frankly it's a simple patch, idk what could be blowing it up but I'll dig a bit | 00:40 |
*** carl_baldwin has quit IRC | 00:41 | |
clarkb | JayF: well you get an entire traceback :) | 00:41 |
fungi | also i need to learn how to install modified puppet modules into a dev env so i can test more than one layer of broken at a time | 00:41 |
clarkb | JayF: it is saying lineno -1 is outside of that lists index range. | 00:41 |
*** prad has joined #openstack-infra | 00:42 | |
JayF | clarkb: it's from something in the commit message; jroll suggested changing it and it did the trick | 00:43 |
JayF | but there's clearly gotta be a bug in pep8 for it to completely bail vs giving reasonable output? | 00:44 |
clarkb | JayF: wait commit message? | 00:44 |
*** ddieterly has joined #openstack-infra | 00:44 | |
mrodden | lolwut | 00:44 |
clarkb | but it isn't even running on the commit message | 00:44 |
JayF | clarkb: yes, 100% | 00:44 |
JayF | clarkb: Apparently not? | 00:44 |
JayF | lol | 00:44 |
clarkb | its running on ironic_python_agent and imagebuild | 00:44 |
JayF | clarkb: the only thing I did was git commit --amend and change the commit message | 00:44 |
pleia2 | jeblair: so we did intentionally add these jobs https://review.openstack.org/#/c/144520/1/zuul/layout.yaml just make them nv? | 00:45 |
clarkb | JayF: can we see the delta? | 00:45 |
openstackgerrit | justinsb proposed openstack/requirements: Bump cassandra-driver to 2.1.4 https://review.openstack.org/151118 | 00:45 |
JayF | my new commit message was literally "some message\n\nwhatever yo" | 00:45 |
JayF | the old commit message is https://review.openstack.org/#/c/153417/1 what's right there | 00:45 |
pleia2 | ah yes, I see tempest is using them too | 00:45 |
jroll | clarkb: I know in the past, hacking has enforced rules about the commit message | 00:46 |
clarkb | jroll: ya hacking but this error is in pepe8 | 00:46 |
jroll | /shrug | 00:46 |
mrodden | hacking extends pep8 IIRC | 00:46 |
clarkb | unless I take that back | 00:46 |
fungi | pleia2: jeblair: looks like 144520 was my fault--i probably missed something when duplicating the icehouse jobs | 00:47 |
clarkb | the top of the traceback is loading the entrypoints I suppose its possible hacking ran? | 00:47 |
clarkb | JayF: jroll you can test by removing hacking and just running flake8 on it | 00:47 |
JayF | clarkb: self.lines is [] for the part it bailed on fwiw | 00:47 |
JayF | clarkb: wdym removing hacking? go in the venv and pip uninstall hacking ? | 00:47 |
jroll | yes | 00:47 |
*** gondoi is now known as zz_gondoi | 00:47 | |
JayF | clarkb: bingo | 00:48 |
JayF | that fixes it as well | 00:48 |
clarkb | so a hacking bug | 00:48 |
clarkb | you should probably file a bug against hacking with a link to the specific patchset that break | 00:48 |
clarkb | *breaks | 00:48 |
fungi | jeblair: pleia2: hrm, 144520 just updated to add the juno jobs, but looks like the icehouse jobs were already voting at that point | 00:49 |
JayF | clarkb: /me suspects the "-"s in the commit message are responsible | 00:49 |
openstackgerrit | Jim Rollenhagen proposed openstack-infra/project-config: Make agent_ssh job not run on stable/juno Ironic patches https://review.openstack.org/153363 | 00:49 |
jroll | clarkb: fixed your comments there ^ | 00:49 |
fungi | pleia2: might need to look back further | 00:49 |
clarkb | jroll: +2 thanks | 00:49 |
jroll | ty! | 00:49 |
openstackgerrit | Merged openstack-infra/project-config: Make manila tempest jobs votable https://review.openstack.org/153113 | 00:49 |
*** zz_gondoi is now known as gondoi | 00:50 | |
openstackgerrit | Merged openstack-infra/project-config: Changed description of EC2 API project https://review.openstack.org/152287 | 00:50 |
*** esker has joined #openstack-infra | 00:50 | |
jroll | fungi: when you have a moment, https://review.openstack.org/153363 unblocks a juno backport for ironic | 00:51 |
*** marun has quit IRC | 00:51 | |
openstackgerrit | Merged openstack-infra/project-config: Automatically trigger building of docs for stackforge/tuskar-ui-extras https://review.openstack.org/152448 | 00:51 |
*** andreaf has quit IRC | 00:52 | |
*** andreaf has joined #openstack-infra | 00:53 | |
openstackgerrit | Merged openstack-infra/project-config: Make VPN repo functional tests non-voting in check queue https://review.openstack.org/152602 | 00:53 |
jroll | thanks fungi :) | 00:53 |
fungi | in good news, eavesdrop is now showing failed on puppetboard rather than upreported (hopefully solved once someone approves https://review.openstack.org/153431 ) | 00:54 |
openstackgerrit | Merged openstack-infra/devstack-gate: Bump ironic build/callback timeouts https://review.openstack.org/153200 | 00:54 |
pleia2 | I think maybe line 536 in layout.yaml wasn't updated for juno | 00:57 |
pleia2 | # tempest and d-g branchless tests need to only run on master | 00:57 |
pleia2 | # (needs to be early to not impact non-voting stanzas later) | 00:57 |
pleia2 | - name: ^(?!periodic-).*-icehouse$ | 00:57 |
pleia2 | branch: ^master.*$ | 00:57 |
pleia2 | does that make sense? | 00:57 |
JayF | clarkb: thanks; filed this here: https://bugs.launchpad.net/hacking/+bug/1418776 and getting the IPA contributor (a new co-worker of ours, clif_h, so if you see him be nice :D) to change the commit message for now. | 00:57 |
*** salv-orl_ has joined #openstack-infra | 00:58 | |
clarkb | pleia2: oh that could be. Though we may need to double check that we haven't set tempest's expectations in a different direction by fubaring that | 00:58 |
* pleia2 nods | 00:58 | |
*** markvoelker has joined #openstack-infra | 01:01 | |
*** ashleighfarnham has quit IRC | 01:01 | |
*** salv-orlando has quit IRC | 01:01 | |
*** salv-orl_ has quit IRC | 01:02 | |
*** rfolco has quit IRC | 01:03 | |
*** zul has quit IRC | 01:03 | |
pleia2 | no, not it, we're not using periodic in the d-g jobs | 01:03 |
pleia2 | a few lines down though has the ones we're looking for | 01:03 |
clarkb | pleia2: I think that is excluding the periodic jobs from the rule | 01:05 |
clarkb | ?! is the option for negative lookahead? | 01:05 |
*** dims__ has joined #openstack-infra | 01:05 | |
pleia2 | oh, right | 01:05 |
*** markvoelker has quit IRC | 01:06 | |
openstackgerrit | Clark Boylan proposed openstack-infra/project-config: add stable compat jobs to python-barbicanclient https://review.openstack.org/150645 | 01:06 |
clarkb | I just fixed sdague's change ^ | 01:06 |
* mordred thinks back to the time on the first Perl Cruise when Mark-Jason Dominus did a session on the internals of Perl's regex engine ... | 01:06 | |
clarkb | because I figure we should be testing that sooner than later. Any other core want to approve that real quickly? | 01:06 |
*** mase_home has quit IRC | 01:07 | |
*** gondoi is now known as zz_gondoi | 01:07 | |
fungi | mordred: nothing makes pcre more tolerable than a tall fruity rum drink | 01:07 |
clarkb | hrm I don't have any rum or fruity liquids | 01:08 |
clarkb | probably a good thing after the other week | 01:08 |
*** zz_gondoi is now known as gondoi | 01:08 | |
greghaynes | clarkb: then it is time to panic! | 01:08 |
*** rmcall has quit IRC | 01:09 | |
mordred | fungi: it was an alaska cruise | 01:09 |
mordred | fungi: but there was scotch at one point | 01:09 |
*** sputnik13 has quit IRC | 01:09 | |
fungi | mordred: i'd leave off the little paper umbrella in that case | 01:10 |
*** mtanino has quit IRC | 01:10 | |
clarkb | my liquor stores are looking pretty sad. Maybe this weekend I will go stock up | 01:10 |
clarkb | mordred: btw sun liquor hedgetrimmer is excellent | 01:10 |
*** dimtruck is now known as zz_dimtruck | 01:11 | |
mordred | clarkb: sun liquor is excellent | 01:11 |
*** andreykurilin_ has quit IRC | 01:11 | |
greghaynes | clarkb: have you acquired cachaca yet? | 01:11 |
clarkb | greghaynes: no | 01:12 |
* greghaynes shakes head | 01:12 | |
clarkb | greghaynes: its really sad. I have no rum, no cachaca, almost no whiskey, no gin, and the bottle of brandy is disappearing quicker than it should | 01:12 |
*** nelsnelson has quit IRC | 01:12 | |
mordred | grue_pm: ^^ you know - I have many pictures from that conference I could terrorize you with ... | 01:12 |
*** abhirc has quit IRC | 01:13 | |
*** mase_home has joined #openstack-infra | 01:13 | |
*** weshay has quit IRC | 01:13 | |
*** salv-orl_ has joined #openstack-infra | 01:14 | |
*** shashankhegde has joined #openstack-infra | 01:14 | |
grue_pm | mordred: ooh really - I have half a dozen wide photos taken with a happy snap camera | 01:15 |
*** thedodd has quit IRC | 01:15 | |
mordred | clarkb: dude. I have two bottles of cachaca, SEVERAL bottles of whiskey including a bottle of connemara peated I picked up last night | 01:15 |
grue_pm | mordred: I distinctly remember being up all night and nearly faceplanting in an awesome talk on regex and having to leave and the instructor saying I'd gone to play bingo | 01:15 |
mordred | :) | 01:15 |
anteaya | grue_pm: sounds like you make an impression | 01:16 |
grue_pm | trying to mix alcohol/partying and conference didnt work well for me. | 01:16 |
*** doug-fish has left #openstack-infra | 01:16 | |
clarkb | mordred: I know right? but keep in mind I did have a keg at the superbowl thing full of home brew | 01:16 |
openstackgerrit | Elizabeth K. Joseph proposed openstack-infra/project-config: Update stable branch selector for Juno https://review.openstack.org/153438 | 01:17 |
pleia2 | jeblair: make sense? ^^ | 01:17 |
anteaya | pleia2: I'm missing context | 01:17 |
anteaya | should I ask for some or will this be approved in the time it takes to explain it to me? | 01:18 |
pleia2 | anteaya: a d-g patch keeps failing to pass verification due to failed tests, jeblair noted that stable branches should not be voting on d-g | 01:19 |
*** zhiwei has joined #openstack-infra | 01:19 | |
anteaya | ah | 01:19 |
anteaya | do you have the url for said patch with failing tests? | 01:19 |
pleia2 | https://review.openstack.org/#/c/144166 | 01:19 |
pleia2 | we've been playing recheck all day long | 01:19 |
grue_pm | mordred: where are these photos? Actuallly I think I have others too of us climbing to the top of a snow peek and seeing the danger bears no people past this point *after* we came down. | 01:20 |
grue_pm | mordred: and the ones of randal's I've snarfed | 01:22 |
anteaya | how do I get a git blame of one line? I tried git blame zuul/layout.yaml:538 and failed | 01:22 |
grue_pm | mordred: maybe weh could have an openstack conference on a cruise liner? | 01:22 |
clarkb | does anyone remember what mrmartin needed the puppet-solr module for? is it askbot? | 01:23 |
pleia2 | clarkb: yes | 01:23 |
anteaya | found it git blame -L538,+1 zuul/layout.yaml | 01:24 |
*** carl_baldwin has joined #openstack-infra | 01:24 | |
*** weshay has joined #openstack-infra | 01:25 | |
anteaya | pleia2: what am I not understanding, patchset 1 voted on icehouse: https://review.openstack.org/#/c/144166 yet the code should already make the job not vote on icehouse if I am understanding correctly | 01:25 |
anteaya | that line last changed last september | 01:26 |
openstackgerrit | Merged openstack-infra/project-config: Jenkins/Puppet: increase timeout to 60 minutes https://review.openstack.org/153421 | 01:26 |
*** shashankhegde has quit IRC | 01:26 | |
openstackgerrit | Merged openstack-infra/puppet-meetbot: Correct source for plugins directory https://review.openstack.org/153431 | 01:29 |
openstackgerrit | Merged openstack-infra/project-config: Allow Tempest to install and configure for the Neutron API job https://review.openstack.org/148641 | 01:29 |
grue_pm | look mordred - pretty shiny things ;-p | 01:29 |
openstackgerrit | Merged openstack-infra/project-config: Install test-requirements for swiftclient functional tests https://review.openstack.org/145716 | 01:29 |
*** Sukhdev has quit IRC | 01:31 | |
fungi | okay, that fixed eavesdrop's puppetry, but meetbot needs a manual restart for it to take effect now | 01:31 |
*** hughhalf is now known as hugh_afk | 01:32 | |
fungi | still no meetings going on, so doing that now | 01:32 |
*** openstack has joined #openstack-infra | 01:34 | |
*** mase_x200 has joined #openstack-infra | 01:36 | |
*** melwitt has quit IRC | 01:37 | |
*** tiswanso has joined #openstack-infra | 01:37 | |
*** tiswanso has quit IRC | 01:37 | |
fungi | morganfainberg: in theory if i refer to bug 1260080 we'll get some noise back from the bot now? | 01:38 |
openstack | bug 1260080 in OpenStack Security Advisory "[OSSA 2014-006] Trustee token revocations with memcache backend (CVE-2014-2237)" [High,Fix released] https://launchpad.net/bugs/1260080 - Assigned to Tristan Cacqueray (tristan-cacqueray) | 01:38 |
*** tiswanso has joined #openstack-infra | 01:38 | |
fungi | indeed i do! | 01:38 |
anteaya | woooo | 01:38 |
morganfainberg | fungi, yep | 01:38 |
anteaya | morganfainberg: nice work | 01:38 |
morganfainberg | yay | 01:38 |
fungi | thanks again morganfainberg!!! | 01:38 |
clarkb | https://jenkins01.openstack.org/job/gate-tempest-dsvm-neutron-pg/2382/console I think that job is running on the sloewst node ever | 01:38 |
morganfainberg | my real reason: more excuses to get all openstack channels logging | 01:38 |
morganfainberg | >.> | 01:38 |
morganfainberg | "you get the bug bot for free **just log your channel**" | 01:39 |
morganfainberg | fungi, happy to help, and glad it's a base part of our services tbh | 01:39 |
fungi | morganfainberg: that's sneaky-smart | 01:39 |
* fungi transitions to standby mode | 01:39 | |
clarkb | morganfainberg: fwiw I am happy to help people set up long running irc clients if they need logs in not publicly logged channels | 01:39 |
morganfainberg | clarkb, i am thinking from an openstack-XXX channel it's nice, but reality it;s more because we should have the bug bot ;) | 01:40 |
morganfainberg | i just got to look like i was being sneaky-smart for a moment ;) | 01:40 |
*** r1chardj0n3s is now known as r1chardj0n3s_afk | 01:40 | |
anteaya | I took a picture | 01:40 |
clarkb | in other news that makes me happy OR and WA currently have legislation in the works to stop doing DST | 01:41 |
anteaya | daylight savings time? | 01:41 |
clarkb | anteaya: ya | 01:41 |
anteaya | you don't like it? | 01:41 |
fungi | if only other states will follow suit | 01:41 |
morganfainberg | clarkb, crap.. i might need tto move to OR or WA based on that instead of NY | 01:41 |
anteaya | personally I would like us all to use utc | 01:41 |
fungi | and then introduce legislation to ditch timezones | 01:42 |
morganfainberg | i mean. that is a REALLY big selling point about where to move | 01:42 |
anteaya | one timezone | 01:42 |
morganfainberg | anteaya, I agree. | 01:42 |
mordred | clarkb: it's likely not going to go to a vote | 01:42 |
morganfainberg | anteaya, i hate doing TZ math | 01:42 |
clarkb | anteaya: I have an extreme dislike for changing clocks twice a year | 01:42 |
*** tiswanso has quit IRC | 01:42 | |
clarkb | mordred: well the way it works in OR is it would go on our ballots in the fall | 01:42 |
anteaya | clarkb: yeah that makes sense | 01:42 |
morganfainberg | clarkb, i hate changing clocks when they run out of battery let alone DST | 01:42 |
anteaya | morganfainberg: me too, to make my meetings on time I just changed my phone to utc | 01:42 |
morganfainberg | clarkb, it's why i use NTP for everything i actually care about | 01:42 |
mordred | I want us to stop DST - but I'd like to stick on DST and not on Standard | 01:43 |
anteaya | then I didn't have to translate the time to $local_timezone | 01:43 |
*** tiswanso has joined #openstack-infra | 01:43 | |
pleia2 | anteaya: hm, so something happened in early september and icehouse jobs started voting again, looking | 01:43 |
clarkb | mordred: ya I think I prefer being on that side of the switch too | 01:43 |
clarkb | mordred: but mostly would be happy to not switch | 01:43 |
fungi | it's why i keep ntp on everything i care about and set all my clocks to utc ;) | 01:43 |
morganfainberg | mordred, i don't care which side of the switch as long as it stops | 01:43 |
clarkb | morganfainberg: +1 | 01:43 |
mordred | clarkb: this is the real reason it's not going to go anywhere right now | 01:43 |
anteaya | pleia2: oh okay, I'm glad I'm not just making your life difficult, I'm trying to be useful | 01:43 |
mordred | "I like the long summer nights in the PNW" is the push back | 01:43 |
anteaya | pleia2: different success rate every day there | 01:43 |
clarkb | mordred: apparently the biggest opponents are golf courses | 01:44 |
clarkb | mordred: which is lolzy | 01:44 |
*** abhirc has joined #openstack-infra | 01:44 | |
*** markvoelker has joined #openstack-infra | 01:44 | |
morganfainberg | fungi, it's more of a headache to run UTC on an iphone than it should be... but with the 1+1 i prob can make that happen easily | 01:44 |
anteaya | clarkb: golf courses? | 01:44 |
clarkb | anteaya: ya, they like the late evening sunlight apparently | 01:44 |
clarkb | anteaya: more people golfing | 01:44 |
anteaya | saskatchewan doesn't switch because it upsets the cows | 01:44 |
fungi | morganfainberg: yeah, i have an ancient crap non-smart phone and it's a pain but i do manage to keep it set to utc | 01:44 |
morganfainberg | mordred, i am finding how much work it's going to be to convert to android. i might be done in a month - so many things | 01:44 |
anteaya | clarkb: why not just golf when you want, rather than looking at a time piece | 01:45 |
clarkb | morganfainberg: wait you do more than text, call, irc, and email on your phone? | 01:45 |
morganfainberg | clarkb, i often do code review from coffeeshops | 01:45 |
clarkb | anteaya: well I think most people work jobs where they are required to be in a chair between hours X and Y | 01:45 |
morganfainberg | clarkb, and tethering | 01:45 |
morganfainberg | clarkb, and MFA tokens | 01:45 |
clarkb | morganfainberg: tethering is easy on android | 01:45 |
clarkb | so is MFA | 01:45 |
anteaya | clarkb: ah, I am rapidly forgetting that world | 01:45 |
morganfainberg | clarkb, it's the convert from Iphone to Andorid MFA apps | 01:45 |
anteaya | would be better do make some legistation around that | 01:46 |
anteaya | the golf when you want bill | 01:46 |
morganfainberg | it usually requires resetting up the MFA since the original strings/QRs are now lost [due to a bad reformat] | 01:46 |
morganfainberg | it's just time consuming | 01:46 |
clarkb | ya I guess it depends on how many places you are using them | 01:46 |
morganfainberg | clarkb, i can be in my chair between 1500 and 0100 UTC if people cared about that | 01:47 |
morganfainberg | :P | 01:47 |
morganfainberg | anteaya, ^^ | 01:47 |
anteaya | morganfainberg: I don't care about that | 01:48 |
anteaya | golf when you want, morganfainberg | 01:48 |
morganfainberg | i meant to the comment of people needing to be in a chair between X and Y | 01:48 |
anteaya | yeah, getting to be silly | 01:48 |
fungi | morganfainberg: 1400 to 2200 utc for me (or much later, obviously) | 01:48 |
morganfainberg | doesn't really change anything just that you don't have to guess when person X wakes up | 01:48 |
anteaya | you can guess or you can ask | 01:48 |
anteaya | you up? | 01:48 |
morganfainberg | since they'd say "i get up at 1800" or something | 01:48 |
anteaya | funny how often I get a yes to that question from mordred | 01:49 |
morganfainberg | vs. "i get up at 6am".. now what timezone are they in? | 01:49 |
morganfainberg | hahaha | 01:49 |
anteaya | waste of my time to guess for him | 01:49 |
morganfainberg | in december i didn't know what TZ i was in let alone anyone else | 01:49 |
anteaya | ha ha ha | 01:49 |
*** zz_dimtruck is now known as dimtruck | 01:50 | |
anteaya | time for me to pick up my cat and move to the couch | 01:50 |
anteaya | she aquired a sneeze the minute I took her to my sister's a month ago | 01:50 |
anteaya | and still has it | 01:50 |
clarkb | I spent 18 years without DST and it never hurt me | 01:51 |
anteaya | hoping it is an emotional response and will diminsh soon | 01:51 |
anteaya | clarkb: you look fine to me | 01:51 |
morganfainberg | arizona? | 01:51 |
clarkb | but the sun did set at just about 1830 local time every day of the year | 01:51 |
clarkb | morganfainberg: Pohnpei, Micronesia | 01:51 |
pleia2 | anteaya: btw, I think your git blame from earlier is a red herring, it changed in september because that's when we split out the modules (so technically the entire file changed) | 01:51 |
*** r-daneel has quit IRC | 01:51 | |
anteaya | the equator is reliable like that | 01:51 |
morganfainberg | ah | 01:51 |
anteaya | pleia2: ah | 01:51 |
anteaya | pleia2: good investigating | 01:51 |
*** bdpayne has quit IRC | 01:51 | |
pleia2 | I've had to go back to the layout file in config to dig up more | 01:51 |
anteaya | pleia2: sorry for the trouble | 01:52 |
pleia2 | no trouble :) I was just looking for the line change you mentioned when I realized it might not actually exist | 01:52 |
clarkb | fungi: its incredibly sad that joystiq is no more | 01:52 |
anteaya | pleia2: never trust me, always check | 01:52 |
*** gondoi is now known as zz_gondoi | 01:52 | |
clarkb | fungi: where will I find out about videogames I don't need | 01:52 |
* anteaya moves to fetch the cat | 01:52 | |
*** salv-orl_ has quit IRC | 01:53 | |
fungi | clarkb: i still posit that we should hire the former joystiq'ers to be part of the openstack blog-marketing machine | 01:53 |
*** rwsu is now known as rwsu-afk | 01:53 | |
fungi | also one of our member companies should give werner koch a solid salary to continue supporting gnupg | 01:54 |
*** shashankhegde has joined #openstack-infra | 01:55 | |
pleia2 | fungi: was nice to see Linux Foundation use their Core Infrastructure Initiative for that too (60k worth!) | 01:56 |
clarkb | pleia2: oh wow | 01:56 |
*** zz_gondoi is now known as gondoi | 01:58 | |
*** gondoi is now known as zz_gondoi | 01:59 | |
*** carl_baldwin has quit IRC | 01:59 | |
fungi | pleia2: agreed, but that's still, well, barely a living wage these days, and certainly meager compensation on its own | 01:59 |
pleia2 | yeah | 01:59 |
*** SumitNaiksatam has quit IRC | 02:00 | |
*** Sukhdev has joined #openstack-infra | 02:00 | |
fungi | anyway, i'm _really_ going into standby now. later all | 02:00 |
*** zz_gondoi is now known as gondoi | 02:00 | |
openstackgerrit | Merged openstack-infra/project-config: Enable jobs to publish cross-project specs https://review.openstack.org/152698 | 02:01 |
clarkb | good night | 02:01 |
pleia2 | night fungi | 02:01 |
clarkb | I am really hoping to check experimental the d-g multihost change once the nova shelve fix merges | 02:01 |
clarkb | but maybe dinner first | 02:01 |
openstackgerrit | Merged openstack-infra/project-config: Enable voting for osc-functional https://review.openstack.org/152749 | 02:01 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Allow independant pipelines to have a window https://review.openstack.org/152389 | 02:02 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add support for disabling bad pipelines https://review.openstack.org/152390 | 02:02 |
openstackgerrit | Merged openstack-infra/project-config: For project ec2-driver setting to noop-job in zuul layout https://review.openstack.org/152811 | 02:03 |
*** amitgandhinz has joined #openstack-infra | 02:04 | |
*** amitgandhinz has quit IRC | 02:05 | |
*** amitgandhinz has joined #openstack-infra | 02:05 | |
openstackgerrit | Merged openstack-infra/project-config: Make gate-git-review-docs voting https://review.openstack.org/152651 | 02:05 |
*** ccrouch has quit IRC | 02:06 | |
*** mase_x200 has quit IRC | 02:09 | |
*** ChuckC_ has joined #openstack-infra | 02:09 | |
*** gondoi is now known as zz_gondoi | 02:10 | |
*** zz_gondoi is now known as gondoi | 02:11 | |
*** fandi has quit IRC | 02:11 | |
*** sarob has joined #openstack-infra | 02:12 | |
*** ChuckC has quit IRC | 02:13 | |
*** sarob has quit IRC | 02:16 | |
*** tkelsey has joined #openstack-infra | 02:17 | |
*** dimtruck is now known as zz_dimtruck | 02:19 | |
openstackgerrit | Doug Wiegley proposed openstack-infra/project-config: Add pylint jobs to service modules https://review.openstack.org/153373 | 02:19 |
pleia2 | alright, I'm heading off to dinner, won't be around much tomorrow or monday (catching up with home things and appointments and sleep) | 02:19 |
*** shashankhegde has quit IRC | 02:20 | |
*** hdd has quit IRC | 02:21 | |
*** tkelsey has quit IRC | 02:22 | |
*** zz_dimtruck is now known as dimtruck | 02:22 | |
*** shashankhegde has joined #openstack-infra | 02:23 | |
*** baoli has joined #openstack-infra | 02:24 | |
*** baoli has quit IRC | 02:30 | |
*** tqtran has quit IRC | 02:30 | |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Refactor sources out of triggers https://review.openstack.org/118993 | 02:31 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add gerrit reviews into patchset approvals https://review.openstack.org/97390 | 02:31 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add support for negative requirements https://review.openstack.org/102726 | 02:31 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Configure triggers dynamically https://review.openstack.org/119534 | 02:31 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add support for 'connection' concept https://review.openstack.org/121528 | 02:31 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Call driver methods more dynamically https://review.openstack.org/119533 | 02:31 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add base class for triggers https://review.openstack.org/119532 | 02:31 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add base class for sources https://review.openstack.org/119531 | 02:31 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add base class for reporters https://review.openstack.org/119530 | 02:31 |
*** wenlock has joined #openstack-infra | 02:32 | |
*** esker has quit IRC | 02:36 | |
*** esker has joined #openstack-infra | 02:37 | |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add support for 'connection' concept https://review.openstack.org/121528 | 02:38 |
*** vilobhmm has quit IRC | 02:40 | |
*** esker has quit IRC | 02:42 | |
*** yamahata has quit IRC | 02:46 | |
openstackgerrit | Walter A. Boring IV (hemna) proposed openstack-infra/project-config: Add os-brick to OpenStack https://review.openstack.org/149778 | 02:47 |
*** mase_x200 has joined #openstack-infra | 02:48 | |
*** harlowja is now known as harlowja_away | 02:48 | |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Configure triggers dynamically https://review.openstack.org/119534 | 02:52 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add support for 'connection' concept https://review.openstack.org/121528 | 02:52 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Call driver methods more dynamically https://review.openstack.org/119533 | 02:52 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add base class for triggers https://review.openstack.org/119532 | 02:52 |
openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add base class for sources https://review.openstack.org/119531 | 02:52 |
*** salv-orlando has joined #openstack-infra | 02:53 | |
*** dannywilson has joined #openstack-infra | 02:55 | |
*** Ryan_Lane has quit IRC | 02:56 | |
*** ChuckC has joined #openstack-infra | 02:59 | |
*** ChuckC_ has quit IRC | 02:59 | |
*** dannywilson has quit IRC | 03:00 | |
*** baoli has joined #openstack-infra | 03:02 | |
*** baoli has quit IRC | 03:08 | |
*** r1chardj0n3s_afk is now known as r1chardj0n3s | 03:09 | |
*** patrickeast has quit IRC | 03:10 | |
*** shashankhegde has quit IRC | 03:12 | |
*** amitgandhinz has quit IRC | 03:14 | |
*** dims__ has quit IRC | 03:15 | |
*** woodster_ has quit IRC | 03:16 | |
*** achanda has joined #openstack-infra | 03:17 | |
*** achanda has quit IRC | 03:23 | |
*** hugh_afk is now known as hughhalf | 03:24 | |
*** salv-orlando has quit IRC | 03:25 | |
*** salv-orlando has joined #openstack-infra | 03:27 | |
*** melwitt has joined #openstack-infra | 03:28 | |
*** armax has quit IRC | 03:28 | |
*** avozza is now known as zz_avozza | 03:29 | |
*** r-daneel has joined #openstack-infra | 03:31 | |
*** salv-orlando has quit IRC | 03:34 | |
*** wenlock has quit IRC | 03:34 | |
*** sdake_ has quit IRC | 03:35 | |
*** r-daneel has quit IRC | 03:35 | |
*** Longgeek has joined #openstack-infra | 03:36 | |
*** zhiwei has quit IRC | 03:37 | |
*** dimtruck is now known as zz_dimtruck | 03:39 | |
*** mattfarina has joined #openstack-infra | 03:40 | |
*** carl_baldwin has joined #openstack-infra | 03:45 | |
*** koolhead17 has joined #openstack-infra | 03:46 | |
*** esker has joined #openstack-infra | 03:49 | |
*** r-daneel has joined #openstack-infra | 03:50 | |
*** mase_x200 has quit IRC | 03:57 | |
*** Sukhdev has quit IRC | 04:00 | |
*** otter768 has joined #openstack-infra | 04:00 | |
*** shashankhegde has joined #openstack-infra | 04:02 | |
*** niska has quit IRC | 04:04 | |
*** Ryan_Lane has joined #openstack-infra | 04:06 | |
*** Ryan_Lane has quit IRC | 04:07 | |
*** esker has quit IRC | 04:07 | |
*** bdpayne has joined #openstack-infra | 04:10 | |
*** bdpayne has quit IRC | 04:11 | |
*** gondoi is now known as zz_gondoi | 04:12 | |
mordred | jhesketh: dude. that's so many zuul patches | 04:14 |
jhesketh | mordred: or the more for you to review ;-) | 04:15 |
mordred | jhesketh: I was just thinking to myself- WOW, I really want to review more patches | 04:15 |
*** niska has joined #openstack-infra | 04:15 | |
jhesketh | good thing I preempted that | 04:16 |
jhesketh | glad to help | 04:16 |
*** BharatK has joined #openstack-infra | 04:16 | |
*** carl_baldwin has quit IRC | 04:19 | |
jesusaurus | jhesketh: your comment on https://review.openstack.org/#/c/74943/19/nodepool/tests/test_nodepool.py confuses me, what is the test you are suggesting that i add? | 04:20 |
*** niska has quit IRC | 04:21 | |
*** achanda has joined #openstack-infra | 04:23 | |
*** prad has quit IRC | 04:24 | |
*** armax has joined #openstack-infra | 04:25 | |
*** amitgandhinz has joined #openstack-infra | 04:25 | |
jhesketh | jesusaurus: basically testing the reverse of the test that is there | 04:27 |
*** zz_avozza is now known as avozza | 04:27 | |
jhesketh | you're testing that the bad-client works on a re-attempt, I'm suggesting we should also test that mutliple bad attempts raises the exception you expect | 04:28 |
*** swamireddy has joined #openstack-infra | 04:28 | |
*** amitgandhinz has quit IRC | 04:29 | |
jesusaurus | ah, hm, ok | 04:29 |
jhesketh | does that make sense? | 04:30 |
jesusaurus | yeah, it does, im just not sure how I would do that | 04:30 |
*** salv-orlando has joined #openstack-infra | 04:31 | |
*** yamamoto_ has joined #openstack-infra | 04:32 | |
*** zz_gondoi is now known as gondoi | 04:33 | |
*** gondoi is now known as zz_gondoi | 04:36 | |
*** zz_gondoi is now known as gondoi | 04:36 | |
*** avozza is now known as zz_avozza | 04:37 | |
*** armax has quit IRC | 04:37 | |
*** koolhead17 has quit IRC | 04:37 | |
*** armax has joined #openstack-infra | 04:37 | |
*** EmilienM|afk has quit IRC | 04:45 | |
*** EmilienM has joined #openstack-infra | 04:46 | |
*** shashankhegde has quit IRC | 04:47 | |
*** salv-orlando has quit IRC | 04:48 | |
*** koolhead17 has joined #openstack-infra | 04:48 | |
*** koolhead17 has quit IRC | 04:48 | |
*** koolhead17 has joined #openstack-infra | 04:48 | |
*** miqui_ has joined #openstack-infra | 04:49 | |
*** salv-orlando has joined #openstack-infra | 04:50 | |
*** mattfarina has quit IRC | 04:51 | |
*** yamahata has joined #openstack-infra | 04:54 | |
*** wenlock has joined #openstack-infra | 04:55 | |
*** thingee has quit IRC | 05:01 | |
*** tiswanso has quit IRC | 05:02 | |
*** gondoi is now known as zz_gondoi | 05:06 | |
*** primeministerp has quit IRC | 05:07 | |
*** bhunter71 has quit IRC | 05:07 | |
*** zz_gondoi is now known as gondoi | 05:08 | |
*** garyh has quit IRC | 05:09 | |
*** r1chardj0n3s is now known as r1chardj0n3s_afk | 05:19 | |
*** armax has quit IRC | 05:23 | |
*** armax has joined #openstack-infra | 05:24 | |
*** achanda has quit IRC | 05:25 | |
*** primeministerp has joined #openstack-infra | 05:25 | |
*** KanagarajM has joined #openstack-infra | 05:25 | |
*** achanda has joined #openstack-infra | 05:27 | |
*** salv-orlando has quit IRC | 05:29 | |
openstackgerrit | Khai Do proposed stackforge/python-jenkins: Change the default server connection timeout to 15 seconds https://review.openstack.org/153467 | 05:29 |
*** garyh has joined #openstack-infra | 05:32 | |
*** harlowja_at_home has joined #openstack-infra | 05:32 | |
*** mrmartin has joined #openstack-infra | 05:34 | |
KanagarajM | could someone review the patch https://review.openstack.org/#/c/152868/ Heat is updated with new REST API in k-2 | 05:36 |
*** hdd has joined #openstack-infra | 05:38 | |
*** harlowja_away has quit IRC | 05:38 | |
*** armax has quit IRC | 05:44 | |
*** mrmartin has quit IRC | 05:44 | |
*** otter768 has quit IRC | 05:49 | |
*** sputnik13 has joined #openstack-infra | 06:04 | |
*** woodster_ has joined #openstack-infra | 06:07 | |
*** sputnik13 has joined #openstack-infra | 06:08 | |
*** niska has joined #openstack-infra | 06:11 | |
*** shashankhegde has joined #openstack-infra | 06:14 | |
*** sputnik13 has quit IRC | 06:15 | |
*** AJaeger has joined #openstack-infra | 06:18 | |
*** hdd has quit IRC | 06:18 | |
*** mrmartin has joined #openstack-infra | 06:19 | |
*** yfried_ has joined #openstack-infra | 06:22 | |
*** yfried_ is now known as yfried|afk | 06:22 | |
openstackgerrit | Merged openstack-infra/project-config: Update chef-rake jobs to use chefdk and run on trusty https://review.openstack.org/152196 | 06:23 |
*** niska has quit IRC | 06:24 | |
*** yfried has quit IRC | 06:25 | |
openstackgerrit | Merged openstack-infra/project-config: GlusterFS: passthrough devstack config https://review.openstack.org/151136 | 06:26 |
openstackgerrit | Merged openstack-infra/project-config: Add gnocchi devstack tests job https://review.openstack.org/152064 | 06:26 |
openstackgerrit | Merged openstack-infra/project-config: Add openstack_functions.py to zuul-dev.o.o https://review.openstack.org/153070 | 06:26 |
openstackgerrit | Merged openstack-infra/project-config: Move puppet-tripleo to Stackforge https://review.openstack.org/152152 | 06:26 |
*** niska has joined #openstack-infra | 06:27 | |
*** melwitt has quit IRC | 06:30 | |
*** wenlock has quit IRC | 06:32 | |
*** sdake_ has joined #openstack-infra | 06:33 | |
openstackgerrit | Merged openstack-infra/project-config: Make agent_ssh job not run on stable/juno Ironic patches https://review.openstack.org/153363 | 06:34 |
*** openstackgerrit has quit IRC | 06:35 | |
*** openstackgerrit has joined #openstack-infra | 06:35 | |
*** tsufiev_ is now known as tsufiev | 06:37 | |
*** salv-orlando has joined #openstack-infra | 06:37 | |
*** SumitNaiksatam has joined #openstack-infra | 06:39 | |
openstackgerrit | Merged openstack-infra/project-config: Add cloud validation (cloudv) project to stackforge https://review.openstack.org/152695 | 06:40 |
*** denis_makogon has joined #openstack-infra | 06:43 | |
*** salv-orlando has quit IRC | 06:48 | |
*** harlowja_at_home has quit IRC | 06:49 | |
*** achanda has quit IRC | 06:52 | |
*** camunoz has quit IRC | 06:54 | |
*** denis_makogon has quit IRC | 06:56 | |
*** mrmartin has quit IRC | 06:56 | |
*** afazekas has joined #openstack-infra | 06:57 | |
*** r-daneel has quit IRC | 06:57 | |
*** ivar-laz_ has joined #openstack-infra | 07:00 | |
*** achanda has joined #openstack-infra | 07:01 | |
*** doude has quit IRC | 07:01 | |
*** sputnik13 has joined #openstack-infra | 07:02 | |
openstackgerrit | Khai Do proposed openstack-infra/jenkins-job-builder: Allow JJB to set connection timeout to jenkins server https://review.openstack.org/151472 | 07:02 |
*** ivar-lazzaro has quit IRC | 07:03 | |
*** gondoi is now known as zz_gondoi | 07:04 | |
*** ivar-laz_ has quit IRC | 07:05 | |
*** naggappan has joined #openstack-infra | 07:06 | |
*** doude has joined #openstack-infra | 07:06 | |
*** ricolin has quit IRC | 07:06 | |
*** vigneshvar has joined #openstack-infra | 07:07 | |
openstackgerrit | Khai Do proposed stackforge/python-jenkins: Change the default server connection timeout to 15 seconds https://review.openstack.org/153467 | 07:11 |
*** chlong has quit IRC | 07:12 | |
*** miqui_ has quit IRC | 07:12 | |
*** ildikov has quit IRC | 07:13 | |
*** chlong has joined #openstack-infra | 07:13 | |
*** zz_gondoi is now known as gondoi | 07:14 | |
*** yfried|afk has quit IRC | 07:16 | |
*** yfried|afk has joined #openstack-infra | 07:16 | |
*** pblaho has joined #openstack-infra | 07:17 | |
*** afazekas has quit IRC | 07:20 | |
*** pblaho has quit IRC | 07:22 | |
*** koolhead17 has quit IRC | 07:22 | |
*** scheuran has joined #openstack-infra | 07:25 | |
*** KanagarajM has quit IRC | 07:27 | |
*** achanda has quit IRC | 07:27 | |
*** ivar-lazzaro has joined #openstack-infra | 07:33 | |
*** _amrith_ is now known as amrith | 07:35 | |
*** yamahata has quit IRC | 07:36 | |
*** ildikov has joined #openstack-infra | 07:40 | |
*** _nadya_ has joined #openstack-infra | 07:41 | |
*** ivar-lazzaro has quit IRC | 07:45 | |
*** _nadya_ has quit IRC | 07:49 | |
*** tkelsey has joined #openstack-infra | 07:49 | |
*** otter768 has joined #openstack-infra | 07:50 | |
*** gondoi is now known as zz_gondoi | 07:50 | |
*** zz_dimtruck is now known as dimtruck | 07:51 | |
*** zz_gondoi is now known as gondoi | 07:51 | |
naggappan | hi could some one poin me where exactly the yamal file is present in repository for test "http://logs.openstack.org/18/153118/2/check/gate-neutron-python27/" . I.e I need to look for "gate-neutron-python27" yamal file. I searched into openstack-infra/project-config repo but i did not get any | 07:51 |
*** ivar-lazzaro has joined #openstack-infra | 07:52 | |
*** otter768 has quit IRC | 07:54 | |
*** tkelsey has quit IRC | 07:56 | |
*** ivar-lazzaro has quit IRC | 08:00 | |
*** gondoi is now known as zz_gondoi | 08:00 | |
*** belmoreira has joined #openstack-infra | 08:01 | |
*** koolhead17 has joined #openstack-infra | 08:06 | |
*** esker has joined #openstack-infra | 08:06 | |
*** markvoelker has quit IRC | 08:12 | |
*** _nadya_ has joined #openstack-infra | 08:13 | |
*** markvoelker has joined #openstack-infra | 08:13 | |
*** amrith is now known as _amrith_ | 08:15 | |
*** dimtruck is now known as zz_dimtruck | 08:16 | |
*** woodster_ has quit IRC | 08:16 | |
*** markvoelker has quit IRC | 08:18 | |
*** andreaf has quit IRC | 08:20 | |
*** jgallard__ has joined #openstack-infra | 08:20 | |
*** andreaf has joined #openstack-infra | 08:20 | |
tchaypo | jeblair: this is fun - running “gertty -v” results in no logs and it sitting at “Sync: 5" | 08:22 |
tchaypo | jeblair: “gertty -d” works fine | 08:22 |
tchaypo | No I tell a lie - it ran fine last time, this time it’s also sitting at “sync: 5" | 08:23 |
tchaypo | ah, there it goes | 08:23 |
tchaypo | okay, -d is working now too. Probably just the server being sad for a moment. Please ignore me. | 08:24 |
*** _nadya_ has quit IRC | 08:29 | |
*** scheuran has quit IRC | 08:30 | |
*** yamamoto_ has quit IRC | 08:31 | |
*** luqas has joined #openstack-infra | 08:32 | |
*** scheuran has joined #openstack-infra | 08:33 | |
*** unicell has joined #openstack-infra | 08:39 | |
*** stevemar has quit IRC | 08:39 | |
*** markus_z has joined #openstack-infra | 08:42 | |
*** markvoelker has joined #openstack-infra | 08:44 | |
*** zz_avozza is now known as avozza | 08:44 | |
*** ghostpl has joined #openstack-infra | 08:45 | |
*** mpaolino has joined #openstack-infra | 08:47 | |
*** scheuran has quit IRC | 08:50 | |
*** alexpilotti has joined #openstack-infra | 08:50 | |
*** scheuran has joined #openstack-infra | 08:50 | |
nibalizer | tchaypo: if it makes you feel any better im trying to sync and im 1K behind and im on hotel wifi | 08:50 |
*** markvoelker has quit IRC | 08:51 | |
nibalizer | so thats how that goes | 08:51 |
nibalizer | er you can figure out how that goes :) | 08:51 |
tchaypo | In my experience | 08:51 |
tchaypo | Either fantastically well | 08:52 |
*** ssam2 has joined #openstack-infra | 08:52 | |
tchaypo | Or it seems as though a proxy dies after 10 requests and then nothing happens for the rest of the night | 08:52 |
*** chlong has quit IRC | 08:53 | |
tchaypo | I was in a hotel a few weeks ago where the AP on the ceiling outside my room stopped routing traffic. | 08:53 |
*** mrmartin has joined #openstack-infra | 08:54 | |
*** koolhead17 has quit IRC | 08:54 | |
*** salv-orlando has joined #openstack-infra | 08:56 | |
*** yamamoto_ has joined #openstack-infra | 08:58 | |
*** jpich has joined #openstack-infra | 08:59 | |
*** tkelsey has joined #openstack-infra | 09:01 | |
*** derekh has joined #openstack-infra | 09:02 | |
*** Guest75042 has joined #openstack-infra | 09:03 | |
*** yfried has joined #openstack-infra | 09:04 | |
*** yfried|afk has quit IRC | 09:05 | |
*** shashankhegde has quit IRC | 09:08 | |
*** yamamoto_ has quit IRC | 09:09 | |
*** yamamoto_ has joined #openstack-infra | 09:13 | |
*** jgrimm is now known as zz_jgrimm | 09:14 | |
openstackgerrit | Cedric Brandily proposed openstack-infra/git-review: Support authentication in run_http_exc https://review.openstack.org/124410 | 09:15 |
*** _shaps__ has quit IRC | 09:15 | |
*** jp_at_hp has joined #openstack-infra | 09:17 | |
*** andreykurilin_ has joined #openstack-infra | 09:23 | |
*** salv-orlando has quit IRC | 09:26 | |
*** andreaf has quit IRC | 09:28 | |
*** salv-orlando has joined #openstack-infra | 09:28 | |
*** andreaf has joined #openstack-infra | 09:29 | |
*** yamamoto_ has quit IRC | 09:30 | |
*** alexpilotti has quit IRC | 09:32 | |
*** ihrachyshka has joined #openstack-infra | 09:35 | |
*** mriedem has joined #openstack-infra | 09:35 | |
*** mriedem_zz has quit IRC | 09:36 | |
*** abhijeetm has joined #openstack-infra | 09:38 | |
*** sputnik13 has quit IRC | 09:39 | |
*** e0ne has joined #openstack-infra | 09:41 | |
*** dizquierdo has joined #openstack-infra | 09:42 | |
*** MaxV has joined #openstack-infra | 09:45 | |
*** BobBall_AWOL is now known as BobBall | 09:46 | |
*** jcoufal has joined #openstack-infra | 09:46 | |
*** markvoelker has joined #openstack-infra | 09:46 | |
abhijeetm | Hi, | 09:48 |
abhijeetm | check-grenade-dsvm job is failing on stable/juno | 09:48 |
abhijeetm | for patch : https://review.openstack.org/#/c/151998/ | 09:48 |
abhijeetm | graenade log : http://logs.openstack.org/98/151998/1/check/check-grenade-dsvm/94c1693/logs/grenade.sh.txt.gz | 09:49 |
*** e0ne has quit IRC | 09:49 | |
abhijeetm | error is : pkg_resources.ContextualVersionConflict: (oslo.config 1.4.0 (/usr/local/lib/python2.7/dist-packages), Requirement.parse('oslo.config>=1.6.0'), set(['tempest-lib'])) | 09:50 |
*** tmcpeak has quit IRC | 09:50 | |
*** e0ne has joined #openstack-infra | 09:50 | |
*** tmcpeak has joined #openstack-infra | 09:50 | |
*** markvoelker has quit IRC | 09:51 | |
*** otter768 has joined #openstack-infra | 09:51 | |
abhijeetm | Is there any bug already filed for it? | 09:52 |
*** jyuso has quit IRC | 09:52 | |
*** SlickNik has quit IRC | 09:52 | |
*** jyuso has joined #openstack-infra | 09:52 | |
*** jpich has quit IRC | 09:52 | |
*** vigneshvar has quit IRC | 09:52 | |
*** AJaeger has quit IRC | 09:53 | |
*** jerryz has quit IRC | 09:53 | |
*** BadCub has quit IRC | 09:53 | |
*** gibi_ has quit IRC | 09:54 | |
*** gibi has joined #openstack-infra | 09:54 | |
*** BadCub has joined #openstack-infra | 09:54 | |
*** jcoufal has quit IRC | 09:55 | |
*** otter768 has quit IRC | 09:55 | |
*** mase_home has quit IRC | 09:57 | |
*** SlickNik has joined #openstack-infra | 09:58 | |
*** hichihara has quit IRC | 09:58 | |
*** salv-orlando has quit IRC | 10:00 | |
*** mpaolino has quit IRC | 10:01 | |
*** belmoreira has quit IRC | 10:01 | |
*** niska has quit IRC | 10:02 | |
*** AJaeger has joined #openstack-infra | 10:05 | |
*** esker has quit IRC | 10:05 | |
*** vigneshvar has joined #openstack-infra | 10:05 | |
*** skolekonov has joined #openstack-infra | 10:05 | |
*** jpich has joined #openstack-infra | 10:06 | |
*** chlong has joined #openstack-infra | 10:09 | |
*** jedimike has joined #openstack-infra | 10:10 | |
*** avozza is now known as zz_avozza | 10:13 | |
*** dizquierdo has quit IRC | 10:13 | |
AJaeger | naggappan: do you still need help? | 10:13 |
*** mpaolino has joined #openstack-infra | 10:14 | |
*** _nadya_ has joined #openstack-infra | 10:14 | |
naggappan | Hi AJaeger . Thanks got it | 10:18 |
AJaeger | naggappan: great! | 10:18 |
*** mika has quit IRC | 10:18 | |
openstackgerrit | Merged openstack-infra/release-tools: Support neutron advanced services https://review.openstack.org/150845 | 10:19 |
naggappan | Hi AJaeger . I am actually looking for gate-neutron-python27 job and you have mentioned about check-grenade-dsvm | 10:20 |
*** jerryz has joined #openstack-infra | 10:20 | |
naggappan | @AJaeger . I have done a CI setup for internal purpose. And for each checkin i need to execute neutron unit test job. So thats why i need the exact job yamal file | 10:21 |
openstackgerrit | Merged openstack-infra/release-tools: Be more informative when putting -2 for stable freeze https://review.openstack.org/153184 | 10:22 |
*** e0ne is now known as e0ne_ | 10:23 | |
*** yamamoto has joined #openstack-infra | 10:23 | |
*** yamamoto has quit IRC | 10:24 | |
naggappan | like it should execute unit test using tox and generate the repote in html formate | 10:24 |
*** e0ne_ is now known as e0ne | 10:25 | |
*** ihrachyshka has quit IRC | 10:25 | |
*** zz_johnthetubagu is now known as johnthetubaguy | 10:25 | |
*** dizquierdo has joined #openstack-infra | 10:25 | |
openstackgerrit | Merged openstack-infra/release-tools: Ignore release-tag dirs when running flake8 https://review.openstack.org/150600 | 10:25 |
openstackgerrit | Merged openstack-infra/release-tools: allow sanity check to report multiple warnings https://review.openstack.org/150601 | 10:26 |
*** sasik has joined #openstack-infra | 10:29 | |
*** sasik has left #openstack-infra | 10:29 | |
*** sasik has joined #openstack-infra | 10:30 | |
*** sasik has left #openstack-infra | 10:30 | |
*** zz_avozza is now known as avozza | 10:31 | |
*** andreykurilin_ has quit IRC | 10:31 | |
*** ihrachyshka has joined #openstack-infra | 10:31 | |
*** mika has joined #openstack-infra | 10:32 | |
*** jcoufal has joined #openstack-infra | 10:33 | |
*** skolekonov has quit IRC | 10:33 | |
*** avozza is now known as zz_avozza | 10:34 | |
tchaypo | and now I have lovely wifi on a train. Italy is marvellous. | 10:35 |
AJaeger | naggappan: This is all defined in project-config repo. | 10:37 |
AJaeger | The job-template python-jobs is defined for neutron | 10:37 |
openstackgerrit | Merged openstack-infra/storyboard: OAuth Storage Abstraction Removed https://review.openstack.org/153106 | 10:38 |
AJaeger | If you grep in jenkins/jobs/*yaml, you'll find the template defined in file python-jobs.yaml as 'gate-{name}-python27' | 10:38 |
openstackgerrit | Guido Günther proposed stackforge/python-jenkins: Don't throw exception on empty response https://review.openstack.org/153398 | 10:38 |
openstackgerrit | Guido Günther proposed stackforge/python-jenkins: Don't assume we get a valid response https://review.openstack.org/153399 | 10:38 |
AJaeger | naggappan: hope that helps | 10:38 |
openstackgerrit | Merged openstack-infra/storyboard: OAuth Functional Tests https://review.openstack.org/153068 | 10:40 |
naggappan | AJaeger. Yes i will look into these things now. Currenlty I use tox and run the unit test for neutron. Once its done i get the result in ".testrepository/$ID" . I have to convert this to html. You have any idea on this. I am looking for those job yamal file just to get this information only | 10:40 |
*** _nadya_ has quit IRC | 10:43 | |
*** markvoelker has joined #openstack-infra | 10:47 | |
*** ldnunes has joined #openstack-infra | 10:49 | |
*** Guest75042 has quit IRC | 10:51 | |
*** skolekonov has joined #openstack-infra | 10:52 | |
*** markvoelker has quit IRC | 10:52 | |
*** jgallard__ has quit IRC | 10:53 | |
*** ociuhandu has joined #openstack-infra | 10:54 | |
*** jgallard__ has joined #openstack-infra | 10:54 | |
AJaeger | naggappan: jenkins/jobs/* contains all the definitions for it and jenkins/scripts are the scripts we use. | 10:54 |
*** dims__ has joined #openstack-infra | 10:54 | |
*** pblaho has joined #openstack-infra | 10:55 | |
naggappan | ok AJaeger thanks | 10:55 |
*** amotoki has joined #openstack-infra | 10:56 | |
AJaeger | naggappan: read also http://ci.openstack.org/third_party.html - it explains everything on how to setup a 3rd party CI system | 10:56 |
*** jgallard__ has quit IRC | 10:57 | |
*** jgallard__ has joined #openstack-infra | 10:57 | |
AJaeger | naggappan, there's also a weekly meeting of all people running such CI systems | 10:57 |
*** koolhead17 has joined #openstack-infra | 10:57 | |
naggappan | Ok | 10:59 |
naggappan | i will attend the meeting AJAaeger. | 10:59 |
*** ihrachyshka has quit IRC | 11:00 | |
AJaeger | naggappan: AFAIR it's Mondays, but check the OpenStack meeting calendar for details. | 11:00 |
*** belmoreira has joined #openstack-infra | 11:01 | |
*** rfolco has joined #openstack-infra | 11:02 | |
*** cdent has joined #openstack-infra | 11:04 | |
*** _nadya_ has joined #openstack-infra | 11:11 | |
*** jgallard__ has quit IRC | 11:12 | |
*** jgallard__ has joined #openstack-infra | 11:12 | |
*** koolhead17 has quit IRC | 11:18 | |
*** reed has joined #openstack-infra | 11:20 | |
*** isviridov_away is now known as isviridov | 11:20 | |
*** isviridov is now known as isviridov_launch | 11:21 | |
*** rlandy has joined #openstack-infra | 11:21 | |
*** yamamoto has joined #openstack-infra | 11:24 | |
*** ihrachyshka has joined #openstack-infra | 11:25 | |
*** yamamoto has quit IRC | 11:29 | |
*** pelix has joined #openstack-infra | 11:30 | |
*** denis_makogon has joined #openstack-infra | 11:32 | |
*** cdent has quit IRC | 11:33 | |
*** cdent has joined #openstack-infra | 11:35 | |
*** koolhead17 has joined #openstack-infra | 11:36 | |
*** ihrachyshka has quit IRC | 11:40 | |
*** pc_m has joined #openstack-infra | 11:40 | |
*** cdent_ has joined #openstack-infra | 11:42 | |
*** zigo has quit IRC | 11:42 | |
*** pblaho has quit IRC | 11:42 | |
*** pblaho_ has joined #openstack-infra | 11:42 | |
*** cdent has quit IRC | 11:42 | |
*** cdent_ is now known as cdent | 11:42 | |
*** markvoelker has joined #openstack-infra | 11:48 | |
*** aysyd has joined #openstack-infra | 11:48 | |
*** otter768 has joined #openstack-infra | 11:52 | |
*** e0ne is now known as e0ne_ | 11:54 | |
*** markvoelker has quit IRC | 11:54 | |
*** mrmartin has quit IRC | 11:56 | |
*** mika has quit IRC | 11:56 | |
*** mikap has joined #openstack-infra | 11:56 | |
*** mikap is now known as mika | 11:56 | |
*** otter768 has quit IRC | 11:56 | |
*** swamireddy has quit IRC | 11:58 | |
*** ameade has quit IRC | 11:58 | |
*** cdent has quit IRC | 11:58 | |
*** bradjones has quit IRC | 11:59 | |
*** e0ne_ is now known as e0ne | 11:59 | |
*** simonmcc has quit IRC | 11:59 | |
*** zul has joined #openstack-infra | 11:59 | |
*** ihrachyshka has joined #openstack-infra | 12:00 | |
*** Guest60279 has quit IRC | 12:00 | |
*** cdent has joined #openstack-infra | 12:00 | |
*** zul has quit IRC | 12:01 | |
*** simonmcc has joined #openstack-infra | 12:01 | |
*** ameade has joined #openstack-infra | 12:01 | |
*** zul has joined #openstack-infra | 12:01 | |
*** Vivek has joined #openstack-infra | 12:01 | |
*** Vivek is now known as Guest71978 | 12:02 | |
*** bradjones has joined #openstack-infra | 12:02 | |
*** julim has quit IRC | 12:04 | |
*** ociuhandu has quit IRC | 12:05 | |
*** d34dh0r53 has quit IRC | 12:06 | |
*** julim has joined #openstack-infra | 12:06 | |
*** russellb has quit IRC | 12:06 | |
*** jroll has quit IRC | 12:06 | |
*** dizquierdo has quit IRC | 12:07 | |
*** d34dh0r53 has joined #openstack-infra | 12:08 | |
*** russellb has joined #openstack-infra | 12:09 | |
*** ociuhandu has joined #openstack-infra | 12:09 | |
*** sileht_ has joined #openstack-infra | 12:10 | |
openstackgerrit | Merged openstack/requirements: Add newly released oslo debtcollector library https://review.openstack.org/153410 | 12:14 |
*** ihrachyshka has quit IRC | 12:15 | |
*** pblaho_ has quit IRC | 12:15 | |
*** ihrachyshka has joined #openstack-infra | 12:15 | |
*** maurosr has quit IRC | 12:17 | |
*** jgrimmn has joined #openstack-infra | 12:19 | |
*** zul has quit IRC | 12:19 | |
*** koolhead17 has quit IRC | 12:19 | |
*** skolekonov has quit IRC | 12:19 | |
*** vigneshvar has quit IRC | 12:19 | |
*** BharatK has quit IRC | 12:19 | |
*** esmute has quit IRC | 12:19 | |
*** che-arne has quit IRC | 12:19 | |
*** imcsk8 has quit IRC | 12:19 | |
*** erikmwilson has quit IRC | 12:19 | |
*** prad-afk has quit IRC | 12:19 | |
*** therve has quit IRC | 12:19 | |
*** sweston has quit IRC | 12:19 | |
*** dougwig has quit IRC | 12:19 | |
*** willroberts_ has quit IRC | 12:19 | |
*** medberry has quit IRC | 12:19 | |
*** dmsimard_away has quit IRC | 12:19 | |
*** funzo has quit IRC | 12:19 | |
*** jkt has quit IRC | 12:19 | |
*** morgabra has quit IRC | 12:19 | |
*** comstud has quit IRC | 12:19 | |
*** Hunner has quit IRC | 12:19 | |
*** sc68cal has quit IRC | 12:19 | |
*** sileht has quit IRC | 12:19 | |
*** jvrbanac has quit IRC | 12:19 | |
*** msuriar has quit IRC | 12:19 | |
*** wendar has quit IRC | 12:19 | |
*** zz_dimtruck has quit IRC | 12:19 | |
*** dtroyer has quit IRC | 12:19 | |
*** cyeoh has quit IRC | 12:19 | |
*** mgagne has quit IRC | 12:19 | |
*** rainya has quit IRC | 12:19 | |
*** rossella_s has quit IRC | 12:19 | |
*** Zenet has quit IRC | 12:19 | |
*** zz_jgrimm has quit IRC | 12:19 | |
*** dtantsur|afk has quit IRC | 12:19 | |
*** anthonyper has quit IRC | 12:19 | |
*** sileht_ is now known as sileht | 12:19 | |
*** maurosr has joined #openstack-infra | 12:19 | |
*** pblaho__ has joined #openstack-infra | 12:19 | |
*** dizquierdo has joined #openstack-infra | 12:21 | |
*** jroll has joined #openstack-infra | 12:21 | |
*** zul has joined #openstack-infra | 12:21 | |
*** koolhead17 has joined #openstack-infra | 12:21 | |
*** skolekonov has joined #openstack-infra | 12:21 | |
*** vigneshvar has joined #openstack-infra | 12:21 | |
*** BharatK has joined #openstack-infra | 12:21 | |
*** esmute has joined #openstack-infra | 12:21 | |
*** che-arne has joined #openstack-infra | 12:21 | |
*** imcsk8 has joined #openstack-infra | 12:21 | |
*** erikmwilson has joined #openstack-infra | 12:21 | |
*** prad-afk has joined #openstack-infra | 12:21 | |
*** therve has joined #openstack-infra | 12:21 | |
*** sweston has joined #openstack-infra | 12:21 | |
*** dougwig has joined #openstack-infra | 12:21 | |
*** willroberts_ has joined #openstack-infra | 12:21 | |
*** anthonyper has joined #openstack-infra | 12:21 | |
*** medberry has joined #openstack-infra | 12:21 | |
*** dmsimard_away has joined #openstack-infra | 12:21 | |
*** funzo has joined #openstack-infra | 12:21 | |
*** jkt has joined #openstack-infra | 12:21 | |
*** morgabra has joined #openstack-infra | 12:21 | |
*** comstud has joined #openstack-infra | 12:21 | |
*** Hunner has joined #openstack-infra | 12:21 | |
*** sc68cal has joined #openstack-infra | 12:21 | |
*** jvrbanac has joined #openstack-infra | 12:21 | |
*** msuriar has joined #openstack-infra | 12:21 | |
*** wendar has joined #openstack-infra | 12:21 | |
*** zz_dimtruck has joined #openstack-infra | 12:21 | |
*** dtroyer has joined #openstack-infra | 12:21 | |
*** cyeoh has joined #openstack-infra | 12:21 | |
*** mgagne has joined #openstack-infra | 12:21 | |
*** rossella_s has joined #openstack-infra | 12:21 | |
*** rainya has joined #openstack-infra | 12:21 | |
*** Zenet has joined #openstack-infra | 12:21 | |
*** dtantsur|afk has joined #openstack-infra | 12:21 | |
*** ihrachyshka has quit IRC | 12:24 | |
*** baoli has joined #openstack-infra | 12:26 | |
*** aysyd has quit IRC | 12:27 | |
*** aysyd has joined #openstack-infra | 12:27 | |
*** pblaho__ has quit IRC | 12:28 | |
*** sileht has quit IRC | 12:28 | |
*** sileht has joined #openstack-infra | 12:28 | |
*** baoli has quit IRC | 12:29 | |
*** ihrachyshka has joined #openstack-infra | 12:30 | |
*** baoli has joined #openstack-infra | 12:30 | |
*** jaypipes has joined #openstack-infra | 12:31 | |
*** rfolco has quit IRC | 12:31 | |
*** rfolco has joined #openstack-infra | 12:33 | |
*** rfolco has quit IRC | 12:35 | |
*** rfolco has joined #openstack-infra | 12:36 | |
*** tkelsey has quit IRC | 12:40 | |
*** doude has quit IRC | 12:40 | |
*** doude has joined #openstack-infra | 12:44 | |
*** markvoelker has joined #openstack-infra | 12:50 | |
*** hashar has joined #openstack-infra | 12:50 | |
*** hashar has quit IRC | 12:52 | |
*** markvoelker has quit IRC | 12:54 | |
openstackgerrit | Christian Berendt proposed openstack-dev/hacking: Add hacking check H106: Use the correct capitalization of OpenStack https://review.openstack.org/153547 | 12:58 |
*** markvoelker has joined #openstack-infra | 13:04 | |
*** swamireddy has joined #openstack-infra | 13:05 | |
*** hashar has joined #openstack-infra | 13:06 | |
*** koolhead17 has quit IRC | 13:07 | |
*** dalgaaf has joined #openstack-infra | 13:07 | |
*** kgiusti has joined #openstack-infra | 13:08 | |
*** mbacchi has joined #openstack-infra | 13:09 | |
*** woodster_ has joined #openstack-infra | 13:15 | |
*** tkelsey has joined #openstack-infra | 13:17 | |
*** dims__ has quit IRC | 13:17 | |
*** alexpilotti has joined #openstack-infra | 13:19 | |
*** ghostpl has quit IRC | 13:21 | |
*** dprince has joined #openstack-infra | 13:21 | |
*** bhunter71 has joined #openstack-infra | 13:24 | |
*** dkliban_afk is now known as dkliban | 13:25 | |
*** abhijeetm has quit IRC | 13:25 | |
*** dims_ has joined #openstack-infra | 13:25 | |
naggappan | to run unit test of any project, say neutron is it required to install other projects like cinder,nova,keystone,horizon etc. ? | 13:26 |
*** Guest75042 has joined #openstack-infra | 13:27 | |
openstackgerrit | Mehdi Abaakouk proposed openstack-infra/project-config: gnocchi: add swift and ceph functional obs https://review.openstack.org/153555 | 13:28 |
*** bknudson has quit IRC | 13:28 | |
sileht | naggappan, no | 13:28 |
*** bswartz has quit IRC | 13:28 | |
*** ghostpl has joined #openstack-infra | 13:30 | |
naggappan | sileht : but I just downloaded neutron repo and run ./run_test.sh in ubuntu. Which ran for long time and gave me only 2 faill and few skip. Others all went fine | 13:30 |
*** spzala has joined #openstack-infra | 13:39 | |
*** hashar has quit IRC | 13:40 | |
sileht | naggappan, you should use 'tox' not ./run_tests.sh | 13:42 |
*** ddieterly has quit IRC | 13:45 | |
naggappan | sileht: Oh ok. i just that there is no difference except tox uses nose test and saves the log | 13:46 |
*** vigneshvar has quit IRC | 13:47 | |
*** mwagner_lap has quit IRC | 13:48 | |
*** swamireddy has quit IRC | 13:50 | |
*** ihrachyshka has quit IRC | 13:51 | |
naggappan | Sileht: just now in another channel #openstack-neutron <ihrachyshka> confirmed that to run unit test just source tree is fine | 13:51 |
*** otter768 has joined #openstack-infra | 13:52 | |
*** spzala has quit IRC | 13:55 | |
*** ihrachyshka has joined #openstack-infra | 13:55 | |
openstackgerrit | Mehdi Abaakouk proposed openstack-infra/project-config: gnocchi: add swift and ceph functional obs https://review.openstack.org/153555 | 13:56 |
*** andreaf has quit IRC | 13:56 | |
*** andreaf has joined #openstack-infra | 13:57 | |
openstackgerrit | Mehdi Abaakouk proposed openstack-infra/project-config: gnocchi: add swift and ceph functional jobs https://review.openstack.org/153555 | 13:57 |
*** otter768 has quit IRC | 13:57 | |
sileht | fungi, AJaeger sdague, I have added the bashate job in gnocchi and I got NOT_REGISTERED :( (example: https://review.openstack.org/#/c/153329/) any idea ? | 13:58 |
AJaeger | sileht: let me check... | 13:58 |
sileht | AJaeger, thanks | 13:59 |
sileht | This error always confumes me, I have to no clue of what I can do to understand what I have done wrong in the project-config git | 14:00 |
AJaeger | a recheck still gets a NOT_REGISTERED. | 14:00 |
sileht | AJaeger, all gnocchi jobs fail since I have added the job | 14:00 |
AJaeger | sileht: yeah ;( | 14:01 |
AJaeger | fungi, any ideas? | 14:01 |
fungi | how recently was that job added? and how soon afterward did that run? | 14:02 |
AJaeger | patch for the bashate job merged 6+ hours ago https://review.openstack.org/#/c/152064/5/jenkins/jobs/projects.yaml | 14:02 |
AJaeger | and was run 3 hours afterwards - and now again | 14:02 |
AJaeger | status.o.o/zuul still shows NOT_REGISTERED | 14:02 |
fungi | okay, so it's still broken? the 153329 change sileht linked would have run moments after the job was created in zuul | 14:03 |
fungi | i'll check the jenkins masters and zuul logs for clues | 14:03 |
*** jroll has quit IRC | 14:03 | |
*** jroll has joined #openstack-infra | 14:03 | |
AJaeger | thanks, fungi | 14:04 |
*** hdd has joined #openstack-infra | 14:04 | |
AJaeger | 153329 was run 2hours afterwards AFAIU | 14:04 |
AJaeger | 152064/ merged at 6:26 UTC | 14:04 |
AJaeger | and 153329 failed at 9:11 | 14:04 |
*** mfink_ has joined #openstack-infra | 14:04 | |
fungi | oh, you said the job creation change merged 6+ hours ago. that's definitely on the + side of 6+ | 14:04 |
fungi | (like nearly 8) | 14:05 |
AJaeger | Sorry for not beiing accurate enough - was multitasking and maths got off ;( | 14:05 |
fungi | no problem. i was erring on the side of "maybe this is a known issue" based on your fuzzy math ;) | 14:05 |
fungi | 2015-02-06 14:00:13,266 INFO zuul.Gearman: Build <gear.Job 0x7f27a91b25d0 handle: None name: build:gate-gnocchi-bashate:bare-trusty unique: 3344b63e77484d3e92ee03bb8788e95a> complete, result NOT_REGISTERED | 14:06 |
fungi | zuul's gearman status has no matches for gate-gnocchi-bashate | 14:07 |
*** jaypipes is now known as leakypipes | 14:07 | |
openstackgerrit | Sergey Kulanov proposed openstack-infra/project-config: Add Fuel LMA collector Plugin to Stackforge https://review.openstack.org/153570 | 14:07 |
AJaeger | it does not exist on jenkins01 either ;( | 14:08 |
fungi | right, no /var/lib/jenkins/jobs/gate-gnocchi-bashate directory | 14:08 |
fungi | presumably the other jenkins masters are the same | 14:08 |
fungi | so jjb is failing to add it | 14:08 |
fungi | trying a manual run of jenkins-jobs update now to see if it's got some good errors for us | 14:08 |
*** dustins has joined #openstack-infra | 14:09 | |
* sileht have no luck with jenkins-job-builder :( | 14:09 | |
fungi | whee! http://paste.openstack.org/show/168126/ | 14:09 |
*** mjturek1 has joined #openstack-infra | 14:10 | |
fungi | AttributeError: 'Jenkins' object has no attribute 'get_plugins_info' | 14:10 |
sileht | outch | 14:10 |
fungi | so this is either a recent change to jjb or python-jenkins | 14:10 |
*** tiswanso has joined #openstack-infra | 14:10 | |
fungi | time to find out which | 14:10 |
AJaeger | Argh ;( | 14:10 |
*** radez_g0n3 is now known as radez | 14:11 | |
AJaeger | sileht: So now it's a known error, please have patience while fungi debugs... | 14:11 |
sileht | AJaeger, sure | 14:11 |
sileht | thanks a lot | 14:11 |
sileht | I have a job in oslo.messaging stuck with the same message: https://review.openstack.org/#/c/146047/ | 14:12 |
*** bswartz has joined #openstack-infra | 14:12 | |
sileht | I guess once you fix the issue, you rebuild all jenkins jobs ? | 14:12 |
fungi | last update to stackforge/python-jenkins was 10 days ago so my money's on something hitting openstack-infra/jenkins-job-builder in the last day or so | 14:12 |
fungi | sileht: once we get a fix merged to jjb everything should start working for those jobs (assuming we don't have other problems hiding behind that one) | 14:13 |
sileht | fungi, ok cool, thanks a lot | 14:13 |
fungi | just need a few minutes to git grep, blame, revert, review, repeat ;) | 14:14 |
AJaeger | fungi: I1cae480a9a341ec2f6062904c962530dfce95057 includes a "import yaml" | 14:14 |
sileht | AJaeger, fungi: https://github.com/openstack-infra/jenkins-job-builder/commit/b4e5aa9b7762a8e3ea24d55bffc6928ecde0a28c | 14:14 |
sileht | it's a bit old, do run master branch of jjb ? | 14:15 |
AJaeger | fungi check https://review.openstack.org/#/c/132927/36/jenkins_jobs/cmd.py line 22 | 14:15 |
fungi | sileht: yeah, my blame is taking me to the same commit | 14:16 |
fungi | AJaeger: the warning you're hunting down may be unrelated to the exception | 14:16 |
*** swamireddy has joined #openstack-infra | 14:16 | |
*** isviridov_launch is now known as isviridov | 14:16 | |
AJaeger | fungi: yeah | 14:16 |
fungi | sileht: yeah, https://review.openstack.org/132927 merged yesterday | 14:17 |
fungi | sileht: i'll try manually reverting that patch on one of the jenkins masters and see if it clears the problem | 14:17 |
*** rm_work|away is now known as rm_work | 14:17 | |
AJaeger | fungi: A typo, it should be get_plugin_info but is get_plugins_info. | 14:18 |
AJaeger | Let me send a patch after double checking... | 14:18 |
fungi | AJaeger: oh, good eye | 14:18 |
*** ddieterly has joined #openstack-infra | 14:19 | |
*** joesavak has joined #openstack-infra | 14:20 | |
*** ihrachyshka has quit IRC | 14:20 | |
*** jlibosva has joined #openstack-infra | 14:21 | |
*** skolekonov has quit IRC | 14:22 | |
fungi | AJaeger: the jenkins_jobs.builder.ModuleRegistry class has a get_plugin_info method, but the traceback is for jenkins.Jenkins.get_plugins_info so may not be related | 14:22 |
fungi | looking in the python-jenkins source now to confirm | 14:22 |
openstackgerrit | Sergey Kulanov proposed openstack-infra/project-config: Add Fuel LMA collector Plugin to Stackforge https://review.openstack.org/153570 | 14:22 |
sileht | fungi, jenkins.Jenkins have get_plugin_info too | 14:23 |
sileht | it have both | 14:23 |
fungi | yep, both | 14:23 |
sileht | the code looks correct | 14:23 |
fungi | looking to see if we have an old python-jenkins installed | 14:23 |
openstackgerrit | Andreas Jaeger proposed openstack-infra/jenkins-job-builder: Fix typo, it's get_plugin_info https://review.openstack.org/153574 | 14:23 |
*** annegent_ has joined #openstack-infra | 14:24 | |
fungi | maybe jjb needs to bump it's req min on that | 14:24 |
nibalizer | fungi: we had to bump python-jenkins in ours this morning | 14:24 |
fungi | python-jenkins==0.4.0 and jenkins-job-builder==1.1.0.35.g74c8ac4 | 14:24 |
nibalizer | rcarrillocruz: knows the details | 14:24 |
AJaeger | mmh, so my patch is not needed? ;( | 14:24 |
AJaeger | Very confusing... | 14:24 |
fungi | AJaeger: probably not. i'm looking now to see what the earliest release is that contains that method | 14:25 |
fungi | something between 0.4.0 and 0.4.4 apparently | 14:25 |
sileht | fungi, this method require >= 0.4.1 | 14:25 |
fungi | sileht: agreed according to git tag --contains b50c59aa (which i got from blame) | 14:26 |
AJaeger | I see now that python-jenkins has both, so will abandon my JJB patch again | 14:26 |
fungi | patch on the way | 14:26 |
rcarrillocruz | what's up | 14:26 |
rcarrillocruz | ah | 14:26 |
rcarrillocruz | so yeah | 14:26 |
rcarrillocruz | you need to upgrade python-jenkins | 14:26 |
rcarrillocruz | cos a commit for JJB that was merged last night uses get_plugin_info, which is dependent on functionality from latest python-jenkins | 14:27 |
rcarrillocruz | fungi: ^ | 14:27 |
rcarrillocruz | 0.4.4 works for us | 14:27 |
*** yamamoto has joined #openstack-infra | 14:27 | |
*** jlibosva has quit IRC | 14:28 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/jenkins-job-builder: Depend on python-jenkins 0.4.1 or later https://review.openstack.org/153576 | 14:28 |
fungi | rcarrillocruz: nibalizer: sileht: AJaeger: ^ | 14:28 |
sileht | fungi, thanks | 14:28 |
* sileht hopes it solves its oslo.messaging job issues too | 14:29 | |
fungi | pelix: zaro: mgagne: https://review.openstack.org/153576 needs +2/approval | 14:30 |
*** yamamoto_ has joined #openstack-infra | 14:30 | |
fungi | jhesketh: SergeyLukjanov: clarkb: jeblair: mordred: ^ if any of you are around | 14:30 |
AJaeger | thanks, fungi! | 14:30 |
SergeyLukjanov | fungi, I'm here | 14:30 |
mordred | on it | 14:30 |
fungi | dogpile. awesome | 14:31 |
openstackgerrit | Guido Günther proposed openstack-infra/jenkins-job-builder: Lazy load plugin list https://review.openstack.org/153396 | 14:31 |
* fungi goes to top up the coffee | 14:31 | |
openstackgerrit | Merged openstack-infra/storyboard-webclient: Fix to show errors again https://review.openstack.org/153176 | 14:31 |
SergeyLukjanov | fungi, +2'd | 14:32 |
*** mattfarina has joined #openstack-infra | 14:32 | |
*** bswartz has quit IRC | 14:33 | |
*** yamamoto has quit IRC | 14:34 | |
*** ZZelle has quit IRC | 14:35 | |
*** zz_gondoi is now known as gondoi | 14:35 | |
*** ZZelle has joined #openstack-infra | 14:35 | |
openstackgerrit | Sergey Kulanov proposed openstack-infra/project-config: Add Fuel LMA collector Plugin to Stackforge https://review.openstack.org/153570 | 14:36 |
*** gondoi is now known as zz_gondoi | 14:36 | |
*** hashar has joined #openstack-infra | 14:36 | |
*** bswartz has joined #openstack-infra | 14:38 | |
openstackgerrit | Merged openstack-infra/project-config: add stable compat jobs to python-barbicanclient https://review.openstack.org/150645 | 14:38 |
*** bknudson has joined #openstack-infra | 14:39 | |
*** scheuran has quit IRC | 14:41 | |
mordred | fungi: I read that as "fungi goes to the top of the coffee" | 14:43 |
*** zz_gondoi is now known as gondoi | 14:43 | |
* fungi is more buoyant that coffee | 14:45 | |
fungi | er, than | 14:45 |
openstackgerrit | Merged openstack-infra/jenkins-job-builder: Depend on python-jenkins 0.4.1 or later https://review.openstack.org/153576 | 14:45 |
*** _amrith_ is now known as amrith | 14:47 | |
*** asselin__ has joined #openstack-infra | 14:48 | |
AJaeger | fungi, do we need to approve now another patch for project-config to push out all changes? | 14:49 |
*** koolhead17 has joined #openstack-infra | 14:50 | |
fungi | AJaeger: you can if you want, though i planned to re-run jjb on the jenkins masters manually as soon as i see python-jenkins get upgraded everywhere | 14:51 |
*** rlandy has quit IRC | 14:51 | |
*** ildikov has quit IRC | 14:52 | |
*** ChuckC has quit IRC | 14:52 | |
AJaeger | fungi, I approved all patches I could this morning ;) So, now somebody else needs to review and approve | 14:52 |
AJaeger | One candidate: https://review.openstack.org/#/c/153173/ | 14:52 |
fungi | aww, now you're guilting me into doing reviews ;) | 14:53 |
fungi | maybe i can get my stats up to top infra reviewer this way | 14:53 |
* AJaeger wasn't subtile enough, sorry | 14:54 | |
fungi | heh | 14:54 |
*** annegent_ has quit IRC | 14:55 | |
*** zz_dimtruck is now known as dimtruck | 14:55 | |
*** ddieterly has quit IRC | 14:55 | |
*** markus_z has quit IRC | 14:55 | |
*** ddieterly has joined #openstack-infra | 14:55 | |
fungi | AJaeger: that one looked fine so i approved it, but it doesn't actually create any new jobs so i don't think it would have necessarily triggered a jjb update on the jenkins masters | 14:57 |
*** ghostpl has quit IRC | 14:57 | |
*** hashar has quit IRC | 14:57 | |
*** hashar has joined #openstack-infra | 14:57 | |
AJaeger | fungi: ah, I see | 14:57 |
*** dhritishikhar_ has joined #openstack-infra | 14:58 | |
*** signed8bit has joined #openstack-infra | 14:59 | |
AJaeger | now it gets more complicated, there're too many patches that Jenkins gave a -1... | 14:59 |
fungi | well, i should be able to start the manual jjb runs here momentarily now anyway | 15:00 |
*** signed8b_ has joined #openstack-infra | 15:01 | |
*** hashar has quit IRC | 15:01 | |
*** amrith is now known as _amrith_ | 15:01 | |
*** tonytan4ever has joined #openstack-infra | 15:02 | |
*** ghostpl has joined #openstack-infra | 15:02 | |
*** armax has joined #openstack-infra | 15:03 | |
openstackgerrit | Merged openstack-infra/project-config: Add Fuel Contrail Plugin to Stackforge https://review.openstack.org/153173 | 15:03 |
*** r-daneel has joined #openstack-infra | 15:03 | |
*** yamamoto_ has quit IRC | 15:04 | |
*** asselin__ has quit IRC | 15:04 | |
*** signed8bit has quit IRC | 15:04 | |
*** dimtruck is now known as zz_dimtruck | 15:05 | |
openstackgerrit | Aleksey Ripinen proposed openstack-infra/storyboard: Added controller for refresh tokens https://review.openstack.org/153591 | 15:05 |
*** hdd has quit IRC | 15:05 | |
*** asselin__ has joined #openstack-infra | 15:05 | |
openstackgerrit | Nikita Konovalov proposed openstack-infra/storyboard: User abort call instead of returning response https://review.openstack.org/152515 | 15:07 |
*** dansmith is now known as superdan | 15:08 | |
*** nelsnelson has joined #openstack-infra | 15:08 | |
*** annegent_ has joined #openstack-infra | 15:09 | |
*** asselin__ has quit IRC | 15:12 | |
*** yamahata has joined #openstack-infra | 15:13 | |
*** GheRivero has joined #openstack-infra | 15:13 | |
*** mjturek1 has quit IRC | 15:13 | |
*** mjturek1 has joined #openstack-infra | 15:16 | |
*** mjturek1 has left #openstack-infra | 15:17 | |
*** stevemar has joined #openstack-infra | 15:17 | |
*** mjturek1 has joined #openstack-infra | 15:17 | |
*** swamireddy1 has joined #openstack-infra | 15:19 | |
*** timcline has joined #openstack-infra | 15:20 | |
*** ghostpl has quit IRC | 15:21 | |
*** swamireddy has quit IRC | 15:21 | |
*** jgrimmn is now known as zz_jgrimmn | 15:21 | |
sdague | fungi: ... all of stackforge is cached in d-g now? | 15:21 |
mordred | yah | 15:22 |
fungi | sdague: all of stackforge is cached on our workers in /opt/git | 15:22 |
fungi | sdague: not sure about d-g | 15:22 |
sdague | ok | 15:22 |
mordred | yah - I was answering about the workers | 15:22 |
*** signed8b_ has quit IRC | 15:22 | |
fungi | i'd have to go digging to see whether d-g is copying all of those into the devstack cachedir or just specific ones | 15:22 |
sdague | I'm trying to provide an example for out of tree plugin testing, I can work with that I think | 15:22 |
*** yamahata has quit IRC | 15:23 | |
fungi | man, our ansible/puppet runs really do take a while to complete, but the flock seems to be working at least | 15:23 |
clarkb | devstack is not copying all of them | 15:24 |
clarkb | but can be found at /opt/git | 15:24 |
openstackgerrit | Aleksey Ripinen proposed openstack-infra/storyboard: Added new paginate query https://review.openstack.org/153231 | 15:24 |
fungi | i think run_all.sh is taking >30m so we're getting one puppet apply every 45 minutes on our servers these days | 15:24 |
clarkb | wow | 15:24 |
*** mtanino has joined #openstack-infra | 15:25 | |
*** ghostpl has joined #openstack-infra | 15:25 | |
fungi | at this speed we should just run that script in a continuous loop | 15:25 |
mordred | morning clarkb | 15:25 |
*** dmsimard_away is now known as dmsimard | 15:25 | |
*** zz_dimtruck is now known as dimtruck | 15:25 | |
clarkb | morning | 15:25 |
jeblair | weird, i think it was taking 10 mins earlier, and most of that was cacti | 15:25 |
openstackgerrit | Merged openstack-infra/project-config: Remove unused env variable option for tenant isolation https://review.openstack.org/152007 | 15:26 |
fungi | hrm, well the current run started at 1500 and is still going | 15:26 |
openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: WIP: testing path for doing external plugins in d-g https://review.openstack.org/153597 | 15:27 |
*** tonytan4ever has quit IRC | 15:28 | |
*** tiswanso has quit IRC | 15:30 | |
*** wenlock has joined #openstack-infra | 15:31 | |
*** tiswanso_ has joined #openstack-infra | 15:32 | |
jeblair | sdague: i think i see where you're going with ^ and left a clarifying comment; lemme know if we're on the same page | 15:32 |
*** amitgandhinz has joined #openstack-infra | 15:32 | |
mriedem | anteaya: if people running third party ci have questions in the ML, what should they tag with? [qa]? | 15:33 |
dprince | Any chance we could get this new TripleO job in today: https://review.openstack.org/#/c/153341/ | 15:33 |
openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: WIP: testing path for doing external plugins in d-g https://review.openstack.org/153597 | 15:33 |
*** hashar has joined #openstack-infra | 15:33 | |
sdague | jeblair: yeh, I came to about the same conclusion at the same time :) | 15:34 |
sdague | maybe, round 2 will be right-ish? | 15:34 |
*** tonytan4ever has joined #openstack-infra | 15:34 | |
*** hashar has quit IRC | 15:34 | |
sdague | the ec2 folks pinged me privately trying to figure out how to setup jobs, and as they are actively asking good questions, I figured they might be the good base example to sort out the through path for external plugin + upstream testing | 15:35 |
*** hashar has joined #openstack-infra | 15:35 | |
mriedem | anteaya: looks like [ThirdPartyCI] is the tag and people mostly post to openstack-infra, so i think i've got my answer | 15:35 |
jeblair | sdague: sounds cool | 15:35 |
*** hashar has quit IRC | 15:36 | |
*** hashar has joined #openstack-infra | 15:37 | |
*** marun has joined #openstack-infra | 15:39 | |
*** dizquierdo has quit IRC | 15:40 | |
*** sabeen1 has joined #openstack-infra | 15:40 | |
*** dizquierdo has joined #openstack-infra | 15:41 | |
*** hashar has quit IRC | 15:41 | |
*** koolhead17 has quit IRC | 15:41 | |
*** _nadya_ has quit IRC | 15:42 | |
*** salv-orlando has joined #openstack-infra | 15:43 | |
fungi | okay, python-jenkins is showing at the latest release on all the jenkins masters right now (except for jenkins-dev which has some puppet issues), but i'm getting a new entrypoint related exception now: http://paste.openstack.org/show/168168/ | 15:43 |
fungi | mordred: does ^ that look familiar? | 15:43 |
*** signed8bit has joined #openstack-infra | 15:43 | |
*** dannywilson has joined #openstack-infra | 15:43 | |
*** hdd has joined #openstack-infra | 15:44 | |
*** MaxV has quit IRC | 15:44 | |
fungi | ohhhh | 15:44 |
fungi | we seem to also have python-jenkins debs installed | 15:44 |
mordred | fail | 15:44 |
* fungi curses | 15:45 | |
openstackgerrit | Pranav Salunke proposed openstack-infra/project-config: Updates training guides jobs https://review.openstack.org/152118 | 15:45 |
clarkb | mordred denis sent mail to list about what inner requirement are. in response to your -2 (want to make sure you see that) | 15:45 |
mordred | clarkb: awesome | 15:46 |
mordred | clarkb: my main tl;dr is - we seem to be reinventing debian packages - so perhaps we've reached the point where we should just figure out doing that | 15:46 |
clarkb | jeblair sdague when you get that sorted would be good to pass the info along to the glusterfs job | 15:47 |
mordred | because "I only want these depends if I have these optional subcomponents" is the type of complexity that that handles very well | 15:47 |
sdague | clarkb: agreed | 15:47 |
clarkb | mordred right. more importantly this change does nothing to solve that | 15:47 |
mordred | yah | 15:49 |
*** adalbas has joined #openstack-infra | 15:49 | |
mordred | I'll follow up with an email there soo | 15:49 |
mordred | soon | 15:49 |
mordred | I _do_ think that there is a feature taht's already in pip/setuptools that dstufft mentions that pbr could and should grow smarts about | 15:49 |
fungi | ugh, and python-setuptools deb is also installed on the jenkins masters | 15:49 |
mordred | that is related to the underlying problem they're trying to solve here | 15:49 |
mordred | fungi: ew gross - what installed it? | 15:50 |
*** mfink_ has quit IRC | 15:50 | |
fungi | mordred: i'm going to go back through the dpkg log, but probably an unattended upgrade of something depending on it | 15:50 |
dstufft | mordred: setuptools extras yea | 15:50 |
mordred | fungi: yay! | 15:50 |
dstufft | setuptools extras are named lists of dependencies which are opt-in and not installed by default | 15:50 |
mordred | dstufft: yah. although - I don't want to generate more people thinking they're going to get more complex dpkg-style dep handling as we get more and more complicated here ... I think we're already overdoing things as it is | 15:51 |
mordred | (as evidenced by the number of thigns we do that make you want to hide) | 15:51 |
dstufft | Here's ane xtra: https://github.com/kennethreitz/requests/blob/master/setup.py#L65-L67 | 15:52 |
dstufft | you can depend on that by using ``requests[security]`` | 15:52 |
dstufft | anywhere you'd normally use just ``requests]`` | 15:52 |
clarkb | extras doesnt fix this | 15:52 |
fungi | i worry that projects are trying to treat requirements lists as a substitute for install documentation | 15:52 |
*** dhritishikhar_ has quit IRC | 15:53 | |
clarkb | they want some way to say if amqp option selected then install only amqp extras | 15:53 |
dstufft | what is selecting the amqp option mean | 15:53 |
clarkb | thats the tricky bit that isnt solved :) | 15:53 |
dstufft | because you can do ``oslo.messaging[ampq]`` | 15:53 |
fungi | install oslo.messaging to work with amqp, so don't install the bits it only needs to use rabbitmq | 15:53 |
*** otter768 has joined #openstack-infra | 15:54 | |
dstufft | which will install the ampq bits | 15:54 |
*** lnxnut has joined #openstack-infra | 15:54 | |
dstufft | but you won't get the ampq bits if you install ``oslo.message`` | 15:54 |
clarkb | dstufft sure but how as a user does that get passed into pip | 15:54 |
clarkb | via devstack or whatever calling process | 15:54 |
clarkb | theres a lot more to it than just change this string | 15:54 |
clarkb | especially since oslo.messaging is a dep of everything else | 15:55 |
*** mfink_ has joined #openstack-infra | 15:55 | |
dstufft | how someone signals to devstack they want a particular extra I dunno, just saying that you don't need to invent anything new on the packaging side if that's all you need, you just need some bits to wire up devstack to installing the extras | 15:56 |
clarkb | dstufft even when nova install oslo.messaging as a dep? | 15:56 |
clarkb | or you make two passes? | 15:56 |
*** tiswanso_ has quit IRC | 15:56 | |
clarkb | I guess you could say installing oslo.messaging wont ever install a workable system. then require an explicit install of an extras set | 15:57 |
jroll | as a deployer, 1) I don't want to have to specify which oslo.messaging extras to install, besides what's in the project requirements.txt, and 2) I have no problem with oslo.messaging installing a dependency that I don't use | 15:58 |
*** yamahata has joined #openstack-infra | 15:58 | |
*** otter768 has quit IRC | 15:58 | |
jroll | clarkb: got a pointer to whatever started this? | 15:58 |
*** kgiusti1 has joined #openstack-infra | 15:59 | |
*** tiswanso_ has joined #openstack-infra | 15:59 | |
dstufft | do two passes or add an ``oslo.messaging[ampq]`` onto the list of things to install, or have nova support an ampq extra as well, the two pass is probably less error prone until pip has a proper dependency resolver, then adding ``oslo.messaging[ampq]`` should be equivilant | 15:59 |
openstackgerrit | Thanh Ha proposed openstack-infra/jenkins-job-builder: Add support for new patchset-created exclude fields https://review.openstack.org/140095 | 15:59 |
*** _amrith_ is now known as amrith | 15:59 | |
clarkb | http://lists.openstack.org/pipermail/openstack-dev/2015-February/056205.html | 15:59 |
fungi | jroll: i have to assume it came up in an oslo weekly meeting? i haven't seen a link to the original discussion which arrived at this decision anywhere | 15:59 |
clarkb | yes dont know where original discussion was | 16:00 |
clarkb | anyways I no understand extras better so win :) | 16:00 |
clarkb | *now | 16:00 |
dhellmann | clarkb: I think we'll probably need 2 passes. We already do some custom logic for different backends. This would simplify that a bit, and put the dependency list in oslo.messaging instead of devstack, which will make it easier to keep it up to date. | 16:00 |
*** kgiusti has quit IRC | 16:00 | |
fungi | dhellmann: is the underlying reason for this that amqp and rabbitmq conflict in some way such that you can't install the deps for both? | 16:01 |
dhellmann | fungi, jroll: I saw some mention of this, and I know bnemec has been experimenting with extras in pbr, but this wasn't something we've discussed. | 16:01 |
clarkb | dhellmann the precipitating change said "it was decided" | 16:01 |
dhellmann | fungi: well, we don't want oslo.messaging to always depend on both as a matter of principle, though maybe the simpler solution is to reconsider that | 16:01 |
fungi | dhellmann: ahh, the original commit message said "it has been decided" which left us asking "where and by whom?" | 16:01 |
clarkb | implying oslo had decided to do this | 16:02 |
dhellmann | clarkb: ok, I don't think I was involved in deciding | 16:02 |
dstufft | at some point we want to add the ability to have "opt out" extras too, right now extras are always opt in | 16:02 |
dstufft | but idk when that'll happen | 16:02 |
*** MarkAtwood has joined #openstack-infra | 16:02 | |
dhellmann | clarkb, fungi : "original change"? I saw something on the dev list a few minutes ago | 16:02 |
AJaeger | dhellmann: https://review.openstack.org/153227 | 16:03 |
fungi | personal opinion, but people wanting to add more and more complexity to our workarounds for the lack of a dep solver in pip is to spend that time improving pip to handle these cases better instead | 16:03 |
dhellmann | fungi, clarkb : "it was decided" without a reference is certainly a reason for a -1 | 16:04 |
dhellmann | AJaeger: thanks | 16:04 |
clarkb | but I think we understand the issue now | 16:05 |
*** yamamoto has joined #openstack-infra | 16:05 | |
dhellmann | fungi: I agree, but I'm not sure that's where this was coming from. I think we just don't want everyone to have to install amqp, zmq, kombu, etc. if they're only going to use one of them. | 16:05 |
*** rfolco has quit IRC | 16:05 | |
clarkb | and importantly mordred can figure out how he want pbr to deal with it | 16:05 |
bnemec | This actually came out of a discussion about a year ago: http://lists.openstack.org/pipermail/openstack-dev/2014-February/026976.html | 16:05 |
jroll | I don't really see this solving any problems - are projects going to stop listing oslo.messaging in requirements.txt and require deployers to choose which "version" of oslo.messaging to install? | 16:05 |
dhellmann | clarkb: yeah, I'd like to see a spec for this so we have a record of it | 16:05 |
jroll | that seems annoying at best | 16:05 |
bnemec | +1 to a spec. | 16:06 |
bnemec | The original change pre-dated that whole process. | 16:06 |
AJaeger | cross-distro spec? | 16:06 |
dhellmann | jroll: no, I think the idea is to help packagers understand what other dependencies are needed given a particular backend service choice | 16:06 |
dhellmann | bnemec: right | 16:06 |
dhellmann | AJaeger: if we're going to solve this in pbr, it's an oslo spec I think | 16:06 |
AJaeger | at least it needs changes in infra as well;) | 16:07 |
dhellmann | jroll: right now that's falling to documentation, which makes automating tooling more challenging | 16:07 |
jroll | dhellmann: so how do I install, say nova, with pip, if this changes? | 16:07 |
*** isviridov is now known as isviridov_away | 16:07 | |
jroll | dhellmann: I don't use requirements.txt as docs, I use it to install dependencies | 16:07 |
dhellmann | jroll: you might have to pip install oslo.messaging with your backend expressed first, and then install nova | 16:07 |
*** david-lyle_afk is now known as david-lyle | 16:07 | |
fungi | dhellmann: we're not really "making" people install everything (pip is one of many deployment options), but if that's really worth avoiding then just put one backend in the requirements and people can remove/install a different one if they need? | 16:07 |
*** mpaolino has quit IRC | 16:07 | |
jroll | dhellmann: yeah, that seems backwards, idk | 16:08 |
*** carl_baldwin has joined #openstack-infra | 16:08 | |
dhellmann | jroll: I'm not sure it's completely possible to deploy nova from pip, though, and that's not something we necessarily care about is it? | 16:08 |
bnemec | fungi: I think that's basically what we're doing today. | 16:08 |
dhellmann | fungi: that's what we do now | 16:08 |
bnemec | We could leave that be, and then provide the alternative requirements for them to also install if they want a different backend. | 16:08 |
fungi | so where did the friction against that come from? | 16:08 |
jroll | dhellmann: it is, pip install -e git+https://git.openstack.org/openstack/nova#egg=nova | 16:08 |
clarkb | dhellman it almost is actually. you just need libvirt and lxml deps if you use pymysql | 16:08 |
jroll | dhellmann: not everyone uses distro packages | 16:08 |
dhellmann | fungi: people who run non-default backends don't want other libs installed? I really don't know why we care, but that's what we're getting. | 16:08 |
fungi | this goes back to my original concern that projects are trying to use requirements files as a replacement for better install documentation | 16:09 |
dhellmann | bnemec: let's get a spec put together to at least explain the problem we're trying to solve | 16:09 |
jroll | fungi: +1 | 16:09 |
jroll | and +1 for a spec | 16:09 |
clarkb | ok some one should respond to list saying this deserves a spec in oslo (because pbr) | 16:09 |
clarkb | I can do that if you like | 16:09 |
*** rfolco has joined #openstack-infra | 16:09 | |
dhellmann | jroll: I built a cloud based on packages like that, so I know, and I know that I had to script the installation of things that were not expressed as dependencies | 16:09 |
*** tonytan_brb has joined #openstack-infra | 16:09 | |
dhellmann | clarkb: I'll do that | 16:10 |
clarkb | then we can express the problem and potential solutions there | 16:10 |
clarkb | kk | 16:10 |
*** tonytan4ever has quit IRC | 16:10 | |
*** yamamoto has quit IRC | 16:10 | |
fungi | agreed. a spec would be great because it still feels to me like it's venturing into "solution searching for a problem" territory | 16:10 |
*** shashankhegde has joined #openstack-infra | 16:10 | |
bnemec | fungi: Isn't that just moving the requirements list from a usable place (a requirements file) to a place (documentation) that users have to install all the things manually (which they'll probably do by...creating a requirements file)? | 16:11 |
clarkb | yup especially since the solution initially proposed doesnt fix the problem | 16:11 |
jroll | dhellmann: right, required python dependencies that aren't in requirements.txt make me sad | 16:11 |
fungi | bnemec: a requirements file is a usable place. a bunch of different requirements files less so | 16:11 |
bnemec | fungi: I still don't see how a bunch of different lists in documentation is better than a bunch of different requirements files. :-/ | 16:12 |
bnemec | But maybe we should save this for the spec discussion. | 16:12 |
*** alaski is now known as lascii | 16:12 | |
clarkb | bnemec no use onereqs file | 16:12 |
fungi | bnemec: well, you'd still need to document the distinction between the requirements files | 16:12 |
dhellmann | jroll: is zmq "required" if you're using amqp? | 16:12 |
*** salv-orlando has quit IRC | 16:13 | |
dhellmann | I've sent email to the list asking denis for a spec | 16:13 |
clarkb | dhellmann no but installing it isnt likely to hurt (because we sort of check you can install everything together today) | 16:13 |
*** salv-orlando has joined #openstack-infra | 16:13 | |
*** koolhead17 has joined #openstack-infra | 16:14 | |
bnemec | I think I initially suggested an install all the things strategy and there was a lot of pushback. | 16:14 |
jroll | dhellmann: no, but oslo.messaging is, and if oslo.messaging isn't in requirements.txt so that I can avoid installing a zmq library... | 16:14 |
dhellmann | clarkb: "install it all" and "stop adding so many dependencies" have different proponents :-/ | 16:14 |
clarkb | at worst its a problem for packagers and you can specify non overlapping sets in more expected to work with existing tools ways | 16:14 |
*** hdd has quit IRC | 16:14 | |
*** AJaeger has quit IRC | 16:14 | |
dhellmann | jroll: i don't understand what you're saying there. I don't think anyone is suggesting removing oslo.messaging from your requirements list. | 16:14 |
openstackgerrit | Aleksey Ripinen proposed openstack-infra/storyboard: Added milestones https://review.openstack.org/152500 | 16:14 |
*** rfolco has quit IRC | 16:15 | |
dhellmann | really, I don't care about this problem, I'm just trying to explain the history. Someone else needs to be the advocate for any particular approach. | 16:15 |
jroll | dhellmann: so by default, install all the oslo.messaging backends and let deployers remove them at will? | 16:15 |
*** dannywilson has quit IRC | 16:15 | |
fungi | jroll: _if_ you're using pip | 16:15 |
fungi | jroll: distro packages will generally have much better inbuilt mechanisms for optional selections | 16:16 |
*** dannywilson has joined #openstack-infra | 16:16 | |
jroll | fungi: sure | 16:16 |
jroll | I guess I don't know how many deployers use pip versus distro packages | 16:16 |
*** rfolco has joined #openstack-infra | 16:16 | |
anteaya | mriedem: yes posting to -infra ml, in which case tagging is optional | 16:17 |
bnemec | TripleO by default installs everything from source/pip to allow for CD. | 16:17 |
fungi | this goes back to "we're working around lack of features in pip, why not improve pip?" | 16:17 |
dstufft | jroll: fungi dhellmann fwiw you won't have to install oslo.messaging first, you could install it at the same time (but you might hit problems b/c of lack of dep solver) or install it later, also nova could also provide an extra that just installs the oslo.messaging extra (though I don't know if you can have an extra that depends on something you depend on + some extras, that might cause an error until we get the better dep solver) | 16:17 |
dstufft | e.g. having install_requires=["oslo.messaging"], extras_require={"ampq": ["oslo.messaging[ampq]"]} might raise an error currently I'm not sure, but if we get a better depsolver that won't be the case for sure | 16:18 |
fungi | dstufft: yeah, entirely likely we'll have situations where package a uses package b and c but b also uses c and we want to specify optional dependencies in c | 16:18 |
fungi | which i guess means install c directly first with specific options, then a | 16:19 |
fungi | and hope pip dtrt with it | 16:19 |
*** jcoufal has quit IRC | 16:19 | |
*** signed8b_ has joined #openstack-infra | 16:19 | |
dstufft | that's something that pip _should_ handle for sure though, it might not currently though because pip doesn't handle multiple specifiers for the same thing very well | 16:19 |
clarkb | fwiw I am with jroll for practical deployment reasosn. if nova + oslo.messaging support amqp and zmq I sant support for both installed so I can switch with config changes and not require redeployment | 16:21 |
*** openstackgerrit has quit IRC | 16:21 | |
dstufft | oslo.messaging[ampq,zmq] :D | 16:21 |
clarkb | zmq and amqp are both supported | 16:21 |
clarkb | therefore their deps are required | 16:22 |
*** openstackgerrit has joined #openstack-infra | 16:22 | |
fungi | jeblair: so the 15:00 run_all.sh took ~43 minutes to complete, then another started at 15:45 which completed at ~16:06 so it does seem somewhat variable | 16:22 |
clarkb | its a bit odd for me to say upfront "I will never use X functionality so please never install it" | 16:22 |
jroll | clarkb: I just think this isn't actually solving a real problem | 16:22 |
*** signed8bit has quit IRC | 16:23 | |
jroll | but will wait for the spec | 16:23 |
clarkb | fungi I am planning to look and see if I can narrow it down to trpuble hosts/manifests | 16:23 |
fungi | clarkb: clarkb it looks like the run for git02 may have taken ~25 minutes during the 15:00 utc session | 16:24 |
openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Add support for volume attach/detach https://review.openstack.org/153623 | 16:24 |
fungi | clarkb: so maybe this is centos 6 git remote timeout problems once again | 16:25 |
*** thedodd has joined #openstack-infra | 16:25 | |
clarkb | fungi: and since that runs before everything else would certainly slow down the pipeline | 16:25 |
fungi | indeed | 16:25 |
fungi | given the frequency we're seeing this manifest in multiple contexts, we should probably try to narrow down what causes it | 16:26 |
*** annegent_ has quit IRC | 16:26 | |
*** rmcall has joined #openstack-infra | 16:26 | |
dstufft | ianw: btw did pip 6.0.8 fix things? | 16:26 |
fungi | clarkb: i still _strongly_ suspect the glibc update | 16:26 |
fungi | clarkb: i'm going to hold a centos6 nodepool node and try to reproduce | 16:27 |
clarkb | fungi: it was the major change between when it didn't do this and when it started | 16:27 |
clarkb | fungi: ok | 16:27 |
krtaylor | mriedem, actually "third-party" is the agreed topic filter tag -> http://lists.openstack.org/cgi-bin/mailman/options/openstack-dev/kurt.r.taylor@gmail.com/?VARHELP=Third+Party+CI+group | 16:27 |
fungi | clarkb: but first i need to finish figuring out how to fix jjb on the jenkins masters | 16:27 |
clarkb | can I ask for reviews of the stack that starts at https://review.openstack.org/#/c/153093/1 ? at least for the first three changes there. WIll get multinode testing working for nova network again | 16:27 |
clarkb | and those jobs are experimental on a few projects now so will start seeing more wide use | 16:28 |
krtaylor | mriedem, substituting your email in url of course | 16:28 |
fungi | clarkb: http://paste.openstack.org/show/168168/ ring any bells? i'm trying to unwind and currently suspect the distro packages for setuptools, pkg_resources, pip, et cetera since they're all installed on our jenkins masters | 16:28 |
clarkb | fungi: anything I can do to help there. maybe we need an ansible script/command? | 16:28 |
openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: WIP: testing path for doing external plugins in d-g https://review.openstack.org/153597 | 16:28 |
fungi | clarkb: purging python-setuptools wants to tear out a ton of other distro python packages with it | 16:29 |
openstackgerrit | yolanda.robla proposed openstack-infra/infra-specs: Add nodepool image testing spec. https://review.openstack.org/139598 | 16:29 |
clarkb | fungi: does pip freeze show python-jenkins>=0.4.1 is installed? | 16:29 |
fungi | clarkb: yep | 16:29 |
*** ildikov has joined #openstack-infra | 16:29 | |
fungi | clarkb: however distro python-jenkins was also present according to dpkg | 16:29 |
clarkb | what if we just remove python-jenkins the distro package? | 16:29 |
fungi | clarkb: removing that and reinstalling python-jenkins via pip didn't help | 16:29 |
*** dangers_away is now known as dangers | 16:30 | |
fungi | clarkb: so then i tried upgrading pbr from 0.10.0 to 0.10.7 but that just got it to start similarly complaining that it couldn't find its pbr dep at that point | 16:30 |
clarkb | setuptools (0.6rc11) | 16:30 |
fungi | twisty maze of package problems, all alike | 16:30 |
clarkb | I am going to guess that that is part of the problem | 16:30 |
*** mjturek1 has quit IRC | 16:30 | |
clarkb | fungi: try a pip install -U setuptools? | 16:31 |
fungi | clarkb: yep, that's from the ubuntu precise python-setuptools package | 16:31 |
*** otter768 has joined #openstack-infra | 16:31 | |
clarkb | then do the things you did above again | 16:31 |
fungi | trying now in hopes of sanity | 16:31 |
*** Guest75042 has quit IRC | 16:31 | |
*** mjturek1 has joined #openstack-infra | 16:31 | |
*** carl_baldwin has quit IRC | 16:31 | |
fungi | clarkb: yeah, pip install of latest setuptools and not removing the distro package seems to have worked for now | 16:32 |
fungi | i'll do the same on the rest of the jenkins masters | 16:32 |
clarkb | cool | 16:33 |
clarkb | I am guessing bug in old pkg_resources which is part of setuptools | 16:33 |
*** rmcall has quit IRC | 16:33 | |
*** koolhead17 has quit IRC | 16:33 | |
*** koolhead17 has joined #openstack-infra | 16:34 | |
*** rmcall has joined #openstack-infra | 16:34 | |
*** carl_baldwin has joined #openstack-infra | 16:36 | |
*** dtantsur|afk is now known as dtantsur | 16:36 | |
*** dims_ is now known as dimsum__ | 16:39 | |
marun | jhesketh: https://review.openstack.org/#/c/146762/ now has a +2 from jeblair. I hope I've managed to satisfy your concerns as well! | 16:39 |
zxiiro | 2 months, 13 patchsets later I hope my patch gets merged soon :) | 16:40 |
*** mwagner_lap has joined #openstack-infra | 16:40 | |
*** unicell has quit IRC | 16:41 | |
openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Add support for volume attach/detach https://review.openstack.org/153623 | 16:41 |
clarkb | zxiiro: the gerrit trigger change? still has my +2 right? | 16:43 |
zxiiro | clarkb: no because I had to revise it. Waiting for Darragh to +2 though. Seems to be a very picky reviewer :) | 16:43 |
*** jgallard__ has quit IRC | 16:44 | |
*** naggappan has quit IRC | 16:44 | |
*** swamireddy has joined #openstack-infra | 16:44 | |
openstackgerrit | Sean Dague proposed openstack-infra/system-config: update indexer for apache logs https://review.openstack.org/153627 | 16:45 |
sdague | clarkb: ^^^ | 16:45 |
fungi | zxiiro: he's pelix in here by the way | 16:45 |
sdague | we aren't indexing keystone by default :( | 16:45 |
zxiiro | fungi: ah good to know. now I know who to bug :D | 16:45 |
fungi | sdague: since there are no bugs in keystone, that saves us on storage ;) | 16:46 |
*** tonytan_brb has quit IRC | 16:46 | |
sdague | fungi: except, you know, this one - https://bugs.launchpad.net/keystone/+bug/1419043 | 16:46 |
openstack | Launchpad bug 1419043 in Keystone "Conflict on isolated credential setup" [Critical,Confirmed] - Assigned to Matthew Treinish (treinish) | 16:46 |
*** swamireddy1 has quit IRC | 16:46 | |
sdague | which I can't see how often it happens | 16:46 |
*** tonytan4ever has joined #openstack-infra | 16:46 | |
fungi | sdague: yeah, i figured that was precipitated by you digging into a keystone bug | 16:47 |
zxiiro | pelix: woohoo thanks! clarkb can you review the patch just needs you +2 again? https://review.openstack.org/140095/ | 16:47 |
sdague | also... I think we aren't indexing horizon any more for similar reasons | 16:47 |
*** prad has joined #openstack-infra | 16:47 | |
pelix | zxiiro: sorry about missing the little things, if I paid more attention I'd spot them all the first time :p | 16:47 |
zxiiro | pelix: no worries. I appreciate projects ensuring their code quality is high. | 16:48 |
clarkb | zxiiro: ya let me deal with this log thing first | 16:48 |
clarkb | fungi: I am +2 on sdague's log change. Both log files exist and look to be in the format sdague has them listed as | 16:49 |
openstackgerrit | Merged openstack-infra/project-config: Add pylint jobs to service modules https://review.openstack.org/153373 | 16:49 |
clarkb | fungi: want to review that really quicky? | 16:49 |
*** signed8b_ is now known as signed8bit_ZZZzz | 16:49 | |
*** carl_baldwin has quit IRC | 16:49 | |
*** carl_baldwin_ has joined #openstack-infra | 16:49 | |
fungi | sdague: clarkb: is oslofmt correct for apache logs? | 16:51 |
fungi | i honestly haven't compared keystone's apache logs to more typical service logs but would have thought they'd be more like typical apache log format | 16:51 |
fungi | clarkb: sounds good | 16:51 |
clarkb | ya see sdagues comment | 16:51 |
*** marun has quit IRC | 16:51 | |
clarkb | keystone uses oslo format even running in apache | 16:52 |
clarkb | horizon error log is apache though | 16:52 |
fungi | huh. fun! | 16:52 |
clarkb | I checked too | 16:52 |
*** dhellmann_ has quit IRC | 16:53 | |
*** koolhead17 has quit IRC | 16:53 | |
*** dhellmann_ has joined #openstack-infra | 16:54 | |
*** signed8bit_ZZZzz is now known as signed8b_ | 16:56 | |
*** dhellmann_ has quit IRC | 16:56 | |
*** ashleighfarnham has joined #openstack-infra | 16:56 | |
*** shashankhegde has quit IRC | 16:56 | |
*** annegent_ has joined #openstack-infra | 16:57 | |
clarkb | zxiiro: approved. Also since you're here you should check out zuul for even more awesome jenkins jobs triggered by gerrit events | 16:57 |
*** _nadya_ has joined #openstack-infra | 16:57 | |
*** dhellmann_ has joined #openstack-infra | 16:57 | |
clarkb | zxiiro: http://ci.openstack.org/zuul/ | 16:58 |
zxiiro | clarkb: I've seen zuul it is pretty cool. You guys demoed some of it for us when I worked at the Eclipse Foundation. | 16:58 |
zxiiro | clarkb: we're looking into installing it at The Linux Foundation in the future | 16:58 |
*** ChuckC has joined #openstack-infra | 16:58 | |
*** dhellmann_ has quit IRC | 16:59 | |
clarkb | cool | 16:59 |
*** vigneshvar has joined #openstack-infra | 16:59 | |
*** dhellmann_ has joined #openstack-infra | 16:59 | |
fungi | zxiiro: you can see the current activity for our zuul deployment at http://status.openstack.org/zuul/ too | 17:00 |
*** tonytan4ever has quit IRC | 17:00 | |
fungi | it's reasonably busy at the moment | 17:00 |
*** tonytan4ever has joined #openstack-infra | 17:00 | |
fungi | okay, jenkins masters are all updated and jjb confirmed working on them again | 17:00 |
zxiiro | fungi: that's pretty neat. When it's busy seems like it's a little overwhelming to look at :) | 17:00 |
*** hdd has joined #openstack-infra | 17:01 | |
*** carl_baldwin_ has quit IRC | 17:01 | |
fungi | zxiiro: yeah, it's tracking a lot... and we've been working over time to condense that display more and more | 17:01 |
*** otter768 has quit IRC | 17:01 | |
fungi | zxiiro: the bluish boxes are change state summaries which you can click to expand and see actual job completion details | 17:02 |
openstackgerrit | Merged openstack-infra/jenkins-job-builder: Add support for new patchset-created exclude fields https://review.openstack.org/140095 | 17:02 |
*** sarob has joined #openstack-infra | 17:02 | |
clarkb | looks like vivid finally has a cgit package | 17:02 |
clarkb | though we probably shouldn't run the mirrors on that | 17:03 |
fungi | clarkb: not sure i want to hang my hopes on ubuntu 16.04 lts to fix the current issues we have ;) | 17:03 |
clarkb | fungi: we could however potentially run them off of centos7 | 17:03 |
*** carl_baldwin has joined #openstack-infra | 17:03 | |
clarkb | if it comes to that should be relatively easy to swap out backends assuming that we don't have to chagne much puppet | 17:03 |
zxiiro | do all of your jenkins masters have every job? or are the jobs on one master somewhere that distributes them out? | 17:03 |
clarkb | zxiiro: most masters have every job, but they registers with zuul via gearman so we only distribute jobs where they are available | 17:04 |
*** annegent_ has quit IRC | 17:04 | |
clarkb | s/registers/register/ | 17:04 |
fungi | clarkb: anyway i'm switching gears now to start seeing if i can recreate and debug the recent centos 6 git remote hangs | 17:04 |
*** kgiusti1 has quit IRC | 17:04 | |
clarkb | fungi: let me know if I can help. Otherwise I will be spending my time this morning reviewing | 17:04 |
fungi | please review. we have a lot of changes to get through ;) | 17:04 |
*** sdake_ has quit IRC | 17:04 | |
zxiiro | right so where do you push your JJB configuration to? | 17:05 |
fungi | zxiiro: we keep it in git managed by gerrit. you can browse it at http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/ | 17:05 |
*** crc32 has joined #openstack-infra | 17:06 | |
fungi | zxiiro: it's continuously deployed onto our jenkins masters via configuration management, and jjb runs to update each jenkins master triggered from local updates to those files | 17:06 |
*** carl_baldwin has quit IRC | 17:06 | |
*** thedodd has quit IRC | 17:06 | |
*** annegent_ has joined #openstack-infra | 17:07 | |
fungi | zxiiro: so basically developers can propose changes to the jjb configuration and once they're proposed they're automatically deployed, active and start running to test new changes | 17:07 |
fungi | er, once they're approved | 17:07 |
zxiiro | ah ok so I guess each jenkins master receives the jobs via a JJB script that updates them when someone pushes in a change | 17:07 |
zxiiro | or do you push it to a single master which lets zuul/gearman distribute them out? | 17:07 |
fungi | zxiiro: more or less, yes | 17:07 |
*** talluri has joined #openstack-infra | 17:08 | |
*** kgiusti has joined #openstack-infra | 17:08 | |
fungi | zxiiro: we use ansible to trigger puppet agent on each jenkins master to retrieve the full body of configuration and then apply it locally on them if changed | 17:08 |
zxiiro | ok, yeah that's the piece of the puzzle I've been confused about. Good to know thanks :) | 17:08 |
*** thedodd has joined #openstack-infra | 17:09 | |
*** rwsu-afk is now known as rwsu | 17:09 | |
fungi | so all jobs get created on all masters, but then they only individually register into zuul's gearman the jobs they have workers capable of running | 17:09 |
zxiiro | i wasn't clear on if only one master had all the jobs and gearman just somehow passes them along, or if you actually go to every master and push jobs to them | 17:09 |
zxiiro | so that explains it :) | 17:09 |
zxiiro | very cool | 17:10 |
fungi | for the most part they all have representatives of all our worker types, but we do have one jenkins master which has separately privileged workers to do things that require service credentials (like uploading releases) | 17:10 |
*** markvan has quit IRC | 17:10 | |
*** carl_baldwin has joined #openstack-infra | 17:10 | |
*** sarob has quit IRC | 17:10 | |
fungi | because the jenkins master/slave design counter-intuitively doesn't really provide any security separation and lets slaves run some things on masters | 17:11 |
fungi | hence our isolated master for more sensitive jobs | 17:11 |
*** annegent_ has quit IRC | 17:12 | |
*** sarob has joined #openstack-infra | 17:12 | |
fungi | where none of its slaves run arbitrary proposed changes, but rather only trusted code | 17:12 |
*** Ala has quit IRC | 17:12 | |
dprince | jeblair: hi, any chance we could get a quick turn around on https://review.openstack.org/#/c/153341/ | 17:12 |
zxiiro | oh i see | 17:12 |
fungi | zxiiro: honestly, we were all rather surprised to discover not only that jenkins masters let slaves tell them to run arbitrary things, but that it was actually an intentional design choice | 17:13 |
odyssey4me | a general question - is it possible to do multi-node build tests within openstack-infra? if so, are there examples I can look at - the only reference to multinode appears to be a nodepool script | 17:13 |
dstufft | fungi: jenkins is not good software | 17:13 |
*** vigneshvar has quit IRC | 17:14 | |
fungi | dstufft: we're weaning ourselves off of it, thankfully, so we get to stop worrying about that at some point | 17:14 |
zxiiro | good to know. I don't think we've realized that yet so I'll have to raise it with our infra team | 17:14 |
clarkb | odyssey4me: it is possible let me get an example | 17:14 |
dstufft | fungi: to turbohipster? or something else? | 17:14 |
zxiiro | anyway I need to head out for some lunch. Have a wonderful day everyone :) | 17:14 |
fungi | dstufft: probably turbohipster, yes. there are some changes in flight to get a turbohipster gearman worker up and running | 17:14 |
clarkb | odyssey4me: https://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/devstack-gate.yaml#n1657 | 17:15 |
*** carl_baldwin_ has joined #openstack-infra | 17:15 | |
*** sarob has quit IRC | 17:15 | |
*** carl_baldwin has quit IRC | 17:15 | |
*** carl_baldwin_ is now known as carl_baldwin | 17:15 | |
clarkb | fungi: I was just reviewing one of jhesketh's changes to nodepool to better support turbohipster, not sure I fully grok how it helps yet | 17:15 |
*** salv-orlando has quit IRC | 17:16 | |
clarkb | odyssey4me: note that the job itself isn't all that different, just tells devstack-gate to run on multiple nodes | 17:16 |
odyssey4me | thanks clarkb - it looks pretty much like any other job | 17:16 |
odyssey4me | what's the special suace that makes it go? | 17:16 |
*** abhirc has quit IRC | 17:17 | |
clarkb | odyssey4me: devstack-gate | 17:17 |
clarkb | odyssey4me: it switches on the TOPOLOGY flag there | 17:17 |
zxiiro | fungi: actually before I go, do you have a link or some sort of article that explains the issue with Jenkins Master / Slaves running arbitrary code? | 17:18 |
fungi | zxiiro: let me dig it up | 17:18 |
*** jyuso has quit IRC | 17:18 | |
*** pczesno has quit IRC | 17:18 | |
*** jyuso has joined #openstack-infra | 17:18 | |
*** heyongli has quit IRC | 17:18 | |
fungi | zxiiro: the jenkins documentation has some details https://wiki.jenkins-ci.org/display/JENKINS/Slave+To+Master+Access+Control | 17:18 |
fungi | zxiiro: looks like they've (recently) started to introduce features to limit that behavior | 17:19 |
*** fabo has quit IRC | 17:19 | |
*** koolhead17 has joined #openstack-infra | 17:19 | |
openstackgerrit | Adam Gandelman proposed openstack-infra/shade: Adds get_network() and list_networks function https://review.openstack.org/150649 | 17:20 |
*** hdd has quit IRC | 17:20 | |
*** achuprin_ has quit IRC | 17:20 | |
*** rwsu has quit IRC | 17:20 | |
odyssey4me | clarkb: so that makes it use the 'devstack-trusty-2-node' zuul node | 17:21 |
*** fabo has joined #openstack-infra | 17:21 | |
*** fabo has joined #openstack-infra | 17:21 | |
fungi | zxiiro: the releases they mention there are ~3-4 months new | 17:21 |
*** belmoreira has quit IRC | 17:21 | |
zxiiro | fungi: thanks! | 17:22 |
fungi | zxiiro: sure thing. let us know if there's anything else we can do to help! | 17:22 |
odyssey4me | clarkb does the name imply that it's two nodes, so not really 'more than one node, up to x nodes'? | 17:22 |
*** ssam2 has quit IRC | 17:22 | |
*** heyongli has joined #openstack-infra | 17:23 | |
*** pczesno has joined #openstack-infra | 17:23 | |
clarkb | odyssey4me: the name implies 2 nodes let me get that node selection code | 17:23 |
morganfainberg | fungi, we can move the keystone logs back to apacheformat | 17:23 |
morganfainberg | it's easy | 17:23 |
*** nicodemos has joined #openstack-infra | 17:23 | |
fungi | odyssey4me: we have to define the node count in nodepool since the group of subnodes are built together and configured to have access to one another | 17:23 |
*** achuprin_ has joined #openstack-infra | 17:23 | |
clarkb | odyssey4me: https://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul/openstack_functions.py#n57 | 17:23 |
morganfainberg | but i jumped through hoops to make it oslo format for ease of use | 17:23 |
*** Ryan_Lane has joined #openstack-infra | 17:23 | |
clarkb | morganfainberg: no no no please no | 17:23 |
morganfainberg | fungi, happy to help reverting that if you'd like. :) | 17:23 |
*** zz_jgrimmn is now known as jgrimm | 17:23 | |
clarkb | apache format is terrible for applications | 17:23 |
fungi | morganfainberg: no need to change, i was just (pleasantly) surprised | 17:23 |
clarkb | its good for serving files | 17:23 |
clarkb | terrible for applications | 17:23 |
morganfainberg | clarkb, i figured you didn't want apache format | 17:23 |
morganfainberg | ;) | 17:23 |
*** e0ne has quit IRC | 17:24 | |
morganfainberg | fungi, we pushed for a apache 2.4 [and code in devstack] for that | 17:24 |
morganfainberg | fungi, trusty was a big win for us | 17:24 |
fungi | indeed | 17:24 |
morganfainberg | on that front | 17:24 |
fungi | 2.4 has some very nice features | 17:24 |
morganfainberg | like configurable access log format :P | 17:24 |
*** armax has quit IRC | 17:25 | |
fungi | just unfortunate that it breaks a fair amount of backward compatibility from 2.2 | 17:25 |
morganfainberg | and error log format | 17:25 |
morganfainberg | or stuff | 17:25 |
clarkb | morganfainberg: I rarely care about bytes transfered unless the thing I am dealing with is files :) | 17:25 |
fungi | but gotta break a few eggs to make a better webserver | 17:25 |
clarkb | and so on | 17:25 |
morganfainberg | fungi, hehe | 17:25 |
*** carl_baldwin has quit IRC | 17:25 | |
*** niska has joined #openstack-infra | 17:25 | |
morganfainberg | we could probably make horizon formats like oslo in 2.4 | 17:25 |
clarkb | jhesketh: I have reviewed 98306 without scoring it, curious to hear what you have to say about my comment there (and I realize it is your weekend so ignore me until monday) | 17:25 |
fungi | and after you've "fixed" a few dozen vhost configs from 2.2 to work with 2.4, it's not so hard | 17:26 |
clarkb | jeblair: you will probably be interested in 98306 as well | 17:26 |
*** koolhead17 has quit IRC | 17:26 | |
*** davideagnello has quit IRC | 17:27 | |
*** jpich has quit IRC | 17:28 | |
*** sigmavirus24_awa is now known as sigmavirus24 | 17:28 | |
*** marun has joined #openstack-infra | 17:28 | |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: OAuth Authorize Scope Validation https://review.openstack.org/153406 | 17:29 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: OAuth tests for authorize_return https://review.openstack.org/153407 | 17:29 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: OAuth validates redirect_uri https://review.openstack.org/153405 | 17:29 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: OAuth check for no response_type https://review.openstack.org/153107 | 17:29 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: OAuth checks for remote data access permissions. https://review.openstack.org/153409 | 17:29 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: OAuth Exception on invalid oauth return data https://review.openstack.org/153408 | 17:29 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: OAuth check for no client_id https://review.openstack.org/153108 | 17:29 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: OAuth check for response_type 'code' https://review.openstack.org/153069 | 17:29 |
krotscheck | Anyone want to help kick off a merge tornado? https://review.openstack.org/#/c/153069/ | 17:30 |
*** thedodd has quit IRC | 17:31 | |
*** thedodd has joined #openstack-infra | 17:31 | |
*** shashankhegde has joined #openstack-infra | 17:32 | |
fungi | mergenado | 17:33 |
fungi | it's the git equivalent of a sharknado | 17:33 |
*** davideagnello has joined #openstack-infra | 17:35 | |
mordred | fungi: what if there were sharks??? | 17:36 |
clarkb | mordred: see comment on 126621 | 17:36 |
fungi | mordred: then i'd want to know who committed sharks into a git repo | 17:37 |
mordred | fungi: I'd want to know who _didn't_ commit sharks into a git repo | 17:37 |
fungi | because that seems patently irresponsible | 17:37 |
fungi | and we're nothing but upstanding, responsible people up in here | 17:37 |
*** vigneshvar has joined #openstack-infra | 17:37 | |
*** sarob has joined #openstack-infra | 17:37 | |
JayF | $infra folks; https://review.openstack.org/153630 is a proposed patch to fix failing Tempest tests for Ironic. Is there anything you guys can do to promote the tests on the latest patchset so we can make sure it fixes it + get the gate for Ironic unstuck? | 17:38 |
mordred | clarkb: oh - well, group/groups are values that are magical to the ansible inventory | 17:40 |
mordred | clarkb: that said - the image_name in the groups param is out of date and not needed | 17:41 |
fungi | krotscheck: lgtm, approve at will | 17:41 |
mordred | ansible now knows how to just infer that | 17:41 |
mordred | clarkb: I can update that | 17:41 |
JayF | The tests on that seem to be running now already, without help fwiw, ty though anyway :) | 17:41 |
clarkb | mordred: well imo we don't need any of it :) | 17:42 |
*** armax has joined #openstack-infra | 17:42 | |
fungi | JayF: yay, we're helping! | 17:42 |
clarkb | mordred: we don't actually run ansible commands across our 900 slaves ever, its usually best to rebuild the images | 17:42 |
*** ghostpl has quit IRC | 17:42 | |
*** shashankhegde has quit IRC | 17:42 | |
JayF | fungi: Hey; it's the mechanic effect. If you want to make your car stop making the funny noise, take the mechanic for a ride, right? | 17:42 |
clarkb | mordred: but it doesn't hurt I was just curious about the redundancy. Why is image_name not needed? | 17:42 |
fungi | JayF: $1 for hitting it with a hammer and $499 for knowing where to hit it | 17:43 |
krotscheck | fungi: Thanks! | 17:43 |
clarkb | fungi: :) though I think the sum of money was much larger in the original story | 17:43 |
* krotscheck gets on the merge train! | 17:43 | |
clarkb | fungi: also chalk | 17:43 |
*** radez is now known as radez_g0n3 | 17:43 | |
*** rfolco has quit IRC | 17:43 | |
fungi | clarkb: true | 17:43 |
openstackgerrit | Merged openstack-infra/storyboard: OAuth check for response_type 'code' https://review.openstack.org/153069 | 17:44 |
*** bnemec is now known as beekneemech | 17:44 | |
*** ZZelle has quit IRC | 17:44 | |
*** sarob has quit IRC | 17:44 | |
*** rfolco has joined #openstack-infra | 17:44 | |
*** SumitNaiksatam has quit IRC | 17:45 | |
mordred | clarkb: image_name can and is inferred by the ansible inventory logic now | 17:45 |
mordred | clarkb: so - not ansible could do the same | 17:45 |
clarkb | mordred: gotcha | 17:45 |
openstackgerrit | Merged openstack-infra/system-config: update indexer for apache logs https://review.openstack.org/153627 | 17:45 |
mordred | clarkb: the main thing here is not that we do use ansible - but that there is this place we can put metadata about our servers | 17:45 |
clarkb | mordred: ya | 17:45 |
mordred | so that things poking around could ... OH - wait - I know why I added image_name | 17:45 |
mordred | because that's the logical image name from nodepool | 17:46 |
*** SumitNaiksatam has joined #openstack-infra | 17:46 | |
*** ChuckC has quit IRC | 17:46 | |
clarkb | mordred: I was also curious about the providers since that should be implicit but then realized that we map many nodepool providers onto specific cloud providers so it isn't 1:1 | 17:46 |
mordred | which is not the same as the image_name that the cloud is going to know | 17:46 |
mordred | yah | 17:46 |
* mordred remembers why he added those things ... | 17:46 | |
clarkb | ya so its probably all fine as sis | 17:46 |
clarkb | +2 | 17:46 |
mordred | it's basically to put the things in to nova metadata that right now you have to run nodepool db commands to find out | 17:46 |
*** annegent_ has joined #openstack-infra | 17:47 | |
fungi | are we gaining renewed confidence in stability/availability of nova metadata in our providers? | 17:47 |
clarkb | fungi: different metadata | 17:48 |
fungi | oh, not the things you query from the metadata service? | 17:48 |
clarkb | fungi: there is the nova metadata service which cloud init uses to set ssh and so forth. That particular thing isn't really reliable (as multinode testing has recently shown) | 17:49 |
openstackgerrit | Merged openstack-infra/storyboard: OAuth check for no response_type https://review.openstack.org/153107 | 17:49 |
*** rwsu has joined #openstack-infra | 17:49 | |
clarkb | fungi: the other metadata is when booting a new node you can attach properties to it as metadata that is queriable with novaclient | 17:49 |
openstackgerrit | Merged openstack-infra/storyboard: OAuth check for no client_id https://review.openstack.org/153108 | 17:49 |
clarkb | fungi: that should be reliable | 17:49 |
*** salv-orlando has joined #openstack-infra | 17:49 | |
fungi | got it. metadata for the nova api calls vs metadata for the instances to consume | 17:49 |
fungi | though presumably one flows into the other | 17:50 |
clarkb | maybe? its the VM consumption that is particularly problematic | 17:50 |
*** ZZelle has joined #openstack-infra | 17:50 | |
clarkb | because it uses the 169.254.169.254 address which is NATed to the nova api server which doesn't seem to work right | 17:50 |
openstackgerrit | Merged openstack-infra/storyboard: OAuth validates redirect_uri https://review.openstack.org/153405 | 17:50 |
clarkb | like its fine on one node not on two | 17:50 |
fungi | since i thought you could set metadata properties on an instance via the api boot call which the instance could then later query from the metadata service to know special pieces of info | 17:51 |
fungi | basically attaching metadata for consumption by the instance's operating system/userspace | 17:51 |
clarkb | ya it may do that (I am not sure) | 17:51 |
*** luqas has quit IRC | 17:51 | |
*** achanda has joined #openstack-infra | 17:51 | |
fungi | but i guess we're just using it for a handy place to stick info we want to query from somewhere nottheinstance later | 17:52 |
clarkb | the whole NAT thing seems questionable though. I wonder why using the network gateway wasn't deemed a better solution to the problem | 17:52 |
clarkb | its a common solution for not needing to discover where to ntp and the like | 17:52 |
fungi | gatewayless networks | 17:53 |
clarkb | I don't think nova network does though | 17:53 |
clarkb | *does those | 17:53 |
*** sarob has joined #openstack-infra | 17:53 | |
clarkb | but I may be wrong | 17:53 |
fungi | ahh. no good guess then | 17:53 |
greghaynes | clarkb: did you end up figuring out your issues with the NAT stuff? | 17:53 |
clarkb | greghaynes: nope fixed nova shelve on with nova mutlihost and have not looked back | 17:53 |
*** sarob has quit IRC | 17:53 | |
clarkb | greghaynes: I asked nova for help and was told "I doubt anyone is interested in fixing that" | 17:54 |
clarkb | so ya | 17:54 |
greghaynes | well, anyone other than you ;) | 17:54 |
*** sarob has joined #openstack-infra | 17:54 | |
openstackgerrit | Merged openstack-infra/storyboard: OAuth Authorize Scope Validation https://review.openstack.org/153406 | 17:55 |
openstackgerrit | Khai Do proposed stackforge/python-jenkins: Set the default server connection timeout to match socket default timeout https://review.openstack.org/153467 | 17:55 |
*** bhuvan has joined #openstack-infra | 17:55 | |
*** denis_makogon has quit IRC | 17:57 | |
openstackgerrit | Merged openstack-infra/storyboard: OAuth tests for authorize_return https://review.openstack.org/153407 | 17:57 |
openstackgerrit | Merged openstack-infra/storyboard: OAuth Exception on invalid oauth return data https://review.openstack.org/153408 | 17:57 |
openstackgerrit | Khai Do proposed stackforge/python-jenkins: Set the default server connection timeout to match socket default timeout https://review.openstack.org/153467 | 17:57 |
openstackgerrit | Merged openstack-infra/nodepool: Change sequence on actions in updateConfig https://review.openstack.org/130811 | 17:58 |
*** pelix has quit IRC | 17:58 | |
*** sarob has quit IRC | 17:58 | |
*** niska has quit IRC | 17:59 | |
clarkb | greghaynes: the stack that starts at https://review.openstack.org/#/c/153093/ fixes nova multihost so once we get those first three changes in we should be working again | 18:00 |
*** mrmartin has joined #openstack-infra | 18:01 | |
greghaynes | fun fun | 18:01 |
*** ChuckC has joined #openstack-infra | 18:02 | |
openstackgerrit | Khai Do proposed stackforge/python-jenkins: Set the server connection timeout to same as socket timeout https://review.openstack.org/153467 | 18:02 |
*** gyee has joined #openstack-infra | 18:03 | |
openstackgerrit | Merged openstack-infra/nodepool: Caching floating ips as server list is done https://review.openstack.org/133422 | 18:04 |
clarkb | mordred: for 136589 nodepool alembic migrations, can't alembic generate the migrations from your db schema? it always bugs me that we have to double account this stuff | 18:04 |
*** jp_at_hp has quit IRC | 18:06 | |
*** derekh has quit IRC | 18:06 | |
fungi | first experiment, i have two held bare-centos6 nodes one with the ghost update and the other without. i'm looping git remote update in a nova clone (along with a one-second sleep) and seeing if either or both get stuck | 18:06 |
*** thedodd has quit IRC | 18:06 | |
greghaynes | clarkb: usually you commit the alembic migration along with your schema change... | 18:07 |
clarkb | greghaynes: yes but you shouldn't have to | 18:07 |
clarkb | I only bring this up because mordred's commit to add alembic appears wrong | 18:07 |
clarkb | because it has to be double accounted so you make mistakes | 18:07 |
clarkb | I am commenting on the change as I go | 18:08 |
*** dtantsur is now known as dtantsur|afk | 18:08 | |
clarkb | it could also be that alembic and sqlalchemy use different defaults | 18:09 |
clarkb | which would be crazy | 18:09 |
greghaynes | maybe im missing something, but generally you write a lot of the alembic migration by hand, it just autogens the hash and such | 18:09 |
* greghaynes reads teh codes | 18:09 | |
*** patrickeast has joined #openstack-infra | 18:09 | |
clarkb | greghaynes: yes but if you change your python code there is sufficient info present to autogenerate a migration fromold version to new version in the general case | 18:09 |
clarkb | eg I added a column | 18:10 |
clarkb | or I added an index | 18:10 |
greghaynes | yea, for the simple case, a lot of the time theres data mutation too though | 18:10 |
greghaynes | which is such fun | 18:10 |
clarkb | right of which we have 0 | 18:11 |
openstackgerrit | Boris Pavlovic proposed openstack-infra/project-config: Add Rally job to Mistral https://review.openstack.org/153643 | 18:12 |
*** swamireddy has quit IRC | 18:13 | |
anteaya | oh my goodness, I finished reading backscroll | 18:14 |
*** mrmartin has quit IRC | 18:14 | |
anteaya | it's almost time for lunch | 18:14 |
*** harlowja has joined #openstack-infra | 18:15 | |
*** otter768 has joined #openstack-infra | 18:16 | |
anteaya | clarkb: in the parent patch of the d-g patch series for multinode is 172.24.4/23 a typo or intentional? | 18:17 |
* anteaya displays her lack of knowledge in ip address syntax conventions | 18:17 | |
fungi | anteaya: intentional | 18:17 |
anteaya | thanks | 18:17 |
fungi | anteaya: that means the range of 412 ipv4 addresses from 172.24.4.0 to 172.24.5.255 | 18:18 |
fungi | er, 512 addresses | 18:18 |
* fungi is suffering from a prolonged case of stupidfingers | 18:18 | |
clarkb | it signifies that 23 of the 32 bits in the address are fixed. The other 9 are useable | 18:19 |
anteaya | your stupid fingers give me comfort | 18:19 |
clarkb | anteaya: ^ if you want to use maths | 18:19 |
anteaya | clarkb fungi thanks | 18:19 |
anteaya | it is another wonderful til day, I also learned about jenkins security in the backscroll | 18:20 |
anteaya | or lack thereof | 18:20 |
*** yjiang5 has left #openstack-infra | 18:21 | |
*** tkelsey has quit IRC | 18:21 | |
fungi | anteaya: basically 2^(32-23)=512 | 18:25 |
*** sarob has joined #openstack-infra | 18:25 | |
*** shashankhegde has joined #openstack-infra | 18:25 | |
*** otter768 has quit IRC | 18:26 | |
anteaya | there's some math | 18:26 |
anteaya | thanks | 18:26 |
*** e0ne has joined #openstack-infra | 18:26 | |
anteaya | clarkb: how should I interpret that the patch is failing in the experiemental pipeline? | 18:27 |
*** dizquierdo has quit IRC | 18:27 | |
*** hdd has joined #openstack-infra | 18:27 | |
clarkb | gah sqlalchemy docs don't specify what the default was for the unique kwarg | 18:27 |
anteaya | the patch being https://review.openstack.org/#/c/153093/ | 18:28 |
zaro | fungi: was wondering if you know why gerrit user for zuul-dev.o.o is 'zuul-dev' and not 'jenkins'? it's 'jenkins' for zuul.o.o | 18:28 |
clarkb | anteaya: there are three changes at the beginning of that stack, the first two will fail but the third passes. we basically need all three for it to pass | 18:28 |
zaro | fungi: http://git.openstack.org/cgit/openstack-infra/system-config/tree/manifests/site.pp#n543 | 18:28 |
anteaya | clarkb: ah okay thanks | 18:28 |
clarkb | anteaya: I kept them separate since I don't have to squash them to get it merged and it makes it more readable | 18:28 |
*** markvan has joined #openstack-infra | 18:28 | |
*** markvan has quit IRC | 18:28 | |
anteaya | clarkb: I could barely read the first as it is, so thanks for the not squash decision | 18:28 |
*** jerryz has quit IRC | 18:28 | |
zaro | fungi: both users are in the 'Continuous integration tools' group on review-dev.o.o | 18:29 |
*** bswartz has quit IRC | 18:30 | |
*** signed8b_ is now known as signed8bit_ZZZzz | 18:30 | |
clarkb | mordred: I commented on 136589. +2 but with a small concern about a delta between nodedb and the migration | 18:30 |
clarkb | anteaya: linux networking, its about the worst thing about linux | 18:30 |
anteaya | clarkb: +1 on the parent with an explaination of what that means coming from me | 18:30 |
anteaya | clarkb: networking seems to be the worst thing about everything | 18:30 |
zaro | fungi: zuul-dev.o.o layout is set to trigger on comments from 'jenkins' user, similar to zuul.o.o's layout.yaml | 18:31 |
zaro | http://git.openstack.org/cgit/openstack-infra/project-config/tree/dev/zuul/layout.yaml | 18:31 |
openstackgerrit | Boris Pavlovic proposed openstack-infra/project-config: Add Rally job to Mistral https://review.openstack.org/153643 | 18:32 |
fungi | zaro: not sure, but we could certainly change that easily enough | 18:32 |
mordred | clarkb: nod | 18:32 |
*** carl_baldwin has joined #openstack-infra | 18:32 | |
zaro | fungi: i'm thinking it would be better to use the same user for both zuul.o.o and zuul-dev.o.o that will make mainting the layout files easier. | 18:32 |
fungi | zaro: mainly i think we've just not historically put a lot of effort into getting those dev systems into a state where they're an end-to-end recreation of our toolchain | 18:33 |
fungi | so there's likely to be some divergence here and there as a result, but i'm not opposed to cleaning that up | 18:33 |
zaro | fungi: or keep it as zuul-dev user and change the layout file to match. | 18:33 |
zaro | what would you suggest? | 18:34 |
fungi | zaro: i'd say let's update the account name to match production. i suspect previously when zuul-dev was connecting to review.o.o instead it used a different username so as not to conflict with the accout production zuul was using | 18:34 |
anteaya | what is q-agt in devstack's service nomenclature? | 18:34 |
anteaya | I'm guessing q for quantum, no idea for agt | 18:35 |
JayF | agent? | 18:35 |
*** _nadya_ has quit IRC | 18:35 | |
zaro | fungi: cool. so if we change zuul-dev to jenkins user would it use the same ssh rsa pub key as one for prod? | 18:36 |
JayF | I honestly don't even know what quantum does; but agt has to be agent, right? | 18:36 |
anteaya | JayF: quantum is the old name for neutron, devstack keeps using q to avoid clashing with nova which has n- | 18:36 |
JayF | aha; and there's a neutron agent, so that fits | 18:36 |
anteaya | JayF: I can buy agent for agt | 18:36 |
marcusvrn1 | Hi all! I'm facing some troubles in the CI jobs execution...Sometimes CI jobs starts failing, because the installed dependencies are not up-to-date. I have installed all openstack dependencies in order to optimize the jobs, but now I have some problems with that approach.. I guess the devstack script checks if the dependency was installed but not if it's the right version. Is there a way to force the job scripts (devst | 18:36 |
*** bswartz has joined #openstack-infra | 18:36 | |
anteaya | JayF: thank you | 18:37 |
fungi | zaro: no, we'd just need to update the public key for the account jenkins in the review-dev trove database so that it's the same as the zuul-dev account | 18:37 |
JayF | anteaya: np; putting the hours I spend on crosswords to work :P | 18:37 |
anteaya | JayF: I can't do crosswords at all, glad you can | 18:37 |
anteaya | marcusvrn1: hello | 18:37 |
zaro | fungi: do you suggest replacing or adding an additional pub key? | 18:37 |
*** tonytan4ever has quit IRC | 18:37 | |
*** dannywilson has quit IRC | 18:37 | |
anteaya | marcusvrn1: can you help us see the problems you are having? like perhaps by pasting some output on paste.openstack.org? | 18:38 |
*** tonytan4ever has joined #openstack-infra | 18:38 | |
fungi | zaro: either is fine. we can always recreate the corresponding public key from a private key if we forget what it was (or just regenerate the keys entirely if we have to) | 18:38 |
*** dannywilson has joined #openstack-infra | 18:38 | |
marcusvrn1 | anteaya: sure! one minute | 18:38 |
*** mrmartin has joined #openstack-infra | 18:39 | |
*** jogo is now known as flashgordon | 18:40 | |
anteaya | marcusvrn1: thanks | 18:40 |
*** niska has joined #openstack-infra | 18:41 | |
*** dannywilson has quit IRC | 18:41 | |
*** dannywilson has joined #openstack-infra | 18:42 | |
*** jedimike has quit IRC | 18:42 | |
*** hdd has quit IRC | 18:42 | |
zaro | fungi: ok, i'll add 'zuul-dev' pub key to 'jenkins' account on review-dev.o.o and change the 'gerrit_user' in site.pp | 18:42 |
fungi | zaro: sounds good | 18:43 |
fungi | i'm going to step away and go get some late lunching, but will be back later | 18:43 |
clarkb | jesusaurus: 145930, nothing seems to consume the version info? I want to say this was discussed at one point but the commit itself is lacking ocntext | 18:44 |
clarkb | jesusaurus: any chance you can fill ianw and I in? | 18:44 |
*** esker has joined #openstack-infra | 18:45 | |
*** tonytan4ever has quit IRC | 18:47 | |
*** tonytan4ever has joined #openstack-infra | 18:47 | |
marcusvrn1 | anteaya: I'm reproducing it again, because, to fix it temporally, I have updated all dependencies manually. | 18:48 |
*** bdpayne has joined #openstack-infra | 18:48 | |
anteaya | okay so let's start again | 18:49 |
anteaya | what is the problem you are looking to solve? | 18:50 |
*** hdd has joined #openstack-infra | 18:50 | |
openstackgerrit | Merged openstack/requirements: Add aioeventlet dependency https://review.openstack.org/138750 | 18:51 |
anteaya | marcusvrn1: what is the problem you are looking to solve? | 18:52 |
*** abhirc has joined #openstack-infra | 18:52 | |
clarkb | marcusvrn1: so you should let devstack install all of the things it wants to install. What you can do is cache the packages | 18:54 |
*** niska has quit IRC | 18:54 | |
marcusvrn1 | anteaya: If I have a devstack dependency already installed, but not updated...for example: I have installed oslo.i18n version 0.2 and the required package is oslo.i18n version 1.0, the devstack considers it is installed, but show an error that the package version installed is not the expected one. | 18:57 |
*** imcsk8 has quit IRC | 18:57 | |
marcusvrn1 | clarkb: but it consumes a lot of time to install each package every time that job runs | 18:58 |
jesusaurus | clarkb: I was trying to figure out why "nodepool --version" gives me "error: too few arguments" and it looks like other projects have something similar to 145930 | 18:58 |
*** dhellmann has quit IRC | 18:58 | |
*** dhellmann_ is now known as dhellmann | 18:58 | |
jesusaurus | though I think fungi was telling me that they are two separate issues | 18:58 |
*** dhellmann_ has joined #openstack-infra | 18:59 | |
*** zz_avozza is now known as avozza | 18:59 | |
anteaya | marcusvrn1: when you set up the environment for your devstack, what did you do? | 18:59 |
*** sputnik13 has joined #openstack-infra | 18:59 | |
*** ivar-lazzaro has joined #openstack-infra | 18:59 | |
clarkb | marcusvrn1: if you cache the packages the time to install is reasonable | 18:59 |
*** sarob has quit IRC | 19:00 | |
*** sarob has joined #openstack-infra | 19:00 | |
openstackgerrit | Sean Dague proposed openstack-infra/project-config: ec2api tempest job https://review.openstack.org/153659 | 19:00 |
sdague | jeblair: so... I *think* that does the right thing ^^^ | 19:01 |
clarkb | jesusaurus: https://git.openstack.org/cgit/openstack-infra/nodepool/tree/nodepool/cmd/nodepoolcmd.py#n319 I see that expects the info that you add | 19:01 |
*** dhellmann_ has quit IRC | 19:01 | |
clarkb | jesusaurus: maybe a comment with a pointer to that chunk of code? | 19:01 |
*** dhellmann_ has joined #openstack-infra | 19:01 | |
sdague | clarkb: your eyes on that would be great as well | 19:01 |
jesusaurus | clarkb: sure, I'll write a better commit message | 19:02 |
jeblair | sdague: is the NO_CLONE or whatever it's called still effective for enable_plugin? | 19:02 |
sdague | jeblair: yep | 19:03 |
sdague | it uses the normal devstack clone paths | 19:03 |
jeblair | sdague: (i ask because i agree having the url for docs purposes is cool, but want to make sure we don't accidentally clone something). | 19:03 |
jeblair | sdague: cool, sounds good | 19:03 |
*** SumitNaiksatam has quit IRC | 19:03 | |
*** johnthetubaguy is now known as zz_johnthetubagu | 19:03 | |
*** mattfarina has quit IRC | 19:04 | |
marcusvrn1 | antena: I looked for which packages that devstack needs and then, I installed them | 19:04 |
openstackgerrit | Merged openstack-infra/project-config: Add TripleO f20 puppet job https://review.openstack.org/153341 | 19:04 |
marcusvrn1 | anteaya: I looked for which packages that devstack needs and then, I installed them | 19:04 |
*** mattfarina has joined #openstack-infra | 19:04 | |
*** sarob has quit IRC | 19:05 | |
marcusvrn1 | clarkb: what is a reasonable time for each CI build? | 19:05 |
clarkb | marcusvrn1: are run in about an hour | 19:05 |
clarkb | s/are/ours/ | 19:05 |
clarkb | sdague: and the plugin does all configuration itself? thats nice | 19:06 |
clarkb | sdague: just looks pretty light so double checking | 19:06 |
openstackgerrit | K Jonathan Harker proposed openstack-infra/nodepool: Add version_info to nodepool https://review.openstack.org/145930 | 19:06 |
sdague | clarkb: yep, that's the specification for external plugins | 19:06 |
clarkb | perfect | 19:07 |
jesusaurus | clarkb: does that make commit message make sense to you? | 19:07 |
anteaya | marcusvrn1: ah okay well that is one approach and you are indicating that is perhaps not optimal for your needs | 19:07 |
sdague | https://github.com/stackforge/ec2-api/tree/master/devstack - it's 2 files, a settings file that gets sourced early, then a dispatcher for various devstack phases | 19:07 |
anteaya | marcusvrn1: having you tried letting devstack install what it needs itself as clarkb suggested? | 19:07 |
clarkb | sdague: so I think you just need to add that job template to the project in projects.yaml to instantiate the template | 19:07 |
*** carl_baldwin has quit IRC | 19:07 | |
clarkb | jesusaurus: yup thanks | 19:08 |
*** yamamoto has joined #openstack-infra | 19:08 | |
openstackgerrit | K Jonathan Harker proposed openstack-infra/nodepool: Add version_info to nodepool https://review.openstack.org/145930 | 19:08 |
sdague | clarkb: in the jobs: section? | 19:08 |
clarkb | sdague: ya | 19:08 |
clarkb | sdague: basically templates don't exist until you listthem in a jobs section instantiating them with a set of parameters | 19:09 |
*** ashleighfarnham has quit IRC | 19:09 | |
*** dhellmann has quit IRC | 19:09 | |
*** dhellmann_ is now known as dhellmann | 19:09 | |
jeblair | also, if we could work out the tempest/neutron thing, we could probably make that builder a macro, or even make that a template where you instantiate it with the add-on project. (these should be considered future refactors; don't need to do that now) | 19:10 |
jesusaurus | clarkb: also, i have another trivial rebase (imports again) of 76057 | 19:10 |
openstackgerrit | Sean Dague proposed openstack-infra/project-config: ec2api tempest job https://review.openstack.org/153659 | 19:11 |
sdague | jeblair: yeh, I agree, we should make this a simpler template in the future | 19:11 |
sdague | clarkb: like that ^^^ | 19:11 |
clarkb | sdague: yup | 19:11 |
sdague | projects.yaml often confuses me, so tell me where I got that wrong :) | 19:11 |
*** signed8bit_ZZZzz is now known as signed8b_ | 19:11 | |
*** thedodd has joined #openstack-infra | 19:12 | |
openstackgerrit | Yichen Wang proposed openstack-infra/project-config: Modify zuul jobs for stackforge/vmtp https://review.openstack.org/153664 | 19:12 |
*** alexpilotti has quit IRC | 19:12 | |
marcusvrn1 | anteaya: clarkb: Yeah, It was set up letting devstack install what it needs...but as I was trying to optimize the build time, I installed the devstack dependencies....maybe I'm trying to optimize the Builds more than needed... mine build runs in ~45 min (with devstack dependencies installed). If the dependencies are not installed, maybe it will run in an hour | 19:12 |
clarkb | sdague: its the difference between a job: and a job-template: job-templates are just containers that need to be filled | 19:12 |
*** yamamoto has quit IRC | 19:13 | |
*** dustins has quit IRC | 19:13 | |
anteaya | marcusvrn1: sounds like you optimized yourself into a corner | 19:13 |
*** ashleighfarnham has joined #openstack-infra | 19:13 | |
anteaya | why not try again letting devstack install what it needs | 19:13 |
anteaya | then check what is installed and cache those packages? | 19:14 |
clarkb | jesusaurus: your fix doesn't fix nodepool --version fwiw | 19:15 |
*** annegent_ has quit IRC | 19:15 | |
clarkb | jesusaurus: I think you also need to make the subcommand optional when using --version | 19:15 |
jeblair | clarkb, sdague: double check my -1 on that... :) | 19:16 |
*** talluri has quit IRC | 19:16 | |
marcusvrn1 | anteaya: I will do it now, after talking to you guys, I guess it's the best solution :) | 19:16 |
anteaya | marcusvrn1: let us know how you make out | 19:16 |
*** talluri has joined #openstack-infra | 19:17 | |
sdague | I'll let clarkb tell me the right thing there :) | 19:17 |
anteaya | marcusvrn1: and we enjoy looking at stacktraces if you have an issue in future | 19:17 |
sdague | happy to delete it | 19:17 |
openstackgerrit | Andrey Pavlov proposed openstack-infra/project-config: template for ec2-api gating jobs https://review.openstack.org/153665 | 19:17 |
marcusvrn1 | clarkb: anteaya: ok! thanks | 19:18 |
clarkb | sdague: jeblair ya the job group isn't used so can just be removed | 19:18 |
clarkb | jesusaurus: I am not sure how to do that with argparse off the top of my head | 19:18 |
jeblair | sdague: this kitchen has a lot of cooks: https://review.openstack.org/153665 | 19:18 |
sdague | yeh, I didn't realize they were running at this as well | 19:19 |
sdague | I don't know if andrey is on irc or not | 19:19 |
jesusaurus | clarkb: ah | 19:19 |
anteaya | yay the first part of the nova-net to neutron migration spec merged! | 19:19 |
jesusaurus | clarkb: that makes sense, I'll see if I can figure out how to do that | 19:19 |
sdague | he had asked me how to do this, so I was trying to get it figured out this morning | 19:19 |
clarkb | jesusaurus: you do need the version info thing too aiui so don't get rid of that | 19:19 |
* anteaya does a happy dance | 19:19 | |
*** talluri has quit IRC | 19:21 | |
*** dustins has joined #openstack-infra | 19:22 | |
*** _buzz has joined #openstack-infra | 19:22 | |
anteaya | I'm going to celebrate by going for a walk | 19:23 |
*** aysyd has quit IRC | 19:24 | |
sdague | jeblair: so we think we're good with getting rid of just the job group? | 19:24 |
*** aysyd has joined #openstack-infra | 19:24 | |
openstackgerrit | Sean Dague proposed openstack-infra/project-config: ec2api tempest job https://review.openstack.org/153659 | 19:25 |
*** cdent has quit IRC | 19:25 | |
sdague | my suggestion is we land that as the example, the ec2-api team can then also add their functional jobs mirroring that | 19:26 |
sdague | and it will be a good base commit to get the glusterfs folks to use | 19:26 |
sdague | clarkb: agree? | 19:26 |
clarkb | +1 | 19:27 |
*** e0ne has quit IRC | 19:28 | |
*** SumitNaiksatam has joined #openstack-infra | 19:29 | |
*** nicodemos has quit IRC | 19:29 | |
*** Andrey-mp has joined #openstack-infra | 19:29 | |
*** alevine has joined #openstack-infra | 19:30 | |
*** tqtran has joined #openstack-infra | 19:31 | |
*** mrmartin has quit IRC | 19:32 | |
*** vigneshvar has quit IRC | 19:33 | |
*** sdake_ has joined #openstack-infra | 19:33 | |
*** vigneshvar has joined #openstack-infra | 19:34 | |
*** avozza is now known as zz_avozza | 19:34 | |
*** thedodd has quit IRC | 19:34 | |
openstackgerrit | Merged openstack-infra/nodepool: Revert "Pin python-daemon to <2.0" https://review.openstack.org/150256 | 19:35 |
*** tonytan4ever has quit IRC | 19:36 | |
*** andreykurilin_ has joined #openstack-infra | 19:38 | |
*** amrith is now known as _amrith_ | 19:38 | |
sdague | clarkb / jeblair - thanks | 19:38 |
sdague | also documented this out on the ML for people - http://lists.openstack.org/pipermail/openstack-dev/2015-February/056257.html | 19:39 |
sdague | hopefully we can point more folks there | 19:39 |
SpamapS | http://paste.openstack.org/show/168273/ | 19:42 |
SpamapS | ^^ thats where my image build failed | 19:42 |
SpamapS | Error: Could not update: Execution of '/usr/bin/gem install --no-rdoc --no-ri puppetlabs_spec_helper' returned 1: ERROR: While executing gem ... (Gem::DependencyError) Unable to resolve dependencies: rspec requires rspec-core (~> 2.99.0), rspec-expectations (~> 2.99.0), rspec-mocks (~> 2.99.0) | 19:43 |
Andrey-mp | sdague - thanks for example | 19:43 |
sdague | Andrey-mp: no problem | 19:43 |
sdague | Andrey-mp: happy to get you guys bootstrapped here | 19:44 |
*** achanda has quit IRC | 19:44 | |
openstackgerrit | Khai Do proposed openstack-infra/system-config: Change the gerrit_user on zuul-dev.o.o to match zuul.o.o https://review.openstack.org/153668 | 19:44 |
*** koolhead17 has joined #openstack-infra | 19:44 | |
openstackgerrit | Yichen Wang proposed openstack-infra/project-config: Modify zuul jobs for stackforge/vmtp https://review.openstack.org/153664 | 19:45 |
*** alevine has quit IRC | 19:47 | |
*** ashleighfarnham has quit IRC | 19:47 | |
*** bradjones has quit IRC | 19:47 | |
*** mrmartin has joined #openstack-infra | 19:47 | |
*** mrmartin has quit IRC | 19:49 | |
*** signed8b_ is now known as signed8bit_ZZZzz | 19:50 | |
*** bradjones has joined #openstack-infra | 19:50 | |
*** radez_g0n3 is now known as radez | 19:50 | |
sdague | jeblair: zuul failed on the last rev of the ec2 patch - http://logs.openstack.org/59/153659/3/check/gate-project-config-layout/86c7637/console.html | 19:52 |
*** niska has joined #openstack-infra | 19:52 | |
*** achanda has joined #openstack-infra | 19:53 | |
jeblair | that's... weird | 19:54 |
jeblair | the cited lines are not near the changes | 19:55 |
*** sigmavirus24 is now known as sigmavirus24_awa | 19:55 | |
sdague | it failed on rev2 and rev3 | 19:55 |
sdague | in same way | 19:55 |
jeblair | oh, i see | 19:55 |
openstackgerrit | Yichen Wang proposed openstack-infra/project-config: Modify zuul jobs for stackforge/vmtp https://review.openstack.org/153664 | 19:55 |
openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate: Diagram the nova net multinode network setup https://review.openstack.org/153672 | 19:55 |
clarkb | sdague: ^ I put it in a second commit so that I wouldn't lose your +2 <_< but how does that diagram look? | 19:56 |
jeblair | sdague: commented on 153659 | 19:56 |
jeblair | (and the error did actually make sense, i was looking at the zuul files, not the jjb) | 19:57 |
sdague | ok, cool. rev coming | 19:57 |
*** gondoi is now known as zz_gondoi | 19:57 | |
openstackgerrit | Sean Dague proposed openstack-infra/project-config: ec2api tempest job https://review.openstack.org/153659 | 19:57 |
*** signed8bit_ZZZzz is now known as signed8b_ | 19:58 | |
sdague | clarkb: thanks | 19:58 |
*** Andrey-mp has quit IRC | 20:00 | |
*** annegent_ has joined #openstack-infra | 20:01 | |
*** tiswanso_ has quit IRC | 20:01 | |
*** thedodd has joined #openstack-infra | 20:02 | |
*** ashleighfarnham has joined #openstack-infra | 20:02 | |
*** tiswanso has joined #openstack-infra | 20:02 | |
*** amitgandhinz has quit IRC | 20:02 | |
*** rfolco has quit IRC | 20:03 | |
*** amitgandhinz has joined #openstack-infra | 20:03 | |
*** hashar has joined #openstack-infra | 20:03 | |
*** signed8b_ has quit IRC | 20:05 | |
*** signed8bit has joined #openstack-infra | 20:05 | |
*** signed8bit has quit IRC | 20:06 | |
*** signed8bit has joined #openstack-infra | 20:06 | |
sdague | clarkb / jeblair - https://review.openstack.org/#/c/153659/ now with passing tests | 20:07 |
*** signed8bit has quit IRC | 20:07 | |
*** signed8bit has joined #openstack-infra | 20:10 | |
*** amitgandhinz has quit IRC | 20:10 | |
jeblair | +3 | 20:11 |
openstackgerrit | K Jonathan Harker proposed openstack-infra/nodepool: Fix nodepool --version https://review.openstack.org/145930 | 20:13 |
*** ldnunes has quit IRC | 20:14 | |
*** ihrachyshka has joined #openstack-infra | 20:15 | |
*** niska has quit IRC | 20:15 | |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: OAuth Validate Token Grant Types https://review.openstack.org/153674 | 20:17 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: OAuth tests for invalid authorization codes. https://review.openstack.org/153675 | 20:17 |
openstackgerrit | Merged openstack-infra/project-config: ec2api tempest job https://review.openstack.org/153659 | 20:18 |
sdague | did something change today about how unit test nodes are setup? | 20:18 |
sdague | http://logs.openstack.org/59/152959/2/check/gate-devstack-unit-tests/7689185/console.html#_2015-02-06_19_12_52_310 | 20:18 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: OAuth tests for invalid authorization codes. https://review.openstack.org/153675 | 20:18 |
sdague | was never an issue before | 20:19 |
sdague | 2015-02-06 19:12:52.310 | [ERROR] /home/jenkins/workspace/gate-devstack-unit-tests/stackrc:685 Could not determine host ip address. See local.conf for suggestions on setting HOST_IP. | 20:19 |
*** achanda has quit IRC | 20:20 | |
openstackgerrit | yolanda.robla proposed openstack-infra/nodepool: Conditionally check for targets in reconfigureManagers https://review.openstack.org/129560 | 20:20 |
sdague | jeblair: thanks! | 20:21 |
mordred | sdague: not that I know of - but I do want to point out to people that sometimes machiens want to know their IP address ... | 20:21 |
SpamapS | mordred: I'm of the opinion that it is basically never the 'right' thing to care what your IP is, even if it is sometimes necessary because there are badly designed things out there. | 20:22 |
*** dustins has quit IRC | 20:22 | |
sdague | SpamapS: well... devstack cares, because it's got to put that into service urls :) | 20:23 |
SpamapS | sdague: right, which is what hostname is supposed to be fore. :-P | 20:23 |
SpamapS | for even | 20:23 |
openstackgerrit | Maru Newby proposed openstack-infra/devstack-gate: Refactor processing of testr artifacts for reuse https://review.openstack.org/153677 | 20:23 |
sdague | SpamapS: rabbit doesn't work right with hostname | 20:23 |
SpamapS | see above "badly designed things" | 20:23 |
SpamapS | :) | 20:23 |
SpamapS | agree | 20:24 |
SpamapS | have wrangled with rabbit's hostname oddness for years | 20:24 |
sdague | ok... so in perfect theory world | 20:24 |
SpamapS | going back to people reporting lower battery life with rabbitmq installed | 20:24 |
sdague | I don't live in perfect theory world :) | 20:24 |
openstackgerrit | Maru Newby proposed openstack-infra/devstack-gate: Refactor processing of testr artifacts for reuse https://review.openstack.org/153677 | 20:24 |
openstackgerrit | yolanda.robla proposed openstack-infra/nodepool: Move image uploads out of ProviderManager https://review.openstack.org/137401 | 20:24 |
sdague | however, more importantly, this is new failure, that didn't fail before | 20:24 |
fungi | surprisingly modest scrollback while i was out | 20:24 |
SpamapS | (because it would spin forever trying to resolve and connect to its hostname.. which is rather difficult on transient wifi) | 20:24 |
openstackgerrit | Maru Newby proposed openstack-infra/devstack-gate: Refactor processing of testr artifacts for reuse https://review.openstack.org/153677 | 20:25 |
SpamapS | sdague: nobody lives there, even the people who think they do ;) | 20:25 |
*** imcsk8 has joined #openstack-infra | 20:25 | |
*** imcsk8 has quit IRC | 20:26 | |
*** imcsk8 has joined #openstack-infra | 20:26 | |
marun | clarkb: I hope you'll be glad to know I'm refactoring d-g to avoid hackery in our hook scripts ^^ :) | 20:26 |
mtreinish | SpamapS: I dunno it's all clouds, sunshine, and rainbows from my point of view. :) | 20:26 |
*** adalbas has quit IRC | 20:26 | |
SpamapS | The point being, there is no actual agreed upon way to determine "this is the one address that every node I communicate with can reach me on". There are about a dozen ways to get an approximation. | 20:26 |
*** niska has joined #openstack-infra | 20:26 | |
marun | mtreinish: your attention on that patch would also be appreciated since I think you've worked on the code in question recently ^^ | 20:27 |
*** otter768 has joined #openstack-infra | 20:27 | |
sdague | so I can work around it, however, it means something changed on the base nodes that made the auto detection in devstack fail | 20:27 |
sdague | which... is odd | 20:27 |
*** carl_baldwin has joined #openstack-infra | 20:27 | |
*** dannywilson has quit IRC | 20:27 | |
mtreinish | marun: well it conflicts with: https://review.openstack.org/#/c/153017/ | 20:28 |
SpamapS | sdague: can you point me at the general area the autodetect is done? I've been around this bush so many times I keep a toothbrush in the bush's medicine cabinet. | 20:28 |
*** ashleighfarnham has quit IRC | 20:28 | |
mtreinish | marun: actually you're dropping the interupted test stuff completely | 20:28 |
marun | mtreinish: no, I'm not | 20:28 |
marun | mtreinish: but I can fix the ordering as per your patch | 20:29 |
mtreinish | oh nm it's there at the bottom | 20:29 |
*** davideagnello has quit IRC | 20:29 | |
mtreinish | I should have realized that because I noticed the conflict... | 20:29 |
*** annegentle has quit IRC | 20:29 | |
SpamapS | In unrelated news, Getting fuel failures.. | 20:29 |
SpamapS | Caching fuel-plugin-contrail from git://git.openstack.org/stackforge/fuel-plugin-contrail.git in /home/clint/.cache/image-create/source-repositories/fuel_plugin_contrail_43829f30223c9e70974944602427351b4738130f | 20:29 |
SpamapS | Cloning into '/home/clint/.cache/image-create/source-repositories/fuel_plugin_contrail_43829f30223c9e70974944602427351b4738130f.tmp'... | 20:29 |
SpamapS | fatal: Could not read from remote repository. | 20:29 |
marun | mtreinish: are there cases where 0 will exist and so will tmp then? | 20:29 |
marun | mtreinish: would you be ammenable to me fixing my patch and you abandoning yours? | 20:30 |
marun | mtreinish: or is the potential review lag something that needs to be avoided? | 20:30 |
*** aysyd has quit IRC | 20:30 | |
sdague | SpamapS: https://github.com/openstack-dev/devstack/blob/master/functions-common#L746 | 20:31 |
*** otter768 has quit IRC | 20:31 | |
*** davideagnello has joined #openstack-infra | 20:31 | |
SpamapS | ah the old "use the first ip on the default route" trick | 20:31 |
mtreinish | marun: so 0 will always exist now, (we preseed an aggregate stream from the subunit2sql db currently) tmp will only exist if the run is interrupted | 20:31 |
marun | mtreinish: ah, ok. | 20:31 |
SpamapS | usually a reasonable choice ;) | 20:32 |
mtreinish | marun: which is why I had to reorder it, because the old order meant we never caught tmp | 20:32 |
*** carl_baldwin has quit IRC | 20:32 | |
marun | mtreinish: makes sense. I'll submit an updated patch. | 20:32 |
mtreinish | marun: if you can think of a better way to handle pre-existing streams I'm not exactly happy with check for 0. Because that's always true and not always the desired check | 20:34 |
marun | mtreinish: hmmm | 20:34 |
mtreinish | marun: especially because we'll be preseeding 10 streams instead of one in the future: https://review.openstack.org/153036 and https://review.openstack.org/151732 | 20:34 |
marun | mtreinish: what exactly are contained in the preseeded streams? | 20:35 |
marun | are -> is | 20:35 |
jeblair | sdague: logstash says that goes back to jan 28 and affects only hpcloud-b1 | 20:35 |
*** BharatK has quit IRC | 20:35 | |
marun | mtreinish: Maybe we can set a constant for the number of pre-existing streams? | 20:36 |
mtreinish | marun: currently it's pretty basic: just test_ids and average runtime between a start and stop timestamp | 20:36 |
marun | mtreinish: or, should we be looking at the last stream? | 20:36 |
sdague | jeblair: interesting | 20:36 |
mtreinish | marun: after those 2 patches land the streams will be the same as from real gate runs minus the attachements | 20:36 |
fungi | SpamapS: i've triggered a full replica refresh in gerrit to hopefully fix that | 20:36 |
mtreinish | marun: http://logs.openstack.org/19/149719/6/check/check-tempest-dsvm-full/4725d5f/logs/testrepository/ | 20:36 |
mtreinish | ^^^ that's from a test patch where I save the entire testrepository from a run | 20:37 |
*** stevemar has quit IRC | 20:37 | |
fungi | SpamapS: stackforge/fuel-plugin-contrail was just added earlier today and we've been seeing occasional git push collisions in gerrit's replication plugin | 20:37 |
*** marcusvrn1 has quit IRC | 20:37 | |
mordred | AROO? | 20:37 |
*** stevemar has joined #openstack-infra | 20:38 | |
marun | mtreinish: so if tmp does not exist, I can imagine the subsequent check would have to be for whether the last run was a preseed or not | 20:38 |
mordred | SpamapS: I'd agree with you on ips/hostnames for a lot of things, because we have this lovely thing called "the DNS" | 20:38 |
fungi | SpamapS: so chances are it was an empty repo on whatever backend haproxy was directing you to | 20:38 |
*** vigneshvar has quit IRC | 20:38 | |
mordred | SpamapS: except there are lower level things that need to run on things sometimes | 20:38 |
*** sarob has joined #openstack-infra | 20:38 | |
marun | mtreinish: the only way I can see to do that would be to know how many preseeds are expected, e.g. it's set as a constant | 20:38 |
mtreinish | marun: I don't have a way to really check that though? | 20:38 |
mtreinish | marun: ah ok | 20:38 |
SpamapS | mordred: we also have this /etc/hosts file that is maleable and works great for stuff like this. | 20:38 |
SpamapS | fungi: I've hit the failure 3 times | 20:38 |
*** prad has quit IRC | 20:38 | |
marun | mtreinish: do you want me to incorporate such a check in my patch? | 20:38 |
marun | mtreinish: or should that come in a follow-on? | 20:39 |
SpamapS | fungi: just now in fact | 20:39 |
jeblair | sdague: that includes devstack-trusty nodes which are from DIB; they are current on hpcloud-b1 and hpcloud-b2 (and possibly others). the dib images should be the same across all of hpcloud. | 20:39 |
fungi | SpamapS: coming from the same source ip address? | 20:39 |
*** dannywilson has joined #openstack-infra | 20:39 | |
mtreinish | marun: I think as a followon would be fine | 20:39 |
marun | mtreinish: ok | 20:39 |
fungi | SpamapS: haproxy is set to persist by source address hash because of the fact that our git servers are not 100% in lockstep sync | 20:39 |
marun | mtreinish: I'd appreciate landing this refactor sooner than later so that we can be assured of consistent artifact processing on the functional jobs | 20:39 |
jeblair | sdague: so the remaining characteristic that ties hpcloud-b1 nodes together is they are on the same neutron net | 20:39 |
clarkb | jeblair: and router | 20:40 |
*** hashar has quit IRC | 20:40 | |
clarkb | marun: looking | 20:40 |
openstackgerrit | Maru Newby proposed openstack-infra/devstack-gate: Refactor processing of testr artifacts for reuse https://review.openstack.org/153677 | 20:40 |
fungi | SpamapS: and the full replication refresh is still going (we have a lot of repos for it to check, i wanted to make sure there weren't more possibly broken besides just that one) | 20:41 |
fungi | SpamapS: but should be done here in a few minutes | 20:41 |
SpamapS | fungi: I shall drum my fingers in anticipation. :) | 20:41 |
fungi | SpamapS: tap, tap, tap | 20:41 |
*** pcrews has quit IRC | 20:42 | |
clarkb | mtreinish: marun don't your two changes conflict? | 20:42 |
*** jgrimm is now known as zz_jgrimm | 20:42 | |
jeblair | sdague, clarkb: it's only happened 13 times in logstash, which is way too low to be every time a devstack job runs on b1 | 20:42 |
marun | clarkb: they do | 20:42 |
marun | clarkb: My latest patch incorporates his change | 20:42 |
SpamapS | sdague: two things. 1) That failure message would be more debuggable with the output of the 'ip route' command. | 20:42 |
clarkb | marun: gotcha | 20:42 |
openstackgerrit | John Villalovos proposed openstack-infra/system-config: Add description of 'ironic' log files https://review.openstack.org/153683 | 20:42 |
jeblair | sdague, clarkb: so i think we're looking at a highly intermittent error related to that network | 20:42 |
sdague | jeblair: it's the unit tests | 20:42 |
sdague | so that might be every time | 20:42 |
jeblair | sdague: also real devstack | 20:42 |
*** ghostpl has joined #openstack-infra | 20:42 | |
SpamapS | sdague: 2) I think what jeblair might be getting at is it is possible the box doesn't have an IP that isn't in the fixed/floating ranges. | 20:42 |
sdague | really? | 20:42 |
jeblair | yeah, lemme try to find a log link that works :/ | 20:43 |
*** pcrews has joined #openstack-infra | 20:44 | |
*** dannywilson has quit IRC | 20:44 | |
jeblair | sdague: unit tests, neutron-dsvm-api, grenade-dsvm-neutron, grenade-dsvm-partial-ncpu and grenade-dsvm | 20:44 |
*** dannywilson has joined #openstack-infra | 20:45 | |
jeblair | sdague: so i guess not "vanilla" devstack, but grenade-dsvm ought to be very common, and some of the others fairly common | 20:45 |
*** bswartz has quit IRC | 20:45 | |
jklare | hi, can someone help me with debugging this error here (http://logs.openstack.org/99/152299/1/experimental/gate-cookbook-openstack-compute-chef-rake/fb4268d/console.html) | 20:45 |
*** ociuhandu has quit IRC | 20:45 | |
*** jlvillal has joined #openstack-infra | 20:46 | |
jeblair | http://logs.openstack.org/13/146113/19/check/check-neutron-dsvm-api/cbe2cb4/console.html | 20:46 |
jeblair | the grenade ones don't have working logs :/ (from last week) | 20:46 |
jklare | i tried the same thing multiple times on fresh 14.04 boxes with just a fresh build-essential installed and it worked | 20:46 |
jklare | anybody any hint why its not working here? | 20:47 |
*** jlvillal has left #openstack-infra | 20:47 | |
*** ghostpl has quit IRC | 20:48 | |
*** ashleighfarnham has joined #openstack-infra | 20:48 | |
sdague | hmmm bummer | 20:48 |
fungi | jklare: this looks familiar. i think the chef devs disabled this job on trusty previously because native extension building was nondeterministic | 20:48 |
*** niska has quit IRC | 20:48 | |
jeblair | jklare: build-essential is installed on those machines, but autoconf is not | 20:48 |
jeblair | the idea of a "base system" is apparently highly variable :/ | 20:49 |
fungi | ahh, yep this is defintely a different one. now i see the "autoconf: not found" | 20:49 |
*** dannywilson has quit IRC | 20:49 | |
sdague | jeblair: so it looks like the host was given - 10.0.0.24 | 20:49 |
jeblair | also, the words "build essential" don't seem to meen what i think they mean | 20:49 |
*** shashankhegde has quit IRC | 20:50 | |
sdague | which is inside the fixed_range that we are setting on hosts | 20:50 |
jklare | fungi: yeah, its the same one we were running into before, but this should not happen anymore and i acutally can do the exact same thing on a fresh ubuntu 14.04 box with just apt-get update; apt-get install build-essential and then the scripts that were run here | 20:50 |
clarkb | marun: mtreinish that latest patchset lgtm | 20:50 |
sdague | which causes the error | 20:50 |
clarkb | sdague: fixed should be 10.1.0.0/20 | 20:50 |
fungi | jklare: worth noting that rackspace doesn't provide "fresh anything" | 20:50 |
clarkb | sdague: that is one of the things that devstack-gate fixes | 20:51 |
fungi | jklare: they make their own base images, custom | 20:51 |
sdague | clarkb: well... it's FIXED_RANGE=10.0.0.0/24 | 20:51 |
* mordred CAN'T WAIT to stop using cloud images | 20:51 | |
sdague | http://logs.openstack.org/13/146113/19/check/check-neutron-dsvm-api/cbe2cb4/console.html#_2015-02-03_21_46_37_578 | 20:51 |
fungi | jklare: so it's entirely possible that your "fresh install" had autoconf by default but rackspace's special base images omit it | 20:51 |
clarkb | sdague: then that job is wrong | 20:51 |
*** andreaf has quit IRC | 20:51 | |
clarkb | sdague: and they shouldn't override the settings that we set | 20:51 |
sdague | http://logs.openstack.org/13/146113/19/check/check-neutron-dsvm-api/cbe2cb4/logs/localrc.txt.gz | 20:51 |
clarkb | I mean | 20:51 |
sdague | it doesn't look like it's getting set for that job | 20:51 |
clarkb | we have done our best to give a consistent platform that works | 20:51 |
*** r1chardj0n3s_afk is now known as r1chardj0n3s | 20:51 | |
*** armax has quit IRC | 20:52 | |
jklare | fungi: so i should install autoconf ? | 20:52 |
jeblair | sdague, clarkb: maybe that's why this error doesn't show up for "normal" devstack jobs? | 20:52 |
sdague | jeblair: yep | 20:52 |
fungi | jklare: you can certainly apt-get install it as part of that job, yeah | 20:53 |
*** shashankhegde has joined #openstack-infra | 20:53 | |
jklare | fungi: do you think thats the right approach ? | 20:54 |
sdague | so I have a fix for the devstack unit tests up | 20:54 |
jklare | fungi: can i get these special images somewhere? | 20:54 |
sdague | the grenade tests should be set correctly, if we can find one that isn't with logs, we should look | 20:54 |
sdague | I actually have no idea how check-neutron-dsvm-api is configured | 20:54 |
fungi | jklare: by signing up for a rackspace account and booting their ubuntu 1.0.4 pvhvm image | 20:54 |
clarkb | sdague: unfortunately everyone assumes 10.0.0.0/24 is theirs to use. A better strategy might be to always use 10.255.0.0/16 | 20:55 |
fungi | er, 14.04 | 20:55 |
*** _nadya_ has joined #openstack-infra | 20:55 | |
jeblair | sdague: they are all on jan 29 and are missing logs :( | 20:55 |
clarkb | or introspecting interfaces on the local machine and picking from a range that doesn't conflict | 20:55 |
sdague | jeblair: they may be unrelated | 20:56 |
fungi | jklare: as soon as we can actually use rackspace's glance to upload our own working bootable images, we plan to also start making them available for download | 20:56 |
*** markvan has joined #openstack-infra | 20:56 | |
clarkb | fwiw we used 10.0.0.0/24 bceaues its hpcloud's default. we actually have the ability to change it | 20:56 |
jeblair | clarkb: how did they get into logstash without being on static.o.o? | 20:56 |
sdague | clarkb: sure, so this is where devstack default just runs afoul, which is why it gets set | 20:56 |
clarkb | jeblair: did they get renamed to hvae a .gz suffix? | 20:56 |
jeblair | oooooh | 20:57 |
jklare | fungi: ...kk ty, i guess i will give it a try and do a quick patch with autoconf | 20:57 |
fungi | jklare: but at the moment we're still roadblocked on things like the fact that they use a custom daemon to update network interface settings in instances at/after boot | 20:57 |
sdague | yeh... we need to do an apache redirect for that :) | 20:57 |
jeblair | sdague: http://logs.openstack.org/16/149416/4/check/check-grenade-dsvm/2a80dde/logs/grenade.sh.txt.gz | 20:57 |
*** mwagner_lap has quit IRC | 20:57 | |
sdague | jeblair: ok, that's just broken crazy pants - http://logs.openstack.org/16/149416/4/check/check-grenade-dsvm/2a80dde/logs/old/localrc.txt.gz | 20:58 |
jeblair | 2015-01-29 04:00:33.435 | /opt/stack/old/devstack/localrc: line 88: syntax error: unexpected end of file | 20:58 |
sdague | yep | 20:58 |
fungi | wow | 20:59 |
sdague | yeh, that's just a trove grenade patch that didn't know what it was doint | 20:59 |
sdague | unrelated fail | 20:59 |
sdague | https://review.openstack.org/#/c/149416/ rev4 | 20:59 |
ekarlso | is it possible with devstack to target an existing keystone ? | 21:00 |
jeblair | so it's a bit of a catch-all error | 21:01 |
fungi | SpamapS: btw that replication refresh looks to be well finished at this point. are you still seeing failures? | 21:01 |
*** tiswanso has quit IRC | 21:01 | |
openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Fix bug in template job yaml expansion. https://review.openstack.org/150666 | 21:01 |
*** yjiang5 has joined #openstack-infra | 21:01 | |
stevemar | ekarlso, that's a good question | 21:01 |
stevemar | ekarlso, i want to say not at the moment | 21:02 |
clarkb | ekarlso: disable keystone in the service list and set the appropriate vars? | 21:02 |
dtroyer | ekarlso: should be, don't enable key and set the KEYSTONE_* vars appropriately | 21:02 |
clarkb | dtroyer: o/ | 21:02 |
stevemar | ekarlso, don't listen to me | 21:02 |
SpamapS | fungi: failed 3 minutes ago. Restarting now. | 21:02 |
*** davideagnello has quit IRC | 21:02 | |
jeblair | sdague: i've confirmed the check-neutron-dsvm-api failure has "FIXED_RANGE=" in localrc | 21:02 |
*** Adri2000 has quit IRC | 21:02 | |
*** melwitt has joined #openstack-infra | 21:03 | |
*** Adri2000 has joined #openstack-infra | 21:03 | |
fungi | SpamapS: i've got a few minutes free now so i'll check for it in all the backends to make sure something's not worse wrong than usual | 21:03 |
mordred | fungi: oh - the config drive support went live | 21:03 |
mordred | fwiw | 21:03 |
jeblair | sdague, clarkb: so is the current hypothesis: devstack-gate unit tests don't set fixed_range and we occasionally get assigned an ip that is in the default fixed_range? | 21:03 |
fungi | mordred: in all the regions now? | 21:03 |
clarkb | jeblair: sdague note that b2 is 10.0.1.0/24 b3 is 10.0.2.0/24 and so on | 21:03 |
fungi | mordred: the ones we use anyway? | 21:03 |
mordred | yeah - I need to test it still | 21:03 |
mordred | yah | 21:04 |
fungi | okay, last i heard it was just iad | 21:04 |
fungi | but then again that was a while back | 21:04 |
*** melwitt_ has joined #openstack-infra | 21:04 | |
mordred | I was hoping to get it tested today, but then today fell apart | 21:04 |
clarkb | jeblair: well b1 will always be 10.0.0.0/24 its the default that hpcloud used for a long time and was not changeable | 21:04 |
clarkb | so when we switched to neutron I thought nothing of it | 21:04 |
clarkb | we could add a new network range for b1 | 21:04 |
jeblair | clarkb: that jives with hypothesis above ^ | 21:04 |
clarkb | but really if you intend on using 10/8 without introspecting network interfaces I think it is on you to set a less commonly used range like 10.255.0.0/16 | 21:05 |
*** davideagnello has joined #openstack-infra | 21:05 | |
openstackgerrit | Claudiu Belu proposed openstack-infra/project-config: Adds networking-hyperv in StackForge https://review.openstack.org/153691 | 21:06 |
*** tiswanso_ has joined #openstack-infra | 21:06 | |
sdague | jeblair: yeh | 21:06 |
clarkb | my home network sits on 10.0.0.0/24 too so I am a fan of tools not using it by dfeault :0 | 21:06 |
clarkb | er :) | 21:06 |
dtroyer | clarkb: I'm afraid that's a common less-commonly-used net ;) Also, I find it nice to totally go where others aren't: 172.21.0.0/xx or something | 21:06 |
dtroyer | I think changing DevStack's default might be overdue? | 21:06 |
*** bdpayne has quit IRC | 21:06 | |
clarkb | dtroyer: ya 172.21.0.0 would likely be better | 21:06 |
jeblair | dtroyer: that might be the best most universal solution | 21:06 |
sdague | maybe, it's whack a mole though | 21:07 |
fungi | SpamapS: it's not a replication problem after all. apparently the script which precreates those empty repos for gerrit to replicate into failed to create the one for that project. diagnosing it now to see if i can tell why | 21:07 |
clarkb | sdague: yes prper fix is check interfaces on host | 21:07 |
sdague | and honestly, people get confused about the 172 one | 21:07 |
clarkb | don't overlap | 21:07 |
*** armax has joined #openstack-infra | 21:07 | |
dtroyer | right, but fewer moles in the middle of the desert, especially when large corps all think they own 10/8 | 21:07 |
sdague | clarkb: or die early like we do, and make you set it | 21:07 |
*** melwitt has quit IRC | 21:07 | |
sdague | clarkb: you need to set your home network to 10.42.0.0 like I did :) | 21:08 |
sdague | so, anyway, there is a unit test fix up | 21:08 |
sdague | changing the defaults is fine as well | 21:08 |
* fungi uses 172.23.5.0/24 | 21:08 | |
clarkb | sdague: I tell you what nova boot --flavor 42 is the best thing ever | 21:08 |
sdague | :) | 21:08 |
clarkb | sdague: I can always remember what flavor to use after tempest runs | 21:08 |
sdague | only second to the heat specific flavor we had for a while... 451 | 21:09 |
fungi | NICE | 21:09 |
*** markmcclain has quit IRC | 21:09 | |
fungi | centigrade 233 | 21:09 |
openstackgerrit | John Villalovos proposed openstack-infra/system-config: Add description of 'ironic' log files https://review.openstack.org/153683 | 21:09 |
sdague | oh, it's still in there | 21:10 |
sdague | lib/tempest: nova flavor-create m1.heat 451 512 0 1 | 21:10 |
fungi | that's marvellous | 21:10 |
SpamapS | fungi: retry failed | 21:10 |
clarkb | anteaya: for 136395 aren't we building for all branches and publishing to branch specific locations? | 21:10 |
clarkb | anteaya: is there a problem with how that is done? | 21:10 |
fungi | SpamapS: it's not a replication problem after all. apparently the script which precreates those empty repos for gerrit to replicate into failed to create the one for that project. diagnosing it now to see if i can tell why | 21:10 |
openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Fix bug in template job yaml expansion. https://review.openstack.org/150666 | 21:10 |
clarkb | fungi: if puppetfailed to run when git derped and you reran it then maybe the subscription for the exec wasn't triggered? | 21:11 |
fungi | maybe | 21:11 |
*** davideagnello has quit IRC | 21:11 | |
* mtreinish feels really slow for not noticing those flavor ids before | 21:11 | |
clarkb | fungi: that would happen if the event that triggers the exec was successfully executed by puppet, then it got stuck on git before runningthe exec | 21:11 |
*** daneyon_ has joined #openstack-infra | 21:13 | |
*** davideagnello has joined #openstack-infra | 21:13 | |
*** marun has quit IRC | 21:13 | |
*** fbo has quit IRC | 21:14 | |
clarkb | mtreinish: for 153438 it will make those jobs stop voting | 21:14 |
daneyon_ | My name is Daneyon Hansen. I have had a profile on openstack.org for several years, but for some reason it is no longer appearing in search and public profile. Is their anyone who can help me troubleshoot? | 21:15 |
clarkb | mtreinish: they will run but not impact jenkins votes | 21:15 |
clarkb | mtreinish: so since we had made them vote for a while wanted to make sure that you are ok with the chnage (it was what we originally intended just not implemented quite right) | 21:15 |
sdake_ | daneyon_ you get an error right? "accessing page doesn't exist"? | 21:15 |
mtreinish | clarkb: oh, we want tempest stable jobs to be voting. That's why we run them to make sure we don't break the stable branches | 21:16 |
clarkb | mtreinish: right but icehouse hasn't voted | 21:16 |
mtreinish | if it's not voting I don't think anyone would pay attention to that | 21:16 |
clarkb | mtreinish: and juno wasn't supposed to be but is. This was our original intention | 21:16 |
mtreinish | clarkb: I believe it does: https://review.openstack.org/#/c/153462/ | 21:16 |
*** kgiusti has quit IRC | 21:17 | |
clarkb | hrm | 21:17 |
clarkb | pleia2: ^ there may be something else broken | 21:17 |
jeblair | 438 just sets the branch selector for those | 21:17 |
clarkb | OH | 21:17 |
clarkb | wow I shouldn't review things tired I guess | 21:17 |
clarkb | nevermind then | 21:18 |
*** markvan has quit IRC | 21:18 | |
jeblair | and i think that change is not necessary because there is no juno tempest branch | 21:18 |
fungi | clarkb: wow, we need to be more careful... http://paste.openstack.org/show/168306/ | 21:18 |
fungi | clarkb: С may look like C but it is _not_ the same codepoint | 21:18 |
clarkb | wait | 21:18 |
fungi | wondering how best to catch things like that | 21:18 |
clarkb | did someone intentionally do that too? I don't even | 21:19 |
fungi | >>> unicodedata.name(u'\u0421') | 21:19 |
fungi | 'CYRILLIC CAPITAL LETTER ES' | 21:19 |
daneyon_ | sdake_: Sorry, it seems you were trying to access a page that doesn't exist. Please check the spelling of the URL you were trying to access and try again. URL = http://www.openstack.org/community/members/profile/1394 | 21:19 |
fungi | clarkb: i'm guessing it's a key on a cyrillic keyboard | 21:19 |
clarkb | ga in vim confirms thats awesome | 21:19 |
sdake_ | daneyon_ not sure how that happens or why, but I'm sure some web wizard here can fix :) | 21:19 |
clarkb | I wonder if daneyon_'s thing is related to membership rolls expiring based on voting practice? | 21:20 |
sdake_ | clarkb have any pointers on folks that can fix daneyon_'s problem? hes submitting a talk with me and I don't want it to break the submission | 21:20 |
daneyon_ | calling all web wizards :) | 21:20 |
clarkb | reed: ^ | 21:20 |
*** achanda has joined #openstack-infra | 21:20 | |
clarkb | daneyon_: the only immediate thing that comes to mind is maybe you hadn't voted enough to maintain membership qualification | 21:20 |
sdake_ | clarkb iiuc daneyon had two accounts registered | 21:20 |
sdake_ | and deleted one | 21:20 |
*** signed8bit is now known as signed8bit_ZZZzz | 21:21 | |
sdake_ | clarkb is it too late to vote :) | 21:21 |
clarkb | let me ask around | 21:22 |
sdake_ | clarkb thanks :) | 21:22 |
*** _nadya_ has quit IRC | 21:23 | |
*** r1chardj0n3s is now known as r1chardj0n3s_afk | 21:24 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Replace Cyrillic capital ES with Latin capital C https://review.openstack.org/153698 | 21:24 |
fungi | SpamapS: ^ there's the cause | 21:25 |
*** dprince has quit IRC | 21:25 | |
*** signed8bit_ZZZzz is now known as signed8bit | 21:25 | |
clarkb | fungi: the diff page in gerrit is amazing for that change | 21:25 |
clarkb | also fungi ^ any ideas on daneyon_'s thing? | 21:25 |
fungi | i know right? | 21:25 |
openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Fix bug in template job yaml expansion. https://review.openstack.org/150666 | 21:25 |
*** achanda has quit IRC | 21:25 | |
fungi | clarkb: no ideas on daneyon_'s thing short of dragging toddmorey or wes out of hiding to dig into it, or reaching out to jpmaxman or jimmy | 21:26 |
daneyon_ | clarkb: I have voted every election. | 21:26 |
fungi | clarkb: i'll try some alternate channels | 21:26 |
daneyon_ | clarkb: At some point, I think someone had used my name, Daneyon Hansen to create a 2nd profile using a different email. I deleted this 2nd account under my name. | 21:27 |
sdake_ | time to restore from backups! | 21:27 |
sdake_ | sorry oculdn't resist :) | 21:27 |
jesusaurus | how do i get testr to tell me what the import errors are? | 21:28 |
clarkb | jesusaurus: it should tell you which module is erroring, then import that module with python | 21:28 |
*** koolhead17 has quit IRC | 21:28 | |
mordred | jesusaurus: .tox/py27/bin/python -m testtools.run discover --list | 21:29 |
mordred | jesusaurus: should print out a list of the available tests | 21:29 |
mordred | and if there are import errors, one of them should bomb out | 21:29 |
clarkb | jesusaurus: apparently something in the python test frameworks/standards/stuff don't allow the exception to bubble out properly | 21:29 |
mordred | yeah - I think lifeless finally got the fix for that landed in 3.4 and is working to bubble it back out | 21:30 |
clarkb | oh cool | 21:30 |
jesusaurus | clarkb: mordred: awesome thanks | 21:31 |
mtreinish | clarkb: you should just be able to do a testr list-tests with everything up to date and it'll print the exception | 21:31 |
*** melwitt_ is now known as melwitt | 21:31 | |
mtreinish | that should have all been in the latest release | 21:31 |
*** radez is now known as radez_g0n3 | 21:31 | |
clarkb | even better | 21:31 |
clarkb | fungi: clearly we should have gerrit display raw binary to us | 21:32 |
clarkb | fungi: then any octet without a leading 0 loses | 21:32 |
fungi | clarkb: or fix create_cgitrepos.py (assuming cgit itself deals okay with utf-8 project descriptions) | 21:33 |
fungi | descriptions are one place at least where i think non-ascii printable characters should be permitted | 21:34 |
daneyon_ | clarkb: when i search daneyon on www.openstack.org, I find another profile number with my name associated: http://www.openstack.org/community/members/profile/8528 I get the same error as profile 1394: Sorry, it seems you were trying to access a page that doesn't exist. Please check the spelling of the URL you were trying to access and try again. | 21:35 |
*** mfink_ has quit IRC | 21:37 | |
fungi | daneyon_: interesting. i'm (carefully) looking around in the backend database for that since i do have access, and i see a member table entry for 1394 with profile info which looks like yours, but nothing for 8528 | 21:37 |
fungi | daneyon_: but find no corresponding entry in the group_members table | 21:38 |
*** ChuckC has quit IRC | 21:38 | |
fungi | (for 1394 i mean) | 21:38 |
clarkb | jeblair: any reason you didn't approve 151656? | 21:38 |
fungi | no, i take that back, member id 1394 is in groups 4 and 8 | 21:39 |
jeblair | fungi: where are you looking? | 21:39 |
openstackgerrit | Merged openstack-infra/project-config: Replace Cyrillic capital ES with Latin capital C https://review.openstack.org/153698 | 21:39 |
fungi | jeblair: the silverstripe trove database, credentials are in hiera | 21:40 |
daneyon_ | clarkb: 1394 appears to be the one that gets loaded when i click view public profile from my profile edit page | 21:40 |
*** marun has joined #openstack-infra | 21:40 | |
jeblair | fungi: thx | 21:40 |
*** bswartz has joined #openstack-infra | 21:40 | |
*** crc32 has quit IRC | 21:40 | |
fungi | jeblair: openstackid_ss_mysql_.* are the hiera keys | 21:40 |
jeblair | clarkb: no reason :) | 21:41 |
clarkb | jeblair: ok I am apprving it then | 21:41 |
*** vigneshvar has joined #openstack-infra | 21:41 | |
*** amotoki has quit IRC | 21:41 | |
fungi | daneyon_: yeah, i think the developers for the site have suggested previously that the account needs to be in group id 5 to count as an individual member | 21:41 |
*** leakypipes has quit IRC | 21:41 | |
fungi | which 1394 is not currently | 21:42 |
openstackgerrit | Khai Do proposed stackforge/python-jenkins: Set the server connection timeout to same as socket timeout https://review.openstack.org/153467 | 21:42 |
fungi | daneyon_: when you browse to https://www.openstack.org/profile/ do you see buttons to the right under the "Profile" heading? | 21:43 |
*** markmcclain has joined #openstack-infra | 21:43 | |
*** sigmavirus24_awa is now known as sigmavirus24 | 21:43 | |
fungi | daneyon_: one might say something like "become a foundation member" | 21:43 |
*** signed8bit has quit IRC | 21:44 | |
daneyon_ | fungi: ya, i see make me a foundation member. let me try that. | 21:44 |
jeblair | or "membership has its rewards" | 21:44 |
*** yamahata has quit IRC | 21:45 | |
daneyon_ | fungi: my member level was speaker. i think someone changed that for my Paris talk.. it used to be member | 21:45 |
fungi | daneyon_: interesting. we'll make sure someone who manages that system looks into it | 21:46 |
*** alexpilotti has joined #openstack-infra | 21:47 | |
*** dmsimard is now known as dmsimard_away | 21:47 | |
jeblair | fungi, mordred: make sure you are on the same page wrt to things like 153354 | 21:49 |
*** ihrachyshka has quit IRC | 21:49 | |
openstackgerrit | Merged openstack-infra/puppet-etherpad_lite: Add connection-tuning file to new Apache 2.4 conf folder structure https://review.openstack.org/151656 | 21:50 |
fungi | jeblair: yeah, we're both aware, that was more of a "SpamapS wanted an example because he was trying to figure out why mysql setupt would be broken under dib" | 21:50 |
jeblair | ok | 21:51 |
fungi | mordred: that should probably be a wip change, maybe indefinitely? | 21:51 |
clarkb | jeblair: its ok to merge some of zaro's puppet-gerrit config changes right? | 21:51 |
*** baoli has quit IRC | 21:51 | |
clarkb | zaro: ^ you too | 21:51 |
jeblair | clarkb: afaik | 21:52 |
openstackgerrit | Kyle Mestery proposed openstack-infra/project-config: Add a check job for the networking-odl project https://review.openstack.org/153704 | 21:52 |
fungi | daneyon_: btw i see your account in group 5 now (individual member) and http://www.openstack.org/community/members/profile/1394 is returning content now | 21:52 |
clarkb | 151368 is the one I am most worried about | 21:52 |
openstackgerrit | Kyle Mestery proposed openstack-infra/devstack-gate: Add DEVSTACK_GATE_NEUTRON_ODL option to enable ODL https://review.openstack.org/153705 | 21:52 |
daneyon_ | fungi: works now. thank you so much. | 21:53 |
jeblair | huh, there is no number 1. or number 2. or number 6. | 21:53 |
daneyon_ | clarkb: works now. thanks a ton! | 21:53 |
clarkb | daneyon_: it was mostly fungi :) glad you got it working | 21:53 |
anteaya | clarkb: for 136395 I submitted that a long time ago at andreas' request | 21:54 |
anteaya | clarkb: I'll have to talk to him and refresh my memory | 21:54 |
clarkb | anteaya: ok no worries | 21:54 |
anteaya | thanks for looking at it | 21:54 |
openstackgerrit | Guido Günther proposed stackforge/python-jenkins: Use empty crumb on empty resonse https://review.openstack.org/153398 | 21:55 |
openstackgerrit | Guido Günther proposed stackforge/python-jenkins: Don't assume we get a valid response https://review.openstack.org/153399 | 21:55 |
openstackgerrit | Guido Günther proposed stackforge/python-jenkins: Fix incorrect indentation https://review.openstack.org/153706 | 21:55 |
openstackgerrit | Guido Günther proposed stackforge/python-jenkins: Don't return None on unhandled http errors https://review.openstack.org/153707 | 21:55 |
daneyon_ | fungi: is their anyway to kill my 8528 account? It's the first one that shows up in a search and redirects to a busted page | 21:57 |
clarkb | zaro: please see comment on 151368 | 21:57 |
openstackgerrit | Merged openstack-infra/puppet-gerrit: Set the Gerrit change screen default to OLD_UI. https://review.openstack.org/151359 | 21:57 |
fungi | daneyon_: yeah the admins for the site are looking at it right now | 21:58 |
*** amitgandhinz has joined #openstack-infra | 21:59 | |
daneyon_ | fungi: thx | 21:59 |
fungi | daneyon_: i only have some limited visibility into the backend for it at the moment and the ability to pester them ;) | 21:59 |
*** annegent_ has quit IRC | 22:00 | |
*** achanda has joined #openstack-infra | 22:00 | |
zaro | clarkb: answered your question | 22:01 |
clarkb | zaro: I don't follow. You specifically install that particular package system wide only if not on precise | 22:02 |
clarkb | zaro: so if you delete the gerrit isntalled version won't that break? | 22:02 |
*** mattfarina has quit IRC | 22:02 | |
zaro | clarkb: ohh sorry i think i wasn't clear about that. | 22:03 |
openstackgerrit | Joe Gordon proposed openstack/requirements: Bump tempest-lib to > 0.2.0 https://review.openstack.org/153708 | 22:03 |
openstackgerrit | Merged openstack-infra/puppet-gerrit: Update Gerrit Puppet module for Trusty https://review.openstack.org/151783 | 22:03 |
zaro | clarkb: i removed the gerrit installed version and it did not break. | 22:04 |
clarkb | zaro: so, does that mean we are using a slower non bouncy castle version of an algorithm? | 22:04 |
clarkb | zaro: I think it would be good to better understand what that means to our current install | 22:05 |
*** abhirc has quit IRC | 22:05 | |
daneyon_ | fungi: no biggie. As long as i have a working profile, then i'm OK. Killing the other profile is a nice to have | 22:05 |
fungi | daneyon_: the member search at http://www.openstack.org/community/members/ is working correctly for me when i plug in your name | 22:05 |
fungi | daneyon_: the general site search is "powered by google" and so it's anybody's guess what they cached | 22:05 |
*** bswartz has quit IRC | 22:05 | |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Remaining functional tests for the OAuth Endpoint https://review.openstack.org/152752 | 22:06 |
daneyon_ | fungi: i see, i was just using the general site search. i'm good. thx again for all the help. | 22:06 |
zaro | clarkb: actually i didn't check what the difference is between the OS packaged version and the one that Gerrit gets when initializing the site. | 22:06 |
clarkb | jeblair: how do I see WIP/d changes in gertty? | 22:06 |
clarkb | zaro: thats not my concern, my concern is on precis ewhere we don't have the system package | 22:06 |
fungi | daneyon_: hopefully that will be self-correcting with your correct profile now reachable. glad you got sorted | 22:06 |
*** salv-orl_ has joined #openstack-infra | 22:07 | |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: OAuth delete refresh tokens when access tokens deleted. https://review.openstack.org/153710 | 22:07 |
zaro | clarkb: i noticed that the puppet was setup use the os packaged version of these files and that's what i thought we wanted to do | 22:07 |
clarkb | but we should probably double check that sysem package is reasonably close to what gerrit wants | 22:07 |
*** daneyon_ has left #openstack-infra | 22:07 | |
openstackgerrit | Joe Gordon proposed openstack/requirements: Bump tempest-lib min version to 0.2.0 https://review.openstack.org/153708 | 22:07 |
clarkb | zaro: yes I think using the system packages is fine | 22:07 |
clarkb | zaro: the problem here is we don't have a system package on precise | 22:07 |
clarkb | fungi: I think you can remove your -2 from 152217 now | 22:08 |
zaro | clarkb: ohh to clarify, that lib is not needed on precise. so it won't get setup | 22:08 |
*** salv-orlando has quit IRC | 22:08 | |
clarkb | zaro: why isn't it needed on precise? | 22:08 |
clarkb | zaro: if you were to install gerrit 2.9 on precise you would need it right? | 22:08 |
zaro | clarkb: sorry, i see now. | 22:08 |
zaro | clarkb: gerrit 2.9 on precise will fail without that lib. | 22:09 |
clarkb | ok. we need to be a bit more careful aboutthis stuff particularly if we want these puppet modules to be reconsumable | 22:09 |
fungi | clarkb: alternatively, i'm tempted to just do 153305 instead and stop caring about that repo | 22:09 |
*** bradjones has quit IRC | 22:09 | |
clarkb | fungi: wfm | 22:09 |
clarkb | mordred: ^ | 22:09 |
*** mattfarina has joined #openstack-infra | 22:10 | |
*** mattfarina has quit IRC | 22:10 | |
*** zigo has joined #openstack-infra | 22:11 | |
*** salv-orl_ has quit IRC | 22:11 | |
zaro | clarkb: i think the easiest solution to this is to just let Gerrit download whatever lib it wants and use those instead of the OS packaged ones? | 22:12 |
flashgordon | clarkb: just two +2 reviews away from landing https://review.openstack.org/#/c/136179/5 | 22:12 |
clarkb | fungi: actually wait, forsimilar reasons to why I -1'd zaro's change we probably want to have a pip module | 22:12 |
flashgordon | fungi: ^ | 22:12 |
*** joesavak has quit IRC | 22:13 | |
clarkb | fungi: not everyone will have used our node install scripts so need something that gets them pip | 22:13 |
flashgordon | clarkb: and getting multihost aiopcpu working | 22:13 |
*** bradjones has joined #openstack-infra | 22:13 | |
clarkb | flashgordon: so close | 22:13 |
*** bknudson has quit IRC | 22:13 | |
*** ChuckC has joined #openstack-infra | 22:13 | |
zaro | clarkb: i don't see how that relates to the puppet-gerrit change | 22:13 |
*** bcourt has quit IRC | 22:13 | |
clarkb | zaro: just that both need to be much more careful around the idea of other people using them | 22:14 |
fungi | clarkb: if so, i think it needs to be a better pip module | 22:15 |
clarkb | fungi: agreed | 22:15 |
zaro | clarkb: ok. is that an answer to my suggestion? | 22:15 |
clarkb | it can stash get-pip.py off in a corner somewhere and make sure it exists and has been run | 22:15 |
clarkb | zaro: no | 22:16 |
clarkb | zaro: I do not know why we use system packages instead ofgerrit provided packages | 22:16 |
clarkb | zaro: jeblair may know | 22:16 |
*** davideagnello has quit IRC | 22:17 | |
*** achanda has quit IRC | 22:17 | |
zaro | clarkb: might be tied to jdk on the system? | 22:17 |
*** achanda has joined #openstack-infra | 22:17 | |
clarkb | zaro: if I had to guess it would be so that we get package updates | 22:18 |
clarkb | which is a good reason to use system packages | 22:18 |
*** davideagnello has joined #openstack-infra | 22:18 | |
*** tkelsey has joined #openstack-infra | 22:19 | |
SpamapS | fungi: still broken | 22:19 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: OAuth now validates client ID against a configured list. https://review.openstack.org/153715 | 22:19 |
clarkb | SpamapS: you could just not use that element for now if it helps | 22:20 |
* krotscheck thinks he may finally be done with auth things. | 22:20 | |
jeblair | clarkb, zaro: yeah, i'd love to continue to use system provided packages for things like crypto libs that gerrit uses | 22:20 |
jeblair | cause i have no idea who's going to make sure that's up to date otherwise | 22:21 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Explicit Hook Priorities https://review.openstack.org/152253 | 22:21 |
zaro | i'm not sure i see a way to run gerrit 2.9 on precise then. | 22:21 |
fungi | SpamapS: yeah, the fix merged a little while ago but i may still need to manually re-run the script now | 22:22 |
SpamapS | clarkb: the cache-devstack element? | 22:22 |
jeblair | zaro: i don't think we have to support that | 22:22 |
zaro | clarkb: ^ does that clear it up? | 22:22 |
*** baoli has joined #openstack-infra | 22:23 | |
clarkb | zaro: I guess. we should probably be explicit about it somewhere but ya wfm | 22:23 |
jeblair | i think we should avoid breaking 2.8 on precise, and if someone wants to figure out how to do 2.9 on precise, that's fine, but otherwise, i think we can move on | 22:23 |
jeblair | clarkb, zaro: i'd be okay if the module errored out and said "2.9 on precise is not supported" | 22:23 |
*** tkelsey has quit IRC | 22:23 | |
clarkb | I will update my review | 22:24 |
openstackgerrit | Guido Günther proposed stackforge/python-jenkins: Don't return None on unhandled http errors https://review.openstack.org/153707 | 22:24 |
openstackgerrit | Guido Günther proposed stackforge/python-jenkins: Fix incorrect indentation https://review.openstack.org/153706 | 22:24 |
openstackgerrit | Guido Günther proposed stackforge/python-jenkins: Use empty crumb on empty resonse https://review.openstack.org/153398 | 22:24 |
openstackgerrit | Guido Günther proposed stackforge/python-jenkins: Don't assume we get a valid response https://review.openstack.org/153399 | 22:24 |
openstackgerrit | Kyle Mestery proposed openstack-infra/project-config: Add a check job for the networking-odl project https://review.openstack.org/153704 | 22:24 |
zaro | cool. will update. | 22:24 |
clarkb | SpamapS: yes I think thats the one | 22:24 |
clarkb | SpamapS: it sets up the git repo cache thing | 22:24 |
SpamapS | clarkb: ok, but I am dubious that I'll be able to test mysql ops in dib without all the pieces. | 22:24 |
openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Add support for volume attach/detach https://review.openstack.org/153623 | 22:25 |
* SpamapS will try it out anyway | 22:25 | |
clarkb | SpamapS: why? thats just a repo cache completely separate from mysql | 22:26 |
fungi | SpamapS: very close now i think. the repo backends are successfully creating all the repos from the list again and i've fired off one more replication refresh to update any which were previously missing | 22:26 |
*** stevemar has quit IRC | 22:26 | |
clarkb | SpamapS: and if it doesn't we should probably make it so it does | 22:26 |
clarkb | SpamapS: so let me know and I can work on that if it is an issue | 22:26 |
*** erlon has quit IRC | 22:26 | |
SpamapS | clarkb: I'm trying to replicate what breaks for you guys first. I'm not really fully aware of the whole thing, just blindly crashing down a path toward a suggested failure mode. | 22:26 |
*** stevemar has joined #openstack-infra | 22:27 | |
*** otter768 has joined #openstack-infra | 22:27 | |
clarkb | zaro: ok reivew updated. | 22:28 |
*** signed8bit has joined #openstack-infra | 22:28 | |
*** marun has quit IRC | 22:30 | |
*** annegentle has joined #openstack-infra | 22:30 | |
*** otter768 has quit IRC | 22:32 | |
*** baoli has quit IRC | 22:33 | |
*** wenlock has quit IRC | 22:34 | |
*** ashleighfarnham has quit IRC | 22:35 | |
*** lnxnut has quit IRC | 22:35 | |
*** vigneshvar has quit IRC | 22:36 | |
openstackgerrit | Craig Bryant proposed openstack-infra/project-config: Add maven build and repo upload for monasca-api https://review.openstack.org/153719 | 22:36 |
mordred | clarkb: yah .... I want a real minimal node so we catch stuff | 22:36 |
openstackgerrit | Guido Günther proposed stackforge/python-jenkins: Don't return None on unhandled http errors https://review.openstack.org/153707 | 22:37 |
openstackgerrit | Guido Günther proposed stackforge/python-jenkins: Fix incorrect indentation https://review.openstack.org/153706 | 22:37 |
openstackgerrit | Guido Günther proposed stackforge/python-jenkins: Use empty crumb on empty resonse https://review.openstack.org/153398 | 22:37 |
fungi | SpamapS: btw git cloning should work for all the repos again now | 22:38 |
*** abhirc has joined #openstack-infra | 22:39 | |
openstackgerrit | Kyle Mestery proposed openstack-infra/project-config: Add a check job for the networking-odl project https://review.openstack.org/153704 | 22:40 |
*** bhuvan has quit IRC | 22:41 | |
*** bhuvan has joined #openstack-infra | 22:42 | |
*** pc_m has quit IRC | 22:43 | |
openstackgerrit | Guido Günther proposed stackforge/python-jenkins: fixup! Use empty crumb on empty resonse https://review.openstack.org/153722 | 22:43 |
openstackgerrit | Guido Günther proposed stackforge/python-jenkins: Don't return None on unhandled http errors https://review.openstack.org/153707 | 22:44 |
openstackgerrit | Guido Günther proposed stackforge/python-jenkins: Fix incorrect indentation https://review.openstack.org/153706 | 22:44 |
openstackgerrit | Guido Günther proposed stackforge/python-jenkins: Use empty crumb on empty response https://review.openstack.org/153398 | 22:44 |
*** carl_baldwin has joined #openstack-infra | 22:45 | |
*** mriedem has quit IRC | 22:46 | |
*** joesavak has joined #openstack-infra | 22:47 | |
*** vigneshvar has joined #openstack-infra | 22:47 | |
*** otter768 has joined #openstack-infra | 22:48 | |
*** jsavak has joined #openstack-infra | 22:49 | |
*** yamamoto has joined #openstack-infra | 22:50 | |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Pass the old entity values in the NotificationHook https://review.openstack.org/151645 | 22:50 |
openstackgerrit | Merged openstack-infra/puppet-storyboard: Added config.json to manifest https://review.openstack.org/148757 | 22:51 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: API events now include resource before/after state. https://review.openstack.org/152318 | 22:51 |
clarkb | mordred: 152691 | 22:52 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Email base plugin. https://review.openstack.org/151948 | 22:52 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Email Templating Engine https://review.openstack.org/147734 | 22:52 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Email SMTP Sender https://review.openstack.org/149792 | 22:52 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Email configuration. https://review.openstack.org/151946 | 22:52 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: [WIP] Email Send Cron Worker https://review.openstack.org/151416 | 22:52 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Email Working Directory Utility Method https://review.openstack.org/151947 | 22:52 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Email Outbox https://review.openstack.org/151413 | 22:52 |
greghaynes | such email | 22:52 |
*** joesavak has quit IRC | 22:53 | |
mordred | clarkb: woo | 22:53 |
clarkb | mordred: it timed out | 22:53 |
openstackgerrit | Guido Günther proposed stackforge/python-jenkins: Don't return None on unhandled http errors https://review.openstack.org/153707 | 22:54 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Email base plugin. https://review.openstack.org/151948 | 22:55 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Email SMTP Sender https://review.openstack.org/149792 | 22:55 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: [WIP] Email Send Cron Worker https://review.openstack.org/151416 | 22:55 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Email Working Directory Utility Method https://review.openstack.org/151947 | 22:55 |
openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Email Outbox https://review.openstack.org/151413 | 22:55 |
mordred | clarkb: I don't like that | 22:56 |
*** annegentle has quit IRC | 22:57 | |
clarkb | the wheelhouse must not be working? | 22:57 |
clarkb | pretty sure we set one up first thing to make lxml installs not terrible | 22:57 |
*** annegentle has joined #openstack-infra | 22:57 | |
*** marun has joined #openstack-infra | 22:58 | |
clarkb | hrm grepping for wheelhouse shows nothing | 22:58 |
fungi | yeah, that's definitely running way too long | 22:58 |
zaro | fungi: can you help with this? http://paste.openstack.org/show/168354/ | 22:58 |
*** signed8bit has quit IRC | 22:58 | |
zaro | zuul looks like its using the private key to connect to gerrit and there's a mismatch. | 22:59 |
*** yamamoto has quit IRC | 23:00 | |
fungi | zaro: if memory serves, paramiko's error message is a little misleading there, and that's it's actually just not able to read the private key | 23:00 |
fungi | zaro: this is supposed to be using /var/lib/zuul/ssh/id_rsa on zuul-dev right? | 23:00 |
zaro | fungi: so when i attempt to start zuul-server with gerrit_user='jenkins' then i gett that error, but when i start with 'zuul-dev' then no error. | 23:01 |
zaro | fungi: yes that what the zuul.conf is pointing to. | 23:01 |
fungi | zaro: i'll check whether the public key for jenkins in review-dev corresponds to the private key on zuul-dev | 23:02 |
clarkb | fungi: any luck with git on centos6? | 23:02 |
fungi | clarkb: no obvious signs of hangups so it's possible i need to try something more than a remote update to trigger it | 23:04 |
SpamapS | fungi: ty | 23:05 |
*** amitgandhinz has quit IRC | 23:07 | |
*** yamamoto has joined #openstack-infra | 23:07 | |
JayF | Hey; fungi clarkb, can one of you bump the post job for IPA (877f668). Once it runs Ironic's gate will be fixed (finally) | 23:08 |
fungi | zaro: the second ssh key for username:jenkins in the review-dev database looks correct | 23:08 |
JayF | the fix is merged in already but because Ironic uses the prebuilt images, until the post job finishes Ironic is still busted | 23:08 |
* JayF has buckets full of sympothy even more for those of you troubleshooting the gate daily after losing 2/3 of a day to it | 23:09 | |
*** jsavak has quit IRC | 23:09 | |
fungi | JayF: we have no way to reprioritize the post pipeline over the other pipelines. it runs jobs when gate and check aren't demanding new workers | 23:09 |
JayF | So that means Ironic gate will be busted for a while then, heh | 23:10 |
fungi | JayF: it's a balancing act. we previously had complaints that nobody was getting check results when the post pipeline was busy | 23:10 |
JayF | I mean, igi, and we're a bit of a special flower at times | 23:10 |
JayF | like I bet we're the only project where a post job would unbreak the gate for something | 23:10 |
zaro | fungi: yeah, i added that. but for some reason zuul is using the private key. which belongs to 'zuul-dev' not 'jenkins' and i think that's why the error. | 23:11 |
*** reed has quit IRC | 23:11 | |
zaro | zuul documentation says that it uses that private key to make connections to gerrit? | 23:11 |
fungi | JayF: not necessarily. we used to have some issues from time to time with projects slurping branch tarballs in jobs and a broken branch tarball would screw stuff up until another post job updated it | 23:11 |
fungi | zaro: `ssh-keygen -y -f /var/lib/zuul/ssh/id_rsa` on zuul-dev spits out what looks like the same string you have in the db, so if the zuul process is actually using /var/lib/zuul/ssh/id_rsa then it should work with that jenkins username | 23:12 |
*** yamamoto has quit IRC | 23:13 | |
*** marun has quit IRC | 23:13 | |
SpamapS | fungi: thanks, confirmed its working | 23:13 |
fungi | zaro: how are you setting the gerrit user when starting zuul? it's currently set to user=zuul-dev in /etc/zuul/zuul.conf | 23:14 |
zaro | ahh so it just take the private key and generates pub key to make the connection to gerrit. that makes sense. | 23:14 |
zaro | fungi: i'm manually setting it. yeah, works now because i set it back. i was testing with the 'jenkins' user. i'll try the test again. | 23:15 |
*** abhirc has quit IRC | 23:15 | |
fungi | zaro: not exactly. it uses the private key to "sign" a message which the gerrit server is able to confirm was made by the private key corresponding to the public key it has listed | 23:16 |
*** sarob has quit IRC | 23:16 | |
*** sigmavirus24 is now known as sigmavirus24_awa | 23:16 | |
*** sarob has joined #openstack-infra | 23:17 | |
zaro | ok. well if i see the same error then there's something wonky going on there. | 23:18 |
*** annegentle has quit IRC | 23:18 | |
*** ddieterly has quit IRC | 23:19 | |
fungi | zaro: section 7 of http://www.ietf.org/rfc/rfc4252.txt describes ssh's publickey auth implementation if you're ever really, really bored | 23:19 |
*** shashankhegde has quit IRC | 23:20 | |
*** dannywilson has joined #openstack-infra | 23:20 | |
*** sarob has quit IRC | 23:21 | |
zaro | no wonder why i've never gotten around to reading it :) | 23:21 |
fungi | heh | 23:21 |
*** dannywilson has quit IRC | 23:24 | |
*** dmsimard_away is now known as dmsimard | 23:24 | |
*** dannywilson has joined #openstack-infra | 23:25 | |
*** dmsimard is now known as dmsimard_away | 23:25 | |
*** bknudson has joined #openstack-infra | 23:25 | |
*** thedodd has quit IRC | 23:25 | |
*** bswartz has joined #openstack-infra | 23:26 | |
*** sarob has joined #openstack-infra | 23:26 | |
zaro | fungi: tested again. this time didn't get the error. not sure what happened, i'm guessing that i did a reload instead of start/stop last time and it confused zuul. anyways sorry to bother you with that non-issue. | 23:28 |
*** salv-orlando has joined #openstack-infra | 23:29 | |
*** hichtakk has joined #openstack-infra | 23:30 | |
*** unicell has joined #openstack-infra | 23:31 | |
zaro | it's ready now: https://review.openstack.org/#/c/153668/ | 23:31 |
*** ZZelle has quit IRC | 23:34 | |
*** salv-orlando has quit IRC | 23:34 | |
*** abhirc has joined #openstack-infra | 23:37 | |
*** sdake_ has quit IRC | 23:37 | |
*** dalgaaf has quit IRC | 23:40 | |
*** salv-orlando has joined #openstack-infra | 23:43 | |
*** salv-orlando has quit IRC | 23:45 | |
*** hichtakk has quit IRC | 23:46 | |
fungi | zaro: no problem, just glad you got it to work! | 23:46 |
openstackgerrit | Douglas Mendizábal proposed openstack-infra/project-config: Move barbicanclient docs jobs to post pipeline https://review.openstack.org/153732 | 23:47 |
*** timcline has quit IRC | 23:48 | |
*** annegentle has joined #openstack-infra | 23:49 | |
*** dkliban is now known as dkliban_afk | 23:50 | |
*** marun has joined #openstack-infra | 23:50 | |
*** armax has quit IRC | 23:55 | |
*** stevemar has quit IRC | 23:56 | |
*** abhirc has quit IRC | 23:56 | |
openstackgerrit | Merged openstack-infra/shade: Adds get_network() and list_networks function https://review.openstack.org/150649 | 23:57 |
*** annegentle has quit IRC | 23:58 | |
clarkb | mordred: so I am reviewing shade changes. Do you expect me to be testing all of them? or? | 23:58 |
*** sabeen1 has quit IRC | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!