| ianw | jeblair: ok. i have people asking me why we're not gating on centos7. i'm definitely signing myself to get centos7 images working, but given the size of the change, i think it's best to let it start working before we add too many features | 00:00 |
|---|---|---|
| jeblair | (the test-debug cycle for this is kind of big. i'm working on a 4 line change to the nodepool scripts which just started its 6th hour-long attempt to build an image) | 00:00 |
| ianw | jeblair: yes, no need to tell me about the difficultly of testing :) | 00:00 |
| *** achanda has quit IRC | 00:01 | |
| clarkb | fungi: 115933 should interest you | 00:01 |
| clarkb | jeblair: that is for not caching attic repos? | 00:01 |
| jeblair | clarkb: no, i'm not working on that. it's for installing zuul in a virtualenv so we can use it in jobs. | 00:02 |
| jeblair | (use zuul-cloner in jobs). step 2 of the puppet integration test project. | 00:02 |
| harlowja | fungi clarkb does https://review.openstack.org/#/c/116388/ look correct if u have a few secs (later is fine also) | 00:02 |
| fungi | clarkb: yep, approved. at the current rate of node availability, it should merge some time tomorrow | 00:03 |
| clarkb | jeblair: even better :) | 00:03 |
| jeblair | it's super trivial, but i'm not going to push up a nodepool script change i haven't tested :) | 00:03 |
| *** otherwiseguy has quit IRC | 00:03 | |
| clarkb | jeblair: ++ | 00:03 |
| openstackgerrit | A change was merged to openstack-infra/config: Remove old stats from whisper https://review.openstack.org/113733 | 00:04 |
| clarkb | fungi: ya I am trying to do a flush of changes so that we can get things queued | 00:04 |
| clarkb | that and I am perpetually behind | 00:04 |
| fungi | clarkb: me too | 00:04 |
| *** sballe has joined #openstack-infra | 00:04 | |
| fungi | and now i have to disappear to do meatspace tasks | 00:04 |
| *** bknudson has joined #openstack-infra | 00:04 | |
| *** homeless_ has quit IRC | 00:05 | |
| fungi | i should design machines to do my chores | 00:05 |
| clarkb | jeblair: fungi when you have a change can you double check 116074 to make sure the syntax there is correct? it looks correct to me but accessbot is relatively new | 00:05 |
| *** signed8bit_ZZZzz is now known as signed8bit | 00:05 | |
| fungi | harlowja: looks right to me, but could stand to get test results back first to confirm | 00:05 |
| harlowja | fungi np, thx, will wait, just wanted to be pre-emptive if i can | 00:06 |
| *** homeless has joined #openstack-infra | 00:06 | |
| *** dims has quit IRC | 00:06 | |
| *** dims has joined #openstack-infra | 00:06 | |
| *** reed_ has quit IRC | 00:06 | |
| clarkb | nibalizer: can you abandon 116169 if it is no longer needed. it looks like mgagne found a way to ru nthose jobs on trusty | 00:06 |
| clarkb | nibalizer: at the very least only puppet 2.7 should be pinned to precise | 00:07 |
| fungi | clarkb: in the past we'd just been delegating ops privs for specific channels directly via chanserv, but i don't necessarily see any reason we can't do it directly via accessbot (seems nicely transparent to move to using it for all of them eventually) | 00:07 |
| clarkb | fungi: ya I like that it is recordred for eg a move to oftc | 00:07 |
| *** sballe__ has quit IRC | 00:07 | |
| *** annegentle has joined #openstack-infra | 00:07 | |
| *** signed8bit has quit IRC | 00:07 | |
| *** SumitNaiksatam has quit IRC | 00:08 | |
| openstackgerrit | A change was merged to openstack-infra/config: Remove unused tempest-dsvm-neutron-isolated-parallel job https://review.openstack.org/114900 | 00:10 |
| *** dims has quit IRC | 00:11 | |
| clarkb | salv-orlando: are you around? want to talk about this full extension job | 00:11 |
| clarkb | salv-orlando: to me it makes sense to roll that into the functional test and have tempest test the integration bits (if they exist at all) | 00:11 |
| openstackgerrit | A change was merged to openstack-infra/config: Disable ironic job on stable/havana https://review.openstack.org/115248 | 00:12 |
| *** sballe has quit IRC | 00:12 | |
| nibalizer | clarkb: okay, my suspicion is that we need to run 2.7 on precise | 00:13 |
| nibalizer | since no one promises puppet 2.7 will work with ruby 1.9 | 00:14 |
| *** stevemar has joined #openstack-infra | 00:14 | |
| nibalizer | but that was just a 'omigod fix the gaaaate' | 00:14 |
| nibalizer | clarkb: abandoned | 00:14 |
| clarkb | nibalizer: fedora claims it works ok | 00:14 |
| clarkb | only puppet seems to say it won't work :) | 00:14 |
| *** HenryG_ is now known as HenryG | 00:16 | |
| *** camunoz_ is now known as camunoz | 00:16 | |
| nibalizer | i mean we saw it not working internally at hp | 00:18 |
| nibalizer | it depends on what parts of puppet you're using | 00:18 |
| nibalizer | i think | 00:18 |
| nibalizer | like if you stick to package file service you're probably going to be okay | 00:18 |
| *** signed8bit has joined #openstack-infra | 00:18 | |
| nibalizer | but when you use more interesting facts and providers and such tahts probably where the errors come from | 00:19 |
| *** praneshp has quit IRC | 00:19 | |
| russellb | clarkb: thanks! | 00:21 |
| openstackgerrit | A change was merged to openstack-infra/config: Add periodic Icehouse jobs https://review.openstack.org/115933 | 00:25 |
| *** rcarrillocruz has quit IRC | 00:26 | |
| *** zz_dimtruck is now known as dimtruck | 00:27 | |
| jeblair | clarkb: generally we don't do that because we don't really need to review channel ops | 00:27 |
| jeblair | clarkb: instead, i think we should just grant one of them op, and then let them self-manage after that | 00:28 |
| clarkb | jeblair: ah ok | 00:28 |
| clarkb | jeblair: would you give one person op via accessbot or just manually? | 00:28 |
| jeblair | clarkb: manually | 00:28 |
| clarkb | rgr | 00:29 |
| openstackgerrit | A change was merged to openstack-infra/config: Switch some oslo library jobs to voting https://review.openstack.org/115959 | 00:29 |
| *** rcarrillocruz has joined #openstack-infra | 00:29 | |
| jeblair | clarkb: i'll go ahead and do that for bdpayne | 00:30 |
| clarkb | ty | 00:31 |
| jeblair | done | 00:32 |
| *** lcheng has quit IRC | 00:35 | |
| openstackgerrit | A change was merged to openstack-infra/config: Align Designate proposed/* ACLs on other projects https://review.openstack.org/116007 | 00:35 |
| openstackgerrit | Joe Gordon proposed a change to openstack/requirements: Add flake8 2.2.3 https://review.openstack.org/116758 | 00:36 |
| openstackgerrit | Joe Gordon proposed a change to openstack/requirements: Drop flake8 2.2.2 https://review.openstack.org/116759 | 00:36 |
| *** markmcclain1 has quit IRC | 00:36 | |
| jogo | ^ needed to turn concurrency on in flake8 for our pep8 jobs | 00:37 |
| *** tomoe_ has joined #openstack-infra | 00:37 | |
| anteaya | am I an idiot if I say we currently have 37 patches in post with the oldest at 3 hours? | 00:38 |
| anteaya | it is possible I'm an idiot | 00:39 |
| pleia2 | anteaya: looks that way to me | 00:39 |
| anteaya | I guess I didn't know if that was news to folks | 00:39 |
| pleia2 | I mean, you're not an idiot, there are lots in post! | 00:39 |
| anteaya | I did scroll back a bit but didn't see any mention of it | 00:39 |
| anteaya | kk, thanks for the you're not an idiot affirmation | 00:40 |
| *** ZZelle has quit IRC | 00:40 | |
| *** signed8bit has quit IRC | 00:40 | |
| clarkb | anteaya: its realted to f20 | 00:40 |
| anteaya | great | 00:40 |
| clarkb | and centos6 potentially | 00:40 |
| anteaya | I'll search on those | 00:40 |
| clarkb | anteaya: well mostly we don't have enough of those nodes | 00:40 |
| anteaya | I'm guessing it is an ongoing conversation | 00:40 |
| anteaya | :( | 00:40 |
| pleia2 | yeah | 00:40 |
| jeblair | i don't think the post queue is related to those so much | 00:40 |
| clarkb | anteaya: for raisins like high error rate | 00:40 |
| clarkb | oh post | 00:40 |
| anteaya | that's what I was afraid of | 00:40 |
| anteaya | post | 00:41 |
| jeblair | i don't think it's an ongoing conversation | 00:41 |
| anteaya | oh okay | 00:41 |
| anteaya | now what? | 00:41 |
| jeblair | anteaya: i don't know. you brought it up. :) | 00:41 |
| anteaya | great | 00:41 |
| adam_g | anyone know if running tempest currently runs anywhere against DEVSTACK_GATE_VIRT_DRIVER="fake"? | 00:41 |
| jeblair | anteaya: i don't think it's particularly news-worthy. it's a low-priority queue. it'll be serviced when the higher-priority ones are less busy. | 00:41 |
| anteaya | jeblair: okay | 00:42 |
| clarkb | adam_g: only for the large ops job which is a tiny subset of tempest | 00:42 |
| ianw | clarkb: yeah, f20 jobs really only run for changes to devstack itself | 00:42 |
| *** dustins has joined #openstack-infra | 00:43 | |
| *** gargola has quit IRC | 00:43 | |
| openstackgerrit | A change was merged to openstack-infra/nodepool: Correct ssh key instructions in README https://review.openstack.org/116723 | 00:43 |
| adam_g | clarkb, hmm. okay. im looking at devstack-gate wrt ironic-sideways. trying to find a good way to avoid running javelin + tempest against the base grenade | 00:44 |
| jeblair | why would we do something different than the normal upgrade jobs? | 00:45 |
| *** SumitNaiksatam has joined #openstack-infra | 00:45 | |
| adam_g | jeblair, its a sideways migration from nova /w virt_driver=fake -> nova /w virt_driver=ironic | 00:46 |
| adam_g | i assume running tempest smoke against fake would fail badly | 00:46 |
| jeblair | jogo: ^? | 00:47 |
| clarkb | ya it should be cause they are blackbox tests not having VMs actually come up will break a ton of tests | 00:47 |
| clarkb | tempest won't know about the fake stuff | 00:47 |
| *** ramashri has quit IRC | 00:48 | |
| jeblair | should the old driver be nova-baremetal? | 00:48 |
| openstackgerrit | patrick-crews proposed a change to openstack-infra/elastic-recheck: Adding query namespace to elastic-recheck https://review.openstack.org/101958 | 00:49 |
| fungi | jeblair: clarkb: right i think where bdpayne got confused on teh chanops thing was that i couldn't grant it for him when he initially asked because accessbot was broken and the channel had been added after it broke so i didn't have ops on it until it got fixed. once it was fixed he'd proposed that change, so i figured it merited further discussion as to how we handle those going forward | 00:49 |
| adam_g | jeblair, this was discussed at length at the nova mid-cycle and during spec review. devstack's nova-bm has bitrot to hell and tempest likely would require lots of work to get it passing against nova-bm. the compromise was to deploy grenade /w base virt_driver=fake, populate the nova-bm database /w an inventory of nodes + interfaces, deploy target grenade /w virt_driver=ironic, migrate nova-bm data -> ironic, run empest | 00:49 |
| adam_g | jeblair, https://review.openstack.org/#/c/95025/13/specs/juno/deprecate-baremetal-driver.rst ln 162 if interested | 00:51 |
| clarkb | huh burning man had its first day cancelled due to rain | 00:51 |
| *** reed_ has joined #openstack-infra | 00:52 | |
| anteaya | clarkb: wat? | 00:52 |
| jogo | clarkb: yeah AFAIK smoke has ssh tests | 00:52 |
| fungi | they should consider having it in the desert next time | 00:52 |
| anteaya | fungi: lol | 00:52 |
| *** mmaglana has quit IRC | 00:53 | |
| anteaya | clarkb: how do you cancel a day of burning man? | 00:53 |
| jeblair | clarkb: mordred and devananda should have been there for days already setting up, so i expect they're all cozy in their camp. | 00:53 |
| *** annegentle has quit IRC | 00:53 | |
| clarkb | anteaya: black rock city is closed until tomorrow at noon | 00:53 |
| anteaya | tell folks to stay inside their tents? | 00:53 |
| jeblair | anteaya: you don't let anyone into the city, and no one is allowed to drive on the playa | 00:53 |
| anteaya | wow | 00:53 |
| anteaya | so folks sleep lined up in their cars | 00:53 |
| clarkb | anteaya: there are apparently alternate camp sites | 00:53 |
| anteaya | so folks sleep in their lined up cars | 00:54 |
| anteaya | clarkb: which didn't get rain? | 00:54 |
| jeblair | anteaya: which aren't dry lake beds | 00:54 |
| clarkb | anteaya: I am sure it got rain too, but ya that | 00:54 |
| anteaya | ah | 00:54 |
| jeblair | (or wet lake beds) | 00:54 |
| anteaya | jeblair: that was the piece I was missing | 00:54 |
| anteaya | never having been there | 00:54 |
| fungi | pontoon tents | 00:54 |
| anteaya | they would be popular | 00:54 |
| clarkb | fungi: rafts clearly everyone should take rafts and boats to the playa | 00:55 |
| anteaya | with bicycle wheels on them | 00:55 |
| anteaya | just in case | 00:55 |
| *** otherwiseguy has joined #openstack-infra | 00:58 | |
| openstackgerrit | A change was merged to openstack-infra/config: Fix gate job timing issues with bundler https://review.openstack.org/114593 | 01:00 |
| openstackgerrit | Adam Gandelman proposed a change to openstack-infra/devstack-gate: Do not run javelin + tempest against ironic base https://review.openstack.org/116761 | 01:03 |
| *** alexpilotti has quit IRC | 01:04 | |
| *** terryw has joined #openstack-infra | 01:07 | |
| *** reed_ has quit IRC | 01:07 | |
| *** otherwiseguy has quit IRC | 01:07 | |
| *** sabeen has quit IRC | 01:07 | |
| *** dmsimard_away is now known as dmsimard | 01:11 | |
| *** annegentle has joined #openstack-infra | 01:11 | |
| openstackgerrit | Russell Bryant proposed a change to openstack-infra/config: add experimental job for nova with f20 virt-preview https://review.openstack.org/113350 | 01:13 |
| openstackgerrit | Russell Bryant proposed a change to openstack-infra/config: Add f20-devstack-virt-preview node type https://review.openstack.org/113349 | 01:13 |
| *** rcarrillocruz has quit IRC | 01:15 | |
| anteaya | clarkb: can I ask you about this comment? https://review.openstack.org/#/c/101911/10/modules/openstack_project/files/gerrit/acls/openstack/pylockfile.config | 01:15 |
| gus | So I have a change that introduces a new tox environment, and I'd like to include that environment in the list of gate tests for this project (oslo.db). | 01:15 |
| anteaya | clarkb: I must have missed something for the lastest style for acl files | 01:15 |
| anteaya | gus: what tox environment? | 01:15 |
| clarkb | anteaya: during the last gerrit restart we renamed all -ptl groups to -release groups | 01:15 |
| *** sthillma has quit IRC | 01:15 | |
| clarkb | anteaya: to better reflect what that group does. | 01:15 |
| * anteaya checks gerrit | 01:15 | |
| anteaya | clarkb: thanks | 01:16 |
| gus | What order do those changes usually get submitted? Should I include it in the regular tox.ini envlist in the original change and the follow it up with a jjb config change? | 01:16 |
| gus | .. or leave it out of the tox.ini envlist until _after_ the gate job exists? | 01:16 |
| anteaya | clarkb: murano-ptl still exists: https://review.openstack.org/#/admin/groups/?filter=-ptl | 01:16 |
| anteaya | clarkb: did that restart happen today? | 01:16 |
| clarkb | gus: usually I think we like to get the job in first as nonvoting, make sure it works against the project side change then merge the project side change | 01:17 |
| gus | anteaya: oslo.db py27-eventlet being introduced with this change: https://review.openstack.org/#/c/104436/7 | 01:17 |
| clarkb | gus: is this something that needs a discrete env? | 01:17 |
| clarkb | gus: why not run that in the py27 env? | 01:17 |
| gus | clarkb: it does while there is a desire to keep eventlet out of the regular list of oslo.db requirements. | 01:17 |
| clarkb | anteaya: no it was a couple weekends ago. I think we will need to clean up a couple times which is why I did not -1 it | 01:17 |
| anteaya | clarkb: kk | 01:17 |
| clarkb | gus: that seems well silly to me | 01:17 |
| anteaya | I'm very behind | 01:17 |
| clarkb | gus: if we need to test eventlet we should test it every time | 01:18 |
| gus | clarkb: did you notice my carefully diplomatic phrasing? | 01:18 |
| clarkb | gus: :) | 01:18 |
| *** dmsimard is now known as dmsimard_away | 01:18 | |
| *** rcarrillocruz has joined #openstack-infra | 01:18 | |
| clarkb | if we really do need a discrete job (I would argue against this) we can do what taskflow does. harlowja is working on that let me dig up the change | 01:18 |
| clarkb | gus: something like https://review.openstack.org/#/c/116388/ | 01:19 |
| gus | ok, so "normal" would be to create the tox.ini environment, create a non-voting jenkins job, then make it voting, and _then_ add it to tox.ini default envlist? | 01:19 |
| clarkb | which needs some work aiui so not quite thee | 01:19 |
| gus | It's that last bit I'm not sure about. | 01:19 |
| lifeless | sdague: oh hai | 01:20 |
| clarkb | but it is very close | 01:20 |
| clarkb | gus: well this is where I think not putting it in the py27 env is silly. if we are just going t oadd it to the default env list why not put the tests in the existing env list | 01:20 |
| clarkb | gus: jenkins never uses the default list so that is alwas up to the project | 01:20 |
| lifeless | sdague: https://bugs.launchpad.net/testrepository/+bug/1331140 | 01:20 |
| uvirtbot | Launchpad bug 1331140 in testrepository "testr reports double failure counts" [Undecided,Incomplete] | 01:20 |
| lifeless | (or dansmith - https://bugs.launchpad.net/testrepository/+bug/1331140 ) | 01:21 |
| gus | yeah, I was surprised just now when I discovered it doesn't use the default env list. | 01:21 |
| clarkb | gus: note the "standard testing interface" or whatever it is called doesn't include py27-eventlet | 01:21 |
| gus | ok, if there's no "normal" I'll leave it up to the reviewers to tell me how they want to do it. | 01:21 |
| clarkb | wfm can you point me at the change so that I can suggest we just use py27 :) ? | 01:22 |
| gus | https://review.openstack.org/#/c/104436/7 | 01:22 |
| harlowja | i'll get https://review.openstack.org/#/c/116388/ working someday :-P | 01:24 |
| clarkb | harlowja: it looks close, it wasn't immediately clear to me why it failed | 01:24 |
| harlowja | clarkb its still sitting in the job queue i think right | 01:25 |
| *** dmsimard_away is now known as dmsimard | 01:25 | |
| harlowja | chililng in the job queue | 01:25 |
| clarkb | oh cool | 01:25 |
| *** unicell has quit IRC | 01:25 | |
| *** dims_ has joined #openstack-infra | 01:25 | |
| clarkb | gus: is the issue that eventlet can't be imported and used by a subset of tests because eventlet pollutes the python interpreter? | 01:28 |
| clarkb | I actually don't know enough about eventlet to know if that is a thing | 01:28 |
| *** dmsimard is now known as dmsimard_away | 01:29 | |
| gus | yeah, you can run a subset of the tests with/without eventlet in the one python process. | 01:29 |
| gus | (with monkey patching, which is the way openstack uses eventlet) | 01:29 |
| gus | my position is that we should test in conditions that match deployment as closely as possible - and so we should only ever test with eventlet (and python2.7 for that matter). | 01:30 |
| clarkb | +++++++++++++++++ | 01:31 |
| gus | but I'm not about to start that "lets just delete all the py33 test jobs" thread on os-dev just yet :/ | 01:31 |
| harlowja | gus something that taskflow (and i think ceilometer) have used to help this environment creation, https://pypi.python.org/pypi/toxgen/ | 01:31 |
| harlowja | might be useful for u | 01:31 |
| harlowja | eck, i like my py33 job :-P | 01:32 |
| clarkb | harlowja: except it leads to needless envs | 01:32 |
| gus | harlowja: if it passes, I'm all for keeping it. It's the ones that fail for known reasons that are pointless (like any one on a project that relies on eventlet). | 01:32 |
| clarkb | harlowja: for the reason above its silly to have a specail env for this | 01:32 |
| *** mmaglana has joined #openstack-infra | 01:32 | |
| *** dimtruck is now known as zz_dimtruck | 01:32 | |
| clarkb | harlowja: fwiw I am really not a fan of what taskflow does, but its hard to test specific versions of reqs in other ways | 01:33 |
| harlowja | clarkb i guess it varies, maybe libraries (oslo and others) should have different enviroments than applications | 01:33 |
| anteaya | clarkb what is merge-check? | 01:33 |
| harlowja | clarkb although ya, i'd like to cut down some of those environments that taskflow could have | 01:34 |
| clarkb | anteaya: it is a pipeline that runs zuul noop jobs to see if chagnes can merge when other changes to a project merge | 01:34 |
| clarkb | anteaya: it basically -1's changes that have merge conflicts | 01:34 |
| gus | but yeah, I know reasonable people disagree with my viewpoint on this so I'm happy to go with whatever people are willing to +2. | 01:34 |
| harlowja | gus so your idea is that there would only ever be [py27, py26, py33] and thats it? | 01:35 |
| gus | oh wait, I said "can" above. you *can't* run a subset of test with/without eventlet in the same python process (with monkeypatching, etc). | 01:35 |
| anteaya | clarkb: cool, are all gerrit repos using the merge-check template? | 01:35 |
| anteaya | clarkb: or just the new repos? | 01:36 |
| clarkb | gus: ya I parsed based on your agreement | 01:36 |
| clarkb | anteaya: all repos | 01:36 |
| clarkb | harlowja: the prolem with lots of envs is it is confusing | 01:36 |
| clarkb | harlowja: we tell users to just run tox or tox -epy27 | 01:36 |
| clarkb | harlowja: except you can't do that anymore | 01:36 |
| anteaya | clarkb: cool thanks | 01:37 |
| clarkb | harlowja: now we are working against limitations of the tooling so we may not get a perfect balance here | 01:37 |
| gus | harlowja: I'm not proposing anything, that was an idle aside from above conversation. I am trying to add an oslo.db test that requires eventlet (since that's what it's testing). | 01:37 |
| gus | and so far that has meant introducing a new oslo.db tox env that includes eventlet. and now I'm trying to work out what to do with the gate tests so it actually gets run :/ | 01:38 |
| harlowja | ya, its painful | 01:39 |
| gus | I was surprised to learn earlier today that the tox envlist doesn't actually influence what the gate tests :/ | 01:39 |
| clarkb | gus: that is intentional. we can't run all the envs on all our nodes | 01:39 |
| clarkb | gus: so we have to be very specific | 01:39 |
| gus | oh I see, so we need that map broken out somewhere - yeah that makes sense. | 01:40 |
| clarkb | py26 is centos6, py33 is special precise nodes, py27 and docs and pep8 is trusty | 01:40 |
| *** marcoemorais has quit IRC | 01:40 | |
| gus | wow. I guess that means I can never run them all on my dev workstation either. I hadn't tried to collect the full set. | 01:41 |
| clarkb | gus: if you use debian it is possible | 01:41 |
| clarkb | but all other distros not so much | 01:41 |
| gus | ok I'll bite. so why don't we use debian for all our test nodes then? | 01:41 |
| clarkb | gus: it has been brought up :) I am/was a fan of the idea at the time and it really comes down to wanting/needing to test on red hat and ubuntu anyways as they traditionally have participated much more | 01:42 |
| *** annegentle has quit IRC | 01:43 | |
| *** bhuvan has quit IRC | 01:43 | |
| gus | I agree the freedom to be able to have per-scenario VMs is certainly very nice. | 01:43 |
| clarkb | gus: basically we are trying to scratch the backs of people that have been helpful (and if you go back into the way before time openstack was a bunch of ubuntu people, mordred, soren, ttx, et al) | 01:43 |
| *** annegentle has joined #openstack-infra | 01:43 | |
| *** nosnos has joined #openstack-infra | 01:44 | |
| *** signed8bit has joined #openstack-infra | 01:44 | |
| *** unicell has joined #openstack-infra | 01:52 | |
| *** rcarrillocruz has quit IRC | 01:53 | |
| *** homeless has quit IRC | 01:55 | |
| *** rcarrillocruz has joined #openstack-infra | 01:55 | |
| openstackgerrit | A change was merged to openstack-dev/hacking: Updated from global requirements https://review.openstack.org/116242 | 01:56 |
| clarkb | for https://review.openstack.org/#/c/115719/ I have tried to abort the jobs that it is spinning on. I don't think I was very successful | 01:57 |
| clarkb | I will probably give it another go when they restart and if that fails I think pushing a patch that is basically a revert may be in order | 01:57 |
| *** yamahata has joined #openstack-infra | 01:57 | |
| clarkb | (unless we want to entertain restarting zuul or does zuul have an unqueue command? /me reads) | 01:57 |
| clarkb | no unqueue | 01:58 |
| *** mfer has joined #openstack-infra | 01:58 | |
| *** mfer has quit IRC | 01:59 | |
| *** baohua has joined #openstack-infra | 01:59 | |
| *** sdake_ has joined #openstack-infra | 02:01 | |
| *** zehicle_at_dell has joined #openstack-infra | 02:05 | |
| *** wenlock has joined #openstack-infra | 02:07 | |
| ianw | jeblair: does fake-servers.py stand alone? | 02:07 |
| *** oanufriev has quit IRC | 02:10 | |
| *** zehicle_at_dell has quit IRC | 02:10 | |
| *** weshay has quit IRC | 02:10 | |
| *** gokrokve_ has quit IRC | 02:15 | |
| *** dustins has quit IRC | 02:17 | |
| *** rcarrillocruz has quit IRC | 02:18 | |
| *** bdpayne has joined #openstack-infra | 02:20 | |
| *** ryanpetrello has quit IRC | 02:21 | |
| *** rcarrillocruz has joined #openstack-infra | 02:22 | |
| *** mmedvede has quit IRC | 02:23 | |
| *** ryanpetrello has joined #openstack-infra | 02:28 | |
| *** dims_ has quit IRC | 02:29 | |
| *** trinaths has quit IRC | 02:29 | |
| *** dims_ has joined #openstack-infra | 02:29 | |
| *** trinaths has joined #openstack-infra | 02:30 | |
| *** david-lyle has quit IRC | 02:31 | |
| *** lcheng has joined #openstack-infra | 02:32 | |
| *** terryw has quit IRC | 02:32 | |
| *** annegentle has quit IRC | 02:33 | |
| *** otherwiseguy has joined #openstack-infra | 02:33 | |
| openstackgerrit | patrick-crews proposed a change to openstack-infra/elastic-recheck: Adding query namespace to elastic-recheck https://review.openstack.org/101958 | 02:33 |
| *** trinaths has quit IRC | 02:34 | |
| *** tsg has joined #openstack-infra | 02:35 | |
| *** tgohad has joined #openstack-infra | 02:35 | |
| jeblair | ianw: yeah, it's a kind of hacky script to stand in for other parts of the system | 02:35 |
| *** annegentle has joined #openstack-infra | 02:36 | |
| jeblair | wow, my 4 line change to install zuul in a venv failed | 02:37 |
| jeblair | with: IOError: invalid Python installation: unable to open /usr/zuul-env/lib/python2.7/config/Makefile (No such file or directory) | 02:37 |
| jeblair | which is especially weird since the venv is /usr/local/zuul-env. | 02:38 |
| jeblair | so i don't even... | 02:38 |
| jeblair | (i'm going to have to build a normal image and try to interactively debug that) | 02:38 |
| clarkb | huh | 02:39 |
| *** sabeen has joined #openstack-infra | 02:39 | |
| clarkb | fwiw I have had reasonably good success aborting jobs for that neutron change | 02:39 |
| clarkb | hopefully get it cleared out then will leave a comment to not recheck | 02:39 |
| jeblair | /usr/local/zuul-env/local/lib/python2.7/site-packages/pip/pep425tags.py:62: RuntimeWarning: invalid Python installation: unable to open /usr/zuul-env/lib/python2.7/config/Makefile (No such file or directory) | 02:39 |
| jeblair | actually, that's the whole error | 02:39 |
| jeblair | where you can see it's a script inside the venv that throws it | 02:39 |
| jeblair | clarkb: oh, what happened? | 02:40 |
| clarkb | neutron change that messes with neutron iptables stuff would cause networking to be lost to the slave, zuul would restart the job because it looks like one of the errors we restart on | 02:42 |
| clarkb | jeblair: aborting the jobs made it stop cycling | 02:42 |
| clarkb | jeblair: https://review.openstack.org/#/c/115719/ | 02:42 |
| jeblair | clarkb: ah ha. :) | 02:44 |
| jeblair | bound to happen some day | 02:44 |
| *** wenlock has quit IRC | 02:45 | |
| ianw | jeblair: ok, i think i got that going with the nodepool fake server | 02:46 |
| ianw | jeblair: so my plan is to script up fake-servers.py to "start" and "complete" fairly randomly a whole bunch of servers, does that sound about right? | 02:46 |
| ianw | jeblair: and see if i can start getting allocations to go over server max | 02:47 |
| *** pcrews has quit IRC | 02:47 | |
| clarkb | oh derp | 02:47 |
| *** gyee has quit IRC | 02:47 | |
| clarkb | I should've escaped those >>>'s | 02:47 |
| jeblair | ianw: i don't think you need anything to complete | 02:47 |
| *** dims__ has joined #openstack-infra | 02:48 | |
| jeblair | ianw: we saw the issue just by starting nodepool and watching it go through two allocation cycles | 02:48 |
| *** dims_ has quit IRC | 02:48 | |
| jeblair | ianw: i doubt anything even needs to start, but i'm almost certain nothing needs to complete | 02:48 |
| ianw | jeblair: hmm, ok. if i could get those logs, that would be awesome :) | 02:49 |
| *** lcheng has quit IRC | 02:51 | |
| openstackgerrit | A change was merged to openstack/requirements: Bump minimum required version for simplejson to 2.2.0 https://review.openstack.org/116632 | 02:51 |
| *** vhoward has left #openstack-infra | 02:51 | |
| clarkb | woo I have working virtualenv again | 02:52 |
| *** gokrokve has joined #openstack-infra | 02:53 | |
| *** nosnos has quit IRC | 02:54 | |
| *** unicell has quit IRC | 02:56 | |
| *** camunoz is now known as camunoz_away | 02:56 | |
| jeblair | ianw: yeah, i'll try to get them. but i think we left what we thought was the way to reproduce it in the revert commit | 02:58 |
| *** dims__ has quit IRC | 03:00 | |
| *** tomoe_ has quit IRC | 03:01 | |
| *** tomoe_ has joined #openstack-infra | 03:01 | |
| *** KanagarajM has joined #openstack-infra | 03:03 | |
| *** adalbas has quit IRC | 03:04 | |
| *** tomoe_ has quit IRC | 03:06 | |
| openstackgerrit | A change was merged to openstack-infra/config: Fix typo in merge-check pipeline description https://review.openstack.org/115344 | 03:12 |
| *** ominakov has joined #openstack-infra | 03:12 | |
| *** rcarrillocruz has quit IRC | 03:14 | |
| *** rcarrillocruz has joined #openstack-infra | 03:16 | |
| *** pcrews has joined #openstack-infra | 03:20 | |
| *** ominakov has quit IRC | 03:22 | |
| *** zz_dimtruck is now known as dimtruck | 03:22 | |
| erw | sdague: fyi, the docker test is fixed, or will be once the gate clears and the patch is merged. | 03:23 |
| *** pcrews has quit IRC | 03:25 | |
| *** wenlock has joined #openstack-infra | 03:26 | |
| *** daya_k has joined #openstack-infra | 03:27 | |
| *** zns has joined #openstack-infra | 03:32 | |
| *** annegentle has quit IRC | 03:33 | |
| *** Ryan_Lane has quit IRC | 03:33 | |
| *** annegentle has joined #openstack-infra | 03:35 | |
| *** unicell has joined #openstack-infra | 03:35 | |
| *** annegentle has quit IRC | 03:37 | |
| *** ominakov has joined #openstack-infra | 03:41 | |
| *** marun has joined #openstack-infra | 03:42 | |
| *** rcarrillocruz has quit IRC | 03:43 | |
| *** rcarrillocruz has joined #openstack-infra | 03:43 | |
| erw | and merged... | 03:44 |
| *** asselin has quit IRC | 03:44 | |
| *** marun_ has quit IRC | 03:44 | |
| *** asselin has joined #openstack-infra | 03:45 | |
| *** kmartin has quit IRC | 03:45 | |
| *** KurtMartin has joined #openstack-infra | 03:45 | |
| *** dimtruck is now known as zz_dimtruck | 03:45 | |
| *** harlowja is now known as harlowja_away | 03:47 | |
| *** tomoe_ has joined #openstack-infra | 03:47 | |
| *** harlowja_away is now known as harlowja | 03:48 | |
| openstackgerrit | lifeless proposed a change to openstack-dev/pbr: Handle more legacy version numbers https://review.openstack.org/116775 | 03:48 |
| lifeless | dhellmann-phone: fungi: clarkb: - to unbreak swift and glance.store - https://review.openstack.org/116775 | 03:49 |
| *** camunoz_away is now known as camunoz | 03:50 | |
| *** marcoemorais has joined #openstack-infra | 03:53 | |
| *** wenlock has quit IRC | 03:53 | |
| *** marcoemorais has quit IRC | 03:54 | |
| clarkb | lifeless: from the tests it isn't clear to me that 2.0.0.rc1 - that is 2.0.0.0rc1 is being tested | 03:57 |
| lifeless | clarkb: line 125 of test_version.py | 03:58 |
| lifeless | 2.1.0.rc1 | 03:58 |
| lifeless | close enough:) | 03:58 |
| clarkb | well wait the commit message specifically says it should be 2.0.0.0rc1 | 03:59 |
| lifeless | yes | 03:59 |
| clarkb | 2.1.0.rc1 misses that last 0 | 03:59 |
| lifeless | mea culpa, would you like a rebase | 03:59 |
| *** vhoward has joined #openstack-infra | 03:59 | |
| lifeless | the issue with swift was 2.1.0.rc1 | 03:59 |
| clarkb | so we should test that right? | 03:59 |
| lifeless | the commit message was a thinko | 03:59 |
| clarkb | the 1 doesn't bother me, the missing 0 does | 03:59 |
| openstackgerrit | A change was merged to openstack/requirements: Bump zake up to 0.1 https://review.openstack.org/116399 | 03:59 |
| clarkb | lifeless: or maybe a second test? | 04:00 |
| lifeless | clarkb: I can add a test for it, if thats your request. | 04:00 |
| clarkb | just to cover the thing in the commit message. ya I think we should do that | 04:00 |
| lifeless | clarkb: just saying that the thing that broke was 2.1.0.rc1 | 04:00 |
| clarkb | if it is important enough to be mentioend in the commit message | 04:00 |
| lifeless | and the commit message was fiction | 04:00 |
| clarkb | I get that, but it points out a case that we should test right? | 04:00 |
| clarkb | or am I over thinking this? | 04:00 |
| openstackgerrit | lifeless proposed a change to openstack-dev/pbr: Handle more legacy version numbers https://review.openstack.org/116775 | 04:01 |
| lifeless | you're over thinking it, but I've a) fixed the commit to cover what broke and b) added a test for good measure. | 04:01 |
| *** david-lyle has joined #openstack-infra | 04:02 | |
| lifeless | ' | 04:07 |
| *** david-lyle has quit IRC | 04:07 | |
| *** nosnos has joined #openstack-infra | 04:12 | |
| *** wenlock has joined #openstack-infra | 04:16 | |
| *** rcarrillocruz has quit IRC | 04:16 | |
| *** praneshp has joined #openstack-infra | 04:16 | |
| *** trinaths has joined #openstack-infra | 04:16 | |
| *** ominakov has quit IRC | 04:18 | |
| *** amotoki has joined #openstack-infra | 04:19 | |
| *** rcarrillocruz has joined #openstack-infra | 04:20 | |
| *** armax has quit IRC | 04:20 | |
| *** praneshp_ has joined #openstack-infra | 04:21 | |
| *** otherwiseguy has quit IRC | 04:21 | |
| *** praneshp has quit IRC | 04:21 | |
| *** praneshp_ is now known as praneshp | 04:21 | |
| *** ominakov has joined #openstack-infra | 04:22 | |
| *** ominakov has quit IRC | 04:28 | |
| *** wenlock has quit IRC | 04:28 | |
| *** ppai has joined #openstack-infra | 04:34 | |
| *** annegentle has joined #openstack-infra | 04:35 | |
| *** oomichi_away has quit IRC | 04:37 | |
| *** loki184 has joined #openstack-infra | 04:38 | |
| *** chandankumar has joined #openstack-infra | 04:43 | |
| *** annegentle has quit IRC | 04:44 | |
| *** rcarrillocruz has quit IRC | 04:46 | |
| *** rcarrillocruz has joined #openstack-infra | 04:49 | |
| *** tnurlygayanov has quit IRC | 04:52 | |
| *** yamahata has quit IRC | 04:55 | |
| *** yamahata has joined #openstack-infra | 04:55 | |
| *** ominakov has joined #openstack-infra | 05:00 | |
| *** david-lyle has joined #openstack-infra | 05:03 | |
| *** asettle has quit IRC | 05:05 | |
| *** zns has quit IRC | 05:07 | |
| *** david-lyle has quit IRC | 05:07 | |
| openstackgerrit | Adrian Otto proposed a change to openstack-infra/config: OpenStack Containers Service https://review.openstack.org/115328 | 05:09 |
| *** baoli has quit IRC | 05:09 | |
| openstackgerrit | Adrian Otto proposed a change to openstack-infra/config: OpenStack Containers Service https://review.openstack.org/115328 | 05:10 |
| *** hogepodge has joined #openstack-infra | 05:11 | |
| *** rcarrillocruz has quit IRC | 05:11 | |
| *** rcarrillocruz has joined #openstack-infra | 05:15 | |
| *** KanagarajM has quit IRC | 05:17 | |
| *** chandankumar has quit IRC | 05:18 | |
| *** asettle has joined #openstack-infra | 05:26 | |
| *** tomoe_ has quit IRC | 05:26 | |
| *** tomoe_ has joined #openstack-infra | 05:27 | |
| *** ildikov has joined #openstack-infra | 05:28 | |
| *** rcarrillocruz has quit IRC | 05:31 | |
| openstackgerrit | Ian Wienand proposed a change to openstack-infra/nodepool: [WIP] Testing capacity failures https://review.openstack.org/116189 | 05:32 |
| *** chandankumar has joined #openstack-infra | 05:32 | |
| *** signed8bit has quit IRC | 05:32 | |
| *** tomoe_ has quit IRC | 05:32 | |
| *** rcarrillocruz has joined #openstack-infra | 05:32 | |
| *** asettle has quit IRC | 05:35 | |
| *** alexandra has joined #openstack-infra | 05:36 | |
| *** KanagarajM has joined #openstack-infra | 05:36 | |
| *** alexandra is now known as asettle | 05:37 | |
| *** tomoe_ has joined #openstack-infra | 05:37 | |
| *** ominakov has quit IRC | 05:40 | |
| openstackgerrit | Prashanth Pai proposed a change to openstack-infra/config: Add swiftonfile project to stackforge https://review.openstack.org/115250 | 05:41 |
| *** flaper87|afk is now known as flaper87 | 05:47 | |
| *** hdd has quit IRC | 05:48 | |
| *** _nadya_ has joined #openstack-infra | 05:49 | |
| *** lcheng has joined #openstack-infra | 05:50 | |
| *** bdpayne has quit IRC | 05:50 | |
| *** pblaho has joined #openstack-infra | 05:52 | |
| *** bdpayne has joined #openstack-infra | 05:54 | |
| *** stevemar has quit IRC | 05:54 | |
| *** rcarrillocruz has quit IRC | 05:55 | |
| *** Longgeek has joined #openstack-infra | 05:57 | |
| *** xchu has joined #openstack-infra | 05:57 | |
| *** k4n0 has joined #openstack-infra | 05:57 | |
| *** xchu has quit IRC | 05:57 | |
| *** flaper87 is now known as flaper87|afk | 05:57 | |
| *** flaper87|afk is now known as flaper87 | 05:58 | |
| *** yolanda_ has quit IRC | 05:58 | |
| *** rcarrillocruz has joined #openstack-infra | 06:00 | |
| *** gokrokve has quit IRC | 06:00 | |
| *** and has joined #openstack-infra | 06:01 | |
| *** david-lyle has joined #openstack-infra | 06:04 | |
| *** david-lyle has quit IRC | 06:08 | |
| *** _nadya_ has quit IRC | 06:10 | |
| openstackgerrit | Steven Dake proposed a change to openstack-infra/zuul: Clarify documentation around use of template tag https://review.openstack.org/116802 | 06:12 |
| *** p5ntangle has joined #openstack-infra | 06:15 | |
| *** rcarrillocruz has quit IRC | 06:16 | |
| *** pblaho is now known as pblaho|afk | 06:16 | |
| *** afazekas has joined #openstack-infra | 06:17 | |
| *** rcarrillocruz has joined #openstack-infra | 06:20 | |
| *** lcheng has quit IRC | 06:22 | |
| *** Ajaeger has joined #openstack-infra | 06:23 | |
| *** gokrokve has joined #openstack-infra | 06:27 | |
| *** gokrokve has quit IRC | 06:28 | |
| *** gokrokve has joined #openstack-infra | 06:29 | |
| *** dvorak has quit IRC | 06:29 | |
| *** flaper87 is now known as flaper87|afk | 06:29 | |
| *** and has quit IRC | 06:29 | |
| *** flaper87|afk is now known as flaper87 | 06:30 | |
| *** gokrokve has quit IRC | 06:30 | |
| *** harlowja is now known as harlowja_away | 06:31 | |
| *** gokrokve has joined #openstack-infra | 06:31 | |
| *** e0ne has joined #openstack-infra | 06:34 | |
| *** gokrokve has quit IRC | 06:35 | |
| *** e0ne has quit IRC | 06:37 | |
| *** rcarrillocruz has quit IRC | 06:37 | |
| *** annegentle has joined #openstack-infra | 06:39 | |
| *** katyafervent is now known as katyafervent_awa | 06:40 | |
| openstackgerrit | Andreas Jaeger proposed a change to openstack-infra/config: Run requirements jobs for openstack-doc-tools https://review.openstack.org/116805 | 06:40 |
| *** e0ne has joined #openstack-infra | 06:41 | |
| *** rcarrillocruz has joined #openstack-infra | 06:42 | |
| *** lcheng has joined #openstack-infra | 06:42 | |
| *** katyafervent_awa is now known as katyafervent | 06:42 | |
| *** annegentle has quit IRC | 06:43 | |
| *** flaper87 is now known as flaper87|afk | 06:45 | |
| *** e0ne has quit IRC | 06:45 | |
| *** Longgeek has quit IRC | 06:45 | |
| *** Longgeek has joined #openstack-infra | 06:46 | |
| *** e0ne has joined #openstack-infra | 06:46 | |
| *** e0ne has quit IRC | 06:47 | |
| *** Ryan_Lane has joined #openstack-infra | 06:51 | |
| openstackgerrit | yolanda.robla proposed a change to openstack-infra/config: Align prepare_node.sh with prepare-node in dib https://review.openstack.org/105931 | 06:51 |
| *** Longgeek_ has joined #openstack-infra | 06:55 | |
| *** RicoLin has joined #openstack-infra | 06:57 | |
| *** RicoLin has quit IRC | 06:57 | |
| *** Longgeek_ has quit IRC | 06:57 | |
| *** Longgeek has quit IRC | 06:57 | |
| *** Longgeek has joined #openstack-infra | 06:58 | |
| *** RicoLin has joined #openstack-infra | 06:58 | |
| *** bdpayne has quit IRC | 06:59 | |
| *** Hal_ has joined #openstack-infra | 07:00 | |
| *** david-lyle has joined #openstack-infra | 07:05 | |
| *** rcarrillocruz has quit IRC | 07:07 | |
| *** Longgeek_ has joined #openstack-infra | 07:07 | |
| *** andreykurilin has joined #openstack-infra | 07:08 | |
| *** david-lyle has quit IRC | 07:09 | |
| *** rcarrillocruz has joined #openstack-infra | 07:11 | |
| *** Longgeek_ has quit IRC | 07:11 | |
| *** Longgeek has quit IRC | 07:11 | |
| *** Ryan_Lane has quit IRC | 07:11 | |
| *** Longgeek has joined #openstack-infra | 07:11 | |
| *** Longgeek_ has joined #openstack-infra | 07:14 | |
| *** flaper87|afk is now known as flaper87 | 07:15 | |
| openstackgerrit | yolanda.robla proposed a change to openstack-infra/nodepool: Update documentation for using diskimage-builder https://review.openstack.org/115614 | 07:16 |
| *** Longgeek has quit IRC | 07:17 | |
| *** jcoufal has joined #openstack-infra | 07:17 | |
| *** Alexei_987 has quit IRC | 07:19 | |
| *** MaxV has joined #openstack-infra | 07:23 | |
| *** jgallard has joined #openstack-infra | 07:23 | |
| *** tomoe_ has quit IRC | 07:24 | |
| *** isaacb has joined #openstack-infra | 07:24 | |
| *** jlibosva has joined #openstack-infra | 07:24 | |
| *** Ajaeger has quit IRC | 07:26 | |
| *** flaper87 is now known as flaper87|afk | 07:27 | |
| *** _nadya_ has joined #openstack-infra | 07:27 | |
| *** gokrokve has joined #openstack-infra | 07:29 | |
| *** flaper87|afk is now known as flaper87 | 07:30 | |
| *** gokrokve has quit IRC | 07:33 | |
| *** Daviey has quit IRC | 07:34 | |
| *** mmaglana has quit IRC | 07:34 | |
| *** mmaglana has joined #openstack-infra | 07:34 | |
| *** p5ntangl_ has joined #openstack-infra | 07:36 | |
| *** pblaho|afk is now known as pblaho | 07:38 | |
| *** p5ntangle has quit IRC | 07:39 | |
| *** annegentle has joined #openstack-infra | 07:39 | |
| *** markmc has joined #openstack-infra | 07:42 | |
| *** rcarrillocruz has quit IRC | 07:42 | |
| *** annegentle has quit IRC | 07:44 | |
| *** rcarrillocruz has joined #openstack-infra | 07:44 | |
| *** Daviey has joined #openstack-infra | 07:47 | |
| *** sdake_ has quit IRC | 07:47 | |
| *** dizquierdo has joined #openstack-infra | 07:49 | |
| *** lcheng has quit IRC | 07:51 | |
| *** lcheng has joined #openstack-infra | 07:51 | |
| *** Longgeek_ has quit IRC | 07:53 | |
| *** Longgeek has joined #openstack-infra | 07:54 | |
| *** Longgeek_ has joined #openstack-infra | 07:55 | |
| *** jistr has joined #openstack-infra | 07:55 | |
| *** Longgeek has quit IRC | 07:59 | |
| *** oanufriev has joined #openstack-infra | 07:59 | |
| *** jpich has joined #openstack-infra | 08:01 | |
| *** ociuhandu has joined #openstack-infra | 08:01 | |
| *** skolekonov has joined #openstack-infra | 08:02 | |
| *** lcheng has quit IRC | 08:02 | |
| *** yfried_ has quit IRC | 08:02 | |
| *** jamielennox is now known as jamielennox|away | 08:03 | |
| *** tomoe_ has joined #openstack-infra | 08:03 | |
| *** david-lyle has joined #openstack-infra | 08:05 | |
| *** MaxV_ has joined #openstack-infra | 08:07 | |
| *** tomoe__ has joined #openstack-infra | 08:08 | |
| *** tomoe__ has quit IRC | 08:09 | |
| *** MaxV has quit IRC | 08:10 | |
| *** tomoe__ has joined #openstack-infra | 08:10 | |
| *** david-lyle has quit IRC | 08:10 | |
| *** tomoe_ has quit IRC | 08:10 | |
| *** KanagarajM2 has joined #openstack-infra | 08:11 | |
| *** MaxV_ has quit IRC | 08:12 | |
| *** KanagarajM has quit IRC | 08:12 | |
| *** andreykurilin has quit IRC | 08:13 | |
| *** e0ne has joined #openstack-infra | 08:16 | |
| *** Shrews has quit IRC | 08:18 | |
| *** jp_at_hp has joined #openstack-infra | 08:18 | |
| *** derekh has joined #openstack-infra | 08:23 | |
| *** _nadya_ has quit IRC | 08:23 | |
| *** rcarrillocruz has quit IRC | 08:24 | |
| *** rcarrillocruz has joined #openstack-infra | 08:28 | |
| *** gokrokve has joined #openstack-infra | 08:29 | |
| *** dtantsur|afk is now known as dtantsur | 08:29 | |
| *** e0ne has quit IRC | 08:31 | |
| *** AJaeger has joined #openstack-infra | 08:31 | |
| *** lcheng has joined #openstack-infra | 08:33 | |
| *** lcheng has quit IRC | 08:33 | |
| *** gokrokve has quit IRC | 08:34 | |
| *** lcheng has joined #openstack-infra | 08:34 | |
| *** amuller has joined #openstack-infra | 08:35 | |
| *** Shrews has joined #openstack-infra | 08:35 | |
| *** linkid has joined #openstack-infra | 08:36 | |
| linkid | hi | 08:37 |
| linkid | I have some questions about experimental jobs | 08:38 |
| linkid | they are only launched by adding a comment to the review, aren't they ? | 08:39 |
| *** annegentle has joined #openstack-infra | 08:39 | |
| *** annegentle has quit IRC | 08:44 | |
| *** Longgeek_ has quit IRC | 08:44 | |
| *** Longgeek has joined #openstack-infra | 08:44 | |
| *** alexpilotti has joined #openstack-infra | 08:45 | |
| *** e0ne has joined #openstack-infra | 08:45 | |
| *** ociuhandu has quit IRC | 08:55 | |
| *** vponomaryov has joined #openstack-infra | 09:03 | |
| *** dizquierdo is now known as dizquierdo_afk | 09:04 | |
| *** lcheng has quit IRC | 09:05 | |
| *** xchu has joined #openstack-infra | 09:06 | |
| *** xchu has quit IRC | 09:06 | |
| *** david-lyle has joined #openstack-infra | 09:06 | |
| *** ZZelle has joined #openstack-infra | 09:07 | |
| *** david-lyle has quit IRC | 09:10 | |
| *** rlandy has joined #openstack-infra | 09:11 | |
| *** pelix1 has joined #openstack-infra | 09:16 | |
| *** rcarrillocruz has quit IRC | 09:19 | |
| *** che-arne has joined #openstack-infra | 09:19 | |
| *** rcarrillocruz has joined #openstack-infra | 09:21 | |
| *** gokrokve has joined #openstack-infra | 09:29 | |
| *** gokrokve has quit IRC | 09:31 | |
| *** gokrokve has joined #openstack-infra | 09:31 | |
| *** HeOS has joined #openstack-infra | 09:31 | |
| *** garyk has joined #openstack-infra | 09:34 | |
| garyk | any idea why jenkins is not running on patches approved? | 09:34 |
| *** gokrokve has quit IRC | 09:35 | |
| *** _nadya_ has joined #openstack-infra | 09:36 | |
| *** annegentle has joined #openstack-infra | 09:39 | |
| *** rcarrillocruz has quit IRC | 09:40 | |
| *** dtantsur is now known as dtantsur|brb | 09:41 | |
| *** rcarrillocruz has joined #openstack-infra | 09:42 | |
| *** jab has joined #openstack-infra | 09:42 | |
| *** jab has quit IRC | 09:43 | |
| *** jab has joined #openstack-infra | 09:43 | |
| *** praneshp has quit IRC | 09:43 | |
| *** annegentle has quit IRC | 09:44 | |
| AJaeger | jeblair, doctools pinning patches are all in - now requirements can merge, I retriggered. | 09:45 |
| *** pblaho is now known as pblaho|afk | 09:47 | |
| *** flaper87 is now known as flaper87|afk | 09:48 | |
| *** p5ntangle has joined #openstack-infra | 09:50 | |
| *** p5ntangle has quit IRC | 09:50 | |
| *** Longgeek has quit IRC | 09:50 | |
| *** p5ntangle has joined #openstack-infra | 09:51 | |
| *** Longgeek has joined #openstack-infra | 09:51 | |
| *** p5ntangl_ has quit IRC | 09:53 | |
| *** p5ntangle has quit IRC | 09:54 | |
| *** p5ntangle has joined #openstack-infra | 09:55 | |
| *** Longgeek has quit IRC | 09:55 | |
| *** p5ntangle has quit IRC | 09:57 | |
| *** flaper87|afk is now known as flaper87 | 09:57 | |
| *** p5ntangle has joined #openstack-infra | 09:58 | |
| *** p5ntangle has quit IRC | 09:59 | |
| *** yamahata has quit IRC | 10:01 | |
| *** mkollaro has joined #openstack-infra | 10:01 | |
| *** p5ntangle has joined #openstack-infra | 10:01 | |
| *** mkollaro1 has quit IRC | 10:03 | |
| *** mattymo has quit IRC | 10:04 | |
| *** mattymo has joined #openstack-infra | 10:04 | |
| *** david-lyle has joined #openstack-infra | 10:07 | |
| *** yamahata has joined #openstack-infra | 10:08 | |
| *** david-lyle has quit IRC | 10:12 | |
| *** bookwar has joined #openstack-infra | 10:14 | |
| *** p5ntangle has quit IRC | 10:14 | |
| *** bookwar_ has joined #openstack-infra | 10:15 | |
| *** bookwar has quit IRC | 10:16 | |
| *** yamahata has quit IRC | 10:17 | |
| openstackgerrit | Julien Danjou proposed a change to openstack-infra/config: Use python3-jobs template where possible https://review.openstack.org/110256 | 10:18 |
| *** rcarrillocruz has quit IRC | 10:20 | |
| openstackgerrit | Julien Danjou proposed a change to openstack-infra/config: Announce tooz events in #openstack-state-management https://review.openstack.org/116844 | 10:21 |
| *** rcarrillocruz has joined #openstack-infra | 10:21 | |
| *** mkollaro has quit IRC | 10:24 | |
| *** mkollaro1 has joined #openstack-infra | 10:24 | |
| *** eharney has joined #openstack-infra | 10:25 | |
| *** eharney has quit IRC | 10:25 | |
| salv-orlando | clarkb: are you already online? | 10:25 |
| *** eharney has joined #openstack-infra | 10:25 | |
| *** jgallard has quit IRC | 10:25 | |
| *** ArxCruz has joined #openstack-infra | 10:25 | |
| * salv-orlando highly unlikely | 10:26 | |
| rcarrillocruz | salv-orlando: he usually connects much later, he's based in Seattle | 10:27 |
| salv-orlando | rcarrillocruz: right. I checked just in case he was travelling in europe or asia | 10:29 |
| *** gokrokve has joined #openstack-infra | 10:29 | |
| *** pcm_ has joined #openstack-infra | 10:29 | |
| *** pcm_ has quit IRC | 10:30 | |
| *** pcm_ has joined #openstack-infra | 10:31 | |
| *** Hal_ has quit IRC | 10:32 | |
| *** gokrokve has quit IRC | 10:34 | |
| openstackgerrit | Julien Danjou proposed a change to openstack-dev/hacking: Add a check for old style class declarations https://review.openstack.org/116846 | 10:37 |
| *** annegentle has joined #openstack-infra | 10:39 | |
| *** annegentle has quit IRC | 10:44 | |
| *** daya_k has quit IRC | 10:44 | |
| *** daya_k has joined #openstack-infra | 10:46 | |
| *** dtantsur|brb is now known as dtantsur | 10:47 | |
| *** daya_k_ has joined #openstack-infra | 10:48 | |
| *** daya_k has quit IRC | 10:48 | |
| *** daya_k_ is now known as daya_k | 10:48 | |
| *** salv-orlando has quit IRC | 10:49 | |
| *** salv-orlando has joined #openstack-infra | 10:51 | |
| sdague | erw: thanks for diving in and fixing it | 10:52 |
| *** daya_k has quit IRC | 10:53 | |
| *** flaper87 is now known as flaper87|afk | 10:53 | |
| *** lukego has joined #openstack-infra | 10:55 | |
| *** ArxCruz has quit IRC | 10:55 | |
| *** flaper87|afk is now known as flaper87 | 10:56 | |
| *** koolhead17 has joined #openstack-infra | 10:57 | |
| *** koolhead17 has joined #openstack-infra | 10:57 | |
| lukego | I am not sure exactly why but I have had to add an “export SCREEN_NAME=stack” to my CI script since a few hours ago. otherwise this variable is blank when ./stack.sh tries to check if a session is already running, and that causes ./stack.sh to erroneously think that devstack is already running if there is *any* screen session running on the host at all. | 10:57 |
| lukego | Just mentioning in case somebody else pops in here with a similar problem. (I spent quite some time on a false trail thinking that cinder was failing to shutdown, but just because I had missed the obvious problem and caught my eye on some spurious error messages in a log) | 10:59 |
| *** pblaho|afk is now known as pblaho | 11:00 | |
| *** david-lyle has joined #openstack-infra | 11:08 | |
| *** dizquierdo_afk is now known as dizquierdo | 11:08 | |
| *** rcarrillocruz has quit IRC | 11:09 | |
| trinaths | I get this devstack error for oslo.db, Could not find a version that satisfies the requirement oslo.db>=0.4.0 (from neutron==2014.2) | 11:10 |
| trinaths | can any one help me on this. here is the log for this http://paste.openstack.org/show/100403/ | 11:10 |
| *** rcarrillocruz has joined #openstack-infra | 11:11 | |
| *** loki184 has quit IRC | 11:11 | |
| *** david-lyle has quit IRC | 11:12 | |
| *** renlt has joined #openstack-infra | 11:13 | |
| *** denis_makogon has joined #openstack-infra | 11:13 | |
| *** changbl has quit IRC | 11:17 | |
| *** pblaho is now known as pblaho|afk | 11:17 | |
| *** Longgeek has joined #openstack-infra | 11:19 | |
| *** p5ntangle has joined #openstack-infra | 11:22 | |
| *** Longgeek has quit IRC | 11:23 | |
| *** marun has quit IRC | 11:27 | |
| *** gokrokve has joined #openstack-infra | 11:29 | |
| *** Longgeek has joined #openstack-infra | 11:30 | |
| *** gokrokve has quit IRC | 11:33 | |
| *** lttrl has joined #openstack-infra | 11:35 | |
| *** rcarrillocruz has quit IRC | 11:38 | |
| *** annegentle has joined #openstack-infra | 11:39 | |
| *** p5ntangl_ has joined #openstack-infra | 11:41 | |
| *** p5ntangle has quit IRC | 11:41 | |
| *** marcusvrn has joined #openstack-infra | 11:41 | |
| *** rcarrillocruz has joined #openstack-infra | 11:42 | |
| *** baoli has joined #openstack-infra | 11:43 | |
| *** bookwar_ is now known as bookwar | 11:43 | |
| *** annegentle has quit IRC | 11:44 | |
| *** baoli has quit IRC | 11:44 | |
| *** baoli has joined #openstack-infra | 11:44 | |
| openstackgerrit | Salvatore Orlando proposed a change to openstack-infra/devstack-gate: Add support for enabling/disabling service extensions https://review.openstack.org/116129 | 11:47 |
| *** weshay has joined #openstack-infra | 11:47 | |
| *** lttrl has quit IRC | 11:49 | |
| *** pblaho|afk is now known as pblaho | 11:50 | |
| *** lttrl has joined #openstack-infra | 11:51 | |
| sdague | hmmm... this is an interesting state challenge | 11:52 |
| sdague | https://review.openstack.org/#/c/109159/ | 11:52 |
| sdague | both W -1 and W +1 | 11:52 |
| sdague | which seems standoff | 11:53 |
| *** ZZelle has quit IRC | 11:53 | |
| AJaeger | sdague, The W-1 always wins... | 11:54 |
| sdague | so how do I change someone else's W-1 | 11:54 |
| sdague | because this seems like W-1 is now a -2 | 11:54 |
| sdague | which I didn't think was the intent | 11:54 |
| AJaeger | sdague, christian is on vacation right now | 11:54 |
| AJaeger | sdague, re-submit the patch and the W-1 will get reset ;) | 11:55 |
| sdague | really? | 11:55 |
| sdague | that seems kind of busted | 11:55 |
| AJaeger | A -2 is sticky a W-1 not... | 11:55 |
| *** jab is now known as bradjones | 11:55 | |
| AJaeger | sdague, W-1 means: This patch needs further work - blocking the current revision | 11:56 |
| AJaeger | -2 blocks the complete patch series and is sticky | 11:56 |
| *** hashar has joined #openstack-infra | 11:56 | |
| AJaeger | sdague, so make a small change, resubmit and see whether that resets the flags... | 11:57 |
| *** hashar_ has joined #openstack-infra | 11:57 | |
| sdague | ok, I guess it was really W-1 for the wrong reason, which was that it was waiting for feedback | 11:58 |
| AJaeger | sdague, yeah, procedural W-1 ;/ | 11:59 |
| AJaeger | I see your commit message change worked - great | 11:59 |
| sdague | yeh | 11:59 |
| sdague | yeh, so that's a state transition bit that I actually want. A -1 that resets when the author comments. | 12:00 |
| *** hashar has quit IRC | 12:01 | |
| *** _nadya_ has quit IRC | 12:02 | |
| *** dkranz has joined #openstack-infra | 12:02 | |
| *** dmsimard_away is now known as dmsimard | 12:02 | |
| *** flaper87 is now known as flaper87|afk | 12:03 | |
| *** mmaglana has quit IRC | 12:03 | |
| *** hashar_ is now known as hahar | 12:06 | |
| *** hahar is now known as hashar | 12:06 | |
| *** flaper87|afk is now known as flaper87 | 12:08 | |
| *** ZZelle has joined #openstack-infra | 12:08 | |
| *** eharney has quit IRC | 12:08 | |
| linkid | hi | 12:08 |
| *** david-lyle has joined #openstack-infra | 12:08 | |
| linkid | why putting a job in experimental while it could a non-voting one ? | 12:09 |
| linkid | for a big test, ok | 12:11 |
| *** annegentle has joined #openstack-infra | 12:11 | |
| linkid | but for a small test, it is ok to put it non-voting just to have the information, no ? | 12:11 |
| *** david-lyle has quit IRC | 12:13 | |
| *** marun has joined #openstack-infra | 12:13 | |
| *** adalbas has joined #openstack-infra | 12:14 | |
| *** annegentle has quit IRC | 12:14 | |
| *** ociuhandu has joined #openstack-infra | 12:14 | |
| *** KanagarajM2 has quit IRC | 12:18 | |
| linkid | futhermore, I'm wondering why there are gate-* jobs in check, for example in python-jobs | 12:19 |
| linkid | I don't understand why it's not check-*… | 12:20 |
| sdague | linkid: because nv voting runs on every patch, which means it uses a lot more resources (thus slowing down every one) | 12:21 |
| sdague | experimental is useful to be able to trigger just when needed | 12:22 |
| linkid | ah, ok | 12:22 |
| *** aysyd has joined #openstack-infra | 12:22 | |
| linkid | and what about gate- | 12:22 |
| linkid | and check-* ? | 12:23 |
| linkid | 'cause I don't really know what to put in experimental, then | 12:23 |
| linkid | or experimental-*? | 12:23 |
| *** AlecTaylor has joined #openstack-infra | 12:24 | |
| AlecTaylor | hi | 12:24 |
| AlecTaylor | Which SaaS solution would you recommend for agile team+project management? :) | 12:24 |
| *** ArxCruz has joined #openstack-infra | 12:25 | |
| *** dprince has joined #openstack-infra | 12:25 | |
| *** stevemar has joined #openstack-infra | 12:26 | |
| *** ArxCruz has quit IRC | 12:26 | |
| *** ArxCruz has joined #openstack-infra | 12:27 | |
| *** ArxCruz has quit IRC | 12:29 | |
| *** gokrokve has joined #openstack-infra | 12:29 | |
| *** ArxCruz has joined #openstack-infra | 12:30 | |
| openstackgerrit | Maru Newby proposed a change to openstack-infra/config: Externalize hooks for neutron functional jobs https://review.openstack.org/116458 | 12:33 |
| marun | clarkb, fungi, jeblair: I've added hook scripts to the Neutron tree in support of this: https://review.openstack.org/#/c/116458/3 | 12:34 |
| *** gokrokve has quit IRC | 12:34 | |
| marun | clarkb, fungi, jeblair: I don't have a good way of testing this without it being merged, and if I've screwed something up the job will break. :/ | 12:35 |
| *** kgiusti has joined #openstack-infra | 12:36 | |
| *** juzuluag has joined #openstack-infra | 12:36 | |
| marun | clarkb, fungi, jeblair: Once this change is merged, though, the burden of job maintenance should be restricted mostly to Neutron rather than config, and changes in the hook scripts can be gated on in Neutron pre-merge. | 12:37 |
| *** rcarrillocruz has quit IRC | 12:37 | |
| *** mmedvede has joined #openstack-infra | 12:37 | |
| *** rcarrillocruz has joined #openstack-infra | 12:41 | |
| *** denis_makogon has quit IRC | 12:41 | |
| *** bradjones has quit IRC | 12:42 | |
| *** ArxCruz has quit IRC | 12:42 | |
| *** Hal_ has joined #openstack-infra | 12:43 | |
| fungi | trinaths: you're using an old, defunct pypi mirror. you should be using https://pypi.python.org/simple/ (pip's default), not http://pypi.openstack.org/openstack/ (that mirror is abandoned and no longer updated) | 12:44 |
| *** dvorak has joined #openstack-infra | 12:46 | |
| *** nosnos has quit IRC | 12:46 | |
| fungi | phschwartz: when you're around again, it seems we've got most of our dfw quota consumed by unremovable error+deleting instances for teh better part of a day now | 12:46 |
| *** ArxCruz has joined #openstack-infra | 12:47 | |
| *** ArxCruz has quit IRC | 12:47 | |
| *** ArxCruz has joined #openstack-infra | 12:48 | |
| *** ArxCruz has quit IRC | 12:49 | |
| *** ominakov has joined #openstack-infra | 12:49 | |
| *** k4n0 has quit IRC | 12:49 | |
| *** ArxCruz has joined #openstack-infra | 12:49 | |
| fungi | tteggel: if you're around, we're hitting about 150 instances an hour in hpcloud which transition from building to error state because nova is reporting that it can't find an available compute node to put them on | 12:50 |
| nibalizer | uh oh | 12:52 |
| *** lukego has quit IRC | 12:52 | |
| nibalizer | did hpcloud run out of cloud? | 12:52 |
| fungi | nibalizer: seems it's all full, yes. no vacancy sign lit up and everything | 12:52 |
| nibalizer | ouch | 12:53 |
| *** ArxCruz has quit IRC | 12:53 | |
| *** ArxCruz has joined #openstack-infra | 12:54 | |
| *** jedimike has joined #openstack-infra | 12:55 | |
| *** yolanda has joined #openstack-infra | 12:55 | |
| *** pdmars has joined #openstack-infra | 12:55 | |
| *** unicell has quit IRC | 12:57 | |
| *** tomoe_ has joined #openstack-infra | 12:57 | |
| *** pdmars has quit IRC | 12:58 | |
| openstackgerrit | Sean Dague proposed a change to openstack/requirements: updated requirements repo readme https://review.openstack.org/116708 | 12:58 |
| *** miqui has joined #openstack-infra | 12:58 | |
| *** pdmars has joined #openstack-infra | 12:58 | |
| *** daya_k has joined #openstack-infra | 12:58 | |
| *** AlecTaylor has quit IRC | 12:58 | |
| *** baohua has quit IRC | 12:59 | |
| *** pblaho has quit IRC | 13:00 | |
| *** tomoe__ has quit IRC | 13:00 | |
| nibalizer | fungi, can you explain to yolanda: the hpcloud priblem? | 13:01 |
| *** mfer has joined #openstack-infra | 13:01 | |
| trinaths | Any Jenkins experts around? | 13:03 |
| openstackgerrit | Randy Bertram proposed a change to openstack/requirements: Update bootstrap-datepicker to 1.3.1.0 https://review.openstack.org/116889 | 13:04 |
| fungi | yolanda: some significant percentage of the instances nodepool is attempting to boot in hpcloud are going into error state before becoming ready, and nova is reporting {"message": "No valid host was found. ", "code": 500, "created": "2014-08-25T21:58:02Z"} | 13:05 |
| *** mjturek has joined #openstack-infra | 13:05 | |
| yolanda | mm, scheduling problems? | 13:05 |
| fungi | yolanda: perhaps | 13:05 |
| yolanda | fungi, have you contacted HP in some way? do you want me to do that? | 13:05 |
| fungi | yolanda: we're seeing this on around 150 nova boot attempts per hour | 13:05 |
| rcarrillocruz | if you open a ticket , we can follow up | 13:05 |
| fungi | yolanda: well, it's been happening since at least yesterday. i was trying to reach out to tteggel then but he didn't seem to be around | 13:06 |
| *** ArxCruz has quit IRC | 13:06 | |
| rcarrillocruz | we can ask on hipchat to the noc with the ticket number | 13:06 |
| fungi | rcarrillocruz: i don't have access to open a ticket i don't think, though clarkb probably can in a few hours | 13:06 |
| *** bknudson has quit IRC | 13:06 | |
| rcarrillocruz | fungi: thing is i don't think any of us have either... i mean, we have access to the hp jira system, but they will ask us details about openstack hp cloud account, something we don't have access to | 13:08 |
| bookwar | trinaths: it is always better to start with the question, noone wants to call himeself an expert before he knows the issue hie is facing :) | 13:08 |
| *** jgallard has joined #openstack-infra | 13:08 | |
| yolanda | fungi, do you know region are you using? | 13:08 |
| fungi | yolanda: east i think | 13:09 |
| *** heyongli has joined #openstack-infra | 13:09 | |
| *** ominakov has quit IRC | 13:09 | |
| *** david-lyle has joined #openstack-infra | 13:09 | |
| fungi | yolanda: OS_AUTH_URL=https://region-b.geo-1.identity.hpcloudsvc.com:35357/v2.0 OS_REGION_NAME=region-b.geo-1 | 13:10 |
| yolanda | rcarrillocruz, we could talk to NOC and explain the problem, maybe it happens in all region | 13:10 |
| fungi | i assume that means we're in "region b" | 13:10 |
| rcarrillocruz | yolanda: i'm asking on .NOC, you can join and we follow up | 13:10 |
| *** ArxCruz has joined #openstack-infra | 13:10 | |
| fungi | yolanda: rcarrillocruz: nibalizer: it's not completely debilitating, just impacting our test workload throughput (as can be seen on the zuul status page) | 13:12 |
| *** hogepodge has quit IRC | 13:12 | |
| rcarrillocruz | fungi: could you paste a full error output from nova somewhere (paste.openstack.org perhaps?) so we can point the NOC guys to look at it ? | 13:12 |
| fungi | rcarrillocruz: all i have is the novaclient api response in our nodepool debug logs, but sure | 13:12 |
| nibalizer | rcarrillocruz: is our internal nodepool happt? | 13:13 |
| nibalizer | er happy? | 13:13 |
| nibalizer | im on phone | 13:13 |
| *** david-lyle has quit IRC | 13:13 | |
| yolanda | nibalizer, our nodepool looks fine | 13:13 |
| nibalizer | hrm | 13:14 |
| rcarrillocruz | yeah, although there was people reporting slowness this morning | 13:14 |
| nibalizer | diff regions? | 13:14 |
| *** dustins has joined #openstack-infra | 13:14 | |
| rcarrillocruz | jobs getting queued after more than 30min, and nodepool was not very busy at the time | 13:14 |
| yolanda | i can take a look at logs of this morning, let me check | 13:15 |
| rcarrillocruz | fungi: noc guys confirm they need the tenant id of openstack-infra account? do you know and is that something that can be shared with us? | 13:15 |
| rcarrillocruz | sorry, first sentence was not a question :-) | 13:16 |
| fungi | rcarrillocruz: i'm pretty sure it's not sensitive information (the password is not exactly one which would be easy to brute force anyway)... OS_TENANT_NAME=openstackjenkins2-project1 | 13:17 |
| yolanda | nibalizer, no scheduler or quota errors for nodepool | 13:17 |
| nibalizer | rcarrillocruz: should i try to hipchat from phone or do yall got it? | 13:17 |
| *** mriedem has joined #openstack-infra | 13:17 | |
| rcarrillocruz | nibalizer: we'll run it, np | 13:18 |
| *** pblaho has joined #openstack-infra | 13:19 | |
| nibalizer | woot | 13:19 |
| nibalizer | if we need sekrits to travel, fungi and i likely have a few gpg trust paths | 13:20 |
| *** zz_jgrimm is now known as jgrimm | 13:23 | |
| fungi | rcarrillocruz: so it turns out that our nodepool debug log doesn't log the api response detail after all. this is an example i isolated from the log as to what i see from nodepoold's perspective... http://paste.openstack.org/show/100472/ | 13:24 |
| phschwartz | fungi: I am here. Let me hit up our ops to clean them | 13:24 |
| phschwartz | :( Le Meridian is already booked | 13:25 |
| fungi | rcarrillocruz: clarkb must have obtained the {"message": "No valid host was found. ", "code": 500, "created": "2014-08-25T21:58:02Z"} detail yesterday by manually recreating the condition | 13:25 |
| sdague | AJaeger: can you update - https://review.openstack.org/#/c/116692/ and remove devstack as well | 13:26 |
| *** isaacb has quit IRC | 13:26 | |
| sdague | because I think it will hit the same issue | 13:26 |
| fungi | phschwartz: thanks! | 13:26 |
| AJaeger | sdague, will do... | 13:26 |
| fungi | phschwartz: and yeah, i expect it's not a huge hotel. i can't remember which one i'm in | 13:27 |
| *** rcarrillocruz has quit IRC | 13:27 | |
| openstackgerrit | Andreas Jaeger proposed a change to openstack/requirements: Remove devstack/devstack-gate from projects https://review.openstack.org/116692 | 13:27 |
| phschwartz | fungi: I got a room at the L'Hotel Pergolese. Good ratings and got a great price booking >90 days in advance. And it was harder for me as I am taking the family with me to turn it into a Europe Vacation after the conference | 13:28 |
| *** gokrokve has joined #openstack-infra | 13:29 | |
| mattymo | :( what's going on with paste.openstack.org? | 13:29 |
| nibalizer | mattymo: it dies a lot | 13:30 |
| *** signed8bit has joined #openstack-infra | 13:30 | |
| nibalizer | maybe just refresh | 13:30 |
| mattymo | yeah now I can view the link | 13:30 |
| *** rcarrillocruz has joined #openstack-infra | 13:31 | |
| fungi | mattymo: it sometimes fails to store/retrieve a cookie in its trove db i think | 13:31 |
| *** gokrokve has quit IRC | 13:33 | |
| *** signed8bit has quit IRC | 13:35 | |
| *** pcrews has joined #openstack-infra | 13:35 | |
| *** signed8bit has joined #openstack-infra | 13:35 | |
| *** mkollaro1 is now known as mkollaro | 13:36 | |
| openstackgerrit | Maru Newby proposed a change to openstack-infra/devstack-gate: Add features.yaml entry for 'no services' https://review.openstack.org/116892 | 13:37 |
| *** chandankumar has quit IRC | 13:38 | |
| *** zz_gondoi is now known as gondoi | 13:39 | |
| *** sballe has joined #openstack-infra | 13:39 | |
| erw | sdague: any idea how best to track successes/failures of a test besides logstash? | 13:39 |
| * erw recalls a page with hypervisor testing stats from the icehouse mid-cycle | 13:39 | |
| vponomaryov | hey, did anyone faced issues like folowing: "Could not find a version that satisfies the requirement oslo.config>=1.4.0.0a3 ..." | 13:40 |
| *** chandankumar has joined #openstack-infra | 13:41 | |
| vponomaryov | (from versions: 1.1.0, 1.1.1, 1.2.0, 1.2.1, 1.3.0) | 13:41 |
| sdague | erw: I think that was gerrit queries | 13:41 |
| sdague | honestly, logstash and gerrit have rich data. graphite has targeted low overhead meters if you can find the right ones that answer your question (graphite and my brain don't work together very well) | 13:42 |
| *** mkollaro has quit IRC | 13:43 | |
| erw | it’s deep and rich, yes, it’s just totally unaggregated (and a hard way to get awareness of problems without running multiple queries per day, afaik) | 13:43 |
| *** jab has joined #openstack-infra | 13:43 | |
| *** jab has joined #openstack-infra | 13:43 | |
| *** ArxCruz has quit IRC | 13:45 | |
| fungi | vponomaryov: yes. depending on where you're seeing that, there could be various causes | 13:45 |
| *** hdd has joined #openstack-infra | 13:45 | |
| vponomaryov | fungi: local attempt to run tox | 13:45 |
| *** jgallard has quit IRC | 13:46 | |
| *** heyongli has quit IRC | 13:46 | |
| fungi | vponomaryov: probably you either have your local system configured to use a stale mirror of pypi, or you're using a version of pip older than 1.5 (via an older version of virtualenv) | 13:46 |
| vponomaryov | fungi: thanks, will check this out | 13:47 |
| *** hogepodge has joined #openstack-infra | 13:47 | |
| *** eharney has joined #openstack-infra | 13:47 | |
| fungi | vponomaryov: keep in mind that virtualenv installs its own copy of pip, and does not use whatever version of pip you might already have installed on your system | 13:48 |
| *** wenlock has joined #openstack-infra | 13:50 | |
| vponomaryov | fungi: in case it installs its own version of pip, then I have no insluence on it | 13:51 |
| vponomaryov | fungi: My system version was 1.4.1, and yes, change to 1.5.0 did not change appearence of error, due to mentioned reason - venv uses its own version | 13:52 |
| *** ominakov has joined #openstack-infra | 13:52 | |
| *** chandankumar has quit IRC | 13:53 | |
| fungi | vponomaryov: right, the version of pip installed by virtualenv depends on the version of virtualenv you're using | 13:54 |
| *** pballand has joined #openstack-infra | 13:54 | |
| *** chandankumar has joined #openstack-infra | 13:54 | |
| fungi | vponomaryov: you can test it by running 'virtualenv foo ; foo/bin/pip --version' | 13:55 |
| *** e0ne has quit IRC | 13:55 | |
| *** jab has quit IRC | 13:55 | |
| *** cnesa8 has quit IRC | 13:55 | |
| fungi | vponomaryov: i believe you will need to upgrade to virtualenv 1.11 or later for it to use pip >=1.5 | 13:56 |
| *** jab has joined #openstack-infra | 13:56 | |
| *** jab has joined #openstack-infra | 13:56 | |
| *** ildikov_ has joined #openstack-infra | 13:56 | |
| fungi | vponomaryov: see the release notes at https://pypi.python.org/pypi/virtualenv for details | 13:56 |
| *** e0ne has joined #openstack-infra | 13:57 | |
| *** denis_makogon has joined #openstack-infra | 13:57 | |
| *** denis_makogon has quit IRC | 13:57 | |
| *** david-lyle has joined #openstack-infra | 13:57 | |
| *** pelix1 is now known as help | 13:58 | |
| *** help is now known as pelix1 | 13:59 | |
| *** p5ntangl_ has quit IRC | 13:59 | |
| *** gokrokve has joined #openstack-infra | 14:00 | |
| *** ildikov has quit IRC | 14:00 | |
| vponomaryov | fungi: thanks, now I see, to use new requirements, we need install virtualenv>=1.11.0 . Update of tox, virtualenv and pip fixed the problem. | 14:02 |
| fungi | vponomaryov: correct, and glad that worked | 14:02 |
| *** dane_leblanc has joined #openstack-infra | 14:05 | |
| *** markmcclain has joined #openstack-infra | 14:05 | |
| *** pradk has joined #openstack-infra | 14:05 | |
| *** chandankumar has quit IRC | 14:06 | |
| *** nelsnelson has joined #openstack-infra | 14:06 | |
| *** jab is now known as bradjones | 14:06 | |
| *** ppai has quit IRC | 14:08 | |
| *** markmcclain1 has joined #openstack-infra | 14:09 | |
| *** dkranz has quit IRC | 14:09 | |
| *** bknudson has joined #openstack-infra | 14:10 | |
| *** homeless has joined #openstack-infra | 14:10 | |
| *** dims has joined #openstack-infra | 14:11 | |
| *** _nadya_ has joined #openstack-infra | 14:11 | |
| *** pballand has quit IRC | 14:11 | |
| *** markmcclain has quit IRC | 14:12 | |
| *** markmcclain1 has quit IRC | 14:13 | |
| *** markmcclain has joined #openstack-infra | 14:14 | |
| *** pballand has joined #openstack-infra | 14:15 | |
| *** markmcclain1 has joined #openstack-infra | 14:15 | |
| *** trinaths has quit IRC | 14:16 | |
| *** zns has joined #openstack-infra | 14:17 | |
| *** atiwari has joined #openstack-infra | 14:17 | |
| *** changbl has joined #openstack-infra | 14:18 | |
| *** markmcclain has quit IRC | 14:19 | |
| *** pblaho is now known as pblaho|afk | 14:20 | |
| *** wenlock has quit IRC | 14:22 | |
| *** tonytan4ever has joined #openstack-infra | 14:22 | |
| *** dkranz has joined #openstack-infra | 14:22 | |
| *** markmcclain1 has quit IRC | 14:22 | |
| *** mmaglana has joined #openstack-infra | 14:23 | |
| *** markmcclain has joined #openstack-infra | 14:23 | |
| *** imcsk8_ has joined #openstack-infra | 14:23 | |
| *** pblaho|afk is now known as pblaho | 14:24 | |
| *** imcsk8 has quit IRC | 14:24 | |
| *** lukego has joined #openstack-infra | 14:26 | |
| *** otherwiseguy has joined #openstack-infra | 14:29 | |
| *** alkari has joined #openstack-infra | 14:29 | |
| *** jedimike has quit IRC | 14:30 | |
| *** imcsk8_ has quit IRC | 14:30 | |
| *** imcsk8 has joined #openstack-infra | 14:30 | |
| *** alkari has quit IRC | 14:30 | |
| *** ekarlso has quit IRC | 14:31 | |
| *** annegentle has joined #openstack-infra | 14:32 | |
| *** rcarrillocruz has quit IRC | 14:32 | |
| *** alkari has joined #openstack-infra | 14:33 | |
| *** gargola has joined #openstack-infra | 14:34 | |
| *** jgrimm is now known as zz_jgrimm | 14:34 | |
| *** sandywalsh has joined #openstack-infra | 14:34 | |
| *** rcarrillocruz has joined #openstack-infra | 14:36 | |
| *** amotoki has quit IRC | 14:36 | |
| *** paulrad has joined #openstack-infra | 14:38 | |
| *** ominakov has quit IRC | 14:40 | |
| *** p5ntangle has joined #openstack-infra | 14:41 | |
| *** denis_makogon has joined #openstack-infra | 14:41 | |
| *** flaper87 is now known as flaper87|afk | 14:43 | |
| *** ominakov has joined #openstack-infra | 14:44 | |
| *** mdorman has joined #openstack-infra | 14:45 | |
| *** Longgeek has quit IRC | 14:45 | |
| *** flaper87|afk is now known as flaper87 | 14:45 | |
| openstackgerrit | Maru Newby proposed a change to openstack-infra/config: Minimize service installation for neutron func job https://review.openstack.org/114416 | 14:46 |
| *** daya_k has quit IRC | 14:46 | |
| openstackgerrit | Dan Prince proposed a change to openstack-infra/config: Import os-net-config project under TripleO https://review.openstack.org/112331 | 14:46 |
| *** p5ntangle has quit IRC | 14:47 | |
| *** cristov_mac has joined #openstack-infra | 14:48 | |
| *** amuller_ has joined #openstack-infra | 14:48 | |
| *** datsun180b has joined #openstack-infra | 14:49 | |
| marun | clarkb: Is something like this workable? https://review.openstack.org/#/c/116892/ | 14:49 |
| marcusvrn | asselin: I finished to run your script and I think that's ok. looking at nodepool logs, I saw that nodepool search for Ubuntu Image....I have to upload the image using "nodepool image-upload" or in the cloud provider? | 14:50 |
| *** amuller has quit IRC | 14:50 | |
| *** dims has quit IRC | 14:51 | |
| *** mmaglana has quit IRC | 14:51 | |
| *** dangers_away is now known as dangers | 14:52 | |
| markvan | fungi: hi again, looking at that autoconf issue again. Please checkout https://review.openstack.org/#/c/112514/ success and failure on hpcloud nodes (1 digit apart). | 14:52 |
| *** dims has joined #openstack-infra | 14:54 | |
| openstackgerrit | Sebastien Badia proposed a change to openstack-infra/config: puppet-jobs: Pin puppet-unit-2.7 jobs to precise https://review.openstack.org/116915 | 14:55 |
| *** ildikov_ has quit IRC | 14:56 | |
| *** wenlock has joined #openstack-infra | 14:57 | |
| sbadia | hi infra, could someone from core have a look at https://review.openstack.org/116915 - current puppet gate (2.7 unit) is still broken | 14:59 |
| sbadia | this patch pin puppet 2.7 unit to precise workers | 14:59 |
| *** garyk has quit IRC | 15:03 | |
| *** reed has joined #openstack-infra | 15:05 | |
| *** jgallard has joined #openstack-infra | 15:05 | |
| *** jp_at_hp has quit IRC | 15:06 | |
| dhellmann | hi, folks, what're the chances we could get pylockfile imported soon? https://review.openstack.org/#/c/101911/10 | 15:06 |
| anteaya | morning dhellmann, yes 101911 looks good to me | 15:08 |
| anteaya | if fungi is about for another +2 and +A that could do it | 15:08 |
| dhellmann | anteaya: thanks, there was the comment from clarkb about the group name, and I'd be happy to update the patch if that helps | 15:08 |
| fungi | on a conference call, but i'll try to look in a sec | 15:09 |
| *** jp_at_hp has joined #openstack-infra | 15:09 | |
| dhellmann | fungi: ok, not an immediate rush, just want to make sure it gets some attention :-) | 15:09 |
| *** reed has quit IRC | 15:09 | |
| anteaya | dhellmann: let's let fungi decide | 15:09 |
| *** zz_jgrimm is now known as jgrimm | 15:09 | |
| dhellmann | anteaya, fungi : wfm | 15:09 |
| anteaya | dhellmann: if you do another patchset do ping, I'll re +1 | 15:10 |
| dhellmann | anteaya: ok | 15:10 |
| anteaya | fungi: +1 for valet | 15:11 |
| fungi | anteaya: truth be told, i used a thesaurus | 15:11 |
| *** reed has joined #openstack-infra | 15:12 | |
| anteaya | I like a good thesaurus | 15:12 |
| HeOS | fungi, i want to send few fixes for jeepyb and gerritlib. How I can do it? Should I do it through bug in launchpad or through code-review on review.openstack.org ? | 15:12 |
| *** rcarrillocruz has quit IRC | 15:12 | |
| anteaya | HeOS: code-review | 15:13 |
| fungi | HeOS: through code-review on review.openstack.org preferably, but if you want to file a bug for those changes too (if it makes sense to do so) then feel free, just make sure to reference it in the commit message | 15:13 |
| HeOS | anteaya, fungi thanks. | 15:14 |
| *** lucasagomes has joined #openstack-infra | 15:14 | |
| *** rcarrillocruz has joined #openstack-infra | 15:14 | |
| lucasagomes | hey please if there's some core to review https://review.openstack.org/#/c/113276/ , it's a small change adding some tests in tempest and is blocking a blueprint in Ironic to be marked as Implemented | 15:15 |
| *** unicell has joined #openstack-infra | 15:15 | |
| fungi | HeOS: and if you're going to link a bug in your commit message, the recommendations on how to do so and take advantage of our bug linking automation are at https://wiki.openstack.org/wiki/GitCommitMessages#Including_external_references | 15:15 |
| *** aviau has quit IRC | 15:17 | |
| fungi | markvan: very interesting. it really doesn't look platform-specific, provider-specific, image-specific, project-specific | 15:17 |
| fungi | markvan: http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiRmFpbGVkIHRvIGJ1aWxkIGdlY29kZSBsaWJyYXJ5XCIgQU5EIHRhZ3M6Y29uc29sZSIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiNjA0ODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQwOTA2NTg4OTE2NX0= | 15:17 |
| openstackgerrit | François Magimel proposed a change to openstack-infra/config: Make py33 job experimental for cloudkitty-dashboard https://review.openstack.org/116637 | 15:18 |
| *** zehicle_at_dell has joined #openstack-infra | 15:19 | |
| fungi | markvan: so my next best guesses are that it's either connectivity-related (gem is trying to get something pre-built from somewhere on the internet, fails and then falls back to building from source) or timing-related (some sorter of order-dependent operation calls that code path or doesn't depending on what did/didn't run before it in a parallelized set of operations) | 15:19 |
| markvan | fungi: interesting view of it. I've been looking through the failing gem package, and it seems fairly straight forward make process for c library. I don't see logic that would cause it not to compile. | 15:19 |
| markvan | fungi: yup, I was hoping that --jobs 1 would remove the parallel question as they are now in the exact same order for installing the gems. | 15:20 |
| anteaya | lucasagomes: for tempest patches the tempest core mostly hang out in the -qa channel: https://review.openstack.org/#/admin/groups/42,members | 15:20 |
| *** lcheng has joined #openstack-infra | 15:20 | |
| lucasagomes | anteaya, thanks, yeah I just pinged there as well! | 15:20 |
| *** armax has joined #openstack-infra | 15:21 | |
| markvan | but the issue seems to be deeper then that and the --verbose does not quite give info in the success path to compare (like we can't see it if did the extension compile or not. | 15:21 |
| *** jpeeler has quit IRC | 15:21 | |
| anteaya | lucasagomes: :D | 15:22 |
| *** jpeeler has joined #openstack-infra | 15:22 | |
| *** jpeeler has quit IRC | 15:22 | |
| *** jpeeler has joined #openstack-infra | 15:22 | |
| markvan | fungi: Can you confirm that both of these nodes do NOT have autoconf installed? If that's the case, then I will keep digging into what triggers there are for making this library vs getting it from somewhere. | 15:22 |
| *** pblaho has quit IRC | 15:24 | |
| jeblair | fungi: the hp cloud servers that are getting the "no valid host" message -- are they all being immediately deleted, or are they sticking around? | 15:25 |
| fungi | jeblair: they seem to get deleted fairly quickly | 15:25 |
| *** signed8b_ has joined #openstack-infra | 15:25 | |
| fungi | jeblair: from what i could tell in the nodepool log anyway | 15:25 |
| jeblair | fungi: how did you find the error message? | 15:26 |
| *** tsg has quit IRC | 15:26 | |
| *** tgohad has quit IRC | 15:26 | |
| fungi | jeblair: clarkb was the one who originally quoted it. i have to assume he was manually running nova boot | 15:26 |
| jeblair | ah | 15:26 |
| fungi | jeblair: since i can't find it in the nodepool debug log | 15:26 |
| *** renlt has quit IRC | 15:27 | |
| fungi | jeblair: anyway, here's an example from the log http://paste.openstack.org/show/100472/ | 15:27 |
| markvan | fungi: this seems related to berkshelf 3.x upgrade we did. checkout https://forums.aws.amazon.com/thread.jspa?messageID=565698&tstart=0 | 15:27 |
| fungi | jeblair: deleted in just over two minutes from the error getting thrown | 15:27 |
| jeblair | fungi: we don't seem to log az :( | 15:27 |
| *** chandankumar has joined #openstack-infra | 15:27 | |
| *** mmaglana has joined #openstack-infra | 15:28 | |
| *** signed8bit has quit IRC | 15:28 | |
| fungi | jeblair: oh, good point. if they were all in one of the three azs we wouldn't know without some real-time correlation from the node list | 15:28 |
| jeblair | fungi: doing that, looks like az1 (4/4) | 15:29 |
| *** ekarlso has joined #openstack-infra | 15:29 | |
| openstackgerrit | Matt Riedemann proposed a change to openstack-infra/elastic-recheck: Add query for ceilometer docs build fail bug 1361455 https://review.openstack.org/116923 | 15:29 |
| uvirtbot | Launchpad bug 1361455 in ceilometer "TypeError in gate-ceilometer-docs" [Undecided,New] https://launchpad.net/bugs/1361455 | 15:29 |
| *** koolhead17 has quit IRC | 15:30 | |
| *** ominakov has quit IRC | 15:30 | |
| fungi | markvan: according to logstash we've been seeing it at least as far back as 2014-08-18 07:49 (style check on change 114495,2) | 15:30 |
| *** sdake_ has joined #openstack-infra | 15:30 | |
| *** IAX has joined #openstack-infra | 15:31 | |
| fungi | markvan: when did you upgrade berkshelf? | 15:31 |
| *** aviau has joined #openstack-infra | 15:31 | |
| markvan | fungi: started on 8-18 | 15:32 |
| fungi | markvan: also, that bug report does look like the same issue, and supports my supposition that it was related to connectivity over the internet | 15:32 |
| markvan | fungi: yeah, it seems the just the size and number of berkshelf 3.x dependencies is somehow causing this issue at times. | 15:33 |
| *** zns has quit IRC | 15:33 | |
| *** markmcclain has quit IRC | 15:33 | |
| *** ominakov has joined #openstack-infra | 15:34 | |
| fungi | markvan: and good to know that even if we had just given up tracking down the cause and installed autoconf everywhere, your jobs would have just started to die on a new error further down the chain | 15:34 |
| markvan | fungi: yup, well stated. Do you know of timeouts that might be tweaked here? Or a better way to do retries? | 15:35 |
| *** UtahDave has joined #openstack-infra | 15:36 | |
| *** UtahDave has left #openstack-infra | 15:37 | |
| markvan | fungi: or maybe there might be some other info in the syslogs on these nodes that I could somehow look at. | 15:37 |
| *** paulrad has quit IRC | 15:37 | |
| fungi | markvan: likely not anything in syslog... we do see random connectivity issues from all our workers to various points on the internet because the internet is an unreliable place and so are clouds | 15:37 |
| fungi | markvan: as such, we try to reduce/eliminate any dependency on network connections outside the worker for our jobs, because every one of them slighthly increases the chances the job will fail unnecessarily | 15:38 |
| *** paulrad has joined #openstack-infra | 15:39 | |
| *** dmellado has joined #openstack-infra | 15:40 | |
| fungi | markvan: if you're able to tweak the berkshelf installer's calls to wget, then presumably there are options around increasing timeouts, retries, et cetera. otherwise you'd need to engineer some sort of retry in a wrapper further outside that call | 15:40 |
| *** ekarlso has quit IRC | 15:40 | |
| *** ekarlso has joined #openstack-infra | 15:40 | |
| markvan | fungi: yup, I agree with trying to reduce outside dependencies. | 15:41 |
| markvan | fungi: in this case it seems like a bundler install issue as when it fails, berkshelf has not even been installed yet, its still working on the dependencies. That --retry option does not seem to help much here. | 15:42 |
| markvan | Seems like we might need to try a wrapper around the "bundler install" and see if something like that would help here. | 15:43 |
| *** signed8b_ has quit IRC | 15:44 | |
| markvan | fungi: I wish we could see more details on what is actually having the issue. | 15:44 |
| *** signed8bit has joined #openstack-infra | 15:45 | |
| *** doug-fish has joined #openstack-infra | 15:46 | |
| fungi | markvan: yeah, either a wrapper around bundler install, or possibly a wrapper around some care wget/curl to pre-cache that particular file it needs (assuming it can be told to look for it locally) | 15:46 |
| *** flaper87 is now known as flaper87|afk | 15:46 | |
| jeblair | fungi: capacity issue; i think there's a tweak we can do to help. working out the numbers. | 15:47 |
| markvan | fungi: thx for all your help here, I will continue to dig and discuss with openstack cookbook team | 15:47 |
| *** stevemar has quit IRC | 15:48 | |
| fungi | jeblair: also, nibalizer/rcarrillocruz/yolanda were talking to support about the symptoms, so the news that it seems to be entirely isolated to az1 may be of interest to them as well | 15:48 |
| *** stevemar has joined #openstack-infra | 15:48 | |
| *** masayukig has quit IRC | 15:49 | |
| markvan | fungi: just another thought as I saw this pass by a few monents ago. is Precise going to be around awhile? that we could force to that code type and try that? Maybe trusty has more/diff dependency list? | 15:50 |
| fungi | markvan: best estimate is probably about another year | 15:50 |
| jeblair | fungi: oh, yeah, sorry, i was chatting with folks in the noc; i think rcarrillocruz had to context switch | 15:50 |
| *** ociuhandu_ has joined #openstack-infra | 15:50 | |
| *** skolekonov has quit IRC | 15:50 | |
| fungi | markvan: we need to continue using it to test the stable/icehouse branches of officially supported openstack projects until they reach end of support | 15:51 |
| markvan | fungi: ah, ok. is it common for folks to try to tie to one node type? not sure if it would work better, just looking for options. | 15:51 |
| markvan | fungi: and is there any easy to pre-test that to see if it would make a difference here? | 15:51 |
| fungi | jeblair: oh, excellent. and wish i had thought to check the az mapping there... now that it's mostly transparent to us i tend to forget there even are azs in hpcloud any longer | 15:51 |
| fungi | markvan: sure, tying to a particular node type makes sense in situations where you need to explicitly confirm you work correctly on that platform, or when a job requires resources which are only available on that platform | 15:53 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Shift hpcloud load away from az1 https://review.openstack.org/116930 | 15:53 |
| jeblair | fungi: i think that should help ^ | 15:53 |
| fungi | markvan: as far as pre-testing, you could run this yourself a bunch in a tight loop on more than one platform and see if it makes any difference, but i suspect this really just boils down to newer vs older berkshelf as indicated in that bug report | 15:54 |
| *** ramashri has joined #openstack-infra | 15:54 | |
| *** pcrews has quit IRC | 15:54 | |
| *** masayukig has joined #openstack-infra | 15:54 | |
| markvan | fungi: yeah, it appears that way. I've been trying to repo this, but have not been able to yet. | 15:55 |
| fungi | jeblair: looks reasonable and while i didn't rerun your calculations they look in line with my rough estimate | 15:56 |
| *** amotoki has joined #openstack-infra | 15:56 | |
| jroll | annegentle: any chance you could take care of this? :) https://bugs.launchpad.net/ironic/+bug/1323712 | 15:57 |
| fungi | markvan: one possibility would be if you had a way to artificially constrain the network connection for a virtual machine or context where you're trying to reproduce it, that might increase the odds in your favor a lot | 15:57 |
| uvirtbot | Launchpad bug 1323712 in ironic "Old ironic-install documentation page should be deleted" [Low,Triaged] | 15:57 |
| jroll | annegentle: there's notes about redirects and such now | 15:57 |
| markvan | fungi: ok, good idea. | 15:57 |
| fungi | markvan: or possibly use a firewall/proxy to explicitly block the program's access to that one url | 15:57 |
| *** tsg has joined #openstack-infra | 15:57 | |
| *** tgohad has joined #openstack-infra | 15:59 | |
| asselin | marcusvrn, use the cloud provider | 16:03 |
| hashar | jeblair: clarkb: I reviewed a few Zuul cloner patches. Went out of time eventually. Mostly nitpick , +1 on enhancing the tests thanks! | 16:03 |
| *** hashar is now known as hasharConfCall | 16:03 | |
| asselin | marcusvrn, actually, image-upload is new. You can try it out. I haven't yet. | 16:03 |
| *** zns has joined #openstack-infra | 16:04 | |
| *** gyee has joined #openstack-infra | 16:05 | |
| *** Hal_ has quit IRC | 16:05 | |
| annegentle | jroll: hm, this patch https://review.openstack.org/#/c/113633/ was supposed to fix it with a redirect. | 16:06 |
| *** jgallard has quit IRC | 16:06 | |
| annegentle | jroll: do you see why that didn't work? | 16:06 |
| *** jpich has quit IRC | 16:06 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Shift hpcloud load away from az1 https://review.openstack.org/116930 | 16:07 |
| *** jpich has joined #openstack-infra | 16:08 | |
| jroll | annegentle: ah, didn't see that change on the bug... looks like the url is wrong, I'll push a patch :) | 16:08 |
| jeblair | fungi: ^ the noc would like even stronger shift | 16:08 |
| annegentle | jroll: thanks, yeah the Closes-bug tag doesn't cross projects | 16:08 |
| openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack-infra/config: Create repo for oslo.log https://review.openstack.org/116934 | 16:08 |
| *** e0ne has quit IRC | 16:08 | |
| jroll | annegentle: ah, right, will poke you when I have a review | 16:09 |
| *** jcoufal has quit IRC | 16:09 | |
| jeblair | fungi: also, should we instamerge that since it's an operational problem? | 16:10 |
| *** reed has quit IRC | 16:10 | |
| *** ociuhandu_ has quit IRC | 16:10 | |
| *** yamahata has joined #openstack-infra | 16:11 | |
| *** trinaths has joined #openstack-infra | 16:11 | |
| *** pballand has quit IRC | 16:12 | |
| *** bdpayne has joined #openstack-infra | 16:12 | |
| *** UtahDave has joined #openstack-infra | 16:12 | |
| *** UtahDave has left #openstack-infra | 16:12 | |
| *** hogepodge has quit IRC | 16:13 | |
| *** afazekas has quit IRC | 16:14 | |
| openstackgerrit | Andrey Nikitin proposed a change to openstack-infra/jeepyb: Added the ability to run jeepyb not only on the host where the Gerrit installed. https://review.openstack.org/116936 | 16:14 |
| marcusvrn | asselin: what I have to install on the ubuntu image to optimize the jobs...the dependencies of devstack should be good ? something else? | 16:15 |
| *** yamahata has quit IRC | 16:16 | |
| fungi | jeblair: sounds fine to me, or just enqueue it into the gate and it should land very quickly? | 16:16 |
| *** amuller_ has quit IRC | 16:17 | |
| *** marcoemorais has joined #openstack-infra | 16:18 | |
| *** esker has joined #openstack-infra | 16:19 | |
| openstackgerrit | Cindy Pallares proposed a change to openstack-infra/reviewday: Change Marconi to Zaqar https://review.openstack.org/116938 | 16:20 |
| jroll | annegentle: https://review.openstack.org/#/c/116939/ :) | 16:22 |
| fungi | jeblair: it's in the gate now, should hopefully have workers shortly | 16:22 |
| *** bhuvan has joined #openstack-infra | 16:23 | |
| *** sballe has quit IRC | 16:24 | |
| *** koolhead17 has joined #openstack-infra | 16:26 | |
| *** ramashri has quit IRC | 16:26 | |
| *** ramashri has joined #openstack-infra | 16:26 | |
| *** Ryan_Lane has joined #openstack-infra | 16:27 | |
| rpodolyaka | jeblair: hey! didn't you mean vote +2 here? https://review.openstack.org/#/c/104134/ :) | 16:29 |
| asselin | marcusvrn, you should use the pre-existing scripts. You can tweak if you like, but use those as a starting point. | 16:29 |
| asselin | marcusvrn, essentially https://github.com/openstack-infra/config/blob/e99348d0db860ed396ca56ae6e74e71621090def/modules/openstack_project/files/nodepool/scripts/prepare_node.sh | 16:30 |
| *** sballe_ has joined #openstack-infra | 16:31 | |
| asselin | marcusvrn, I've 'tweaked' it to work in my environment (behind corp proxy) https://github.com/rasselin/os-ext-testing/tree/master/puppet/modules/os_ext_testing/files/nodepool | 16:31 |
| *** Ryan_Lane has quit IRC | 16:32 | |
| *** markmc has quit IRC | 16:32 | |
| *** pcrews has joined #openstack-infra | 16:33 | |
| *** annegentle has quit IRC | 16:34 | |
| openstackgerrit | Sean Dague proposed a change to openstack/requirements: updated requirements repo readme https://review.openstack.org/116708 | 16:34 |
| *** gokrokve_ has joined #openstack-infra | 16:35 | |
| *** derekh has quit IRC | 16:36 | |
| *** zehicle_at_dell has quit IRC | 16:37 | |
| pleia2 | jeblair: so, do we want to start moving bugs over to storyboard today during our bug review? | 16:37 |
| *** sballe_ has quit IRC | 16:37 | |
| *** ominakov has quit IRC | 16:38 | |
| *** markmcclain has joined #openstack-infra | 16:38 | |
| *** markmcclain has quit IRC | 16:38 | |
| pleia2 | ones we opened as "reminders" should be easy, there are others that we're just kind of keeping updated that we can summarize the state of and move | 16:38 |
| *** lcheng has quit IRC | 16:38 | |
| *** gokrokve has quit IRC | 16:38 | |
| clarkb | fungi: I was doing nova show on the uuids that returned status ERROR | 16:39 |
| *** jpich_ has joined #openstack-infra | 16:39 | |
| *** pcrews has quit IRC | 16:39 | |
| clarkb | pleia2: I like the idea, not sure how we would implement it. Just by hand as we examine each bug? | 16:40 |
| *** balles has joined #openstack-infra | 16:40 | |
| *** signed8bit has quit IRC | 16:40 | |
| pleia2 | clarkb: yeah, I think that's the only way | 16:40 |
| pleia2 | might take a few days, but it will cause us to be a bit more decisive about some of the long-standing bugs | 16:41 |
| *** jpich has quit IRC | 16:41 | |
| pleia2 | I have to duck out at 2:30 today (have a sick kitty) | 16:41 |
| *** tonytan4ever has quit IRC | 16:41 | |
| *** medieval1_ has joined #openstack-infra | 16:41 | |
| clarkb | marun: my concern with that change is it seems to mix branches and env var settings inthe features.yaml list | 16:43 |
| *** tgohad__ has joined #openstack-infra | 16:43 | |
| *** tsg has quit IRC | 16:43 | |
| *** tgohad has quit IRC | 16:43 | |
| clarkb | marun: which is probably actually a bug in the features.yaml but may be confusing | 16:43 |
| *** tsg has joined #openstack-infra | 16:43 | |
| clarkb | marun: I think I am ok with this for now | 16:44 |
| openstackgerrit | A change was merged to openstack/requirements: Add Pint for Horizon https://review.openstack.org/97224 | 16:44 |
| openstackgerrit | A change was merged to openstack/requirements: Add flake8 2.2.3 https://review.openstack.org/116758 | 16:44 |
| *** medieval1 has quit IRC | 16:45 | |
| *** isviridov is now known as isviridov|away | 16:45 | |
| openstackgerrit | A change was merged to openstack/requirements: bump pycadf to 0.6.0 https://review.openstack.org/116360 | 16:46 |
| *** sballe_ has joined #openstack-infra | 16:47 | |
| *** ominakov has joined #openstack-infra | 16:47 | |
| *** aviau has quit IRC | 16:47 | |
| openstackgerrit | A change was merged to openstack/requirements: Add pysaml2 to global requirements https://review.openstack.org/113294 | 16:48 |
| jeblair | rpodolyaka: yep, sorry! :) | 16:48 |
| openstackgerrit | A change was merged to openstack/requirements: Drop flake8 2.2.2 https://review.openstack.org/116759 | 16:48 |
| clarkb | sdague: it would be good to get your feedback on https://review.openstack.org/#/c/116892/ | 16:50 |
| clarkb | sdague: to make sure I am not missing major issues with that features.yaml change | 16:50 |
| * clarkb walks to office and preps to dive into bugs | 16:50 | |
| jeblair | pleia2: i'm leaning toward just doing the usual procedure with bugs today; i'm not sure we're adequately prepped to move them into nodepool | 16:50 |
| *** markmcclain has joined #openstack-infra | 16:51 | |
| jeblair | er, storyboard | 16:51 |
| jeblair | (there's no config project in storyboard for one thing) | 16:51 |
| pleia2 | jeblair: ok, maybe move some of the ones we can, like nodepool bugs to the nodepool project in storyboard? | 16:51 |
| jeblair | pleia2: sure | 16:53 |
| *** lcheng has joined #openstack-infra | 16:53 | |
| openstackgerrit | OpenStack Proposal Bot proposed a change to openstack-dev/hacking: Updated from global requirements https://review.openstack.org/116946 | 16:53 |
| zaro | clarkb: can you take a look at this failure? http://logs.openstack.org/34/56734/7/check/jenkins-job-builder-compare-xml/d211b6f/console.html.gz | 16:54 |
| zaro | clarkb: i can't seem to see where it's duplicated | 16:54 |
| *** jpich has joined #openstack-infra | 16:54 | |
| sdague | clarkb: I'll take a look in a few, must get food now | 16:56 |
| *** pballand has joined #openstack-infra | 16:56 | |
| *** jpich_ has quit IRC | 16:56 | |
| *** SumitNaiksatam has quit IRC | 16:57 | |
| openstackgerrit | Dan Prince proposed a change to openstack-infra/config: Import os-net-config project under TripleO https://review.openstack.org/112331 | 16:58 |
| *** aviau has joined #openstack-infra | 16:59 | |
| *** gema_ has joined #openstack-infra | 17:00 | |
| *** amcrn has joined #openstack-infra | 17:00 | |
| pleia2 | ok, bug time: https://etherpad.openstack.org/p/cibugreview-august2014 | 17:01 |
| *** dane_leblanc has quit IRC | 17:01 | |
| *** signed8bit has joined #openstack-infra | 17:02 | |
| *** jpich has quit IRC | 17:02 | |
| pleia2 | for bugs I think should be moved to storyboard I'm keeping a STORYBOARD URL: section (it's on all of them by default, removing as I go through them) | 17:02 |
| openstackgerrit | Dan Prince proposed a change to openstack-infra/config: Consolidate tripleo/os-apply-config ACL files https://review.openstack.org/116950 | 17:02 |
| *** e0ne has joined #openstack-infra | 17:03 | |
| *** jpich has joined #openstack-infra | 17:03 | |
| *** ChanServ changes topic to "Bug Triage Day: https://etherpad.openstack.org/p/cibugreview-august2014" | 17:05 | |
| jeblair | pleia2: i will be back in 10 mins, sorry | 17:05 |
| openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: Add support for the Jenkins Valgrind publisher plugin. https://review.openstack.org/113117 | 17:06 |
| *** signed8bit has quit IRC | 17:07 | |
| *** jistr has quit IRC | 17:07 | |
| marun | clarkb: I'm happy to pursue a different approach if you'd prefer. | 17:07 |
| marun | clarkb: I picked what seemed the simplest path but I recognize that it's not ideal. | 17:08 |
| *** SumitNaiksatam has joined #openstack-infra | 17:09 | |
| marun | sdague: do you have any suggestions on how to do this better? https://review.openstack.org/#/c/116892 | 17:09 |
| clarkb | ya lets see what sdague has to say | 17:09 |
| *** lcheng has quit IRC | 17:10 | |
| *** hasharConfCall has quit IRC | 17:10 | |
| *** zns has quit IRC | 17:11 | |
| marun | clarkb: unrelated, if a change has been approved but a gate job fails for what is clearly an unrelated reason, is there any way to resubmit without reapproval? | 17:12 |
| marun | clarkb: this is the change in question: https://review.openstack.org/#/c/116554/ | 17:12 |
| marun | clarkb: It's the backport of the hook scripts to support functional testing on icehouse and they can't possibly have an effect on the gate job. | 17:12 |
| *** signed8bit has joined #openstack-infra | 17:14 | |
| clarkb | marun: yup, 'recheck' the change | 17:14 |
| clarkb | zuul will notice after check changes run that the change has everything it needs to go into the gate and the change will enter the gate pipeline | 17:15 |
| marun | clarkb: 'recheck no bug' | 17:15 |
| clarkb | marun: the no bug is no longer necessary | 17:15 |
| marun | clarkb: ah, gotcha | 17:15 |
| *** harlowja_away is now known as harlowja | 17:15 | |
| clarkb | marun: we decided that tracking this stuff with elastic recheck was more accurate so dropped that requirement | 17:15 |
| marun | clarkb: I think I've mainly used recheck for check failures, didn't realize how it worked for gate failures | 17:16 |
| *** marcoemorais has quit IRC | 17:16 | |
| clarkb | marun: it didn't in the past, but zuul has gotten smarter | 17:16 |
| marun | clarkb: nice :) | 17:16 |
| *** jpich has quit IRC | 17:16 | |
| *** praneshp has joined #openstack-infra | 17:16 | |
| marun | clarkb: assuming that patch lands soon, do you have any concerns with https://review.openstack.org/#/c/116458/ ? | 17:17 |
| *** marcoemorais has joined #openstack-infra | 17:17 | |
| *** marcoemorais has quit IRC | 17:17 | |
| marun | clarkb: So long as I haven't screwed up the job config, I should be able to fix failures from now on from the neutron tree and save you and the infra core the headache. | 17:17 |
| *** tomoe_ has quit IRC | 17:18 | |
| *** marcoemorais has joined #openstack-infra | 17:18 | |
| *** chuckC has quit IRC | 17:19 | |
| clarkb | marun: do we need to wait for the icehouse change to merge before changing infra side? I assume that job is voting now and we should wait | 17:20 |
| marun | clarkb: yes, we have to wait. I forgot to apply WIP after the last patch submission, I've put it back with a comment about the icehouse backport. | 17:20 |
| *** dizquierdo has quit IRC | 17:21 | |
| clarkb | marun: thanks | 17:21 |
| * clarkb starts bug day stuff | 17:21 | |
| openstackgerrit | OpenStack Proposal Bot proposed a change to openstack-dev/hacking: Updated from global requirements https://review.openstack.org/116946 | 17:21 |
| clarkb | I am going to work on new bug categorization | 17:22 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/config: Remove duplicate barbican job https://review.openstack.org/116959 | 17:22 |
| *** Ryan_Lane has joined #openstack-infra | 17:22 | |
| *** pcrews has joined #openstack-infra | 17:23 | |
| *** dane_leblanc has joined #openstack-infra | 17:23 | |
| clarkb | zaro: gertty uses storyboard. Can you move https://bugs.launchpad.net/openstack-ci/+bug/1340360 to storyboard and I will close this in lp | 17:23 |
| uvirtbot | Launchpad bug 1340360 in openstack-ci "Gerrty fails to start on MAC" [Undecided,New] | 17:23 |
| *** ramashri has quit IRC | 17:24 | |
| jeblair | clarkb, pleia2: back | 17:24 |
| *** ramashri has joined #openstack-infra | 17:24 | |
| *** tomoe_ has joined #openstack-infra | 17:25 | |
| clarkb | jeblair: I am tackling the new bug list | 17:25 |
| *** paulrad has quit IRC | 17:25 | |
| pleia2 | \o/ | 17:25 |
| *** marcoemorais has quit IRC | 17:26 | |
| *** tomoe_ has quit IRC | 17:26 | |
| fungi | i'm going to go ahead and ninja merge 116930,2 since it's been in the gate pipeline for over and hour with no bare-precise workers assigned to it. ugh | 17:28 |
| jeblair | i deleted openstack-ci from the task list on https://bugs.launchpad.net/openstack-ci/+bug/1266513 | 17:28 |
| uvirtbot | Launchpad bug 1266513 in tripleo "Some Python requirements are not hosted on PyPI" [High,In progress] | 17:28 |
| *** amcrn has quit IRC | 17:28 | |
| *** RicoLin has quit IRC | 17:28 | |
| jeblair | i figure that's the next best thing to marking it closed, which we can't due to timeouts | 17:28 |
| *** tnovacik has joined #openstack-infra | 17:28 | |
| *** marcoemorais has joined #openstack-infra | 17:29 | |
| openstackgerrit | A change was merged to openstack-infra/config: Shift hpcloud load away from az1 https://review.openstack.org/116930 | 17:29 |
| jeblair | fungi: thx | 17:29 |
| clarkb | jeblair: ++ | 17:30 |
| *** reed has joined #openstack-infra | 17:30 | |
| jeblair | https://bugs.launchpad.net/openstack-ci/+bug/1344023 | 17:30 |
| uvirtbot | Launchpad bug 1344023 in openstack-ci "Package libffi was not found in the pkg-config search path" [Critical,Confirmed] | 17:30 |
| jeblair | who understands that? | 17:30 |
| jeblair | there's a comment that says it was fixed; it shows up in logstash (link in bug) twice, both times for gate-tuskar-ui-python27 | 17:31 |
| clarkb | jeblair: I would say that is the yum -y thing mordred worked around but that shouldn't affect python27 jobs | 17:31 |
| *** jaypipes has quit IRC | 17:32 | |
| jeblair | there was also something about oslo alphas | 17:32 |
| jeblair | hrm. they just recheck-no-bugged that | 17:34 |
| jeblair | i'm going to stick my fingers in my ears and say that was resolved. clearly the tuskar folks don't think it's a bug. | 17:35 |
| * zaro and clarkb cannot enter any new stories into storyboard. | 17:36 | |
| jeblair | ah neat. so probably the connection to rabbit failed again | 17:37 |
| *** lucasagomes is now known as lucas-dinner | 17:37 | |
| *** ominakov has quit IRC | 17:37 | |
| *** lucas-dinner has left #openstack-infra | 17:37 | |
| jeblair | checking | 17:37 |
| *** ominakov has joined #openstack-infra | 17:37 | |
| clarkb | jeblair: thanks, I was looking in apache error logs and not seeing anything obvious | 17:38 |
| jroll | jeblair: can I bug you to look at https://review.openstack.org/#/c/112143/ | 17:38 |
| jeblair | clarkb: for some reason it ends up in error.log | 17:38 |
| jeblair | jroll: we're doing a bug day now. maybe later unless it's extremely urgent? | 17:38 |
| clarkb | jeblair: there it is, thanks | 17:38 |
| clarkb | jeblair: do we fix that by kicking rabbit or apache? | 17:39 |
| jeblair | clarkb: gimme 1 sec to prepare a resolution | 17:39 |
| clarkb | and by fix I guess I mean work around ok | 17:39 |
| jroll | jeblair: no worries, not urgent, thanks | 17:39 |
| clarkb | jeblair: and when that is done, https://bugs.launchpad.net/openstack-ci/+bug/1341460 is related to a bug you closed, do you recall enough of that bug to know if we can close that one too? if not I will do further investigation | 17:39 |
| uvirtbot | Launchpad bug 1341460 in openstack-ci "40+ minute git clone git://git.openstack.org/openstack-infra/devstack-gate" [Medium,Triaged] | 17:39 |
| *** zns has joined #openstack-infra | 17:41 | |
| *** annegentle has joined #openstack-infra | 17:42 | |
| *** _nadya_ has quit IRC | 17:43 | |
| *** hogepodge has joined #openstack-infra | 17:43 | |
| *** p5ntangle has joined #openstack-infra | 17:44 | |
| *** cristov_mac has quit IRC | 17:44 | |
| *** alexpilotti has quit IRC | 17:45 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/puppet-storyboard: Make enable notifications a flag https://review.openstack.org/116971 | 17:46 |
| *** gokrokve has joined #openstack-infra | 17:47 | |
| *** ominakov has quit IRC | 17:48 | |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Disable notifications in storyboard https://review.openstack.org/116973 | 17:48 |
| *** alexpilotti has joined #openstack-infra | 17:48 | |
| jeblair | clarkb: that's ^ how we're going to fix it medium term (because i don't intend on restarting storyboard daily to fix that problem) | 17:49 |
| jeblair | clarkb: short term, i've restarted apache -- see if you can file a bug now | 17:49 |
| clarkb | jeblair: wfm | 17:49 |
| *** zehicle_at_dell has joined #openstack-infra | 17:49 | |
| clarkb | yup bug submitted | 17:49 |
| jeblair | clarkb: (this is the 2nd time this has happened, the first time i restarted both apache and rabbitmq to see if that fixed it) | 17:49 |
| *** mrrrgn has joined #openstack-infra | 17:49 | |
| jeblair | clarkb: cool, so i think we know all we need to from production. i'll make sure a storyboard bug is filed and up to date | 17:50 |
| jeblair | (on this problem) | 17:50 |
| clarkb | jeblair: sounds good and I am +2 on those puppet changes | 17:50 |
| *** gokrokve_ has quit IRC | 17:50 | |
| openstackgerrit | Mathieu Gagné proposed a change to stackforge/python-jenkins: Enabled hacking check H404 https://review.openstack.org/106374 | 17:51 |
| openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Disable notifications in storyboard https://review.openstack.org/116973 | 17:51 |
| jeblair | commit msg update to link to bug https://storyboard.openstack.org/#!/story/202 | 17:51 |
| *** tonytan4ever has joined #openstack-infra | 17:51 | |
| *** gokrokve has quit IRC | 17:51 | |
| *** alexpilotti has quit IRC | 17:53 | |
| *** che-arne has quit IRC | 17:53 | |
| *** signed8bit has quit IRC | 17:53 | |
| anteaya | krtaylor: is your system actually down or had you just modified the wikipage as an example? https://wiki.openstack.org/wiki/ThirdPartySystems | 17:53 |
| *** chandankumar has quit IRC | 17:53 | |
| *** paulrad has joined #openstack-infra | 17:55 | |
| *** doude has quit IRC | 17:56 | |
| krtaylor | anteaya, actually down, we did a big update and are still working out the kinks | 17:56 |
| openstackgerrit | Ken Giusti proposed a change to openstack-infra/config: Add a test to verify oslo.messaging's AMQP 1.0 messaging protocol support https://review.openstack.org/115752 | 17:57 |
| fungi | clarkb: does an unquoted True or False actually work for setting a puppet variable or does it have to be true or false (lower-case)? | 17:57 |
| *** annegentle has quit IRC | 17:57 | |
| jeblair | clarkb, fungi: i can't look up the rax neutron outage ticket because i can't log into the web ui | 17:58 |
| openstackgerrit | A change was merged to stackforge/python-jenkins: Add MANIFEST.in https://review.openstack.org/116327 | 17:58 |
| *** ramashri has quit IRC | 17:58 | |
| fungi | jeblair: looking | 17:58 |
| krtaylor | anteaya, currently having problems with NetworkManager with our Fedora guests | 17:58 |
| jeblair | clarkb, fungi: it asks for the account number, and even when i supply it, it says invalid credentials | 17:58 |
| *** annegentle has joined #openstack-infra | 17:58 | |
| clarkb | fungi: oh right since we are doing erb substituion it probably needs to be quoted | 17:58 |
| *** ramashri has joined #openstack-infra | 17:58 | |
| clarkb | fungi: though I think we may get away with it being an implicit string but thats bad | 17:58 |
| anteaya | krtaylor: :( | 17:59 |
| jeblair | clarkb, fungi: i got the account number by logging into the cloud sites control panel (which, incidentally, confirms i have the right password) | 17:59 |
| clarkb | jeblair: I ran into that too, I am trying to remembre the work around. I think it was log into the new panel | 17:59 |
| anteaya | krtaylor: okay glad the wikpage is accurate | 17:59 |
| anteaya | krtaylor: hope you find a fix, your system is disabled then, yes? | 17:59 |
| jeblair | clarkb: the new panel is the problem. the old panel works, but has no functions | 18:00 |
| *** marun has quit IRC | 18:00 | |
| jeblair | oh! | 18:00 |
| *** gondoi is now known as zz_gondoi | 18:00 | |
| jeblair | clarkb, fungi: old panel login, link to 'tickets' sso's you into the new panel | 18:00 |
| jeblair | this is, i suspect, not a long term solution. | 18:00 |
| fungi | jeblair: which account was it under? not openstackci i guess? | 18:00 |
| *** pelix1 has quit IRC | 18:01 | |
| *** pballand has quit IRC | 18:01 | |
| *** p5ntangle has quit IRC | 18:02 | |
| clarkb | fungi: https://bugs.launchpad.net/openstack-ci/+bug/1350861 does that bug look like the classic ubuntu mirror in rax land has failed us bug? | 18:02 |
| uvirtbot | Launchpad bug 1350861 in openstack-ci "you have held broken packages" [Undecided,New] | 18:03 |
| *** chuckC has joined #openstack-infra | 18:03 | |
| jeblair | fungi: yeah, openstackci | 18:03 |
| pleia2 | so this one doesn't get lost in the Low section, I think it can be closed: https://bugs.launchpad.net/openstack-ci/+bug/1235335 | 18:03 |
| *** arborism has joined #openstack-infra | 18:03 | |
| uvirtbot | pleia2: Error: Could not parse data returned by Launchpad: The read operation timed out | 18:03 |
| pleia2 | heh | 18:04 |
| *** bdpayne has quit IRC | 18:04 | |
| fungi | jeblair: huh... maybe it's a sort order problem because they seem to have updated the timestamp on all open cases on the 14th... regardless i didn't see a recent case report about a neutron outage | 18:04 |
| *** bdpayne has joined #openstack-infra | 18:04 | |
| jeblair | fungi: i think we're talking about different things | 18:04 |
| fungi | jeblair: not really sure what you were talking about. you asked about getting to an open case about a neutron outage in rackspace, so i was trying to find it | 18:05 |
| jeblair | fungi, clarkb: oh, i was trying to log into yet a different wrong rax control panel. nevermind | 18:05 |
| *** HeOS has quit IRC | 18:05 | |
| *** datsun180b has quit IRC | 18:05 | |
| fungi | clarkb: that looks like the other bug... for broken ubuntu official mirrors (encountered with hpcloud workers) | 18:06 |
| jeblair | fungi: i was struggling to log in. i wasn't really at the point of talking about the tickets themselves | 18:06 |
| fungi | aha | 18:06 |
| *** pradk has quit IRC | 18:06 | |
| clarkb | fungi: thanks, I will dig that one up and mark it as duplicate | 18:06 |
| openstackgerrit | Adrian Otto proposed a change to openstack-infra/config: OpenStack Containers Service https://review.openstack.org/115328 | 18:06 |
| fungi | clarkb: i think it's bug 1286818 | 18:07 |
| uvirtbot | Launchpad bug 1286818 in openstack-ci "Ubuntu package archive periodically inconsistent causing gate build failures" [Low,Triaged] https://launchpad.net/bugs/1286818 | 18:07 |
| *** HeOS has joined #openstack-infra | 18:07 | |
| jeblair | clarkb: i'm going to mark that bug invalid right now, since it seems to have been a transient issue | 18:07 |
| *** arborism is now known as amcrn | 18:07 | |
| clarkb | jeblair: wfm | 18:08 |
| clarkb | jeblair: the one I am looking at or the other one or both? | 18:08 |
| clarkb | jeblair: or the one from when you debugged storyboard? | 18:08 |
| jeblair | clarkb: the one you asked me to look at about neutron outages :) | 18:08 |
| clarkb | jeblair: thanks :) | 18:08 |
| *** changbl has quit IRC | 18:08 | |
| *** ildikov has joined #openstack-infra | 18:09 | |
| clarkb | fungi: https://bugs.launchpad.net/openstack-ci/+bug/1286818 is the original I should use? | 18:09 |
| *** amotoki has quit IRC | 18:09 | |
| uvirtbot | Launchpad bug 1286818 in openstack-ci "Ubuntu package archive periodically inconsistent causing gate build failures" [Low,Triaged] | 18:09 |
| jeblair | pleia2: i have an alternate proposal for zuul bugs | 18:10 |
| jeblair | pleia2: since there are 56 open zuul bugs, and i don't really want to copy all of them, nor a subset of them (and have to figure out which ones were copied later) | 18:10 |
| jeblair | pleia2: let's just detach the openstack-ci project from them | 18:11 |
| *** ominakov has joined #openstack-infra | 18:11 | |
| jeblair | pleia2: and count on there being an import later | 18:11 |
| *** dustins has quit IRC | 18:11 | |
| fungi | clarkb: yeah, i'm updating 1286818 right now with some more recent details about why the suggested solution there turned out not to work | 18:11 |
| clarkb | fungi: thanks | 18:11 |
| *** dustins has joined #openstack-infra | 18:11 | |
| openstackgerrit | Clayton O'Neill proposed a change to openstack-infra/jenkins-job-builder: Move extended-choice support to parameters module https://review.openstack.org/116704 | 18:12 |
| *** jlibosva has quit IRC | 18:12 | |
| linkid | Hi. I was wondering what is the difference between gate-* and check-* jobs. Because I see some gate-* jobs in the check of projects, so, it's weird to me… | 18:13 |
| *** marcoemorais has quit IRC | 18:14 | |
| *** annegentle has quit IRC | 18:14 | |
| *** changbl has joined #openstack-infra | 18:14 | |
| clarkb | linkid: the separation was created so that we could run check jobs on slower nodes than gate jobs | 18:14 |
| pleia2 | jeblair: wfm | 18:14 |
| *** marcoemorais has joined #openstack-infra | 18:14 | |
| clarkb | linkid: then we use the different jobs in those specific zuul pipelines | 18:15 |
| *** marcoemorais has quit IRC | 18:15 | |
| *** marcoemorais has joined #openstack-infra | 18:15 | |
| linkid | Ah, ok. So, I think it would be better to use a check-* one for an experimental one, no ? But what about experimental-* one ? | 18:17 |
| *** sballe__ has joined #openstack-infra | 18:17 | |
| *** HeOS has quit IRC | 18:18 | |
| linkid | (better than a gate-* job, I mean) | 18:18 |
| *** sballe_ has quit IRC | 18:19 | |
| zaro | anteaya you and pleia2 are same color on bug etherpad. might consider picking another color | 18:19 |
| *** gokrokve has joined #openstack-infra | 18:19 | |
| clarkb | linkid: we don't want experimental-* jobs typically because that implies they will never do anything else. Ideally experimental jobs "graduate" into running more often either in the gate or periodically | 18:19 |
| mtreinish | clarkb, fungi: any ideas on how I can get some more info out of: http://logs.openstack.org/c4/c42d0f81f25f7262aa77c0a33b4f068893bbdfad/post/tempest-coverage/c134692/console.html.gz | 18:19 |
| mtreinish | it seems like the post coverage jobs have been failing for some time | 18:20 |
| clarkb | jeblair: https://bugs.launchpad.net/openstack-ci/+bug/1343250 would be a good one for you to comment on | 18:20 |
| uvirtbot | Launchpad bug 1343250 in openstack-ci "http://zuul.openstack.org/ should point/redirect to http://status.openstack.org/zuul/" [Undecided,New] | 18:20 |
| *** johnthetubaguy is now known as zz_johnthetubagu | 18:20 | |
| *** lukego has quit IRC | 18:20 | |
| *** mrrrgn has quit IRC | 18:20 | |
| pleia2 | zaro: I don't think anteaya is on the etherpad, but there are actually 2 of me (it's open on my laptop too, over there --->) | 18:21 |
| *** marcoemorais has quit IRC | 18:21 | |
| linkid | clarkb: ok. This is why I didn't see many experimental-* jobs in the layout config file. | 18:21 |
| *** marcoemorais has joined #openstack-infra | 18:21 | |
| *** marun has joined #openstack-infra | 18:22 | |
| clarkb | mtreinish: /bin/sh: 1: coverage: not found I think you need to put coverage in your test requirements | 18:22 |
| mtreinish | clarkb: it is | 18:22 |
| clarkb | mtreinish: does tox -ecover work for you locally? | 18:22 |
| mtreinish | clarkb: http://git.openstack.org/cgit/openstack/tempest/tree/test-requirements.txt#n8 | 18:22 |
| mtreinish | yeah it works fine for me | 18:22 |
| jeblair | clarkb: commented and wontfix | 18:23 |
| linkid | clarkb: so, do you think a job running as experimental should be a check-* or a gate-* job? | 18:23 |
| *** natarajk has joined #openstack-infra | 18:23 | |
| clarkb | mtreinish: you know what the issue is (still theory) we don't appear to install test-requirements in your tox.ini | 18:23 |
| jeblair | mtreinish: hi, we're doing bug triage here. want to help? :) | 18:23 |
| *** PsionTheory has joined #openstack-infra | 18:23 | |
| *** kgiusti has quit IRC | 18:23 | |
| *** doug-fish has left #openstack-infra | 18:23 | |
| jeblair | linkid: gate | 18:24 |
| clarkb | mtreinish: you need a deps section like you have under docs and venv targets | 18:24 |
| *** kgiusti has joined #openstack-infra | 18:24 | |
| clarkb | jeblair: thanks | 18:24 |
| *** p5ntangle has joined #openstack-infra | 18:24 | |
| mtreinish | jeblair: sure I'll take a look at some bugs see if there is anything I can grok | 18:24 |
| mtreinish | clarkb: ok thanks, I can fix that | 18:24 |
| *** balles has quit IRC | 18:25 | |
| *** kgiusti has quit IRC | 18:25 | |
| *** balles has joined #openstack-infra | 18:25 | |
| *** kgiusti has joined #openstack-infra | 18:25 | |
| pleia2 | mtreinish: the gate-failure tagged bugs may be of most interest to you: https://bugs.launchpad.net/openstack-ci/+bugs?field.tag=gate-failure | 18:26 |
| linkid | jeblair: ok, thank you :) | 18:26 |
| pleia2 | I think we have some low priority ones that haven't been looked at in a while | 18:27 |
| *** yfried_ has joined #openstack-infra | 18:27 | |
| *** aysyd has quit IRC | 18:27 | |
| *** ominakov has quit IRC | 18:27 | |
| *** marcoemorais has quit IRC | 18:28 | |
| *** marcoemorais has joined #openstack-infra | 18:28 | |
| openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Add query for ceilometer docs build fail bug 1361455 https://review.openstack.org/116923 | 18:29 |
| uvirtbot | Launchpad bug 1361455 in ceilometer "TypeError in gate-ceilometer-docs (dup-of: 1348818)" [Undecided,New] https://launchpad.net/bugs/1361455 | 18:29 |
| uvirtbot | Launchpad bug 1348818 in designate "Unittests do not succeed with random PYTHONHASHSEED value" [High,In progress] https://launchpad.net/bugs/1348818 | 18:29 |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/config: Directs new account requests to use the new mailing list https://review.openstack.org/116989 | 18:29 |
| *** arnaud has joined #openstack-infra | 18:29 | |
| fungi | phschwartz: were you able to make any headway woth getting ops to clear the 116 error+deleting state instances we have in dfw? they still seem to be hanging around... | 18:30 |
| kgiusti | Hi - anyone willing to sanity check a new job I'm working on for oslo.messaging? Total noob, could be worth a few laughs: https://review.openstack.org/#/c/115752/2/modules/openstack_project/files/jenkins_job_builder/config/oslo.yaml | 18:30 |
| asselin | anyone seen this error in devstack-gate? ERROR: openstackclient.shell Exception raised: (netaddr 0.7.5 (/usr/lib/python2.7/dist-packages), Requirement.parse('netaddr>=0.7.6')) | 18:30 |
| *** annegentle has joined #openstack-infra | 18:30 | |
| phschwartz | fungi: I have requested that they be removed, but not sure if ops has been able to do it yet. Let me follow up with them. | 18:31 |
| fungi | phschwartz: no worries. just making sure it wasn't a manifestation of some new, different problem or something. thanks! | 18:31 |
| openstackgerrit | K Jonathan Harker proposed a change to openstack-infra/infra-specs: Put the puppet modules in their own projects/repos https://review.openstack.org/99990 | 18:31 |
| phschwartz | fungi: no same issue :) | 18:31 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/jenkins-job-builder: Generate native xml format of Jenkins Git plugin version 2.x https://review.openstack.org/78930 | 18:31 |
| *** annegentle has quit IRC | 18:32 | |
| anteaya | asselin: is this happening on your ci system? | 18:33 |
| nibalizer | jesusaurus: this both of us working on the spec thing feels really cool :P | 18:33 |
| nibalizer | such team; wow | 18:34 |
| asselin | anteaya, yes | 18:34 |
| anteaya | asselin: what version of netaddr do you have? | 18:34 |
| jesusaurus | nibalizer: yeah | 18:34 |
| anteaya | it seems to say you have version 0.7.5 and need 0.7.6 | 18:34 |
| clarkb | dstufft: http://logs.openstack.org/36/105736/12/check/gate-nova-python27/ea3c156/console.html.gz#_2014-08-10_15_13_28_525 any idea why that happened? | 18:34 |
| asselin | netaddr==0.7.5 | 18:34 |
| nibalizer | also if we could get some eyes on this https://review.openstack.org/#/c/116915/ that would be good | 18:34 |
| markvan | fungi: hi again. quick question. Are the images used on the nodes available somewhere for download? Or the basic instructions of what was done? (ubuntu server 14.04.1, minimal install with ...?) | 18:34 |
| nibalizer | the puppet-openstack gate is super broken | 18:34 |
| fungi | jeblair: btw, most recent LaunchStatusException in hpcloud was 17:35:48, so since that az rebalancing change merged it has definitely worked around the problem | 18:34 |
| anteaya | asselin: I think it is saying you need 0.7.6 | 18:34 |
| nibalizer | im not really confident enough with jjb to know if that even works | 18:35 |
| asselin | anteaya, yes. but why is it saying that yet installed a different version? | 18:35 |
| *** aysyd has joined #openstack-infra | 18:35 | |
| fungi | markvan: no, until very recently our providers did not use glance, so we have been relying on building them from scratch based on various provided base images in each provider/region | 18:35 |
| asselin | anteaya, I just created this image this morning | 18:35 |
| jeblair | asselin, anteaya, nibalizer, jesusaurus: hi. we're doing some bug triage here. if your topic is not urgent, would you mind discussing it later or elsewhere? | 18:36 |
| markvan | fungi: ok, are those base images around, at least I could start there. | 18:36 |
| anteaya | asselin: when was your last successful image build? | 18:36 |
| anteaya | jeblair: sorry | 18:36 |
| jeblair | asselin, anteaya, nibalizer, jesusaurus: otherwise, please feel free to pitch in and help. see the URL in the channel topic | 18:36 |
| fungi | markvan: in hpcloud they're the latest ubuntu trusty 14.04 lts cloud images canonical publishes | 18:36 |
| clarkb | dstufft: we have markupsafe in our mirror. And according to timestamps we have had those files in our mirror since june 30th | 18:36 |
| anteaya | sorry I didn't know that was today | 18:37 |
| *** ominakov has joined #openstack-infra | 18:37 | |
| markvan | fungi: thx, I start there. | 18:37 |
| * fungi will stop answering non-bug-triage related questions now | 18:37 | |
| nibalizer | jeblair: eep sorry | 18:38 |
| clarkb | dstufft: https://bugs.launchpad.net/openstack-ci/+bug/1355050 updated with the info Iwas able to collect. please do update the bug if this is something you are aware of | 18:39 |
| uvirtbot | Launchpad bug 1355050 in openstack-ci "markupsafe package not found" [Medium,Triaged] | 18:39 |
| clarkb | dstufft: and I will need to buy you beer | 18:39 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/puppet-storyboard: Make enable notifications a flag https://review.openstack.org/116971 | 18:40 |
| dstufft | clarkb: are you just fronting this with apache | 18:40 |
| openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Disable notifications in storyboard https://review.openstack.org/116973 | 18:40 |
| dstufft | or nginx or whatever | 18:40 |
| *** jp_at_hp has quit IRC | 18:41 | |
| *** garyh has joined #openstack-infra | 18:41 | |
| clarkb | dstufft: yes | 18:41 |
| dstufft | clarkb: if you don't have something fronting it which will handle the normalization that PyPI does, then you need to ensure you use the exact names | 18:42 |
| clarkb | jeblair: I am going to defer https://bugs.launchpad.net/openstack-ci/+bug/1359001 to you. I think I would say just disable the built in geard server... but zuul probably could handle that better | 18:42 |
| uvirtbot | Launchpad bug 1359001 in openstack-ci "zuul service untrackable if it tries to start gearman when port 4730 is already open" [Undecided,New] | 18:42 |
| clarkb | dstufft: oh right this is that thing. even though pip says real name is MarkupSafe and has a url to that index? | 18:43 |
| *** p5ntangle has quit IRC | 18:43 | |
| jeblair | clarkb: yeah, just make sure that's a zuul bug | 18:43 |
| clarkb | jeblair: ok | 18:43 |
| *** mwagner_lap has joined #openstack-infra | 18:43 | |
| dstufft | clarkb: it's a sort of bad thing, because it figures out the it needs to look at /simple/MarkupSafe/ because it looks at /simple/ and finds the markupsafe link | 18:44 |
| dstufft | but it thinks it's an external link | 18:44 |
| clarkb | jeblair: I have removed infra and added zuul | 18:44 |
| clarkb | dstufft: oh fun | 18:44 |
| dstufft | so it doesn't bother to do it without --allow-external and --allow-unverified | 18:44 |
| clarkb | dstufft: any chance I can bribe you to tl;dr on that bug? | 18:44 |
| dstufft | I have on my TODO list to fix this, so that PyPI/bandersnatch stores things in the already normalized form | 18:44 |
| dstufft | then pip can normalize before looking | 18:45 |
| dstufft | so it doesn't require smarts on the index side to handle it | 18:45 |
| clarkb | jeblair: dhellmann shouldn't bugs like https://bugs.launchpad.net/openstack-ci/+bug/1358984 go in storyboard? | 18:45 |
| uvirtbot | Launchpad bug 1358984 in openstack-ci "gertty layout calculation exception" [Undecided,New] | 18:45 |
| dstufft | clarkb: yea | 18:45 |
| clarkb | dstufft: great thank you | 18:45 |
| clarkb | and excited to see it get fixed :) | 18:45 |
| *** markmc has joined #openstack-infra | 18:45 | |
| clarkb | notmyname: I am triaging https://bugs.launchpad.net/openstack-ci/+bug/1358779 where do I look to see what the device that swift uses is? I think we are using the defaults as provided by devstack and that is what is running out of space | 18:47 |
| uvirtbot | Launchpad bug 1358779 in openstack-ci "swift: no space left on device" [Undecided,New] | 18:47 |
| openstackgerrit | Dmitry Teselkin proposed a change to openstack-infra/nodepool: Add per-provider env vars https://review.openstack.org/116993 | 18:47 |
| jeblair | clarkb: yes; gertty is not an infra project | 18:47 |
| clarkb | notmyname: http://logs.openstack.org/94/108394/3/check/check-tempest-dsvm-neutron-full/4b574bb/logs/etc/swift/container-server/1.conf.txt.gz is devices = /opt/stack/data/swift/1 | 18:48 |
| jeblair | if people want it to be, i'm all ears. | 18:48 |
| clarkb | notmyname: is that the thing that would be running out of disk? | 18:48 |
| clarkb | jeblair: no I think it being in a very informal stackforge project has been good | 18:48 |
| clarkb | jeblair: because you have hacked on it however you liked :) | 18:48 |
| clarkb | and this tool is cool | 18:49 |
| clarkb | tl;dr don't mess with a good thing | 18:49 |
| jeblair | clarkb: i'll move that bug | 18:49 |
| clarkb | jeblair: ok ty | 18:49 |
| * jeblair keeps getting logged out of storyboard :( | 18:50 | |
| *** e0ne has quit IRC | 18:50 | |
| jeblair | wow, it didn't take long for storyboard to lose its rabbit connection again | 18:51 |
| clarkb | notmyname: I think I figured it out, in devstack/lib/swift we default to 1G if not tempest and 6G if tempest | 18:51 |
| openstackgerrit | Khai Do proposed a change to openstack-infra/jenkins-job-builder: Ensure dict orders are deterministic https://review.openstack.org/107063 | 18:52 |
| *** sabeen has quit IRC | 18:56 | |
| *** sabeen has joined #openstack-infra | 18:56 | |
| jesusaurus | clarkb: is https://bugs.launchpad.net/openstack-ci/+bug/1358354 the same rax resolv.conf issue you were fighting with the other day? | 18:58 |
| uvirtbot | Launchpad bug 1358354 in openstack-ci "centos6-rax: fatal: Unable to look up git.openstack.org (port 9418) (Temporary failure in name resolution)" [High,Fix released] | 18:58 |
| *** rcarrillocruz has quit IRC | 18:58 | |
| openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack-infra/devstack-gate: Add oslo.log to devstack-vm-gate-wrap.sh https://review.openstack.org/116995 | 18:59 |
| fungi | jesusaurus: we sometimes also just fail to get working dns lookups in jobs for various reasons, so it's possible it could have been unrelated | 19:00 |
| anteaya | meeting time | 19:00 |
| clarkb | jesusaurus: yes I just updated it | 19:00 |
| *** ChanServ changes topic to "Discussion of OpenStack Developer Infrastructure | docs http://ci.openstack.org | bugs https://launchpad.net/openstack-ci/ | https://git.openstack.org/cgit/openstack-infra/config/tree/" | 19:00 | |
| clarkb | fungi: no that is the same it was on rax centos6 | 19:00 |
| fungi | clarkb: oh, perfect then | 19:01 |
| *** hashar has joined #openstack-infra | 19:01 | |
| *** reed has quit IRC | 19:01 | |
| *** rcarrillocruz has joined #openstack-infra | 19:01 | |
| *** tgohad has joined #openstack-infra | 19:01 | |
| *** zns has quit IRC | 19:03 | |
| *** tgohad__ has quit IRC | 19:03 | |
| *** tgohad__ has joined #openstack-infra | 19:03 | |
| *** tsg has quit IRC | 19:04 | |
| *** harlowja has quit IRC | 19:06 | |
| openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack-infra/config: Fix typo - run gate/check against oslo.serialization-py33 https://review.openstack.org/116997 | 19:06 |
| *** zns has joined #openstack-infra | 19:06 | |
| *** harlowja has joined #openstack-infra | 19:08 | |
| *** Sukhdev has joined #openstack-infra | 19:09 | |
| *** baoli has quit IRC | 19:11 | |
| *** tsg has joined #openstack-infra | 19:11 | |
| *** baoli has joined #openstack-infra | 19:12 | |
| *** SumitNaiksatam has quit IRC | 19:13 | |
| *** _nadya_ has joined #openstack-infra | 19:13 | |
| *** tgohad has quit IRC | 19:14 | |
| *** tgohad__ has quit IRC | 19:14 | |
| *** jistr has joined #openstack-infra | 19:14 | |
| *** tgohad has joined #openstack-infra | 19:15 | |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/config: Directs new account requests to use the new mailing list https://review.openstack.org/116989 | 19:15 |
| *** trinaths has quit IRC | 19:17 | |
| zaro | pleia2: bug 823481 is tracked upstream, could you please mark as won't fix? | 19:17 |
| uvirtbot | Launchpad bug 823481 in openstack-ci "Gerrit should have a single page diff view" [Wishlist,Triaged] https://launchpad.net/bugs/823481 | 19:17 |
| pleia2 | zaro: I don't have access to do that, someone else should though | 19:18 |
| zaro | clarkb, fungi ^^ | 19:21 |
| *** amcrn has quit IRC | 19:21 | |
| zaro | can you help there? | 19:21 |
| clarkb | zaro: meeting time | 19:21 |
| *** tnovacik has quit IRC | 19:21 | |
| fungi | zaro: after we're done with the meeting, sure | 19:21 |
| *** ramashri has quit IRC | 19:22 | |
| *** jamespage_ has joined #openstack-infra | 19:22 | |
| *** otherwiseguy has quit IRC | 19:23 | |
| *** ramashri has joined #openstack-infra | 19:23 | |
| *** jamespage_ has quit IRC | 19:23 | |
| greghaynes | jeblair: Why mark as wontfix on https://bugs.launchpad.net/openstack-ci/+bug/1294381 rather than just +Aing https://review.openstack.org/#/c/105650/ ? | 19:23 |
| *** otherwiseguy has joined #openstack-infra | 19:23 | |
| uvirtbot | Launchpad bug 1294381 in openstack-ci "pypi-mirror does not pickup all necessary python packages" [Medium,Won't fix] | 19:23 |
| greghaynes | seems easier ;) | 19:23 |
| *** arborism has joined #openstack-infra | 19:24 | |
| fungi | greghaynes: we should probably start up a group conversation about handing over the reigns of pypi-mirror to a new set of maintainers if there's really a desire to keep it alive | 19:27 |
| *** otherwiseguy has quit IRC | 19:28 | |
| *** prad has joined #openstack-infra | 19:28 | |
| *** oanufriev has quit IRC | 19:31 | |
| *** paulrad has quit IRC | 19:31 | |
| *** emagana has joined #openstack-infra | 19:31 | |
| *** sdague has quit IRC | 19:31 | |
| greghaynes | yeaa | 19:33 |
| greghaynes | or just +A and act like none of this ever happened :) | 19:33 |
| greghaynes | nothing to see here, move along | 19:33 |
| dhellmann | were we having memory issues on some of the dsvm nodes earlier today? I'm getting test failures, and it looks like I wasn't the only one but they haven't happened for a few hours. | 19:34 |
| dhellmann | http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiT1NFcnJvcjogW0Vycm5vIDEyXSBDYW5ub3QgYWxsb2NhdGUgbWVtb3J5XCIiLCJmaWVsZHMiOltdLCJvZmZzZXQiOjAsInRpbWVmcmFtZSI6Ijg2NDAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQwOTA4MTU3MjIwOX0= | 19:34 |
| openstackgerrit | Spencer Krum proposed a change to openstack-infra/infra-specs: Multiple Data Dirs proposal https://review.openstack.org/100363 | 19:35 |
| *** Ryan_Lane has quit IRC | 19:36 | |
| *** _nadya_ has quit IRC | 19:37 | |
| *** dims has quit IRC | 19:38 | |
| *** dims has joined #openstack-infra | 19:39 | |
| *** gyee has quit IRC | 19:40 | |
| *** flaper87|afk is now known as flaper87 | 19:43 | |
| *** Alexei_987 has joined #openstack-infra | 19:43 | |
| *** dane_leblanc has quit IRC | 19:44 | |
| openstackgerrit | Antoine Musso proposed a change to openstack-infra/zuul: Display only first 6 chars for git commit id https://review.openstack.org/83556 | 19:44 |
| fungi | hashar: ^ most git tools use 7 digits instead (if that doesn't make too big of a visual difference) | 19:45 |
| hashar | fungi: I have just fixed a typo in the commit message :D | 19:46 |
| hashar | Wikimedia uses its own status page js | 19:46 |
| fungi | hashar: ahh, yeah i hadn't looked at the change | 19:46 |
| hashar | but yeah 6 or 7 digits is usually enough | 19:47 |
| *** tonytan4ever has quit IRC | 19:47 | |
| *** Alexei_987 has left #openstack-infra | 19:47 | |
| *** melwitt has joined #openstack-infra | 19:48 | |
| *** klindgren has joined #openstack-infra | 19:50 | |
| *** melwitt1 has joined #openstack-infra | 19:50 | |
| *** amuller has joined #openstack-infra | 19:51 | |
| *** sdague has joined #openstack-infra | 19:51 | |
| openstackgerrit | K Jonathan Harker proposed a change to openstack-infra/infra-specs: Put the puppet modules in their own projects/repos https://review.openstack.org/99990 | 19:52 |
| *** melwitt has quit IRC | 19:52 | |
| *** dane_leblanc has joined #openstack-infra | 19:54 | |
| klindgren | Lifeless - ping? | 19:56 |
| lifeless | klindgren: pong | 19:57 |
| klindgren | question on subunit: http://bazaar.launchpad.net/~subunit/subunit/trunk/view/head:/setup.py#L39 | 19:58 |
| *** arnaud has quit IRC | 19:58 | |
| klindgren | What is that line for. Trying to build the package and when I download the tarball and run python setup.py build I get OSError: [Errno 2] No such file or directory: '' | 19:59 |
| klindgren | but on 0.0.18 it works just fine | 19:59 |
| *** marcoemorais has quit IRC | 19:59 | |
| klindgren | (this is on 0.0.19) | 19:59 |
| *** marcoemorais has joined #openstack-infra | 19:59 | |
| *** natarajk has quit IRC | 19:59 | |
| clarkb | mgagne: nibalizer: I commened on the puppet 2.7 run on precise change | 20:00 |
| *** marcoemorais has quit IRC | 20:00 | |
| klindgren | lifeless, commenting out that line lets python setup.py build work correctly as well under 0.0.19 | 20:01 |
| *** annegentle has joined #openstack-infra | 20:01 | |
| *** marcoemorais has joined #openstack-infra | 20:01 | |
| klindgren | (This is on cent7) | 20:01 |
| mgagne | clarkb: alright, reading | 20:01 |
| pleia2 | anteaya and others: draft for 3rd party email: https://etherpad.openstack.org/p/use-3rd-party-lists | 20:01 |
| pleia2 | I'm going to go grab some lunch | 20:01 |
| clarkb | I need to grab lunch too | 20:01 |
| clarkb | wenlock: the problem with librarian is that it does or did depend on puppet, if you install librarian it install puppet from gems | 20:02 |
| clarkb | wenlock: at that point you are broken | 20:02 |
| mgagne | clarkb: so node label in JJB isn't of much use? Zuul can override it anyway... | 20:02 |
| clarkb | mgagne: well node label in JJB tells jenkins what to register that job as the zuul via gearman selects which node to run it on | 20:02 |
| clarkb | mgagne: now that we have a split precise/trusty setup going we have to be very specific on the zuul side about how to chooes nodes | 20:03 |
| *** ominakov has quit IRC | 20:03 | |
| lifeless | klindgren: that line fixes doing setup.py from a different directory - for VPATH builds | 20:03 |
| *** natarajk has joined #openstack-infra | 20:03 | |
| clarkb | wenlock: and our install modules script does git repos now and can checkout arbitrary refs | 20:03 |
| *** marcoemorais has quit IRC | 20:03 | |
| clarkb | wenlock: so a few lines of bash has basically replaced complicated ruby thing that completely breaks us | 20:03 |
| wenlock | clarkb , in my testing i didn't need to do that, here is a sample right after running install_puppet.sh for setting up librarian : http://paste.forj.io/show/10/ | 20:04 |
| *** marcoemorais has joined #openstack-infra | 20:04 | |
| lifeless | klindgren: does pip install <tarball> work for you ? | 20:04 |
| clarkb | wenlock: as an alternative I would consider r10k but librarian has bitten me way too hard to make me look at it again | 20:04 |
| anteaya | pleia2: looks good | 20:04 |
| clarkb | wenlock: did that install puppet? | 20:04 |
| clarkb | wenlock: in any cse there are bette rtools | 20:04 |
| clarkb | wenlock: so I don't want to use less good tools | 20:04 |
| wenlock | clarkb, let me verify that again. at the time of that testing i wasn't looking to see if my puppet ver changed | 20:04 |
| *** dmsimard is now known as dmsimard_away | 20:04 | |
| anteaya | pleia2: noting that the use of require in the email is fine but I will not support an addition to the thirdparty.rst file under the requirements section for mailing lists | 20:05 |
| anteaya | pleia2: so we are clear | 20:05 |
| wenlock | clarkb, if you can point me at a better one, i can investigate and report out | 20:05 |
| clarkb | wenlock: our install modules script and r10k | 20:05 |
| clarkb | wenlock: both are better imo | 20:05 |
| lifeless | klindgren: regardless of whether pip install <tarball> works, can you file a bug upstream, with the output of the error? Thanks! | 20:05 |
| pleia2 | anteaya: fair enough | 20:05 |
| *** tonytan4ever has joined #openstack-infra | 20:05 | |
| wenlock | clarkb we forked install_module.sh a while ago because it didn't seperate the module list from the code | 20:05 |
| anteaya | pleia2: thanks | 20:05 |
| wenlock | clarkb did that improve? | 20:05 |
| clarkb | wenlock: no, but thats easy to fix if you need it. Just put module list in a file that you source | 20:06 |
| lyxus | anteaya, Do you know what's happening with with the vArmour CI | 20:06 |
| *** jistr has quit IRC | 20:06 | |
| wenlock | clarkb that exactly what we did | 20:06 |
| wenlock | clarkb, so we were planning on just simply extending install_module.sh to continue doing that and give it more brains to use other tools when it finds config files for those tools | 20:07 |
| klindgren | lifeless pip install does work. I will file a bug. | 20:07 |
| wenlock | calrkb for example, if it found a Puppetfile, it would install librarian and do a librarian-puppet update agains that file | 20:07 |
| clarkb | wenlock: I don't know why that is necessary though | 20:07 |
| wenlock | calrkb or better yet, if it found Puppetfile.erb it would erb the file and use it | 20:07 |
| clarkb | wenlock: but r10k would better deal with that | 20:07 |
| wenlock | clarkb, let me hunt down r10k and check it out | 20:08 |
| clarkb | wenlock: why not just list the deps like we do today | 20:08 |
| wenlock | clarkb this guy? https://github.com/adrienthebo/r10k | 20:08 |
| clarkb | wenlock: then you have a single way of doing things that doesn't need crazy gem bootstrap env | 20:08 |
| clarkb | wenlock: yes that | 20:08 |
| wenlock | clarkb because your deps will exist on a git repo | 20:08 |
| clarkb | wenlock: we handle that just fine | 20:08 |
| wenlock | not in a published forge | 20:09 |
| *** Ryan_Lane has joined #openstack-infra | 20:09 | |
| clarkb | yes that is completely handled | 20:09 |
| *** dims_ has joined #openstack-infra | 20:09 | |
| anteaya | lyxus: no | 20:09 |
| anteaya | lyxus: what is happening with the vArmour CI? | 20:09 |
| clarkb | wenlock: you forked install modules so you don't get the latest and greateest goodness :) | 20:09 |
| anteaya | lyxus: or put another way, why do you ask? | 20:09 |
| clarkb | wenlock: but a couple months ago it grew the checkout git repo feature | 20:09 |
| wenlock | clarkb, looking at install_modules.sh updates for sure | 20:10 |
| *** dprince has quit IRC | 20:10 | |
| wenlock | clarkb, ok this is nice | 20:10 |
| wenlock | i see that now | 20:10 |
| *** ominakov has joined #openstack-infra | 20:10 | |
| wenlock | clarkb, so i would simply propose that install_modules.sh support something like a modules.env file | 20:11 |
| clarkb | wenlock: yup | 20:11 |
| wenlock | so you can seperate the data from the logic | 20:11 |
| wenlock | clarkb, then we'll re-pull that guy for sure | 20:11 |
| clarkb | I think the key thing is that r10k and puppet librarian do all the things | 20:12 |
| wenlock | clarkb, so here is a question though, you would then have all puppet-xyz modules go into /etc/puppet/modules ? | 20:12 |
| clarkb | which makes them complicated and easier to break. Whereas a simple shell script while not going to do everything is simple to debug and understand | 20:12 |
| *** dims has quit IRC | 20:12 | |
| clarkb | wenlock: yes I think that is how it is setup | 20:12 |
| wenlock | clarkb, it means you wouldn't have modulepath hiearchy anymore either.... so you can do things like override a module in /etc/puppet/modules with your own custom module | 20:13 |
| wenlock | clarkb, maybe not so important for you guys though | 20:13 |
| clarkb | wenlock: that sounds liek a major anti pattern | 20:13 |
| *** linkid has left #openstack-infra | 20:13 | |
| clarkb | wenlock: overriding moduels in that way is a path to pain when things don't work right | 20:13 |
| anteaya | lyxus: do you have additional information? | 20:13 |
| clarkb | wenlock: I would use puppet environments instead | 20:13 |
| wenlock | clarkb puppet 3.x | 20:14 |
| wenlock | yeah | 20:14 |
| clarkb | unfortunately the problem of namespacing puppet modules is unsolved and nasty | 20:14 |
| wenlock | clarkb exactly | 20:14 |
| *** rlandy has quit IRC | 20:14 | |
| clarkb | my solution is don't do it :) | 20:14 |
| lyxus | anteaya, I have a review upstream and it's automatically do +1 with an 10.X.X.X IP , see https://review.openstack.org/#/c/113421/ | 20:14 |
| *** dims_ has quit IRC | 20:14 | |
| lyxus | anteaya, I don't have the info to contact them and let them know that they have a problem | 20:14 |
| klindgren | lifeless - https://bugs.launchpad.net/subunit/+bug/1361857 | 20:15 |
| uvirtbot | Launchpad bug 1361857 in subunit "Subunit 0.0.19 wont build" [Undecided,New] | 20:15 |
| clarkb | I need to grab lunch though. check out r10k if you need Puppetfile support as finch seems to have done a good job with it | 20:15 |
| clarkb | and double check your puppet version after installing librarian, it may not be what you want | 20:15 |
| wenlock | clarkb cool, will do, and let you know | 20:15 |
| anteaya | lyxus: yeah okay, 1 minute to test a patch is not testing a patch | 20:15 |
| wenlock | clarkb ty for the input there. | 20:16 |
| lyxus | anteaya, and no access to the log | 20:16 |
| anteaya | fungi can you disable vArmour CI and I will email them | 20:16 |
| anteaya | lyxus: thanks for letting us know | 20:16 |
| fungi | anteaya: sure | 20:16 |
| *** dims has joined #openstack-infra | 20:17 | |
| anteaya | fungi: thanks | 20:18 |
| fungi | anteaya: i've deactivated vArmour CI (10119) | 20:18 |
| anteaya | thank you | 20:19 |
| *** sabeen has quit IRC | 20:20 | |
| *** alexpilotti has joined #openstack-infra | 20:21 | |
| *** dims has quit IRC | 20:22 | |
| *** signed8bit has joined #openstack-infra | 20:23 | |
| anteaya | lyxus: http://lists.openstack.org/pipermail/openstack-infra/2014-August/001825.html | 20:23 |
| anteaya | lyxus: thanks again | 20:23 |
| lyxus | anteaya, No problem | 20:23 |
| *** dane_leblanc has quit IRC | 20:25 | |
| *** arborism has quit IRC | 20:29 | |
| *** kgiusti has quit IRC | 20:29 | |
| *** flaviof is now known as flaviof_zzz | 20:29 | |
| notmyname | clarkb: I'm at the ops meetup today and just now saw your questions. did you get it figured out? | 20:31 |
| *** SumitNaiksatam has joined #openstack-infra | 20:32 | |
| *** rcarrillocruz has quit IRC | 20:32 | |
| *** rcarrillocruz has joined #openstack-infra | 20:36 | |
| clarkb | yup I think I got it | 20:37 |
| lyxus | kevinbenton, Hi Kevin, how are you dealing with the rebase issue ? | 20:37 |
| *** ociuhandu has quit IRC | 20:38 | |
| *** amcrn has joined #openstack-infra | 20:38 | |
| *** gyee has joined #openstack-infra | 20:40 | |
| *** zehicle has joined #openstack-infra | 20:40 | |
| *** mfer has quit IRC | 20:40 | |
| *** zehicle_at_dell has quit IRC | 20:41 | |
| *** jistr has joined #openstack-infra | 20:42 | |
| ianw | fungi / clarkb / jeblair / anyone : https://review.openstack.org/#/c/115752/ (Add a test to verify oslo.messaging's AMQP 1.0 messaging protocol support) <- only fedora has the packages required for this. IMO it's fine for him to bring his test up on f20 nodes. are you going to be ok with adding the dev packages to install in thick_slave.pp for f20 nodes? i can't see a precedent for this at the moment. i don't want to be advising | 20:42 |
| ianw | ken of the wrong thing | 20:42 |
| marun | clarkb: is autocheck disabled? | 20:42 |
| *** pballand has joined #openstack-infra | 20:43 | |
| *** otherwiseguy has joined #openstack-infra | 20:43 | |
| openstackgerrit | A change was merged to openstack/requirements: Remove devstack/devstack-gate from projects https://review.openstack.org/116692 | 20:44 |
| *** mfer has joined #openstack-infra | 20:44 | |
| *** mrrrgn has joined #openstack-infra | 20:46 | |
| fungi | marun: describe autocheck... do you mean where we were rerunning check jobs if someone commented on a change which had no check results for more than 72 hours, or something else? | 20:46 |
| marun | fungi: that's it | 20:46 |
| PsionTheory | Does Anyone know of any upcoming features being considered for Neutron IPv6 Features within the K Release Cycle ? | 20:46 |
| marun | PsionTheory: wouldn't that be a better question for #openstack-neutron? | 20:47 |
| fungi | marun: we retired that in favor of automated merge conflict detection. now when a change merges to a project, zuul immediately checks all open changes for the same project+branch and -1s them if they don't merge cleanly onto the new state | 20:47 |
| marun | fungi: ah, ok. I've seen that in action but didn't really understand the mechanism | 20:47 |
| fungi | marun: lighter-weight, faster and accomplishes much of the same since we still require an actual +1 check on a change before it's enqueued into the gate | 20:48 |
| *** e0ne has joined #openstack-infra | 20:48 | |
| * fungi needs to go grab dinner, but will be back for more bug triage soon | 20:48 | |
| PsionTheory | yes. i posed there and here just trying to cover all locations | 20:48 |
| *** morganfainberg is now known as morganfainberg_Z | 20:49 | |
| fungi | PsionTheory: this is the channel where we discuss the openstack project community infrastructure systems (wiki, code review, job automation, mailing list software, et cetera) | 20:49 |
| fungi | PsionTheory: we don't generally discuss much about actual openstack except in places where we're reusing it ourselves to support our community systems | 20:50 |
| *** cnesa8 has joined #openstack-infra | 20:50 | |
| *** amuller has quit IRC | 20:51 | |
| *** juzuluag has quit IRC | 20:52 | |
| PsionTheory | ok. my apologies | 20:55 |
| mdorman | i’ve noticed that the gate queue time is up to a couple hours. is the fundamental problem that there needs to be more test nodes? | 20:56 |
| *** koolhead17 has quit IRC | 20:56 | |
| clarkb | mdorman: basically | 20:57 |
| *** zz_gondoi is now known as gondoi | 20:57 | |
| clarkb | mdorman: there are some other issues too though. there is a nova bug that affects us in rax where we can't always delete a node and that consumes that nodes quota | 20:58 |
| mdorman | i see | 20:58 |
| clarkb | mdorman: and we hit quota issues in hpcloud that we have hopefully worked around | 20:58 |
| mdorman | so i assume that if more machines were made available for this, that would be welcome? | 20:58 |
| clarkb | mdorman: so we are somewhat more contrained than we would like and the backlog has grown. But its also getting close to feature freeze which always contributes to the backlog | 20:58 |
| clarkb | mdorman: yes, it is a thing that jeblair has talked to other groups about | 20:59 |
| mdorman | gottcha, makes sense | 20:59 |
| *** mrrrgn has quit IRC | 20:59 | |
| clarkb | if you are interested in donating openstack cloud resources you should talk to jeblair :) | 20:59 |
| mdorman | kk. yeah something i want to raise with my employer as a potential, just wanted to find out if that would actaully behelping or not. | 21:00 |
| *** signed8bit has quit IRC | 21:01 | |
| clarkb | ianw: let me catch up on that | 21:01 |
| jeblair | mdorman: yep; i can send you some boilerplate about what we'd need and how it would work if that's helpful | 21:01 |
| *** mrrrgn has joined #openstack-infra | 21:01 | |
| *** signed8bit has joined #openstack-infra | 21:02 | |
| *** marcoemorais has quit IRC | 21:02 | |
| mdorman | jeblair: yeah that’d be great. will pm you my email | 21:02 |
| *** ominakov has quit IRC | 21:02 | |
| *** bhuvan_ has joined #openstack-infra | 21:02 | |
| clarkb | ianw: I think we may actually need a bare-f20 node imgae to run those tsets as we won't have package dependencies on those nodes | 21:03 |
| clarkb | ianw: however we don't do any amqp unittests against real amqp servers so it would be new in that regard too | 21:03 |
| *** marcoemorais has joined #openstack-infra | 21:03 | |
| *** marcoemorais has quit IRC | 21:04 | |
| *** ominakov has joined #openstack-infra | 21:04 | |
| *** marcoemorais has joined #openstack-infra | 21:04 | |
| clarkb | ianw: we can chat more later but I want to get back to bug day activities now | 21:04 |
| clarkb | ianw: maybe they can do what swift function and neutron functional tests do and rely on devstack for the dependencies? | 21:05 |
| ianw | clarkb: np | 21:05 |
| *** bhuvan has quit IRC | 21:05 | |
| *** bhuvan_ has quit IRC | 21:06 | |
| *** paulrad has joined #openstack-infra | 21:07 | |
| *** bhuvan has joined #openstack-infra | 21:07 | |
| *** zehicle has quit IRC | 21:08 | |
| openstackgerrit | Anita Kuno proposed a change to openstack-infra/config: Directs new account requests to use the new mailing list https://review.openstack.org/116989 | 21:08 |
| *** Sukhdev has quit IRC | 21:09 | |
| pleia2 | anteaya: thanks \o/ | 21:09 |
| anteaya | thank you | 21:09 |
| anteaya | :D | 21:09 |
| *** aysyd has quit IRC | 21:10 | |
| *** dims has joined #openstack-infra | 21:10 | |
| *** dkranz has quit IRC | 21:11 | |
| *** markmcclain has quit IRC | 21:12 | |
| *** markmc has quit IRC | 21:12 | |
| lyxus | Any one running a CI here? I would like to know how do you deal with reviews that haven't been rebased | 21:15 |
| *** flaper87 is now known as flaper87|afk | 21:15 | |
| *** pballand has quit IRC | 21:15 | |
| *** e0ne has quit IRC | 21:15 | |
| *** zehicle_at_dell has joined #openstack-infra | 21:15 | |
| *** todd_dsm has joined #openstack-infra | 21:16 | |
| anteaya | lyxus: have you an example? | 21:16 |
| pleia2 | lyxus: not sure what you mean by "deal with" - I think usually the person who submitted the change handles rebasing their change | 21:17 |
| *** mdorman has quit IRC | 21:17 | |
| lyxus | anteaya, I am reading 116989, do you imply that CI owners have to keep their subscription to third-party-request ( I am already subscribed to both) | 21:17 |
| anteaya | I don't imply it, I state it | 21:18 |
| *** hogepodge has quit IRC | 21:18 | |
| anteaya | I don't scale | 21:18 |
| anteaya | and at somepoint need to be on holidays | 21:18 |
| *** paulrad has quit IRC | 21:19 | |
| *** bhuvan has quit IRC | 21:19 | |
| anteaya | if other folks, hopefully ci folks, learn to help each other, then I will just hang out a gone fishing sign and close the door | 21:19 |
| *** bhuvan has joined #openstack-infra | 21:19 | |
| clarkb | I marked https://bugs.launchpad.net/openstack-ci/+bug/1349634 incomplete beceause testing on OS X is basically impossible for me | 21:19 |
| uvirtbot | Launchpad bug 1349634 in openstack-ci "Update command not creating jobs" [Undecided,Incomplete] | 21:19 |
| lyxus | pleia2, anteaya , I have couple of reviews that haven't been rebased recently (last 3 days), some of my new tests are failing because it hasn't been rebased. Should I do a -1 and ask for rebase or 0 and ask for rebase | 21:19 |
| clarkb | if anyone has an OS X machine and wants to update that bug it would be much appreciated | 21:20 |
| *** mfer has quit IRC | 21:20 | |
| clarkb | I did give steps for doing things a bit more pythony so that we can have a common set of steps to debug | 21:20 |
| clarkb | rather than eg brew | 21:20 |
| lyxus | anteaya, it makes sense. I am ALL about helping :) | 21:20 |
| anteaya | lyxus: yes, you are very supportive | 21:21 |
| anteaya | lyxus: and I appreciate it | 21:21 |
| anteaya | thank you | 21:21 |
| jogo | pleia2: ping | 21:21 |
| pleia2 | jogo: pong | 21:21 |
| jogo | pleia2: want to learn how to add a e-r patch today? | 21:21 |
| jogo | and document it ;) | 21:21 |
| *** jistr has quit IRC | 21:21 | |
| anteaya | lyxus: can you stop testing those patches until they ahve been rebased | 21:21 |
| *** annegentle has quit IRC | 21:22 | |
| anteaya | and then as a reviewer make a comment requesting the patch be rebased? | 21:22 |
| pleia2 | jogo: how's tomorrow or a bit later? I need to convince an uber driver to take me and my cat to the vet in a few minutes (she's sick, boo) | 21:22 |
| anteaya | and you are welcome to -1 as yourself reviewing code | 21:22 |
| anteaya | lyxus: would that work? | 21:22 |
| *** cnesa7 has joined #openstack-infra | 21:23 | |
| jogo | kk | 21:23 |
| jogo | hope your cat feels better | 21:23 |
| jogo | I'll ping you tomorrow | 21:24 |
| pleia2 | jogo: I'll ping you upon my return this afternoon | 21:24 |
| pleia2 | or that | 21:24 |
| pleia2 | :) | 21:24 |
| * pleia2 goes to pack up kitty | 21:24 | |
| *** cnesa8 has quit IRC | 21:24 | |
| anteaya | good health to kitty, pleia2 | 21:24 |
| lyxus | anteaya, That's where I was going toward, however I think sending a 0 with a message like "please rebase, retrigger using XXX-ci re-check" | 21:25 |
| anteaya | ah | 21:26 |
| anteaya | please don't send a rebase message with your ci system | 21:26 |
| anteaya | post it yourself as a reviewer | 21:26 |
| *** datsun180b has joined #openstack-infra | 21:26 | |
| lyxus | anteaya, of course ! | 21:26 |
| anteaya | thanks | 21:26 |
| anteaya | and whether you vote -1 or 0 is up to you | 21:27 |
| *** hashar has quit IRC | 21:28 | |
| lyxus | anteaya, Ok, will do. | 21:28 |
| *** pdmars has quit IRC | 21:28 | |
| * anteaya goes for a walk | 21:30 | |
| *** zehicle_at_dell has quit IRC | 21:30 | |
| *** changbl has quit IRC | 21:32 | |
| *** tonytan4ever has quit IRC | 21:32 | |
| *** morganfainberg_Z is now known as morganfainberg | 21:33 | |
| dolphm | can anyone tell me the rackspace service / internal IP for static.openstack.org / logs.openstack.org? | 21:34 |
| *** Ryan_Lane1 has joined #openstack-infra | 21:34 | |
| *** Ryan_Lane has quit IRC | 21:35 | |
| zaro | fungi: could you please close out bug 1021865 too? it's tracked upstream. | 21:35 |
| uvirtbot | Launchpad bug 1021865 in openstack-ci "Gerrit should have a nicer way of reporting jenkins job status" [Wishlist,Triaged] https://launchpad.net/bugs/1021865 | 21:35 |
| *** sandywalsh has quit IRC | 21:35 | |
| *** rcarrillocruz has quit IRC | 21:36 | |
| *** mrrrgn has quit IRC | 21:36 | |
| clarkb | dolphm: why for? | 21:37 |
| *** changbl has joined #openstack-infra | 21:37 | |
| dolphm | clarkb: i'd like to build a server closer to it, to download logs faster and without consuming public IP bandwidth | 21:37 |
| clarkb | wait you can access that ip from other tenants? | 21:38 |
| *** natarajk has left #openstack-infra | 21:38 | |
| clarkb | oh right this is why the dbaas stuff isso sketchy | 21:38 |
| dolphm | clarkb: correct, service net is not secure | 21:38 |
| dolphm | clarkb: it's just the intra-dc network | 21:38 |
| clarkb | dolphm: I don't think we support the internal ip | 21:38 |
| *** rcarrillocruz has joined #openstack-infra | 21:38 | |
| clarkb | I would have to double check firewall rules | 21:38 |
| dolphm | boo | 21:38 |
| dolphm | clarkb: what's the chance it could be opened on that server if i file a bug against infra? =D | 21:39 |
| clarkb | well it may be opened I am checking however, I really don't know that we want to give people access to the private ips | 21:39 |
| clarkb | mostly because they may change and then you would be broken | 21:39 |
| *** pcm_ has quit IRC | 21:40 | |
| clarkb | (because we don't DNS them because that doesn't make sense) | 21:40 |
| clarkb | fungi: jeblair ^ thoughts? | 21:40 |
| lifeless | dolphm: do you expect a noticable perf difference? surely same region public<->public doesn't actually go over the narrow links | 21:40 |
| *** mriedem has quit IRC | 21:41 | |
| *** ominakov has quit IRC | 21:42 | |
| clarkb | lifeless: I am pretty sure we tested it at some point and throughput was about the same. But public IP costs money | 21:42 |
| clarkb | however, I am not comfortable advertising private IPs | 21:42 |
| clarkb | because there is no good way to DNS them | 21:42 |
| *** harlowja is now known as harlowja_away | 21:43 | |
| lifeless | so outbound NAT <-> public IP should be the same no? | 21:43 |
| lifeless | all dolphm needs to know is what region to put his server in? | 21:44 |
| clarkb | rax dfw | 21:44 |
| clarkb | but again there isn't any guarntee we won't just change that | 21:44 |
| openstackgerrit | Sebastien Badia proposed a change to openstack-infra/config: puppet-jobs: Pin puppet-unit-2.7 jobs to precise https://review.openstack.org/116915 | 21:45 |
| clarkb | I feel like people relying on specific implementation details of our servers is not so good | 21:45 |
| clarkb | and maybe we should be talking about making log downloads better in the general case? | 21:45 |
| clarkb | dolphm: ^ is there a specific use case you have or juts normal my job failed give me logs? | 21:45 |
| clarkb | Ryan_Lane1: https://bugs.launchpad.net/openstack-ci/+bug/1353653 FYI also feel free to point me in a direction to debug that and I will see what I can do | 21:46 |
| uvirtbot | Launchpad bug 1353653 in openstack-ci "Wiki's Youtube plugin appears broken" [Medium,Triaged] | 21:46 |
| *** emagana has quit IRC | 21:46 | |
| *** zns has quit IRC | 21:46 | |
| *** emagana has joined #openstack-infra | 21:46 | |
| *** ociuhandu has joined #openstack-infra | 21:47 | |
| *** atiwari has quit IRC | 21:48 | |
| *** emagana has quit IRC | 21:51 | |
| *** datsun180b has quit IRC | 21:51 | |
| *** paulrad has joined #openstack-infra | 21:54 | |
| *** laca has quit IRC | 21:54 | |
| clarkb | ok got through the new bugs list | 21:54 |
| *** markmcclain has joined #openstack-infra | 21:54 | |
| *** markmcclain has quit IRC | 21:54 | |
| *** oanufriev has joined #openstack-infra | 21:54 | |
| *** dims has quit IRC | 21:55 | |
| *** ramashri has quit IRC | 21:55 | |
| *** marun has quit IRC | 21:56 | |
| *** dims has joined #openstack-infra | 21:56 | |
| *** markmcclain has joined #openstack-infra | 21:56 | |
| *** praneshp has quit IRC | 21:56 | |
| *** praneshp has joined #openstack-infra | 21:57 | |
| *** praneshp has quit IRC | 21:57 | |
| *** praneshp has joined #openstack-infra | 21:57 | |
| *** laca has joined #openstack-infra | 21:58 | |
| *** otherwiseguy has quit IRC | 21:59 | |
| dolphm | lifeless: i'd expect a performance difference (granted i dont work in pub cloud and could be wrong), and there's no bandwidth charge, technically | 21:59 |
| *** harlowja_away is now known as harlowja | 22:00 | |
| dolphm | clarkb: right now my use case is "let me grep my logs" | 22:00 |
| jeblair | dolphm: i heard at one point you could expect better performance on the public network | 22:00 |
| *** ramashri has joined #openstack-infra | 22:00 | |
| *** dims has quit IRC | 22:00 | |
| *** cinerama` is now known as cinerama | 22:00 | |
| jeblair | i have not tested that recently | 22:01 |
| *** ramashri has quit IRC | 22:01 | |
| dolphm | jeblair: wow that .. sucks | 22:01 |
| *** linkid has joined #openstack-infra | 22:02 | |
| *** ominakov has joined #openstack-infra | 22:02 | |
| clarkb | jeblair: fungi pleia2 any preference for where in the bug list I jump now that the new list is empty? | 22:02 |
| jeblair | clarkb: /win 57 | 22:02 |
| jeblair | well, there's your answer :) | 22:02 |
| *** wenlock has quit IRC | 22:02 | |
| * clarkb looks for 57 | 22:03 | |
| jeblair | clarkb: i've skimmed it from top to bottom and hit a bunch of stuff, so i don't really have a demarcation point | 22:03 |
| *** ominakov has quit IRC | 22:03 | |
| clarkb | jeblair: ok | 22:03 |
| *** ominakov has joined #openstack-infra | 22:04 | |
| *** adalbas has quit IRC | 22:05 | |
| *** dane_leblanc has joined #openstack-infra | 22:05 | |
| *** alexpilotti has quit IRC | 22:06 | |
| clarkb | dolphm: https://bugs.launchpad.net/openstack-ci/+bug/1313168 doesn't seem like an infra bug to me. Wouldn't ssh key failures like that be related to the cirros node booted and the networking? | 22:08 |
| uvirtbot | Launchpad bug 1313168 in openstack-ci "paramiko ValueError: Unable to compute factors p and q from exponent d" [Medium,Triaged] | 22:08 |
| clarkb | sdague: ^ | 22:08 |
| mattoliverau | Morning | 22:09 |
| clarkb | its not an entropy issue right? calculating p and q assumes we already have a key somewhere that we are doing maths on | 22:09 |
| clarkb | mattoliverau: good morning | 22:09 |
| clarkb | mattoliverau: we are doing bug day things. https://etherpad.openstack.org/p/cibugreview-august2014 if you want to dig in | 22:10 |
| *** dane_leblanc has quit IRC | 22:10 | |
| mattoliverau | Sure :) | 22:12 |
| clarkb | jeblair: dolphm: now that recheck #bugnumber is deadish should we close https://bugs.launchpad.net/openstack-ci/+bug/1235335 ? | 22:12 |
| uvirtbot | Launchpad bug 1235335 in openstack-ci "Reject "recheck/reverify bug <the bug# being fixed>"" [Low,Triaged] | 22:12 |
| *** paulrad has quit IRC | 22:13 | |
| dolphm | clarkb: dont have an answer to your first question; and marked it invalid | 22:13 |
| *** bknudson has quit IRC | 22:13 | |
| clarkb | dolphm: it is a really odd error that I think means it got a bad ssh key from somewhere | 22:14 |
| dolphm | clarkb: i just want these kinds of recurring issues to be tracked :( even if its won't fix / cant fix / upstream issue | 22:15 |
| clarkb | dolphm: ya thats fair. I just find that infra is everyone's default location and we can't do much with them. Redirecting to groups that can actually fix the problems is what I am hoping to do | 22:15 |
| *** PsionTheory has quit IRC | 22:16 | |
| clarkb | we almost need a way to submit bugs aginst The Entire Thing as a giant unclassified bug queue. Then different projects can grab at it | 22:16 |
| dolphm | clarkb: understood. if i dont know the more specific team, i hope that -infra does :) | 22:16 |
| dolphm | dedicated LP project? | 22:17 |
| clarkb | dolphm: maybe? we are gettingclose to switching to storyboard so maybe we can figure out something good there | 22:17 |
| dolphm | openstack-unhandled | 22:18 |
| *** dane_leblanc has joined #openstack-infra | 22:18 | |
| clarkb | fungi: have we had any luck diagnosing https://bugs.launchpad.net/openstack-ci/+bug/1282795 type failures with the extra debugging info we have added? | 22:19 |
| uvirtbot | Launchpad bug 1282795 in openstack-ci "InterpreterNotFound: python2.6" [Low,Confirmed] | 22:19 |
| *** [1]m1dev has joined #openstack-infra | 22:21 | |
| *** esker has quit IRC | 22:22 | |
| *** signed8b_ has joined #openstack-infra | 22:22 | |
| *** esker has joined #openstack-infra | 22:22 | |
| *** vhoward- has joined #openstack-infra | 22:22 | |
| *** vhoward has quit IRC | 22:22 | |
| *** abramley has quit IRC | 22:22 | |
| *** abramley_ has joined #openstack-infra | 22:22 | |
| *** signed8bit has quit IRC | 22:22 | |
| *** abramley_ is now known as abramley | 22:23 | |
| *** Hefeweizen has quit IRC | 22:23 | |
| *** s0nea has quit IRC | 22:23 | |
| *** rfolco has quit IRC | 22:23 | |
| *** tristanC has quit IRC | 22:23 | |
| *** ubuntu3 has quit IRC | 22:23 | |
| *** timrc has quit IRC | 22:23 | |
| *** GheRivero has quit IRC | 22:23 | |
| *** m1dev has quit IRC | 22:23 | |
| *** prad has quit IRC | 22:23 | |
| *** bhuvan_ has joined #openstack-infra | 22:23 | |
| *** s0nea_ has joined #openstack-infra | 22:23 | |
| *** [1]m1dev is now known as m1dev | 22:24 | |
| *** s0nea_ is now known as s0nea | 22:24 | |
| *** GheRivero has joined #openstack-infra | 22:24 | |
| *** tristanC has joined #openstack-infra | 22:24 | |
| *** ubuntu3 has joined #openstack-infra | 22:24 | |
| *** timrc has joined #openstack-infra | 22:24 | |
| *** Hefeweizen has joined #openstack-infra | 22:24 | |
| *** jlk_clone has joined #openstack-infra | 22:24 | |
| *** rfolco has joined #openstack-infra | 22:24 | |
| fungi | clarkb: yeah, late back to the party here, but i too have been skimming/random hit-and-run on the list | 22:25 |
| *** chuck_ has joined #openstack-infra | 22:25 | |
| *** slagle_ has joined #openstack-infra | 22:25 | |
| fungi | also we should convince the aussies to take over the bug day now that it's getting lateish on this end of the rock | 22:26 |
| *** bhuvan has quit IRC | 22:26 | |
| *** MmikeM has joined #openstack-infra | 22:26 | |
| *** esker has quit IRC | 22:26 | |
| *** mmedvede has quit IRC | 22:26 | |
| fungi | dolphm: clarkb: a dedicated lp project for "i don't know whose bug this is" might as well be called "bitbucket" | 22:27 |
| *** hogepodge has joined #openstack-infra | 22:27 | |
| *** spiffxp- has joined #openstack-infra | 22:27 | |
| openstackgerrit | Clark Boylan proposed a change to openstack-infra/jenkins-job-builder: Handle utf8 in JJB XML output https://review.openstack.org/117041 | 22:27 |
| fungi | nobody will probably look at it, except qa people who aren't yet burned out (if there are any of those left now) | 22:27 |
| mattoliverau | Well I'm happy to work my way through, josh is on leave (here in Melbourne) so I'll complain to him about missing bug day then :) | 22:27 |
| clarkb | I got nerd sniped by fixing ^ I supposed I should add a test for that | 22:28 |
| *** AaronGreen has joined #openstack-infra | 22:28 | |
| clarkb | fungi: ya that is my worry | 22:28 |
| clarkb | mattoliverau: wait he is on leave and visiting you? | 22:28 |
| mattoliverau | *at lunch, I meant, man I think I need coffee | 22:28 |
| clarkb | mattoliverau: you should throw work at him for being silly enough to be in melbourne :) | 22:28 |
| fungi | clarkb: i should revisit the "interpreter not found" logstash queries now--thanks for the reminder | 22:28 |
| clarkb | fungi: np | 22:29 |
| mattoliverau | He's visiting Melbourne and have organized a lunch with josh me and richard | 22:29 |
| clarkb | always happy to give other people work >_> | 22:29 |
| mattoliverau | Lol will do ;) | 22:29 |
| *** tsufiev has quit IRC | 22:29 | |
| *** tsufiev_ has joined #openstack-infra | 22:29 | |
| mattoliverau | Its called delegating :) | 22:30 |
| *** AlecTaylor has joined #openstack-infra | 22:31 | |
| *** AlecTaylor has quit IRC | 22:31 | |
| *** AlecTaylor has joined #openstack-infra | 22:31 | |
| *** uvirtbot` has joined #openstack-infra | 22:32 | |
| *** stevemar has quit IRC | 22:32 | |
| *** sballe_ has joined #openstack-infra | 22:32 | |
| fungi | clarkb: heisenbug. a search on logstash for message:"InterpreterNotFound:" AND tags:console over the past 7 days returns "No events matched" | 22:32 |
| fungi | (am i doing it wrong?) | 22:33 |
| *** klindgren_ has joined #openstack-infra | 22:33 | |
| *** gokrokve_ has joined #openstack-infra | 22:33 | |
| *** _buzz_ has joined #openstack-infra | 22:33 | |
| clarkb | fungi: earch for yum and rpm not found | 22:34 |
| *** dtantsur_ has joined #openstack-infra | 22:34 | |
| clarkb | and no that looks like the way to do it | 22:34 |
| clarkb | maybe drop the : from your message query? | 22:34 |
| clarkb | but quotes should escape the : and you have quotes | 22:34 |
| *** garyh_ has joined #openstack-infra | 22:34 | |
| fungi | clarkb: does it substring match without a wildcard there even if it's not a space-separated string | 22:34 |
| fungi | ? | 22:35 |
| *** gaelL_ has joined #openstack-infra | 22:35 | |
| fungi | but anyway, no difference | 22:35 |
| *** DuncanT- has joined #openstack-infra | 22:35 | |
| fungi | 0 hits | 22:35 |
| *** unicell1 has joined #openstack-infra | 22:35 | |
| dolphm | fungi: ha for some bugs thats fine. we need to recheck against wont fix / cant fix too | 22:35 |
| fungi | dolphm: yep, it was just a really infuriating bug and now that we've got extra debug info/logging added it's not happening any longer | 22:36 |
| *** gondoi is now known as zz_gondoi | 22:36 | |
| *** todd_dsm has quit IRC | 22:36 | |
| *** marcoemorais has quit IRC | 22:36 | |
| fungi | which is doubly infuriating | 22:36 |
| *** marcoemorais has joined #openstack-infra | 22:36 | |
| *** ildikov_ has joined #openstack-infra | 22:36 | |
| *** zz_gondoi is now known as gondoi | 22:36 | |
| fungi | dolphm: oh, you meant the bitbucket catch-all project comment | 22:36 |
| *** pbelanyi_ has joined #openstack-infra | 22:36 | |
| *** sballe__ has quit IRC | 22:36 | |
| * fungi is bad at context switching | 22:36 | |
| *** david-ly_ has joined #openstack-infra | 22:36 | |
| *** Tailor has joined #openstack-infra | 22:37 | |
| *** praneshp_ has joined #openstack-infra | 22:37 | |
| *** nibalize1 has joined #openstack-infra | 22:37 | |
| *** andreykurilin_ has joined #openstack-infra | 22:37 | |
| *** TheJulia_ has joined #openstack-infra | 22:37 | |
| *** NobodyCa1 has joined #openstack-infra | 22:37 | |
| *** wenlock has joined #openstack-infra | 22:37 | |
| dolphm | fungi: sorry i have bad reply latency :) | 22:37 |
| *** e0ne has joined #openstack-infra | 22:37 | |
| *** jamespd_ has joined #openstack-infra | 22:37 | |
| *** zul has quit IRC | 22:37 | |
| *** ianw has quit IRC | 22:37 | |
| *** mrda has quit IRC | 22:37 | |
| *** slagle has quit IRC | 22:37 | |
| *** dmitryme has quit IRC | 22:37 | |
| *** skraynev has quit IRC | 22:37 | |
| *** uvirtbot has quit IRC | 22:37 | |
| *** jlk has quit IRC | 22:37 | |
| *** Mmike has quit IRC | 22:37 | |
| *** AaronGr has quit IRC | 22:37 | |
| *** dtantsur has quit IRC | 22:37 | |
| *** spiffxp_ has quit IRC | 22:37 | |
| *** pbelanyi has quit IRC | 22:37 | |
| *** rainya_ has quit IRC | 22:37 | |
| *** dtantsur_ is now known as dtantsur | 22:37 | |
| *** gema has joined #openstack-infra | 22:38 | |
| *** Shrews_ has joined #openstack-infra | 22:38 | |
| fungi | conflicts with my leaky brain cache | 22:38 |
| *** e0ne has quit IRC | 22:38 | |
| *** ianw has joined #openstack-infra | 22:38 | |
| *** david-lyle has quit IRC | 22:38 | |
| *** praneshp has quit IRC | 22:39 | |
| *** praneshp_ is now known as praneshp | 22:39 | |
| *** AlecTaylor has quit IRC | 22:39 | |
| fungi | clarkb: i did revisit the missing yum query earlier today too and no hits since early utc on the 23rd so may also have worked its way out of the stale image cache in dfw, or whatever is going on there | 22:39 |
| *** mattymo has quit IRC | 22:40 | |
| *** ildikov has quit IRC | 22:40 | |
| *** radez_g0` has joined #openstack-infra | 22:40 | |
| *** mattymo has joined #openstack-infra | 22:40 | |
| *** vipuls has joined #openstack-infra | 22:41 | |
| *** sballe_ has quit IRC | 22:41 | |
| clarkb | lifeless: using testtools DocTestMatches matcher fails on unicode string in python2.7. Do you know what I am doing wrong? | 22:41 |
| clarkb | or are all docstrings in python assumed to be real strings and this won't work? | 22:41 |
| *** yolanda_ has joined #openstack-infra | 22:41 | |
| *** dmitryme has joined #openstack-infra | 22:41 | |
| *** ociuhandu_ has joined #openstack-infra | 22:41 | |
| *** mrodden_ has joined #openstack-infra | 22:41 | |
| *** maurosr has quit IRC | 22:42 | |
| *** Alex_Gaynor has quit IRC | 22:42 | |
| *** skath_ has quit IRC | 22:42 | |
| *** pabelanger has quit IRC | 22:42 | |
| *** pabelanger_ has joined #openstack-infra | 22:42 | |
| *** ociuhandu has quit IRC | 22:43 | |
| *** ociuhandu_ is now known as ociuhandu | 22:43 | |
| *** slagle_ has quit IRC | 22:43 | |
| *** garyh has quit IRC | 22:43 | |
| *** gokrokve has quit IRC | 22:43 | |
| *** gema_ has quit IRC | 22:43 | |
| *** sdake_ has quit IRC | 22:43 | |
| *** unicell has quit IRC | 22:43 | |
| *** klindgren has quit IRC | 22:43 | |
| *** eharney has quit IRC | 22:43 | |
| *** ZZelle has quit IRC | 22:43 | |
| *** Shrews has quit IRC | 22:43 | |
| *** krtaylor has quit IRC | 22:43 | |
| *** openstackgerrit has quit IRC | 22:43 | |
| *** _buzz has quit IRC | 22:43 | |
| *** vipul has quit IRC | 22:43 | |
| *** nibalizer has quit IRC | 22:43 | |
| *** proffalken has quit IRC | 22:43 | |
| *** radez_g0n3 has quit IRC | 22:43 | |
| *** mrodden has quit IRC | 22:43 | |
| *** TheJulia has quit IRC | 22:43 | |
| *** NobodyCam has quit IRC | 22:43 | |
| *** gaelL has quit IRC | 22:43 | |
| *** jamespd has quit IRC | 22:43 | |
| *** jd__ has quit IRC | 22:43 | |
| *** DuncanT has quit IRC | 22:43 | |
| *** laxity has quit IRC | 22:43 | |
| *** jd__ has joined #openstack-infra | 22:43 | |
| clarkb | looking int testtools it seems to try and make unicode work | 22:43 |
| *** dkehn has quit IRC | 22:43 | |
| *** chmouel_ has quit IRC | 22:43 | |
| *** asadoughi has quit IRC | 22:43 | |
| *** greghaynes has quit IRC | 22:43 | |
| *** dansmith has quit IRC | 22:43 | |
| *** devananda has quit IRC | 22:43 | |
| *** [1]m1dev has joined #openstack-infra | 22:43 | |
| *** vipuls is now known as vipul | 22:43 | |
| *** mrodden_ is now known as mrodden | 22:43 | |
| *** devananda has joined #openstack-infra | 22:43 | |
| *** asadoughi has joined #openstack-infra | 22:43 | |
| *** eharney_ has joined #openstack-infra | 22:43 | |
| *** Tailor has quit IRC | 22:43 | |
| *** yolanda has quit IRC | 22:43 | |
| *** chmouel has joined #openstack-infra | 22:43 | |
| *** greghaynes has joined #openstack-infra | 22:43 | |
| *** proffalk1n has joined #openstack-infra | 22:43 | |
| lifeless | clarkb: what does the failure look like? | 22:43 |
| *** mattymo has quit IRC | 22:43 | |
| *** dansmith- has joined #openstack-infra | 22:43 | |
| *** dansmith- is now known as dansmith | 22:43 | |
| *** garyh_ is now known as garyh | 22:44 | |
| *** skath_ has joined #openstack-infra | 22:44 | |
| *** mattymo has joined #openstack-infra | 22:44 | |
| *** sballe has joined #openstack-infra | 22:44 | |
| *** dkehn_ has joined #openstack-infra | 22:44 | |
| *** krtaylor has joined #openstack-infra | 22:44 | |
| *** dguerri has quit IRC | 22:44 | |
| *** Alex_Gaynor has joined #openstack-infra | 22:44 | |
| *** dansmith is now known as Guest61572 | 22:44 | |
| *** sdake_ has joined #openstack-infra | 22:44 | |
| *** dguerri has joined #openstack-infra | 22:44 | |
| *** maurosr has joined #openstack-infra | 22:45 | |
| *** vladan has quit IRC | 22:45 | |
| clarkb | lifeless: http://paste.openstack.org/show/100697/ | 22:45 |
| clarkb | lifeless: I am trying to match two documents with snowman in them | 22:45 |
| *** vladan has joined #openstack-infra | 22:45 | |
| *** ZZelle has joined #openstack-infra | 22:45 | |
| mgagne | clarkb: looks like uninstall puppet wasn't enough, we also need to uninstall puppet-common =( | 22:46 |
| clarkb | mgagne: should we move forward with pinning on precise instead? | 22:46 |
| Ryan_Lane1 | clarkb: hm. it looks like the iframes are being embedded | 22:46 |
| mgagne | clarkb: yes, I guess we will get faster results | 22:46 |
| *** HenryG has quit IRC | 22:46 | |
| *** ramashri has joined #openstack-infra | 22:47 | |
| *** m1dev has quit IRC | 22:47 | |
| *** [1]m1dev is now known as m1dev | 22:47 | |
| *** skraynev has joined #openstack-infra | 22:47 | |
| pleia2 | ok, back from cat adventure (all is well) | 22:47 |
| fungi | it's a Ryan_Lane1! glad to see you weren't shaken apart by seismic activity | 22:48 |
| *** NobodyCa1 is now known as NobodyCam | 22:48 | |
| *** flaper87|afk has quit IRC | 22:48 | |
| *** flaper87|afk has joined #openstack-infra | 22:48 | |
| Ryan_Lane1 | :) | 22:48 |
| Ryan_Lane1 | fungi: thanks | 22:48 |
| clarkb | I managed to abort all but one of those jobs associated to the broken neutron change | 22:48 |
| Ryan_Lane1 | yeah, I got woken up | 22:48 |
| Ryan_Lane1 | but it wasn't too bad | 22:48 |
| clarkb | hopefully I can catch that last job and abort it too so that we stop cycling on it | 22:48 |
| fungi | clarkb: agreed. i've been playing whack-a-jenkins with those throughout the day | 22:49 |
| fungi | one of us will quell it | 22:49 |
| *** marun has joined #openstack-infra | 22:49 | |
| fungi | just in time for the author to rebase it or upload another commit message edit | 22:50 |
| *** gondoi is now known as zz_gondoi | 22:50 | |
| clarkb | lifeless: unless is self.want.__class__(actual) failing because actual is utf8 bytes and want is string? | 22:50 |
| clarkb | lifeless: or is it failing because the coercion there only works if you provide an encoding? | 22:50 |
| Ryan_Lane1 | ah | 22:50 |
| Ryan_Lane1 | this is an issue with mixed content | 22:51 |
| Ryan_Lane1 | firefox blocks mixed content by default now | 22:51 |
| fungi | "mixed content" | 22:51 |
| fungi | isn't the point of the world wide web that it has mixed content? | 22:51 |
| Ryan_Lane1 | I'd imagine that it's the same problem in chrome too | 22:52 |
| Ryan_Lane1 | mixed content is http content being loaded on an https page | 22:52 |
| fungi | ohhh... "mixed content" means "multi-protocol (http+https)" | 22:52 |
| fungi | yep | 22:52 |
| clarkb | lifeless: a quick check shows that want.__class__(actual) should work if both are unicode strings | 22:52 |
| *** jgrimm is now known as zz_jgrimm | 22:52 | |
| fungi | just found an explanation of it on a web page with slightly less mixed content | 22:52 |
| Ryan_Lane1 | I may fork the extension and fix the issue | 22:54 |
| *** sballe has quit IRC | 22:54 | |
| *** Ryan_Lane1 is now known as Ryan_LAne | 22:54 | |
| *** Ryan_LAne has joined #openstack-infra | 22:54 | |
| *** Ryan_LAne is now known as Ryan_Lane | 22:54 | |
| fungi | apparently https content on an http page is not deemed mixed content, just the other way 'round? | 22:54 |
| Ryan_Lane | yes | 22:54 |
| *** dtantsur has quit IRC | 22:55 | |
| *** dtantsur has joined #openstack-infra | 22:55 | |
| *** DuncanT- has quit IRC | 22:55 | |
| *** DuncanT- has joined #openstack-infra | 22:55 | |
| *** pbelanyi_ has quit IRC | 22:55 | |
| *** pbelanyi_ has joined #openstack-infra | 22:55 | |
| *** praneshp has quit IRC | 22:55 | |
| *** praneshp has joined #openstack-infra | 22:55 | |
| fungi | so if we can just rewrite all the youtube urls to https... ;) | 22:55 |
| *** wenlock has quit IRC | 22:55 | |
| *** wenlock has joined #openstack-infra | 22:55 | |
| Ryan_Lane | http content in an https session degrades the security of the session | 22:55 |
| JayF | yeah the premise being; you tell someone it's secure in the address bar that it had better be secure | 22:55 |
| *** ianw has quit IRC | 22:55 | |
| *** ianw has joined #openstack-infra | 22:55 | |
| Ryan_Lane | fungi: the extension writes the URLs | 22:55 |
| JayF | but http:// gives no such promise so it's just bonus if you've got ssl | 22:55 |
| *** radez_g0` has quit IRC | 22:55 | |
| *** radez_g0` has joined #openstack-infra | 22:55 | |
| oanufriev | hi. is this a normal case in zuul? http://status.openstack.org/zuul/ | 22:55 |
| *** skath_ has quit IRC | 22:56 | |
| *** skath_ has joined #openstack-infra | 22:56 | |
| fungi | Ryan_Lane: yeah, i assumed as much, or else you wouldn't have waved around the forking solution | 22:56 |
| *** maurosr has quit IRC | 22:56 | |
| *** maurosr has joined #openstack-infra | 22:56 | |
| Ryan_Lane | :) | 22:56 |
| Ryan_Lane | it's actually a pretty easy fix | 22:56 |
| Ryan_Lane | I actually wonder if protocol relative URLs would work for this | 22:56 |
| fungi | oanufriev: depends on what your sample size is. if you're talking about normal at some point in openstack's integrated release development cycle, then yes this is more or less normal for feature (proposal) freeze | 22:57 |
| clarkb | lifeless: oh I get it, one side is a processed bytestring the other is python unicode | 22:57 |
| clarkb | lifeless: yup that was it | 22:57 |
| fungi | oanufriev: our providers have some ongoing issues which are impacting our test throughput as well, but this is mostly just a problem of volume | 22:57 |
| oanufriev | fungi oh, thanks | 22:57 |
| lifeless | clarkb: so """foo bar baz""" is a bytestring in python 2.x | 22:57 |
| lifeless | clarkb: unless you use unicode literals | 22:58 |
| lifeless | clarkb: which we can do, if we've stopped caring about2.6 | 22:58 |
| *** flaviof_zzz is now known as flaviof | 22:58 | |
| Ryan_Lane | yep. protocol relative links will work | 23:00 |
| Ryan_Lane | I'll fix this tonight. it should be really easy | 23:00 |
| fungi | Ryan_Lane: thanks a bunch! | 23:00 |
| ZZelle | clarkb, hi | 23:00 |
| Ryan_Lane | yw | 23:00 |
| ZZelle | clarkb, is gerrit 2.9 in openstack-infra roadmap? | 23:01 |
| jogo | hmm how come our pypi mirror doesn't have flake8 2.2.3 http://pypi.openstack.org/simple/flake8/ | 23:01 |
| jogo | it was added yesterday | 23:01 |
| jogo | to pypi.python | 23:01 |
| pleia2 | jogo: I'm around for the foreseeable future | 23:01 |
| fungi | jogo: bandersnatch is likely stuck again... looking now | 23:02 |
| jogo | fungi: thanks | 23:02 |
| jogo | pleia2: excellent can we punt to tomorrow | 23:02 |
| pleia2 | jogo: yep | 23:02 |
| fungi | jogo: yep, stuck since some time on the 24th | 23:02 |
| jogo | I am in the middle of a heated containers debate | 23:02 |
| pleia2 | goodie! | 23:02 |
| fungi | jogo: make sure to vent your containers when heating, to avoid unwanted explosions | 23:02 |
| jogo | fungi: hehe that works on so many levels | 23:02 |
| clarkb | lifeless: nah I am just forcing everything to bytestring using encode | 23:02 |
| clarkb | lifeless: its good enough | 23:03 |
| jogo | we just need a openstack project called vent now | 23:03 |
| fungi | jogo: i'll make one called 'splosions | 23:03 |
| lifeless | vent, I like it | 23:03 |
| JayF | jogo: serenity now | 23:03 |
| *** dustins has quit IRC | 23:03 | |
| fungi | jogo: or mayve asplode | 23:03 |
| *** david-ly_ is now known as david-lyle | 23:04 | |
| jogo | fungi: let me know when bandersnatch is up again so I can run the recheck | 23:04 |
| pleia2 | fungi: well, "infrastructure" really should have a code name... | 23:04 |
| *** mrda has joined #openstack-infra | 23:04 | |
| fungi | jogo: it'll be a few minutes... i'm trying to collect some semblance of state information about the current hung process | 23:04 |
| jogo | fungi: excellent | 23:04 |
| lifeless | clarkb: can I get a +2 on https://review.openstack.org/#/c/116775/ ? | 23:05 |
| *** andreykurilin_ has quit IRC | 23:06 | |
| *** alexpilotti has joined #openstack-infra | 23:06 | |
| clarkb | lifeless: did the test you added for the thing we talked about last night actually test the thing I wanted tested? | 23:06 |
| clarkb | lifeless: looks like its the same as the other test with the missing trailing 0 | 23:06 |
| fungi | jogo: yep, it's the usual known cause... "TooManyRedirects: Exceeded 30 redirects." seems "Coinbridge" was renamed to "coinbridge" and we tried to sync that update at 2014-08-24 14:55:03 but ran afoul of an infinite redirect loop between pypi.python.org and their fastly cdn. it should have expired by now so restarting it ought to fix | 23:06 |
| clarkb | pleia2: yes! we should call infra "mantle" or some other foundation of a thing thing | 23:07 |
| fungi | jogo: however i probably should open a bitbucket issue against bandersnatch about how it fails to terminate under these conditions | 23:07 |
| *** markmcclain has quit IRC | 23:07 | |
| pleia2 | clarkb: I was voting for 'splosions :) | 23:07 |
| fungi | pleia2: i think i prefer "asplodey" | 23:08 |
| pleia2 | hehe | 23:08 |
| lifeless | clarkb: I don't understand what you mean | 23:08 |
| lifeless | clarkb: we had two discrete failures reported | 23:08 |
| clarkb | lifeless: 2.1.0.0rc1 | 23:08 |
| lifeless | clarkb: 2.1.0.rc1 | 23:08 |
| clarkb | vs 2.1.0.rc1 | 23:08 |
| lifeless | clarkb: and 0.0.1a2 | 23:08 |
| clarkb | you are testing 2.1.0.rc1 we want to test 2.1.0.0rc1 | 23:08 |
| lifeless | no we don't | 23:09 |
| clarkb | but its in your commit message... | 23:09 |
| lifeless | 2.1.0.0rc1 is already tested | 23:09 |
| clarkb | it is? | 23:09 |
| lifeless | test_rc_version | 23:09 |
| lifeless | self.assertEqual(semver, from_pip_string("1.2.4.0rc1")) | 23:09 |
| lifeless | the test we need added was the non-canonical form x.y.z.$prerelease$serial | 23:10 |
| lifeless | which is added | 23:10 |
| lifeless | we also needed x.y.z$prerelease$serial which I added | 23:11 |
| clarkb | ok so the commit message was just confusing me | 23:11 |
| lifeless | and I added x.y forms as well | 23:11 |
| lifeless | I mean, I can add more tests, but none proposed so far seem to add coverage | 23:11 |
| *** ianw has quit IRC | 23:12 | |
| *** ianw has joined #openstack-infra | 23:12 | |
| lifeless | dhellmann-phone: clarkb: can I get a +2 each on https://review.openstack.org/#/c/108269/ ? | 23:13 |
| clarkb | lifeless: ya I was just confused by the commit message | 23:13 |
| clarkb | lifeless: the commit message calls out a specific case then ignores it best I can tell | 23:14 |
| lifeless | clarkb: huh? | 23:14 |
| lifeless | clarkb: left side in the commit message is the input | 23:14 |
| lifeless | clarkb: right side is the canonical form | 23:14 |
| clarkb | lifeless: but your canonical form is different | 23:14 |
| lifeless | clarkb: test_from_pip_string_legacy_no_0_prerelease tests the input | 23:14 |
| clarkb | 0rc1 != rc1 | 23:15 |
| lifeless | clarkb: from_pip_string doesn't take canonical form, its takes dogsbreakfast | 23:15 |
| lifeless | clarkb: of course, because testing canonical form as input isn't interesting. | 23:15 |
| lifeless | clarkb: we need to test the bad data. | 23:15 |
| lifeless | clarkb: which the test does | 23:16 |
| clarkb | I get that, it just seems like the canonical form isn't actually reprsented in the test for 2.1.0.rc1 | 23:16 |
| lifeless | clarkb: what do you mean represented? | 23:16 |
| lifeless | clarkb: are you asking me to serialise expected, and then compare the strings? | 23:17 |
| *** dmellado has quit IRC | 23:17 | |
| clarkb | I mean you are doing an assert that input 2.1.0.rc1 comes out as 2.1.0.0rc1 except we aren't checking that | 23:17 |
| clarkb | instead we are checking internal representations | 23:17 |
| lifeless | e.g. assertEqual("2.1.0.0rc1", parsed.release_string()) | 23:17 |
| clarkb | lifeless: maybe that is what I need | 23:17 |
| lifeless | we're checking the object is equal | 23:17 |
| clarkb | lifeless: right but its just implicit that the object you contruct is equivalent to 2.1.0.0rc1 | 23:18 |
| lifeless | clarkb: its explicit actually | 23:18 |
| lifeless | clarkb: that is the contract | 23:18 |
| lifeless | clarkb: and we've got lots of tests covering that | 23:18 |
| lifeless | clarkb: e.g. test_rc_version | 23:18 |
| clarkb | its not explicit in the test that was written to check that 2.1.0.rc1 becomes 2.1.0.0rc1 | 23:18 |
| lifeless | thats not what the test was written to check | 23:19 |
| clarkb | then why is it in the commit message... | 23:19 |
| clarkb | I think if you didn't specifically call that out in the commit message I wouldn't care | 23:19 |
| lifeless | it was written to check that we can parse 2.1.0.rc1 As major=2, minor=1, patch=1 prerelease_type=rc prerelease=1 | 23:19 |
| clarkb | but the commit message says check X to Y and we don't do that | 23:19 |
| lifeless | which has a canonical form of 2.1.0.0rc1 | 23:19 |
| lifeless | clarkb: thats not what the commit message says; it says what the canonical form is - it was intended for clarity. | 23:20 |
| lifeless | clarkb: nowhere in the commit message does it say 'equal' or 'check' or ... | 23:20 |
| fungi | jogo: the mirror just pulsed and now you have flake8 2.2.3 available to you there | 23:21 |
| jogo | fungi: woot | 23:23 |
| lifeless | clarkb: but honestly, I have no interest in arguing. Tell me what would help you understand the commit message and I'll reword it. | 23:23 |
| lifeless | clarkb: I don't think the test is wrong; I think its entirely appropriate to compare the object representations not the strings | 23:23 |
| clarkb | lifeless: we have called out specific version mappings that were unhandled. This change handles those cases and tests them. But it isn't clear in the test that we are actually testing that. I would argue that the contract could be changed in such a way that we no longer test that version any longer (by updating the transitive tests that cover this but not updating the test I would like to see | 23:24 |
| clarkb | updated) | 23:24 |
| clarkb | lifeless: mostly its about sanity for the reviewer. we call out X to Y. We don't clearly test it | 23:24 |
| lifeless | clarkb: so I put Y in there for reviewers. | 23:24 |
| *** dmellado has joined #openstack-infra | 23:24 | |
| lifeless | I can remove it. | 23:24 |
| lifeless | clarkb: I disagree with your point about contract | 23:25 |
| lifeless | clarkb: if we change the contract to alter parsing, it will fail this test. | 23:25 |
| lifeless | clarkb: if we change the contract to alter serialisation, it should not fail this test because the object identity isn't changed. | 23:25 |
| lifeless | clarkb: that has no dependencies on other tests. | 23:26 |
| lifeless | for instance, if we said that we were making the canonical form be x.y.z.rc1, this test doesn't and should not change. | 23:26 |
| lifeless | because the 0 in 0rc1 is not semantic - its not part of the object model | 23:26 |
| lifeless | and thats why I *don't want* to compare strings there. | 23:26 |
| clarkb | how is it not semantic? if it wasn't we could just leave it out... | 23:27 |
| lifeless | clarkb: its syntactic | 23:27 |
| clarkb | it has meaning otherweise we wouldn't be doing all of this work to ensure its there | 23:27 |
| *** changbl has quit IRC | 23:27 | |
| clarkb | lifeless: why can't we just accept .rc1 then? | 23:27 |
| lifeless | clarkb: this patch means we can | 23:27 |
| *** dangers is now known as dangers_away | 23:27 | |
| lifeless | clarkb: the semver blueprint says that x.y.z.0rc1 is how we'll notate pre-release versions | 23:28 |
| lifeless | and it says that because of a) for a bit pep-440 was saying it had to have it that way (thats changed) and b) we had consensus that this way is aesthetically more aligned with upstream semver | 23:29 |
| jeblair | i'm seeing some very weird virtualenv/pip behavior, where installation succeeds or fails depending on where in the filesystem the virtualenv is | 23:30 |
| jeblair | http://paste.openstack.org/show/100705/ and http://paste.openstack.org/show/100709/ | 23:30 |
| jeblair | installation works unless the venv is installed into /usr/local/ | 23:31 |
| lifeless | jeblair: see the path transform? | 23:31 |
| jeblair | lifeless: yep | 23:31 |
| lifeless | jeblair: /usr/local -> /usr | 23:31 |
| jeblair | lifeless: seems crucial, but no idea why that would have happened | 23:31 |
| lifeless | easy_install being evil I suspect | 23:32 |
| lifeless | looking at get_prefixes stuff | 23:32 |
| lifeless | mrda: ping | 23:33 |
| lifeless | bah | 23:33 |
| *** bdpayne has quit IRC | 23:33 | |
| *** bdpayne has joined #openstack-infra | 23:34 | |
| jeblair | dstufft: ^ does that make any sense to you? | 23:35 |
| jeblair | should that even be running easy_install? | 23:35 |
| jeblair | i don't actually know what our expectation is around that for pbr-based projects at the moment | 23:36 |
| anteaya | how do I change the status of this bug to closed? https://bugs.launchpad.net/openstack-ci/+bug/1263121 | 23:37 |
| uvirtbot` | Launchpad bug 1263121 in openstack-ci "Gerrit external testing tools should have consistent names" [Medium,Confirmed] | 23:37 |
| *** pcm has joined #openstack-infra | 23:37 | |
| jeblair | anteaya: set the status to fix-released | 23:37 |
| *** bknudson has joined #openstack-infra | 23:37 | |
| dstufft | jeblair: does appear to be anything i know of off the top of my head | 23:37 |
| dstufft | doesn't* | 23:37 |
| anteaya | jeblair: k, thanks | 23:37 |
| jeblair | anteaya: and if you can't do that, join https://launchpad.net/~openstack-ci-bugs :) | 23:38 |
| lifeless | clarkb: so, updated the commit message. | 23:39 |
| jeblair | dstufft: where should i file a bug report? | 23:40 |
| *** ociuhandu has quit IRC | 23:40 | |
| *** linkid has left #openstack-infra | 23:40 | |
| dstufft | jeblair: can you reproduce? | 23:40 |
| fungi | jeblair: are you using a debuntu platform or a redbox? | 23:40 |
| jeblair | dstufft, fungi: easily reproducible on precise | 23:41 |
| dstufft | jeblair: probably should be filed on pip, it might be a birtualenv prob tho but if it is it's the same people so it's OK | 23:41 |
| pleia2 | fungi: oh! I'm flying to Debconf late tomorrow afternoon, CI things happening Thursday: https://launchpad.net/~openstack-ci-bugs | 23:41 |
| pleia2 | err | 23:41 |
| pleia2 | https://summit.debconf.org/debconf14/track/validation-ci/ | 23:41 |
| pleia2 | laggy paste buffer | 23:42 |
| jeblair | dstufft: okay, i'll see if i can reduce the test case a little more, then file. thanks | 23:42 |
| fungi | pleia2: i'm very excited--keep me apprised and sorry i'm not going to be there myself to pitch in | 23:42 |
| pleia2 | fungi: will do | 23:42 |
| dstufft | lifeless: clarkb I have a library that is the reference implementation for parsing PEP 440 versions fwiw | 23:43 |
| dstufft | it has a ton of tests | 23:43 |
| dstufft | it's apache2 licensed, you can steal the version parsing from it if you wan | 23:43 |
| dstufft | want | 23:43 |
| dstufft | https://github.com/pypa/packaging/blob/master/packaging/version.py | 23:43 |
| lifeless | dstufft: may do, thanks. | 23:43 |
| dstufft | https://packaging.pypa.io/en/latest/version/ docs | 23:44 |
| dstufft | it's a pretty good bet we'll be ending up using this in pip, and maybe setuptools, fwiw | 23:44 |
| anteaya | jeblair: I could do that | 23:45 |
| anteaya | and I joined | 23:46 |
| anteaya | jeblair: mind approving pleia2 and myself? | 23:46 |
| anteaya | we are pending approval | 23:46 |
| pleia2 | Ending bug day count: 233 | 23:46 |
| pleia2 | nice work :) started with 270 | 23:46 |
| anteaya | pleia2: good work | 23:46 |
| *** chuckC has quit IRC | 23:47 | |
| anteaya | pleia2: and the summit url needs a cert | 23:47 |
| fungi | pleia2: anteaya: done | 23:47 |
| anteaya | fungi: thanks | 23:47 |
| pleia2 | 4 of them were just moved to zuul, ssh | 23:47 |
| r1chardj0n3s | jeblair: could be the debuntu /local/ path hackery in the virtualenv falling about laughing - perhaps check in the virtualenv that any .../local/... symlinks are correct? | 23:47 |
| pleia2 | thanks fungi | 23:47 |
| r1chardj0n3s | jeblair: ... given that it's the "local" case that's failing | 23:48 |
| anteaya | hey r1chardj0n3s | 23:48 |
| r1chardj0n3s | hiya anteaya | 23:48 |
| fungi | r1chardj0n3s: that's what i was wondering but was trying to work out how to nail down for sure | 23:48 |
| r1chardj0n3s | fungi: I'd just poke around the created venv to make sure all the symlinks actually work | 23:48 |
| fungi | makes sense | 23:49 |
| r1chardj0n3s | 'cos I suspect that the might not have anticipated someone creating a venv inside /usr/local | 23:49 |
| r1chardj0n3s | maybe | 23:49 |
| r1chardj0n3s | or it's just a dumb bug ;) | 23:49 |
| r1chardj0n3s | clarkb: are you up for working through that pip-missing-reqs change? | 23:49 |
| *** pballand has joined #openstack-infra | 23:50 | |
| *** marun has quit IRC | 23:52 | |
| clarkb | r1chardj0n3s: not right now maybe closer to 7 or 8pm PDT (2-3 hours from now) | 23:53 |
| clarkb | r1chardj0n3s: I need to run errands nowish | 23:53 |
| r1chardj0n3s | ok, just gimme a ping when you're good to go then :) | 23:53 |
| clarkb | woot I think I fixed JJB and it can handle unicode inputs now | 23:53 |
| anteaya | yay clarkb | 23:53 |
| lifeless | clarkb: dhellmann-phone: https://review.openstack.org/#/c/116775/ needs a re-review since I changed the commit message | 23:55 |
| fungi | jeblair: point of reference, i can't reproduce on relatively current debian/testing and distro-provided python-virtualenv 1.11.4 package so this might be specific to older virtualenv or older python interpreter packaging (likely also unreproducible on ubuntu/trusty) | 23:55 |
| jeblair | r1chardj0n3s: like this: lrwxrwxrwx 1 root root 23 Aug 26 23:51 bin -> /usr/local/zuul-env/bin | 23:56 |
| *** esker has joined #openstack-infra | 23:56 | |
| jeblair | those look correct | 23:57 |
| jeblair | i'm worried this is pbr related | 23:57 |
| lifeless | jeblair: I'm struggling to see how it would be | 23:57 |
| jeblair | but i don't know how to test that | 23:57 |
| lifeless | jeblair: we don't fiddle with build paths in pbr today | 23:57 |
| *** sthillma has joined #openstack-infra | 23:58 | |
| r1chardj0n3s | jeblair: yep, that does. but something is nuking the "local" from /usr/local/zuul-env/ in that Makefile path... | 23:58 |
| lifeless | jeblair: we don't have 'local' as a string in pbr except in comments. | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!