| mordred | clarkb: if it just installs, then it's not vendored/tied, which means that because of how pip works, they can update independently | 00:00 |
|---|---|---|
| dstufft | https://bitbucket.org/hpk42/tox/src/7109f1184d9f0303b050fce006cd90fa3db9e26e/setup.py?at=default#cl-21 | 00:00 |
| anteaya | mordred: http://paste.openstack.org/show/152070/ | 00:00 |
| mordred | anteaya: then, also, can you do ".tox/py27/bin/pip --version" | 00:00 |
| dstufft | it looks like tox does specific a min version at least in it's default branch | 00:00 |
| * anteaya does that | 00:00 | |
| *** sigmavirus24 has left #openstack-infra | 00:01 | |
| anteaya | http://paste.openstack.org/show/152071/ | 00:01 |
| fungi | dstufft: agreed, that seems to be the case | 00:01 |
| anteaya | mordred: http://paste.openstack.org/show/152072/ | 00:02 |
| *** melwitt has quit IRC | 00:02 | |
| mordred | anteaya: were you doing tox -epep8 ? | 00:02 |
| fungi | i was going to look at the tox release notes online, but i get a _very_ odd error from https://testrun.org/tox/ | 00:02 |
| anteaya | no, just tox | 00:02 |
| *** melwitt has joined #openstack-infra | 00:02 | |
| anteaya | $ tox | 00:02 |
| fungi | "The OCSP server has no status for the certificate." | 00:02 |
| anteaya | no arguments | 00:02 |
| mordred | anteaya: neat. try: | 00:02 |
| mordred | anteaya: then, also, can you do ".tox/pep8/bin/pip --version" | 00:02 |
| anteaya | http://paste.openstack.org/show/152073/ | 00:03 |
| * anteaya notes paste is holding up | 00:03 | |
| * anteaya checks dinner | 00:04 | |
| fungi | aha, seems like they're missing a sufficiently long chain cert for that site | 00:04 |
| mordred | k. only thing different so far is pip version in the virtualenv | 00:04 |
| *** andreaf has quit IRC | 00:05 | |
| anteaya | so far | 00:05 |
| * mordred trying to reproduce with that | 00:05 | |
| mordred | oh -also, host system virtualenv is different version | 00:06 |
| mordred | which I believe is what's leading to different pip version | 00:06 |
| dstufft | yea virtualenv version controls pip version | 00:06 |
| *** marun has quit IRC | 00:06 | |
| dstufft | unless you have an old virtualenv, which downloaded stuff from the internet | 00:06 |
| * mordred is testing to verify | 00:06 | |
| *** sputnik13 has quit IRC | 00:07 | |
| *** sputnik13 has joined #openstack-infra | 00:09 | |
| dstufft | mordred: clarkb fungi so is pbr omiting the shas now? | 00:09 |
| anteaya | pleia2: I was trying to test dhellmann's opml patch, what is a .tmpl file extention? | 00:09 |
| * dstufft tries to catch up ons tatus | 00:09 | |
| anteaya | pleia2: the internets point to proprietary things or gaming uses | 00:09 |
| *** erlon has quit IRC | 00:09 | |
| mordred | dstufft: patch is going through the gate | 00:09 |
| clarkb | dstufft: it will as soon as thinbgs merge | 00:09 |
| mordred | as soon as that's done, we'll tag | 00:10 |
| clarkb | there was a gate reset so we are about an hour away | 00:10 |
| clarkb | hrm | 00:10 |
| clarkb | nodepool doesn't look happy | 00:10 |
| *** sputnik13 has quit IRC | 00:10 | |
| clarkb | watch deleting the dns records will have done something silly to iptables | 00:10 |
| mordred | in case anyone is wondering, a great way to notice how many requirements something has is to install a new venv while tethered to a phone | 00:10 |
| clarkb | mordred: I just did that | 00:11 |
| anteaya | I was just wondering that | 00:11 |
| heyongli | anteaya, 3rd comment now should be collection to left colon automaticlly, am riht? or there is a special way to do this? | 00:11 |
| anteaya | can we set up a jenkins job for that | 00:11 |
| dstufft | mordred: pip 6 caches that shit by default | 00:11 |
| dstufft | so | 00:12 |
| anteaya | heyongli: hello | 00:12 |
| mordred | dstufft: neat! | 00:12 |
| dstufft | pip 6 supremacy is what I'm trying to say | 00:12 |
| mordred | well, one thingat a time | 00:12 |
| anteaya | heyongli: sorry I have no context for your comment | 00:12 |
| anteaya | heyongli: is this in relation to a patch? | 00:12 |
| pleia2 | anteaya: I read it as "template" - not a vendor-specific thing | 00:12 |
| anteaya | okay | 00:12 |
| clarkb | hrm the deficit numbers don't look right in nodepool | 00:12 |
| heyongli | anteaya, no , i might not express my self claar, let me paste a result | 00:13 |
| clarkb | well maybe things are ok there is a distinct spike on the graph | 00:13 |
| anteaya | pleia2: perhaps I should check with doug | 00:13 |
| anteaya | heyongli: good idea | 00:13 |
| clarkb | it does think it knows about 635 nodes | 00:13 |
| mordred | yes | 00:13 |
| pleia2 | anteaya: if you search our repos, the planet.openstack.org uses .tmpl files too as templates | 00:13 |
| mordred | it's virtualenv | 00:13 |
| clarkb | and only 33 nodes are ready so maybe we are ok | 00:13 |
| pleia2 | anteaya: (so my brain didn't just make it up, yay!) | 00:13 |
| anteaya | pleia2: ah okay, that is probably it then | 00:13 |
| mordred | jeblair, anteaya: upgrade virtualenv on your system and this will work | 00:13 |
| anteaya | pleia2: yay for your brain | 00:13 |
| clarkb | I wonder if it just takes that long for zuul to catch up on the merge events | 00:13 |
| fungi | anteaya: oh, btw jyuso got up with me this morning. the certs/keys you were concerned about are the ones generated for keystone in that devstack run. we publish them for all our job logs too, for example http://logs.openstack.org/69/134369/1/gate/gate-tempest-dsvm-postgres-full/6b2ef17/logs/etc/keystone/ssl/certs/ | 00:14 |
| mordred | of course, upgrading tox should also cause virtualenv to get upgraded | 00:14 |
| mordred | so we _could_ put minversion=1.8.0 in the tox.ini | 00:14 |
| mordred | but I kinda think that since it's not actually tox that we need 1.8 of we should not do that | 00:15 |
| anteaya | fungi: thanks, glad I was the problem here with me not understanding and not them | 00:15 |
| fungi | anteaya: no worries | 00:15 |
| anteaya | pip install -U virtualenv ? | 00:15 |
| mordred | clarkb: I'm going to comment on that bug just so that next time we encounter this we know how to fix it | 00:15 |
| mordred | anteaya: yes | 00:15 |
| heyongli | anteaya, http://paste.openstack.org/show/152079/ | 00:15 |
| clarkb | mordred: thank you | 00:15 |
| anteaya | mordred: thanks | 00:15 |
| *** ZZelle_ has quit IRC | 00:16 | |
| heyongli | anteaya, like the IBM powrKVM CI check, anything appear there is vote or comments? | 00:16 |
| anteaya | I don't understand what I am looking at | 00:17 |
| jeblair | 5591 set_description:jenkins01.openstack.org | 00:17 |
| anteaya | where did this output come from heyongli | 00:17 |
| jeblair | clarkb: number of outstanding set_description jobs for jenkins01 | 00:17 |
| anteaya | is this jenkins output you copied from a comment on a patch? | 00:17 |
| heyongli | anteaya, https://review.openstack.org/#/c/137530/ | 00:17 |
| mordred | jeblair: ok. I've updated the bug about this with the information about upgrading virtualenv | 00:17 |
| jeblair | mordred: what bug? | 00:17 |
| mordred | https://bugs.launchpad.net/devstack/+bug/1393006 | 00:18 |
| uvirtbot | Launchpad bug 1393006 in devstack "testtools 1.2.0 with old unittest2 breaks subunit.run discover --list" [Critical,Fix released] | 00:18 |
| anteaya | okay so I'm looking at this, what is the question heyongli | 00:18 |
| *** sputnik13 has joined #openstack-infra | 00:18 | |
| anteaya | mordred: tox is running | 00:18 |
| jeblair | mordred: neat. i don't see anything from you on that bug | 00:18 |
| mordred | jeblair: "Timeout error, please try again in a few minutes." | 00:18 |
| heyongli | anteaya, IBM PowerKVM CI checkDec 3, 2014 6:19 PM, this line is vote? | 00:18 |
| mordred | jeblair: ok. the comment saved this time | 00:19 |
| jeblair | mordred: why did tox 161 work for you? | 00:19 |
| heyongli | anteaya, i'm looking for what is look like if a CI just comments. | 00:19 |
| mordred | jeblair: because I had newer virtualenv | 00:19 |
| mordred | jeblair: downgrading tox did not downgrade virtualenv | 00:19 |
| mordred | clarkb: the thing I was trying to say before, is that there is a now-fixed behavior in old pip where if something was in setup_requires, it would download an egg to the current directory | 00:20 |
| clarkb | mordred: rather than install it properly? | 00:20 |
| mordred | clarkb: then, when install_requires processed it, it would think it had it, because it resolved it in the current dir | 00:20 |
| mordred | clarkb: BUT - that's not actually installed | 00:20 |
| *** signed8bit is now known as signed8bit_ZZZzz | 00:20 | |
| mordred | so when you go to run, it would be not found | 00:20 |
| mordred | this is fixed in all the places now | 00:21 |
| clarkb | rgr | 00:21 |
| *** carl_baldwin has quit IRC | 00:21 | |
| mordred | dstufft: I may know WAY too much about all o this | 00:21 |
| clarkb | jeblair: so that is what causes the queue graph to spike | 00:21 |
| anteaya | heyongli: okay now I understand | 00:21 |
| mordred | dstufft: I have no idea how you feel knowing much more :) | 00:21 |
| anteaya | at the bottom of that page, do you see a button called "Toggle CI"? | 00:21 |
| jeblair | clarkb: yeah, is it correlated with nodepool weirdness at all? nodepool timeouts? zuul timeouts? | 00:21 |
| anteaya | heyongli: in the lower left hand corner | 00:21 |
| dstufft | mordred: tecinhally that was a fix to setuptools not pip | 00:22 |
| *** andreaf has joined #openstack-infra | 00:22 | |
| dstufft | setuptools 7 fixed that | 00:22 |
| jeblair | clarkb: i suspect that the _drops_ might be zuul timeouts and reconnects (so the queue gets restarted) | 00:22 |
| mordred | dstufft: ah - thanks good point | 00:22 |
| clarkb | jeblair: I think it is, if you look at the graphs on zuul status its a steady climb then it falls to zero when ya the reconnect happens | 00:22 |
| mordred | dstufft: but the virtualenv upgrade gets both, yeah? | 00:22 |
| dstufft | mordred: yea, we upgrade everything | 00:22 |
| heyongli | anteaya, lower left hand corner is voted CI, right? | 00:22 |
| dstufft | virtualenv 12 will have the latest pip and setuptools when we release | 00:22 |
| anteaya | heyongli: Toggle CI | 00:22 |
| jeblair | clarkb: i'm going to see if i can figure out what's happening with zuul-jenkins; if you can investigate the potential relation to nodepool weirdness, that would be cool | 00:23 |
| anteaya | there is a button in your browser, or should be | 00:23 |
| clarkb | jeblair: ok | 00:23 |
| dstufft | mordred: and just gonna say, I am a poster child for making bad life decisions | 00:23 |
| *** dpaterson has quit IRC | 00:23 | |
| heyongli | anteaya, i see the Toggle CI, button | 00:24 |
| clarkb | jeblair: what was string to grep for zuul gearman reconnections? looking to narrow to timestamps | 00:24 |
| anteaya | heyongli: http://imgur.com/pesE5PB | 00:24 |
| anteaya | heyongli: great | 00:24 |
| anteaya | heyongli: click it | 00:24 |
| jeblair | clarkb: lost due to disconnect | 00:24 |
| *** amitgandhinz has joined #openstack-infra | 00:25 | |
| anteaya | heyongli: that will show all the ci comments in the comments section | 00:25 |
| anteaya | now | 00:25 |
| anteaya | do you see the column called Verified in the top left corner? | 00:25 |
| anteaya | in a table | 00:25 |
| heyongli | anteaya, i see them | 00:25 |
| heyongli | anteaya, i see ther is a Verified+1 | 00:26 |
| *** dpaterson has joined #openstack-infra | 00:26 | |
| anteaya | Jenkins is -1 and three CI systems are +1 | 00:26 |
| anteaya | great | 00:26 |
| anteaya | so find a comment from a CI system that doesn't have an entry in the verified column | 00:26 |
| anteaya | that CI system is just commenting | 00:26 |
| *** dims has quit IRC | 00:27 | |
| heyongli | anteaya, i found one, so any get vote right CI could post a Verified+1 column, if you don't have dont' do that. right? | 00:28 |
| *** dims has joined #openstack-infra | 00:28 | |
| anteaya | correct | 00:28 |
| anteaya | if you send a comment with a verified portion | 00:28 |
| anteaya | and you don't have voting rights | 00:28 |
| jeblair | clarkb: despite the large queue, job submission seems to still be quite fast. so i don't think the fact a worker is stuck is causing delays and timeouts | 00:28 |
| anteaya | your comment will not be accepted | 00:28 |
| anteaya | it won't be posted | 00:28 |
| heyongli | anteaya, now i know the answer, very helpful. | 00:29 |
| anteaya | great | 00:29 |
| anteaya | glad you are happy | 00:29 |
| *** amitgandhinz has quit IRC | 00:29 | |
| heyongli | anteaya, does vote right need landing test cases to tempest or somewhere? | 00:29 |
| clarkb | jeblair: I am seeing the last reset happening at 1700 yesterday utc | 00:30 |
| anteaya | voting permissions (it isn't actually a right) are decided by the project you want to verify | 00:30 |
| anteaya | heyongli: so many things need to be in place | 00:30 |
| clarkb | jeblair: but the delay in building a ton of nodes is recent | 00:30 |
| jeblair | clarkb: probably before the zuul restart to pick up the newer timeout | 00:30 |
| anteaya | heyongli: and one of them is a stable history of commenting | 00:30 |
| clarkb | jeblair: yup | 00:30 |
| *** bdpayne has quit IRC | 00:31 | |
| anteaya | heyongli: are you testing your system againist the ci-sandbox repository? | 00:31 |
| heyongli | anteaya, i try to understanding the proccess, anything is help. | 00:31 |
| *** bdpayne has joined #openstack-infra | 00:31 | |
| anteaya | heyongli: http://git.openstack.org/cgit/openstack-dev/ci-sandbox/ | 00:31 |
| anteaya | heyongli: you are doing a good job | 00:31 |
| anteaya | start by testing your system agains this repository | 00:32 |
| heyongli | anteaya, yeah, we had run our CI in real repo several weeks, but disable posting any comments to testing our CI. | 00:32 |
| anteaya | oh okay | 00:32 |
| *** sputnik13 has quit IRC | 00:32 | |
| clarkb | jeblair: however there are recent timeout errors in nodepool (not many likle before) | 00:32 |
| *** dims has quit IRC | 00:32 | |
| clarkb | jeblair: maybe geard doesn't list quickly when the numbers are large like that? | 00:32 |
| heyongli | anteaya, sandbox stage is not own by me, it should be long time ago | 00:32 |
| anteaya | heyongli: you can always use the sandbox | 00:32 |
| anteaya | if you think using it marks you as a beginner, think again | 00:33 |
| clarkb | jeblair: I can confirm manually running status against zuul from nodepool is slow | 00:33 |
| anteaya | you should disable your system and test against the sandbox repo anytime you make changes to your system | 00:33 |
| clarkb | jeblair: and it killed my connection | 00:33 |
| anteaya | we have had to disable people's systems because they were making changes and didn't disable their systems while they were doing so | 00:33 |
| anteaya | consider it a good first step for anything new with your system | 00:34 |
| heyongli | anteaya, i get it. | 00:34 |
| anteaya | great thank you | 00:34 |
| *** teran has joined #openstack-infra | 00:34 | |
| heyongli | anteaya, when the CI come back from sandbox to real repo? | 00:34 |
| jeblair | clarkb: so it seems like geard is stuck right now; so either it will get unstuck within 5 minutes, or zuul will reconnect (which may unstick it) | 00:34 |
| anteaya | heyongli: that can be a step | 00:34 |
| anteaya | heyongli: you can ask to comment on a repo and show your sandbox history as proof you are reliable | 00:35 |
| *** sputnik13 has joined #openstack-infra | 00:35 | |
| anteaya | heyongli: you are working with jogo for commenting on nova right? | 00:35 |
| anteaya | so you need to show jogo that he should allow you to comment on nova | 00:36 |
| jeblair | i'm restarting zuul + geard | 00:36 |
| anteaya | the best way is to show your comment history | 00:36 |
| anteaya | from the sandbox | 00:36 |
| *** emagana has quit IRC | 00:36 | |
| heyongli | anteaya, i begin to get this. | 00:36 |
| anteaya | I'm so glad | 00:36 |
| *** teran_ has quit IRC | 00:37 | |
| heyongli | anteaya, even just comments also need approve, do you mean? by showing a stable comments log in the sandbox, right? | 00:37 |
| anteaya | that is the preferred way, yes | 00:37 |
| anteaya | it isn't always what happens | 00:37 |
| anteaya | but it is what we do like to see | 00:37 |
| anteaya | it shows you are paying attention | 00:37 |
| heyongli | and everytime you changing the CI, use sandbox again | 00:38 |
| anteaya | and want to be useful to the community | 00:38 |
| anteaya | heyongli: yes | 00:38 |
| clarkb | jeblair: ok | 00:38 |
| anteaya | it means if something is funny with your system and you post 100 comments in 2 minutes | 00:38 |
| heyongli | does this process captured in anywhere? | 00:38 |
| anteaya | you just spam the sandbox | 00:38 |
| anteaya | well we do our best to capture it with http://ci.openstack.org/third_party.html | 00:39 |
| anteaya | but we have various levels of implementation from the operators | 00:39 |
| fungi | looks like changes are getting reenqueued now | 00:39 |
| *** zz_sabari is now known as sabari | 00:40 | |
| heyongli | anteaya very thanks i'm reading this wiki, if anything i don't understand, i come back to boher you again -:) | 00:40 |
| anteaya | heyongli: you are asking good questions and you and jyuso are doing good work | 00:40 |
| anteaya | heyongli: it is a pleasure to work with you | 00:41 |
| heyongli | anteaya, thanks, i'm very glad to have you mentor us, really. | 00:41 |
| anteaya | it is my pleasure | 00:41 |
| anteaya | there is a hope we might have something running for nfv by the end of this release | 00:42 |
| anteaya | which is good news | 00:42 |
| heyongli | anteaya, we are tying to set the our CI for real HW, maybe fro NVF too. | 00:42 |
| jeblair | clarkb, fungi: i have started tcpdumps on zuul and jenkins0* to see if that yields more info | 00:43 |
| *** lttrl has quit IRC | 00:43 | |
| *** sabari is now known as zz_sabari | 00:43 | |
| *** sputnik13 has quit IRC | 00:43 | |
| clarkb | jeblair: ok, I can report nodepool is now trying to use all our quota so it is doing stuff | 00:43 |
| heyongli | anteaya, i'm going to office, then, see you. | 00:44 |
| *** sputnik13 has joined #openstack-infra | 00:44 | |
| jeblair | clarkb: well, hrm. jenkins01 is already queuing set_description jobs | 00:44 |
| anteaya | heyongli: see you | 00:44 |
| jeblair | clarkb: i had surmised that there was another bug in geard, but perhaps the jenkins01 manager is really just stuck. | 00:44 |
| clarkb | jeblair: perhaps the worker thread in the gearman plugin there is in trouble? I will try finding it in melody | 00:44 |
| *** Masahiro has joined #openstack-infra | 00:45 | |
| clarkb | jeblair: ya | 00:45 |
| fungi | jeblair: this sounds like a distinct possibility | 00:46 |
| *** carl_baldwin has joined #openstack-infra | 00:46 | |
| fungi | perhaps next we should try quiescing jenkins01 and restarting it? | 00:46 |
| fungi | i'm happy to give that a roll | 00:46 |
| clarkb | jeblair: the manager thread is number two in cpu time on jenkins01 | 00:47 |
| clarkb | it says it is runnable though | 00:48 |
| *** unicell has joined #openstack-infra | 00:48 | |
| anteaya | okay well tox finished that time, for anyone who cared | 00:49 |
| *** bswartz has joined #openstack-infra | 00:51 | |
| *** ddieterly has joined #openstack-infra | 00:51 | |
| *** kumartin has joined #openstack-infra | 00:51 | |
| asselin | hi, I'm still having issues with ip tables. I found the last two lines in rules.v4 are an issue. anything look wrong here? http://paste.openstack.org/show/152081/ | 00:52 |
| jeblair | clarkb, fungi: my math says that there shoud have been 73 jobs that it processed before getting stuck, but i don't see any packet captures on jenkins01 with that job. however, i may not have finished setting the tcpdump processing up by then | 00:52 |
| fungi | asselin: perhaps the loader assumes comments start with # and a space? | 00:53 |
| fungi | asselin: oh, you're saying when you uncomment them they cause a problem | 00:54 |
| asselin | fungi, yes | 00:54 |
| *** Longgeek has joined #openstack-infra | 00:54 | |
| *** _sweston is now known as spw | 00:54 | |
| jeblair | fungi: let's hold off on a jenkins restart just yet... | 00:55 |
| fungi | asselin: well for starters, the second one isn't -A | 00:55 |
| jeblair | fungi: i might want to restart zuul one more time and see if we see the same | 00:55 |
| fungi | jeblair: sure | 00:55 |
| asselin | fungi, line 48? | 00:55 |
| fungi | asselin: 49, and it's using an undefined "stack-INPUT" chain | 00:56 |
| *** salv-orlando has quit IRC | 00:56 | |
| asselin | fungi, yes....weird. I'm seeing it correct in system-config. OK...I will trace it. thanks | 00:56 |
| *** dannywilson has quit IRC | 00:56 | |
| jogo | any further ideas about why http://logs.openstack.org/52/134052/5/check//gate-hacking-integration-nova/c4d107b/console.html#_2014-12-16_22_38_03_070 is failing | 00:57 |
| *** timcline has joined #openstack-infra | 00:57 | |
| fungi | asselin: i would suggest you try feeding those entries to iptables and seeing what errors they give | 00:57 |
| jeblair | fungi, clarkb: yeah, i'm going to do another zuul restart to confirm this | 00:58 |
| clarkb | jeblair: ok | 00:58 |
| *** rmcall has joined #openstack-infra | 00:58 | |
| *** Longgeek has quit IRC | 00:58 | |
| *** sabeen2 has quit IRC | 00:59 | |
| *** dims has joined #openstack-infra | 00:59 | |
| *** rmcall has quit IRC | 00:59 | |
| fungi | jogo: is it just failing on that 134052 change? | 01:00 |
| *** sputnik13 has quit IRC | 01:00 | |
| jogo | fungi: no its failing on master | 01:00 |
| jogo | I can reproduce locally | 01:00 |
| asselin | fungi, ok I reapplied the puppet. I probably inadventently changed the file. Here's the new one. Line 24 is the offending line: http://paste.openstack.org/show/152082/ | 01:00 |
| clarkb | jeblair: though it isn't clear to me what you are trying to confirm | 01:01 |
| clarkb | jogo: what version of setuptools? | 01:01 |
| jogo | clarkb: setuptools.__version__ | 01:01 |
| jogo | '3.6' | 01:01 |
| jogo | I am very confused about that | 01:01 |
| jogo | '8.0.4' | 01:02 |
| jogo | works fine | 01:02 |
| *** mtanino has quit IRC | 01:02 | |
| fungi | asselin: i'm going to guess it's something to do with your rate limiting or logging. i'd need to compare to some working examples | 01:02 |
| jeblair | clarkb: whether the manager thread on jenkins01 is independently stuck and not picking up jobs, or whether the problem might lie on the geard side | 01:02 |
| dstufft | 3.6 is what version of setuptools ships with the current version of virtualenv | 01:02 |
| *** rmcall has joined #openstack-infra | 01:03 | |
| jogo | dstufft: ahh how do I get around that? | 01:03 |
| jogo | the nova tox env seems to not have that issue | 01:03 |
| *** asettle is now known as asettle-lunch | 01:03 | |
| dstufft | I'm not sure what your issue, if you just want a newer setuptools you just upgrade setuptools | 01:03 |
| fungi | asselin: though it seems to match what we have in openstack-infra/system-config:modules/openstack_project/manifests/single_use_slave.pp | 01:03 |
| dstufft | pip install --upgrade setuptools inside the virtualenv | 01:03 |
| asselin | fungi, yes https://github.com/openstack-infra/system-config/blob/master/modules/iptables/templates/rules.erb | 01:03 |
| jogo | dstufft: I want that to happen automatically | 01:04 |
| jogo | dstufft: it seems to happen like that in nova | 01:04 |
| dstufft | probably they are doing pip install --upgrade <something> where <something> has setuptools in it's dependency tree somewhere | 01:04 |
| jeblair | clarkb, fungi: well, jenkins01 is now processing set_describe jobs. so i think i'm back at "wait for it to happen again and see if the tcpdump catches it" | 01:05 |
| fungi | asselin: introduced by https://review.openstack.org/135694 | 01:05 |
| *** mjturek has quit IRC | 01:05 | |
| fungi | jeblair: :/ | 01:05 |
| asselin | fungi, :( | 01:05 |
| fungi | asselin: that change merged to system-config ~5 days ago | 01:06 |
| asselin | fungi, yes, my images haven't been updating | 01:06 |
| fungi | asselin: what distro/release are you seeing this problem on? | 01:06 |
| jeblair | fungi, clarkb: geard status is being slow again | 01:06 |
| asselin | fungi, ubuntu 14.04 | 01:06 |
| jogo | dstufft: ahh makes sense. So should I add setuptools as a dep somewhere? | 01:07 |
| asselin | fungi, | 177 | p221 | dpc | dpc-1418324445.template.openstack.org | 1418324445 | e1c31014-d4ce-4edc-96f7-07b48269b240 | d0af8410-cec9-4961-b875-4661318bb489 | ready | 124 | 01:07 |
| jogo | dstufft: wonder why this just broke recently | 01:07 |
| asselin | 124 hous is about 5 days | 01:07 |
| dstufft | jogo: what's broken | 01:07 |
| jogo | http://logs.openstack.org/52/134052/5/check//gate-hacking-integration-nova/c4d107b/console.html#_2014-12-16_22_38_03_070 | 01:07 |
| *** rmcall has quit IRC | 01:07 | |
| jogo | dstufft: that fails on master too | 01:07 |
| *** bdpayne has quit IRC | 01:07 | |
| fungi | asselin: confirmed, we're broken on the same | 01:09 |
| fungi | asselin: checking now to see what the syntax error is there | 01:09 |
| asselin | fungi, thanks | 01:09 |
| fungi | asselin: if nothing obvious jumps out at me, i'll propose a revert in a few minutes | 01:09 |
| asselin | fungi, sounds reasonable | 01:09 |
| jogo | dstufft: any ideas on what could have caused that breakage ? | 01:10 |
| dstufft | jogo: I am confused as to how this is related to setuptools version actually | 01:10 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Fix the log path returned from zuul https://review.openstack.org/142291 | 01:11 |
| *** otter768 has joined #openstack-infra | 01:11 | |
| *** carl_baldwin has quit IRC | 01:11 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Ensure we set attrs in test_ids for sql2subunit https://review.openstack.org/142292 | 01:11 |
| dstufft | jogo: you say you can repro it with setuptools 3.6 but not 8.0? | 01:11 |
| jogo | dstufft: correct | 01:12 |
| jogo | dstufft: well not exactly | 01:12 |
| dstufft | jogo: can you repro it with setuptools 7.0? | 01:12 |
| jogo | dstufft: let me double check | 01:12 |
| *** markmcclain has quit IRC | 01:12 | |
| mordred | jogo: can you reproduce locally? | 01:12 |
| jogo | mordred: yes via the hacking pep8 venv | 01:12 |
| jogo | dstufft: it fails for setuptools 8.0.4 as well | 01:13 |
| mordred | jogo: in that venv, can you "import nova.hacking.checks.factory" in python ? | 01:13 |
| jogo | damn | 01:13 |
| jogo | mordred: eventlet | 01:13 |
| mordred | jogo: WOOT! | 01:13 |
| mordred | jogo: I love it when it's not me | 01:14 |
| mordred | jogo: what did eventlet do? new release? | 01:14 |
| jogo | mordred: no we import it in nova__init__.py now | 01:14 |
| * jogo wonders off to nova land to sort it out | 01:14 | |
| jogo | mordred dstufft thanks | 01:14 |
| mordred | jogo: have I ever mentioned that importing things in __init__.py causes evil? | 01:16 |
| *** otter768 has quit IRC | 01:16 | |
| jogo | mordred: I see why | 01:16 |
| jogo | it was sdague https://review.openstack.org/#/c/140146/ | 01:16 |
| greghaynes | mordred: Quite an understatement ;) | 01:16 |
| mordred | of course, with eventlet, it's ACTUALLY probably the right thign to do | 01:17 |
| mordred | except when it's not | 01:17 |
| jeblair | mordred: why is importing something in __init__.py evil? | 01:17 |
| mordred | jeblair: unexpected sideeffects | 01:18 |
| jeblair | mordred: that sounds backwards -- importing modules should not have side-effects. but that's on the modules, not on the side of the importer | 01:18 |
| greghaynes | they shouldnt, but they often do :( | 01:19 |
| mordred | yeah - sorry - what I meant was "running code that has sideeffects in __init__.py is evil" | 01:19 |
| clarkb | jeblair: we are just watching it again? | 01:19 |
| jeblair | clarkb: yep | 01:19 |
| jeblair | clarkb: it's behaving :( | 01:19 |
| jogo | mordred: do you think it makes more sense to leave nova/hacking/checks.py there and revert | 01:19 |
| jogo | or move nova/hacking/checks.py out of nova/* | 01:20 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Correct iptables log option order https://review.openstack.org/142293 | 01:20 |
| fungi | asselin: jeblair: mordred: clarkb: ^ critical fix for nodepool image building | 01:21 |
| mordred | jogo: neither | 01:21 |
| fungi | that was... not exactly easy to track down | 01:21 |
| asselin | fungi, will test this quickly now | 01:21 |
| mordred | jogo: honestly, you'll unwind so much to try to figure all that out | 01:21 |
| clarkb | fungi: looking | 01:21 |
| *** camunoz has quit IRC | 01:22 | |
| asselin | fungi, +1 | 01:22 |
| jogo | mordred: what do you propose? | 01:22 |
| clarkb | fungi: is that new? | 01:22 |
| fungi | we're basically 5 days behind on nodepool images (ever since the change adding that line merged) | 01:23 |
| clarkb | (the rule not iptables being funny) | 01:23 |
| mordred | jogo: Id' just figure out how to bypass the import when we're running things - like, maybe inject something somewhere in hacking so taht when it goes to import things nova can detect it and not do eventlet | 01:23 |
| mordred | jogo: OR - don't listen to me - I may be wrong | 01:23 |
| dstufft | you could probably mock eventlet in hacking | 01:23 |
| jogo | mordred: that will break local checks in ova | 01:23 |
| jogo | nov | 01:24 |
| jogo | nova | 01:24 |
| mordred | SPECTACULAR | 01:24 |
| jogo | dstufft: this is a nova problem not a universal one | 01:24 |
| jogo | mordred: nova.hacking.checks.factory is what registers local checks | 01:24 |
| mordred | jogo: so what about eventlet is breaking hacking - do we just not have hacking in the venv? | 01:24 |
| dstufft | nova_hacking :V | 01:24 |
| jogo | mordred: as part of the hacking tests, we build tox venv on master | 01:25 |
| *** bdpayne has joined #openstack-infra | 01:25 | |
| jogo | and run flake8 on other repos inside of that | 01:25 |
| jogo | to see what trunk hacking will do | 01:25 |
| jeblair | dstufft: i think the _second_ time we split out nova's hacking checks from the repo, the cycle is complete. :) | 01:25 |
| mordred | jogo: OH | 01:25 |
| jogo | that venv doesn't have eventlet so goes kapow | 01:25 |
| mordred | jogo: right. I think you're going to need a venv with eventlet in it | 01:25 |
| jogo | jeblair: ^_^ | 01:25 |
| jogo | mordred: I guess we can make that test a bit more robust and install the target repos requirements | 01:26 |
| mordred | well, that'll get expensive quickly | 01:26 |
| mordred | for now, I'd just add eventlet | 01:26 |
| mordred | it's pervasive across openstack and it does weird things on import | 01:26 |
| jogo | mordred: with devpi-server it is quick for me | 01:27 |
| jogo | mordred: that is reasonable | 01:27 |
| jeblair | clarkb, fungi: i'm going to leave this for a bit; i'll check in a couple of hours and see if i can stop the packet captures | 01:28 |
| clarkb | jeblair: ok sounds good | 01:29 |
| clarkb | I need to check out now and start thinking about heading to dinner | 01:29 |
| clarkb | dinner with family all the way from micronesia | 01:30 |
| anteaya | clarkb: enjoy | 01:30 |
| clarkb | mordred: in theory pbr changes will merge in ~45 minutes, if we do manage to get them tagged this evening we should push a revert of setuptools pins to devstack to test if it all works | 01:30 |
| clarkb | fungi: ^ | 01:30 |
| fungi | clarkb: _after_ tagging pbr 0.10.3 on the feature/0.10 branch, yeah? | 01:31 |
| dstufft | then I get to break it all over with pip 6 | 01:32 |
| fungi | dstufft: i for one welcome our new meme overlords | 01:33 |
| clarkb | fungi correct and bandersnatch syncing | 01:33 |
| mordred | clarkb: ++ | 01:33 |
| fungi | clarkb: oh, yeah, i'll make sure to double-check the bandersnatch mirror contents for latest pbr at that point | 01:33 |
| dstufft | has that been working better? | 01:33 |
| dstufft | bandersnatch | 01:33 |
| fungi | mordred: will you be around in 45-60 minutes to tag new pbr? | 01:33 |
| *** nelsnelson has quit IRC | 01:34 | |
| mordred | fungi, clarkb: I'm going to push the tag-merge as a real merge btw - so I'll get that taken care of | 01:34 |
| fungi | dstufft: i think so. it's only been a couple days since upgrading and the pypi-side race fix, so time will tell | 01:34 |
| mordred | fungi: yes | 01:34 |
| openstackgerrit | Anita Kuno proposed openstack/requirements: Revert "Add a tox env to check requirements overlap" https://review.openstack.org/142296 | 01:34 |
| fungi | mordred: excellent--i'll leave the release end in your capable hands--thanks! | 01:34 |
| mordred | dstufft: btw: https://bitbucket.org/pypa/bandersnatch/pull-request/12/add-option-to-dir-hash-index-files/diff next time you get bored ... | 01:35 |
| openstackgerrit | Anita Kuno proposed openstack/requirements: Revert "Add a tox env to check requirements overlap" https://review.openstack.org/142296 | 01:35 |
| fungi | mordred: if you use a real merge into master, then you'll presumably be dropping the git sha/egg-info change you have proposed for master at that point? | 01:35 |
| mordred | fungi: yes | 01:35 |
| dstufft | mordred: I'm not core on bandersnatch | 01:36 |
| fungi | dstufft: oh, yeah, that pr. it would be awesome so that we can have pbr write to afs | 01:36 |
| *** emagana has joined #openstack-infra | 01:36 | |
| fungi | dstufft: you are our chief lobbyist ;) | 01:36 |
| mordred | dstufft: I know - but you know everyone and they like you | 01:36 |
| openstackgerrit | Joe Gordon proposed openstack-dev/hacking: Add eventlet to test-requirements https://review.openstack.org/142297 | 01:36 |
| jogo | mordred: there ^ | 01:36 |
| dstufft | ha | 01:37 |
| dstufft | ok :) | 01:37 |
| dstufft | I can review it at least | 01:37 |
| dstufft | and add my thoughts | 01:37 |
| fungi | thoughts like... wtf is afs? | 01:37 |
| mordred | jogo: that just makes me sad | 01:38 |
| dstufft | fungi: I (sadly?) do know what AFS is | 01:38 |
| jogo | mordred: yeah, but like you said that is probably the easiest fix | 01:38 |
| fungi | dstufft: be glad and rejoice, for afs is with us always | 01:39 |
| mordred | jogo: totes. I'm +2. Im just a sad +2 | 01:39 |
| *** kumartin has quit IRC | 01:39 | |
| jogo | mordred: haha | 01:39 |
| *** timcline has quit IRC | 01:40 | |
| *** carl_baldwin has joined #openstack-infra | 01:42 | |
| fungi | mordred: speaking of afs, any insights on what else i'll need in https://review.openstack.org/142130 ? (i know i'll need to give the afsdb servers an acl allowing gerrit2 on review-dev to write into that subtree, but what else?) | 01:42 |
| *** melwitt has quit IRC | 01:44 | |
| fungi | mordred: the idea is that once that works, i'll do the same to review.o.o and then mount the corresponding read-only volume on the git servers | 01:44 |
| *** sarob has quit IRC | 01:45 | |
| *** bdpayne has quit IRC | 01:46 | |
| *** wenlock has joined #openstack-infra | 01:48 | |
| *** emagana has quit IRC | 01:48 | |
| anteaya | oh I forgot, off to an appointment tomorrow morning, should be back in the afternoon | 01:50 |
| *** jaypipes has quit IRC | 01:52 | |
| *** yaguang has joined #openstack-infra | 01:53 | |
| mordred | fungi: I mean, it LOOKS about right, but it seems not right enough because it's not super complicated | 01:53 |
| fungi | mordred: i just realized i probably need to use the read-write path to the mirror there, for starters | 01:53 |
| mordred | oh. right | 01:54 |
| *** carl_baldwin has quit IRC | 01:54 | |
| jeblair | fungi: will we be vos releasing this mirror? | 01:54 |
| fungi | jeblair: i don't think that's probably necessary | 01:55 |
| *** dims has quit IRC | 01:55 | |
| fungi | jeblair: it's getting written to basically continuously by gerrit as changes happen to git repos | 01:55 |
| *** dims has joined #openstack-infra | 01:56 | |
| jeblair | fungi: then if we're not going to have a read-only version, then the only path available will be the rw one, so you should be set | 01:56 |
| fungi | jeblair: good point. the git servers don't need read-write access to that volume but that's just a matter of acls | 01:56 |
| *** salv-orlando has joined #openstack-infra | 01:57 | |
| jeblair | dstufft: http://afstest.openstack.org/mirror/pypi/web/ was generated with that patch (and running out of afs behind an apache with those rewrite rules). it's not running continuously though (yet), so hasn't been updated since. | 01:57 |
| jeblair | fungi: yep | 01:57 |
| *** gyee has quit IRC | 01:57 | |
| *** yaguang has quit IRC | 01:59 | |
| jeblair | fungi: git-sandbox should probably be its own volume though. so i think your manual steps are create the volume, create a non-interactive pts entry, grant it acls | 02:00 |
| *** dims has quit IRC | 02:00 | |
| jeblair | fungi: probably the big todo that's missing from puppet is setting gerrit up to start inside of k5start once you have the kerberos principal for it | 02:00 |
| fungi | jeblair: ooh, great point. we need something to kinit for it | 02:01 |
| dstufft | oh hey | 02:01 |
| dstufft | pbr thing merged | 02:01 |
| fungi | dstufft: one to go, ~9 minutes eta | 02:01 |
| dstufft | oh | 02:01 |
| dstufft | I got some email | 02:01 |
| jeblair | fungi: oh, yeah, so normally i'd create a principal and set out a keytab for k5start. i think that's a binary file. so i'm not sure what we'll end up putting in hiera. | 02:01 |
| *** salv-orlando has quit IRC | 02:01 | |
| dstufft | I don't actually know how gerrit works :D | 02:01 |
| dstufft | I just pretend | 02:02 |
| fungi | dstufft: the first change adds the egg-info entry, the second stops sticking it in the version string | 02:02 |
| dstufft | fungi: ah | 02:02 |
| fungi | dstufft: separated so as to make them easier to discuss and revert if needed | 02:02 |
| jogo | mordred: why is pbr in the integrated gate? | 02:02 |
| fungi | jeblair: sounds like we'll need some sort of keytab manager in puppet? | 02:03 |
| jogo | isn't that a little odd | 02:03 |
| mordred | jogo: because if we break pbr we break EVERYTHING | 02:03 |
| mordred | jogo: we don't do that as often anymore - but back in the day it was very important | 02:03 |
| fungi | jogo: because it curently runs gate-requirements-integration-dsvm | 02:03 |
| jogo | true, but shouldn't check jobs cover that? | 02:04 |
| fungi | currently | 02:04 |
| jeblair | fungi: maybe there's a way we could encode it into hiera | 02:04 |
| fungi | jeblair: raw hex entries? | 02:04 |
| fungi | jeblair: https://github.com/collectivemedia/puppet-krb5keytab | 02:05 |
| fungi | i see some ideas in there | 02:05 |
| fungi | jeblair: looks like they're using base64 | 02:05 |
| *** wenlock has quit IRC | 02:06 | |
| *** shashankhegde has quit IRC | 02:07 | |
| heyongli | jogo, does the pci test cases landing on nova need further wok?: https://review.openstack.org/#/c/141270/ | 02:07 |
| jogo | fungi: what does that job do? | 02:08 |
| fungi | jogo: it iterates over global requirements and tries to install everything using proposed pbr changes | 02:08 |
| *** yjiang5 is now known as yjiang5_away | 02:09 | |
| fungi | jogo: runs http://git.openstack.org/cgit/openstack-dev/pbr/tree/tools/integration.sh | 02:09 |
| jogo | fungi: ahh and that is used to gate the requirements job | 02:09 |
| jogo | err repo | 02:09 |
| fungi | jogo: but also used to gate that pbr patches don't render things uninstallable | 02:09 |
| jogo | which has swift-dsvm-functional so it is in the integrated gate? | 02:10 |
| *** dpaterson has quit IRC | 02:10 | |
| jogo | and that is run in places with standard tempest-full gate jobs | 02:10 |
| *** otter768 has joined #openstack-infra | 02:11 | |
| *** yaguang has joined #openstack-infra | 02:12 | |
| *** camunoz has joined #openstack-infra | 02:12 | |
| jogo | heyongli: I will have to do a more thorough review in the near future | 02:12 |
| jogo | heyongli: hopefully this isn't blocking you though right? | 02:13 |
| jogo | you can still work on the tests and start setting up the CI system right? | 02:13 |
| heyongli | jogo, no , it won't, land to nova i good, but i think the third party CI i worked on could be continue without that. | 02:13 |
| jogo | heyongli: agreed | 02:14 |
| heyongli | jogo, landing to nova is good for sharing and qulity control, so i hope it will happen | 02:14 |
| fungi | dstufft: mordred: the second pbr change merged, so i think we're set for a 0.10.3 tag to get pushed | 02:14 |
| dstufft | then setuptools gets unpinned? | 02:14 |
| jogo | heyongli: if there is lack of consensus about landing them in nova, posting the tests on stackforge isn't a bad option as well | 02:14 |
| fungi | dstufft: yep, sounds like clarkb wanted to try that after dinner maybe | 02:14 |
| *** sweston has quit IRC | 02:15 | |
| *** spw is now known as sweston | 02:15 | |
| heyongli | jogo, ok, that's also make sense, let's try at least, and tanks you always kind to make it here today. | 02:15 |
| jogo | heyongli: no problem, thanks for working on these tests | 02:16 |
| heyongli | jogo, that's my job, i like it. | 02:16 |
| jogo | :) | 02:16 |
| clarkb | anyone can propose the revert to unpin | 02:18 |
| clarkb | I will try to do it after dinner if not already done | 02:18 |
| *** ChuckC has quit IRC | 02:18 | |
| openstackgerrit | Adrian Turjak proposed openstack-infra/project-config: Add new Openstack-Pydashie project https://review.openstack.org/142240 | 02:18 |
| fungi | i can propose the revert as soon as i see a pbr 0.10.3 on all our mirrors | 02:20 |
| *** bdpayne has joined #openstack-infra | 02:21 | |
| heyongli | jogo, you might intresting to some pci design, do you have time to look this sriov interface attach bp? : https://review.openstack.org/#/c/139910/ | 02:21 |
| jogo | heyongli: sorry not tonight | 02:22 |
| heyongli | jogo, not that rush, but thanks, that's will be helpfull | 02:22 |
| *** adalbas has quit IRC | 02:22 | |
| *** MarkAtwood has joined #openstack-infra | 02:24 | |
| *** gokrokve has joined #openstack-infra | 02:24 | |
| *** sarob has joined #openstack-infra | 02:26 | |
| *** sarob has quit IRC | 02:31 | |
| *** wenlock has joined #openstack-infra | 02:35 | |
| *** bdpayne has quit IRC | 02:35 | |
| mordred | fungi: ok - pushing tag | 02:39 |
| *** carl_baldwin has joined #openstack-infra | 02:40 | |
| mordred | fungi: done | 02:40 |
| *** emagana has joined #openstack-infra | 02:43 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: WIP: Add a db api method to extract run_times for a single test https://review.openstack.org/142309 | 02:46 |
| *** emagana has quit IRC | 02:48 | |
| openstackgerrit | Joe Gordon proposed openstack-infra/elastic-recheck: Add fingerprint fur bug 1403284 https://review.openstack.org/142310 | 02:48 |
| uvirtbot | Launchpad bug 1403284 in devstack "mysql (1040, 'Too many connections')" [Undecided,New] https://launchpad.net/bugs/1403284 | 02:48 |
| openstackgerrit | Merged openstack-infra/system-config: Correct iptables log option order https://review.openstack.org/142293 | 02:49 |
| *** zz_dimtruck is now known as dimtruck | 02:50 | |
| *** carl_baldwin has quit IRC | 02:51 | |
| openstackgerrit | Merged openstack-dev/hacking: Add eventlet to test-requirements https://review.openstack.org/142297 | 02:54 |
| fungi | it's on pypi.python.org now | 02:54 |
| fungi | oddly, it triggered both the release _and_ pre-release pipelines?!? http://logs.openstack.org/f3/f3bda4ab5b16d69cb4cd8269e3af0c92a5338ff3/ | 02:55 |
| clarkb | oh crap | 02:55 |
| clarkb | I know why | 02:55 |
| clarkb | my regex for prerelease puts ? on the abc group | 02:56 |
| *** hdd has quit IRC | 02:56 | |
| clarkb | should just remove the outer ()? | 02:56 |
| clarkb | sorry | 02:56 |
| fungi | yeah, we need to make that non-optional | 02:56 |
| fungi | whoops | 02:56 |
| clarkb | yup | 02:56 |
| fungi | sorry i missed that in review :/ | 02:56 |
| clarkb | I wrote it. I fyou push fix I can approve | 02:56 |
| fungi | no harm done i think. looks like stuff released successfully anyway | 02:56 |
| fungi | will do--just a moment | 02:57 |
| clarkb | oh good. maybe check sdist and whl install? as they may have overwritteb each other? | 02:57 |
| clarkb | I am suddenly paranoid I derped hard | 02:58 |
| *** carl_baldwin has joined #openstack-infra | 03:00 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Pre-release tags must include non-digits https://review.openstack.org/142313 | 03:01 |
| fungi | clarkb: ^ | 03:01 |
| fungi | checking now | 03:01 |
| clarkb | I am approving 142313 now | 03:03 |
| *** ChuckC has joined #openstack-infra | 03:03 | |
| *** timcline has joined #openstack-infra | 03:04 | |
| *** timcline has quit IRC | 03:04 | |
| fungi | the wheel on tarballs.o.o is fine | 03:04 |
| fungi | as is the tarball | 03:04 |
| *** timcline has joined #openstack-infra | 03:04 | |
| clarkb | yay | 03:04 |
| clarkb | danke | 03:05 |
| fungi | i'm testing the ones on pypi as well | 03:05 |
| fungi | nice that pbr is self-built too | 03:06 |
| fungi | so pbr freeze in my venv is reporting "pbr==0.10.3 # git sha e73e67a" | 03:07 |
| *** timcline has quit IRC | 03:08 | |
| fungi | crappity. we only got a wheel upload to pypi.python.org | 03:08 |
| fungi | i'll retrigger the upload | 03:08 |
| *** sandywalsh has quit IRC | 03:09 | |
| *** bdpayne has joined #openstack-infra | 03:09 | |
| clarkb | huh | 03:09 |
| *** timcline has joined #openstack-infra | 03:10 | |
| *** sandywalsh has joined #openstack-infra | 03:11 | |
| fungi | yeah, it raced with the wheel upload from the pre-release pipeline... http://logs.openstack.org/f3/f3bda4ab5b16d69cb4cd8269e3af0c92a5338ff3/release/pbr-pypi-both-upload/7f8ee12/console.html | 03:11 |
| fungi | HTTPError: 400 Client Error: A file named "pbr-0.10.3-py2.py3-none-any.whl" already exists for pbr-0.10.3. To fix problems with that file you should create a new release. | 03:11 |
| clarkb | good that pypi throws an appropriate error | 03:12 |
| dstufft | eventually I plan on making it so you can't delete a file off PyPI and re-upload a new one too | 03:12 |
| dstufft | right now you can | 03:12 |
| *** dannywilson has joined #openstack-infra | 03:12 | |
| fungi | yeah, in this case i think i'll leave it and manually upload the missing tarball | 03:12 |
| *** Krast has quit IRC | 03:13 | |
| fungi | rather than try retriggering that job | 03:13 |
| clarkb | ++ | 03:13 |
| fungi | since that would involve deleting the existing wheel which is not a great habit to get into | 03:13 |
| openstackgerrit | Merged openstack-infra/project-config: Pre-release tags must include non-digits https://review.openstack.org/142313 | 03:14 |
| *** timcline has quit IRC | 03:14 | |
| *** timcline has joined #openstack-infra | 03:15 | |
| *** timcline has quit IRC | 03:17 | |
| *** timcline has joined #openstack-infra | 03:17 | |
| *** changbl has joined #openstack-infra | 03:17 | |
| fungi | okay, pypi.python.org is updated now to include the tarball, and the md5sum matches the one computed by the tarball job | 03:22 |
| fungi | and i've tested it with 'pip install --no-use-wheel pbr' in a venv, all good | 03:23 |
| fungi | polling our mirrors | 03:23 |
| *** emagana has joined #openstack-infra | 03:24 | |
| *** dannywilson has quit IRC | 03:24 | |
| fungi | they're all up to date with wheels and tarballs of the new version | 03:25 |
| fungi | setuptools pin revert on the way in moments | 03:25 |
| *** dannywilson has joined #openstack-infra | 03:25 | |
| *** harlowja is now known as harlowja_away | 03:25 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Revert "Pin version of setuptools" https://review.openstack.org/142320 | 03:28 |
| fungi | clarkb: dstufft: ^ | 03:28 |
| *** timcline has quit IRC | 03:28 | |
| *** dannywilson has quit IRC | 03:29 | |
| clarkb | fungi is there a devstack change? | 03:31 |
| fungi | clarkb: i was looking to see if it got pinned anywhere besides our nodepool images | 03:31 |
| *** sarob has joined #openstack-infra | 03:32 | |
| fungi | clarkb: https://review.openstack.org/142322 | 03:33 |
| fungi | dstufft: ^ | 03:33 |
| *** baoli has quit IRC | 03:35 | |
| fungi | anyway, that will need to run tests for a while. i may turn in for the night | 03:35 |
| *** asettle-lunch is now known as asettle | 03:35 | |
| openstackgerrit | Monty Taylor proposed openstack-dev/pbr: Merge git sha removal https://review.openstack.org/142323 | 03:36 |
| *** Alexandra_ has joined #openstack-infra | 03:36 | |
| *** timcline has joined #openstack-infra | 03:37 | |
| *** sarob has quit IRC | 03:37 | |
| mordred | clarkb, fungi: ok, I _think_ that's right - but we should probably hammer on that merge a little better | 03:38 |
| *** timcline has quit IRC | 03:38 | |
| *** ryanpetrello has quit IRC | 03:39 | |
| *** asettle has quit IRC | 03:39 | |
| *** ivar-lazzaro has quit IRC | 03:39 | |
| *** Alexandra_ is now known as asettle | 03:40 | |
| *** ddieterly has quit IRC | 03:42 | |
| *** jerryz has joined #openstack-infra | 03:42 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for neutron bug 1403291 https://review.openstack.org/142324 | 03:44 |
| uvirtbot | Launchpad bug 1403291 in neutron "test_server_connectivity_pause_unpause fails with "AssertionError: False is not true : Timed out waiting for 172.24.4.64 to become reachable"" [Undecided,New] https://launchpad.net/bugs/1403291 | 03:44 |
| openstackgerrit | Merged openstack/requirements: Add tooz to project list to update https://review.openstack.org/140344 | 03:47 |
| *** carl_baldwin has quit IRC | 03:47 | |
| *** doug-fish1 has left #openstack-infra | 03:48 | |
| *** carl_baldwin has joined #openstack-infra | 03:48 | |
| *** unicell1 has joined #openstack-infra | 03:48 | |
| *** MarkAtwood has quit IRC | 03:48 | |
| *** Ryan_Lane has quit IRC | 03:49 | |
| *** unicell has quit IRC | 03:50 | |
| *** gokrokve has quit IRC | 03:50 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Move to pbr freeze from pip freeze https://review.openstack.org/142257 | 03:53 |
| *** sarob has joined #openstack-infra | 03:54 | |
| *** dkranz has quit IRC | 03:56 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Install python-magic on devstack slaves https://review.openstack.org/142327 | 03:57 |
| *** zz_sabari is now known as sabari | 03:59 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/system-config: Ensure python-magic is installed on all slaves https://review.openstack.org/142330 | 04:02 |
| jhesketh | If any cores are still around ^ should fix the devstack gate from failing... however I'm not sure where the best place is to put dependencies for devstack | 04:02 |
| jhesketh | ^ being 142327 | 04:02 |
| *** dimtruck is now known as zz_dimtruck | 04:03 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/reviewstats: Sync with current core group https://review.openstack.org/142332 | 04:03 |
| *** wenlock has quit IRC | 04:07 | |
| *** patrickeast has quit IRC | 04:09 | |
| *** salv-orlando has joined #openstack-infra | 04:09 | |
| *** unicell1 is now known as unicell | 04:10 | |
| *** unicell has joined #openstack-infra | 04:10 | |
| *** esker has joined #openstack-infra | 04:11 | |
| openstackgerrit | Tony Breeds proposed openstack-infra/reviewstats: Sync with current core group https://review.openstack.org/142332 | 04:11 |
| dstufft | fungi: does the fact that https://review.openstack.org/#/c/142320/ is passing tests mean it worked? | 04:13 |
| mordred | dstufft: not yet - that drives the beginning of image creation | 04:14 |
| fungi | dstufft: mordred: but 142322 does | 04:15 |
| mordred | jhesketh: looking | 04:15 |
| fungi | (the devstack revert) | 04:15 |
| dstufft | fungi: ok, that ones not done yet I guess | 04:15 |
| dstufft | will watch :D | 04:15 |
| mordred | fungi: do we want to change pip freeze to pbr freeze in devstack? did I push one of those up already? | 04:15 |
| fungi | mordred: i don't recall, and i've reached the point where i'll have to pick it back up tomorrow | 04:16 |
| mordred | yah | 04:16 |
| mordred | I'm actually wondering if we use the freeze stuff in devstack itself | 04:17 |
| mordred | there it is. devstack-gate | 04:17 |
| dstufft | hmm | 04:17 |
| dstufft | non voting failures on 142322 looking at status.o.o | 04:18 |
| *** ChuckC_ has joined #openstack-infra | 04:19 | |
| dstufft | hm | 04:20 |
| dstufft | "2.2.1c1.6" | 04:20 |
| *** ChuckC has quit IRC | 04:20 | |
| dstufft | swift :( | 04:20 |
| mordred | dstufft: hrm. why is that 2.2.1c1.6 I wonder ... oh, swift uses post versioning | 04:21 |
| mordred | and that may be post versioning after a pre-release tag | 04:22 |
| mordred | that's not great | 04:22 |
| dstufft | so that would work if they had used -6 or .post6 | 04:22 |
| dstufft | :( | 04:22 |
| mordred | they didn't use anything | 04:22 |
| mordred | they tagged something as 2.2.1rc1 | 04:23 |
| mordred | and since then, there have been 6 commits | 04:23 |
| dstufft | oh, and pbr jsut appends a .6 to it? | 04:23 |
| mordred | yup | 04:23 |
| mordred | it _used_ to make it 2.2.1c1.6.g$sha | 04:24 |
| mordred | also, I _think_ the lifeless patches make this bit better | 04:24 |
| dstufft | the swift thing wasn't an error, though it's going to trigger the < 0 because we can't parse it behavior | 04:25 |
| dstufft | the error that made them fail was pytz | 04:25 |
| dstufft | pytz 2012d was installed | 04:25 |
| mordred | our favorite | 04:25 |
| dstufft | and babel has a >=0a | 04:25 |
| dstufft | pytz>=0a | 04:25 |
| mordred | yah. that's our way to get it to install something | 04:26 |
| mordred | since they have bad versions | 04:26 |
| dstufft | they don't anymore! | 04:26 |
| dstufft | but the old ones are bad | 04:26 |
| mordred | ah! | 04:26 |
| dstufft | :( | 04:26 |
| mordred | we should fix that then - to my knowledge we don't need the old versions for any reason | 04:26 |
| *** carl_baldwin has quit IRC | 04:26 | |
| dstufft | but they switched from YYYYletter to YYYYY.N | 04:26 |
| dstufft | a = 1, b = 2, etc | 04:26 |
| mordred | but we should be able to do >=2012.4 | 04:27 |
| dstufft | yes | 04:27 |
| dstufft | 2013.6 is the first version they used the YYYY.N versioning on | 04:27 |
| *** zz_dimtruck is now known as dimtruck | 04:28 | |
| dstufft | but >=2012.4 will match that | 04:28 |
| mordred | ok. so the new pbr master fixes the swift version | 04:28 |
| dstufft | heh | 04:28 |
| dstufft | another problem -> some of the tests shell out and run some python code and then assert against the output | 04:29 |
| dstufft | and since ubuntu has some wierdo versioned stuff installed, setuptools warns about it | 04:29 |
| dstufft | messing up the output | 04:29 |
| dstufft | also the swift version | 04:29 |
| mordred | yeah | 04:29 |
| mordred | well, those versions are going to be aroudn until the end of time | 04:30 |
| *** stevemar has quit IRC | 04:30 | |
| dstufft | it's a python warning though | 04:30 |
| mordred | right | 04:30 |
| mordred | I'm just saying | 04:30 |
| dstufft | so you can suppress the warnings using an envvar | 04:30 |
| mordred | what's the var? | 04:30 |
| dstufft | uhhh | 04:30 |
| dstufft | moment | 04:30 |
| mordred | (also, this is going to make python on ubuntu/debian very ugly | 04:30 |
| mordred | because those aren't going to be going away | 04:30 |
| *** sabari is now known as zz_sabari | 04:30 | |
| dstufft | so this is the warning we added to warn people about things being parsed as non PEP 440 | 04:31 |
| mordred | right | 04:31 |
| dstufft | we could remove that warning | 04:31 |
| dstufft | not sure what's better | 04:31 |
| mordred | at some point are they going to be errors? | 04:31 |
| mordred | I suppose if you're managing your python with dpkg, you don't care about the setuptools version math, so it's not a big deal to suppress there | 04:32 |
| mordred | in that case | 04:32 |
| dstufft | no they'll never be errors | 04:32 |
| mordred | the mixed some-system/some-pip is gonna be ugly | 04:32 |
| mordred | because suppressing could suppress knowledge of a possible issue | 04:32 |
| dstufft | or well, in the foreseable future it won't be errors | 04:32 |
| dstufft | maybe someday we'll feel good enough about PEP 440 adoption to do that, but I don't forsee it | 04:33 |
| mordred | I would recommend not making it errors unless you want python to stop being usable on ubuntu | 04:33 |
| mordred | ubuntu and debian _cannot_ adopt pep440 | 04:33 |
| *** hdd has joined #openstack-infra | 04:34 | |
| mordred | but ... that's certainly not my problem right now | 04:34 |
| mordred | :) | 04:34 |
| dstufft | mordred: they can certainly put PEP440 versions inside the python metadata | 04:34 |
| mordred | but then they're lying | 04:34 |
| mordred | oh - unless you mean translating | 04:34 |
| dstufft | why is it lying to do a mechanical transformation | 04:34 |
| dstufft | yea | 04:34 |
| mordred | sorry, I mean trying to figure out how to get 1.2.0~0ubuntu1 into PEP440 | 04:35 |
| dstufft | wouldn't that be 1.2.0-0ubuntu1 | 04:36 |
| mordred | nope | 04:36 |
| mordred | oh, yeah | 04:36 |
| mordred | sorry | 04:36 |
| mordred | yes, what you said | 04:36 |
| dstufft | 1.2.0+0ubuntu1 | 04:36 |
| *** ryanpetrello has joined #openstack-infra | 04:36 | |
| mordred | k. then maybe it'll all be happy | 04:36 |
| mordred | how do they get that into the metadata? | 04:36 |
| mordred | you know what - nevermind - I have other fish | 04:37 |
| mordred | dstufft: 2.2.1.dev3 ... | 04:37 |
| dstufft | right now by patching the setup.py, but a future effort is going to be talking to downstream and asking them how they would prefer to inject it | 04:37 |
| mordred | dstufft: that's a dev version that's before 2.2.1, right? | 04:37 |
| dstufft | mordred: yes | 04:37 |
| mordred | dstufft: cool. thanks | 04:37 |
| dstufft | PYTHONWARNINGS=ignore::RuntimeWarning:pkg_resources | 04:38 |
| dstufft | I think | 04:38 |
| dstufft | maybe we should subclass RuntimeWArning and make a PEP440Warning | 04:38 |
| dstufft | https://docs.python.org/2/using/cmdline.html#cmdoption-W | 04:38 |
| mordred | cool. I have learned something | 04:38 |
| dstufft | that describes the -W command line option, anything you pass tot hat can be passed via PYTHONWARNINGS (comma seperated for multiple -W values) | 04:39 |
| *** Masahiro has quit IRC | 04:39 | |
| *** Ryan_Lane has joined #openstack-infra | 04:39 | |
| *** Masahiro has joined #openstack-infra | 04:40 | |
| *** emagana has quit IRC | 04:40 | |
| dstufft | (0.1.21-nmu2ubuntu2 is the wierdo ubuntu version that is causing output, so that's directly translatable to PEP 440 at least, and they must be injecting that somehow) | 04:40 |
| mordred | what's that a package of again? | 04:40 |
| dstufft | python-debian, so maybe it's something they maintain themselves | 04:41 |
| *** carl_baldwin has joined #openstack-infra | 04:42 | |
| dstufft | mordred: looks like all the current errors will be fixed by fixing the swift version thing and turning off the warnings | 04:42 |
| mordred | wow. it's awesoe to see how they're doing that | 04:42 |
| *** hdd_ has joined #openstack-infra | 04:42 | |
| dstufft | oh and pytz | 04:43 |
| *** hdd has quit IRC | 04:43 | |
| dstufft | those 3 times | 04:43 |
| dstufft | things | 04:43 |
| *** dimtruck is now known as zz_dimtruck | 04:43 | |
| mordred | dstufft: where were you seeing the pytz problem | 04:44 |
| dstufft | check-tempest-dsvm-f20 | 04:45 |
| dstufft | on https://review.openstack.org/#/c/142322/ | 04:45 |
| *** andreaf has quit IRC | 04:45 | |
| mordred | yup. I can't fix those | 04:46 |
| mordred | they're fedora | 04:46 |
| mordred | they're installed from OS pacakges | 04:46 |
| mordred | pytz and Babel | 04:46 |
| mordred | python-babel-1.3-3.fc20.noarch | 04:46 |
| *** andreaf has joined #openstack-infra | 04:46 | |
| mordred | pytz.noarch 0:2012d-5.fc20 | 04:46 |
| dstufft | lol | 04:48 |
| dstufft | of course | 04:48 |
| dstufft | :( | 04:48 |
| dstufft | mordred: what's the point of that test, can it just pip install --upgrade pytz? :V | 04:48 |
| mordred | dstufft: that's installing openstack | 04:48 |
| mordred | there are a set of things that devstack installs from distro packages | 04:49 |
| dstufft | why does it install some things from a distro package | 04:50 |
| mordred | history. always has. there was a point in time where we tried to install everything we could from distro packages and only install from pip if we had no other choice | 04:50 |
| mordred | that's still largely what happens there | 04:50 |
| mordred | ish | 04:51 |
| mordred | but the situation is unavoidable to a degree - there are python packages that are required by very basic os things - cloud-init for instance, requires python-requests | 04:51 |
| mordred | which means it's going to get pulled in from distro | 04:51 |
| dstufft | yea | 04:52 |
| dstufft | well, regardless, I should probably go bother fedora | 04:52 |
| mordred | yup. although that's fedora 20 | 04:52 |
| mordred | which isn't gonna get fixed | 04:52 |
| dstufft | oh, they don't fix fedora 20? | 04:52 |
| mordred | not like this they don't | 04:53 |
| mordred | distros only patch already released things with things liek security updates | 04:53 |
| mordred | certainly not behavioral changes | 04:53 |
| mordred | and not changes in how they might package things in the future | 04:53 |
| dstufft | I've had distros patch bugs | 04:54 |
| mordred | sdague, dtroyer: ^^ we may need to think MUCH harder about a global venv for devstack | 04:54 |
| mordred | we may be getting to a spot where using newer setuptools with _any_ python from distros may get very very broken | 04:54 |
| *** rediskin has quit IRC | 04:55 | |
| *** dmitryme has quit IRC | 04:55 | |
| *** otter768 has quit IRC | 04:55 | |
| *** timrc has quit IRC | 04:55 | |
| *** salv-orlando has quit IRC | 04:55 | |
| mordred | sdague: also, https://review.openstack.org/#/c/134732/ | 04:56 |
| mordred | sdague: I know you abandonded it | 04:56 |
| *** dmitryme has joined #openstack-infra | 04:56 | |
| mordred | but seriously ... | 04:56 |
| mordred | dstufft: that patch ^^ was my last attept to get devstack to stop installing python libraries from distro packages | 04:57 |
| *** zz_sabari is now known as sabari | 04:57 | |
| *** esker has quit IRC | 04:58 | |
| *** Shrews has quit IRC | 04:59 | |
| *** timrc has joined #openstack-infra | 05:00 | |
| *** Ryan_Lane has quit IRC | 05:01 | |
| *** sarob has quit IRC | 05:01 | |
| *** koolhead17 has joined #openstack-infra | 05:02 | |
| *** koolhead17 has joined #openstack-infra | 05:02 | |
| dstufft | mordred: so to move things forward with pytz, do we need to get something like 134732 in, or can we switch debstack to install pytz with pip | 05:03 |
| *** weshay has quit IRC | 05:03 | |
| mordred | well, it gets pulled in from Babel | 05:04 |
| dstufft | s/Babel/pytz then | 05:04 |
| mordred | we can probably land that change, yes - although that's going to be a longer term battle to deal with | 05:04 |
| mordred | and I think we'll need to come up with a strategy for dealing with it | 05:04 |
| *** sarob has joined #openstack-infra | 05:05 | |
| *** camunoz has quit IRC | 05:05 | |
| *** sarob has quit IRC | 05:05 | |
| *** camunoz has joined #openstack-infra | 05:05 | |
| *** talluri has joined #openstack-infra | 05:06 | |
| *** Ryan_Lane has joined #openstack-infra | 05:06 | |
| *** rediskin has joined #openstack-infra | 05:07 | |
| *** carl_baldwin has quit IRC | 05:09 | |
| *** sarob has joined #openstack-infra | 05:09 | |
| *** Ryan_Lane has quit IRC | 05:10 | |
| *** melwitt has joined #openstack-infra | 05:11 | |
| dstufft | mordred: so if I udnerstand correctly, horizon already installs babel via pip | 05:12 |
| *** carl_baldwin has joined #openstack-infra | 05:14 | |
| *** carl_baldwin has quit IRC | 05:15 | |
| mordred | yes | 05:16 |
| mordred | BUT - if babel is already installed via rpm | 05:16 |
| mordred | and -U isn't given | 05:16 |
| dstufft | ah right | 05:16 |
| dstufft | assuming it matches the version spec | 05:17 |
| dstufft | not sure waht the version spec is | 05:17 |
| mordred | I believe it's unbounded | 05:17 |
| dstufft | >=1.3 | 05:17 |
| mordred | oh, really? | 05:17 |
| mordred | oh - for babel | 05:17 |
| mordred | yeah, >=1.3 | 05:17 |
| dstufft | yea | 05:17 |
| *** hdd_ has quit IRC | 05:19 | |
| *** ryanpetrello has quit IRC | 05:22 | |
| dstufft | mordred: oh, couldn't global-requirements just get pytz>=2013.6 | 05:24 |
| dstufft | (that's the first version that was PEP 440 compat) | 05:24 |
| mordred | yah, I dont think that would be a problem | 05:25 |
| *** Sukhdev has joined #openstack-infra | 05:28 | |
| *** yaguang has quit IRC | 05:29 | |
| openstackgerrit | Donald Stufft proposed openstack/requirements: Ensure we have a PEP 440 compatible version of pytz https://review.openstack.org/142348 | 05:31 |
| dstufft | mordred: made a pr ^ | 05:33 |
| mordred | woot! | 05:33 |
| mordred | +2 | 05:33 |
| clarkb | how do we fix the swift thibg? | 05:35 |
| clarkb | will devN work? | 05:35 |
| clarkb | so 1.2.3c1.dev6 | 05:35 |
| dstufft | that is an acceptable PEP 440 version, but it it sorts before 1.2.3c1 | 05:36 |
| dstufft | as older | 05:36 |
| mordred | clarkb: it's fixed in the lifeless branch | 05:37 |
| mordred | we could also add "post" before the auto revno, right? | 05:37 |
| mordred | like 1.2.3c1.post6 is valid? | 05:37 |
| clarkb | but 1.2.3c1.6 is not valid... | 05:38 |
| dstufft | .post6 is valid yes | 05:38 |
| dstufft | and sorts after | 05:38 |
| clarkb | ok so further improvement needed but doable | 05:38 |
| dstufft | I think lifeless branch does 1.2.3.c2.dev6 | 05:39 |
| dstufft | er, minus one ot | 05:40 |
| dstufft | dot | 05:40 |
| clarkb | ya | 05:40 |
| clarkb | mordred http://www.opb.org/news/blog/newsblog/psu-unveils-zero-gravity-espresso-cup-for-all-your-caffeine-in-space-needs/ | 05:40 |
| clarkb | for when your visit mars as atourist | 05:41 |
| mordred | lifeless branch actually does 1.2.2.dev3 | 05:41 |
| mordred | or 1.2.3.dev3 I mean | 05:41 |
| mordred | because it gets much fancier with calculation | 05:41 |
| dstufft | mordred: oh | 05:42 |
| dstufft | ok | 05:42 |
| mordred | clarkb: I think doing the postX might be a good short term | 05:42 |
| clarkb | mordred ya I think the non lifeless change to do that is easy | 05:42 |
| clarkb | since you already switch on post vs pre | 05:43 |
| *** sarob has quit IRC | 05:44 | |
| mordred | clarkb: https://review.openstack.org/142351 | 05:44 |
| clarkb | +2 | 05:46 |
| *** yaguang has joined #openstack-infra | 05:46 | |
| dstufft | I gave my +1 for what little it's worth ;) | 05:47 |
| *** emagana has joined #openstack-infra | 05:51 | |
| *** emagana has quit IRC | 05:55 | |
| *** salv-orlando has joined #openstack-infra | 05:56 | |
| *** achanda has joined #openstack-infra | 06:01 | |
| jeblair | clarkb, fungi: set_description:jenkins01.openstack.org is queueing again; i stopped the tcpdumps, will examine tomorrow | 06:01 |
| *** salv-orlando has quit IRC | 06:01 | |
| *** hdd has joined #openstack-infra | 06:03 | |
| *** harlowja_at_home has joined #openstack-infra | 06:06 | |
| *** sabari is now known as zz_sabari | 06:12 | |
| harlowja_at_home | have u guys seen anything like 'NameError: name 'StandardError' is not defined' before; or recently? | 06:15 |
| harlowja_at_home | i'm seeing that from http://logs.openstack.org/37/142337/1/check//gate-tooz-tox-py34-mysql/100e11d/console.html | 06:16 |
| harlowja_at_home | which seems to be coming from sphinx :-/ | 06:16 |
| *** koolhead17 has quit IRC | 06:16 | |
| harlowja_at_home | bunch of other examples @ https://review.openstack.org/#/c/142337/ | 06:16 |
| harlowja_at_home | all py33/py34... | 06:17 |
| *** vigneshvar has joined #openstack-infra | 06:17 | |
| *** asettle has quit IRC | 06:17 | |
| harlowja_at_home | seems to be happening to most anyone (from a sample of 2 reviews) with py33/py34 | 06:18 |
| *** zz_sabari is now known as sabari | 06:19 | |
| *** yfried has joined #openstack-infra | 06:19 | |
| *** dannywilson has joined #openstack-infra | 06:26 | |
| *** harlowja_at_home has quit IRC | 06:26 | |
| *** dannywilson has quit IRC | 06:30 | |
| *** avozza is now known as zz_avozza | 06:32 | |
| *** dims has joined #openstack-infra | 06:34 | |
| *** dims has quit IRC | 06:39 | |
| *** achanda has quit IRC | 06:40 | |
| *** achanda has joined #openstack-infra | 06:41 | |
| *** hdd has quit IRC | 06:41 | |
| *** rlandy has joined #openstack-infra | 06:42 | |
| *** reed has quit IRC | 06:44 | |
| *** achanda_ has joined #openstack-infra | 06:45 | |
| *** achanda has quit IRC | 06:45 | |
| *** garyk has joined #openstack-infra | 06:47 | |
| *** achanda_ has quit IRC | 06:48 | |
| *** yamamoto has quit IRC | 06:51 | |
| *** jgallard_ has joined #openstack-infra | 06:52 | |
| *** otter768 has joined #openstack-infra | 06:56 | |
| *** Shrews has joined #openstack-infra | 06:59 | |
| *** sputnik13 has joined #openstack-infra | 07:00 | |
| *** otter768 has quit IRC | 07:01 | |
| *** liam_ has joined #openstack-infra | 07:06 | |
| *** liam_ is now known as Guest72494 | 07:06 | |
| *** ryanpetrello has joined #openstack-infra | 07:08 | |
| *** ryanpetrello has quit IRC | 07:13 | |
| *** pcaruana has joined #openstack-infra | 07:16 | |
| *** yamamoto has joined #openstack-infra | 07:16 | |
| *** AJaeger has joined #openstack-infra | 07:17 | |
| *** dannywilson has joined #openstack-infra | 07:19 | |
| *** dannywilson has quit IRC | 07:20 | |
| *** belmoreira has joined #openstack-infra | 07:21 | |
| *** sputnik13 has quit IRC | 07:23 | |
| *** sputnik13 has joined #openstack-infra | 07:23 | |
| *** armax has quit IRC | 07:26 | |
| *** Sukhdev has quit IRC | 07:28 | |
| *** mrunge has joined #openstack-infra | 07:32 | |
| *** Ala has joined #openstack-infra | 07:33 | |
| *** achanda has joined #openstack-infra | 07:35 | |
| *** berendt has joined #openstack-infra | 07:39 | |
| *** yamamoto has quit IRC | 07:43 | |
| *** naggappan has joined #openstack-infra | 07:46 | |
| *** _nadya_ has joined #openstack-infra | 07:46 | |
| *** mrmartin has joined #openstack-infra | 07:47 | |
| *** melwitt has quit IRC | 07:50 | |
| *** _nadya_ has quit IRC | 07:52 | |
| *** talluri has quit IRC | 07:54 | |
| *** achanda has quit IRC | 07:55 | |
| *** achanda has joined #openstack-infra | 07:56 | |
| *** pblaho has joined #openstack-infra | 07:57 | |
| *** achanda has quit IRC | 08:01 | |
| *** achanda has joined #openstack-infra | 08:02 | |
| *** pcrews has quit IRC | 08:04 | |
| *** e0ne has joined #openstack-infra | 08:05 | |
| *** e0ne has quit IRC | 08:07 | |
| *** pcrews has joined #openstack-infra | 08:07 | |
| *** bdpayne has quit IRC | 08:07 | |
| *** bdpayne has joined #openstack-infra | 08:09 | |
| *** Guest51388 has joined #openstack-infra | 08:12 | |
| *** pcrews has quit IRC | 08:13 | |
| *** arxcruz has joined #openstack-infra | 08:18 | |
| *** yamamoto has joined #openstack-infra | 08:19 | |
| *** mpaolino has joined #openstack-infra | 08:19 | |
| *** yfried is now known as yfried|afk | 08:20 | |
| *** yfried|afk is now known as yfried | 08:24 | |
| *** matel has joined #openstack-infra | 08:24 | |
| *** jedimike has joined #openstack-infra | 08:25 | |
| *** HeOS has quit IRC | 08:26 | |
| *** jcoufal has joined #openstack-infra | 08:30 | |
| *** yamamoto has quit IRC | 08:30 | |
| *** bhunter71 has quit IRC | 08:31 | |
| *** Longgeek has joined #openstack-infra | 08:33 | |
| *** amuller has joined #openstack-infra | 08:34 | |
| *** wuhg has joined #openstack-infra | 08:37 | |
| garyk | AJaeger: you have a few secs for some question. I am in the process of creating the git history. Any idea how long this should take? The script (similar to the oslo incubabator one) is running for nearly over an hour | 08:41 |
| *** _nadya_ has joined #openstack-infra | 08:42 | |
| AJaeger | garyk: it takes some time to run. | 08:43 |
| AJaeger | neutron is a large repo but an hour looks rather long. | 08:44 |
| AJaeger | Is it really doing something? | 08:44 |
| AJaeger | I haven't used that script, so can't help with it | 08:44 |
| garyk | AJaeger: from the trace I am getting: 2014-12-17 00:44:28 /usr/lib/git-core/git-filter-branch: 2: [: 4deaa53bafae2210e0789d6617c5e6e8b8079fa1: unexpected operator | 08:44 |
| garyk | Rewrite e75ae7f6b636e11c6a78309d1dcba8753053d063 (2019/8964).bzrignore | 08:44 |
| garyk | I guess that it is running over all of the commits ever and exclusing the ones that are not related to the files that I am keeping. | 08:45 |
| AJaeger | garyk: yeah, exactly | 08:46 |
| AJaeger | that trace looks bad | 08:46 |
| AJaeger | the rewrite is a fourth done and as long as it continues, it's fine - that takes very long | 08:47 |
| AJaeger | how did you invoke tools/split.sh ? | 08:48 |
| *** tnovacik has joined #openstack-infra | 08:49 | |
| garyk | AJaeger: i am running a tweaked script - https://raw.githubusercontent.com/dougwig/split-repo/master/service-split.sh | 08:49 |
| *** ajo has joined #openstack-infra | 08:49 | |
| *** talluri has joined #openstack-infra | 08:50 | |
| AJaeger | garyk: discuss the trace with dougwig - and once your repo is done, publish it somewhere and check that it looks sane... | 08:51 |
| garyk | AJaeger: ok, will do. | 08:52 |
| *** ChuckC_ is now known as ChuckC | 08:52 | |
| ajo | garyk, is the gate ok? I found one of my jobs gone and strange spikes in the zuul job queue | 08:53 |
| ajo | morning btw ;) | 08:54 |
| *** Guest24100 has quit IRC | 08:56 | |
| *** Guest24100 has joined #openstack-infra | 08:56 | |
| *** otter768 has joined #openstack-infra | 08:56 | |
| *** ryanpetrello has joined #openstack-infra | 08:57 | |
| *** jpich has joined #openstack-infra | 08:58 | |
| garyk | ajo: i am not sure - i have been trying to get a +1 for about 48 hours to no avail | 08:59 |
| *** sabari is now known as zz_sabari | 08:59 | |
| *** tnovacik has quit IRC | 08:59 | |
| *** Masahiro has quit IRC | 09:00 | |
| *** andreykurilin_ has joined #openstack-infra | 09:00 | |
| *** Masahiro has joined #openstack-infra | 09:00 | |
| *** _nadya_ has quit IRC | 09:01 | |
| *** ryanpetrello has quit IRC | 09:01 | |
| *** otter768 has quit IRC | 09:02 | |
| *** _nadya_ has joined #openstack-infra | 09:05 | |
| *** Masahiro has quit IRC | 09:05 | |
| *** bdpayne has quit IRC | 09:06 | |
| *** tnovacik has joined #openstack-infra | 09:06 | |
| *** hashar has joined #openstack-infra | 09:08 | |
| garyk | AJaeger: the command that is taking forever is git filter-branch. I guess i will just try and be patient.... | 09:08 |
| AJaeger | garyk: yeah, as long as it counts up... | 09:08 |
| garyk | ajo: gate seems fine now - all those rechecked from this morning pass. | 09:09 |
| ajo | garyk, yes, I just discovered than my last recheck is at least running | 09:09 |
| ajo | thanks | 09:09 |
| garyk | AJaeger: most of the code that we are pushing to the branch will be refactored - i am not really sure what value the history will have - that is currently in the neutron branch. but i am trying | 09:09 |
| *** jgallard_ has quit IRC | 09:10 | |
| *** MaxV has joined #openstack-infra | 09:10 | |
| *** jgallard_ has joined #openstack-infra | 09:10 | |
| *** Masahiro has joined #openstack-infra | 09:12 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/storyboard: Return task count by status for a story dynamically https://review.openstack.org/139100 | 09:12 |
| *** tnovacik has quit IRC | 09:13 | |
| *** BobBall_AWOL is now known as BobBall | 09:13 | |
| *** derekh has joined #openstack-infra | 09:16 | |
| *** _nadya_ has quit IRC | 09:16 | |
| *** mrunge has quit IRC | 09:18 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/infra-specs: Add nodepool image testing spec. https://review.openstack.org/139598 | 09:21 |
| *** zz_avozza is now known as avozza | 09:23 | |
| garyk | AJaeger: problem was logging in the scrip - there are 8K neutron commits - i removed the logging and script runs a lot faster - it is 90% done… oh well. | 09:24 |
| *** mrunge has joined #openstack-infra | 09:25 | |
| *** mrunge has joined #openstack-infra | 09:25 | |
| *** achanda has quit IRC | 09:28 | |
| *** praveenkumar has joined #openstack-infra | 09:30 | |
| *** yamamoto has joined #openstack-infra | 09:31 | |
| *** tnovacik has joined #openstack-infra | 09:33 | |
| praveenkumar | Can someone please tell me what's wrong with http://paste.fedoraproject.org/160493/14188087 JJB template? | 09:33 |
| praveenkumar | I am getting error http://fpaste.org/160494/ | 09:34 |
| *** achanda has joined #openstack-infra | 09:34 | |
| hashar | praveenkumar: the string in dsl: | is passed to python str.format() | 09:35 |
| hashar | praveenkumar: so {someparam} is expanded based on a dict like { 'someparam': 'myvalue' } | 09:35 |
| hashar | I think that is it | 09:35 |
| *** yamamoto has quit IRC | 09:36 | |
| praveenkumar | hashar: so {name} value I already passed in project section, but it causing issue in param[] section. | 09:37 |
| hashar | ohh | 09:38 |
| *** teran_ has joined #openstack-infra | 09:39 | |
| praveenkumar | hashar: is it also evalute dsl because I think it should just convert dsl section to string after key values and put under dsl section. | 09:39 |
| hashar | I am not sure how to prevent params evaluation | 09:41 |
| hashar | anyway you will need it to evaluate {name} | 09:41 |
| *** teran has quit IRC | 09:41 | |
| AJaeger | praveenkumar: you might need to change the "{" to "{{" for quoting | 09:41 |
| hashar | so the best thing would be to escape the curly braces by doubling them: { -> {{ | 09:41 |
| hashar | that is how curly braces are escaped with python str.format() | 09:41 |
| hashar | AJaeger: +1 :] | 09:42 |
| praveenkumar | AJaeger: hashar alright, let me try that also. | 09:42 |
| *** e0ne has joined #openstack-infra | 09:42 | |
| hashar | that pass on my setup | 09:42 |
| hashar | though I have no idea whether the resulting XML is valid / doing what is expected :] | 09:42 |
| *** HeOS has joined #openstack-infra | 09:44 | |
| *** salv-orlando has joined #openstack-infra | 09:44 | |
| praveenkumar | AJaeger: hashar: http://paste.fedoraproject.org/160498/80943814 made changes as suggested but still failing to eval "GERRIT_HOST parameter missing to format parallel". | 09:44 |
| AJaeger | praveenkumar: write: | 09:45 |
| AJaeger | {{ build( "{name}-pep8", | 09:45 |
| *** acruz_ has joined #openstack-infra | 09:45 | |
| praveenkumar | AJaeger: oh alright and end with '}}' | 09:45 |
| *** acruz_ has quit IRC | 09:45 | |
| AJaeger | you quoted the wrong string | 09:45 |
| AJaeger | sure ;9 | 09:45 |
| *** acruz_ has joined #openstack-infra | 09:46 | |
| hashar | yeah sorry for the misleading info :D | 09:46 |
| hashar | tried it, it works | 09:46 |
| matel | Hi guys, anyone experienced issues with iptables - applying puppet config fails, with error 6: http://paste.openstack.org/show/152218/ | 09:46 |
| matel | something like Could not start Service[iptables]: Execution of '/etc/init.d/iptables-persistent start' returned 1: * Loading iptables rules... | 09:46 |
| hashar | praveenkumar: that yields some XML http://paste.openstack.org/show/152219/ | 09:46 |
| *** teran_ has quit IRC | 09:47 | |
| *** arxcruz has quit IRC | 09:47 | |
| *** acruz_ is now known as arxcruz | 09:47 | |
| hashar | the example at http://ci.openstack.org/jenkins-job-builder/project_flow.html probably need to mention it when using a job-template | 09:47 |
| praveenkumar | hashar: I thing generated xml look file | 09:47 |
| *** acruz_ has joined #openstack-infra | 09:47 | |
| praveenkumar | hashar: yes, exactly my point | 09:47 |
| praveenkumar | hashar: here also they used parallel build without any '{{ }}' so may be this need an update. | 09:48 |
| AJaeger | praveenkumar: Quoting for a template and quoting for a job is different! | 09:48 |
| AJaeger | A template needs variable expansion, a job not. | 09:49 |
| *** arxcruz has quit IRC | 09:49 | |
| AJaeger | So, the example is a job and thus does not need quoting. | 09:49 |
| hashar | praveenkumar: you can git clone ssh://review.openstack.org:29418/openstack-infra/jenkins-job-builder.git and edit jenkins_jobs/modules/project_flow.py :-] | 09:49 |
| *** acruz_ is now known as arxcruz | 09:49 | |
| *** salv-orlando has quit IRC | 09:49 | |
| AJaeger | matel: no idea. Which job is this? | 09:49 |
| hashar | the double curly braces are definitely documented somewhere | 09:49 |
| praveenkumar | AJaeger: ah alright, so may be an example needed for job_template for flow project type. | 09:50 |
| hashar | would not hurt to have it repeated on the Flow Project module description as well | 09:50 |
| hashar | praveenkumar: +1 :] | 09:50 |
| openstackgerrit | yolanda.robla proposed openstack-infra/storyboard: Return task count by status for a story dynamically https://review.openstack.org/139100 | 09:50 |
| matel | AJaeger: it's our own nodepool. | 09:50 |
| hashar | matel: no idea sorry might be a transient issue with one of the cloud providers | 09:50 |
| praveenkumar | hashar: I will try to send a example patch set for this. | 09:51 |
| matel | AJaeger: but we use upstream wherever we can. | 09:51 |
| matel | AJaeger: I will try to re-build it again. | 09:51 |
| *** ssam2 has joined #openstack-infra | 09:53 | |
| *** mrunge has quit IRC | 09:53 | |
| AJaeger | matel: I can't help with nodepool, hope others can. | 09:54 |
| matel | AJaeger: i think it's mainly a puppet related issue, the module that does the iptables magic. | 09:54 |
| matel | hashar: thanks, I am re-building it again, but I don't think it has anything to do with the cloud provider. | 09:55 |
| hashar | matel: I have no clue really. Just suspecting :] Maybe the image is lacking IPv6 support | 09:56 |
| hashar | matel: I am afraid you will have to wait for East coasters to wake up | 09:56 |
| hashar | (US east coasters) | 09:56 |
| *** ihrachyshka has joined #openstack-infra | 09:56 | |
| matel | hashar: thanks, will look into it, maybe I find the issue. | 09:56 |
| openstackgerrit | Nikita Konovalov proposed openstack-infra/python-storyboardclient: Added logging and i18n dependencies https://review.openstack.org/142400 | 09:57 |
| *** teran has joined #openstack-infra | 09:59 | |
| *** avozza is now known as zz_avozza | 09:59 | |
| *** yamamoto has joined #openstack-infra | 10:00 | |
| *** mrunge has joined #openstack-infra | 10:00 | |
| *** achanda has quit IRC | 10:01 | |
| *** achanda has joined #openstack-infra | 10:02 | |
| *** tnovacik has quit IRC | 10:03 | |
| *** teran has quit IRC | 10:03 | |
| *** lifeless_ is now known as lifeless | 10:04 | |
| *** jamielennox is now known as jamielennox|away | 10:04 | |
| *** skolekonov has joined #openstack-infra | 10:06 | |
| *** adalbas has joined #openstack-infra | 10:06 | |
| *** achanda has quit IRC | 10:07 | |
| *** adalbas has quit IRC | 10:08 | |
| *** ociuhandu has joined #openstack-infra | 10:08 | |
| *** zz_avozza is now known as avozza | 10:08 | |
| *** garyk has left #openstack-infra | 10:10 | |
| *** AJaeger has quit IRC | 10:10 | |
| *** zz_johnthetubagu is now known as johnthetubaguy | 10:13 | |
| *** akuznetsova has left #openstack-infra | 10:14 | |
| *** liusheng has quit IRC | 10:21 | |
| *** jamielennox|away is now known as jamielennox | 10:21 | |
| *** liusheng has joined #openstack-infra | 10:21 | |
| *** e0ne is now known as e0ne_ | 10:21 | |
| *** jp_at_hp has joined #openstack-infra | 10:22 | |
| *** mrmartin has quit IRC | 10:22 | |
| *** e0ne_ is now known as e0ne | 10:23 | |
| openstackgerrit | Nikita Konovalov proposed openstack-infra/python-storyboardclient: Setting up base classes https://review.openstack.org/138092 | 10:25 |
| *** ociuhandu has quit IRC | 10:26 | |
| openstackgerrit | Nikita Konovalov proposed openstack-infra/python-storyboardclient: Added required dependencies https://review.openstack.org/142400 | 10:27 |
| openstackgerrit | Nikita Konovalov proposed openstack-infra/python-storyboardclient: Setting up base classes https://review.openstack.org/138092 | 10:28 |
| *** Masahiro has quit IRC | 10:32 | |
| *** talluri has quit IRC | 10:33 | |
| *** e0ne is now known as e0ne_ | 10:33 | |
| *** yamamoto has quit IRC | 10:39 | |
| *** alexpilotti has joined #openstack-infra | 10:41 | |
| *** e0ne_ is now known as e0ne | 10:42 | |
| *** yamamoto has joined #openstack-infra | 10:42 | |
| *** unicell has quit IRC | 10:45 | |
| *** unicell has joined #openstack-infra | 10:46 | |
| *** ryanpetrello has joined #openstack-infra | 10:46 | |
| *** talluri has joined #openstack-infra | 10:49 | |
| *** jamielennox is now known as jamielennox|away | 10:51 | |
| *** ryanpetrello has quit IRC | 10:51 | |
| *** otter768 has joined #openstack-infra | 10:57 | |
| *** jgallard_ has quit IRC | 10:58 | |
| *** ZZelle has quit IRC | 10:58 | |
| *** ZZelle has joined #openstack-infra | 10:58 | |
| *** otter768 has quit IRC | 11:02 | |
| *** hashar has quit IRC | 11:03 | |
| *** yamamoto has quit IRC | 11:03 | |
| openstackgerrit | garyk proposed openstack-infra/project-config: Add VMware-NSX to StackForge https://review.openstack.org/140409 | 11:13 |
| *** garyk has joined #openstack-infra | 11:14 | |
| *** andreykurilin_ has quit IRC | 11:18 | |
| openstackgerrit | Mauro Rodrigues proposed openstack-infra/elastic-recheck: Update query for Bug #1365046 https://review.openstack.org/142169 | 11:25 |
| uvirtbot | Launchpad bug 1365046 in openstack-gate "Job failed due to no devstack directory" [Undecided,Confirmed] https://launchpad.net/bugs/1365046 | 11:25 |
| *** garyk has quit IRC | 11:27 | |
| *** teran has joined #openstack-infra | 11:28 | |
| *** teran has quit IRC | 11:32 | |
| *** Masahiro has joined #openstack-infra | 11:33 | |
| *** praveenkumar has quit IRC | 11:35 | |
| *** teran has joined #openstack-infra | 11:35 | |
| *** mpaolino has quit IRC | 11:38 | |
| *** Masahiro has quit IRC | 11:38 | |
| *** ajo has quit IRC | 11:39 | |
| *** ajo has joined #openstack-infra | 11:39 | |
| *** hashar has joined #openstack-infra | 11:43 | |
| *** pc_m has joined #openstack-infra | 11:45 | |
| *** hashar has quit IRC | 11:46 | |
| mika | hm, how do you manage to get those "Jenkins check", "IBM PowerKVM CI check", etc subsections on gerrit, like on https://review.openstack.org/#/c/141973/ ? is this some special configuration of gerrit? is zuul reporting that? | 11:46 |
| *** ociuhandu has joined #openstack-infra | 11:47 | |
| *** aysyd has joined #openstack-infra | 11:49 | |
| *** e0ne is now known as e0ne_ | 11:49 | |
| *** ociuhandu has quit IRC | 11:52 | |
| *** dims has joined #openstack-infra | 11:55 | |
| *** adalbas has joined #openstack-infra | 11:55 | |
| *** Guest24100 is now known as Bob | 11:56 | |
| *** Bob is now known as Bob2 | 11:56 | |
| *** Bob2 is now known as Bob1 | 11:56 | |
| *** ociuhandu has joined #openstack-infra | 11:57 | |
| *** e0ne_ has quit IRC | 12:00 | |
| *** yaguang has quit IRC | 12:01 | |
| *** salv-orlando has joined #openstack-infra | 12:01 | |
| *** erlon has joined #openstack-infra | 12:02 | |
| *** matel is now known as matel_eating | 12:02 | |
| *** yamamoto has joined #openstack-infra | 12:04 | |
| *** garyk has joined #openstack-infra | 12:04 | |
| *** salv-orlando has quit IRC | 12:05 | |
| *** salv-orlando has joined #openstack-infra | 12:05 | |
| *** dmsimard_away is now known as dmsimard | 12:06 | |
| *** salv-orlando has quit IRC | 12:07 | |
| *** salv-orlando has joined #openstack-infra | 12:08 | |
| *** ddieterly has joined #openstack-infra | 12:08 | |
| *** yamamoto has quit IRC | 12:09 | |
| openstackgerrit | Christian Berendt proposed openstack/requirements: Bump version of openstack-doc-tools >= 0.21 https://review.openstack.org/142076 | 12:10 |
| *** salv-orlando has quit IRC | 12:10 | |
| *** talluri has quit IRC | 12:12 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: move oslo.version to attic https://review.openstack.org/141812 | 12:16 |
| *** amitgandhinz has joined #openstack-infra | 12:17 | |
| *** afazekas has joined #openstack-infra | 12:21 | |
| *** AJaeger has joined #openstack-infra | 12:22 | |
| *** cnesa has joined #openstack-infra | 12:27 | |
| *** doug-fish has joined #openstack-infra | 12:28 | |
| *** MaxV_ has joined #openstack-infra | 12:29 | |
| *** ajo_ has joined #openstack-infra | 12:29 | |
| *** ajo has quit IRC | 12:30 | |
| *** [HeOS] has joined #openstack-infra | 12:31 | |
| *** cnesa2 has joined #openstack-infra | 12:31 | |
| *** cnesa has quit IRC | 12:31 | |
| *** HeOS has quit IRC | 12:31 | |
| *** [HeOS] is now known as HeOS | 12:32 | |
| *** MaxV has quit IRC | 12:32 | |
| *** praveenkumar has joined #openstack-infra | 12:33 | |
| *** baoli has joined #openstack-infra | 12:33 | |
| *** baoli has quit IRC | 12:33 | |
| *** baoli has joined #openstack-infra | 12:34 | |
| *** igorbelikov has joined #openstack-infra | 12:34 | |
| *** ryanpetrello has joined #openstack-infra | 12:35 | |
| *** BobBall has quit IRC | 12:36 | |
| *** matel_eating is now known as matel | 12:36 | |
| *** yamamoto has joined #openstack-infra | 12:38 | |
| *** ryanpetrello has quit IRC | 12:39 | |
| *** lttrl has joined #openstack-infra | 12:40 | |
| *** yamamoto has quit IRC | 12:41 | |
| *** yamamoto has joined #openstack-infra | 12:41 | |
| *** yamamoto has quit IRC | 12:42 | |
| *** Masahiro has joined #openstack-infra | 12:49 | |
| gilliard | mika: they are added by a javascript overlay. Check the file hideci.js in your browser. | 12:49 |
| *** bobba has joined #openstack-infra | 12:51 | |
| *** dprince has joined #openstack-infra | 12:52 | |
| *** hashar has joined #openstack-infra | 12:52 | |
| *** mase_x200 has joined #openstack-infra | 12:53 | |
| *** Masahiro has quit IRC | 12:54 | |
| bookwar | hi everyone, can you please check what's happening with merge-check pipeline: http://status.openstack.org/zuul/ we have stackforge/fuel-main pending there for a long time | 12:56 |
| AJaeger | bookwar: for 13min, correct? | 12:57 |
| AJaeger | bookwar: upper left corner shows "Queue lengths: 77 events, 136 results." | 12:57 |
| AJaeger | And all nodes are busy, so will take a bit longer | 12:58 |
| AJaeger | merge-check is nothing that should stop you, no need to wait for it, just continue coding ;) | 12:58 |
| *** otter768 has joined #openstack-infra | 12:58 | |
| bookwar | AJaeger: yes, sorry, i misunderstood, i thought this is the pipeline which prevents merging | 12:59 |
| bookwar | but it is only the checker for unmerged commits | 12:59 |
| *** nfedotov has joined #openstack-infra | 13:00 | |
| *** ildikov has quit IRC | 13:01 | |
| openstackgerrit | Ricardo Carrillo Cruz proposed openstack-infra/infra-specs: Create Nodepool REST API spec https://review.openstack.org/141016 | 13:02 |
| *** otter768 has quit IRC | 13:03 | |
| AJaeger | bookwar: correct | 13:04 |
| *** imcsk8 has quit IRC | 13:05 | |
| *** imcsk8 has joined #openstack-infra | 13:05 | |
| *** vipul has quit IRC | 13:05 | |
| *** jgallard_ has joined #openstack-infra | 13:05 | |
| *** jesusaurus has quit IRC | 13:05 | |
| *** amotoki has joined #openstack-infra | 13:08 | |
| *** weshay has joined #openstack-infra | 13:08 | |
| *** lucasagomes has joined #openstack-infra | 13:09 | |
| Shrews | fungi: hi! | 13:09 |
| *** e0ne has joined #openstack-infra | 13:09 | |
| *** fandi has joined #openstack-infra | 13:09 | |
| garyk | AJaeger: i have addressed your comments - please see https://review.openstack.org/140409 - this has a git repo with the history | 13:10 |
| AJaeger | great, garyk! Will review later | 13:10 |
| lucasagomes | fungi, hi there. Once you have a time mind taking a look at https://review.openstack.org/#/c/139374/ ? I understand it was mostly a find&replace for all projects | 13:10 |
| *** vipul has joined #openstack-infra | 13:10 | |
| garyk | AJaeger: thanks! | 13:11 |
| *** talluri has joined #openstack-infra | 13:12 | |
| *** belmoreira has quit IRC | 13:13 | |
| *** ildikov has joined #openstack-infra | 13:13 | |
| *** _buzz has quit IRC | 13:15 | |
| *** talluri_ has joined #openstack-infra | 13:16 | |
| *** talluri has quit IRC | 13:17 | |
| *** ssam2 has quit IRC | 13:17 | |
| *** jesusaurus has joined #openstack-infra | 13:18 | |
| sdague | bookwar: it checks for merge conflicts in unmerged patches | 13:19 |
| *** afazekas has quit IRC | 13:20 | |
| *** kashyap has quit IRC | 13:20 | |
| *** kgiusti has joined #openstack-infra | 13:22 | |
| *** kevinbenton has quit IRC | 13:23 | |
| *** kashyap has joined #openstack-infra | 13:25 | |
| *** kevinbenton has joined #openstack-infra | 13:25 | |
| *** mbacchi has joined #openstack-infra | 13:26 | |
| *** afazekas has joined #openstack-infra | 13:26 | |
| *** ssam2 has joined #openstack-infra | 13:31 | |
| *** tkelsey has joined #openstack-infra | 13:36 | |
| *** mjturek has joined #openstack-infra | 13:37 | |
| *** yamamoto has joined #openstack-infra | 13:42 | |
| *** vigneshvar has quit IRC | 13:43 | |
| *** dkliban_afk is now known as dkliban | 13:43 | |
| *** mpaolino has joined #openstack-infra | 13:45 | |
| mika | gilliard: thanks for the hint, nice trick :) | 13:47 |
| *** jcoufal_ has joined #openstack-infra | 13:47 | |
| *** yamamoto has quit IRC | 13:47 | |
| *** cdent has joined #openstack-infra | 13:49 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/project-config: openstack/requirements stable branch ACL update https://review.openstack.org/142446 | 13:49 |
| *** che-arne has joined #openstack-infra | 13:49 | |
| *** jcoufal has quit IRC | 13:50 | |
| *** hdd has joined #openstack-infra | 13:50 | |
| *** mrunge has quit IRC | 13:51 | |
| *** vdo has joined #openstack-infra | 13:52 | |
| *** jaypipes has joined #openstack-infra | 13:52 | |
| *** vdo has quit IRC | 13:52 | |
| *** vdo has joined #openstack-infra | 13:52 | |
| *** berendt has quit IRC | 13:52 | |
| *** vdo is now known as vdo_ | 13:53 | |
| *** vdo_ is now known as vdo | 13:54 | |
| *** vdo has quit IRC | 13:54 | |
| *** vdo has joined #openstack-infra | 13:54 | |
| gilliard | woah did gerrit just update? | 13:56 |
| *** talluri_ has quit IRC | 14:00 | |
| *** talluri has joined #openstack-infra | 14:01 | |
| garyk | AJaeger: i blew away the 'nsx' branch. that was my bad | 14:02 |
| *** mpaolino has quit IRC | 14:03 | |
| *** esker has joined #openstack-infra | 14:03 | |
| *** dmsimard is now known as dmsimard_away | 14:04 | |
| *** dpaterson has joined #openstack-infra | 14:06 | |
| annegentle | is it 1500 UTC now? | 14:06 |
| gilliard | 1400 | 14:07 |
| *** miqui has joined #openstack-infra | 14:07 | |
| annegentle | thanks gilliard :) | 14:07 |
| gilliard | I live in UTC so it's an easy one :) | 14:07 |
| *** julim has joined #openstack-infra | 14:07 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 14:09 | |
| *** emagana has joined #openstack-infra | 14:09 | |
| *** radez_g0n3 is now known as radez | 14:11 | |
| mestery | anteaya: Regarding https://review.openstack.org/#/c/140409/, I have given my +1 now. I think garyk is on the right track there. | 14:11 |
| *** mfink has quit IRC | 14:12 | |
| *** mpaolino has joined #openstack-infra | 14:13 | |
| *** doug-fish has quit IRC | 14:15 | |
| *** dustins has joined #openstack-infra | 14:16 | |
| *** ala_ has joined #openstack-infra | 14:17 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Update query for Bug #1365046 https://review.openstack.org/142169 | 14:18 |
| uvirtbot | Launchpad bug 1365046 in openstack-gate "Job failed due to no devstack directory" [Undecided,Confirmed] https://launchpad.net/bugs/1365046 | 14:18 |
| *** esker has quit IRC | 14:18 | |
| *** ddieterly has quit IRC | 14:18 | |
| *** mfink has joined #openstack-infra | 14:19 | |
| *** esker has joined #openstack-infra | 14:19 | |
| *** ddieterly has joined #openstack-infra | 14:19 | |
| *** Ala has quit IRC | 14:19 | |
| *** mattfarina has joined #openstack-infra | 14:20 | |
| *** ala_ has quit IRC | 14:20 | |
| *** Ala has joined #openstack-infra | 14:20 | |
| AJaeger | garyk: cool! | 14:21 |
| AJaeger | mestery: Yeah, 140409 looks fine now. I can't check all the content of the upstream repo | 14:22 |
| mestery | AJaeger: I trust garyk has this all working smoothly now. :) | 14:23 |
| *** ddieterly has quit IRC | 14:23 | |
| *** dkranz has joined #openstack-infra | 14:29 | |
| *** e0ne is now known as e0ne_ | 14:29 | |
| *** mpaolino has quit IRC | 14:29 | |
| *** resker has joined #openstack-infra | 14:30 | |
| *** esker has quit IRC | 14:30 | |
| *** e0ne_ is now known as e0ne | 14:31 | |
| *** erikmwilson has joined #openstack-infra | 14:31 | |
| sdague | so something remains very odd with zuul's event queue | 14:32 |
| *** resker has quit IRC | 14:33 | |
| *** Sincler has quit IRC | 14:34 | |
| *** dizquierdo has joined #openstack-infra | 14:35 | |
| *** mase_x200 has quit IRC | 14:35 | |
| *** hdd has quit IRC | 14:36 | |
| *** mtanino has joined #openstack-infra | 14:37 | |
| fungi | Shrews: what up? | 14:37 |
| AJaeger | sdague: yeah, looking at it yesterday it seem driven by a cron job running every 15 mins | 14:37 |
| AJaeger | but I didn't look close enough or long enough, just looked odd | 14:37 |
| Shrews | fungi: was just going to query you about 13937 | 14:37 |
| AJaeger | sorry, just anecdotal reference | 14:38 |
| *** AJaeger has quit IRC | 14:38 | |
| *** Masahiro has joined #openstack-infra | 14:38 | |
| Shrews | fungi: mostly if you'd mind if i made a change for you since that seemed like a global search/replace through all projects | 14:38 |
| *** nelsnelson has joined #openstack-infra | 14:39 | |
| Shrews | fungi: sorry, 139374 | 14:40 |
| * Shrews needs more coffee before cut & paste will work correctly | 14:41 | |
| *** ssam2 has quit IRC | 14:41 | |
| *** ssam2 has joined #openstack-infra | 14:41 | |
| *** luqas has joined #openstack-infra | 14:42 | |
| *** Masahiro has quit IRC | 14:43 | |
| *** dpaterson has quit IRC | 14:44 | |
| *** e0ne is now known as e0ne_ | 14:46 | |
| fungi | Shrews: lucasagomes: ahh, yeah, hack it up all you like | 14:48 |
| *** talluri has quit IRC | 14:48 | |
| Shrews | fungi: already did :-P | 14:49 |
| lucasagomes | fungi, cool :) Shrews just did it, patch is approved now | 14:49 |
| fungi | Shrews: lucasagomes: i have >200 patches and while i spot-checked a bunch of them looking for anything i might have missed, there were still some rare patterns i failed to catch or which led to misleading prose/links | 14:49 |
| Shrews | fungi: yeah, i figured as much | 14:49 |
| fungi | so those were to a great extent a starting point/placeholder for others to comment on or take over as they saw fit | 14:49 |
| *** doude has quit IRC | 14:50 | |
| *** zz_gondoi is now known as gondoi | 14:50 | |
| *** mriedem has joined #openstack-infra | 14:50 | |
| fungi | mainly just trying to drive down traffic to the old wiki documents which have been supplanted and get more traffic flowing directly to the infra manual when appropriate | 14:50 |
| *** armax has joined #openstack-infra | 14:50 | |
| *** pcaruana has quit IRC | 14:51 | |
| *** ddieterly has joined #openstack-infra | 14:52 | |
| *** Sincler has joined #openstack-infra | 14:52 | |
| *** e0ne_ is now known as e0ne | 14:55 | |
| *** bobba is now known as BobBall | 14:56 | |
| *** mpaolino has joined #openstack-infra | 14:56 | |
| *** esker has joined #openstack-infra | 14:57 | |
| *** erikmwilson has quit IRC | 14:57 | |
| *** sigmavirus24 has joined #openstack-infra | 14:57 | |
| *** resker has joined #openstack-infra | 14:58 | |
| *** doug-fish has joined #openstack-infra | 14:58 | |
| *** gnuoy has quit IRC | 14:59 | |
| *** otter768 has joined #openstack-infra | 14:59 | |
| *** gnuoy has joined #openstack-infra | 14:59 | |
| * annegentle waves | 15:00 | |
| annegentle | ttx mtreinish jeblair up for a chat? | 15:00 |
| *** stevemar has joined #openstack-infra | 15:00 | |
| *** signed8bit has quit IRC | 15:00 | |
| mtreinish | annegentle: yep | 15:00 |
| ttx | annegentle: sure | 15:00 |
| annegentle | ttx: dumb question, how do I invite the four of us to a channel/room? | 15:01 |
| *** talluri has joined #openstack-infra | 15:01 | |
| ttx | annegentle: create channel, then /invite | 15:01 |
| *** talluri has quit IRC | 15:01 | |
| *** esker has quit IRC | 15:01 | |
| ttx | like /invite ttx while on desired channel | 15:01 |
| *** doude has joined #openstack-infra | 15:02 | |
| *** carl_baldwin has joined #openstack-infra | 15:02 | |
| *** erikwilson is now known as erikmwilson | 15:04 | |
| jeblair | sdague: there's a stuck jenkins administrative job, we're still debugging | 15:04 |
| *** otter768 has quit IRC | 15:04 | |
| Kiall | Is it just me, or has the gate been acting up over the last few days? Jobs complete for a patchset, yet still on the statis page 45 mins later etc | 15:04 |
| fungi | jeblair: oh, btw it looks like we have the same backup you were tracking last night--hopefully caught a fish in your net this time | 15:05 |
| fungi | ahh, nevermind that's what you just commented onm | 15:05 |
| fungi | Kiall: the queue lengths listed in the top left corner are things zuul has outstanding it needs to process, which could be acting on job completions among other tasks | 15:06 |
| fungi | Kiall: and yes, we recently switched the gearman implementation it relies on to do async i/o, still possibly some bugs in there jeblair is trying to pin down | 15:08 |
| Kiall | Ah, change of lib makese sense.. I've just noticed this large delay between jobs completing and being reported back to gerrit over the last few days and figured something was uop | 15:09 |
| Kiall | up* | 15:09 |
| *** timcline has joined #openstack-infra | 15:09 | |
| *** ayoung has joined #openstack-infra | 15:11 | |
| *** garyk has quit IRC | 15:12 | |
| Kiall | fungi: http://tinyurl.com/nb5ra9h (graphite.o.o link) - looks like the lib change made a big difference ;) | 15:13 |
| openstackgerrit | Sean Dague proposed openstack/requirements: remove docs projects from g-r constraints https://review.openstack.org/142462 | 15:14 |
| *** sputnik13 has quit IRC | 15:14 | |
| *** garyk has joined #openstack-infra | 15:14 | |
| openstackgerrit | Paul Karikh proposed openstack/requirements: Bump version of django_openstack_auth to >=1.1.8 https://review.openstack.org/142463 | 15:15 |
| *** lttrl has quit IRC | 15:16 | |
| *** lttrl has joined #openstack-infra | 15:16 | |
| *** yfried has quit IRC | 15:18 | |
| *** yfried_ has joined #openstack-infra | 15:18 | |
| fungi | Kiall: that doesn't really indicate a direct correlation. that library was last updated on zuul.openstack.org 9 days ago | 15:19 |
| dhellmann | anteaya: ".tmpl" is "template" | 15:20 |
| dhellmann | anteaya: I just made up the extension, we can change it if you want | 15:20 |
| dhellmann | fungi: thanks for the heads-up on the merge; I'll send another email encouraging reviews of the stable requirements updates | 15:21 |
| *** nuritv has quit IRC | 15:23 | |
| *** lucasagomes is now known as lucas-hungry | 15:24 | |
| *** ihrachyshka has quit IRC | 15:25 | |
| *** signed8bit has joined #openstack-infra | 15:25 | |
| *** lttrl has quit IRC | 15:28 | |
| *** marun has joined #openstack-infra | 15:31 | |
| *** hdd has joined #openstack-infra | 15:32 | |
| *** wenlock has joined #openstack-infra | 15:35 | |
| *** Ala has quit IRC | 15:36 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for trove unit test bug 1379729 https://review.openstack.org/142468 | 15:40 |
| uvirtbot | Launchpad bug 1379729 in trove "test_tranformer unit test fails with ModelNotFoundError: InstanceServiceStatus Not Found" [Medium,Triaged] https://launchpad.net/bugs/1379729 | 15:40 |
| *** belmoreira has joined #openstack-infra | 15:41 | |
| *** dkranz has quit IRC | 15:43 | |
| *** achanda has joined #openstack-infra | 15:44 | |
| fungi | mordred: ttx: just a head up, post-setuptools-8 discussion on the distutils-sig ml indicates there's a good likelihood that pep 440 will soon be revised to switch from "c" to "rc" | 15:44 |
| fungi | clarkb: ^ | 15:44 |
| odyssey4me | haha fungi :) | 15:45 |
| mordred | fungi: cool | 15:45 |
| mordred | fungi: also, re: mailing list around putting global requirements entries into requirements proposals ... | 15:46 |
| mordred | fungi: we do have some amount of similar code in the pbr changelog writing | 15:47 |
| mordred | fungi: so if someone decides to work on such a thing, it may be possible to learn from or even directly leverage that | 15:47 |
| * fungi nods | 15:47 | |
| fungi | i think the trick in this case is that you need to filter git blame output to the specific lines you're proposing, and then use the hashes listed by that result to grab commit messages from the commit history and concatenate them, or something | 15:48 |
| *** miqui_ has joined #openstack-infra | 15:48 | |
| *** carl_baldwin has quit IRC | 15:50 | |
| mordred | yah. blech | 15:50 |
| *** dkranz has joined #openstack-infra | 15:50 | |
| mordred | fungi: I know it's a tiring subject, but I'd like to repeat my statement that perhaps our efforts to ensure a single common requirements list may be not worth it | 15:51 |
| *** amotoki has quit IRC | 15:51 | |
| mordred | fungi: also, if you haven't already, definitely read the scrollback between dstufft and I from after you dropped off last night | 15:52 |
| fungi | oh, i have | 15:52 |
| mordred | k | 15:52 |
| mordred | just making sure | 15:52 |
| fungi | i get that requirements files in general are an ugly hack and guarantee almost nothing, so trying to sync them is actually of less benefit than people would expect | 15:52 |
| *** harlowja_at_home has joined #openstack-infra | 15:52 | |
| mordred | yup | 15:53 |
| dstufft | mordred: probably you still need that until pip gets a real dep solver | 15:53 |
| ttx | fungi: sigh | 15:53 |
| mordred | dstufft: unless we gave up on the idea of a single machine coordinated install without any namespacing | 15:53 |
| ttx | fungi: well, we have both tags for swift 2.2.1. Will that be fixed before 2015.1 RC period ? | 15:54 |
| dstufft | mordred: well, yea that's a thing, though I was under the impression that was a hard requirement | 15:54 |
| mordred | dstufft: it is, or at least, we treat it as if it is | 15:54 |
| mordred | dstufft: but there are times when I think that the amount of effort it takes to still not quite get it right may be misspent | 15:54 |
| dstufft | ttx: the c -> rc thing? the code to fix it is already done, I'll probably be saying something like "okay unless someone has an objection i'm gonna do the needful" sometime today | 15:55 |
| mordred | when in _reality_ - people who are deploying openstack are deploying it across many different machines - and the one "production" thing I know of that co-locates services does it with virtualenvs | 15:55 |
| fungi | ttx: unknown... it would need to appear in an updated version of the spec and then get implemented by setuptools et al | 15:55 |
| *** belmoreira has quit IRC | 15:55 | |
| harlowja_at_home | mordred, i can vouch for yahoo co-locating at least some of the api services together; not all but some... | 15:56 |
| harlowja_at_home | and not in virtualenvs | 15:56 |
| fungi | mordred: right, again our requirements syncing is almost certainly a reaction to/symptom of devstack all-in-one installs | 15:56 |
| *** mrunge has joined #openstack-infra | 15:56 | |
| mordred | harlowja_at_home: cool. good to know | 15:56 |
| mordred | harlowja_at_home: does yahoo locally create OS distro packages of them first? | 15:57 |
| harlowja_at_home | ya | 15:57 |
| * mordred asks leading question, knowing software that harlowja_at_home has written ... | 15:57 | |
| harlowja_at_home | ;) | 15:57 |
| clarkb | fungi: sort of, its a problem you have anytime you try to install >1 python package from source on a single machine | 15:58 |
| *** hashar is now known as hasharCall | 15:58 | |
| *** skolekonov has quit IRC | 15:58 | |
| *** mpaolino has quit IRC | 15:58 | |
| mordred | that's the thing - if we're going to stick with pip, then I kinda think that venvs or containers make more sense, and if we're going to do all-in-one, we should figure out local distro packaging which has better dep solving | 15:58 |
| clarkb | fungi: in fact I expect to run into it with nodepool/zuul/gear/jeepyb more often as the all in third party stuff gets more steam | 15:58 |
| mordred | because it's not that installing the software is hard | 15:58 |
| mordred | it's that figuring out the dep solution is | 15:58 |
| *** tonytan4ever has joined #openstack-infra | 15:58 | |
| clarkb | I am a fan of venvs | 15:58 |
| harlowja_at_home | mordred, +2 to that; one recommended way would be cool, and likely its not the all-in-one install way... | 15:59 |
| * dstufft is also a fan of venvs | 15:59 | |
| clarkb | locally I have venvs all over the place for all different things. The only globally installed python I have is pip/virtualenv/tox | 15:59 |
| * dstufft might be biased | 15:59 | |
| *** reed has joined #openstack-infra | 15:59 | |
| fungi | mordred: yes, i do feel like system-wide installation via pip is grotesque. on my servers and personal machines i leave the system-wide installation managed solely by the distro packaging system and use virtualenvs for anything pip-obtained | 15:59 |
| dstufft | mordred: there's another thing too, that is kind of interesting | 16:00 |
| mordred | clarkb: especially since upstream python, in the form of dstufft, has been telling us for ages that installing globally is a Very Bad Idea | 16:00 |
| dstufft | mordred: not sure ifit's useful at all for openstack | 16:00 |
| morganfainberg | mordred, +1 to venvs (smaller +1 to containers but really thats just a personal bias) | 16:00 |
| mordred | fungi: ++ | 16:00 |
| dstufft | sec let me get link | 16:00 |
| fungi | clarkb: ha, i have you beat then. i install tox, virtualenv, et cetera into a virtualenv created by the distro python-virtualenv package | 16:00 |
| *** pcrews has joined #openstack-infra | 16:00 | |
| mordred | fungi: hah. nice | 16:00 |
| dstufft | mordred: https://github.com/mitsuhiko/pipsi | 16:00 |
| fungi | but i actually directly call ~/venvs/tox/bin/tox whatever | 16:00 |
| harlowja_at_home | i install tox into a a mini-tox; that goes into a micro-tox that has virtualenv; so there! :-P | 16:01 |
| mordred | dstufft: zomg | 16:01 |
| harlowja_at_home | ha | 16:01 |
| clarkb | fungi: I think I decided that virtualenv was too old and liked ease of not virtualenving to virtualenv :) | 16:01 |
| dstufft | mordred: it lets you pip install command line things into their own virtualenv | 16:01 |
| mordred | I was JUST going to say that a thing like that would be super helpful | 16:01 |
| mordred | because that way you don't have to know that $service is in venv $foo | 16:01 |
| *** mpaolino has joined #openstack-infra | 16:01 | |
| fungi | clarkb: yeah, i have a virtualenv virtualenv so i can ~/venvs/virtualenv/bin/virtualenv whatever to create other virtualenvs | 16:01 |
| mordred | clarkb, fungi: ^^ go check that out | 16:01 |
| dstufft | mordred: at some point I want to figure out how to make pip do this, but there's the problem where you'd sometimes want it and sometimes not want it, so I haven't touched it yet | 16:01 |
| SergeyLukjanov | oh, I see "Queue lengths: 694 events, 303 results." in zuul | 16:02 |
| SergeyLukjanov | morning folks | 16:02 |
| dstufft | mordred: but yea, pipsi is sort of like static linking for python | 16:02 |
| rcarrillocruz | you're making my brain bleed with such nesting :-) | 16:03 |
| mordred | dstufft: of course, it would be nice if pipsi was pip installable ... | 16:03 |
| *** marcusvrn has quit IRC | 16:03 | |
| *** asselin_ has joined #openstack-infra | 16:04 | |
| *** spzala has joined #openstack-infra | 16:04 | |
| dstufft | mordred: I know armin, I could probably go bother him to ask him if he could | 16:04 |
| mordred | dstufft: I'm mostly carping | 16:05 |
| *** spzala has quit IRC | 16:05 | |
| dstufft | I think the reason it probably isn't is so pipsi can itself be installed into a per command virtualenv | 16:05 |
| mordred | dstufft: but one could also imagine wanting to have an option to not write to ~/.local/bin but instead to /usr/local/bin | 16:06 |
| *** rmcall has joined #openstack-infra | 16:06 | |
| *** Sukhdev has joined #openstack-infra | 16:06 | |
| clarkb | mordred: can you summarize current state of setuptools world for us? do we just need the postN thing to get released? | 16:06 |
| clarkb | mordred: and new version for pytz? | 16:06 |
| dstufft | mordred: it has --home and --bin-dir to control where the venvs go and the bins go | 16:06 |
| fungi | dstufft: i already do a lot of that. for example i have a ~/bin directory with symlinks into separate virtualenv bindirs for git-review, gertty, et cetera | 16:07 |
| fungi | works surprisingly well | 16:07 |
| mordred | clarkb: yes to both | 16:07 |
| *** prad has joined #openstack-infra | 16:07 | |
| clarkb | mordred: anything else that is important? | 16:08 |
| dstufft | mordred: clarkb also need to turn off warnings | 16:08 |
| fungi | tweak manpath a little and ~/man can do similarly for symlinks to manpages in virtualenvs | 16:08 |
| mordred | dstufft: yah - but that's a lot of work to achieve what woudl be a common case for me | 16:08 |
| mordred | dstufft: but maybe I'll just make a PR | 16:08 |
| mordred | clarkb: not that I know of | 16:09 |
| dstufft | mordred: clarkb the warning we added for telling people their non PEP 440 version is gonna sort < 0 is making some CLI tests fail b/c ubuntu has an unrelated non PEP 440 verisoned package installed | 16:09 |
| mordred | clarkb: although we _Do_ need to have a longer conversation with sdague (not today, I'm slammed) about the distro-packages vs. python packages in devstack | 16:09 |
| Kiall | fungi: you sure there's no issue? I only see 1 job running out of all the queued jobs, and the results from jobs 1hr 45min ago still havent reported :/ | 16:09 |
| mordred | clarkb: oh- right - pep440 warning suppression | 16:10 |
| mordred | there's an env var we can set | 16:10 |
| dstufft | PYTHONWARNINGS=ignore::RuntimeWarning:pkg_resources should shut up all the runtimewarning's from pkg_resources | 16:10 |
| clarkb | dstufft: so tests are parsing that output and saying lol fail? | 16:10 |
| mordred | yah | 16:10 |
| dstufft | clarkb: yea | 16:10 |
| clarkb | :( ok | 16:10 |
| dstufft | (I didn't verify that syntax for PYTHONWARNINGS, but it's something like that) | 16:11 |
| *** rcarrill` has joined #openstack-infra | 16:11 | |
| ruhe | exit | 16:11 |
| ruhe | sorry | 16:11 |
| * morganfainberg exits. | 16:11 | |
| morganfainberg | :) | 16:11 |
| *** jerryz has quit IRC | 16:12 | |
| dstufft | clarkb: mordred also if you're concerned at all about silencing all runtime warnings in pkg_resources I can make a patch to subclass, but if you're not I won't bother | 16:12 |
| *** dangers_away is now known as dangers | 16:13 | |
| openstackgerrit | Mauro Rodrigues proposed openstack-infra/elastic-recheck: Query for bug #1253896 https://review.openstack.org/142479 | 16:13 |
| uvirtbot | Launchpad bug 1253896 in tempest/havana "Attempts to verify guests are running via SSH fails. SSH connection to guest does not work." [Critical,Confirmed] https://launchpad.net/bugs/1253896 | 16:13 |
| clarkb | dstufft: I think having the warnings is good even if it makes tests fail because it means we have stuff to fix | 16:13 |
| clarkb | dstufft: may not be directly related to a particular test but now we have things saying "Fix me" | 16:13 |
| *** mpaolino has quit IRC | 16:13 | |
| *** amuller has quit IRC | 16:13 | |
| dstufft | clarkb: in this case, the warning is completely unrelated to openstack, because when you import pkg_resources it parses all the versions of things installed | 16:14 |
| *** rcarrillocruz has quit IRC | 16:14 | |
| dstufft | and ubuntu has some completely unrelated thing installed | 16:14 |
| dstufft | which triggers the warning | 16:14 |
| clarkb | OHHH | 16:14 |
| clarkb | I see | 16:14 |
| fungi | Kiall: did i say no issue? i said no obvious correlation to the most recent changes we made (indicating that while they're a place to start looking, they're not necessarily the cause) | 16:14 |
| *** flip214 has joined #openstack-infra | 16:15 | |
| Kiall | fungi: ah, sorry, I thought you meant it's just backed up a little ;) | 16:15 |
| fungi | Kiall: the graph you linked shows a change in behavior two days ago, we changed the code 9 days ago | 16:15 |
| dstufft | clarkb: there's also a warning for swift's post release version in pbr, but that's getting (or is?) fixed I think | 16:15 |
| flip214 | is it possible to change the "Identity" OpenID link for a user account? | 16:15 |
| *** marcusvrn has joined #openstack-infra | 16:15 | |
| fungi | flip214: where? | 16:15 |
| clarkb | SergeyLukjanov: ya zuul looks super unhappy processing those events | 16:16 |
| flip214 | fungi: https://review.openstack.org/#/settings/web-identities | 16:16 |
| clarkb | SergeyLukjanov: jeblair was looking into it last night and should be around soon so I don't want to go poking anything just yet | 16:16 |
| flip214 | I'd like to switch identity for my user | 16:16 |
| fungi | flip214: those get autogenerated when you log into gerrit with a new identity and it provides no facility to move/combine them | 16:16 |
| fungi | flip214: basically gerrit has open authentication, so the first time you auth with a new identity it creates a whole new account tied to it | 16:17 |
| flip214 | fungi: yeah, but there'll be someone who can do an UPDATE statement in the right place, no? | 16:17 |
| flip214 | ;) | 16:18 |
| flip214 | It's just so that the work is attributed to the correct self. | 16:19 |
| morganfainberg | flip214, is it always possible to do crazy things like direct DB manipulation, it's a question of risk vs value. - | 16:19 |
| *** sabeen has joined #openstack-infra | 16:19 | |
| morganfainberg | flip214, you can also put a patch into stackalytics and gitdm to map the details correctly (for the email) | 16:19 |
| flip214 | yeah, of course. I don't know whether there's a way to get that field writable, that's why I ask here. | 16:19 |
| morganfainberg | flip214, but the OpenID is not responsible for the email used on a commit message | 16:19 |
| morganfainberg | flip214, changing OpenID connect field only changes who can login, not the committer/author of patches | 16:20 |
| flip214 | it's interesting that https://review.openstack.org/#/settings/web-identities has a "delete" button, but not an "add" | 16:21 |
| *** ihrachyshka has joined #openstack-infra | 16:21 | |
| flip214 | morganfainberg: yeah, I'm trying to get the "right" identity associated. | 16:22 |
| morganfainberg | flip214, the worst case scenario is make a new gerrit id, there is no reason it should have much (if any) impact except the username itself. | 16:22 |
| *** lucas-hungry is now known as lucasagomes | 16:23 | |
| *** lucasagomes has left #openstack-infra | 16:23 | |
| morganfainberg | flip214, that is if the nice folks here in -infra aren't doing the update for you. (i don't claim they will/wont etc, just offering details/workarounds) | 16:23 |
| *** mpaolino has joined #openstack-infra | 16:23 | |
| *** harlowja_at_home has quit IRC | 16:23 | |
| flip214 | yeah, right. thank you, perhaps it's simpler to just switch. | 16:23 |
| *** dizquierdo has quit IRC | 16:24 | |
| bookwar | i see that specs.openstack.org is up and running now, can we add publishing of our stackforge/fuel-pecs repository there? | 16:25 |
| *** pblaho has quit IRC | 16:26 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for nova unit test race bug 1403564 https://review.openstack.org/142485 | 16:27 |
| uvirtbot | Launchpad bug 1403564 in nova "nova.tests.unit.conductor.test_conductor._BaseTaskTestCase.test_build_instances_scheduler_failure is racy" [Medium,Confirmed] https://launchpad.net/bugs/1403564 | 16:27 |
| *** vigneshvar has joined #openstack-infra | 16:27 | |
| *** Masahiro has joined #openstack-infra | 16:27 | |
| tchaypo | It looks like there’s something affecting py33 jobs on many projects | 16:29 |
| tchaypo | at least https://bugs.launchpad.net/python-openstackclient/+bug/1403557 and https://bugs.launchpad.net/os-apply-config/+bug/1403510 have been raised | 16:29 |
| uvirtbot | Launchpad bug 1403557 in python-openstackclient "unable to build py33 environment (dup-of: 1403510)" [Undecided,New] | 16:29 |
| uvirtbot | Launchpad bug 1403510 in os-apply-config "gate tests failed with "NameError: name 'StandardError' is not defined"" [Low,Triaged] | 16:29 |
| *** rlandy has quit IRC | 16:29 | |
| *** ociuhandu has quit IRC | 16:30 | |
| *** jcoufal_ is now known as jcoufal | 16:31 | |
| nfedotov | Hello All! These ir a feature in the grenade project. The target tempest uses images of a base tempest (they were downloaded by base devstack). And it makes several tests to fail in a patchset https://review.openstack.org/#/c/122936/ Can somebody comment it? | 16:31 |
| *** Masahiro has quit IRC | 16:31 | |
| *** jgallard_ has quit IRC | 16:33 | |
| ruhe | tchaypo: yeah. Steve Martinelli reported this issue in openstack-dev ML | 16:33 |
| openstackgerrit | Merged openstack-infra/subunit2sql: Add new db api methods for getting test data from runs https://review.openstack.org/141547 | 16:33 |
| openstackgerrit | Merged openstack-infra/subunit2sql: Refactor sql2subunit to use get_tests_run_dicts_from_run_id https://review.openstack.org/141548 | 16:33 |
| openstackgerrit | Merged openstack-infra/subunit2sql: Correct writing of timestampes in write_test() for sql2subunit https://review.openstack.org/141585 | 16:33 |
| *** salv-orlando has joined #openstack-infra | 16:33 | |
| ruhe | tchaypo: i have the same issue on other projects too: openstack/python-saharaclient and stackforge/yaql . i guess all the py34 jobs are affected | 16:34 |
| tchaypo | You're seeing it on py34? I've only seen py33 | 16:34 |
| * clarkb reminds everyone setuptools released... | 16:35 | |
| ruhe | tchaypo: i see it on py34 | 16:36 |
| tchaypo | thanks clarkb | 16:36 |
| *** patrickeast has joined #openstack-infra | 16:36 | |
| tchaypo | so i was about to say that one change i noticed between a patchset that passed tests, and the same patchset later, was a different order of requirement installation | 16:37 |
| tchaypo | the one that worked installed docutils as a dep of sphinx, then jinja2; the one that failed installed docutils as a dep of jinja2 as a dep of sphinx. sounds like maybe the new version of setuptools changed the ordering, amongst other things? | 16:37 |
| tchaypo | but both working/failing logs say they’re using setuptools 3.6 | 16:38 |
| dstufft | mordred: fedora is going to update Babel so it doesn't break with their version of pytz with setuptools 8, they said they'll push to f20 and f21 too | 16:38 |
| flip214 | in case somebody else needs that: launchpad allows to change the openid link, via launchpad.net/~<username>/+edit | 16:38 |
| flip214 | thanks. | 16:38 |
| *** flip214 has left #openstack-infra | 16:38 | |
| dstufft | will take awhile to make it into the release archive tho :( | 16:39 |
| ruhe | clarkb: but why would it fail (tox -e py34) if there is still a cap on setuptools? | 16:39 |
| clarkb | ruhe: the cap is artificial, it could be installing things itself | 16:39 |
| *** ZZelle_ has joined #openstack-infra | 16:39 | |
| dstufft | I don't believe anything in setuptools 8 should have affected the functionality of py3 | 16:40 |
| dstufft | the only change in 8 is the PEP 440 stuff | 16:40 |
| *** achanda has quit IRC | 16:41 | |
| clarkb | dstufft: I think it may be how docutils is using setuptools? In any case it is a failure to install | 16:41 |
| clarkb | and to not first rule out setuptools 8.0 would be silly imo | 16:41 |
| mordred | clarkb: should we set a global status on that? :) | 16:41 |
| tchaypo | docutils handles py3 compatibility by install-time conversion of its files | 16:41 |
| *** achanda has joined #openstack-infra | 16:41 | |
| mordred | dstufft: AWESOME | 16:42 |
| dstufft | 2to3 ftl | 16:42 |
| tchaypo | http://logs.openstack.org/20/142120/2/gate//gate-os-apply-config-python33/a46f8f9/tox/py33-1.log is the failing log from my change | 16:43 |
| tchaypo | http://logs.openstack.org/20/142120/2/check//gate-os-apply-config-python33/c271e52/tox/py33-1.log is the earlier run of the same patchset that passed | 16:43 |
| dstufft | mordred: they said 24-48 hours for it to get into the updates-testing, and then 2 weeks for it to make it out of there and into updates.. so it's a bit long :/ | 16:43 |
| jeblair | clarkb, fungi: there's a performance hit in geard on job submission with reaally high queues. with, honestly, a pretty trivial fix. though i believe it would mean a behavioral change from C gearmand | 16:43 |
| mordred | dstufft: yah - but the only problem is a warning, right? | 16:43 |
| tchaypo | as far as i can tell both of them use setuptools 3.6 | 16:44 |
| morganfainberg | hogepodge, ping. | 16:44 |
| dstufft | mordred: no, that's a hard failure when pkg_resources loads | 16:44 |
| morganfainberg | hogepodge, re interop stuff. | 16:44 |
| dstufft | because Babel has a dependency on >0a | 16:44 |
| mordred | oh. awesome | 16:44 |
| jeblair | clarkb, fungi: but basically, every job submission right now (including the thousands of set_description jobs) probably takes > 1 second | 16:44 |
| dstufft | and 2012d < 0a | 16:44 |
| clarkb | jeblair: and then we run status on it and it gets really sad? | 16:44 |
| mordred | well, that one we can take care of by removing the babel requirement from devstack rpms/debs | 16:44 |
| morganfainberg | hogepodge, and you know you're not in openstack-dev right? ;) | 16:44 |
| jeblair | clarkb: no, i think that's okay, though it's one of the reasons status is slow to respond sometimes | 16:45 |
| jeblair | clarkb: so to track back... | 16:45 |
| *** yamamoto has joined #openstack-infra | 16:45 | |
| *** achanda has quit IRC | 16:46 | |
| jeblair | clarkb: i believe that because set_dsecription:jenkins01 is stuck, the queues get larger, and large queues cause slow job submission, and since zuul submits jobs at a very high rate, zuul's main loop is slowing | 16:46 |
| dstufft | oh wow | 16:46 |
| dstufft | that py33 issue | 16:46 |
| dstufft | lol | 16:46 |
| clarkb | jeblair: gotcha | 16:46 |
| jeblair | clarkb: i do not know why set_description:jenkins01 is stuck, i'm still downloading pcaps :) | 16:46 |
| clarkb | dstufft: do you understand it? | 16:46 |
| clarkb | jeblair: ok, anything I can do to assist? should I put 01 in shutdown mode now that you have pcps? | 16:47 |
| dstufft | clarkb: I udnerstand what's happening, I don't understand why it just started happening | 16:47 |
| clarkb | dstufft: thats a start at least and way more than I understand | 16:47 |
| mordred | wow. we install sphinx in devstack | 16:47 |
| jeblair | clarkb: yeah, i think it's okay to shut down 01 | 16:47 |
| dstufft | oh wait | 16:48 |
| mtreinish | mordred: heh, what pulls it in? | 16:48 |
| dstufft | I do know what made it fail recently | 16:48 |
| dstufft | it's pbr's fault | 16:48 |
| tchaypo | https://www.irccloud.com/pastebin/957UVE5g | 16:48 |
| mordred | mtreinish: nothing | 16:48 |
| mordred | mtreinish: it's directly requested | 16:48 |
| tchaypo | dstufft: comments on https://bugs.launchpad.net/os-apply-config/+bug/1403510?comments=all plz | 16:48 |
| uvirtbot | Launchpad bug 1403510 in os-apply-config "gate tests failed with "NameError: name 'StandardError' is not defined"" [Low,Triaged] | 16:48 |
| mordred | mtreinish: and it's what causes distro babel to be installed | 16:48 |
| mordred | which is what's breaking that bit | 16:48 |
| dstufft | lol | 16:48 |
| mtreinish | oh wow, ok. | 16:48 |
| dstufft | wow | 16:48 |
| clarkb | jeblair: ok I am starting shutdown mode there | 16:48 |
| dstufft | so | 16:48 |
| *** marcusvrn has quit IRC | 16:49 | |
| dstufft | docutil's setup.py install is being executed | 16:49 |
| openstackgerrit | James E. Blair proposed openstack-infra/gear: Only wake relevant connections https://review.openstack.org/142496 | 16:49 |
| dstufft | in ./ there is a py2 version of docutils, which is being translated into py3 in ./build | 16:49 |
| jeblair | clarkb, fungi: ^ should make job submission fast even on large queues | 16:49 |
| *** marcusvrn has joined #openstack-infra | 16:49 | |
| *** marun has quit IRC | 16:49 | |
| *** yamamoto has quit IRC | 16:50 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 16:50 | |
| dstufft | as part of installing docutils, setuptools interates of the egg_writer entry point and imports things, which causes pbr to get imported | 16:50 |
| dstufft | pbr imports sphinx | 16:50 |
| mordred | dstufft, clarkb, fungi, mtreinish: https://review.openstack.org/142497 | 16:50 |
| dstufft | sphionx imports docutils | 16:50 |
| mordred | that removes sphinx from devstack | 16:50 |
| dstufft | and ./ is on sys.path | 16:50 |
| dstufft | so it imports the py2 docutils from ./ | 16:50 |
| *** nfedotov has left #openstack-infra | 16:50 | |
| *** achanda has joined #openstack-infra | 16:51 | |
| mordred | dstufft: that's so fantastic I want to spit | 16:51 |
| tchaypo | and then we’re running non-translated docutils in py3, so it fails. | 16:51 |
| dstufft | I am both impressed with the round about way that error happened, and that I manaaged to figure it out so quickly | 16:51 |
| tchaypo | dstufft: so why did it just start breaking? | 16:52 |
| mordred | ++ | 16:52 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 16:52 | |
| dstufft | tchaypo: because pbr just recently released a version that was the first version to have an egg_writer entry point | 16:52 |
| tchaypo | dstufft: we love you and owe you many $DRINK_OF_CHOICE :) | 16:52 |
| mordred | dstufft: oh for the love of | 16:52 |
| tchaypo | dstufft: it’s not saturday, why would there be a pbr release? | 16:52 |
| *** kgiusti has quit IRC | 16:52 | |
| mordred | dstufft: so, I can protect the sphinx import from the egg_write code path | 16:52 |
| openstackgerrit | Mauro Rodrigues proposed openstack-infra/elastic-recheck: Query for bug #1253896 https://review.openstack.org/142479 | 16:52 |
| uvirtbot | Launchpad bug 1253896 in tempest/havana "Attempts to verify guests are running via SSH fails. SSH connection to guest does not work." [Critical,Confirmed] https://launchpad.net/bugs/1253896 | 16:52 |
| mordred | it's really only needed if someone is actually trying to build sphinx docs | 16:53 |
| tchaypo | so for this to fail, we need to have a python2 version of docutils in the system path, but be running python3 checks? | 16:53 |
| dstufft | in sys.path yea | 16:53 |
| dstufft | and the only reason you do | 16:53 |
| dstufft | is because you're installing docutils | 16:53 |
| dstufft | and sys.path[0] is "." | 16:53 |
| dstufft | this error would only ever happen while installing docutils | 16:54 |
| dstufft | this particular one | 16:54 |
| mordred | oh - wow, no I cannot | 16:54 |
| * mordred digs deeper | 16:54 | |
| dstufft | because if you wern't installing docutils into a py3 environment, you wouldn't haev the untranslated py2 copy of the code in "." | 16:54 |
| openstackgerrit | Christian Berendt proposed openstack/requirements: Bump version of openstack-doc-tools >= 0.21.1 https://review.openstack.org/142076 | 16:55 |
| mtreinish | mordred: +2 on 142497 | 16:55 |
| tchaypo | mordred: I’ve added pbr to https://bugs.launchpad.net/pbr/+bug/1403510 | 16:55 |
| uvirtbot | Launchpad bug 1403510 in os-apply-config "gate tests failed with "NameError: name 'StandardError' is not defined"" [Low,Triaged] | 16:55 |
| mordred | dstufft: ok. I think I can see an out in pbr | 16:56 |
| *** packet has joined #openstack-infra | 16:56 | |
| *** melwitt has joined #openstack-infra | 16:56 | |
| *** mpaolino has quit IRC | 16:56 | |
| *** bhunter71 has joined #openstack-infra | 16:57 | |
| *** marun has joined #openstack-infra | 16:57 | |
| *** cnesa2 has quit IRC | 16:58 | |
| openstackgerrit | Aleksey proposed openstack-infra/storyboard: Fix i18n https://review.openstack.org/142503 | 16:58 |
| *** marcusvrn has quit IRC | 16:58 | |
| tchaypo | oh, I just realised - it’s not that we’re importing the system docutils, it’s that we’re importing the version of docutils that we’re in the middle of translating, before the file has been translated | 16:58 |
| dstufft | tchaypo: yes | 16:59 |
| tchaypo | it sounds like this is going to break all py3x jobs - worth putting in status? | 17:00 |
| garyk | ancan you please take a look at https://review.openstack.org/#/c/140409/ | 17:00 |
| openstackgerrit | Adam Gandelman proposed openstack-infra/project-config: Update ironic ACLs for ironic-stable-maint https://review.openstack.org/142504 | 17:00 |
| *** otter768 has joined #openstack-infra | 17:00 | |
| *** zz_sabari is now known as sabari_ | 17:01 | |
| dstufft | mordred: y'all made my new favorite setuptools bug ever | 17:01 |
| dstufft | mordred: so congrats :D | 17:01 |
| *** harlowja_away is now known as harlowja | 17:01 | |
| dstufft | well setuptools involved bug | 17:01 |
| openstackgerrit | Merged openstack-infra/reviewstats: Sync with current core group https://review.openstack.org/142332 | 17:01 |
| clarkb | I am not sure I understand why distutils is being imported during setup | 17:01 |
| clarkb | oh I know | 17:01 |
| clarkb | nevermind | 17:01 |
| clarkb | because sphinx is dumb and pbr has to monkey patch it to be usefulk | 17:01 |
| *** doug-fish has quit IRC | 17:01 | |
| *** asselin_ has quit IRC | 17:02 | |
| *** doug-fish has joined #openstack-infra | 17:02 | |
| *** sarob has joined #openstack-infra | 17:02 | |
| *** dkranz has quit IRC | 17:02 | |
| clarkb | ok going to focus on gear now | 17:03 |
| mordred | clarkb, dstufft: https://review.openstack.org/142509 | 17:04 |
| mordred | tchaypo: ^^ | 17:04 |
| *** otter768 has quit IRC | 17:05 | |
| *** changbl has quit IRC | 17:05 | |
| mordred | I believe that will prevent pbr from importing sphinx when it's running the egg_info writer hook | 17:05 |
| tchaypo | mordred: closes-bug #1403510 | 17:05 |
| uvirtbot | Launchpad bug 1403510 in os-apply-config "gate tests failed with "NameError: name 'StandardError' is not defined"" [Low,Triaged] https://launchpad.net/bugs/1403510 | 17:05 |
| clarkb | jeblair: so I am reading this geard change and is it divergent from C gearman in a meaningful way? the protocol isn't changed its merely an change on which connections are woken | 17:06 |
| dstufft | mordred: that depends on another patch | 17:06 |
| dstufft | mordred: that other patch can't pass py33 gates I don't think | 17:06 |
| dstufft | without this patch | 17:07 |
| clarkb | ya flip the order and it should self test and all that | 17:07 |
| mordred | woot | 17:07 |
| mordred | done | 17:08 |
| tchaypo | Good, because I was about to say that I haven’t been able to reproduce on my system so i don’t know how to test this | 17:08 |
| clarkb | mordred: so that fixes because it will fail and catch exception returning false then everything continues? | 17:08 |
| mordred | clarkb: nope - it fixes because the function to create the classes will not get run at import | 17:09 |
| *** mpaolino has joined #openstack-infra | 17:09 | |
| mordred | so when pbr/packaging is imported by setuptools to get the write_pbr_json hook, it will not run the import code at all | 17:10 |
| mordred | only when you're actually operating pbr will that happen | 17:10 |
| *** spzala has joined #openstack-infra | 17:10 | |
| clarkb | perfect | 17:10 |
| mordred | clarkb: I'm runnign out the door/not really here today - so if I missed something stupid, I can't fix it until tomorrow - however, if those pass tests, feel free to release without me | 17:12 |
| clarkb | ok | 17:12 |
| *** hdd has quit IRC | 17:13 | |
| *** MaxV_ has quit IRC | 17:13 | |
| tchaypo | should I be able to see checks in the queue on http://status.openstack.org/zuul/ ? | 17:13 |
| clarkb | tchaypo: yes? gearman is currently unhappy though so things may be funny | 17:13 |
| *** ssam2 has quit IRC | 17:14 | |
| *** emagana has quit IRC | 17:14 | |
| dhellmann | mordred: there's a pbr refactoring patch that may help with some of the extraneous imports: https://review.openstack.org/133607 | 17:16 |
| mordred | oh god | 17:16 |
| clarkb | wow | 17:17 |
| anteaya | dhellmann: ah thank you, that would explain why I couldn't find it | 17:17 |
| mordred | dhellmann: I'd love to take that - but there's so much in flight that there's no way that's landing | 17:17 |
| mordred | it's gonna have to be redone I think | 17:17 |
| mordred | but I'll look at it tomorrow | 17:17 |
| anteaya | dhellmann: no need to change I just didn't know where it came from | 17:17 |
| dhellmann | mordred: yeah | 17:17 |
| anteaya | dhellmann: apparently your brain is not yet indexed :D | 17:17 |
| dhellmann | mordred: +2a on https://review.openstack.org/#/c/142509/ | 17:17 |
| dhellmann | anteaya: I'm sure google is working on that | 17:17 |
| openstackgerrit | Joshua Harlow proposed openstack-infra/elastic-recheck: Add query for bug 1403510 affecting docutils/py33/py34 https://review.openstack.org/142513 | 17:18 |
| uvirtbot | Launchpad bug 1403510 in os-apply-config "gate tests failed with "NameError: name 'StandardError' is not defined"" [Low,Triaged] https://launchpad.net/bugs/1403510 | 17:18 |
| *** dkranz has joined #openstack-infra | 17:18 | |
| clarkb | dhellmann: what about the child of 142509 | 17:18 |
| clarkb | dhellmann: ideally we would release both of those to cover the current known issues | 17:18 |
| anteaya | dhellmann: no doubt, wear your tinfoil hat | 17:18 |
| dhellmann | clarkb: https://review.openstack.org/#/c/142351/ ? | 17:19 |
| dstufft | dhellmann: yea | 17:19 |
| clarkb | dhellmann: yup | 17:19 |
| clarkb | dhellmann: it turns out doing 1.2.3a1.6 is not valid under pep440 but 1.2.3a1.post6 is | 17:19 |
| dhellmann | whee | 17:20 |
| *** sarob has quit IRC | 17:20 | |
| *** achanda has quit IRC | 17:20 | |
| lifeless | clarkb: we should use devN not postN, for untagged builds | 17:20 |
| dhellmann | +2a, in spite of lack of tests | 17:20 |
| clarkb | lifeless: we actually use both depending | 17:21 |
| lifeless | clarkb: postN is a release | 17:21 |
| *** sarob has joined #openstack-infra | 17:21 | |
| lifeless | clarkb: depending on what? There was no ention of postN in the discussion around versioning rules that the semver work provoked | 17:21 |
| *** sabari_ is now known as zz_sabari_ | 17:21 | |
| clarkb | lifeless: its based on sort order. so for servers you get 2014.1.0a1.devN and for clients you get 1.2.3a1.postN | 17:22 |
| clarkb | lifeless: depending on how things should sort | 17:22 |
| lifeless | clarkb: wat | 17:22 |
| clarkb | beacuse devN says you are working up to that release and postN says this is after that release | 17:22 |
| clarkb | dstufft: ^ did I capture that properly? | 17:22 |
| lifeless | clarkb: yes but we've consolidated all that | 17:22 |
| lifeless | clarkb: after a1 we go to a2.devN | 17:22 |
| lifeless | clarkb: for servers and clients | 17:22 |
| jeblair | clarkb: i believe c gearmand needlessly wakes connections. i like the more efficient approach myself | 17:23 |
| *** gyee has joined #openstack-infra | 17:23 | |
| clarkb | jeblair: +1 | 17:23 |
| *** Sukhdev_ has joined #openstack-infra | 17:23 | |
| jeblair | clarkb: but no, afaik, it's not violating any protocol promises | 17:23 |
| *** Ryan_Lane has joined #openstack-infra | 17:23 | |
| clarkb | lifeless: right but we are not affecting that stack, this is all pre semver in pbr | 17:23 |
| clarkb | lifeless: with semver you would bump the version and always devN | 17:24 |
| lifeless | clarkb: yah, ok well I'll go back into lurk mode, still doing house cleanup | 17:24 |
| dstufft | clarkb: yea more or less, generally .postN is recommend not to include code changes, more like, doc fixes and stuff, but it's not a hard requirement | 17:24 |
| *** gyee has quit IRC | 17:24 | |
| lifeless | clarkb: someone is merging these changes into tip right? | 17:25 |
| *** patrickeast has quit IRC | 17:25 | |
| *** gyee has joined #openstack-infra | 17:25 | |
| clarkb | lifeless: mordred has been shepharding it all | 17:25 |
| clarkb | he has proposals up for the things that make sense against master | 17:25 |
| lifeless | ok, I shall not stress | 17:25 |
| mordred | look it's lifeless | 17:25 |
| *** melwitt1 has joined #openstack-infra | 17:25 | |
| *** jcoufal has quit IRC | 17:25 | |
| mordred | lifeless: yeah, don't stress - I've been merging on to your changes too - but I will want to have a non-rushed conversation with you about the reader class | 17:25 |
| dhellmann | clarkb, lifeless : so is https://review.openstack.org/#/c/142351/2 correct or do we need another patch? | 17:26 |
| mordred | as there may be some new cases it needs to handle now | 17:26 |
| *** e0ne has quit IRC | 17:26 | |
| clarkb | dhellmann: it is correct for the pre semver pbr world which is why that change is on the "feature" branch | 17:26 |
| mordred | yes | 17:26 |
| *** melwitt has quit IRC | 17:26 | |
| dhellmann | clarkb: k | 17:26 |
| mordred | we can't do the full devX plan yet | 17:26 |
| *** melwitt1 is now known as melwitt | 17:26 | |
| Sukhdev_ | anteaya: Ping | 17:26 |
| mordred | because that requires lifeless logic | 17:26 |
| *** Sukhdev has quit IRC | 17:26 | |
| mordred | so for a bit, we'll do post-release logic on top of pre-release releases which is valid pep440 | 17:27 |
| *** jpich has quit IRC | 17:27 | |
| lifeless | mordred: ok | 17:27 |
| lifeless | mordred: you're at LCA right? Maybe we can grab 20m side by side | 17:27 |
| anteaya | Sukhdev_: how can I help? | 17:28 |
| mordred | lifeless: yah | 17:29 |
| *** hasharCall has quit IRC | 17:29 | |
| anteaya | Sukhdev_: I am right here and getting tired of pms | 17:29 |
| anteaya | please talk to me in public | 17:29 |
| mordred | lifeless: although I _really_ want to get your changes into a release version of pbr sooner than that - that might be a pipe dream though | 17:29 |
| anteaya | so hopefully other people can read and learn from your question | 17:29 |
| mordred | lifeless: I do not like needing to make fake feature branches to release new features on top of old code base | 17:30 |
| clarkb | jeblair: is your plan to restart geard/zuul on zuul.o.o with that patch soon? | 17:30 |
| lifeless | mordred: well, can always mail me :) | 17:30 |
| lifeless | mordred: or make a time | 17:30 |
| Sukhdev_ | anteaya: OK - did not want to clutter and bore others :-) | 17:30 |
| mordred | lifeless: bah. I expect you to telepathically know what I'm thinking!!! | 17:30 |
| anteaya | ask away | 17:30 |
| lifeless | ok, -> breakfast then house evisceration | 17:30 |
| clarkb | dhellmann: mordred we should port the distutils fix to master though | 17:30 |
| clarkb | if that hasn't already been pushed | 17:30 |
| dstufft | clarkb: docutils* | 17:30 |
| clarkb | dstufft: sorry type driver is failing me | 17:31 |
| *** doug-fish has left #openstack-infra | 17:31 | |
| Sukhdev_ | anteaya: Want to set up a new meeting on one of the IRC channels | 17:31 |
| anteaya | great | 17:31 |
| dhellmann | clarkb: that's https://review.openstack.org/#/c/142509/ right? | 17:31 |
| clarkb | dhellmann: yup | 17:31 |
| dstufft | dhellmann: yes | 17:31 |
| dhellmann | ugh, cherry pick failed | 17:32 |
| dhellmann | I need lunch before I try that by hand. | 17:32 |
| *** Kat has joined #openstack-infra | 17:32 | |
| Sukhdev_ | anteaya: you are very knowleageable about this stuff - was wondering if there is any guideline to follow | 17:32 |
| *** Ryan_Lane has quit IRC | 17:32 | |
| *** achanda has joined #openstack-infra | 17:32 | |
| Sukhdev_ | anteaya: I see the list of meetings here https://wiki.openstack.org/wiki/Meetings | 17:32 |
| *** Kat is now known as Guest25727 | 17:32 | |
| anteaya | jeblair: any objection to me adding a section to the infra manual about steps to follow to create a new meeting | 17:32 |
| anteaya | Sukhdev_: right now I don't see a section in our infra manual | 17:33 |
| anteaya | Sukhdev_: but you are demonstrating there is a need | 17:33 |
| mordred | clarkb: we should - but I do not have time to do that righ tnow | 17:33 |
| mordred | so I will next time I'm on laptop | 17:33 |
| clarkb | mordred: sounds like dhellmann might get it done after lunch | 17:33 |
| *** wuhg has quit IRC | 17:33 | |
| anteaya | Sukhdev_: I'll create a patch, you can review the patch and give your feedback based on whether or not I was able to answer all your questions | 17:34 |
| *** Guest25727 has quit IRC | 17:34 | |
| *** sarob has quit IRC | 17:34 | |
| clarkb | I need food too and have a new laptop that needs to have new OS installed | 17:34 |
| clarkb | jeblair: so ping if you need/want help with gear things | 17:34 |
| mordred | clarkb, dhellmann: cool | 17:34 |
| Sukhdev_ | anteaya: sure - but, for get me going for now - can you give me a hint? | 17:34 |
| *** arxcruz has quit IRC | 17:35 | |
| Sukhdev_ | anteaya: I am having hard time trying to figure out which time slot is available on which channel and how do I reserve the slot so that there is no conflicts | 17:35 |
| *** _nadya_ has joined #openstack-infra | 17:36 | |
| *** emagana has joined #openstack-infra | 17:36 | |
| *** shashankhegde has joined #openstack-infra | 17:37 | |
| *** Katherine has joined #openstack-infra | 17:38 | |
| anteaya | Sukhdev_: give me 10 minutes | 17:38 |
| Sukhdev_ | anteaya: no worries…thanks | 17:39 |
| *** avozza is now known as zz_avozza | 17:42 | |
| *** sputnik13 has joined #openstack-infra | 17:42 | |
| *** tkelsey has quit IRC | 17:44 | |
| *** sputnik13 has quit IRC | 17:44 | |
| *** AJaeger has joined #openstack-infra | 17:48 | |
| *** armax has quit IRC | 17:48 | |
| Katherine | hi folks. i'm hoping someone may be able to help me with a zuul issue i'm seeing. i'm working with openstack anymore but am an hp employee trying to set up zuul in our ci environment | 17:48 |
| *** gilliard is now known as gilliard_afk | 17:49 | |
| *** _nadya_ has quit IRC | 17:50 | |
| fungi | Katherine: what's the issue? | 17:50 |
| Katherine | i have my environment hooked up well, it seems, and the zuul server and merger are running and getting stream events from gerrit | 17:51 |
| *** jp_at_hp has quit IRC | 17:51 | |
| Katherine | however, in my zuul debug log, i'm seeing: 2014-12-17 10:55:05,704 WARNING zuul.Scheduler: Project fusion not found | 17:51 |
| Katherine | i googled this and found some information but did not see a final resolution | 17:52 |
| Katherine | since the scheduler doesn't recognize my project, gate jobs are not being triggered | 17:52 |
| *** andreykurilin_ has joined #openstack-infra | 17:53 | |
| *** dannywilson has joined #openstack-infra | 17:53 | |
| *** thedodd has joined #openstack-infra | 17:54 | |
| Katherine | sorry, realized i had a type in my intro. "i'm NOT working with openstack anymore..." | 17:54 |
| Katherine | i'd originally worked with it on a former project here at hp | 17:55 |
| *** ryanpetrello has joined #openstack-infra | 17:56 | |
| fungi | Katherine: i believe that error message means zuul saw an event from the gerrit stream for a project named "fusion" but doesn't have an entry for it in the layout.yaml | 17:57 |
| Katherine | yes, that's the gist i got from the stream i found. however, i do have an entry in my layout.yaml: | 17:57 |
| *** Sukhdev has joined #openstack-infra | 17:57 | |
| Katherine | projects: - name: fusion check: - zuul-gate-unittest | 17:57 |
| *** sarob has joined #openstack-infra | 17:58 | |
| fungi | for reference, it's coming from this method: http://git.openstack.org/cgit/openstack-infra/zuul/tree/zuul/scheduler.py#n806 | 17:58 |
| *** marcusvrn has joined #openstack-infra | 17:59 | |
| fungi | so this means that self.layout.projects.get('fusion') is failing | 17:59 |
| pleia2 | anteaya: if you haven't already, I'd ask ttx since he seems to be the meeting guardian | 17:59 |
| pleia2 | not really sure it belongs in an infra manual | 17:59 |
| *** shashankhegde has quit IRC | 17:59 | |
| fungi | pleia2: it may belong in infra-manual once the meeting schedule management tool is further along | 18:00 |
| pleia2 | fungi: yeah, once our tool is running it might | 18:00 |
| Katherine | i found the code in the scheduler.py but couldn't glean anything else from it | 18:00 |
| fungi | pleia2: at which point it will all be determined/changed via code review of configuration in an infra project | 18:00 |
| *** derekh has quit IRC | 18:00 | |
| *** kgiusti has joined #openstack-infra | 18:01 | |
| Katherine | how can i figure out why the projects.get is failing? | 18:01 |
| pleia2 | yeah, I've been following the progress of it | 18:01 |
| pleia2 | hard nut to crack :) | 18:01 |
| fungi | Katherine: so is that the only error you're getting? it could be a log of things... is the layout.yaml readable by the user zuul's running under? | 18:01 |
| *** bdpayne has joined #openstack-infra | 18:01 | |
| *** Sukhdev_ has quit IRC | 18:01 | |
| *** thedodd has quit IRC | 18:01 | |
| openstackgerrit | Anita Kuno proposed openstack-infra/infra-manual: Add a instructions for meetings https://review.openstack.org/142525 | 18:02 |
| Katherine | lol! no, it's not. good catch | 18:02 |
| fungi | Katherine: or maybe the yaml in that file isn't being parsed correctly due to a typo? | 18:02 |
| fungi | aha! file permissions | 18:02 |
| fungi | there you go | 18:02 |
| fungi | Katherine: chances are there were some more severe errors in your logs in that case | 18:02 |
| jogo | wow bug 403510 just triggered a massive gate reset | 18:03 |
| uvirtbot | Launchpad bug 403510 in launchpad-buildd "package maintainers in PPA uploads are what ever was uploaded, results in Debian developers receiving spam" [High,Triaged] https://launchpad.net/bugs/403510 | 18:03 |
| *** tonytan4ever has quit IRC | 18:03 | |
| fungi | jogo: missing a digit? | 18:03 |
| jogo | bug 1403510 | 18:03 |
| uvirtbot | Launchpad bug 1403510 in os-apply-config "gate tests failed with "NameError: name 'StandardError' is not defined"" [High,Confirmed] https://launchpad.net/bugs/1403510 | 18:03 |
| anteaya | Sukhdev: see if you can wade through https://review.openstack.org/#/c/142525/1 | 18:03 |
| Katherine | no errors in the log. just that one warning. i change perms. let me restart things | 18:03 |
| anteaya | Sukhdev: if you have problems or questions, add them as comments to the patch so I can improve it | 18:03 |
| Sukhdev | anteaya: cool - let me review it | 18:04 |
| jogo | I don't see https://review.openstack.org/#/c/142509/ in zuul anywhere either | 18:05 |
| anteaya | pleia2: thanks | 18:05 |
| *** vdo has quit IRC | 18:05 | |
| anteaya | pleia2: yeah I don't know either but at least is is a jumping off point | 18:05 |
| anteaya | since i keep getting asked about it | 18:05 |
| jeblair | clarkb: i'm going to work on debugging the other problem | 18:05 |
| jeblair | clarkb: then make a decision about restarting gear | 18:05 |
| *** dkranz has quit IRC | 18:05 | |
| jeblair | anteaya: yeah, i don't think infra-manual is a good place for meetings right now | 18:07 |
| *** dannywilson has quit IRC | 18:07 | |
| anteaya | and I didn't mention the new tool yet, since I don't know what to say about it | 18:07 |
| anteaya | jeblair: okay | 18:07 |
| anteaya | jeblair: any redirect then? | 18:07 |
| anteaya | I can abandon and then just keep it to point people at who keep asking me | 18:07 |
| *** dannywilson has joined #openstack-infra | 18:07 | |
| jeblair | anteaya: the wiki? | 18:08 |
| *** BobBall is now known as BobBall_AWOL | 18:08 | |
| *** resker has quit IRC | 18:08 | |
| jeblair | anteaya: https://wiki.openstack.org/wiki/Meetings | 18:08 |
| Sukhdev | anteaya: I did a quick read - it gives good steps, but, one thing which is tripping me is to have some kind of a view where I can see what slots are available on which channel | 18:08 |
| anteaya | let's see what ttx thinks | 18:08 |
| anteaya | Sukhdev: yeah, we don't have that yet | 18:09 |
| *** markmcclain has joined #openstack-infra | 18:09 | |
| anteaya | Sukhdev: it doesn't exist | 18:09 |
| jeblair | there's the ical feed | 18:09 |
| Sukhdev | anteaya: If there was a tool (or a way) to see that, that will be really cool | 18:09 |
| *** HeOS has quit IRC | 18:09 | |
| anteaya | Sukhdev: great | 18:09 |
| *** gondoi is now known as zz_gondoi | 18:09 | |
| anteaya | that tool is under development | 18:09 |
| anteaya | Sukhdev: what to help develop it? | 18:09 |
| *** shayneburgess has joined #openstack-infra | 18:09 | |
| anteaya | jeblair: there is, which I have never gotten to work for me, so I can tell people how to use it since I don't know myself | 18:10 |
| anteaya | can't | 18:10 |
| Sukhdev | anteaya: I used that iCal app and it messed up my calander on the mac - having hard time cleaning it | 18:10 |
| *** markmcclain has quit IRC | 18:10 | |
| anteaya | Sukhdev: http://git.openstack.org/cgit/openstack-infra/irc-meetings/tree/README.rst | 18:10 |
| *** Guest51388 has quit IRC | 18:11 | |
| *** dannywilson has quit IRC | 18:12 | |
| Sukhdev | anteaya: So, for now, I have to pick a time and work iteratively and see if it is taken, if yes, pick another and keep going!!!! Yikes :-( | 18:12 |
| *** Ryan_Lane has joined #openstack-infra | 18:12 | |
| anteaya | that is what I have to do | 18:13 |
| Sukhdev | anteaya: Thanks for such a quick response and putting the patch out. I will re-read and add the comments that I posted here on this channel. | 18:13 |
| anteaya | I honestly don't know what else to tell you in terms of booking a meeting | 18:13 |
| anteaya | thanks | 18:13 |
| Sukhdev | anteaya: BTW, one question for clarification - say I figure out the time, and update the meeting wiki to add my meeting there | 18:14 |
| anteaya | ttx so I have composed some steps for creating and chairing a meeting and they need a home, how do you feel about me adding them to the meetings wikipage? https://review.openstack.org/#/c/142525/1 | 18:14 |
| Sukhdev | anteaya: how does it tie into the back-end? For example, when #startmeeting <meeting-name> is executed, how does the back-end know if it is a valid meeting or not? | 18:15 |
| *** thedodd has joined #openstack-infra | 18:15 | |
| *** garyk has quit IRC | 18:15 | |
| anteaya | any meeting that uses the #startmeeting command is a valid meeting | 18:15 |
| anteaya | there is no tie in between the bot and the wikipage | 18:16 |
| *** Masahiro has joined #openstack-infra | 18:16 | |
| anteaya | the meetings are booked on the honour system | 18:16 |
| anteaya | if you run a meeting and you haven't booked the space | 18:16 |
| anteaya | you will get the look of disapproval from others | 18:16 |
| Sukhdev | anteaya: Oh - so, if I misspell the name of the meeting, it will think it is a different meeting :-):-) | 18:16 |
| anteaya | yes | 18:16 |
| anteaya | and a new log category will be created | 18:17 |
| Sukhdev | anteaya: As usual, you have been very helpful - I knew you will provide some insight to this….and, you have done so….appreciate it, and big thank you…. | 18:18 |
| *** sarob has quit IRC | 18:18 | |
| anteaya | good luck with your meeting | 18:20 |
| anteaya | and you are welcome | 18:20 |
| *** marun has quit IRC | 18:20 | |
| *** Masahiro has quit IRC | 18:20 | |
| nelsnelson | Greetings, channel. I'm trying to come up with an easy way to modify the tempest.conf file prior to the running of the tempest tests during a devstack-gate invocation run. Is there currently a best way to accomplish this at present? | 18:21 |
| tchaypo | jogo: i can’t see it either. I’m assuming that’s because of the gearman issues that jeblair/clarkb are (i think) working on | 18:23 |
| tchaypo | Sukhdev: fwiw, the infra team can manually go into the servers and rename files for you if the meeting name is wrong | 18:24 |
| tchaypo | Sukhdev: bug obviously that’s manual work and it’s going to make them sad, so try to avoid it if you can ;) | 18:24 |
| *** shashankhegde has joined #openstack-infra | 18:24 | |
| Sukhdev | tchaypo: Understood - thanks | 18:25 |
| *** bdpayne has quit IRC | 18:25 | |
| *** ivar-lazzaro has joined #openstack-infra | 18:26 | |
| Katherine | fungi, i must have also had a typo in my layout.yaml. i simplified it and that fixed that issue | 18:26 |
| *** dkranz has joined #openstack-infra | 18:26 | |
| Katherine | thank you | 18:26 |
| fungi | Katherine: you're welcome--glad you managed to work it all out | 18:26 |
| *** mpaolino has quit IRC | 18:27 | |
| jogo | tchaypo: ahhh makes sense | 18:28 |
| fungi | nelsnelson: devstack's lib/tempest does a lot of tempest configuration tweaking | 18:29 |
| *** baoli has quit IRC | 18:29 | |
| nelsnelson | fungi, taking a look... | 18:29 |
| fungi | nelsnelson: looks like it starts from the sample tempest config, so you might be able to substitute your own... | 18:30 |
| *** patrickeast has joined #openstack-infra | 18:30 | |
| fungi | nelsnelson: ot | 18:30 |
| fungi | er | 18:30 |
| *** luqas has quit IRC | 18:30 | |
| fungi | nelsnelson: or it's possible you could make iniset calls in devstack through a custom plugin | 18:31 |
| *** ryanpetrello has quit IRC | 18:31 | |
| nelsnelson | fungi, I am not familiar with iniset calls | 18:31 |
| fungi | nelsnelson: the calls you see in lib/tempest and lib/heat to change entries in $TEMPEST_CONFIG | 18:32 |
| *** armax has joined #openstack-infra | 18:32 | |
| nelsnelson | oh i see now | 18:32 |
| nelsnelson | fungi, yeah this looks good. | 18:33 |
| jeblair | fungi, clarkb: there is a network error involved in the set_description problem | 18:33 |
| nelsnelson | fungi, I'm not sure how to create a custom plugin, tho | 18:33 |
| fungi | nelsnelson: it's possible we have some job examples where tempest configuration is tweaked | 18:33 |
| fungi | jeblair: that makes a lot of sense actually | 18:33 |
| *** zz_sabari_ is now known as zz_zz_sabari_ | 18:33 | |
| *** SumitNaiksatam has joined #openstack-infra | 18:34 | |
| fungi | jeblair: so maybe we have some network connectivity problems with jenkins01 which are periodically triggering this behavior | 18:34 |
| anteaya | are there any guidelines for when someone can add instructions to install a new package on a devstack node? | 18:34 |
| jeblair | fungi: seems likely. i'm still piecing the tcp events together | 18:34 |
| anteaya | I am sure jhesketh is doing the right thing, but I don't know what guidelines to follow in these cases | 18:35 |
| anteaya | just let people add packages if the commit message makes sense? | 18:35 |
| *** marun has joined #openstack-infra | 18:35 | |
| fungi | anteaya: can you link the review you're talking about? | 18:36 |
| anteaya | https://review.openstack.org/#/c/142327/1 | 18:36 |
| anteaya | it isn't a question about this patch | 18:36 |
| anteaya | it is about this kind of patch in general | 18:36 |
| anteaya | if there are no guidelines that is fine | 18:37 |
| anteaya | I was just wondering if there were | 18:37 |
| fungi | anteaya: as with all patches of this kind, the trick is to find out why and if it can't be done another way, of course | 18:37 |
| anteaya | okay | 18:38 |
| anteaya | I will look into that | 18:38 |
| fungi | for example, in this specific case, i'm curious whether the upload can't run from a virtualenv with that python library installed | 18:38 |
| fungi | every python library package we preinstall on a worker has the chance to drag in others and potentially conflict with things we try to run from virtualenvs with system site packages enabled, et cetera | 18:39 |
| anteaya | I guess I don't understand why a virtualenv would be different from a node in this case | 18:39 |
| jeblair | fungi: i think we put zuul-cloner in a venv, right? | 18:39 |
| anteaya | right, hence my question about just tossing in another dependency | 18:39 |
| *** salv-orlando has quit IRC | 18:39 | |
| fungi | anteaya: for a simple example, what if tempest also uses python-magic but isn't compatible with the version in debian | 18:40 |
| fungi | s/debian/ubuntu/ | 18:40 |
| anteaya | good point | 18:40 |
| fungi | jeblair: i believe so, yes | 18:40 |
| anteaya | so create a venv on the devstack node and install that lib within the venv | 18:40 |
| anteaya | is that what you are saying? | 18:40 |
| fungi | anteaya: if the uploader can be run from within a venv, then yes | 18:41 |
| fungi | i can't immediately imagine why it wouldn't be able to | 18:41 |
| anteaya | okay | 18:41 |
| anteaya | I'll put that in a comment, thank you | 18:41 |
| fungi | and that has the benefit of isolating it from causing trouble for other jobs run on those workers | 18:41 |
| anteaya | yes | 18:42 |
| jeblair | anteaya: (to very specifically answer your question -- even though we don't have good guidelines for this kind of change, they can be tricky, so definitely don't just merge if the commit msg makes sense; asking for help is the way to go. thanks for doing so!) | 18:42 |
| fungi | yep, when in doubt, ask. that's why there are multiple people collaborating on reviews ;) | 18:42 |
| anteaya | jeblair: okay thanks | 18:42 |
| anteaya | I'd rather be told to be quiet and go away rather than make a mistake with a merge decision | 18:43 |
| anteaya | fungi: thanks | 18:43 |
| fungi | i'd rather not tell you to be quiet and go away. make more noise and ask questions | 18:44 |
| jeblair | and stick around | 18:44 |
| fungi | though also, if you do merge something which causes trouble, it's not the end of the world (we've all done it). there's always git revert | 18:45 |
| anteaya | thanks | 18:45 |
| *** Hefeweizen has quit IRC | 18:45 | |
| anteaya | right I will be sure to let you know once I realize I have made a mistake when I do, so it can get fixed as fast as possible | 18:46 |
| harlowja | qq, doesn't anyone have a sec to look into where https://review.openstack.org/#/c/142499/ went (it doesn't appear to be in zuul, wondering if it got lost somewhere) | 18:47 |
| *** teran has quit IRC | 18:48 | |
| *** matel has quit IRC | 18:49 | |
| anteaya | fungi: can you -2 this oslo.version -> openstack-attic patch please? | 18:49 |
| anteaya | fungi: no sense me doing it in case I am not around when the rename happens | 18:50 |
| *** ryanpetrello has joined #openstack-infra | 18:50 | |
| anteaya | just to prevent it getting merged prematurely | 18:50 |
| *** tonytan4ever has joined #openstack-infra | 18:50 | |
| fungi | harlowja: i think that's stuck in the zuul event queue backlog jeblair is debugging | 18:51 |
| *** Sukhdev has quit IRC | 18:51 | |
| harlowja | kk | 18:51 |
| harlowja | fungi thx | 18:51 |
| fungi | anteaya: sure thing | 18:51 |
| anteaya | fungi: thanks | 18:52 |
| AJaeger | anteaya: thanks for asking! | 18:52 |
| anteaya | AJaeger: :D | 18:52 |
| anteaya | AJaeger: we all get to learn new things | 18:52 |
| dhellmann | clarkb, mordred : I'm looking at that backport now and getting a weird error where LocalBuildDoc is being used before it is defined | 18:52 |
| AJaeger | anteaya: a lot - and it's difficult to keep up to date... | 18:52 |
| anteaya | AJaeger: true | 18:53 |
| dhellmann | clarkb, mordred : that's in the pbr unit tests, possibly because I have sphinx installed? | 18:53 |
| fungi | AJaeger: i've been core/root on the team for more than two years now and still continually find things i didn't know about | 18:53 |
| fungi | that's part of the fun! ;) | 18:54 |
| dims | anteaya: fungi: thanks for the oslo.version attic review...we were not sure about the process when we filed the review :) | 18:54 |
| *** esker has joined #openstack-infra | 18:54 | |
| *** achanda has quit IRC | 18:54 | |
| AJaeger | fungi: if even you can't keep up, I'm giving up to try ;) | 18:54 |
| fungi | dims: yeah, looks good. it's a low-priority task we'll batch up with other rename requests in a maintenance window since there's gerrit down-time required to do it | 18:54 |
| anteaya | dims: it looks like you have everything right on the patch, we just have to make sure it merges during a rename window, which means a scheduled gerrit downtime | 18:54 |
| anteaya | AJaeger: dude, no way I can keep up with you | 18:55 |
| dims | thanks a bunch, yes, absolutely +1 low priority | 18:55 |
| anteaya | AJaeger: but you are inspiring :D | 18:55 |
| dims | anteaya: i told AJaeger the same :) | 18:55 |
| *** achanda has joined #openstack-infra | 18:55 | |
| dims | too fast! | 18:56 |
| anteaya | dims: :D he is | 18:56 |
| fungi | he rocks the stackalytics and reviewstats data constantly | 18:56 |
| anteaya | so efficient | 18:56 |
| anteaya | someone has to | 18:56 |
| anteaya | glad it is someone I get to work with | 18:56 |
| *** markmcclain has joined #openstack-infra | 18:56 | |
| AJaeger | still, I miss a lot since I can't be the whole day on IRC like you are... | 18:56 |
| fungi | he and dims are apparently tied on http://stackalytics.com/?metric=person-day&project_type=all right now | 18:57 |
| dims | ah, never saw that view :) | 18:57 |
| dims | fungi: i see you tied as well! | 18:58 |
| AJaeger | fungi, you're there as well! | 18:58 |
| fungi | dims: yes, proof we all spend too much time on computers i guess | 18:58 |
| dims | lol | 18:58 |
| AJaeger | ;) | 18:58 |
| AJaeger | how is that metric calculated? | 18:58 |
| *** koolhead17 has joined #openstack-infra | 18:59 | |
| fungi | no clue. i assume it's tarot cards and tea leaves | 18:59 |
| *** gyee has quit IRC | 19:00 | |
| AJaeger | that would explain it - I expect that fungi spend more "real" person days on the project than I did. Just some of his work is not visible ;( | 19:00 |
| clarkb | dhellmann: I think that was the issue we were attempting to fix. maybe the code changed enough since 0.10.0 that the same fix does not apply? | 19:01 |
| *** otter768 has joined #openstack-infra | 19:01 | |
| dhellmann | clarkb, mordred : https://review.openstack.org/#/c/142509/ is approved in that feature branch but is still pending merge. When I "git review -d" it the tests fail with the same error. | 19:01 |
| clarkb | dhellmann: hrm maybe it is not a complete test /me tries to reproduce | 19:01 |
| dhellmann | clarkb: see my comment on https://review.openstack.org/#/c/142509/ | 19:02 |
| fungi | huh, yeah it hasn't merited a check pipeline run yet | 19:02 |
| *** afazekas has quit IRC | 19:02 | |
| dhellmann | no tests have run in CI for that patch -- there are no comments by jenkins | 19:02 |
| *** bdpayne has joined #openstack-infra | 19:03 | |
| clarkb | dhellmann: oh so it still has an import time error | 19:03 |
| dhellmann | clarkb: yeah | 19:03 |
| fungi | i get the same | 19:03 |
| fungi | in py27 even | 19:03 |
| clarkb | ya reproduced | 19:03 |
| fungi | playing with the patch real quick to see if i can come up with a relevant solution | 19:04 |
| dhellmann | fixing that error by changing the base class to add the "Sphinx" prefix gives me a different error where we are trying to call a None somewhere | 19:04 |
| clarkb | awesome I am going to go back to hiding behind "make new machine work" | 19:04 |
| fungi | yeah, saw your comment on the change | 19:04 |
| dhellmann | paste.openstack.org is giving me internal errors | 19:04 |
| clarkb | we should just untrove that instance | 19:05 |
| dhellmann | the new error from pbr: http://pastebin.com/4yJvQh9p | 19:05 |
| asselin | any apache experts have tips to help out with mod_cache_disk? https://review.openstack.org/#/c/141518/ | 19:05 |
| *** tonytan4ever has quit IRC | 19:05 | |
| *** gyee has joined #openstack-infra | 19:06 | |
| *** otter768 has quit IRC | 19:06 | |
| anteaya | openstack-infra has a stackalytics page: http://stackalytics.com/?metric=person-day&project_type=all&user_id=hudson-openstack | 19:07 |
| *** dannywilson has joined #openstack-infra | 19:08 | |
| anteaya | AJaeger: to follow up on https://review.openstack.org/#/c/140409/ and to include mestery | 19:09 |
| dhellmann | clarkb, fungi, mordred : is the master branch of pbr broken? | 19:09 |
| anteaya | AJaeger: so yes you are correct in general we discourage tags and branches when creating new repos | 19:09 |
| anteaya | AJaeger: but this is not a general case | 19:09 |
| anteaya | AJaeger: this is a new repo created as a split from neutron | 19:09 |
| fungi | dhellmann: broken with setuptools 8 still i think | 19:10 |
| dhellmann | ah, ok | 19:10 |
| fungi | dhellmann: but also has not-yet-completed semver work on it | 19:10 |
| *** hdd has joined #openstack-infra | 19:10 | |
| fungi | dhellmann: basically we have inverted master and feature branches here | 19:10 |
| anteaya | AJaeger: and we are following the pattern we created when we did the neutron services split (lbaas, fwaas, vpnaas) | 19:10 |
| dhellmann | fungi: ok, I think I get it | 19:10 |
| fungi | dhellmann: think of feature/0.10 as the actual master branch of pbr, and master would at the moment be more correctly a feature/semver branch | 19:11 |
| anteaya | AJaeger: and in those cases, we want the seed repo to have tags and branches if there were tags and branches from the code in neutron | 19:11 |
| *** dannywil_ has joined #openstack-infra | 19:11 | |
| AJaeger | anteaya: I wasn't aware of that. So far I worked on the assumption that split up repos were never released with these tags/branches, so there's no sense to import them. | 19:11 |
| anteaya | AJaeger: so both you and mestery are correct, but your comments AJaeger apply to the general case, which this patch is not | 19:11 |
| dhellmann | fungi: do you have any idea why zuul isn't running the tests for the feature/0.10 branch? | 19:12 |
| anteaya | AJaeger: yes sorry, this happened when I was at the neutron code sprint last week and clark and fungi were helping from infra | 19:12 |
| AJaeger | anteaya: and indeed the neutron-lbaas repo has the tags and branches | 19:12 |
| anteaya | AJaeger: monday and tuesday | 19:12 |
| *** dannywilson has quit IRC | 19:12 | |
| dhellmann | fungi: or at least that one patch, I guess, I haven't checked all of them | 19:12 |
| AJaeger | anteaya: you're ahead of me on this one ;) | 19:12 |
| AJaeger | anteaya: thanks for telling me. | 19:13 |
| fungi | dhellmann: zuul has an event backlog, jeblair is debugging | 19:13 |
| anteaya | AJaeger: on this one yes | 19:13 |
| dhellmann | fungi: ok | 19:13 |
| anteaya | AJaeger: sorry I didn't think to tell you before | 19:13 |
| * AJaeger removes his +2 for now and let you comment | 19:13 | |
| openstackgerrit | Stefano Maffulli 'reed' proposed openstack-infra/system-config: Remove community.openstack.org from the list of server https://review.openstack.org/142544 | 19:13 |
| anteaya | AJaeger: the patch itself looks fine and I'm fine with the history if mestery is, right now I am waiting on clean up | 19:13 |
| AJaeger | anteaya: no problem, I don't have a problem with learning and revisiting my comments when I get new knowledge. Thanks for telling me! | 19:13 |
| anteaya | AJaeger: they don't have the patches ready to merge to delete the split out code once the patch is merged, and they don't yet see the importance of ensuring the two patches (repo creation and code deletion) happen in quick successtion | 19:14 |
| anteaya | but we will get there | 19:14 |
| anteaya | AJaeger: thank you for understanding, and being so patient with me | 19:15 |
| anteaya | :D | 19:15 |
| AJaeger | ;) | 19:15 |
| pleia2 | anteaya: hopefully a quick question, are there still plans to flesh out -manual with a new/useful version of jaypipes' blog posts? I'd like to help with review+testing of this work if so (plus, it'll help with my understanding of building one from the ground up, where now I'm only familiar with maintenance+management) | 19:16 |
| anteaya | well I defer to jeblair here | 19:17 |
| *** btran has joined #openstack-infra | 19:17 | |
| pleia2 | I think there is a need to put it *somewhere* not-on-a-blog, since we get so many questions that I have trouble answering, and wish I could | 19:17 |
| anteaya | since the latest is that third party documentation gets directed to system-config/.. third-party.rst | 19:17 |
| anteaya | me too | 19:17 |
| anteaya | I agree that somewhere not-on-a-blog would be good | 19:18 |
| anteaya | at this very moment, I have no confidence where that place is | 19:18 |
| *** koolhead17 has quit IRC | 19:18 | |
| anteaya | but I encourage you to champion finding out | 19:18 |
| anteaya | and to put the information in that yet to be discovered place | 19:18 |
| anteaya | and I will happliy point to it when asked | 19:19 |
| pleia2 | anteaya: ok, I assume the third party folks don't care, as long as it exists in a link we can point them to? | 19:19 |
| anteaya | well less that they don't care and more that it isn't their decision | 19:19 |
| jaypipes | pleia2: ++. I will help with that effort, and I can try and get someone else at Mirantis to contribute to the effort as well. | 19:19 |
| *** erlon has quit IRC | 19:19 | |
| pleia2 | great, so it's just up to us to find it a home | 19:19 |
| anteaya | and if we point them to it they can read it | 19:20 |
| pleia2 | jaypipes: wonderful, I know you put some effort in previously so I really don't want to see it wasted again | 19:20 |
| anteaya | jaypipes: thanks jay :D | 19:20 |
| pleia2 | I'll stick it on the meeting agenda for now, will remove if we get an answer earlier than that | 19:20 |
| jaypipes | pleia2: I just feel bad that you all have gotten questions on it and I have not been able to answer them :( | 19:20 |
| anteaya | jaypipes: we all get so busy | 19:21 |
| pleia2 | jaypipes: yeah, they come from all over the place so it's tricky to keep track unless you work on it full time | 19:21 |
| anteaya | glad to have your help whenever you can | 19:21 |
| pleia2 | it == infra | 19:21 |
| *** AJaeger has quit IRC | 19:21 | |
| fungi | dhellmann: trying to interpret the intent of mordred's patch, i think the LocalBuildDoc definition was meant to come between the SphinxLocalBuildDoc and SphinxLocalBuildLatex class definitions, but i'm still getting another error when i fix that | 19:21 |
| anteaya | pleia2: yes putting it on the agenda can't hurt, then it won't get lost | 19:21 |
| jaypipes | pleia2: you want me to give an initial stab at it in the ci.openstack.org docs repo? | 19:21 |
| anteaya | jaypipes: well that is what we are just discussing | 19:22 |
| jaypipes | k | 19:22 |
| anteaya | where is the best place | 19:22 |
| dhellmann | fungi: I'm trying another approach to solve the problem with some proper refactoring | 19:22 |
| pleia2 | jaypipes: we're trying to determine whether to put it in ci. or under docs/infra-manual, so I'd hold off until we know which | 19:22 |
| pleia2 | jaypipes: that saidy, they're both .rst, so you could do some prep and then move to land it whereever we select | 19:22 |
| fungi | dhellmann: okay, cool. i've so far reached "ImportError: pbr.packaging.LocalBuildDoc" | 19:22 |
| pleia2 | -y | 19:22 |
| jaypipes | k, | 19:22 |
| dhellmann | fungi: oh, try adding global statements for the symbols that function modifies and see if that helps | 19:22 |
| fungi | dhellmann: i did, but not after reordering. testing now | 19:23 |
| jaypipes | pleia2: k, in the holiday week I plan to rework a number of things and do the ansible stuff I planned to do earlier, so I can adapt the blog posts into RST files at the same time. | 19:23 |
| jaypipes | pleia2: shall we aim for early-to-mid January to make this a reality? | 19:24 |
| pleia2 | jaypipes: perfect | 19:24 |
| jaypipes | cool. | 19:24 |
| anteaya | hopefully we should know where it should go by then | 19:24 |
| fungi | dhellmann: nah, http://paste.openstack.org/show/152382/ but i'll see how far this rabbit hole goes | 19:25 |
| *** bitblt has joined #openstack-infra | 19:25 | |
| jaypipes | krotscheck: Is the Login button on storyboard broken? I click on it and it just goes to https://storyboard.openstack.org/#!/auth/authorize and doesn't do anything. | 19:26 |
| jaypipes | krotscheck: I'd log a bug about it... but ... can't log in :) | 19:27 |
| krotscheck | jaypipes: WFM - can you take a quick look at your browser console and see what kind of an error it’s throwing? | 19:27 |
| jaypipes | sure, sec | 19:27 |
| krotscheck | Also, what browser are you using? | 19:27 |
| jaypipes | krotscheck: chromium: http://paste.openstack.org/show/152383/ | 19:28 |
| krotscheck | jaypipes: Ok, lemme bounce out to chromium and see if I can repro. | 19:29 |
| pleia2 | jaypipes: does it work if you hit it again? (I think Chrome's caching does something weird so it works for me the 2nd time sometimes) | 19:29 |
| jaypipes | krotscheck: here's all of it: http://paste.openstack.org/show/152384/ | 19:29 |
| jaypipes | lemme check a shift f5 | 19:29 |
| jaypipes | hmm, yep, that did it. a shift F5 worked. | 19:29 |
| jaypipes | weird... | 19:29 |
| krotscheck | jaypipes: When was the last time you used StoryBoard? | 19:30 |
| jaypipes | hmm, I think maybe a couple weeks ago? | 19:30 |
| *** fifieldt_ has quit IRC | 19:30 | |
| krotscheck | jaypipes: That might be it. I’m pondering there might be an edge case with expired refresh tokens. | 19:30 |
| jaypipes | well, at least I know now what to do :) | 19:30 |
| jaypipes | thx guys | 19:31 |
| krotscheck | jaypipes: We did fix a couple of bugs in refresh tokens a few days ago, but that oculd have introduced somethign else. Either way, I’m glad we got you working again :) | 19:31 |
| *** andreykurilin_ has quit IRC | 19:32 | |
| jaypipes | krotscheck: cheers! | 19:32 |
| jaypipes | and now I can go work on https://storyboard.openstack.org/#!/story/2000084 :) | 19:32 |
| dhellmann | fungi, clarkb, mordred : do we have a simple way to test a fix for this issue with sphinx and pbr? | 19:32 |
| fungi | dhellmann: as in not running pbr unit tests? | 19:33 |
| dhellmann | fungi: yeah, because the unit tests have sphinx installed and I thought this was an issue with not having sphinx installed? | 19:33 |
| fungi | oh, recreating the bug | 19:33 |
| dhellmann | yeah | 19:33 |
| clarkb | ya its install a thing that installs docutils under python3 | 19:33 |
| fungi | seeing what i can come up with now | 19:33 |
| morganfainberg | fungi, clarkb, i'm going hold off on tagging new keystoneclient / middleware etc until i hear from you guys we're all clear from the stuff going on today (whatever it is) - i don't want to have a ksc release or something go out and have a huge delay to fix it if there is something wrong with it and breaking lots of people. | 19:33 |
| clarkb | because docutils relies on 2to3 | 19:33 |
| dhellmann | clarkb: so if I can run pbr's unit tests on py33 we should be ok? | 19:34 |
| clarkb | dhellmann: yes I think that should cover it | 19:34 |
| clarkb | or py34 | 19:34 |
| dhellmann | ok, cool, new patch incoming | 19:34 |
| dhellmann | well, let me check my setuptools version before I declare victory | 19:35 |
| morganfainberg | not that i expect something to be broken with client or middleware :P but you know... same reason i wont release on a friday if avoidable | 19:35 |
| *** dims has quit IRC | 19:35 | |
| *** adalbas has quit IRC | 19:35 | |
| *** dims has joined #openstack-infra | 19:36 | |
| *** alexpilotti has quit IRC | 19:36 | |
| *** flwang has quit IRC | 19:37 | |
| *** hashar has joined #openstack-infra | 19:37 | |
| fungi | clarkb: "NameError: name 'StandardError' is not defined" bubbling up from docutils/__init__.py is the hallmark of this bug, right? | 19:38 |
| *** johnthetubaguy is now known as zz_johnthetubagu | 19:39 | |
| *** ChuckC has quit IRC | 19:39 | |
| dstufft | fungi: yes | 19:40 |
| clarkb | yup | 19:40 |
| *** dims has quit IRC | 19:40 | |
| fungi | k | 19:40 |
| *** salv-orlando has joined #openstack-infra | 19:40 | |
| fungi | most interestingly, with 142509 checked out i still get that | 19:41 |
| dhellmann | what do I need to put in my .gitreview file to make it submit the patch against the feature branch? | 19:41 |
| dhellmann | is that option called "defaultbranch"? | 19:41 |
| fungi | dhellmann: yes, or just type the branchname at the end of the command | 19:42 |
| fungi | git review feature/0.10 | 19:42 |
| dhellmann | fungi: https://review.openstack.org/142560 and https://review.openstack.org/142561 | 19:42 |
| dhellmann | clarkb, mordred : ^^ | 19:42 |
| dhellmann | the second one is the interesting one, with the fix | 19:43 |
| dougwig | dhellmann: defaultbranch=feature/lbaasv2 | 19:43 |
| dougwig | e.g. | 19:43 |
| dhellmann | the new options module was needed to avoid circular import issues, but the rest of the changes should be pretty straightforward code shuffling | 19:43 |
| clarkb | cool I will look in a bit. I just about have new machine working the way I want it | 19:44 |
| dhellmann | the solution was to put the sphinx command classes in a place where they can always be imported, and have commands refer to that only if sphinx is available | 19:44 |
| dhellmann | that way commands never refers to a thing in a module that might be None | 19:44 |
| *** dpyzhov has joined #openstack-infra | 19:45 | |
| fungi | dhellmann: makes sense. that was quick for such a significant refactoring | 19:45 |
| *** salv-orlando has quit IRC | 19:45 | |
| fungi | trying it out now | 19:45 |
| dpyzhov | Hi guys. We have a really critical fix in merge queue. It was approved an hour ago. But it still not merged. What can be done in order to push it? | 19:46 |
| dhellmann | fungi: oslo has given me lots of practice at this :-) | 19:47 |
| dpyzhov | https://review.openstack.org/#/c/142518/ and https://review.openstack.org/#/c/142519/ | 19:47 |
| *** fifieldt_ has joined #openstack-infra | 19:47 | |
| *** e0ne has joined #openstack-infra | 19:47 | |
| *** SumitNaiksatam has quit IRC | 19:47 | |
| *** yamamoto has joined #openstack-infra | 19:47 | |
| fungi | dhellmann: strangely, i'm still reproducing the docutils exception with tox -epy34 (on debian, though shouldn't matter i think?) | 19:47 |
| *** eharney has quit IRC | 19:48 | |
| dhellmann | fungi: hmm, I upgraded setuptools in my venv and ran the tests but I didn't rebuild the venv at that point | 19:49 |
| dhellmann | where do you see the failure? | 19:49 |
| fungi | dhellmann: docutils/__init__.py", line 68 | 19:49 |
| dhellmann | I mean what do you do to trigger it? | 19:49 |
| fungi | dhellmann: tox -r -e py34 | 19:49 |
| dhellmann | ok, yeah, that's what I didn't do | 19:50 |
| dhellmann | let me set up a cloud vm with latest setuptools and try that | 19:50 |
| pleia2 | nibalizer: https://twitter.com/golang/status/545108371628519424 | 19:50 |
| nibalizer | pleia2: there you go! | 19:51 |
| pleia2 | nibalizer: I don't know if this turns it into an action item, but it's something :) | 19:51 |
| *** changbl has joined #openstack-infra | 19:51 | |
| *** yamamoto has quit IRC | 19:52 | |
| anteaya | so armax and I were talking about neutron code split process | 19:53 |
| anteaya | and we were just trying to get our steps straight to ensure both ends were doing the agreed upon thing | 19:53 |
| anteaya | and I appreciate him putting in the effort here so we can get a process | 19:53 |
| *** _nadya_ has joined #openstack-infra | 19:53 | |
| anteaya | now the question of when the code needs to be deleted in neutron has come up | 19:53 |
| *** HeOS has joined #openstack-infra | 19:54 | |
| anteaya | I feel that part of my responsiblity to +2 or +3 the new repo creation patch with a seed repo of code split from neutron | 19:54 |
| armax | anteaya: thanks, my assumption was that we’d create the project on stackforge, seeded with an existing code + history | 19:54 |
| fungi | pleia2: nibalizer: the amusing part is not only does their tool come in about google search result #25 for "git-review" (the first 20+ of which are our tool) but even gets beat out by https://www.npmjs.com/package/git-review | 19:54 |
| armax | and then we’d go about taking on the steps of cleaning up the neutron repo and getting in sync with the external module | 19:55 |
| anteaya | is to ensure there are clean up patches against neutron that have been reviewed, are ready to merge, and have an approver standing by to +A as soon as the new repo is successfully created | 19:55 |
| marun | anteaya: I'm not sure I agree with that approach. | 19:55 |
| anteaya | armax is concerned that this will prevent the work from happening as he had thought that code clean up could happen when it was convienent for neutron | 19:55 |
| marun | anteaya: It's more likely that we'd need to iterate on the cleanup patch(es). | 19:55 |
| anteaya | including experiementing when the code was in both repos | 19:55 |
| pleia2 | fungi: hah, yeah, I thought about making a crack about using a tool called "google" to search for existing project names ;) | 19:56 |
| armax | anteaya: my understing was that we’d only need to ensure history was preserved and then that we could iterate on it | 19:56 |
| marun | anteaya: We're all adults here, I think we can and should be trusted to do the removal in a timely fashion rather than requiring it be immediate. | 19:56 |
| dpyzhov | fungi: can you help me or route to someone to help? we have hanged merge requests | 19:56 |
| anteaya | so we brought the conversation to the public channel to get some input | 19:56 |
| pleia2 | fungi: but I wasn't grumpy enough | 19:56 |
| armax | the other question I had, is how much history should be preserved | 19:56 |
| fungi | dpyzhov: zuul is backed up at the moment, currently being debugged | 19:56 |
| armax | just the one of master, or the one of master + stable + tags | 19:56 |
| dpyzhov | fungi: do you have any estimates? | 19:56 |
| fungi | dpyzhov: no, i do not | 19:57 |
| *** sarob has joined #openstack-infra | 19:57 | |
| ttx | anteaya: ok... content sounds good. Maybe create a "how to run a meeting" page and link it from the top of the Meetings page ? | 19:57 |
| dpyzhov | fungi: ok, thanks. we’ll wait | 19:57 |
| anteaya | marun: it has nothing to do with maturity, and everything to do with infra responsiblity for repo accuracy and cleanup | 19:57 |
| ttx | anteaya: since that page should be autogenerated from openstack-infra/irc-meetings soon | 19:57 |
| anteaya | ttx I can do that, thanks | 19:57 |
| armax | so in a nutshell, what to expect when one specifies an ‘upstream’ repo on the project creation? | 19:58 |
| ttx | that will allow to link to same page once that is done | 19:58 |
| anteaya | ttx great | 19:58 |
| anteaya | armax marun I appreciate you coming here to talk about it as I think it needs to be discussed | 19:58 |
| anteaya | apparently right now I'm alone on this one | 19:58 |
| marun | anteaya: I'm not clear on what infra's responsibility is, exactly. Can you please explain and/or point me to documentation? | 19:59 |
| marun | (in this instance, of course) | 19:59 |
| *** jcoufal has joined #openstack-infra | 19:59 | |
| anteaya | but I do hope others will read backscroll and offer their thoughts | 19:59 |
| anteaya | marun: I don't know as we have documentation, more like axioms | 19:59 |
| anteaya | like "don't delete history" | 19:59 |
| anteaya | and I am assuming we have one that goes along the lines of "code exists in one place" | 20:00 |
| marun | anteaya: So is the concern that the cleanup patch has to match up with what is retained in the other repo? | 20:00 |
| *** armax has quit IRC | 20:00 | |
| anteaya | though I haven't heard that stated outright | 20:00 |
| marun | anteaya: to avoid the process being lossy? | 20:00 |
| anteaya | marun: yes, to fit the "code exists in one place" axiom | 20:00 |
| *** armax has joined #openstack-infra | 20:00 | |
| anteaya | marun: or to avoid divergence | 20:00 |
| marun | anteaya: I'm not entirely clear that this is necessary, though. | 20:01 |
| anteaya | and then a forced cleanup | 20:01 |
| anteaya | great | 20:01 |
| marun | anteaya: The code we're talking about is going to be vendor-specific. | 20:01 |
| anteaya | which is why we are discussing it here | 20:01 |
| marun | anteaya: It's not generally applicable or useful to the project as a whole - that's why we want to externalize it. | 20:01 |
| *** markmcclain has quit IRC | 20:01 | |
| marun | anteaya: So I'm not sure the same rules as community code need to be followed. | 20:01 |
| marun | anteaya: the services split was different in this regard. | 20:02 |
| anteaya | since part of the code split workflow I am familiar with it freeze the repo, split, seed new repo, delete old code, unfreeze | 20:02 |
| anteaya | great | 20:02 |
| anteaya | then we need to come up with new rules | 20:02 |
| anteaya | so we know what we are doing and everyone is aware | 20:02 |
| anteaya | because right now it sounds like we aren't | 20:02 |
| anteaya | and if the rest of infra is fine with code in two places | 20:02 |
| anteaya | I can go along with that | 20:03 |
| anteaya | but I don't want it to just be me | 20:03 |
| *** ryanpetrello has quit IRC | 20:03 | |
| marun | anteaya: understood. | 20:03 |
| anteaya | thanks | 20:03 |
| dhellmann | fungi: what version of tox and virtualenv do I need to get setuptools 8? | 20:03 |
| marun | anteaya: I look forward to hearing input from other infra stakeholders. | 20:04 |
| anteaya | me too | 20:04 |
| *** reed has quit IRC | 20:04 | |
| anteaya | since we don't have anyone chiming in at the moment, could I convince you to add an item to next weeks infra meeting agenda | 20:04 |
| dstufft | dhellmann: fungi note the py33 thing shouldn't be related to the setuptools version | 20:04 |
| fungi | anteaya: marun: armax: to be blunt, i mostly just care that the desired end state is reached and that the process for getting there doesn't require any more direct assistance from the infra team than is absolutely necessary (and of course that community values aren't compromised to that end) | 20:04 |
| *** Masahiro has joined #openstack-infra | 20:04 | |
| dhellmann | dstufft: oh? I thought it was for some reason. Is this just a pbr thing? | 20:05 |
| fungi | dhellmann: o | 20:05 |
| fungi | er | 20:05 |
| fungi | dhellmann: i'm just running with tox 1.8.1 | 20:05 |
| dhellmann | fungi: ok, I'm not able to reproduce this issue. | 20:05 |
| dstufft | dhellmann: pbr added some code in response to setuptools 8, and that code breaks when trying to install docutils on py3, on pretty much any verison of setuptools | 20:06 |
| dhellmann | oh, wait, I wonder if that's because I have a bunch of wheels cached already | 20:06 |
| fungi | dhellmann: in this case my tox's calling environment has pip 1.4.1 and setuptools 0.9.8 | 20:06 |
| anteaya | fungi: are you fine with a new repo being created and old code staying in master for some indeterminate time? | 20:06 |
| anteaya | neutron master | 20:06 |
| dhellmann | dstufft, fungi : let me disable my wheel cache and see if that lets me reproduce it | 20:06 |
| dstufft | dhellmann: it won't be triggered if you have a py3 wheel for docutils | 20:06 |
| fungi | anteaya: it's not my code. if that's what's convenient for the neutron developers (and if it doesn't bite them later requiring infra help to bail them out of some mess) then i don't think it's my place to care | 20:06 |
| dstufft | because there's no executing of setup.py in that case | 20:07 |
| dhellmann | right | 20:07 |
| anteaya | ah it is the undefined "requiring infra help to bail them out of some mess" that I am trying to avoid | 20:07 |
| anteaya | since deleting code right away would most definitely avoid that | 20:07 |
| tchaypo | pleia2: don’t forget that there was already a language called Go, and they were aware of that, but decided to go public with their language called Go anyway | 20:08 |
| marun | anteaya: moving vendor code out-of-tree isn't very risky. | 20:08 |
| fungi | anteaya: yep, as long as they have contingency plans for dealing with people proposing driver changes to the wrong repo (and possibly getting merged, et cetera) then they're probably covered. just a matter of gettign all the neutron cores on board with an indefinite hard freeze on those files probably | 20:08 |
| marun | anteaya: it's not nearly as large a task a moving something like services out. | 20:09 |
| marun | anteaya: and I'm not sure I can imagine a scenario that would require infra intervention. | 20:09 |
| marun | anteaya: we have the power of git on our side, after all. | 20:09 |
| pleia2 | tchaypo: heh, yeah, greghaynes posted the infamous bug #9 yesterday | 20:09 |
| uvirtbot | Launchpad bug 9 in launchpad "Rosetta's po parser is too strict" [Medium,Fix released] https://launchpad.net/bugs/9 | 20:09 |
| *** Masahiro has quit IRC | 20:09 | |
| bhunter71 | sorry to interrupt - a quick/dumb question; when a CI/jenkins server runs 'jenkins-jobs update' - a service account could be used, as set up in jenkins>credentials>global credentials? My Jenkins is, otherwise, configured with OAuth/matrix authentication | 20:09 |
| *** zz_gondoi is now known as gondoi | 20:10 | |
| pleia2 | tchaypo: hoping that they would be willing to change the name of a supplimental tool that just launched 2 months ago, even if they wouldn't rename their whole language | 20:10 |
| *** rlandy has joined #openstack-infra | 20:10 | |
| fungi | bhunter71: yes, that's what we do | 20:10 |
| bhunter71 | fungi: thanks much! | 20:10 |
| armax | anteaya, fungi: so my question is: how much information we retain in the migration process to avoid any chance of bail out? | 20:10 |
| fungi | bhunter71: we have openid authentication on our jenkins masters, but explicitly create a service account for jenkins-job-builder to interact with | 20:11 |
| tchaypo | their “it was originally called review, git forces us to add the git- prefix” logic | 20:11 |
| armax | anteaya, fungi: just master, or master+stable+tags? | 20:11 |
| armax | anteaya: I think that’s the crux of the matter that I am trying to undersatnd | 20:11 |
| tchaypo | I can’t tell if they’re talking about our git-review, or their git-review | 20:11 |
| armax | and how much of the history preservation process is automatic vs manual | 20:11 |
| armax | I was working under the assumption that when the stackforge project was being seeded, *everything* was being kept | 20:12 |
| *** aysyd has quit IRC | 20:12 | |
| armax | it does not seem to be clear on the creators’ manual... | 20:13 |
| clarkb | armax: everything from the source repo is kept but you provide the source repo | 20:13 |
| armax | I am not sure that’s intentional | 20:13 |
| armax | clarkb: right | 20:13 |
| armax | so everything is being slurped, it’s my understanding. | 20:13 |
| clarkb | everything with a named ref yes | 20:13 |
| clarkb | so brnaches and tags | 20:14 |
| armax | ok | 20:14 |
| armax | clarkb: thanks for clearing this up | 20:14 |
| anteaya | armax: so you have what you need? | 20:15 |
| armax | so, anteaya, fungi if we agree that we can keep the split process loosely a two stages effort | 20:15 |
| dhellmann | fungi: ok, now I'm getting the StandardError is not defined error | 20:15 |
| fungi | dhellmann: wheel cache was mitigating it i guess? | 20:16 |
| dhellmann | yeah | 20:16 |
| armax | fungi, anteaya: and we make sure we warn projects owners of the implications of their history preservation exercise | 20:16 |
| armax | then we should be good | 20:16 |
| dhellmann | do you know how the pbr/hooks/commands.py module is being triggered? I wonder if we can say "if you are already running the install command, disable sphinx" | 20:16 |
| armax | I’ll stress this out on the docs I am putting together | 20:16 |
| anteaya | armax: fungi said that you need a contigency plan for what to do if someone proposes a patch against code taht has been split out | 20:16 |
| armax | anteaya: in Neutron you mean? | 20:16 |
| anteaya | armax: yes | 20:16 |
| fungi | i don't think that's something that needs to be written down anywhere, just make sure you keep it in mind | 20:17 |
| armax | anteaya: I just have to behave like a bloodhound and -2 like crazy :) | 20:17 |
| anteaya | armax: if you are willing to take that resposiblity, so be it | 20:17 |
| fungi | people will accidentally propose patches to those files in the wrong repo for as long as they're still there, so yeah just got to be on top of them | 20:17 |
| anteaya | what fungi said | 20:17 |
| anteaya | that is my concern | 20:17 |
| fungi | and if your core review team is large enough, some of them probably will get approved | 20:17 |
| anteaya | so remove code or -2 proposed patches | 20:17 |
| *** flwang1 has joined #openstack-infra | 20:18 | |
| anteaya | whatever it takes | 20:18 |
| armax | fungi: agreed | 20:18 |
| anteaya | and remove code is my preference | 20:18 |
| armax | it makes perfect sense to be very diligent during the process | 20:18 |
| armax | anteaya: there’s been ample warning of a soft freeze on vendor code | 20:18 |
| fungi | but it's a balancing act. i'm definitely not going to try to tell teh neutron devs what workflow is best for them, just pointing out potential gotchas | 20:18 |
| anteaya | armax: okay | 20:19 |
| tchaypo | dhellmann: fungi: do we know which change in pbr caused this? is it something we could fix by reverting a change? | 20:19 |
| anteaya | but I think you are able to hear my concerns now | 20:19 |
| dhellmann | tchaypo: I have no idea | 20:19 |
| fungi | tchaypo: it's all tripleo's fault ;) | 20:19 |
| anteaya | when I wasnt' sure that message was getting across before | 20:19 |
| armax | so once the split effort has been initiated it’s up to the maintaner to retain consistency, and I would imagine the same person who takes care of the split and possible bug fix to understand what’s going on | 20:19 |
| anteaya | armax: warnings don't protect you at all | 20:19 |
| fungi | tchaypo: cd people wanting to keep track of git shas in packages. setuptools 8/pep 440 makes that hard, so mordred came up with embedding teh data in egg-info | 20:20 |
| armax | anteaya: agreed | 20:20 |
| anteaya | armax: it just gives you something to point at when people question why you -2'd something | 20:20 |
| fungi | tchaypo: we can revert that, but then we're back to not being able to run our test infrastructure with setuptools 8 | 20:20 |
| anteaya | armax: ah, I would take responsiblity yourself, at least to ensure the split is clean | 20:20 |
| anteaya | I am learning to not depend on anyone else | 20:20 |
| anteaya | even nice people | 20:21 |
| dhellmann | fungi: I don't think I realized how much time pre-building wheels was saving me running unit tests. | 20:21 |
| *** reed has joined #openstack-infra | 20:21 | |
| armax | anteaya: fair enough…I’ll capture these notes | 20:21 |
| clarkb | dhellmann: wheels are pretty awesome | 20:21 |
| anteaya | armax: great thanks for your persistence | 20:21 |
| anteaya | armax: I appreciate it | 20:21 |
| armax | as for gary’s patch, I think it’s fair to signal him the fact that is currently seeding the history just for master | 20:21 |
| fungi | tchaypo: dhellmann: as dstufft pointed out, it's pbr tweaking egg-info which causes us to have non-translated docutils loaded into the execution space | 20:21 |
| openstackgerrit | Darragh Bailey proposed openstack-infra/jenkins-job-builder: Use threads to update jobs in jenkins https://review.openstack.org/45371 | 20:22 |
| *** kevinbenton has quit IRC | 20:22 | |
| anteaya | armax: if that it is what it is doing | 20:22 |
| anteaya | armax: to be honest I don't know | 20:22 |
| armax | and he’s not retaining any tags, if he wants to be conservative, he should revise that, otherwise he gets only one shot at doing it | 20:22 |
| dstufft | fungi: to be specific, it's the fact that pbr added a specific entry point, and setuptools imports pbr as part of loading that entry point | 20:22 |
| anteaya | armax: conservative is my favourite way | 20:22 |
| dhellmann | fungi: is that https://review.openstack.org/#/c/141667/ then? | 20:22 |
| anteaya | armax: and I want to take some time for the conversation to steep | 20:23 |
| anteaya | armax: we can talk again tomorrow | 20:23 |
| armax | as clarkb pointed out the seeding captures everything, so I’d be temped to suggest him to exploit this opportunity | 20:23 |
| fungi | dhellmann: yep, that one | 20:23 |
| anteaya | armax: I encourage your suggestion | 20:23 |
| armax | anteaya, clarkb, fungi: thanks for the input, much appreciated | 20:23 |
| armax | it | 20:23 |
| anteaya | thanks armax and marun | 20:23 |
| clarkb | dstufft: dhellmann fungi so to fix this can we split the import paths for egg info and sphinx? so that when setuptools imports nothing bad happens? | 20:23 |
| dhellmann | fungi: and it's just the fact that we *have* an egg_info.writer plugin? | 20:24 |
| tchaypo | fungi: my head hurts even more. | 20:24 |
| dstufft | dhellmann: the fact you have that causes you to be imported | 20:24 |
| dhellmann | clarkb: that's sort of what my patch does, except it tries to figure out if sphinx is present | 20:24 |
| dstufft | the fact pbr has that causes pbrt o be imported by setup.py* | 20:24 |
| dstufft | importing pbr imports sphinx which imports docutils | 20:24 |
| *** salv-orlando has joined #openstack-infra | 20:24 | |
| dhellmann | oh, hmm, we were only catching ImportError, but that's not the error being thrown | 20:25 |
| fungi | so maybe we can factor out just the bits which need to write egg-info into a separate module and only import that for the entryoint? | 20:25 |
| fungi | entrypoint | 20:25 |
| clarkb | fungi: ya I think that is what I was trying to sy. you said it much better | 20:26 |
| dstufft | yes that's a good way to fix it | 20:27 |
| fungi | jeblair: clarkb: jenkins01 is long-idle at this point. can i restart it, or are we waiting on further diagnostic data to be collected? | 20:27 |
| jeblair | fungi: i think we should just keep it offline for now | 20:27 |
| fungi | k | 20:27 |
| dhellmann | fungi: it's not that code that's causing the problem, it's the entry point scan itself | 20:27 |
| dhellmann | fungi: I think i see how to fix it, give me a few minutes to test | 20:27 |
| jeblair | fungi: (i suspect brining it online may allow the problem to recur) | 20:28 |
| fungi | aha | 20:28 |
| dstufft | you can probably also paper over the bug just by expanding the scope of exceptions which you considder for marking sphinx support as no | 20:30 |
| dstufft | dhellmann: speaking of wheels saving time, it won't be in 6, but hopefully pip 7 will have an on by default automatic wheel cache, so that if you install something that doens't have a wheel, it builds a wheel the first time, caches it, and then uses that in the future | 20:32 |
| dhellmann | dstufft: nice! | 20:32 |
| dstufft | that'll probably break a few things too | 20:32 |
| dhellmann | dstufft: yeah, I'm going to convert any exceptions importing sphinx into ImportError | 20:32 |
| tchaypo | on a related note - it sounds like mordred’s patch doesn’t do what we need, so | 20:34 |
| clarkb | tchaypo: hrm? | 20:34 |
| dstufft | which patch | 20:34 |
| dstufft | the one that broke py33? it does something that you need, it just introduced another bug that only effects installing docutils | 20:35 |
| tchaypo | perhaps we should mark it as such | 20:36 |
| tchaypo | sorry, got halfway through typing, switched windows to check must have hit enter as i was switching windows | 20:36 |
| tchaypo | I was talking about change 142509 | 20:36 |
| tchaypo | https://review.openstack.org/#/c/142509 | 20:37 |
| anteaya | ianw: if you are about can you help me understand why we need a whole new job here rather than making use of the -20 job: https://review.openstack.org/#/c/140889/ can we make the -{version} an option on that job and use it for both? | 20:37 |
| tchaypo | which seems to have been superseded by https://review.openstack.org/#/c/142561 and will shortly be super-duper-seded by something else | 20:37 |
| *** rmcall has quit IRC | 20:37 | |
| *** zz_zz_sabari_ is now known as zz_zz_zz_sabari_ | 20:37 | |
| *** _nadya_ has quit IRC | 20:39 | |
| *** rmcall has joined #openstack-infra | 20:39 | |
| *** adrian_otto has joined #openstack-infra | 20:40 | |
| *** baoli has joined #openstack-infra | 20:41 | |
| adrian_otto | hey, I have a question… I just tagged a release 2014.2.2 of solum and 1.2.2 of python-solumclient, but I'm not seeing any jobs show up under "release" at http://status.openstack.org/zuul/ and no tarballs showed up in http://tarballs.openstack.org/solum/ and http://tarballs.openstack.org/python-solumclient/ respectively. Did I miss something? | 20:42 |
| dhellmann | dstufft, clarkb, fungi : something in pbr's test requirements list is installing a released version of pbr, which still has the problem, and which is preventing the fix in the version of pbr I'm *testing* from being used instead | 20:44 |
| fungi | adrian_otto: zuul is working through events very slowly at the moment. there's an event queue ~500 deep right now, so it's probably in there somewhere | 20:44 |
| dstufft | dhellmann: that would probably explain why it wasn't caught | 20:44 |
| dhellmann | right | 20:44 |
| adrian_otto | fungi: thanks! Is there anywhere I can look to see the queue? | 20:44 |
| dhellmann | dstufft: I'm fiddling with the tox.ini to see if I can force the local copy of pbr to be installed before anything else | 20:44 |
| fungi | adrian_otto: counts at the top left of http://status.openstack.org/zuul/ | 20:45 |
| clarkb | dhellmann: can you at least confirm the fix works by manually installing that version of pbr in the venv then rerunning tests? | 20:45 |
| clarkb | dhellmann: you may b eable to do that via the install command | 20:45 |
| fungi | dhellmann: that explains why i was suddenly reproducing it on older pbr versions--i was beating my head on teh keyboard trying to figure out what i was doing wrong there | 20:45 |
| clarkb | or evn listing . in the deps list | 20:45 |
| *** unicell has quit IRC | 20:45 | |
| dhellmann | clarkb: the failure is triggered when installing docutils into the test environment. I can try redoing the steps by hand after this run completes | 20:45 |
| dhellmann | fungi: yeah, it took me a while, too, until I looked very closely at the traceback | 20:46 |
| clarkb | if putting . in the deps list works that would be amazing | 20:46 |
| dhellmann | clarkb: that's what I'm trying now | 20:46 |
| *** markmcclain has joined #openstack-infra | 20:46 | |
| *** gondoi is now known as zz_gondoi | 20:46 | |
| dhellmann | running 2to3 on docutils takes forever | 20:47 |
| dhellmann | dstufft: while we're talking about how nice wheels are, I'd like your input on https://review.openstack.org/#/c/141184/ | 20:47 |
| *** zz_gondoi is now known as gondoi | 20:48 | |
| dstufft | dhellmann: you know you can just do pip wheel -r global-requirements.txt ? | 20:48 |
| *** achanda has quit IRC | 20:49 | |
| *** r-daneel has joined #openstack-infra | 20:49 | |
| *** achanda has joined #openstack-infra | 20:49 | |
| dhellmann | dstufft: some of our requirements can't build wheels properly, and when pip hits one of those it stops. This installs everything that works right, and ignores errors for packages that can't build wheels. | 20:49 |
| dstufft | dhellmann: ah | 20:50 |
| dhellmann | clarkb, fungi, dstufft : new version of https://review.openstack.org/142561 ready for review | 20:50 |
| *** jcoufal has quit IRC | 20:50 | |
| dhellmann | adding "." to the deps list seems to work | 20:51 |
| *** kevinbenton has joined #openstack-infra | 20:51 | |
| fungi | dhellmann: clarkb: ingenious | 20:52 |
| fungi | i'm confirmign and checking for regressions now | 20:52 |
| *** marun has quit IRC | 20:52 | |
| clarkb | I am running tests locally too also I love that . works | 20:53 |
| *** jcoufal has joined #openstack-infra | 20:53 | |
| *** achanda has quit IRC | 20:54 | |
| clarkb | looks like pep8 may fail? | 20:54 |
| *** dustins has quit IRC | 20:54 | |
| fungi | i hadn't tried that yet | 20:55 |
| fungi | py33 is happy though | 20:55 |
| *** spzala has quit IRC | 20:55 | |
| *** Katherine has quit IRC | 20:55 | |
| *** dustins has joined #openstack-infra | 20:56 | |
| dhellmann | let me see about pep8 | 20:56 |
| fungi | py34 is working for me too | 20:57 |
| fungi | and py27 | 20:57 |
| fungi | i don't have py26 handy on my workstation any longer | 20:57 |
| clarkb | ya 34 and 27 work for me | 20:58 |
| dhellmann | I forgot zuul was backlogged, I'll run all of the tests locally here | 20:58 |
| clarkb | but pep8 is cranky | 20:58 |
| *** bdpayne has quit IRC | 20:58 | |
| *** dims has joined #openstack-infra | 20:58 | |
| clarkb | so now I just need to review it | 20:58 |
| *** thedodd has quit IRC | 20:58 | |
| *** ecosta has joined #openstack-infra | 20:59 | |
| dhellmann | hmm, I'm seeing errors in py26 because it doesn't like the testrepository database format | 21:00 |
| dhellmann | I wish testr would use a version-specific directory for that database | 21:00 |
| clarkb | dhellmann: the fix for that is to always run py33 first iirc | 21:01 |
| clarkb | but still very annoying | 21:01 |
| fungi | git clean -dfx ; tox -e py26 | 21:01 |
| fungi | works for me anyway | 21:01 |
| dhellmann | clarkb: yeah, I usually set up projects that way | 21:01 |
| *** mancdaz has quit IRC | 21:02 | |
| anteaya | clarkb: you did a gerrit group cleanup last time we had an oops, this isn't really an oops but armax found a non compliant acl file whist trying to implement a job to test acl format: https://review.openstack.org/#/c/142258/1 | 21:02 |
| *** otter768 has joined #openstack-infra | 21:02 | |
| anteaya | clarkb: do you think this should be merged and cleaned up manually to avoid an orphaned group? | 21:02 |
| *** mancdaz has joined #openstack-infra | 21:03 | |
| jeblair | clarkb, fungi: so jenkins kernel retransmitted a dropped packet, and the second time it made it. the sequence was "grab_job_uniq, job_assign_uniq, work_complete, grab_job_uniq" with the work_complete being the dropped packet. | 21:03 |
| fungi | anteaya: "vmt" is the vulnerability management team | 21:03 |
| fungi | anteaya: it has no subsets | 21:03 |
| anteaya | ah so that would be no | 21:03 |
| *** thedodd has joined #openstack-infra | 21:03 | |
| jeblair | clarkb, fungi: i'm assuming that just means tha geard received "work_complete, grab_job_uniq" all at once | 21:03 |
| anteaya | so we have to allow for an exception for this file in the test | 21:03 |
| anteaya | fungi: thanks | 21:03 |
| clarkb | dhellmann: is that options code really (C) AURA? (just double checking as it jumped out at me as odd) | 21:04 |
| fungi | jeblair: could it have received those in an unexpected order? | 21:04 |
| jeblair | clarkb, fungi: i netcatted those two into geard, and it processed it fine... | 21:04 |
| *** dprince has quit IRC | 21:04 | |
| fungi | huh | 21:04 |
| jeblair | fungi: i think tcp will take care of that, right? | 21:04 |
| fungi | jeblair: yep, my brain was on datagrams for a moment, but there would be no retransmit | 21:04 |
| fungi | jeblair: definitely would be received in the order sent, anyway | 21:05 |
| dhellmann | clarkb: I don't know; I copied the copyright settings from the file where it used to live. Isn't that our policy? I can remove them entirely, if that's better. | 21:05 |
| jeblair | fungi: yeah, so i'm assuming it was in the correct order and all at once (as soon as the missing piece was supplied) | 21:05 |
| clarkb | dhellmann: oh thats from over there? good neough for me | 21:05 |
| jeblair | but i can't find anything about that which would cause geard to stop processing that connection | 21:05 |
| fungi | clarkb: yeah, it was a refactor, that code just moved | 21:05 |
| jeblair | clarkb, fungi: i've got one more data point i can try to triangulate with. waiting for wireshark to load it. | 21:06 |
| anteaya | that might be my first -2 that is meant as a minus 2 rather than a don't merge this by accident | 21:06 |
| *** __TheDodd__ has joined #openstack-infra | 21:07 | |
| *** otter768 has quit IRC | 21:07 | |
| *** ecosta has quit IRC | 21:08 | |
| clarkb | anteaya: ya that will need coordination | 21:08 |
| clarkb | anteaya: because wherever possible we should avoid orphan groups | 21:08 |
| clarkb | jeblair: rgr standing by for whatever next course of action is | 21:09 |
| anteaya | clarkb: actually fungi kyboshed that patch, since vmt (vulnerability mangagement team) will not become a vmt-core gerrit group | 21:09 |
| *** thedodd has quit IRC | 21:09 | |
| clarkb | oh even better | 21:09 |
| anteaya | clarkb: so I -2'd it | 21:09 |
| clarkb | anteaya: perfect | 21:09 |
| anteaya | :D | 21:09 |
| dhellmann | clarkb, fungi : I'm seeing "db type is dbm.gnu, but the module is not available" under py33 now. Do you know what package I need off the top of your head? This is 14.04.1 | 21:09 |
| dhellmann | I would have thought libgdbm3, but that's installed | 21:10 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/project-config: Add nodepool script to preseed testrepository from subunit2sql https://review.openstack.org/136234 | 21:10 |
| jeblair | mtreinish: ooh how exciting! ^ | 21:10 |
| fungi | dhellmann: git clean -dfx and rerunning doesn't make it go away? | 21:10 |
| clarkb | dhellmann: I don't know sorry | 21:10 |
| dhellmann | yeah, I'm doing that now, i was trying to just fix up my box so running this in the right order would work | 21:10 |
| mtreinish | jeblair: yeah it'll be cool to get that running. (although I doubt it'll make a noticeable performance improvement) | 21:11 |
| clarkb | ok so I grok this change. basically make options a thing to avoid importing when not necessary. and put the docutils things off to the side | 21:11 |
| fungi | dhellmann: i thought that was just one of the usual symptoms of running with an existing testrepository db created by a previous run under a different interpreter | 21:11 |
| anteaya | I'll stop shoving stuff at zuul for a bit and go for a walk | 21:11 |
| dhellmann | fungi: it is, but depending on what you have installed and what order you run, you get a different dbm format | 21:12 |
| clarkb | jeblair: by the way gertty sync queue is over 1k on ne wmachine :) | 21:12 |
| dhellmann | that's a *terrible* way to create a database :-/ | 21:12 |
| jeblair | clarkb: we should review some patches :) | 21:12 |
| openstackgerrit | Adrian Turjak proposed openstack-infra/project-config: Add new Openstack-Pydashie project https://review.openstack.org/142240 | 21:12 |
| clarkb | jeblair: indeed | 21:13 |
| jeblair | clarkb: and some of that (~half) will end up being quick no-ops. | 21:13 |
| clarkb | if only these fires would go away | 21:13 |
| mtreinish | jeblair: acutally I had a qq on that patch, I'm not sure of the best way to inject that script into the image creation process. Any suggestions? | 21:14 |
| fungi | dhellmann: `tox -evenv -- python setup.py build_sphinx` is not looking so good... | 21:14 |
| clarkb | mtreinish: if you make the script a nodepool script it iwll happen automagically | 21:14 |
| *** mwhudson_ is now known as mwhudson | 21:14 | |
| mtreinish | clarkb: oh cool, I put it project-config/nodepool/scripts | 21:15 |
| dhellmann | fungi: ok, I'll test that one, too | 21:15 |
| fungi | dhellmann: i think i see the issue | 21:15 |
| clarkb | fungi: oh good idea | 21:15 |
| *** teran has joined #openstack-infra | 21:15 | |
| fungi | dhellmann: inline comment fixes it | 21:16 |
| *** mwhudson has quit IRC | 21:16 | |
| *** sweston is now known as spw | 21:16 | |
| dhellmann | fungi: ok, pep8 caught that but I'm still re-running the other tests | 21:16 |
| *** amitgandhinz has quit IRC | 21:16 | |
| dhellmann | it's a little disturbing that running the tests didn't catch missing imports in that file | 21:17 |
| fungi | dhellmann: oh, i hadn't tried pep8. and yes that's definitely pointing to a coverage issue | 21:17 |
| clarkb | dhellmann: well you ignore import errors :) | 21:17 |
| *** sweston has joined #openstack-infra | 21:17 | |
| fungi | hrm, there's that :/ | 21:17 |
| dhellmann | clarkb: it means nothing is trying to use that code in the tests, though | 21:17 |
| clarkb | dhellmann: ya | 21:18 |
| clarkb | dhellmann: however we should test it now via building docs and your . | 21:18 |
| clarkb | so not unittested but will be covered once this change goes in | 21:18 |
| dhellmann | yep | 21:18 |
| *** mwhudson has joined #openstack-infra | 21:18 | |
| dhellmann | clarkb: the tests take ages because each env has to wait for docutils to run through 2to3 | 21:18 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Plugins may now register cron workers. https://review.openstack.org/129609 | 21:19 |
| *** mancdaz has quit IRC | 21:19 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Bump rabbitmq module to 5.0.0 https://review.openstack.org/142582 | 21:19 |
| *** mancdaz has joined #openstack-infra | 21:19 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Plugins may now register cron workers. https://review.openstack.org/129609 | 21:21 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Added manifest for storyboard-dev.openstack.org https://review.openstack.org/140466 | 21:23 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/system-config: Added manifest for storyboard-dev.openstack.org https://review.openstack.org/140466 | 21:24 |
| dhellmann | fungi, clarkb, dstufft : new version of https://review.openstack.org/#/c/142561/2 | 21:25 |
| dhellmann | oops, https://review.openstack.org/#/c/142561/3 | 21:25 |
| dhellmann | "tox -r" and "tox -e venv -- python setup.py build_sphinx" are all green | 21:25 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/project-config: Prepare project-config for puppet module split #1 https://review.openstack.org/140523 | 21:25 |
| jaypipes | jeblair: so I spent a couple hours this afternoon working on making gertty a bit zippier. :) should have a patch for you later tonight. basically, I've reworked a few of the sync tasks to not take the DB thread lock for as long, and modified the list changes view to not need to do a full refresh() when a change is toggled reviewed/hidden. sync events at startup and during use seem to be noticeably snappier. | 21:26 |
| fungi | dhellmann: aha, yeah i can see where stringio would have gone unspotted | 21:26 |
| clarkb | dhellmann: woot, I am going to read through it again. I do think you will have to flip the order of your two commits though | 21:26 |
| clarkb | dhellmann: since the gitreview update will fail tests | 21:26 |
| fungi | clarkb: i think we probably just need to ditch the .gitreview addition. it will only be one more potential gotcha come time to do the merge commit | 21:27 |
| clarkb | fungi: that works too | 21:27 |
| clarkb | also we should rebase mordred's postN change atop dhellmann's change | 21:27 |
| fungi | yeah | 21:27 |
| dhellmann | clarkb: ok, I can flip them | 21:28 |
| jeblair | jaypipes: awesome! thanks! | 21:28 |
| jaypipes | jeblair: hey, thank YOU for an awesome tool :) | 21:28 |
| dhellmann | fungi: oh, or I can drop it | 21:28 |
| clarkb | dhellmann: maybe just drop it like fungi suggestions? you can edit the file and just not commit it | 21:28 |
| fungi | i honestly hadn't expected this "feature" branch to stick around so long | 21:28 |
| clarkb | dhellmann: git review doesn't need the edits to be committed for you to make use of them | 21:28 |
| clarkb | fungi: ya | 21:28 |
| clarkb | wow it is time for lunch already | 21:29 |
| clarkb | let me do that before I try to review code | 21:29 |
| fungi | it was really just supposed to be a quick hack to backport a patch while the semver bits were being polished up | 21:29 |
| dhellmann | fungi, clarkb : dropped | 21:29 |
| asselin | nibalizer, any idea where these modules are? puppet-openssl puppet-puppetboot | 21:29 |
| dhellmann | fungi: maybe we need to find a good place to create a "feature/semver" branch, then drop that stuff from master? | 21:30 |
| *** yjiang5_away is now known as yjiang5 | 21:30 | |
| fungi | dhellmann: that's what i would have proposed had i realized we'd need to do so much more of this. but to do that in a fast-forward-friendly manner would involve a lot of reverts on master | 21:30 |
| * dhellmann nods | 21:31 | |
| fungi | (which mordred had started down the path to initially) | 21:31 |
| fungi | i think his though was just an inverted diff between master and the last tag | 21:32 |
| *** Rockyg has joined #openstack-infra | 21:32 | |
| *** andreykurilin_ has joined #openstack-infra | 21:33 | |
| dhellmann | I suppose renaming the existing branches would just lead to all sorts of pitchforks and brimstone | 21:34 |
| fungi | dhellmann: yep, it would cause some real messes on people's existign clones | 21:34 |
| dhellmann | right | 21:35 |
| fungi | so at this point i'm sort of just hoping that this is the last of the backport issues, and then the semver stuff on master gets sorted to some conclusion quickly | 21:36 |
| fungi | and then we learn from the experience | 21:36 |
| *** Shrews has quit IRC | 21:37 | |
| *** Hefeweizen has joined #openstack-infra | 21:38 | |
| *** julim has quit IRC | 21:38 | |
| *** rmcall_ has joined #openstack-infra | 21:38 | |
| *** __TheDodd__ has quit IRC | 21:39 | |
| *** rmcall has quit IRC | 21:39 | |
| *** rmcall_ is now known as rmcall | 21:39 | |
| dhellmann | fungi: I've learned we need to use feature branches more, and that we need someone to actually own this library and manage its development instead of having several of us working on it part time. | 21:41 |
| fungi | dhellmann: yeah, at least the semver implementation was enough individual behavior changes that they probably shouldn't have been just dripping into master bit by bit | 21:42 |
| dhellmann | yeah | 21:42 |
| openstackgerrit | Ben Nemec proposed openstack-dev/hacking: Remove Git commit message checks https://review.openstack.org/142585 | 21:42 |
| openstackgerrit | Ben Nemec proposed openstack-dev/hacking: Remove complex import rules https://review.openstack.org/142586 | 21:42 |
| *** flwang1 has quit IRC | 21:42 | |
| *** mrunge has quit IRC | 21:42 | |
| jeblair | clarkb, fungi: i'd like to restart geard with extra logging but without stopping zuul. i believe i can do that by killing the process and then restarting by hand. i will save queues beforehand just in case though. | 21:44 |
| jeblair | clarkb: i don't want to apply my change yet | 21:44 |
| nibalizer | asselin: hrm? | 21:44 |
| nibalizer | i might have moved the puppet-openssl module into openstack_project | 21:44 |
| asselin | nibalizer, those two modules are in the puppet split spec, but not in system-config | 21:44 |
| *** marun has joined #openstack-infra | 21:44 | |
| asselin | nibalizer, ok, and puppet-puppetboot? | 21:45 |
| *** chuckC_ has joined #openstack-infra | 21:45 | |
| fungi | jeblair: okay, that sounds like a winner if it will work | 21:45 |
| asselin | nibalizer, link/ref to puppet-openssl move? | 21:46 |
| dstufft | wow | 21:46 |
| dstufft | zuul's queue is massive | 21:46 |
| openstackgerrit | Doug Hellmann proposed openstack/requirements: Add developer script to build wheels https://review.openstack.org/141184 | 21:48 |
| *** zz_zz_zz_sabari_ is now known as sabari | 21:48 | |
| fungi | dstufft: it's been worse, but not in a while | 21:48 |
| openstackgerrit | Joe Gordon proposed openstack-dev/hacking: Add docstring to is_import_exception https://review.openstack.org/142587 | 21:48 |
| clarkb | jeblair: ok | 21:49 |
| *** amitgandhinz has joined #openstack-infra | 21:49 | |
| nibalizer | asselin: looks like i refactored openssl in ff007f29a2d8fe834cb1caa638ee0c848241e65a | 21:49 |
| asselin | nibalizer, noted | 21:50 |
| clarkb | should I go ahead and rebase mordred's postN change? | 21:50 |
| clarkb | fungi: dhellmann ^? | 21:50 |
| dhellmann | clarkb: yeah, good idea | 21:51 |
| fungi | clarkb: yep | 21:51 |
| *** amitgandhinz has quit IRC | 21:52 | |
| *** amitgandhinz has joined #openstack-infra | 21:52 | |
| *** mbacchi has quit IRC | 21:52 | |
| dstufft | so with the postN change and the py3 fix | 21:53 |
| dstufft | pytz and warnings are what's left that I know of | 21:53 |
| *** Masahiro has joined #openstack-infra | 21:53 | |
| dhellmann | pytz? | 21:53 |
| dhellmann | warnings? | 21:53 |
| david-lyle | I pushed tag 1.1.8 to openstack/django_openstack_auth a week ago, it's visible on http://git.openstack.org/cgit/openstack/django_openstack_auth, seems like the publish job to pypi failed, is there an easy way to re-trigger the publish? | 21:53 |
| nibalizer | asselin: it looks like mordred killed puppetboot in c8a29bea6dde8bf54a82c47bd8f014e142a0d58e | 21:53 |
| jeblair | clarkb, fungi: i believe this is the first time we've swapped out a running geard without disrupting zuul | 21:54 |
| dstufft | dhellmann: for setuptools 8 | 21:54 |
| asselin | nibalizer, noted. thank you! | 21:54 |
| dhellmann | dstufft: ok, so not in pbr? | 21:54 |
| fungi | dhellmann: non-pep-440-compliant versions of things preinstalled from distro system packages | 21:54 |
| dstufft | dhellmann: nah, pbr should be fine after this, as far as I know | 21:54 |
| nibalizer | git bisect ftw | 21:54 |
| fungi | jeblair: it worked?!? | 21:54 |
| clarkb | 142351 has been reparented | 21:55 |
| dstufft | pytz is 2012d on fedora, and Babel has a dep on >=0a which makes it not accept 2012d | 21:55 |
| dstufft | so setputools 8 pkg_resourced blows up | 21:55 |
| fungi | jeblair: so you just killed the process for geard and invoked it directlt? | 21:55 |
| fungi | directly? | 21:55 |
| jeblair | fungi: so far... i expect it to have to restart some jobs, but i waited until _most_ jobs were finished, so hopefully that's a minimum | 21:55 |
| clarkb | dstufft: ya so to fix pytz I think we can just upgrade our version on our slvae images | 21:55 |
| dstufft | and ubuntu has some random stuff installed with non pep 440 versions, which cuases a warning to be output when pkg_resources is imported, and some tests execute a subprocess and assert against the stdout of that process | 21:56 |
| clarkb | dstufft: or do I not fully understand the issue? | 21:56 |
| dstufft | clarkb: that should do it yea | 21:56 |
| dstufft | clarkb: it might effect devstack in not the CI infra though | 21:56 |
| clarkb | dstufft: ya | 21:56 |
| nibalizer | clarkb: gah the git ui | 21:56 |
| jeblair | clarkb, fungi: i'm going to put jenkins01 back online in the hopes that it malfunctions again | 21:57 |
| nibalizer | its git bisect start then git bisect reset | 21:57 |
| fungi | jeblair: okay | 21:57 |
| dstufft | https://admin.fedoraproject.org/updates/babel 1.3-7 has fedora fixed for the pytz issue | 21:57 |
| nibalizer | stop would have been just wayy to obvious | 21:57 |
| dstufft | but it's only in testing right now | 21:57 |
| clarkb | jeblair: ok, but you haven't applied any changes at this point right? | 21:57 |
| clarkb | jeblair: just new geard | 21:57 |
| fungi | more log detail? | 21:57 |
| *** dkliban is now known as dkliban_afk | 21:57 | |
| jeblair | clarkb: correct. still running same gear version as before, just more logs | 21:57 |
| clarkb | ok | 21:58 |
| *** Masahiro has quit IRC | 21:58 | |
| *** sarob has quit IRC | 21:58 | |
| *** dannywilson has joined #openstack-infra | 21:59 | |
| clarkb | dhellmann: so I cna whip up a change to fix pytz on fedora as soon as I properly review your change which I am doing now | 21:59 |
| *** changbl has quit IRC | 21:59 | |
| *** dizquierdo has joined #openstack-infra | 21:59 | |
| *** rmcall_ has joined #openstack-infra | 22:00 | |
| dstufft | clarkb: for the record, 2013.6 is the first PEP 440 version of pytz | 22:01 |
| *** rmcall has quit IRC | 22:01 | |
| *** sarob has joined #openstack-infra | 22:01 | |
| *** rmcall_ is now known as rmcall | 22:01 | |
| fungi | clarkb: switch it from distro package to pip? | 22:01 |
| dhellmann | fungi, clarkb, dstufft, mordred : is there a list of the setuptools 8 fallout that we're fixing? | 22:01 |
| *** dannywil_ has quit IRC | 22:02 | |
| *** kgiusti has left #openstack-infra | 22:02 | |
| fungi | dhellmann: i think the most recent "list" if you can call it that is my summary to the ml from monday | 22:02 |
| dhellmann | fungi: ok, dstufft had me worried there was another surprise coming :-) | 22:02 |
| clarkb | fungi: ya was just going to do pip install pytz with the version string in requirements | 22:03 |
| dhellmann | clarkb: do we have control over pytz releases? | 22:03 |
| clarkb | dhellmann: not directy, but we can use pip to install a working version into the base os | 22:03 |
| dhellmann | ok | 22:03 |
| fungi | oh, right, we have "pytz" in global-requirements.txt | 22:03 |
| *** mattfarina has quit IRC | 22:03 | |
| dstufft | I made a global requirements thing to upgrade that to pytz>2013.6 last night, dunno if that's the right solution | 22:04 |
| *** dims has quit IRC | 22:04 | |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Extend ACL checks to OpenStack namespace. https://review.openstack.org/142230 | 22:04 |
| pleia2 | nibalizer: working on a new puppet module and I noticed we get a pile of "Setting templatedir is deprecated." warnings, know if we're tracking this, or should be fixing? (I can have a look if we should and aren't) | 22:04 |
| dstufft | it failed but I don't understand the failure | 22:04 |
| dhellmann | dstufft: link? | 22:04 |
| dstufft | https://review.openstack.org/#/c/142348/ | 22:04 |
| clarkb | I have approved the pbr stack | 22:05 |
| nibalizer | pleia2: hopefully we've found all the places that are setting templatedir in puppet.conf | 22:05 |
| nibalizer | it could be just that your local puppet install has it set and shouldn't | 22:05 |
| clarkb | mtreinish: is the failure on 142348 familiar to you? | 22:05 |
| dhellmann | dstufft: that looks like an unrelated error at first glance, unless one of the servers is actually breaking on a pytz call somewhere | 22:06 |
| *** pcrews has quit IRC | 22:06 | |
| pleia2 | nibalizer: aha, I'm getting them from /usr/lib/ruby/vendor_ruby/puppet/settings.rb which maybe we can't do anything about? | 22:07 |
| *** amitgandhinz has quit IRC | 22:07 | |
| dstufft | dhellmann: that's what I thought, but I wasn't sure | 22:07 |
| dhellmann | dstufft: I see a timeout error in the n-api screen log | 22:07 |
| nibalizer | pleia2: no its just beause you have templatedir set in your /etc/puppet/puppet.conf | 22:07 |
| dhellmann | http://logs.openstack.org/48/142348/1/check//check-tempest-dsvm-neutron-full/e591190/logs/screen-n-api.txt.gz?level=WARNING | 22:07 |
| nibalizer | at least, i think thats the issue | 22:07 |
| *** mriedem has quit IRC | 22:08 | |
| *** rlandy has quit IRC | 22:08 | |
| pleia2 | nibalizer: ah, so I do, where did we fix this? I'm running fresh trusty install + instructions at http://ci.openstack.org/sysadmin.html#making-a-change-in-puppet | 22:08 |
| mgagne | I'm having issues with latest pbr when git is not installed. | 22:09 |
| clarkb | mgagne: can you be more specific? | 22:09 |
| dstufft | clarkb: I wonder if ^ is the problem from openstack-dev | 22:09 |
| mgagne | I found this commit which would address my issue: https://git.openstack.org/cgit/openstack-dev/pbr/commit/?id=654191113e2eb31e57daa4d69aeb3fe052bced5e but latest version includes a commit which reverted this change: https://github.com/openstack-dev/pbr/commit/e73e67acdd84e3c0fe7f5a8cabb62d514c5a9d06 | 22:09 |
| *** marun has quit IRC | 22:09 | |
| mgagne | clarkb: getting File not found when installing pbr. | 22:10 |
| *** jcoufal has quit IRC | 22:10 | |
| *** marun has joined #openstack-infra | 22:10 | |
| mgagne | clarkb: the issue was identified by one of our devs so info is second hand. | 22:10 |
| clarkb | mgagne: gah I see | 22:10 |
| fungi | mgagne: we haven't released from master for a while. we've been releasing minor backports | 22:10 |
| clarkb | I will write a patch for that | 22:10 |
| mgagne | clarkb: maybe issue is fixed but not released | 22:10 |
| clarkb | fungi: no mordred derped | 22:10 |
| fungi | oh | 22:10 |
| clarkb | and me too becuase reviewed | 22:10 |
| mgagne | 0.10.3: 20 hours ago | 22:10 |
| fungi | mgagne: that release was based off 0.10 not off master | 22:11 |
| mgagne | Our tests started failing less than 24 hours ago | 22:11 |
| openstackgerrit | Jay Pipes proposed stackforge/gertty: Release DB session thread lock earlier in syncs https://review.openstack.org/142589 | 22:11 |
| mgagne | fungi: right | 22:11 |
| fungi | but yeah, sounds like it's a separate error | 22:11 |
| fungi | so we probably want to tack that on top of the other stack of fixes we have in the feature/0.10 branch i guess | 22:12 |
| mgagne | so let me summarize when I understood: bug #1326682 is fixed in master, not 0.10 branch right? | 22:12 |
| uvirtbot | Launchpad bug 1326682 in pbr "pbr doesn't check if git is not installed and/or not in the PATH" [Undecided,Fix committed] https://launchpad.net/bugs/1326682 | 22:12 |
| *** dkranz has quit IRC | 22:12 | |
| fungi | and release them together in 0.10.4 | 22:12 |
| mtreinish | clarkb: looking | 22:13 |
| mgagne | fungi: that would be great | 22:13 |
| *** esker has quit IRC | 22:14 | |
| nibalizer | pleia2: yea you might get that on the first run | 22:14 |
| nibalizer | we made the decision not to munge puppet.conf in install_puppet.sh | 22:14 |
| openstackgerrit | Jay Pipes proposed stackforge/gertty: Speed up the toggling of reviewed/hidden changes https://review.openstack.org/142590 | 22:14 |
| nibalizer | well we made the decision not to copy in a puppet.conf, we could add a sed -i i suppose | 22:15 |
| pleia2 | nibalizer: ok, thanks | 22:15 |
| fungi | mgagne: looks like it was actually released in 0.9.0 so the issue in 0.10.3 is a regression | 22:15 |
| dstufft | dhellmann: there's a way to re-run the tests on the pytz change right? I'm not remembering what it is | 22:15 |
| jaypipes | jeblair, krotscheck: is there a commit message tag I should use to link a storyboard story to a Gerrit review? | 22:15 |
| nibalizer | so hopefully after you run puppet apply it should have put a templatedirless puppet.conf in place for you | 22:15 |
| dhellmann | dstufft: leave a comment with "recheck" | 22:15 |
| *** SumitNaiksatam has joined #openstack-infra | 22:16 | |
| dstufft | dhellmann: ah right | 22:16 |
| dstufft | thanks | 22:16 |
| krotscheck | jaypipes: “story: ###” But I believe it’s not quite hooked up yet. | 22:16 |
| jaypipes | krotscheck: gotcha. | 22:16 |
| jaypipes | krotscheck: yeah, must not be... see the two commits above from me. they have Storyboard story: XXX in them. | 22:16 |
| krotscheck | jaypipes: That’s on zaro’s plate right now. | 22:17 |
| jaypipes | ya, no worries and not a big deal :) | 22:17 |
| mtreinish | clarkb: no I don't think I've seen that before, it's weird looking. Nova complains about a connection timeout to neutron but the neutron service log shows everything is normal for the requests that failed | 22:18 |
| *** ayoung is now known as ayoung_dreidl | 22:18 | |
| mtreinish | clarkb: I'll open a bug and file a query for it | 22:18 |
| *** dustins has quit IRC | 22:20 | |
| *** mfink has quit IRC | 22:22 | |
| clarkb | dstufft: dhellmann fungi mgagne https://review.openstack.org/142593 | 22:23 |
| *** MarkAtwood has joined #openstack-infra | 22:23 | |
| mgagne | clarkb: ty | 22:24 |
| clarkb | mgagne: any chance you can confirm that fixes for you? | 22:24 |
| dhellmann | clarkb: that looks good; is it based on another commit that should be referenced in the message? | 22:24 |
| *** rmcall has quit IRC | 22:25 | |
| clarkb | dhellmann: no its fixing the change that mordred made | 22:25 |
| mgagne | clarkb: it's kind of hard because the issue is within an other project of ours which installs openstack clients which in turn installs pbr | 22:25 |
| dhellmann | clarkb: ok | 22:25 |
| clarkb | dhellmann: mordred added the _run_git_functions function which didn't check for the git dir first | 22:25 |
| clarkb | also I think I may need to reorder the function defs so that everything is happy importing? | 22:25 |
| *** prad has quit IRC | 22:26 | |
| *** jaypipes has quit IRC | 22:26 | |
| dhellmann | only if one of those functions is run at import time, I think | 22:26 |
| *** rmcall has joined #openstack-infra | 22:27 | |
| *** markmcclain has quit IRC | 22:27 | |
| *** vigneshvar has quit IRC | 22:27 | |
| fungi | clarkb: lgtm. i'm going to run out to grab something to eat, but will return | 22:27 |
| *** armax has quit IRC | 22:27 | |
| clarkb | oh right | 22:27 |
| *** spzala has joined #openstack-infra | 22:27 | |
| *** thedodd has joined #openstack-infra | 22:27 | |
| pleia2 | latest wildfly running with and an off the shelf puppet module (with some config adjustments), applying gold stars to self | 22:27 |
| dhellmann | I'm going to step out, too. I probably won't be back online before tomorrow morning. | 22:27 |
| *** zz_avozza is now known as avozza | 22:28 | |
| clarkb | dhellmann: ok thanks for all the help | 22:28 |
| *** ddieterly has quit IRC | 22:28 | |
| fungi | if we get these merged i or someone can cut 0.10.4 and see where else we're broken | 22:28 |
| *** melwitt has quit IRC | 22:28 | |
| *** bitblt has quit IRC | 22:28 | |
| *** melwitt has joined #openstack-infra | 22:28 | |
| *** ihrachyshka has quit IRC | 22:28 | |
| *** dims__ has joined #openstack-infra | 22:29 | |
| *** ddieterly has joined #openstack-infra | 22:29 | |
| dhellmann | clarkb: ping me if you need any other reviews | 22:29 |
| dhellmann | fungi: cool, thanks | 22:29 |
| fungi | will do, and thanks | 22:29 |
| * fungi will bbiaw | 22:29 | |
| mtreinish | clarkb: oh, http://logs.openstack.org/48/142348/1/check//check-tempest-dsvm-neutron-full/e591190/logs/kern_log.txt.gz#_Dec_17_06_02_52 would explain why neutron says it sent a response and nova timed out... | 22:30 |
| jeblair | clarkb: your 'read more' gear change seems to work well in stress testing | 22:30 |
| clarkb | jeblair: thats good, I haven't been able to swing back around and clean that up | 22:31 |
| mtreinish | connection errors in the kernel log aren't ever a good sign | 22:31 |
| jeblair | clarkb: i'm thinking it's probably what we want to do after the selective wake | 22:31 |
| *** bitblt has joined #openstack-infra | 22:32 | |
| clarkb | jeblair: in particular I wanted to address your comment on the change | 22:32 |
| clarkb | and I think the admin detection is wrong as I have pushed it let me check locally | 22:32 |
| anteaya | Queue lengths: 760 events, 1524 results. | 22:33 |
| *** ddieterly has quit IRC | 22:33 | |
| anteaya | is there a point we gently request folks to maybe change focus in their workflow? | 22:33 |
| jeblair | anteaya: people are not the problem | 22:34 |
| anteaya | very good | 22:34 |
| *** dannywilson has quit IRC | 22:36 | |
| *** armax has joined #openstack-infra | 22:36 | |
| *** dannywilson has joined #openstack-infra | 22:37 | |
| *** Kat has joined #openstack-infra | 22:37 | |
| *** Kat is now known as Guest69208 | 22:37 | |
| *** Guest69208 has quit IRC | 22:38 | |
| *** Katherine has joined #openstack-infra | 22:38 | |
| *** jedimike has quit IRC | 22:38 | |
| *** cdent has quit IRC | 22:44 | |
| *** dizquierdo has quit IRC | 22:46 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/gear: Read more bytes per readPacket iteration https://review.openstack.org/140186 | 22:46 |
| clarkb | jeblair: ^ that should be in much better shape. addresses your comment and fixes admin status | 22:47 |
| *** bhunter71 has quit IRC | 22:47 | |
| Katherine | ll | 22:49 |
| *** sarob has quit IRC | 22:51 | |
| jeblair | clarkb: echo "status"|nc localhost 4730 doesn't work for me with your change | 22:52 |
| *** e0ne has quit IRC | 22:52 | |
| clarkb | jeblair: the most recent patch doesn't work? | 22:52 |
| clarkb | jeblair: I know the old one wouldn't have | 22:52 |
| *** jamielennox|away is now known as jamielennox | 22:52 | |
| jeblair | clarkb: oh sorry, yeah that was ps2, retesting with ps3 | 22:52 |
| clarkb | jeblair: cool | 22:52 |
| jeblair | yeah, better. | 22:53 |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: move neutron-api job to use gate hooks https://review.openstack.org/142603 | 22:53 |
| *** ryanpetrello has joined #openstack-infra | 22:54 | |
| *** spzala has quit IRC | 22:54 | |
| *** stevemar has quit IRC | 22:55 | |
| openstackgerrit | James E. Blair proposed openstack-infra/gear: Fix accounting bug when peeking for job https://review.openstack.org/142604 | 22:55 |
| jeblair | clarkb: that's not an issue, just happened to notice it ^ | 22:56 |
| Katherine | is anyone still online who may be able to help with another zuul question? | 22:56 |
| *** stevemar has joined #openstack-infra | 22:56 | |
| jeblair | Katherine: probably; it's usually best just to go ahead and ask :) | 22:57 |
| *** armax has quit IRC | 22:57 | |
| *** sarob has joined #openstack-infra | 22:57 | |
| Katherine | works for me! | 22:57 |
| Katherine | ok, i'm cloning my project on my jenkins instance but when i try to fetch from my zuul server, for example, git fetch http://zuul-00.vse.adapps.hp.com/fusion refs/zuul/master/Zc75be890f63d4d938aedb4d99f73a503, i get fatal: http://zuul-00.vse.adapps.hp.com/fusion/info/refs not found: did you run git update-server-info on the server? | 22:59 |
| clarkb | Katherine: is apache (or some other web server) running on that host and serving out the zuul ref repos? | 22:59 |
| Katherine | let me double check on the "serving out the ref repos". apache is running | 23:00 |
| Katherine | ah, you know, apache is not serving out the repos. i forgot to add that part to the apache config. i'm not sure what apache file that should go in, though | 23:02 |
| *** Rockyg has quit IRC | 23:03 | |
| *** ryanpetrello has quit IRC | 23:03 | |
| *** otter768 has joined #openstack-infra | 23:03 | |
| clarkb | usually a vhost definition in /etc/apache2/sites-enabled | 23:03 |
| *** Rockyg has joined #openstack-infra | 23:03 | |
| clarkb | I can dig up our exampl | 23:03 |
| Katherine | thanks! | 23:03 |
| *** timcline has quit IRC | 23:03 | |
| *** sarob has quit IRC | 23:04 | |
| clarkb | https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/zuul/templates/zuul.vhost.erb | 23:05 |
| *** shashankhegde has quit IRC | 23:06 | |
| Katherine | thanks, clarkb! | 23:06 |
| clarkb | no problem | 23:07 |
| *** otter768 has quit IRC | 23:08 | |
| openstackgerrit | Merged openstack-infra/project-config: openstack/requirements stable branch ACL update https://review.openstack.org/142446 | 23:10 |
| openstackgerrit | Merged openstack-infra/project-config: Fix the log path returned from zuul https://review.openstack.org/142291 | 23:10 |
| openstackgerrit | Merged openstack-infra/project-config: python-surveilclient: Added gate checks https://review.openstack.org/142202 | 23:10 |
| *** timcline has joined #openstack-infra | 23:11 | |
| *** shashankhegde has joined #openstack-infra | 23:12 | |
| *** wenlock has quit IRC | 23:12 | |
| *** zz_dimtruck is now known as dimtruck | 23:12 | |
| *** marun has quit IRC | 23:13 | |
| *** Sukhdev has joined #openstack-infra | 23:14 | |
| *** andreykurilin_ has quit IRC | 23:14 | |
| *** MaxV has joined #openstack-infra | 23:16 | |
| david-lyle | I pushed tag 1.1.8 to openstack/django_openstack_auth a week ago, it's visible on http://git.openstack.org/cgit/openstack/django_openstack_auth, seems like the publish job to pypi failed, is there an easy way to re-trigger the publish? | 23:20 |
| *** signed8bit has quit IRC | 23:21 | |
| *** ayoung_dreidl is now known as ayoung | 23:23 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 23:26 | |
| *** gondoi is now known as zz_gondoi | 23:26 | |
| *** nelsnelson has quit IRC | 23:29 | |
| *** armax has joined #openstack-infra | 23:32 | |
| dstufft | or do /me wonders if openstack CI shouldn't fail fast if queue length gets over a certain number | 23:37 |
| dstufft | er | 23:37 |
| dstufft | left overs :( | 23:37 |
| jeblair | dstufft: i don't think that's a solution to the underlying network/protocol problem we are trying to debug | 23:38 |
| dstufft | jeblair: No, just a way to make the queue go faster when it's very long :) | 23:38 |
| *** avozza is now known as zz_avozza | 23:39 | |
| jeblair | dstufft: i think it would just be a way to make people angry. right now it's backlogged, but making forward progress and not losing any data | 23:39 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for trove unit test bug 1379729 https://review.openstack.org/142468 | 23:39 |
| uvirtbot | Launchpad bug 1379729 in trove "test_tranformer unit test fails with ModelNotFoundError: InstanceServiceStatus Not Found" [Medium,Triaged] https://launchpad.net/bugs/1379729 | 23:39 |
| anteaya | dstufft: it would just cause people to recheck and stuff things back in the queue | 23:39 |
| dstufft | why would they recheck a job that's not going to pass anyways | 23:40 |
| *** bitblt has quit IRC | 23:40 | |
| anteaya | david-lyle: not ignoring you, yes there is a way to re-trigger the publish, I don't know what it is, I think that jeblair clarkb or fungi would have to do it | 23:40 |
| dstufft | fail fast == one of the things have already failed, you know this particular queue item isn't going to pass successfully, so don't run the rest of the tests | 23:40 |
| jeblair | dstufft: iow, the problem is not that there is too much going on, there is an underlying fault that we haven't isolated yet. | 23:40 |
| anteaya | david-lyle: and they are all busy trying to get zuul and geard into a happy state | 23:40 |
| jeblair | dstufft: oh, but why tie that to queue length? | 23:40 |
| dstufft | jeblair: becasue if the queue isn't busy the extra information from getting _all_ the errors that would happen can be useful | 23:41 |
| jeblair | dstufft: fail-fast is reasonable in some circumstances, but it's not always what we want; it's often useful to get all the data. | 23:41 |
| jeblair | dstufft: the current backlog is not due to insufficient resources | 23:42 |
| david-lyle | anteaya: no worries, I saw I tried in the midst of turmoil, then things looked quieter when I popped back in. Thanks | 23:42 |
| jeblair | running fewer jobs would not appreciably help | 23:42 |
| anteaya | david-lyle: yup, good thoughts | 23:42 |
| *** Masahiro has joined #openstack-infra | 23:42 | |
| *** sabeen has quit IRC | 23:42 | |
| anteaya | david-lyle: if this fire gets contained someone will read backscroll and try to address | 23:42 |
| anteaya | david-lyle: if you dont' see any action, try us tomorrow, fair? | 23:43 |
| david-lyle | anteaya: absolutely | 23:43 |
| anteaya | david-lyle: thanks | 23:43 |
| clarkb | anteaya: thank you | 23:43 |
| david-lyle | happy firefighting :) | 23:43 |
| clarkb | david-lyle: and sorry we aren't super responsive right now | 23:43 |
| anteaya | doing my best to do what I can to help | 23:43 |
| dstufft | jeblair: eh, well I've thought about it previously too, not just tied to tonight, tonight is just particuarly back logged and reminded me about it | 23:43 |
| * anteaya mans the phone | 23:43 | |
| david-lyle | clarkb: I completely understand | 23:44 |
| *** kumartin has joined #openstack-infra | 23:44 | |
| *** fandi has quit IRC | 23:44 | |
| clarkb | jeblair: are you currently still waiting for gear to fall into the description update trap again? jenkins01 is running jobs so it should be getting told to update descriptions | 23:44 |
| jeblair | clarkb: yep. i think it's only recently gotten into the state where it might happen again. | 23:45 |
| dstufft | jeblair: the other thing that might be useful is to have a new patch revision abort existing jobs (I wish travis did this too, I almost always manually abort jobs when I can :/) | 23:46 |
| jeblair | dstufft: it already does | 23:46 |
| dstufft | jeblair: it does? why is there two queued items for the same gerrit CR, is that a side effect of the current issues? | 23:46 |
| *** Masahiro has quit IRC | 23:46 | |
| jeblair | dstufft: likely side effect of current issue | 23:47 |
| jeblair | which change? | 23:47 |
| dstufft | jeblair: It jsut fell off I think, becuase I can't find it now. it was one of the pbr changes | 23:49 |
| *** wenlock has joined #openstack-infra | 23:49 | |
| *** sabari is now known as zz_sabari | 23:49 | |
| anteaya | I see four pbr changes all unique | 23:49 |
| jeblair | yeah, that may have just been the lag in processing that event | 23:49 |
| *** andreaf has quit IRC | 23:50 | |
| *** yamamoto has joined #openstack-infra | 23:50 | |
| *** MaxV has quit IRC | 23:51 | |
| *** MaxV has joined #openstack-infra | 23:52 | |
| *** armax has quit IRC | 23:53 | |
| *** timcline has quit IRC | 23:53 | |
| *** yamamoto has quit IRC | 23:55 | |
| *** thedodd has quit IRC | 23:56 | |
| hashar | might be totally unrelated, but I had an issue with changes being stuck in Zuul queue for quite a long time | 23:56 |
| hashar | the reason is the gearman server dieing somehow. All merge:merge jobs are then marked as pending although they haven't been actually submitted | 23:57 |
| hashar | so they are stuck in the queue | 23:57 |
| hashar | it is a logic error fixed by https://review.openstack.org/#/c/128921/ (have been running it for a couple months) | 23:57 |
| hashar | jeblair: ^^ ::D | 23:57 |
| hashar | i can't remember whether it caused the result queue to not be processed though :( | 23:58 |
| *** hdd has quit IRC | 23:58 | |
| *** wenlock has quit IRC | 23:58 | |
| jeblair | hashar: that doesn't seem to be related to the problems we're seeing right now, but i'll keep it in mind, thanks | 23:58 |
| anteaya | hashar: thanks for trying to assist | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!