| clarkb | jeblair: mordred: woot reproduced | 00:00 |
|---|---|---|
| clarkb | will paste a set of steps shortly | 00:00 |
| mordred | clarkb: yay! | 00:00 |
| clarkb | http://paste.openstack.org/show/162449/ | 00:01 |
| bdpayne | ok, that helped... thanks | 00:01 |
| *** mohitsharma has quit IRC | 00:02 | |
| mtreinish | jogo: uhm, l62 and l63 | 00:02 |
| *** armax has quit IRC | 00:02 | |
| clarkb | mordred: one thing I noticed was that if I didn't delete the old egg info it used the old SOURCES.txt | 00:02 |
| clarkb | mordred: so, if you egg_info'd off of say master then egg_info'd off of that specific commit alembic was still in SOURCES.txt so starting fresh is important | 00:03 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add support to suppress bot notifications https://review.openstack.org/147293 | 00:03 |
| clarkb | mordred: so I am not sure that SOURCES.txt are being properly updated | 00:03 |
| mtreinish | jogo: why not just break the query part out into a separate test instead of just removing the lp part? | 00:04 |
| *** andreykurilin_ has quit IRC | 00:04 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for bug 1410969 https://review.openstack.org/147294 | 00:04 |
| *** mohitsharma has joined #openstack-infra | 00:05 | |
| *** gondoi is now known as zz_gondoi | 00:05 | |
| mordred | clarkb: nod. ok. that's good to know | 00:05 |
| mordred | clarkb: I think then it might have somethign to do with our logic to try to update when you need but not blow it away when you don't | 00:06 |
| *** markvoelker has joined #openstack-infra | 00:06 | |
| *** zz_gondoi is now known as gondoi | 00:06 | |
| jogo | mtreinish: comment on the patch, its a WIP | 00:06 |
| jogo | mtreinish: I was thinking break it out all together, but just wanted to test it out | 00:06 |
| *** armax has joined #openstack-infra | 00:08 | |
| openstackgerrit | Paul Michali proposed openstack-infra/project-config: Enable functional test job in openstack ci for neutron-vpnaas https://review.openstack.org/148616 | 00:08 |
| clarkb | pc_m: you lost a level of indentation in that patchset that will need to be added back | 00:11 |
| *** dangers is now known as dangers_away | 00:12 | |
| mtreinish | clarkb: I was looking at my test patch again, and I don't see the pre-seed stream still. I checked the nodepool logs and didn't see the perm error from before | 00:13 |
| *** sabeen1 has quit IRC | 00:13 | |
| pc_m | clarkb: Hmm. I cut and pasted the tests (and renamed them) from neutron, and saw the error on the first line, which was indented 2 more than all the others. | 00:13 |
| clarkb | mtreinish: so its working? | 00:14 |
| *** MaxV has joined #openstack-infra | 00:14 | |
| pc_m | clarkb: So, I unindented it by two, and the others to correspond. Did I mess it up again? | 00:14 |
| mtreinish | clarkb: no, there should be a pre seed stream in: http://logs.openstack.org/19/149719/2/check/check-tempest-dsvm-full/370e9dd/logs/testrepository/ | 00:14 |
| mtreinish | but there is only 1 stream there (which is generated by the test run) | 00:14 |
| clarkb | pc_m: its yaml, you don't want to remove the indentation of the jobs: list | 00:14 |
| pc_m | In patch set 6 | 00:14 |
| pc_m | clarkb: Guess I'm confused as to what I did wrong (and I don't know YAML at all). | 00:15 |
| clarkb | mtreinish: http://logs.openstack.org/19/149719/2/check/check-tempest-dsvm-full/370e9dd/logs/devstack-gate-setup-workspace-new.txt.gz#_2015-01-26_20_01_40_773 | 00:16 |
| clarkb | mtreinish: I forgot about that :/ | 00:16 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Check logs are complete before uploading to swift https://review.openstack.org/150188 | 00:16 |
| jhesketh | clarkb: ^ | 00:16 |
| mtreinish | clarkb: sigh.... | 00:16 |
| mtreinish | clarkb: should I revive the cp patch from before? | 00:17 |
| clarkb | mtreinish: I guess | 00:17 |
| pc_m | clarkb: Is the '{pipeline}-...' line supposed to be lined up with the openstack-publish-jobs line and it with the python-jobs line? | 00:17 |
| clarkb | pc_m: if you look in that file there should be tons of examples but jobs: is one indent level then everthing below it is at least one additional level | 00:18 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/devstack-gate: Really preseed tempest testrepository from database https://review.openstack.org/149740 | 00:18 |
| mordred | clarkb: thanks for the test case, btw - I'm looking forward to tearing my hair out and cursing at python packaging .. | 00:18 |
| clarkb | mordred: enjoy | 00:18 |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Add plugins_info to module registry object. https://review.openstack.org/132927 | 00:18 |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Add support for hipchat notifier 0.1.8 https://review.openstack.org/135843 | 00:18 |
| * mordred stabs random person with a very cold pizza | 00:18 | |
| *** hichtakk has quit IRC | 00:19 | |
| *** baoli has quit IRC | 00:19 | |
| *** gondoi is now known as zz_gondoi | 00:19 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/devstack-gate: Really preseed tempest testrepository from database https://review.openstack.org/149740 | 00:20 |
| *** baoli has joined #openstack-infra | 00:20 | |
| clarkb | jhesketh: lgtm | 00:20 |
| clarkb | jeblair: mordred fungi if 150188 looks good to you all as well I can rebuild images this evening | 00:20 |
| *** hichtakk has joined #openstack-infra | 00:20 | |
| *** _amrith_ is now known as amrith | 00:20 | |
| openstackgerrit | Paul Michali proposed openstack-infra/project-config: Enable functional test job in openstack ci for neutron-vpnaas https://review.openstack.org/148616 | 00:20 |
| *** hichtakk has quit IRC | 00:20 | |
| *** hichtakk has joined #openstack-infra | 00:21 | |
| *** hichtakk has quit IRC | 00:21 | |
| *** zz_gondoi is now known as gondoi | 00:21 | |
| pc_m | clarkb: Ah I see, I unindented the previous lines. | 00:21 |
| mordred | clarkb: WOW | 00:21 |
| jeblair | clarkb: jhesketh +2; did not approve in case fungi wanted to review; feel free to aprv at will though | 00:22 |
| fungi | yep, looking now--thanks | 00:22 |
| jhesketh | jeblair, clarkb: actually might just put that in wip | 00:22 |
| mordred | same here | 00:22 |
| jhesketh | just need to test some more | 00:22 |
| *** hichtakk has joined #openstack-infra | 00:22 | |
| *** amitgandhinz has joined #openstack-infra | 00:23 | |
| *** andreykurilin_ has joined #openstack-infra | 00:23 | |
| * jhesketh doesn't trust his lack of bash skills | 00:23 | |
| clarkb | jhesketh: kk :) | 00:23 |
| jeblair | jhesketh: i think the thing to take away from this is that we all trust your lack of bash skills. ;) | 00:23 |
| fungi | wow. why did i not know the joys of /proc/sys/kernel/random/uuid until just this instant?!? | 00:23 |
| jeblair | fungi: i was thinking the same thing! | 00:23 |
| * jeblair has to run | 00:23 | |
| sdague | fungi: nice | 00:23 |
| clarkb | it was a TIL for me too | 00:24 |
| fungi | sdague: we all owe thanks to jhesketh and 150188 on that one | 00:24 |
| btran | Hi, any changes in devstack recently? I"m getting HTTP 401 error Authentication failure: Could not find user: %SERVICE_USER% . Was running fine on friday | 00:24 |
| mtreinish | fungi: wait that's a thing? | 00:24 |
| sdague | so is that actually an rfc uuid? | 00:24 |
| mordred | sdague: seems to be | 00:24 |
| fungi | according to the random machines i just checked, it exists and does "things" | 00:24 |
| mordred | sdague: just cat it | 00:24 |
| jhesketh | fungi: well actually thanks to a google for bash uuid | 00:24 |
| fungi | yeah, i get a fresh uuid on every read | 00:24 |
| fungi | it's beautiful | 00:25 |
| mordred | sdague: I feel like somehow knowing about that shoudl be able to make something in openstack much clearner | 00:25 |
| jhesketh | heh | 00:25 |
| sdague | mordred: no, but uuid spec includes namespace bits | 00:25 |
| fungi | and whether or not it's a "real" uuid is irrelevant in this situation. we just need a random string | 00:25 |
| mordred | fungi: ++ | 00:25 |
| jhesketh | so when I run this script on my machine, the first fetch of the logs works, but after that I get wget complains "Cannot write to '/tmp/console.txt’ (Success).".. However the permissions on the file are fine, any thoughts? | 00:26 |
| fungi | i'd have been just as satisfied with a dd of /dev/urandom piped through md5sum or base64 | 00:26 |
| *** _nadya_ has joined #openstack-infra | 00:26 | |
| clarkb | jhesketh: let me try some local wgetting | 00:26 |
| fungi | jhesketh: wget won't overwrite by default | 00:27 |
| *** amitgandhinz has quit IRC | 00:27 | |
| *** mohitsharma has quit IRC | 00:27 | |
| jhesketh | fungi: isn't that the point of --continue though? | 00:27 |
| fungi | jhesketh: oh, it'll append in that case | 00:28 |
| clarkb | ya it seems to work locally | 00:28 |
| fungi | jhesketh: so you're saying when you get an incomplete log and then try to append it's failing on permissions? | 00:28 |
| jhesketh | fungi: seems that way | 00:29 |
| jhesketh | but the permissions look right to me | 00:29 |
| jhesketh | and apparently it works for clarkb | 00:29 |
| fungi | where does this script run? on the worker where the job ran?? | 00:29 |
| clarkb | though I didn't mange to test with incomplete logs | 00:29 |
| clarkb | let me try esting with jenkins | 00:29 |
| clarkb | any running job should work | 00:29 |
| jhesketh | fungi: yes | 00:30 |
| fungi | jhesketh: if we end up running this later on jobs which use long-running (non-ephemeral) workers, we probably need to namespace and clean up the tempfile | 00:30 |
| *** arielb has quit IRC | 00:30 | |
| jhesketh | fungi: I didn't think we had any non-ephemeral workers/jobs | 00:30 |
| *** _nadya_ has quit IRC | 00:30 | |
| fungi | jhesketh: we have plenty. upload jobs mostly | 00:30 |
| jhesketh | oh, well, then I should fix this now | 00:31 |
| openstackgerrit | Merged openstack/requirements: Bump gabbi to 0.5.0 https://review.openstack.org/149414 | 00:31 |
| jhesketh | first I want to figure out why this fails on my machine | 00:31 |
| fungi | jhesketh: translations push/pull, requirements sync updates, uploads to pypi/puppetforge/maven-central | 00:32 |
| fungi | jhesketh: basically any job which depends on privileged credentials | 00:32 |
| *** shashankhegde has joined #openstack-infra | 00:32 | |
| clarkb | grabbing https://jenkins07.openstack.org/job/check-tempest-dsvm-docker/2554/consoleText over and over works for me | 00:32 |
| jhesketh | noted | 00:32 |
| *** gokrokve has quit IRC | 00:32 | |
| clarkb | jhesketh: what is the path with the html? | 00:32 |
| jhesketh | logText/progressiveHtml | 00:33 |
| clarkb | thanks. that seems to work as well | 00:34 |
| jhesketh | hmm, what version of wget are you using? | 00:34 |
| *** adalbas has quit IRC | 00:34 | |
| * jhesketh has 1.14 | 00:34 | |
| clarkb | jhesketh: 1.15 from ubuntu trusty | 00:34 |
| openstackgerrit | Travis McPeak proposed openstack/requirements: Adding bandit to test requirements https://review.openstack.org/150138 | 00:35 |
| jhesketh | okay, I'll try on another machine | 00:35 |
| fungi | oh, that's a very good point. we'll be beholden to the behaviors of various versions of whet on all our different worker platforms | 00:35 |
| fungi | er, wget | 00:35 |
| *** baoli has quit IRC | 00:35 | |
| jhesketh | so --continue is meant to continue a partial file... in essence the file is downloaded fully, not partially, but then we're requesting it again with a changed source file... I wonder if that'll cause any issues | 00:36 |
| *** baoli has joined #openstack-infra | 00:36 | |
| clarkb | jhesketh: but we don't change the source file in the retry loop right? | 00:36 |
| fungi | so, i think --continue expects the new content to be a strict superset of the old (and may use range calls?) | 00:37 |
| clarkb | that is what I would expect but we don't change the local version so that should be fine right? | 00:37 |
| fungi | for example, if a partial wget still adds </pre></body></html> or something then it'll need to be stripped between passes | 00:37 |
| fungi | no idea whether that's truly the case | 00:38 |
| *** pc_m has quit IRC | 00:38 | |
| jhesketh | looking at the man it seems to do what we want | 00:38 |
| *** dims has quit IRC | 00:38 | |
| jhesketh | " This behavior can be desirable in certain cases—for instance, you can use ‘wget -c’ to download just the new portion that’s been appended to a data collection or log file. " | 00:38 |
| *** baoli has quit IRC | 00:38 | |
| *** dims has joined #openstack-infra | 00:39 | |
| *** pc_m has joined #openstack-infra | 00:39 | |
| *** fifieldt has joined #openstack-infra | 00:39 | |
| *** baoli has joined #openstack-infra | 00:39 | |
| fungi | i mean we need to compare a wget of the partial and complete log to see whether it's only appending data or if there is data moving/replaced between them | 00:39 |
| jhesketh | so long as the file doesn't change (ie is only appended to by Jenkins) we should be fine | 00:39 |
| *** dims has quit IRC | 00:39 | |
| fungi | closing html tags conveniently appended to a partial log by jenkins are my particular concern | 00:39 |
| clarkb | OHHH | 00:39 |
| *** tmcpeak has quit IRC | 00:39 | |
| openstackgerrit | Sylvain Bauza proposed openstack-infra/project-config: Add regression exception for Nova Cells V1 check job https://review.openstack.org/150193 | 00:39 |
| clarkb | fungi: ya let me look in my files locally | 00:40 |
| clarkb | hrm I have no html tags | 00:40 |
| clarkb | anmd the script seems to add them so that seems right | 00:40 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 00:40 | |
| jhesketh | fungi: yes, that's a concern.. Looking at the locations we are fetching from though there is no closing/surrounding text so it seems to be a pretty straight forward append | 00:40 |
| clarkb | fungi: so we should be safe on that front | 00:40 |
| fungi | so the other possibility is that i seem to recall wget --continue only works if the httpd supports range headers | 00:41 |
| jhesketh | the progressText thing we use is what Jenkins uses to load its javascript log viewer | 00:41 |
| clarkb | fungi: which it should because its working for me locally | 00:41 |
| jhesketh | fungi: that's correct | 00:41 |
| fungi | okay, cool | 00:41 |
| *** gondoi is now known as zz_gondoi | 00:41 | |
| clarkb | could this be a umask thing? | 00:41 |
| clarkb | or a wget 1.14 bug? | 00:41 |
| jhesketh | don't think it's umask, just about to try else where | 00:41 |
| *** markmcclain has quit IRC | 00:41 | |
| *** thedodd has joined #openstack-infra | 00:42 | |
| *** markmcclain has joined #openstack-infra | 00:42 | |
| *** ryanpetrello has quit IRC | 00:43 | |
| jhesketh | hmm, works for me with wget 1.15 on another machine | 00:43 |
| *** ryanpetrello has joined #openstack-infra | 00:44 | |
| *** r-daneel has quit IRC | 00:44 | |
| *** ryanpetrello has quit IRC | 00:44 | |
| *** dims has joined #openstack-infra | 00:45 | |
| openstackgerrit | Merged openstack/requirements: Avoid django_openstack_auth==1.1.8 https://review.openstack.org/149996 | 00:45 |
| *** dmsimard is now known as dmsimard_away | 00:45 | |
| *** ryanpetrello has joined #openstack-infra | 00:46 | |
| openstackgerrit | Paul Michali proposed openstack-infra/project-config: Enable functional test job in openstack ci for neutron-vpnaas https://review.openstack.org/148616 | 00:49 |
| *** dims has quit IRC | 00:50 | |
| *** andreykurilin_ has quit IRC | 00:51 | |
| *** sandywalsh has quit IRC | 00:52 | |
| *** belmoreira has quit IRC | 00:53 | |
| *** harlowja has quit IRC | 00:54 | |
| *** stevemar has joined #openstack-infra | 00:54 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Check logs are complete before uploading to swift https://review.openstack.org/150188 | 00:54 |
| openstackgerrit | Mark T. Voelker proposed openstack-infra/system-config: Add openstack-nova to eavesdrop https://review.openstack.org/150195 | 00:54 |
| clarkb | jhesketh: should we add a preventative rm prior to each wget too? | 00:54 |
| jhesketh | okay works on centos 6 with wget 1.12 and ubuntu 12.04 with wget 1.13.4 | 00:54 |
| clarkb | if [ -f file ] ; then rm file ; fi | 00:55 |
| jhesketh | so not sure why my desktop is failing, but seems to be limited to it so I'd say my env is dirty | 00:55 |
| jhesketh | clarkb: was thinking of writing to a file with the uuid as the name in a followup change | 00:55 |
| clarkb | jhesketh: wouldn' we accumulate files if we do that? | 00:56 |
| *** jaypipes has quit IRC | 00:56 | |
| *** gokrokve has joined #openstack-infra | 00:56 | |
| *** dannywilson has quit IRC | 00:56 | |
| jhesketh | clarkb: hmm, good point... as long as only one job is running at one time we should be fine to rm then | 00:56 |
| fungi | yeah, probably need to cleanup at the start of the script run, or at the end and then namespace them in case that fails | 00:57 |
| jhesketh | clarkb: want it in this change or a subsequent | 00:57 |
| *** ryanpetrello has quit IRC | 00:57 | |
| fungi | i'm fine with it in a followup change. we don't need it _yet_ | 00:57 |
| fungi | and the bug was already there | 00:57 |
| fungi | i'm okay to +2/approve if you're fine with it | 00:58 |
| *** ryanpetrello has joined #openstack-infra | 00:58 | |
| clarkb | ya it can wait for subsequent change | 00:58 |
| clarkb | jhesketh: we only ever set things up as single executor so it should be fine do do it that way | 00:58 |
| fungi | also sdague is on an exit trap kick. they're cool, but i'm indifferent (we can just do cleanup at start) | 00:59 |
| clarkb | I prefer cleanup at start, its simpler | 00:59 |
| fungi | i've +2'd but i'll let someone else +2 before approving | 00:59 |
| clarkb | I will review the latest patchset | 00:59 |
| fungi | since there's a new patchset | 00:59 |
| *** mase_x200 has joined #openstack-infra | 01:00 | |
| *** pc_m has quit IRC | 01:00 | |
| whoops | exit | 01:00 |
| *** whoops has quit IRC | 01:00 | |
| clarkb | heh | 01:01 |
| *** gokrokve has quit IRC | 01:01 | |
| clarkb | I have approved it | 01:01 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Remove old log fetches in case of conflict https://review.openstack.org/150197 | 01:01 |
| *** markmcclain has quit IRC | 01:01 | |
| clarkb | well maybe, brwoser is being funny | 01:01 |
| clarkb | there it goes (I should go back to gertty now that I untangled that mess) | 01:01 |
| jhesketh | thanks guys :-) | 01:02 |
| *** MaxV has quit IRC | 01:03 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for django-openstack-auth 1.1.8 bug 1413876 https://review.openstack.org/150198 | 01:03 |
| jeblair | clarkb, fungi: there's one thing that didn't quite make the translation to the video of my talk -- my pre-show slide was a black screen with a blinking green cursor, and the laugh at the start of the presentation is when i change from that to the title slide | 01:05 |
| *** markvoelker has quit IRC | 01:05 | |
| fungi | sounds awesome | 01:05 |
| clarkb | oh ya I need to watch that | 01:06 |
| clarkb | it is now loading | 01:06 |
| *** markvoelker has joined #openstack-infra | 01:06 | |
| *** spandhe has quit IRC | 01:06 | |
| clarkb | "warm welcome" -> I am now deaf :) | 01:06 |
| jeblair | fungi: a blinking green cursor sparks my imagination :) | 01:06 |
| fungi | mine as well! | 01:06 |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Add plugins_info to module registry object. https://review.openstack.org/132927 | 01:07 |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Add support for hipchat notifier 0.1.8 https://review.openstack.org/135843 | 01:07 |
| *** mase_x200 has quit IRC | 01:07 | |
| openstackgerrit | Merged openstack/requirements: Bumping PyKMIP version from 0.1.0 to 0.2.0 https://review.openstack.org/137016 | 01:07 |
| openstackgerrit | Merged openstack/requirements: Avoid using pexpect version 3.3 https://review.openstack.org/145104 | 01:07 |
| *** Sukhdev has quit IRC | 01:08 | |
| clarkb | the mordred laugh is great too | 01:08 |
| jhesketh | while people are looking at swift-log stuff, anybody mind reviewing this one please: https://review.openstack.org/#/c/141277/ | 01:08 |
| *** oomichi has joined #openstack-infra | 01:08 | |
| jeblair | clarkb: yeah, i've been able to hear mordred, fallenpegasus, and bkuhn | 01:09 |
| *** markvoelker has quit IRC | 01:10 | |
| *** zhiwei has joined #openstack-infra | 01:11 | |
| *** hdd has quit IRC | 01:14 | |
| *** armax has quit IRC | 01:14 | |
| clarkb | jhesketh: that change is so large :P I will take a look when jeblair's talk is over | 01:15 |
| *** armax has joined #openstack-infra | 01:15 | |
| *** gyee has quit IRC | 01:15 | |
| clarkb | jhesketh: I assume 141277 is tested locally? I can probably test it myself pretty easily too | 01:16 |
| *** gokrokve has joined #openstack-infra | 01:16 | |
| *** jerryz has joined #openstack-infra | 01:17 | |
| *** melwitt has quit IRC | 01:18 | |
| *** alexpilotti has joined #openstack-infra | 01:18 | |
| *** achanda_ has joined #openstack-infra | 01:19 | |
| jhesketh | clarkb: yes, I tested when I wrote it | 01:20 |
| openstackgerrit | Merged openstack-infra/project-config: Check logs are complete before uploading to swift https://review.openstack.org/150188 | 01:21 |
| clarkb | I won't kick off new image builds quite yet since I do want to review 141277 | 01:21 |
| *** yamahata has joined #openstack-infra | 01:22 | |
| *** hdd has joined #openstack-infra | 01:22 | |
| *** achanda has quit IRC | 01:23 | |
| *** kgiusti has quit IRC | 01:23 | |
| *** achanda_ has quit IRC | 01:24 | |
| *** marun has quit IRC | 01:25 | |
| *** crc32 has quit IRC | 01:25 | |
| *** otter768 has joined #openstack-infra | 01:26 | |
| vipul | anyone else seeing issues with this change? https://github.com/openstack-dev/devstack/commit/1631af891af32eaa9af609398a88252ab437b0b4 | 01:27 |
| vipul | seems not all sample.conf files in projects.. i.e. Glance are updated with what seems to be different settings necesarry for the auth_middleware | 01:27 |
| *** armax has quit IRC | 01:28 | |
| *** reed has quit IRC | 01:28 | |
| vipul | in a new devstack, here's a setting that's failing to get set: /etc/glance/glance-api.conf:admin_user = %SERVICE_USER% | 01:29 |
| *** bdpayne has quit IRC | 01:29 | |
| btran | vipul: yes, I am getting the same problem | 01:30 |
| btran | I ping the chat room about the issue, but got no responses, thought it might have been my env setup | 01:31 |
| clarkb | a quick glance (no pun intended) at the zuul status page shows thing are working | 01:31 |
| clarkb | might be good to compare your devstack to what tempest is using | 01:31 |
| *** otter768 has quit IRC | 01:32 | |
| vipul | clarkb: good point.. although unless dsvm is setup using different scripts, this should definitely be an issue | 01:34 |
| clarkb | its just devstack gate then devstack | 01:34 |
| *** harlowja has joined #openstack-infra | 01:35 | |
| vipul | clarkb: is it possible the devstack vms were created a while ago? | 01:36 |
| clarkb | vipul: they should always use latest devstack (that is the point of gating) | 01:36 |
| fungi | yep. we run the most recent branch tips of devstack and devstack-gate for each job run | 01:37 |
| *** hichtakk has quit IRC | 01:41 | |
| *** ctlaugh has joined #openstack-infra | 01:42 | |
| *** tkelsey has joined #openstack-infra | 01:42 | |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Add plugins_info to module registry object. https://review.openstack.org/132927 | 01:43 |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Add support for hipchat notifier 0.1.8 https://review.openstack.org/135843 | 01:43 |
| clarkb | jeblair: that was a fun talk | 01:46 |
| clarkb | now to review swift upload script change | 01:46 |
| *** tkelsey has quit IRC | 01:46 | |
| *** tsg has joined #openstack-infra | 01:48 | |
| *** hdd has quit IRC | 01:50 | |
| waynr | zaro: i am looking into implementing Parameterized Remote Trigger Plugin in JJB, but it looks like it requires globaly configuration on the jenkins master, as long as we document this need is there any reason you can think of that the patch wouldn't be accepted? also, do you know of anyway to read the global jenkins config from within a module? | 01:51 |
| *** gokrokve has quit IRC | 01:51 | |
| *** thedodd has quit IRC | 01:51 | |
| *** armax has joined #openstack-infra | 01:53 | |
| openstackgerrit | Merged openstack/requirements: Remove requirements overlap check https://review.openstack.org/142151 | 01:54 |
| clarkb | jhesketh: mostly because I am thinking as I review. Do we need to be better about filename sanitization here? I guess we don't have a db to do injection attacks against and we are uploading to swift so its not like we right to important places on a filesystem so probably not | 01:54 |
| clarkb | jhesketh: then we just have to be careful when serving the data which sdague added a long time ago so we should be ok? | 01:55 |
| clarkb | jhesketh: also does this flatten everything to a single index level? trying to figure that out currently | 01:56 |
| clarkb | jhesketh: eg is it recursively making an index for each level? | 01:56 |
| *** dims has joined #openstack-infra | 01:59 | |
| jhesketh | clarkb: I think the index building doesn't need to concern itself with filename sanitization too much... swift will take care of that to some degree.. If we get odd names in the future there may be a bug but I can't think of one (since you're also limited by the filesystem conditions) | 01:59 |
| clarkb | ya | 01:59 |
| jhesketh | not sure what we need to be careful about when serving | 01:59 |
| jhesketh | either the file exists when requested or it doesn't | 01:59 |
| jhesketh | there should be 1 index per directory (ie it is recursive) | 02:00 |
| clarkb | jhesketh: ya my concern there is maybe the file exists as say /etc/passwd | 02:00 |
| clarkb | but os loganalyze does sanitize that so should be ok | 02:00 |
| clarkb | jhesketh: yup I found the path walking now | 02:00 |
| openstackgerrit | Merged openstack/requirements: Bump eventlet version to 0.16.1 https://review.openstack.org/145816 | 02:00 |
| openstackgerrit | Merged openstack/requirements: Bump version of openstack-doc-tools >= 0.21.1 https://review.openstack.org/142076 | 02:00 |
| openstackgerrit | Merged openstack/requirements: add elasticsearch python client https://review.openstack.org/147229 | 02:00 |
| *** ChuckC has quit IRC | 02:01 | |
| jhesketh | clarkb: yeah it's only a concern for os-loganalyze.. if we upload the passwd file from a slave then that's no surprise since we're running arbitrary code (ie proposed code) anyway | 02:01 |
| clarkb | yup | 02:01 |
| jhesketh | os-loganlayze only looks in its srv folder for local content, outside of that it'll query swift | 02:01 |
| *** ChuckC_ has joined #openstack-infra | 02:01 | |
| *** rwsu is now known as rwsu-afk | 02:05 | |
| *** mohitsharma has joined #openstack-infra | 02:05 | |
| clarkb | jhesketh: approved | 02:06 |
| *** ddieterly has joined #openstack-infra | 02:06 | |
| clarkb | once that merges I will kick off some image rebuilds | 02:06 |
| jhesketh | clarkb: shiny, thanks :-) | 02:07 |
| *** avozza is now known as zz_avozza | 02:08 | |
| *** ChuckC_ has quit IRC | 02:09 | |
| *** ChuckC has joined #openstack-infra | 02:09 | |
| clarkb | jhesketh: which image is most useful first? bare-trusty? bare-precise? | 02:10 |
| jhesketh | clarkb: pretty arbitrary really, maybe trusty/ | 02:10 |
| clarkb | ok | 02:10 |
| clarkb | I will do all the bare-* but will start with trusty | 02:10 |
| openstackgerrit | Merged openstack-infra/project-config: Add in parent links to zuul log indexes https://review.openstack.org/141277 | 02:11 |
| clarkb | there it is. starting builds now | 02:12 |
| jhesketh | clarkb: noted, although wait for the child change of ^ before rebuilding please :-) | 02:12 |
| jhesketh | sorry, should have given you a heads up, this one is about to merge too: https://review.openstack.org/#/c/141286/ | 02:12 |
| clarkb | I think we should cut it such that nodes boot and clone after that merges | 02:13 |
| clarkb | if not I will rebuild | 02:13 |
| *** otter768 has joined #openstack-infra | 02:14 | |
| jhesketh | yep | 02:14 |
| clarkb | at least for hpcloud that should be the case. rax booted much quicker | 02:14 |
| *** salv-orlando has joined #openstack-infra | 02:14 | |
| openstackgerrit | Merged openstack-infra/project-config: Add extra detail to swift indexes https://review.openstack.org/141286 | 02:15 |
| clarkb | gah I think rax builds just missed it | 02:15 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-dev/hacking: Updated from global requirements https://review.openstack.org/150204 | 02:15 |
| jhesketh | clarkb: all good, get it next time | 02:15 |
| *** ChuckC_ has joined #openstack-infra | 02:15 | |
| clarkb | watching puppet output now as project-config is cloned by puppet | 02:16 |
| *** salv-orl_ has joined #openstack-infra | 02:18 | |
| *** salv-orlando has quit IRC | 02:18 | |
| *** ChuckC has quit IRC | 02:19 | |
| *** liusheng has quit IRC | 02:20 | |
| clarkb | jhesketh: looks like it just cloned on the rax builds so we should be fine | 02:20 |
| clarkb | puppet actually takes its time before satisfying that item | 02:20 |
| *** ivar-laz_ has joined #openstack-infra | 02:21 | |
| *** kaisers1 has quit IRC | 02:21 | |
| *** kaisers has joined #openstack-infra | 02:21 | |
| *** liusheng has joined #openstack-infra | 02:21 | |
| jhesketh | cool | 02:22 |
| *** alexpilotti has quit IRC | 02:22 | |
| *** shashankhegde has quit IRC | 02:22 | |
| *** dims has quit IRC | 02:24 | |
| *** ivar-lazzaro has quit IRC | 02:25 | |
| *** ivar-laz_ has quit IRC | 02:25 | |
| *** armax has quit IRC | 02:27 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Remove old log fetches in case of conflict https://review.openstack.org/150197 | 02:27 |
| *** hdd has joined #openstack-infra | 02:28 | |
| jhesketh | jeblair: when you get a chance, can you take a look at the comment replies on https://review.openstack.org/#/c/118993/ please | 02:28 |
| clarkb | wait this storm in the NE is called "juno"? thats awesome | 02:29 |
| mordred | heck yes | 02:29 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Fix up status page dependencies https://review.openstack.org/98028 | 02:30 |
| clarkb | jhesketh: new images should be ready real soon now for bare-trusty | 02:32 |
| clarkb | at least one region is snapshotting now | 02:32 |
| jhesketh | cool, thanks | 02:32 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for django-openstack-auth 1.1.8 bug 1413876 https://review.openstack.org/150198 | 02:37 |
| clarkb | things that are slow: image snapshots | 02:38 |
| *** gokrokve has joined #openstack-infra | 02:40 | |
| *** mwagner_lap has quit IRC | 02:42 | |
| mordred | clarkb: while you're bored waiting for snapshots, if you wanted to review shade patches ... | 02:44 |
| *** Ryan_Lane has quit IRC | 02:46 | |
| *** signed8bit has joined #openstack-infra | 02:47 | |
| *** yamamoto_ has joined #openstack-infra | 02:47 | |
| *** yamahata has quit IRC | 02:48 | |
| clarkb | mordred: sorry debugging rax precise issues | 02:51 |
| clarkb | I think they no longer have non pvhvm base images | 02:51 |
| mordred | do we _want_ non pvhvm base images? | 02:52 |
| *** thedodd has joined #openstack-infra | 02:53 | |
| *** thedodd has quit IRC | 02:53 | |
| mordred | clarkb: I see images listed as "PV" and "PVHVM" | 02:53 |
| *** mwagner_lap has joined #openstack-infra | 02:53 | |
| clarkb | mordred: we used non pvhvm because the pvhvm images were different and hadn't done the work to test that they worked for us | 02:53 |
| mordred | nod | 02:54 |
| clarkb | mordred: but I think that ship has sailed now so pushing a change to use pvhvm | 02:54 |
| *** fandi has joined #openstack-infra | 02:54 | |
| mordred | ++ | 02:54 |
| mordred | I agree with your logic | 02:54 |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Use Rackspace Precise PVHVM images. https://review.openstack.org/150231 | 02:55 |
| *** fandi has quit IRC | 02:55 | |
| *** fandi has joined #openstack-infra | 02:56 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Use Rackspace CentOS 6 PVHVM base images https://review.openstack.org/150233 | 02:58 |
| clarkb | mordred: ^ problem with centos6 for other raisins | 02:58 |
| clarkb | tl;dr clouds please don't rename your base image names | 02:58 |
| clarkb | I mean even if you just uploaded a pvhvm image to the "normal" image I would have likely been happy | 02:58 |
| *** fandi has quit IRC | 02:59 | |
| *** fandi has joined #openstack-infra | 02:59 | |
| clarkb | jhesketh: at this point in time your chances of getting a bare-trusty node with the right files should be high. bare-precise is being built in hpcloud but rax needs the two changes above for the non trusty images | 02:59 |
| mordred | clarkb: +2 on both | 02:59 |
| mordred | clarkb: also - JEEZ | 03:00 |
| jhesketh | clarkb: cool, I'll fire off some tests | 03:00 |
| clarkb | mordred: there are times when I seriously consider running a cloud simply to do it better | 03:00 |
| clarkb | mordred: but then I remember hard drives fail | 03:01 |
| mordred | clarkb: yah | 03:01 |
| clarkb | mordred: maybe we should put in a talk for vancouver where we talk about running clouds for your users | 03:02 |
| mordred | clarkb: well, you know what though? hard drives failing is a task that can be taken care of by a human on the ground swapping drives out from the raid arrays every night | 03:02 |
| mordred | clarkb: ++ | 03:02 |
| clarkb | mordred: is that something you would be interested in doing? | 03:02 |
| *** devlaps has quit IRC | 03:03 | |
| mordred | clarkb: yeah - I'll work up an abstract | 03:06 |
| clarkb | because i have a giant list of fedbacky type things I am happy to provide | 03:06 |
| clarkb | starting with 1. I just want a computer on the internet 99% of the time | 03:06 |
| *** fandi has quit IRC | 03:07 | |
| *** fandi has joined #openstack-infra | 03:07 | |
| clarkb | and 2. I should be able to consistently boot that computer with a single api call that doesn't change for 2 years | 03:07 |
| *** ddieterly has quit IRC | 03:09 | |
| mordred | so much yes | 03:10 |
| jhesketh | clarkb: looks like the grep or something isn't working and we're looping on grabbing the consolelog: https://jenkins01.openstack.org/job/gate-project-config-layout/370/consoleFull | 03:11 |
| *** fandi has quit IRC | 03:11 | |
| *** fandi has joined #openstack-infra | 03:11 | |
| clarkb | jhesketh: thats awesome. Should I kill that job manually? | 03:12 |
| jhesketh | well I don't think it'll finish | 03:12 |
| jhesketh | also means we've broken the jobs :-( | 03:12 |
| clarkb | jhesketh: ya :) don't worry we shall fix | 03:12 |
| clarkb | I hat ethat set -x doesn't show the ! | 03:13 |
| clarkb | ok now to wget and try to reproduce | 03:14 |
| clarkb | jhesketh: are there other jobs I need to fix? I am going to delete the images I just built | 03:14 |
| jhesketh | that's the only test one I fired off, so depends what is running | 03:15 |
| jhesketh | The jobs queued are going to fail anyway so we may as well just recheck as the failures come in | 03:15 |
| clarkb | jhesketh: but its only infra things right? | 03:15 |
| clarkb | we don't swift all the things yet | 03:15 |
| jhesketh | yep | 03:15 |
| jhesketh | correct | 03:15 |
| jhesketh | hmm, works for me and grepping that log finds the uuid | 03:17 |
| clarkb | jhesketh: is the logic in the while loop wrong though | 03:18 |
| clarkb | jhesketh: maybe the file path is off or something? I am about to dig in as soon as I clean up these new images | 03:18 |
| jhesketh | not that I can tell.. I just tested the logic and it works for me (tm) | 03:19 |
| jhesketh | clarkb: are there any nodes you can log into and see what is in /tmp/console.txt? | 03:19 |
| clarkb | jhesketh: maybe? let me see | 03:20 |
| *** tmcpeak has joined #openstack-infra | 03:21 | |
| clarkb | jhesketh: can you link me to a job that is still going if one exists? | 03:21 |
| jhesketh | can't see any still running | 03:21 |
| jhesketh | clarkb: oh, interesting https://jenkins01.openstack.org/job/gate-devstack-publish-docs/182/console | 03:24 |
| jhesketh | looks like that one worked | 03:24 |
| *** tmcpeak has quit IRC | 03:24 | |
| clarkb | jhesketh: looking at the wget output, it appears to never get any additional bytes | 03:25 |
| jhesketh | the one that failed? | 03:25 |
| clarkb | ya | 03:25 |
| clarkb | 1113138 is what it gets each time | 03:25 |
| clarkb | so if the first one fails its likely the others do too | 03:25 |
| clarkb | simply because it never gets more | 03:25 |
| clarkb | so maybe the thing to do for now is have it retry up to ~20 times then give up? that is one minute of stalling | 03:26 |
| clarkb | jhesketh: at least that way we don't wedge a bunch of things on an infinite loop. Then we can work on debugging the looping | 03:26 |
| jhesketh | clarkb: so either it was downloading the same parts each time, or if it was appending it was never reaching the end | 03:27 |
| clarkb | jhesketh: I think the subsequent GETs get no bytes from jenkins and you are just left with what the first one got | 03:28 |
| jhesketh | ah, right | 03:28 |
| clarkb | except that it appears to do real work? | 03:28 |
| jhesketh | and the one that succeeded found the uuid first try | 03:28 |
| clarkb | so maybe it is refetching the entire thing each time | 03:28 |
| clarkb | jhesketh: yup | 03:28 |
| jhesketh | the entire thing is only 80,393 bytes though.. | 03:28 |
| clarkb | prior to the looping? | 03:29 |
| jhesketh | nope, the entire thing (ie https://jenkins01.openstack.org/job/gate-project-config-layout/370/consoleText as it is now) | 03:29 |
| jhesketh | (I guess some of the extra bytes could be headers) | 03:30 |
| clarkb | jhesketh: its 1362779 for me | 03:30 |
| clarkb | I am pretty sure apache isn't doing any caching for us | 03:31 |
| clarkb | though other things could be | 03:31 |
| *** camunoz has quit IRC | 03:32 | |
| clarkb | jhesketh: I think we should likely go with a shortcircuit after X tries for now (seems reasonable to have in general as well) | 03:33 |
| *** mohitsharma has quit IRC | 03:35 | |
| jhesketh | I was relying on the job timeout to catch bad fetches | 03:36 |
| jhesketh | although I agree it is reasonable, it doesn't solve what is wrong | 03:36 |
| jhesketh | but I'm also short on ideas to try | 03:36 |
| fungi | oh, we should see if the truncated logs are all for jobs on workers in one provider | 03:37 |
| jhesketh | fungi: what would that imply? | 03:37 |
| *** mohitsharma has joined #openstack-infra | 03:37 | |
| clarkb | jhesketh: ya I just think that the job timeout could be massive compared to job runtime and we can safely bail out sooner | 03:37 |
| fungi | transparent proxy? oh, though this is https, so no | 03:37 |
| *** teran has quit IRC | 03:38 | |
| clarkb | I think it would have to be jenkins caching | 03:38 |
| clarkb | but it didn't appear to cache when I tried it locally | 03:38 |
| jhesketh | the consoleText maybe, but the progressive log shouldn't (although we didn't get to that) | 03:39 |
| clarkb | jhesketh: the hpcloud bare-precise rebuilds are done if you want to try them | 03:42 |
| clarkb | jhesketh: I deleted all the bare-trusty new images so we should be fine there until they rebuild or we fix it | 03:42 |
| clarkb | I need to pop downstairs for dinner now thouhg | 03:42 |
| clarkb | will check back in after | 03:42 |
| jhesketh | clarkb: as in the precise nodes are built with this change? | 03:43 |
| jhesketh | or rebuilt without it | 03:43 |
| clarkb | built with the looping | 03:44 |
| clarkb | but only on hpcloud | 03:44 |
| jhesketh | right, okay | 03:45 |
| *** mohitsharma has quit IRC | 03:46 | |
| *** mohitsharma has joined #openstack-infra | 03:47 | |
| yamamoto_ | is there a way to merge a patch overriding a jenkins failure? | 03:47 |
| *** camunoz has joined #openstack-infra | 03:47 | |
| *** ayoung is now known as ayoung_ZZzz__ | 03:49 | |
| clarkb | it is possible but only done if it is the only option | 03:49 |
| fungi | yamamoto_: under the right conditions the gerrit admins can step in, but it's generally preferable to find other solutions (squashing mutually dependent changes, disabling broken tests or jobs which aren't slated to get fixed immediately, et cetera) | 03:49 |
| yamamoto_ | as the same thing likely happen again in future i want a solution without involving gerrit admins | 03:51 |
| yamamoto_ | https://review.openstack.org/#/c/150244/ | 03:52 |
| fungi | yamamoto_: please elaborate on the situation | 03:52 |
| yamamoto_ | i'm considering gate-networking-ofagent-python27 job non-voting as it can be api mismatch with neutron | 03:52 |
| yamamoto_ | but not sure where i can write voting: false in layout.yaml | 03:53 |
| fungi | yamamoto_: in the jobs list, you put in the job name or a regex matching the jobs you want to act on | 03:54 |
| yamamoto_ | networking-ofagent is tested with neutron's master. tests will fail whenever neutron changes its api. | 03:54 |
| fungi | it's earlier in the file, before the projects list | 03:54 |
| yamamoto_ | it seems "python-jobs" is somehow shared with other projects | 03:55 |
| clarkb | yamamoto_ a good protection against that is to have tests in neutron that will fail if they change their api | 03:55 |
| fungi | yamamoto_: that definitely sounds like a situation you'll want to discuss with neutron core reviewers to come up with a mutually acceptable way for plugins to test their compliance to the api | 03:55 |
| fungi | and to hold neutron accountable for maintaining api stability where it makes sense | 03:55 |
| yamamoto_ | clarkb: in longer term, sure | 03:56 |
| clarkb | or now | 03:57 |
| *** dannywilson has joined #openstack-infra | 03:57 | |
| clarkb | I dont know why that has to be a long term thing. At the very least it forces more thought into changing apis | 03:57 |
| yamamoto_ | i agree starting a discussion now is good idea. but it would take some time to fix. | 03:58 |
| yamamoto_ | i want a shorter term solution to make a progress. | 04:00 |
| *** dannywilson has quit IRC | 04:01 | |
| *** gokrokve has quit IRC | 04:03 | |
| *** achanda has joined #openstack-infra | 04:05 | |
| clarkb | you can make the job non voting | 04:05 |
| *** spzala has quit IRC | 04:06 | |
| yamamoto_ | how can i mark -python27 job non-voting only for my project? does it require inlining python-jobs? | 04:08 |
| clarkb | no if you look at the jobs list you can spscify exact job names | 04:10 |
| *** Kiall has quit IRC | 04:10 | |
| clarkb | so you can specify the name for your job | 04:11 |
| yamamoto_ | clarkb: i see. where in the list should i put my entry? | 04:11 |
| clarkb | towards the bottom is fine | 04:12 |
| *** camunoz has quit IRC | 04:15 | |
| *** markvoelker has joined #openstack-infra | 04:17 | |
| *** changbl has quit IRC | 04:17 | |
| *** gokrokve has joined #openstack-infra | 04:20 | |
| clarkb | jhesketh were you planning any more patches? | 04:21 |
| jhesketh | clarkb: I have the timeout one, just need to push it up, but I was hoping to find more details on the issue but got distracted sorry | 04:22 |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: layout.yaml: Mark gate-networking-ofagent-python27 non-voting https://review.openstack.org/150254 | 04:22 |
| clarkb | jhesketh no problem just want to make sure I dont miss it | 04:23 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Put in a retry limit for fetching logs https://review.openstack.org/150255 | 04:27 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Put in a retry limit for fetching logs https://review.openstack.org/150255 | 04:27 |
| *** mohitsharma has quit IRC | 04:28 | |
| clarkb | jhesketh: for the rm -f we are running with set -e if rm fails because file doesn't exist that script will stop early right? | 04:31 |
| *** mohitsharma has joined #openstack-infra | 04:31 | |
| clarkb | jhesketh: I think you need [ -f /tmp/console.html ] && rm -f /tmp/console.html | 04:31 |
| jhesketh | clarkb: good catch | 04:32 |
| fungi | clarkb: rm -f doesn't fail when the file doesn't exist does it? | 04:32 |
| jhesketh | fungi: I think it does | 04:32 |
| fungi | manual tests confirm `rm -f foo` when foo dne exits 0 | 04:32 |
| jhesketh | oh, the -f flag makes it exit 0 | 04:33 |
| jhesketh | (without it, it does exit 1) | 04:33 |
| fungi | right | 04:33 |
| clarkb | jhesketh: and I think you have an extra ; after your thens in the next change | 04:33 |
| clarkb | fungi: wait but force means force not pretend I worked | 04:33 |
| clarkb | meh | 04:33 |
| clarkb | I will change my vote | 04:33 |
| fungi | the extra ; may break though | 04:33 |
| *** BharatK has joined #openstack-infra | 04:33 | |
| StevenK | clarkb: Well, force also means "don't care that the file doesn't exist" | 04:34 |
| fungi | -bash: syntax error near unexpected token `;' | 04:34 |
| fungi | so it will need fixing | 04:34 |
| StevenK | Yeah, that one used to trip me up all the time. But I have then on the line before, so why don't I need a ; when I do it as a one-liner ... | 04:35 |
| *** mohitsharma has quit IRC | 04:35 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Put in a retry limit for fetching logs https://review.openstack.org/150255 | 04:35 |
| * jhesketh 's bash foo is weak | 04:35 | |
| clarkb | ok I am +2 on the stack | 04:35 |
| clarkb | jhesketh: should I go ahead and delete the bare-preicse images with the old looping? | 04:36 |
| *** changbl has joined #openstack-infra | 04:37 | |
| fungi | clarkb: if you look at https://review.openstack.org/#/c/150197/1..2/jenkins/scripts/grab_console_log.sh you'll see i asked him to add -f specifically to fix that problem ;) | 04:37 |
| jhesketh | clarkb: which region? | 04:38 |
| clarkb | jhesketh: hpcloud | 04:38 |
| clarkb | jhesketh: not sure if you wanted to test it there first, but the current stack should test it just as well | 04:38 |
| jhesketh | hmm, I'm half waiting to see if another node goes through and works, but it's pot luck at the moment | 04:39 |
| *** teran has joined #openstack-infra | 04:39 | |
| clarkb | jhesketh: ya probably better to just get the current stack in and go with that as it should expose the issues if they exist it will just do so more gracefully | 04:39 |
| jhesketh | oh you rebuild a new node (or revert to the old one without looping) | 04:39 |
| *** packet has quit IRC | 04:39 | |
| clarkb | jhesketh: well I want to revert to the old one without looping tonight so that our old image is a known good | 04:39 |
| *** amotoki has joined #openstack-infra | 04:40 | |
| clarkb | jhesketh: otherwise we may build with new new looping and it still doesn't work then we have two images that don't work | 04:40 |
| clarkb | so just wondering if you need the new looping (current state) for anthing before I go back to no looping | 04:40 |
| jhesketh | clarkb: nope, delete away | 04:41 |
| clarkb | cool thats done | 04:42 |
| jhesketh | clarkb: what time is the rebuild? | 04:42 |
| clarkb | jhesketh: 1400UTC so about 13 hours from now | 04:43 |
| clarkb | jhesketh: looks like your retry limit change hits bashate | 04:43 |
| clarkb | except the bashate error omplains about a thing that isn't a problem | 04:43 |
| *** teran has quit IRC | 04:44 | |
| *** mbacchi has quit IRC | 04:45 | |
| openstackgerrit | Merged openstack-infra/project-config: Remove old log fetches in case of conflict https://review.openstack.org/150197 | 04:45 |
| clarkb | er wait I am bad at maths | 04:46 |
| clarkb | it is almost 500UTC so justover 9 hurs from now | 04:46 |
| openstackgerrit | Jerry Zhao proposed openstack-infra/nodepool: Revert "Pin python-daemon to <2.0" python-daemon 2.0.4 has fixed the setuptool issue. https://groups.google.com/forum/#!topic/comp.lang.python/bIgGrkPYiiM This reverts commit 790b0f30c08c08453aa5931f7ff9371931318150. https://review.openstack.org/150256 | 04:47 |
| *** otter768 has quit IRC | 04:47 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Put in a retry limit for fetching logs https://review.openstack.org/150255 | 04:48 |
| *** alexpilotti has joined #openstack-infra | 04:48 | |
| openstackgerrit | Jerry Zhao proposed openstack-infra/nodepool: Revert "Pin python-daemon to <2.0" https://review.openstack.org/150256 | 04:48 |
| *** camunoz has joined #openstack-infra | 04:48 | |
| *** mtanino has quit IRC | 04:48 | |
| *** bhunter71 has quit IRC | 04:48 | |
| *** changbl has quit IRC | 04:49 | |
| *** otter768 has joined #openstack-infra | 04:49 | |
| *** unicell has quit IRC | 04:50 | |
| clarkb | fungi: ^ if you are still around 150255 should be bashate happy now with a slight change | 04:50 |
| openstackgerrit | Jerry Zhao proposed openstack-infra/gear: Revert "Pin python-daemon to <2.0" https://review.openstack.org/150257 | 04:52 |
| fungi | approved | 04:53 |
| clarkb | fungi: oh I just approved it :) double the approval | 04:54 |
| clarkb | jerryz: please see my comments on those changes | 04:54 |
| fungi | jerryz: thanks for those. i think zuul needs one too if you haven't already done that. was on my to do list for this week to test | 04:54 |
| clarkb | fungi: jerryz: we just need to get the requirement line right | 04:54 |
| jerryz | clarkb, fungi: got it. | 04:54 |
| clarkb | fungi: grim fandango remastered becomes a thing tomorrow | 04:55 |
| fungi | and i agree with clarkb, it should be python-daemon!=2.0,!=2.0.1,!=2.0.2,!=2.0.3 i think (based on the releases i see on pypi) | 04:56 |
| fungi | jerryz: ^ | 04:56 |
| *** ChuckC_ is now known as ChuckC | 04:56 | |
| StevenK | Surely it could be <2.0,>=2.0.4 ? | 04:56 |
| fungi | StevenK: that is a nonsense string for pep 440 | 04:56 |
| clarkb | StevenK: nope the , is a logical AND | 04:57 |
| fungi | StevenK: how can a version be both <2.0 _and_ >=2.0.4? | 04:57 |
| StevenK | Bah, we can't have nice things | 04:57 |
| openstackgerrit | Merged openstack-infra/project-config: Put in a retry limit for fetching logs https://review.openstack.org/150255 | 04:58 |
| clarkb | ok new images building now | 04:58 |
| *** otter768 has quit IRC | 04:59 | |
| jhesketh | shiny | 04:59 |
| *** esker has joined #openstack-infra | 05:03 | |
| *** achanda has quit IRC | 05:03 | |
| openstackgerrit | Craig Bryant proposed openstack-infra/project-config: Add maven build and repo upload for monasca-persister https://review.openstack.org/150259 | 05:06 |
| *** markvoelker has quit IRC | 05:09 | |
| *** achanda has joined #openstack-infra | 05:09 | |
| *** garyh has quit IRC | 05:09 | |
| *** markvoelker has joined #openstack-infra | 05:10 | |
| *** harlowja is now known as harlowja_away | 05:10 | |
| *** achanda has quit IRC | 05:13 | |
| *** markvoelker has quit IRC | 05:14 | |
| *** harlowja_at_home has joined #openstack-infra | 05:15 | |
| *** salv-orl_ has quit IRC | 05:16 | |
| openstackgerrit | Jerry Zhao proposed openstack-infra/nodepool: Revert "Pin python-daemon to <2.0" https://review.openstack.org/150256 | 05:17 |
| openstackgerrit | Jerry Zhao proposed openstack-infra/gear: Revert "Pin python-daemon to <2.0" https://review.openstack.org/150257 | 05:22 |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: Use a canonical way to specify python https://review.openstack.org/150262 | 05:22 |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: check_valid_gerrit_config: Portability improvements https://review.openstack.org/150263 | 05:22 |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: check_projects_yaml_alphabetized: Portability improvements https://review.openstack.org/150264 | 05:22 |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: run-layout: Portability improvements https://review.openstack.org/150265 | 05:22 |
| *** unicell has joined #openstack-infra | 05:26 | |
| clarkb | jhesketh: bare-trusty is snapshotting across the board should have new images useable shortly | 05:29 |
| jhesketh | cool | 05:29 |
| openstackgerrit | Jerry Zhao proposed openstack-infra/zuul: Revert "Pin python-daemon<2.0" https://review.openstack.org/150268 | 05:32 |
| *** yfried_ has quit IRC | 05:34 | |
| clarkb | jhesketh: only two more snapshots to go | 05:34 |
| clarkb | yamamoto_: any chance you can explain those portability improvements in the commit messages? or somewhere so that reviewers don't have to hunt that down? | 05:35 |
| *** mohitsharma has joined #openstack-infra | 05:35 | |
| clarkb | jhesketh: and all done now | 05:36 |
| jhesketh | thanks | 05:36 |
| *** ildikov has quit IRC | 05:36 | |
| *** markvoelker has joined #openstack-infra | 05:37 | |
| *** markvoelker has quit IRC | 05:38 | |
| *** markvoelker has joined #openstack-infra | 05:38 | |
| *** teran has joined #openstack-infra | 05:40 | |
| *** garyh has joined #openstack-infra | 05:40 | |
| *** mohitsharma has quit IRC | 05:40 | |
| *** dims has joined #openstack-infra | 05:41 | |
| *** mrmartin has joined #openstack-infra | 05:42 | |
| clarkb | jhesketh: https://jenkins05.openstack.org/job/gate-infra-puppet-apply-trusty/35/console :/ | 05:42 |
| clarkb | if then fi | 05:43 |
| clarkb | clearly it is too late in the evening for me and fungi to code review | 05:43 |
| *** markvoelker has quit IRC | 05:43 | |
| clarkb | jhesketh: if you push that fix up real quick I can approve | 05:43 |
| *** baoli has quit IRC | 05:44 | |
| *** teran has quit IRC | 05:45 | |
| *** signed8bit has quit IRC | 05:45 | |
| *** baoli has joined #openstack-infra | 05:45 | |
| BharatK | Hi All, | 05:46 |
| BharatK | https://review.openstack.org/#/c/143308/ | 05:46 |
| openstackgerrit | Nastya Urlapova proposed openstack-infra/project-config: Fuel-qa repo for Fuel https://review.openstack.org/150271 | 05:46 |
| jhesketh | clarkb: woops | 05:46 |
| clarkb | BharatK: at the very least we should not be using github | 05:47 |
| BharatK | I am waiting for this patch. Please anyone review this patch. And let me know your comments. | 05:47 |
| clarkb | BharatK: but I haev a hunch that sdague will want this to just be appended into the localrc rather than having specific paths for it in devstack-gate | 05:47 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: Fix bash if exit https://review.openstack.org/150272 | 05:47 |
| jhesketh | clarkb: you may have to force push that through | 05:48 |
| jhesketh | clarkb: in the mean time it's probably a good move to delete the images | 05:48 |
| jhesketh | sorry :-s | 05:48 |
| clarkb | jhesketh: no problem I reviewed that change to :) | 05:48 |
| BharatK | clarkb, Yes I modified url to stackforge repository in https://review.openstack.org/#/c/143308/6/devstack-vm-gate.sh | 05:48 |
| *** baoli has quit IRC | 05:49 | |
| *** dims has quit IRC | 05:49 | |
| clarkb | jhesketh: ok new images are gone now | 05:50 |
| clarkb | BharatK: that uses github | 05:50 |
| *** dims has joined #openstack-infra | 05:50 | |
| BharatK | clarkb, But as per Sean's patch https://review.openstack.org/#/c/142805/ there we need to use github URL onli right? | 05:51 |
| *** dims has quit IRC | 05:52 | |
| *** dims has joined #openstack-infra | 05:52 | |
| clarkb | BharatK: can you point where sdague says that? | 05:52 |
| BharatK | clarkb, https://review.openstack.org/#/c/142805/7/doc/source/plugins.rst Line number 132 | 05:53 |
| *** yamahata has joined #openstack-infra | 05:54 | |
| clarkb | BharatK: I left a comment on your change | 05:54 |
| clarkb | BharatK: that is just an example | 05:54 |
| BharatK | clarkb, Okay thank you will see. | 05:55 |
| *** mrmartin has quit IRC | 05:56 | |
| *** talluri has joined #openstack-infra | 05:58 | |
| clarkb | jhesketh: I am going to call it a day once I get that change in (its currently failing on older nodes with the bad if statements) | 05:59 |
| *** talluri has quit IRC | 06:00 | |
| *** talluri has joined #openstack-infra | 06:00 | |
| *** markmcclain has joined #openstack-infra | 06:01 | |
| openstackgerrit | Merged openstack-dev/hacking: Updated from global requirements https://review.openstack.org/150204 | 06:02 |
| jhesketh | clarkb: sounds good | 06:02 |
| jhesketh | clarkb: It's possibly a trivial enough change to just submit, but clearly that's not my call | 06:02 |
| clarkb | jhesketh: it is, I figure I should get it through properly since I think it will go through now | 06:03 |
| *** achanda has joined #openstack-infra | 06:03 | |
| jhesketh | fair enough | 06:03 |
| clarkb | jhesketh: the second half of tests passed during the last run | 06:03 |
| clarkb | which makes me think new nodes are good now | 06:03 |
| *** harlowja_at_home has quit IRC | 06:03 | |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: check_projects_yaml_alphabetized: Portability improvements https://review.openstack.org/150264 | 06:04 |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: run-layout: Portability improvements https://review.openstack.org/150265 | 06:04 |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: Use a canonical way to specify python https://review.openstack.org/150262 | 06:04 |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: check_valid_gerrit_config: Portability improvements https://review.openstack.org/150263 | 06:04 |
| *** liusheng has quit IRC | 06:04 | |
| *** liusheng has joined #openstack-infra | 06:04 | |
| yamamoto_ | clarkb: done | 06:04 |
| clarkb | yamamoto_: thank you. | 06:04 |
| *** gokrokve_ has joined #openstack-infra | 06:05 | |
| clarkb | yamamoto_: fwiw I believe there is a preference for bash in some circles because bash is always bash but sh may be dash or ash or real sh or bash or whatever shell you symlinked today | 06:05 |
| yamamoto_ | clarkb: apparently i'm not in the circle :-) | 06:07 |
| *** gokrokve has quit IRC | 06:08 | |
| openstackgerrit | Joe Gordon proposed openstack-infra/elastic-recheck: Add placeholder query to classify flake8 failures in the gate https://review.openstack.org/150277 | 06:10 |
| *** gokrokve_ has quit IRC | 06:10 | |
| clarkb | jogo: what expected issues? | 06:10 |
| *** salv-orlando has joined #openstack-infra | 06:11 | |
| *** oomichi has quit IRC | 06:13 | |
| *** abhirc has quit IRC | 06:14 | |
| openstackgerrit | Merged openstack-infra/project-config: Fix bash if exit https://review.openstack.org/150272 | 06:14 |
| clarkb | jhesketh: ^ and with that I am off good night | 06:14 |
| jhesketh | clarkb: thanks :-) | 06:15 |
| *** ildikov has joined #openstack-infra | 06:15 | |
| *** Ryan_Lane has joined #openstack-infra | 06:16 | |
| *** teran has joined #openstack-infra | 06:19 | |
| *** jyuso has quit IRC | 06:19 | |
| *** dims has quit IRC | 06:23 | |
| *** woodster_ has quit IRC | 06:23 | |
| *** liusheng has quit IRC | 06:24 | |
| *** liusheng has joined #openstack-infra | 06:25 | |
| *** dims has joined #openstack-infra | 06:26 | |
| *** pcrews has quit IRC | 06:27 | |
| *** vigneshvar has joined #openstack-infra | 06:27 | |
| openstackgerrit | Merged openstack-infra/project-config: layout.yaml: Mark gate-networking-ofagent-python27 non-voting https://review.openstack.org/150254 | 06:27 |
| *** dims has quit IRC | 06:30 | |
| *** markvoelker has joined #openstack-infra | 06:31 | |
| *** markvoelker has quit IRC | 06:36 | |
| *** shashankhegde has joined #openstack-infra | 06:36 | |
| *** gokrokve has joined #openstack-infra | 06:37 | |
| *** gokrokve has quit IRC | 06:39 | |
| *** gokrokve has joined #openstack-infra | 06:39 | |
| *** mohitsharma has joined #openstack-infra | 06:41 | |
| *** zz_avozza is now known as avozza | 06:41 | |
| *** gokrokve has quit IRC | 06:44 | |
| *** mrunge has joined #openstack-infra | 06:44 | |
| jogo | clarkb: if a new rule is added previous flake8 runs may not catch something | 06:46 |
| jogo | clarkb: and rebase related issues | 06:46 |
| jogo | clarkb: 'stale' check jobs etc. | 06:46 |
| *** shashankhegde has quit IRC | 06:49 | |
| *** mohitsharma has quit IRC | 06:52 | |
| tchaypo | Do you guys look after uvirtbot? | 06:52 |
| *** spandhe has joined #openstack-infra | 06:53 | |
| *** avozza is now known as zz_avozza | 06:58 | |
| *** markvoelker has joined #openstack-infra | 06:58 | |
| *** otter768 has joined #openstack-infra | 07:00 | |
| *** markmcclain has quit IRC | 07:01 | |
| *** yfried_ has joined #openstack-infra | 07:03 | |
| *** markvoelker has quit IRC | 07:04 | |
| *** otter768 has quit IRC | 07:04 | |
| *** yfried_ has quit IRC | 07:07 | |
| *** yfried_ has joined #openstack-infra | 07:07 | |
| *** yfried_ is now known as yfried|afk | 07:08 | |
| *** hdd has quit IRC | 07:09 | |
| *** mohitsharma has joined #openstack-infra | 07:11 | |
| *** mohitsharma has quit IRC | 07:12 | |
| *** yfried|afk is now known as yfried_ | 07:12 | |
| BharatK | ping clarkb | 07:15 |
| *** talluri has quit IRC | 07:15 | |
| *** salv-orlando has quit IRC | 07:16 | |
| *** zz_avozza is now known as avozza | 07:17 | |
| *** scheuran has joined #openstack-infra | 07:18 | |
| *** mohitsharma has joined #openstack-infra | 07:23 | |
| *** esker has quit IRC | 07:24 | |
| *** belmoreira has joined #openstack-infra | 07:24 | |
| *** greghaynes has quit IRC | 07:24 | |
| *** greghaynes has joined #openstack-infra | 07:26 | |
| openstackgerrit | Bharat Kumar Kobagana proposed openstack-infra/devstack-gate: Allow GlusterFS backend for cinder https://review.openstack.org/143308 | 07:26 |
| *** dims has joined #openstack-infra | 07:27 | |
| *** jamielennox is now known as jamielennox|away | 07:29 | |
| *** _nadya_ has joined #openstack-infra | 07:31 | |
| *** tsg has quit IRC | 07:31 | |
| *** dims has quit IRC | 07:31 | |
| *** _nadya_ has quit IRC | 07:34 | |
| *** stevemar has quit IRC | 07:35 | |
| *** praveenkumar has quit IRC | 07:37 | |
| *** gokrokve has joined #openstack-infra | 07:37 | |
| *** tkelsey has joined #openstack-infra | 07:38 | |
| *** gokrokve has quit IRC | 07:42 | |
| *** _nadya_ has joined #openstack-infra | 07:42 | |
| *** mrmartin has joined #openstack-infra | 07:44 | |
| *** elliottk has quit IRC | 07:48 | |
| *** avozza is now known as zz_avozza | 07:49 | |
| *** waynr has quit IRC | 07:50 | |
| *** berendt has joined #openstack-infra | 07:51 | |
| *** e0ne has joined #openstack-infra | 07:55 | |
| *** belmoreira has quit IRC | 07:55 | |
| anteaya | tchaypo: we don't yet, we are working on doing so | 07:57 |
| *** _nadya_ has quit IRC | 07:58 | |
| *** _nadya_ has joined #openstack-infra | 07:58 | |
| tchaypo | anteaya: morning! | 07:59 |
| *** jyuso1 has joined #openstack-infra | 07:59 | |
| *** markvoelker has joined #openstack-infra | 08:00 | |
| *** HeOS has quit IRC | 08:00 | |
| anteaya | tchaypo: somethign like that | 08:00 |
| *** MaxV has joined #openstack-infra | 08:02 | |
| *** liusheng has quit IRC | 08:02 | |
| *** belmoreira has joined #openstack-infra | 08:03 | |
| *** liusheng has joined #openstack-infra | 08:03 | |
| *** markvoelker has quit IRC | 08:04 | |
| *** _nadya_ has quit IRC | 08:04 | |
| *** MaxV has quit IRC | 08:06 | |
| *** yamahata has quit IRC | 08:08 | |
| *** MaxV has joined #openstack-infra | 08:08 | |
| *** harlowja_away has quit IRC | 08:08 | |
| *** MaxV has quit IRC | 08:10 | |
| *** gema has joined #openstack-infra | 08:11 | |
| *** arxcruz has joined #openstack-infra | 08:14 | |
| *** arxcruz has quit IRC | 08:14 | |
| *** arxcruz has joined #openstack-infra | 08:15 | |
| *** waynr has joined #openstack-infra | 08:16 | |
| *** salv-orlando has joined #openstack-infra | 08:17 | |
| *** matrohon has joined #openstack-infra | 08:18 | |
| *** oomichi has joined #openstack-infra | 08:20 | |
| *** Ryan_Lane has quit IRC | 08:22 | |
| *** _nadya_ has joined #openstack-infra | 08:23 | |
| *** dims has joined #openstack-infra | 08:28 | |
| *** _nadya_ has quit IRC | 08:28 | |
| *** dtantsur|afk is now known as dtantsur | 08:29 | |
| *** markus_z has joined #openstack-infra | 08:29 | |
| *** achanda has quit IRC | 08:32 | |
| *** dims has quit IRC | 08:32 | |
| *** alexpilotti has quit IRC | 08:33 | |
| *** jgallard_ has joined #openstack-infra | 08:34 | |
| *** achuprin_ has quit IRC | 08:34 | |
| *** gokrokve has joined #openstack-infra | 08:37 | |
| *** MaxV has joined #openstack-infra | 08:40 | |
| *** gokrokve has quit IRC | 08:42 | |
| *** teran has quit IRC | 08:45 | |
| *** jp_at_hp has joined #openstack-infra | 08:45 | |
| *** achuprin_ has joined #openstack-infra | 08:47 | |
| *** jcoufal has joined #openstack-infra | 08:48 | |
| *** jlibosva has joined #openstack-infra | 08:49 | |
| *** achanda has joined #openstack-infra | 08:51 | |
| *** doude_ has joined #openstack-infra | 08:52 | |
| *** doude_ has quit IRC | 08:52 | |
| *** doude has quit IRC | 08:52 | |
| *** doude has joined #openstack-infra | 08:53 | |
| *** talluri has joined #openstack-infra | 08:56 | |
| *** jpich has joined #openstack-infra | 08:57 | |
| *** Guest28610 has joined #openstack-infra | 09:00 | |
| *** markvoelker has joined #openstack-infra | 09:00 | |
| *** otter768 has joined #openstack-infra | 09:01 | |
| *** markvoelker has quit IRC | 09:05 | |
| *** otter768 has quit IRC | 09:05 | |
| *** dhritishikhar has joined #openstack-infra | 09:07 | |
| *** jistr has joined #openstack-infra | 09:08 | |
| *** e0ne has quit IRC | 09:13 | |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Add Parameterized Remote Trigger Plugin support. https://review.openstack.org/150327 | 09:15 |
| *** fandi has quit IRC | 09:15 | |
| *** mohitsharma has quit IRC | 09:15 | |
| *** zz_avozza is now known as avozza | 09:15 | |
| *** mohitsharma has joined #openstack-infra | 09:18 | |
| openstackgerrit | James Polley proposed openstack-infra/reviewstats: Add tchaypo as core https://review.openstack.org/150332 | 09:19 |
| *** talluri has quit IRC | 09:19 | |
| *** yamamoto_ has quit IRC | 09:20 | |
| *** teran has joined #openstack-infra | 09:23 | |
| *** talluri has joined #openstack-infra | 09:23 | |
| *** andreykurilin_ has joined #openstack-infra | 09:23 | |
| *** derekh has joined #openstack-infra | 09:23 | |
| *** achanda has quit IRC | 09:24 | |
| *** HeOS has joined #openstack-infra | 09:25 | |
| *** tnurlygayanov has joined #openstack-infra | 09:25 | |
| *** teran_ has joined #openstack-infra | 09:26 | |
| *** fandi has joined #openstack-infra | 09:27 | |
| *** fandi has quit IRC | 09:27 | |
| *** teran has quit IRC | 09:28 | |
| *** ihrachyshka has joined #openstack-infra | 09:30 | |
| *** jedimike has joined #openstack-infra | 09:30 | |
| *** achanda has joined #openstack-infra | 09:30 | |
| *** achanda has quit IRC | 09:31 | |
| *** dizquierdo has joined #openstack-infra | 09:34 | |
| *** zhiwei has quit IRC | 09:36 | |
| *** ssam2 has joined #openstack-infra | 09:37 | |
| *** gokrokve has joined #openstack-infra | 09:37 | |
| *** zhiwei has joined #openstack-infra | 09:37 | |
| *** pelix has joined #openstack-infra | 09:39 | |
| *** gokrokve_ has joined #openstack-infra | 09:39 | |
| *** Ala has joined #openstack-infra | 09:39 | |
| *** gokrokve has quit IRC | 09:41 | |
| *** gokrokve_ has quit IRC | 09:44 | |
| *** che-arne|2 has joined #openstack-infra | 09:46 | |
| *** che-arne|2 has quit IRC | 09:47 | |
| *** che-arne has quit IRC | 09:47 | |
| *** ZZelle has quit IRC | 09:50 | |
| *** yamamoto has joined #openstack-infra | 09:50 | |
| *** kaisers has quit IRC | 09:51 | |
| *** hichihara has quit IRC | 09:57 | |
| *** avozza is now known as zz_avozza | 09:57 | |
| *** zz_avozza is now known as avozza | 09:57 | |
| *** markvoelker has joined #openstack-infra | 10:01 | |
| *** salv-orlando has quit IRC | 10:02 | |
| *** salv-orlando has joined #openstack-infra | 10:02 | |
| *** yamamoto has quit IRC | 10:05 | |
| *** spandhe has quit IRC | 10:05 | |
| *** zhiwei has quit IRC | 10:07 | |
| *** markvoelker has quit IRC | 10:07 | |
| *** mohitsharma has quit IRC | 10:14 | |
| *** fev3r101 has joined #openstack-infra | 10:15 | |
| *** dims has joined #openstack-infra | 10:16 | |
| *** mohitsharma has joined #openstack-infra | 10:17 | |
| *** dims has quit IRC | 10:21 | |
| *** matrohon has quit IRC | 10:25 | |
| *** derekh has quit IRC | 10:26 | |
| *** derekh has joined #openstack-infra | 10:27 | |
| *** yfried_ is now known as yfried|afk | 10:35 | |
| *** tkelsey has quit IRC | 10:35 | |
| *** mohitsharma has quit IRC | 10:35 | |
| *** gokrokve has joined #openstack-infra | 10:37 | |
| *** ldnunes has joined #openstack-infra | 10:39 | |
| *** _nadya_ has joined #openstack-infra | 10:40 | |
| *** gokrokve has quit IRC | 10:42 | |
| *** e0ne has joined #openstack-infra | 10:47 | |
| *** andreykurilin_ has quit IRC | 10:51 | |
| *** andreykurilin_ has joined #openstack-infra | 10:51 | |
| *** yfried|afk is now known as yfried_ | 10:56 | |
| *** rlandy has joined #openstack-infra | 10:59 | |
| *** otter768 has joined #openstack-infra | 11:01 | |
| *** avozza is now known as zz_avozza | 11:05 | |
| *** zz_avozza is now known as avozza | 11:05 | |
| *** otter768 has quit IRC | 11:06 | |
| *** e0ne is now known as e0ne_ | 11:08 | |
| *** e0ne_ is now known as e0ne | 11:09 | |
| *** jgallard_ has quit IRC | 11:09 | |
| *** jgallard_ has joined #openstack-infra | 11:09 | |
| *** fev3r101 has quit IRC | 11:10 | |
| *** rfolco has joined #openstack-infra | 11:10 | |
| *** jgallard_ has quit IRC | 11:16 | |
| *** btran has quit IRC | 11:17 | |
| *** aysyd has joined #openstack-infra | 11:30 | |
| *** pblaho has joined #openstack-infra | 11:31 | |
| *** akurenyshev has quit IRC | 11:32 | |
| *** andreykurilin_ has quit IRC | 11:35 | |
| *** skolekonov has joined #openstack-infra | 11:36 | |
| *** gokrokve has joined #openstack-infra | 11:37 | |
| *** cdent has joined #openstack-infra | 11:39 | |
| *** zhiwei has joined #openstack-infra | 11:42 | |
| *** gokrokve has quit IRC | 11:43 | |
| *** adalbas has joined #openstack-infra | 11:45 | |
| *** mrmartin has quit IRC | 11:53 | |
| *** dtantsur is now known as dtantsur|lunch | 11:56 | |
| openstackgerrit | Nastya Urlapova proposed openstack-infra/project-config: Fuel-qa repo for Fuel https://review.openstack.org/150271 | 11:59 |
| *** _nadya_ has quit IRC | 12:00 | |
| *** aysyd has quit IRC | 12:01 | |
| *** markvoelker has joined #openstack-infra | 12:04 | |
| *** markvoelker has quit IRC | 12:09 | |
| *** e0ne is now known as e0ne_ | 12:10 | |
| openstackgerrit | Paul Michali proposed openstack-infra/project-config: Enable functional test job in openstack ci for neutron-vpnaas https://review.openstack.org/148616 | 12:10 |
| *** pc_m has joined #openstack-infra | 12:10 | |
| *** mrmartin has joined #openstack-infra | 12:12 | |
| *** e0ne_ is now known as e0ne | 12:13 | |
| *** mase_x200 has joined #openstack-infra | 12:16 | |
| *** mase_x200 has quit IRC | 12:19 | |
| openstackgerrit | Nikita Konovalov proposed openstack-infra/storyboard-webclient: Cleanup for POST and PUT requests https://review.openstack.org/150389 | 12:24 |
| *** mase_x200 has joined #openstack-infra | 12:24 | |
| *** Kiall has joined #openstack-infra | 12:25 | |
| *** amotoki has quit IRC | 12:30 | |
| *** amotoki has joined #openstack-infra | 12:31 | |
| *** woodster_ has joined #openstack-infra | 12:31 | |
| *** e0ne is now known as e0ne_ | 12:31 | |
| *** achanda has joined #openstack-infra | 12:32 | |
| *** e0ne_ is now known as e0ne | 12:34 | |
| *** amotoki has quit IRC | 12:35 | |
| *** achanda has quit IRC | 12:36 | |
| *** jp_at_hp has quit IRC | 12:36 | |
| *** amotoki has joined #openstack-infra | 12:37 | |
| *** gokrokve has joined #openstack-infra | 12:37 | |
| *** Guest28610 has quit IRC | 12:39 | |
| *** weshay has joined #openstack-infra | 12:41 | |
| *** gokrokve has quit IRC | 12:42 | |
| *** baoli has joined #openstack-infra | 12:43 | |
| *** Guest28610 has joined #openstack-infra | 12:43 | |
| *** baoli has quit IRC | 12:47 | |
| *** baoli has joined #openstack-infra | 12:47 | |
| *** talluri has quit IRC | 12:48 | |
| *** _nadya_ has joined #openstack-infra | 12:49 | |
| *** nuritv has quit IRC | 13:00 | |
| *** Guest28610 has quit IRC | 13:02 | |
| *** otter768 has joined #openstack-infra | 13:02 | |
| *** che-arne has joined #openstack-infra | 13:03 | |
| *** markvoelker has joined #openstack-infra | 13:05 | |
| openstackgerrit | Filip Blaha proposed openstack-infra/project-config: Functional tests job for policy enforcement https://review.openstack.org/150401 | 13:05 |
| *** doug-fish has joined #openstack-infra | 13:05 | |
| *** nuritv has joined #openstack-infra | 13:06 | |
| *** otter768 has quit IRC | 13:07 | |
| *** ddieterly has joined #openstack-infra | 13:07 | |
| *** dtantsur|lunch is now known as dtantsur | 13:10 | |
| *** markvoelker has quit IRC | 13:10 | |
| *** tkelsey has joined #openstack-infra | 13:13 | |
| *** Guest28610 has joined #openstack-infra | 13:20 | |
| *** mescanef has joined #openstack-infra | 13:22 | |
| *** mjturek has joined #openstack-infra | 13:23 | |
| *** markvoelker has joined #openstack-infra | 13:25 | |
| *** Longgeek has joined #openstack-infra | 13:26 | |
| *** jp_at_hp has joined #openstack-infra | 13:30 | |
| *** zhiwei has quit IRC | 13:31 | |
| *** alexpilotti has joined #openstack-infra | 13:33 | |
| *** dprince has joined #openstack-infra | 13:34 | |
| *** teran_ has quit IRC | 13:35 | |
| *** mohitsharma has joined #openstack-infra | 13:36 | |
| *** dhritishikhar has quit IRC | 13:37 | |
| openstackgerrit | Nikita Konovalov proposed openstack-infra/python-storyboardclient: Adding pretty-tox https://review.openstack.org/150417 | 13:37 |
| *** gokrokve has joined #openstack-infra | 13:37 | |
| *** teran has joined #openstack-infra | 13:38 | |
| *** vigneshvar has quit IRC | 13:38 | |
| *** oomichi has quit IRC | 13:40 | |
| *** doude has quit IRC | 13:41 | |
| *** mohitsharma has quit IRC | 13:41 | |
| *** doude has joined #openstack-infra | 13:41 | |
| *** gokrokve has quit IRC | 13:42 | |
| *** bknudson has joined #openstack-infra | 13:42 | |
| *** mjturek has quit IRC | 13:44 | |
| *** tsg has joined #openstack-infra | 13:46 | |
| *** gokrokve has joined #openstack-infra | 13:47 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: Fix use of actual vs. expected https://review.openstack.org/150419 | 13:47 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: ignore release-tag-* temporary directories https://review.openstack.org/150420 | 13:47 |
| *** mjturek has joined #openstack-infra | 13:50 | |
| *** bhunter71 has joined #openstack-infra | 13:51 | |
| *** gokrokve has quit IRC | 13:51 | |
| *** sandywalsh has joined #openstack-infra | 13:53 | |
| *** mbacchi has joined #openstack-infra | 13:54 | |
| *** markvoelker has quit IRC | 13:54 | |
| *** emagana has joined #openstack-infra | 13:54 | |
| *** Sukhdev has joined #openstack-infra | 13:55 | |
| *** radez_g0n3 is now known as radez | 13:59 | |
| *** changbl has joined #openstack-infra | 14:01 | |
| *** yamahata has joined #openstack-infra | 14:03 | |
| *** mase_x200 has quit IRC | 14:03 | |
| *** dkliban_afk is now known as dkliban | 14:04 | |
| *** maxbit has joined #openstack-infra | 14:06 | |
| *** maxbit_ has joined #openstack-infra | 14:08 | |
| *** maxbit has quit IRC | 14:12 | |
| *** mattfarina has joined #openstack-infra | 14:13 | |
| *** mjturek has quit IRC | 14:15 | |
| *** dustins has joined #openstack-infra | 14:16 | |
| *** maxbit_ has quit IRC | 14:17 | |
| *** ddieterly has quit IRC | 14:17 | |
| *** mescanef has quit IRC | 14:18 | |
| *** mjturek has joined #openstack-infra | 14:19 | |
| *** BobBall_AWOL is now known as BobBall | 14:22 | |
| *** salv-orlando has quit IRC | 14:23 | |
| *** salv-orlando has joined #openstack-infra | 14:23 | |
| *** Longgeek has quit IRC | 14:23 | |
| *** pcrews has joined #openstack-infra | 14:24 | |
| *** spzala has joined #openstack-infra | 14:27 | |
| openstackgerrit | Igor Belikov proposed openstack-infra/jenkins-job-builder: Add 'Enable condition' support to MultiJob builder https://review.openstack.org/150430 | 14:28 |
| *** amitgandhinz has joined #openstack-infra | 14:28 | |
| openstackgerrit | Nastya Urlapova proposed openstack-infra/project-config: Fuel-qa repo for Fuel https://review.openstack.org/150271 | 14:29 |
| ttx | yay, yaml2ical 0.1.0 is out. Now on to pairing it with openstack-meetings | 14:32 |
| anteaya | ttx \o/ | 14:32 |
| openstackgerrit | Nastya Urlapova proposed openstack-infra/project-config: Fuel-qa repo for Fuel https://review.openstack.org/150271 | 14:32 |
| *** dims has joined #openstack-infra | 14:33 | |
| *** markvoelker has joined #openstack-infra | 14:36 | |
| *** gokrokve has joined #openstack-infra | 14:37 | |
| *** yamahata has quit IRC | 14:39 | |
| openstackgerrit | Eran Gampel proposed openstack-infra/project-config: Register DragonFlow projcet for stackforge to the CI System https://review.openstack.org/150437 | 14:39 |
| *** signed8bit has joined #openstack-infra | 14:39 | |
| *** gokrokve has quit IRC | 14:42 | |
| *** denis_makogon has joined #openstack-infra | 14:42 | |
| ttx | anteaya: offline travel is actually a great way to make progress on those. I should do that more often | 14:43 |
| *** gokrokve has joined #openstack-infra | 14:48 | |
| *** maxbit has joined #openstack-infra | 14:48 | |
| *** david-lyle_afk is now known as david-lyle | 14:49 | |
| fungi | dhellmann: what are your feelings regarding dropping python 3.3 jobs for oslo.messaging and oslo.rootwrap given the discussion with barry and doko it tabled for a month while we wait for 3.4.3 to be released? | 14:50 |
| fungi | er, is tabled | 14:51 |
| *** gokrokve_ has joined #openstack-infra | 14:51 | |
| anteaya | ttx :D | 14:51 |
| *** maxbit_ has joined #openstack-infra | 14:51 | |
| *** r-daneel has joined #openstack-infra | 14:52 | |
| *** dguitarbite has joined #openstack-infra | 14:52 | |
| dguitarbite | fungi: ping, need to branch training guides | 14:52 |
| fungi | dguitarbite: howdy. you seemed to have logged off or something yesterday by the time i was awake | 14:53 |
| *** gokrokve has quit IRC | 14:53 | |
| *** dimtruck is now known as zz_dimtruck | 14:54 | |
| *** abhirc has joined #openstack-infra | 14:54 | |
| fungi | dguitarbite: project is presumably openstack/training-guides but what branch name do you want and from what ref do you want it branched (tip of master, some other specific commit)? | 14:54 |
| *** maxbit has quit IRC | 14:54 | |
| dguitarbite | fungi: yes its openstack/training-guides | 14:55 |
| dguitarbite | let me give you the commit it | 14:55 |
| *** jcoufal_ has joined #openstack-infra | 14:55 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:57 | |
| *** jcoufal has quit IRC | 14:58 | |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/storyboard: Added branches to storyboard https://review.openstack.org/150447 | 14:58 |
| *** dhritishikhar has joined #openstack-infra | 14:59 | |
| anteaya | fungi was the uvirtbot discussion yesterday because uvirtbot is having issues? | 15:00 |
| fungi | anteaya: yes, it's offline and soren had commented to someone that he'd rather not have to maintain it or something, so morganfainberg has a change up to load the same plugin in our openstack meetbot | 15:01 |
| openstackgerrit | Aleksey Ripinen proposed openstack-infra/storyboard: Added branches to storyboard https://review.openstack.org/150447 | 15:01 |
| anteaya | fungi: awesome thank you | 15:01 |
| fungi | just the responding to bug comments in channel with urls part, not the announcing new bug reports part (the latter seemed not really used by our community and requires a lot of extra setup) | 15:01 |
| *** tsg_ has joined #openstack-infra | 15:03 | |
| anteaya | yeah, agreed | 15:03 |
| *** adreznec has joined #openstack-infra | 15:03 | |
| *** markvoelker has quit IRC | 15:03 | |
| anteaya | just keep what we had | 15:03 |
| dguitarbite | fungi: This is the commit id (HEAD) 83ae4f8 from where the openstack/training-guides project needs to be branched | 15:03 |
| *** teran_ has joined #openstack-infra | 15:03 | |
| *** markvoelker has joined #openstack-infra | 15:03 | |
| *** BharatK has quit IRC | 15:03 | |
| *** otter768 has joined #openstack-infra | 15:03 | |
| dguitarbite | fungi: it is the Icehouse release for openstack/training-guides | 15:04 |
| fungi | dguitarbite: and what branch name do you want started at that ref? stable/icehouse? | 15:04 |
| *** rwsu-afk has quit IRC | 15:04 | |
| dguitarbite | fungi, yes stable/icehouse would be good. | 15:04 |
| fungi | dguitarbite: done | 15:04 |
| dguitarbite | fungi: thanks :) | 15:04 |
| *** teran_ has quit IRC | 15:05 | |
| fungi | you bet | 15:05 |
| *** teran_ has joined #openstack-infra | 15:05 | |
| dguitarbite | Am I correct in assuming that the branch will instantly appear in the git repository? | 15:05 |
| fungi | dguitarbite: you tell me https://git.openstack.org/cgit/openstack/training-guides ;) | 15:06 |
| dguitarbite | ohh, I see it... thanks :) | 15:06 |
| fungi | my pleasure--any time | 15:06 |
| *** teran has quit IRC | 15:06 | |
| *** tsg has quit IRC | 15:06 | |
| *** dmsimard_away is now known as dmsimard | 15:06 | |
| *** amitgandhinz has quit IRC | 15:06 | |
| *** ayoung_ZZzz__ is now known as ayoung_snowedin | 15:07 | |
| *** otter768 has quit IRC | 15:08 | |
| anteaya | emagana: do you have a minute for in here? | 15:08 |
| *** teran has joined #openstack-infra | 15:08 | |
| *** markvoelker has quit IRC | 15:09 | |
| anteaya | I just wanted infra folks to know what you are dealing with for docs work | 15:09 |
| clarkb | fungi is 3.4.3 special? | 15:09 |
| *** berendt has quit IRC | 15:09 | |
| *** jerryz has quit IRC | 15:09 | |
| anteaya | so in the neutron meeting emagana showed us this: https://github.com/ionosphere80/openstack-networking-guide/blob/master/scenario-legacy-ovs/scenario-legacy-ovs.md | 15:09 |
| fungi | clarkb: yeah, moar fix0rz apparently | 15:09 |
| anteaya | which he is working on for docs and is very pretty | 15:09 |
| anteaya | and which he hasn't pushed up to gerrit yet since he says working with the .md file is easier for them | 15:10 |
| emagana | I am here | 15:10 |
| anteaya | and I can't argue that point | 15:10 |
| fungi | clarkb: i think the goal is to not waste time packaging 3.4.2 and going through the ubuntu sru mre process with it when 3.4.3 is only a month away | 15:10 |
| emagana | praying that my battery does not died soon | 15:10 |
| anteaya | so I just wanted infra folks to be aware of your needs for the docs work, which is excellent | 15:10 |
| anteaya | so perhaps we can figure out how to support your work with gerrit | 15:10 |
| *** coolsvap is now known as coolsvap|afk | 15:10 | |
| anteaya | if it is possible to do so | 15:10 |
| emagana | any feedback is wellcome! we are working on the networking guide that will help us to finally fix the admin guide and install guides | 15:11 |
| anteaya | emagana: and I have to run away too, so just wanted to drop this here right now so I didn't forget | 15:11 |
| clarkb | fungi except 3.4 has been broken since april... | 15:11 |
| fungi | clarkb: yep | 15:11 |
| anteaya | emagana: thanks | 15:11 |
| emagana | anteaya: Thanks! I do appraciate.. I am also in a rush | 15:11 |
| anteaya | so maybe jeblair will see when he reads the backscroll and might have some ideas | 15:11 |
| *** salv-orlando has quit IRC | 15:11 | |
| mordred | clarkb, fungi: that's the saddest and most ridiculous thing I've ever heard | 15:11 |
| anteaya | emagana: thanks I won't keep you | 15:11 |
| anteaya | emagana: talk to you later | 15:12 |
| * anteaya also goes offline | 15:12 | |
| emagana | anteaya: sounds good! | 15:12 |
| fungi | clarkb: i offered to help, but an not sure there's much i can do (short of going through the process of becoming an official ubuntu developer) besides test it and give my thumbs-up | 15:12 |
| fungi | s/an/am/ | 15:12 |
| *** abhirc has quit IRC | 15:12 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Add missing subscription button to story detail https://review.openstack.org/149595 | 15:12 |
| *** teran_ has quit IRC | 15:12 | |
| mordred | fungi: I poked all of the ubuntu developers who work for me and the response was kind of a "yeah, that's about the state of ubuntu server right now" | 15:13 |
| *** emagana has quit IRC | 15:13 | |
| *** emagana has joined #openstack-infra | 15:13 | |
| *** dangers_away is now known as dangers | 15:14 | |
| *** abhirc has joined #openstack-infra | 15:17 | |
| *** avozza is now known as zz_avozza | 15:17 | |
| *** emagana has quit IRC | 15:17 | |
| *** zz_avozza is now known as avozza | 15:17 | |
| *** tmcpeak has joined #openstack-infra | 15:18 | |
| *** wenlock has joined #openstack-infra | 15:19 | |
| *** dims has quit IRC | 15:20 | |
| *** erikmwil_ has joined #openstack-infra | 15:20 | |
| *** erikmwilson is now known as Guest86107 | 15:20 | |
| *** erikmwil_ is now known as erikmwilson | 15:20 | |
| *** tsufiev is now known as tsufiev_ | 15:20 | |
| *** erikmwil- has joined #openstack-infra | 15:20 | |
| *** dims has joined #openstack-infra | 15:20 | |
| *** mugsie_ is now known as mugsie | 15:21 | |
| *** nfedotov has joined #openstack-infra | 15:21 | |
| fungi | mordred: it's unfortunate, but i suppose it's a factor of workload vs available developers... i foresaw this when they originally announced they were going to make a "server" version, i just didn't expect it to take quite so many years to reach this point | 15:22 |
| *** abhirc has quit IRC | 15:22 | |
| *** dims has quit IRC | 15:25 | |
| clarkb | anteaya: I guess I don't understand why they can't dev those docs along with the other docs | 15:27 |
| clarkb | anteaya: there is/was a markdown to docbook conversion step for some doc builds | 15:28 |
| * mordred is confused - that looks like it's part of one of the networking guides | 15:29 | |
| mordred | are we suggesting moving the docs to markdown? or injecting markdown? or what's the ask? | 15:29 |
| clarkb | mordred: thats my confusion | 15:29 |
| clarkb | mordred: it looks like a group of people went off to write docs on github for whatever reason and now think they can't gerrit for some other reasons? | 15:30 |
| clarkb | but all the involved reasons are unclear to me | 15:30 |
| *** zz_dimtruck is now known as dimtruck | 15:30 | |
| mordred | yah | 15:31 |
| mordred | anteaya: I know you're afk - but when you get back it would be good to know a) the problem statement b) the request | 15:32 |
| *** tsg_ has quit IRC | 15:32 | |
| mordred | clarkb: I'm going to guess this is "github renders markdown in the web" | 15:32 |
| *** mohitsharma has joined #openstack-infra | 15:33 | |
| mordred | but it might also be "github has in-web editing" | 15:33 |
| mordred | I just don't know | 15:33 |
| mordred | btw - the content of that page is actually quite clear and easy to read - so nicely done on that count | 15:34 |
| *** mohitsha_ has joined #openstack-infra | 15:34 | |
| *** mohitsharma has quit IRC | 15:37 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/zuul: Zuul sometimes fails to update remotes https://review.openstack.org/149336 | 15:38 |
| *** liusheng has quit IRC | 15:39 | |
| *** maxbit_ has quit IRC | 15:39 | |
| openstackgerrit | Barnaby Court proposed openstack-infra/jenkins-job-builder: Add ability to whitelist branches with the github pull request builder. https://review.openstack.org/150457 | 15:39 |
| *** liusheng has joined #openstack-infra | 15:39 | |
| *** nelsnelson has joined #openstack-infra | 15:39 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/zuul: Zuul sometimes fails to update remotes https://review.openstack.org/149336 | 15:40 |
| asselin_ | anyone know how do tag a commit message with a bug number to storyboard? | 15:41 |
| *** e0ne is now known as e0ne_ | 15:41 | |
| *** maxbit has joined #openstack-infra | 15:41 | |
| clarkb | asselin_: just continue to use the fixes-bug: storyboardnumberhere tags. gerrit won't link properly but when we switch everything to storyboard it will work right | 15:41 |
| asselin_ | ok thanks | 15:41 |
| *** rwsu has joined #openstack-infra | 15:42 | |
| *** Sukhdev has quit IRC | 15:42 | |
| asselin_ | clarkb, one line change for zuul merger issue: https://review.openstack.org/#/c/149336/ | 15:42 |
| clarkb | asselin_: ya I was just looking at that. Might be nice to see if we can narrow it down further than simply use latest | 15:42 |
| openstackgerrit | Barnaby Court proposed openstack-infra/jenkins-job-builder: Enable whitelisting branches with pull request builder https://review.openstack.org/150457 | 15:43 |
| asselin_ | latest is 0.3.6, but I can see if there's something less | 15:43 |
| *** zz_jgrimm is now known as jgrimm | 15:43 | |
| fungi | as in "commit x in release y fixed reported bug z" | 15:43 |
| fungi | or something along those lines | 15:43 |
| *** kurtmartin has joined #openstack-infra | 15:44 | |
| asselin_ | fungi, I will try | 15:44 |
| fungi | or identifying a behavior change in that release which matches zuul's expectations | 15:44 |
| asselin_ | fungi, it's not a zuul bug | 15:44 |
| openstackgerrit | Travis McPeak proposed openstack/requirements: Adding bandit to test requirements https://review.openstack.org/150138 | 15:45 |
| fungi | asselin_: right, just wondering if there's a reported issue upstream in gitpython | 15:45 |
| asselin_ | fungi, there are lots of similar issues reported | 15:45 |
| asselin_ | fungi, I didn't see an exact match, but I suspect one of the changes also fixed this one. | 15:45 |
| clarkb | https://github.com/gitpython-developers/GitPython/issues?q=is%3Aissue+fetch+ I don't see anything that matches the specific error there | 15:45 |
| asselin_ | fungi, and in the comments, the author is basically 'hoping' that it also fixes other bugs... | 15:46 |
| *** kgiusti has joined #openstack-infra | 15:46 | |
| *** hj-hp has joined #openstack-infra | 15:46 | |
| mordred | yay for blind hope! | 15:46 |
| asselin_ | mordred, :) | 15:46 |
| *** markvoelker has joined #openstack-infra | 15:46 | |
| *** stevemar has joined #openstack-infra | 15:47 | |
| clarkb | speaking of hope. fungi can I get you to review https://review.openstack.org/#/c/150233/ and its parent? should fix rax builds but hoping the base images are similar enough that it doesn't break us in the process | 15:48 |
| clarkb | I can babysit building new images today if those two changes go in | 15:48 |
| *** abhirc has joined #openstack-infra | 15:49 | |
| *** mescanef has joined #openstack-infra | 15:49 | |
| clarkb | pleia2: can I say that certcheck is the best thing ever? | 15:49 |
| *** ddieterly has joined #openstack-infra | 15:49 | |
| fungi | clarkb: yeah, i added a to do for this week to get a new ask.o.o cert | 15:49 |
| *** e0ne_ has quit IRC | 15:51 | |
| *** annegent_ has joined #openstack-infra | 15:52 | |
| *** andreaf_ has quit IRC | 15:53 | |
| *** andreaf_ has joined #openstack-infra | 15:53 | |
| openstackgerrit | Merged openstack-infra/system-config: Use Rackspace Precise PVHVM images. https://review.openstack.org/150231 | 15:55 |
| *** jaypipes has joined #openstack-infra | 15:57 | |
| *** jlibosva has quit IRC | 15:59 | |
| *** amitgandhinz has joined #openstack-infra | 15:59 | |
| openstackgerrit | Merged openstack-infra/system-config: Use Rackspace CentOS 6 PVHVM base images https://review.openstack.org/150233 | 15:59 |
| *** mohitsharma has joined #openstack-infra | 16:00 | |
| *** jerryz has joined #openstack-infra | 16:00 | |
| *** filler has joined #openstack-infra | 16:01 | |
| jeblair | clarkb: thanks, glad you liked the talk! | 16:01 |
| *** spzala has quit IRC | 16:01 | |
| jeblair | jhesketh: https://review.openstack.org/#/c/118993/ is next on my list | 16:01 |
| *** mrmartin has quit IRC | 16:03 | |
| *** jlibosva has joined #openstack-infra | 16:03 | |
| *** ildikov has quit IRC | 16:03 | |
| *** mohitsha_ has quit IRC | 16:04 | |
| jeblair | mordred, anteaya: yeah, i don't understand what you were asking about the ovs doc -- but i think you might have been saying that .md is preferred to .rst. however, most of our doc tooling is built around .rst or docbook, and the docs team is moving most of the docs that aren't long-form books to .rst | 16:05 |
| *** fandi has joined #openstack-infra | 16:05 | |
| *** salv-orlando has joined #openstack-infra | 16:05 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Create a neutron client https://review.openstack.org/147731 | 16:06 |
| jeblair | anteaya: so i believe the expectation from the doc team in the future is that they will help continue to build and support .rst based documentation. and even today, we have tooling that will take .rst files and render them to docs-draft.openstack.org for easy review of changes | 16:06 |
| *** jerryz has quit IRC | 16:06 | |
| *** jerryz has joined #openstack-infra | 16:06 | |
| mordred | Shrews: why did you add back in passing the region name? | 16:06 |
| *** packet has joined #openstack-infra | 16:07 | |
| jeblair | anteaya: so we should find out what the blocker is for the ovs docs using that. converting from .md to .rst is straightforward and automatic. | 16:07 |
| fungi | (also, there are probably wysiwyg->rst editors people can use locally when preparing new changes/patchsets) | 16:07 |
| mordred | Shrews: OH - nevermind, I get it | 16:07 |
| ctlaugh | asselin_ - I'm about to use your fork to try to get a CI environment going... any gotchas or other things I might need to watch for? | 16:08 |
| Shrews | mordred: i don't know why that one was removed. i was getting keystoneclient.openstack.common.apiclient.exceptions.EndpointNotFound | 16:08 |
| mordred | have I ever mentioned how happy I am that both MD and RST exist and have adherants | 16:08 |
| asselin_ | ctlaugh, docs may not be completely up to date. | 16:08 |
| clarkb | mordred: just point at rst compiling to !html and be happy :) | 16:08 |
| *** fandi has quit IRC | 16:08 | |
| *** fandi has joined #openstack-infra | 16:09 | |
| *** salv-orlando has quit IRC | 16:09 | |
| *** baoli has quit IRC | 16:10 | |
| asselin_ | ctlaugh, but any improvements would be welcomed. fresh eyes are always the best! | 16:10 |
| *** pcm_ has joined #openstack-infra | 16:10 | |
| ctlaugh | asselin_: I assume I already need to have an openstack deployment up and running? | 16:11 |
| *** sandywalsh_ has joined #openstack-infra | 16:11 | |
| *** bswartz has joined #openstack-infra | 16:11 | |
| asselin_ | ctlaugh, yes, for nodepool. but you can still test it out w/o nodepool running simple jobs on the jenkins master. | 16:12 |
| *** dkliban is now known as dkliban_brb | 16:13 | |
| *** tobiash_ has joined #openstack-infra | 16:13 | |
| openstackgerrit | Merged openstack/requirements: Add kafka-python dependency needed for ceilometer kafka publisher https://review.openstack.org/127309 | 16:13 |
| *** dannywilson has joined #openstack-infra | 16:14 | |
| *** imcsk8_ has joined #openstack-infra | 16:14 | |
| *** timrc_ has joined #openstack-infra | 16:14 | |
| *** yjiang5_ has joined #openstack-infra | 16:15 | |
| *** dannywilson has quit IRC | 16:15 | |
| *** dannywilson has joined #openstack-infra | 16:15 | |
| *** spiffxp- has joined #openstack-infra | 16:15 | |
| *** armax has joined #openstack-infra | 16:16 | |
| *** ruhe2 has joined #openstack-infra | 16:16 | |
| *** rakhmerov__ has joined #openstack-infra | 16:16 | |
| *** rakhmerov has quit IRC | 16:16 | |
| ctlaugh | asselin_: ok - I'll give it a go... It took a couple of days and several other conversations, but I think I've decided it's the way to go vs. just using jenkins and gerrit trigger. After conversing with one of the KVM for arm64 maintainers, I also believe there is not a ned to run everything on bare metal like I originally was thinking, so just using KVM instances should meet our needs. | 16:16 |
| ctlaugh | asselin_, hopefully just a "standard" setup | 16:17 |
| asselin_ | ctlaugh, cool | 16:17 |
| *** ildikov has joined #openstack-infra | 16:17 | |
| *** e0ne has joined #openstack-infra | 16:17 | |
| fungi | ctlaugh: asselin_: also you can use it if you just have a tenant account in an openstack service provider... you don't need to actually be running your own openstack environment | 16:17 |
| *** sandywalsh has quit IRC | 16:17 | |
| *** pc_m has quit IRC | 16:17 | |
| asselin_ | ctlaugh, fyi, i'm working on an in-tree version. | 16:17 |
| *** tobiash has quit IRC | 16:18 | |
| *** spiffxp has quit IRC | 16:18 | |
| *** yjiang5 has quit IRC | 16:18 | |
| *** timrc has quit IRC | 16:18 | |
| *** clarkb has quit IRC | 16:18 | |
| *** imcsk8 has quit IRC | 16:18 | |
| *** Guest14840 has quit IRC | 16:18 | |
| *** phschwartz has quit IRC | 16:18 | |
| *** kgiusti has quit IRC | 16:18 | |
| *** ruhe has quit IRC | 16:18 | |
| *** phschwartz has joined #openstack-infra | 16:18 | |
| *** coolsvap|afk is now known as coolsvap | 16:18 | |
| *** spiffxp- is now known as spiffxp | 16:18 | |
| *** ruhe2 is now known as ruhe | 16:18 | |
| fungi | (we use it with donated tenant accounts in rackspace and hpcloud, as well as the tripleo community cloud) | 16:18 |
| asselin_ | fungi, yes, the challenge with a public provider is to get it to connect to our test Hardware | 16:18 |
| *** clarkb has joined #openstack-infra | 16:19 | |
| fungi | good point | 16:19 |
| clarkb | how much did I miss? | 16:19 |
| *** ctlaugh has quit IRC | 16:19 | |
| *** Guest14840 has joined #openstack-infra | 16:20 | |
| *** ctlaugh has joined #openstack-infra | 16:21 | |
| *** kgiusti has joined #openstack-infra | 16:21 | |
| dhellmann | fungi: is the motivation for dropping those 3.3 jobs to cut down on the images infra is managing? I'd hate to have regressions in language version support, obviously. Do you know if there's something we can do in our code to work around the issue? | 16:21 |
| *** jaypipes has quit IRC | 16:21 | |
| fungi | clarkb: a one-line exchange between me and asselin_ about their setup. nothing terribly critical | 16:21 |
| clarkb | dhellmann: if you get rid or objects that refer to each other the garbage collector shouldn't segfault | 16:22 |
| clarkb | s/or/of/ | 16:22 |
| fungi | dhellmann: yeah, it might be possible to turn off specific tests which break on ubuntu trusty's python3.4 interpreter | 16:22 |
| clarkb | dhellmann: the issue is the gc get an object to gc then follows as far as it can go to gc all the dead things, but those same things can be further along in the larger gc list so when it iterates to them which are now null boom segfault | 16:22 |
| asselin_ | fungi, fyi I got it down to GitPython 0.3 | 16:23 |
| fungi | dhellmann: i've got an updated pass going right now to spot if there are any other projects hitting issues on 3.4 which are working and voting on 3.3, but plan to switch everyone who can safely switch this week (at which point we'd be maintaining heavily modified precise images for python33 jobs on just those two projects) | 16:24 |
| dhellmann | clarkb: ok, but I guess we don't know which objects those are | 16:24 |
| dhellmann | fungi: yeah, that sounds like an extra burden we'd want to avoid | 16:24 |
| *** ociuhandu has joined #openstack-infra | 16:24 | |
| clarkb | dhellmann: yup its hard because by the time it gets to where it fails its null | 16:24 |
| *** dhritishikhar_ has joined #openstack-infra | 16:25 | |
| clarkb | so you have to note a bunch of state and I gave up pretty early on trying to determine which specific things were making it break | 16:25 |
| dhellmann | clarkb: did you narrow it down to a subset of the tests? | 16:25 |
| *** rakhmerov__ is now known as rakhmerov | 16:25 | |
| clarkb | dhellmann: no | 16:26 |
| dhellmann | ok | 16:26 |
| clarkb | there is really not much info because the thing that is broken is gone when it breaks | 16:26 |
| dhellmann | right | 16:26 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Fix for finding addresses https://review.openstack.org/150479 | 16:26 |
| *** dhritishikhar has quit IRC | 16:27 | |
| Shrews | mordred: ^^ | 16:27 |
| Shrews | yay bugs | 16:27 |
| dhellmann | clarkb, fungi : I think I'm OK with disabling those jobs. Let me talk to the devs on those teams. | 16:27 |
| *** dhritishikhar_ is now known as dhritishikhar | 16:27 | |
| *** tsg has joined #openstack-infra | 16:27 | |
| *** 17WAA14VW has joined #openstack-infra | 16:27 | |
| *** dizquierdo has quit IRC | 16:27 | |
| dhellmann | clarkb, fungi : I'll start a mailing list thread, and maybe you can add detail if I leave out anything important | 16:27 |
| fungi | dhellmann: definitely, and thanks for being flexible | 16:27 |
| *** peekay is now known as pradk | 16:28 | |
| *** Mithrandir has quit IRC | 16:29 | |
| *** kurtmartin has quit IRC | 16:29 | |
| *** Ala has quit IRC | 16:30 | |
| dhellmann | fungi, clarkb : I guess we don't have a 3.x interpreter on fedora, centos, or whatever other red hat variants we're using in the gate? | 16:30 |
| dhellmann | I'm sure you guys have been through all of this, so I'm just trying to make sure I have the full picture | 16:31 |
| fungi | dhellmann: red hat derived distros are, from what i can find, allergic to providing multiple system python interpreters. the preferred solution seems to be to compile your own from source even on fedora and rhel/centos 7 | 16:31 |
| fungi | and call it from a separate path | 16:32 |
| dhellmann | wow, ok, that's pretty extreme | 16:32 |
| *** 17WAA14VW is now known as dims | 16:33 | |
| fungi | dhellmann: one alternative would be to switch to debian jessie (which is now in release freeze for a while). it has 3.4.2 packaged | 16:33 |
| dhellmann | fungi: are we already running nodes with those images? | 16:33 |
| fungi | dhellmann: nope | 16:33 |
| dhellmann | ok, so that's also more work | 16:33 |
| fungi | yep | 16:33 |
| jeblair | at one point it was really hard to do so in rh based distros due to the system-level python dependencies (equivalent to debian's link with perl) | 16:33 |
| jeblair | debian++ | 16:33 |
| dhellmann | have you heard from canonical with more details of a release plan? the last message I saw wasn't exactly heartening | 16:34 |
| *** Mithrandir has joined #openstack-infra | 16:34 | |
| dhellmann | jeblair: yeah, just install to /usr/local though, right? | 16:34 |
| dhellmann | or /usr/lib/python3.x? I guess I don't understand the issue fully | 16:34 |
| *** tsg_ has joined #openstack-infra | 16:34 | |
| fungi | dhellmann: the plan is to wait for 3.4.3 to get released in about a month, and then package that and put it through trusty sru with a request for a microversion release exception | 16:35 |
| jeblair | dhellmann: yeah, i was indicating why they might be 'allergic' to multiple distro-level python versions | 16:35 |
| dhellmann | fungi: can we set a deadline after which we'll do something to bring 3.4 testing back for those libs, even if canonical doesn't have their release out? | 16:35 |
| dhellmann | jeblair: got it | 16:35 |
| mordred | Shrews: wow - so, in a fit of madness - you DO need to pass region_name to neutron_client but you should not pass it to nova | 16:36 |
| *** tsg has quit IRC | 16:36 | |
| Shrews | mordred: i want to cry | 16:36 |
| *** avozza is now known as zz_avozza | 16:36 | |
| *** yfried_ has quit IRC | 16:37 | |
| fungi | dhellmann: i wouldn't mind hacking on a debian jessie worker anyway (i don't think it would be much work to get going). let's say end of march--that's a month for the sru mre process to conclude, and if i can get debian nodes available sooner we can always run some (all?) py3k testing on those anyway | 16:38 |
| notmyname | anyone looked at the gethostbyname() CVE today? | 16:38 |
| dhellmann | fungi: ok, cool, can I include that rough timeline in this email? | 16:38 |
| jeblair | fungi: sounds like a plan | 16:38 |
| jeblair | notmyname: no, thanks | 16:38 |
| notmyname | jeblair: lsof | grep libc | awk '{print $1}' | sort | uniq | 16:38 |
| *** baoli has joined #openstack-infra | 16:38 | |
| notmyname | woops | 16:38 |
| *** jlibosva has quit IRC | 16:38 | |
| notmyname | jeblair: https://news.ycombinator.com/item?id=8953545 | 16:38 |
| fungi | dhellmann: yeah, i think that's a perfectly reasonable schedule so feel free to mention it | 16:38 |
| *** nfedotov has quit IRC | 16:38 | |
| dhellmann | fungi: ok, great, thanks | 16:39 |
| *** salv-orlando has joined #openstack-infra | 16:39 | |
| clarkb | notmyname: yes, I was trying to figure out if libc on debuntu were affected to othen I got distracted | 16:39 |
| *** spzala has joined #openstack-infra | 16:39 | |
| openstackgerrit | Nastya Urlapova proposed openstack-infra/project-config: Fuel-qa repo for Fuel https://review.openstack.org/150271 | 16:39 |
| fungi | notmyname: yep, i've been poking at it a little since i saw my e-mail this morning | 16:39 |
| *** emagana has joined #openstack-infra | 16:39 | |
| clarkb | looks like debuntu are | 16:39 |
| *** sabeen1 has joined #openstack-infra | 16:39 | |
| clarkb | (I thought rh and debuntu used different libc) | 16:40 |
| *** unicell has quit IRC | 16:40 | |
| notmyname | clarkb: fungi: is there any reason I shouldn't assume this is a "hair on fire, patch/reboot everything" situation? | 16:40 |
| fungi | debian has applied patches in jessie and sid at this point | 16:40 |
| notmyname | cause "gethostbyname() is broken" sounds really bad | 16:40 |
| *** mohitsharma has quit IRC | 16:40 | |
| clarkb | notmyname: because in theory you don't have to reboot everything, just apply update then restart external facing services | 16:41 |
| *** e0ne is now known as e0ne_ | 16:41 | |
| notmyname | clarkb: right | 16:41 |
| clarkb | so its wait for fix to arrive, then restart services (reboots maybe easier) | 16:42 |
| *** jlibosva has joined #openstack-infra | 16:42 | |
| *** tsg_ has quit IRC | 16:42 | |
| openstackgerrit | David Caro proposed openstack-infra/jenkins-job-builder: Added possibility to use non-existent keys https://review.openstack.org/101580 | 16:42 |
| fungi | unfortunately http://people.canonical.com/~ubuntu-security/cve/2015/ doesn't list it yet | 16:42 |
| *** dkliban_brb is now known as dkliban | 16:42 | |
| *** mohitsharma has joined #openstack-infra | 16:42 | |
| openstackgerrit | David Caro proposed openstack-infra/jenkins-job-builder: Added possibility to use non-existent keys https://review.openstack.org/101580 | 16:42 |
| mordred | Shrews: NO - IT'S WORSE | 16:42 |
| jeblair | fungi: ubuntu security is slower than debian now? | 16:43 |
| *** scheuran has quit IRC | 16:43 | |
| mordred | Shrews: on one cloud, you must provide region_name, on the other cloud you must not provide region_name | 16:43 |
| fungi | jeblair: at times, yes | 16:43 |
| Shrews | mordred: that is supremely horrible | 16:44 |
| mordred | jeblair: kinda sad when you can't deliver on your one value add over the thing you forked | 16:44 |
| fungi | jeblair: it's possible ubuntu has patched packages uploaded and just haven't updated their cve tracker yet (it has a tendency to lag a bit). i'm confirming now | 16:44 |
| *** mohitsha_ has joined #openstack-infra | 16:44 | |
| jeblair | mordred: i see a lot of cloud stabbing in your future; do you order cutlery in bulk? | 16:44 |
| clarkb | fungi: http://www.ubuntu.com/usn/ I don't see it there either which was part of the difficulty for me deciding if debuntu were affected | 16:44 |
| mordred | Shrews: I'm going to see if "try: no region_name: except: region_name" works - because the "must have region_name" path does seem to fail fast | 16:44 |
| notmyname | fungi: looks like there are some libc updates on my precise box. not sure if it's for this bug | 16:44 |
| *** gema has quit IRC | 16:44 | |
| openstackgerrit | James Graf proposed openstack-infra/jenkins-job-builder: Add support for Job DSL plugin https://review.openstack.org/150112 | 16:45 |
| fungi | https://lists.debian.org/debian-security-announce/2015/msg00025.html | 16:45 |
| Shrews | mordred: be careful with that. with glance on HP, no region will succeed, but return a false endpoint which eventually fails (slowly) when you try to contact it | 16:45 |
| fungi | for debian, it's 2.18-1 in testing/unstable and 2.13-38+deb7u7 in stable | 16:46 |
| Shrews | mordred: that's the thing i pointed out to you yesterday and made me stabby | 16:46 |
| *** ildikov has quit IRC | 16:47 | |
| *** signed8bit has quit IRC | 16:47 | |
| mordred | Shrews: z o m g | 16:47 |
| clarkb | https://lists.ubuntu.com/archives/ubuntu-security-announce/2015-January/002813.html so trusty isn't affected? | 16:47 |
| ryanpetrello | anybody know if something like http://status.openstack.org/zuul/?filter=<XYZ> exists ? | 16:47 |
| *** mohitsharma has quit IRC | 16:47 | |
| clarkb | (granted many of our long lived nodes are precise and it appears according to that that packages are available | 16:48 |
| fungi | i don't see any security updates for libc6 on trusty (yet anyway). most recent package revisions are from december | 16:49 |
| clarkb | fungi: ya that email implies trusty isn't affected | 16:49 |
| fungi | agreed | 16:49 |
| clarkb | but only by exclusion which is a bad implication :) | 16:49 |
| *** alexpilotti has quit IRC | 16:49 | |
| clarkb | now to see if centos6 has patches yet | 16:50 |
| fungi | though the latest showing on packages.ubuntu.com for precise are also not updated yet | 16:50 |
| openstackgerrit | Filip Blaha proposed openstack-infra/project-config: Functional tests job for policy enforcement https://review.openstack.org/150401 | 16:50 |
| jeblair | fungi, clarkb: i just successfully updated a 10.04 machine to the version listed in that email | 16:51 |
| dhellmann | fungi: http://lists.openstack.org/pipermail/openstack-dev/2015-January/055270.html | 16:51 |
| *** ihrachyshka has quit IRC | 16:51 | |
| fungi | okay, excellent | 16:51 |
| fungi | dhellmann: thanks! | 16:51 |
| *** e0ne_ has quit IRC | 16:51 | |
| *** gema_ has joined #openstack-infra | 16:52 | |
| clarkb | this is going to hurt the most with elasticsearch, but elasticsearch is only accessible via the proxy which means maybe we can ignore it until the weekend for es? | 16:52 |
| dhellmann | fungi: I asked for feedback by the 29th, so if you don't hear otherwise by the morning of the 30th, go ahead and disable the jobs | 16:52 |
| *** patrickeast has joined #openstack-infra | 16:52 | |
| clarkb | I will go ahead and put jenkins06 and 07 in shutdown mode so we can reboot them once precise has packages | 16:52 |
| fungi | dhellmann: thanks--that's plenty soon. i really appreciate getting the discussion rolling there | 16:53 |
| *** rwsu_ has joined #openstack-infra | 16:53 | |
| *** rwsu has quit IRC | 16:53 | |
| dhellmann | fungi: no problem -- I wish we weren't in this situation, but these things happen | 16:54 |
| *** emagana has quit IRC | 16:54 | |
| fungi | clarkb: sounds good | 16:54 |
| *** abhirc has quit IRC | 16:54 | |
| *** emagana has joined #openstack-infra | 16:54 | |
| pleia2 | clarkb: glad it continues to be useful \o/ | 16:54 |
| *** abhirc has joined #openstack-infra | 16:54 | |
| fungi | dhellmann: i'm just going to take it as an excuse to see if our tooling and jobs present any serious issues for my personal preferred distro ;) | 16:55 |
| *** hj-hp has quit IRC | 16:55 | |
| dhellmann | fungi: I support this approach. | 16:55 |
| *** emagana_ has joined #openstack-infra | 16:56 | |
| *** e0ne has joined #openstack-infra | 16:56 | |
| *** emagana has quit IRC | 16:56 | |
| clarkb | fungi: jeblair packages are available for precise best I can tell too | 16:56 |
| clarkb | its really weird that ubuntu usn is not up to date | 16:56 |
| jeblair | clarkb: why not just reboot all of es? we'll be rebooting gerrit anyway, so there's going to be disruption | 16:56 |
| clarkb | jeblair: because it has to rebuild the entire cluster after wards will likely make elastic recheck useless for a while | 16:57 |
| clarkb | I am going to do the logstash workers and logstash.o.o now | 16:57 |
| jeblair | clarkb: how long does the rebuild take? | 16:57 |
| jeblair | clarkb, fungi, mordred: https://etherpad.openstack.org/p/libc-infra-reboot | 16:57 |
| *** melwitt has joined #openstack-infra | 16:57 | |
| clarkb | jeblair: I would guess about a day | 16:57 |
| fungi | do i need to fire up an ansible loop to update packages on everything, or is someone already on that>? | 16:57 |
| clarkb | jeblair: when es was disrupted last week that is about how long it took | 16:58 |
| fungi | thanks jeblair | 16:58 |
| clarkb | fungi: that is probably a good place to start :) | 16:58 |
| jeblair | clarkb: hrm. is there no graceful shutdown/restart? | 16:58 |
| fungi | i'll do a quick pass to identify what's running precise. also centos 6 yeah? | 16:58 |
| clarkb | jeblair: there is sort of, you can tell it to not rebalance any shards then do a single node at a time | 16:58 |
| *** signed8bit has joined #openstack-infra | 16:59 | |
| jeblair | clarkb: any reason not to do that? | 16:59 |
| clarkb | jeblair: but during that time it stops all operations iirc which manes things back up | 16:59 |
| clarkb | whereas in the other situation you can continue to read and write you just do it slowl | 16:59 |
| clarkb | fungi: yes centos6 but I havne't confirmed cnetos6 hs packages yet | 16:59 |
| openstackgerrit | Merged openstack-infra/release-tools: Use PEP440 normalized versions https://review.openstack.org/143039 | 17:00 |
| *** notmyname has quit IRC | 17:00 | |
| clarkb | jeblair: we can certainly give it a go and see how bad it is | 17:00 |
| fungi | i can go hunting for them in a bit if nobody beats me to it | 17:00 |
| jeblair | mordred: are you around to help? | 17:01 |
| *** zz_avozza is now known as avozza | 17:01 | |
| *** emagana_ has quit IRC | 17:01 | |
| *** aysyd has joined #openstack-infra | 17:01 | |
| clarkb | fungi: `ansible $THINGTOONLYSELECTPRECISENODES -m apt -a "name=libc6 state=latest` | 17:01 |
| *** notmyname has joined #openstack-infra | 17:02 | |
| fungi | clarkb: you read my mind. i was grepping our documentation :/ | 17:02 |
| *** liusheng has quit IRC | 17:02 | |
| *** e0ne_ has joined #openstack-infra | 17:02 | |
| *** liusheng has joined #openstack-infra | 17:03 | |
| jeblair | clarkb: oops didn't see your note | 17:03 |
| *** xyang0 has joined #openstack-infra | 17:04 | |
| *** hj-hp has joined #openstack-infra | 17:04 | |
| clarkb | jeblair: its ok you beat me to it | 17:04 |
| jeblair | clarkb: you want to look into centos6 | 17:04 |
| *** rwsu_ is now known as rwsu | 17:04 | |
| clarkb | jeblair: yes I can do that | 17:04 |
| *** erikmwilson has quit IRC | 17:04 | |
| *** erikmwil- is now known as erikmwilson | 17:04 | |
| *** erikmwil_ has joined #openstack-infra | 17:04 | |
| *** erikmwilson is now known as Guest22067 | 17:04 | |
| *** erikmwil_ is now known as erikmwilson | 17:04 | |
| *** otter768 has joined #openstack-infra | 17:04 | |
| fungi | jeblair seems to have beat me to pasting in the list | 17:04 |
| fungi | anyway, looping those in ansible to update now | 17:04 |
| mordred | jeblair: yes | 17:05 |
| jeblair | fungi: ++ | 17:05 |
| *** sigmavirus24 is now known as sigmavirus24_awa | 17:05 | |
| fungi | the count in the etherpad matches the list i generated, so i think it's good | 17:05 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 17:05 | |
| *** Guest28610 has quit IRC | 17:05 | |
| clarkb | I have confirmed on my trusty machine that it doesn't know about any libc6 updates | 17:05 |
| *** e0ne has quit IRC | 17:06 | |
| clarkb | now to ask yum about it | 17:06 |
| jeblair | i'm going to sort the list by impact of rebooting | 17:06 |
| *** cdent has quit IRC | 17:07 | |
| fungi | grr, of course the ansible cli has no installed manpage | 17:07 |
| *** mohitsharma has joined #openstack-infra | 17:07 | |
| jeblair | fungi: documentation is not agile | 17:08 |
| fungi | i take it the host pattern can't be a space-separated list of hostnames? | 17:08 |
| mtreinish | fungi: it's python... | 17:08 |
| mordred | fungi: no, but you can separate them with ; | 17:08 |
| fungi | mordred: perfect, thanks | 17:08 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for nova rpc message timeout bug 1415106 https://review.openstack.org/150493 | 17:08 |
| *** Ryan_Lane has joined #openstack-infra | 17:09 | |
| clarkb | git01 appears to have the latest available version of glibc which I don't think is patched | 17:09 |
| *** liusheng has quit IRC | 17:09 | |
| jeblair | fungi, clarkb, mordred: we really need to finish retiring old-wiki. i will update it now. | 17:09 |
| *** spzala_ has joined #openstack-infra | 17:09 | |
| *** otter768 has quit IRC | 17:09 | |
| mordred | fungi: scuse me - : | 17:09 |
| mordred | not ; | 17:09 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/zuul: Zuul sometimes fails to update remotes https://review.openstack.org/149336 | 17:09 |
| mordred | fungi: you can see an example in ./modules/openstack_project/files/ansible/remote_puppet_else.yaml fwiw | 17:09 |
| asselin_ | fungi, clarkb updated commit message with GitPython rev that fixes the issue ^^ | 17:09 |
| *** rm_work is now known as rm_work|away | 17:10 | |
| *** liusheng has joined #openstack-infra | 17:10 | |
| *** BharatK has joined #openstack-infra | 17:10 | |
| *** bdpayne has joined #openstack-infra | 17:10 | |
| clarkb | yup current version that is available is from the 7th | 17:10 |
| *** Kerralissa has joined #openstack-infra | 17:10 | |
| fungi | mordred: that did it. thanks, running now | 17:10 |
| *** mohitsha_ has quit IRC | 17:10 | |
| jeblair | clarkb: what is 'elasticsearch.openstack.org' -- it's not on the precise list | 17:11 |
| *** dtantsur is now known as dtantsur|afk | 17:11 | |
| *** zz_johnthetubagu is now known as johnthetubaguy | 17:11 | |
| BharatK | ping clarkb | 17:11 |
| *** sarob has joined #openstack-infra | 17:11 | |
| jeblair | BharatK: best just to ask your question | 17:11 |
| BharatK | clarkb, I have seen Sean's patch https://review.openstack.org/#/c/145321/ | 17:11 |
| *** spzala has quit IRC | 17:12 | |
| *** spzala_ is now known as spzala | 17:12 | |
| BharatK | Could you please explain how to use this in my patch | 17:12 |
| clarkb | jeblair: that node should've been deleted a long time ago | 17:12 |
| *** mohitsharma has quit IRC | 17:12 | |
| clarkb | jeblair: is it still up? | 17:12 |
| clarkb | it was the node that had all the IO problems so added 07 | 17:12 |
| fungi | i get success >> { "changed": false } for all the hosts. i think that means -m apt -a "name=libc6 state=latest" didn't do anything? | 17:12 |
| *** tonytan4ever has joined #openstack-infra | 17:13 | |
| *** MarkAtwood has joined #openstack-infra | 17:13 | |
| jeblair | clarkb: oh, i thought we had a load balancer or something | 17:13 |
| fungi | does the ansible apt module update the package list before it updates the package? | 17:13 |
| clarkb | fungi: maybe you need an explicit apt-get update first? would check the version that you have installed on a couple nodes | 17:13 |
| clarkb | jeblair: load balancer for api access is logstash.openstack.org and that should be easy to reboot | 17:13 |
| jeblair | oh ok | 17:14 |
| mordred | fungi: I do not know - one sec, I'll look | 17:14 |
| fungi | clarkb: no dice... still all at 2.15-0ubuntu10.9 | 17:14 |
| *** MaxV has quit IRC | 17:14 | |
| openstackgerrit | Merged openstack/requirements: Bump alembic to 0.7.2 https://review.openstack.org/150162 | 17:14 |
| jeblair | clarkb: any ideas how long rebooting es one at a time will take? | 17:14 |
| fungi | it also proceeded way to fast to have been actually updating the package list first, so i am almost positive it didn't | 17:14 |
| fungi | er, too | 17:14 |
| mordred | fungi: update_cache is a param that can be set to yes | 17:14 |
| fungi | mordred: thanks, adding | 17:15 |
| *** Kerralissa has quit IRC | 17:15 | |
| fungi | mordred: that's going much slower, so i think it dtrt now | 17:15 |
| fungi | yep, updating to 2.15-0ubuntu10.10 now | 17:15 |
| clarkb | jeblair: the rebooting itself should be relatively quick. we tell cluster to not rebalance, reboot one node, tell cluster to recover, then repeat. The pain there is I expect the index backlog to grow since we won't be able to index things during the reboot and resync | 17:16 |
| clarkb | jeblair: so its graceful to the elasticsearch cluster but less so to elastic recheck | 17:16 |
| mordred | fungi: woot | 17:16 |
| *** ildikov has joined #openstack-infra | 17:16 | |
| fungi | i'll get this documented for the benefit of future fire drills | 17:16 |
| jeblair | clarkb: yeah, i'm weighing the idea of just taking 30 mins of downtime to restart all of zuul, jenkins, gerrit, es at once... | 17:16 |
| jeblair | clarkb: versus trying to do minimal downtime of those | 17:17 |
| jeblair | sounds like es would fit within that window | 17:17 |
| clarkb | jeblair: ya and fwiw es isn't super critical service and it will catch up | 17:17 |
| mordred | jeblair: ++ | 17:18 |
| clarkb | fwiw I am looking at http://mirror.centos.org/centos/6/updates/x86_64/Packages/ for centos6 pacakges will put that on the etherpad too | 17:19 |
| *** annegent_ has quit IRC | 17:19 | |
| fungi | seems fine to me. i'm in favor of the rip-off-the-bandage approach | 17:19 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for nova rpc message timeout bug 1415106 https://review.openstack.org/150493 | 17:20 |
| jeblair | okay, so i split the precise list into less-disruptive and more-disruptive hosts... | 17:20 |
| *** shashankhegde has joined #openstack-infra | 17:20 | |
| *** talluri has joined #openstack-infra | 17:20 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/devstack-gate: Really preseed tempest testrepository from database https://review.openstack.org/149740 | 17:21 |
| jeblair | fungi: i think you can just ansible reboot the less-disruptive ones when they are ready | 17:21 |
| *** marun has joined #openstack-infra | 17:21 | |
| fungi | jeblair: yep, the loop just finished | 17:21 |
| fungi | i'll do them now | 17:21 |
| *** liusheng has quit IRC | 17:22 | |
| zaro | morning | 17:22 |
| jeblair | clarkb: when you are done with centos, would like like to turn of rebalancing in es? | 17:22 |
| jeblair | turn off | 17:22 |
| *** liusheng has joined #openstack-infra | 17:23 | |
| clarkb | jeblair: sure I can do that | 17:23 |
| *** jpich has quit IRC | 17:24 | |
| zaro | nibalizer, fungi : answered your questions to https://review.openstack.org/#/c/148363/ | 17:25 |
| fungi | hrm, no built-in reboot module for ansible that i can fine. guess it's time for a custom playbook | 17:25 |
| fungi | oh, i can just use the command module i guess | 17:25 |
| jeblair | fungi, mordred: is there a shell mod | 17:26 |
| jeblair | yeah | 17:26 |
| mordred | jeblair: yes | 17:26 |
| jeblair | clarkb, fungi, mordred: i put a list of steps for the more-disruptive hosts in the etherpad | 17:26 |
| jeblair | line 86 | 17:26 |
| mordred | cmd module executes commands without a subshell - shell module does it with a subshell | 17:26 |
| jeblair | there goes etherpad :) | 17:27 |
| *** gokrokve_ has quit IRC | 17:28 | |
| *** thedodd has joined #openstack-infra | 17:28 | |
| jeblair | it's back up | 17:28 |
| anteaya | jeblair: thanks that is a good summary and I will follow up with emagama | 17:28 |
| sdague | hey, does anyone know why - https://review.openstack.org/#/c/135700/ didn't set the topic correctly in the gerrit review? | 17:28 |
| *** vigneshvar has joined #openstack-infra | 17:29 | |
| *** baoli has quit IRC | 17:29 | |
| jeblair | sdague: what should it have been? | 17:30 |
| *** markus_z has quit IRC | 17:30 | |
| *** jaypipes has joined #openstack-infra | 17:30 | |
| sdague | jeblair: bp/flavor-from-sysmeta-to-blob | 17:31 |
| anteaya | mordred: the problem statement is that right now networking guides appear to be favouring a github centric workflow | 17:31 |
| anteaya | mordred: I was trying to see how to advocate for a gerrit centric workflow | 17:31 |
| anteaya | mordred: jeblair gave me a direction which I will try to advocate for | 17:32 |
| sdague | jeblair: mostly - http://status.openstack.org/release/ seems to be largely not working (lots of /!\ ) because bp topics aren't getting set | 17:32 |
| *** tonytan4ever has quit IRC | 17:34 | |
| jeblair | sdague: it matches the regex in git-review. possibilities: (a) submitter did not use git-review; (b) submitter explicitly set topic; (c) bug in git-review that would need further examination | 17:34 |
| *** kurtmartin has joined #openstack-infra | 17:35 | |
| sdague | jeblair: it seems to be happening a ton, not just for this one | 17:35 |
| jeblair | sdague: suggests (c). probably next step is to push a copy of that change with verbose git-review output or similarly debug | 17:36 |
| *** hdd has joined #openstack-infra | 17:36 | |
| jeblair | sdague: we are currently rebooting all of infra due to cve, so i can't help with that right this moment | 17:37 |
| sdague | jeblair: no prob | 17:37 |
| *** jcoufal_ has quit IRC | 17:37 | |
| zaro | pelix: so i'de like to propose new core reviewers for jjb and maybe remove some current ones. | 17:38 |
| fungi | i think most of the nondisruptive hosts should be up again. double-checking now | 17:38 |
| fungi | 11-minute uptimes across the board, so seems to have worked | 17:39 |
| zaro | pelix: i think waynr and yolanda are good candidates. any others you can think of? | 17:39 |
| *** leifmadsen_ is now known as leifmadsen | 17:41 | |
| *** sabeen1 has left #openstack-infra | 17:41 | |
| *** johnthetubaguy is now known as zz_johnthetubagu | 17:41 | |
| zaro | pelix: propose to remove Arnaud Babre, mgagne and Marc Abramowitz | 17:42 |
| *** dprince has quit IRC | 17:43 | |
| *** tonytan4ever has joined #openstack-infra | 17:43 | |
| pelix | zaro: Well I haven't seen anything from the three you mentioned in a long time (though might be worth just checking) | 17:43 |
| mgagne | zaro: I agree with this proposition. I feel I don't have the time to fulfil the expectations someone could reasonably have from a core reviewer | 17:43 |
| *** belmoreira has quit IRC | 17:44 | |
| pelix | zaro: waynr and yolanda are definitely contributing with reviews and code so *thumbs-up* | 17:44 |
| *** gokrokve has joined #openstack-infra | 17:44 | |
| *** MarkAtwood has quit IRC | 17:44 | |
| *** vigneshvar has quit IRC | 17:45 | |
| *** dizquierdo has joined #openstack-infra | 17:45 | |
| *** talluri has quit IRC | 17:46 | |
| *** shashankhegde has quit IRC | 17:46 | |
| clarkb | now that I have the docs in a row for es (see what I did there :) ) I am going to get bigdesk and elasticsearch head connected then start doing es nodes | 17:47 |
| *** CIBuilds has joined #openstack-infra | 17:47 | |
| yolanda | hi zaro, pelix, thx for considering me. I honestly want to contribute more and do more reviews, sometimes lack of time is a blocker | 17:47 |
| jeblair | clarkb: want to wait for coordinated downtime with the rest of the system? | 17:47 |
| clarkb | jeblair: oh ya I can do that | 17:47 |
| clarkb | I need some time anyways to get the javascript tools running | 17:47 |
| jeblair | fungi: are you ready to proceed with the disruptive nodes? | 17:47 |
| yolanda | zaro, pelix: rcarrillocruz and me wanted to take a look at jjb performance, it's very very slow for us sometimes to perform a jjb update, this is happening in your environments as well? | 17:48 |
| fungi | jeblair: yep | 17:49 |
| *** Ryan_Lane has quit IRC | 17:50 | |
| zaro | yolanda: well you've been doing more reviews with whatever time you have than some current cores, so i think a change is appropriate :) | 17:50 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for nova rpc message timeout bug 1415106 https://review.openstack.org/150493 | 17:50 |
| zaro | yolanda: yes, it's slow, but are you referring to the yaml to xml transform or for actually creating the jobs on jenkins? | 17:51 |
| jeblair | status notice Gerrit and Zuul will be offline for a few minutes for a security update | 17:51 |
| jeblair | clarkb: fungi ^ ? | 17:51 |
| fungi | jeblair: looks good | 17:51 |
| zaro | yolanda: pelix has an enhancement up for review on the updating part? | 17:51 |
| rcarrillocruz | the fact that JJB goes thru ALL jobs when you are just adding a new one seems a bit overkill | 17:52 |
| zaro | yolanda: would be a good one to test, no? | 17:52 |
| clarkb | jeblair: lgtm | 17:52 |
| jeblair | #status notice Gerrit and Zuul will be offline for a few minutes for a security update | 17:52 |
| openstackstatus | jeblair: sending notice | 17:52 |
| zaro | rcarrillocruz: do you mean does the transform on all jobs? | 17:52 |
| fungi | jeblair: clarkbL when do we want to reboot eavesdrop? wait until a lull in meetings i guess? | 17:53 |
| jeblair | fungi: i was planning on doing it at 1800 | 17:53 |
| fungi | okay | 17:53 |
| jeblair | fungi: libc is installed everywhere, right? :) | 17:53 |
| -openstackstatus- NOTICE: Gerrit and Zuul will be offline for a few minutes for a security update | 17:53 | |
| fungi | oh, i see it at item #0 there now | 17:53 |
| clarkb | I was just going to check all the es nodes to be double sure | 17:53 |
| fungi | jeblair: yes, everywhere which runs on ubuntu precise anyway | 17:53 |
| jeblair | fungi: k | 17:53 |
| *** bdpayne has quit IRC | 17:54 | |
| openstackgerrit | Valeriy Ponomaryov proposed openstack-infra/project-config: Make manila tox job 'genconfig' votable https://review.openstack.org/150521 | 17:54 |
| jeblair | clarkb: we're waiting on your okay to start | 17:54 |
| openstackstatus | jeblair: finished sending notice | 17:54 |
| rcarrillocruz | zaro: i mean the jenkins-jobs update, on our Openstack CI it takes a lot of time going thru all jobs, even though the change triggering it may be just a one job addition | 17:54 |
| fungi | oh, wait, somehow review.openstack.org claims to still have 10.9 installed | 17:55 |
| fungi | i wonder how that failed to work | 17:55 |
| *** ayoung_snowedin is now known as ayoung | 17:55 | |
| cody-somerville | Hey. Is the gerrit and zuul thing re: glibc? | 17:55 |
| fungi | cody-somerville: yeah | 17:55 |
| clarkb | jeblair: fungi I am ready to reboot the first es node (I will start with 07 and work back | 17:55 |
| jeblair | cody-somerville: yep https://lists.ubuntu.com/archives/ubuntu-security-announce/2015-January/002813.html | 17:55 |
| fungi | jeblair: clarkb: let me run one more pass on the package updates | 17:56 |
| clarkb | fungi: kk | 17:56 |
| fungi | shouldn't take long | 17:56 |
| rcarrillocruz | btw, seems there's an EPEL issue ongoing, i can't pull from epel repo | 17:56 |
| rcarrillocruz | just in case any of you see issues in CentOS machines... | 17:56 |
| *** mtanino has joined #openstack-infra | 17:56 | |
| fungi | spot checks showed everything updated, but when i went through a full dump i found several at least which didn't update for some reason | 17:56 |
| clarkb | rcarrillocruz: centos6 doesn't seem to have the package yet | 17:57 |
| clarkb | so I am ignoring centos6 for now | 17:57 |
| cody-somerville | Is there a set of instructions for safely restarting zuul with preserving the queue? I know we can dump and reload but hoping there are canonical instructions somewhere. | 17:57 |
| *** Guest28610 has joined #openstack-infra | 17:57 | |
| *** vigneshvar has joined #openstack-infra | 17:57 | |
| *** derekh has quit IRC | 17:58 | |
| *** ihrachyshka has joined #openstack-infra | 17:58 | |
| *** e0ne_ has quit IRC | 17:59 | |
| jeblair | cody-somerville: just the dump + reload. an option to have zuul save the queue itself on exit would be really helpful | 17:59 |
| mkoderer | hi folks :) | 17:59 |
| zaro | mkoderer: hi | 17:59 |
| *** maxbit has quit IRC | 17:59 | |
| yolanda | zaro, sorry, i got pinged somewhere else, looking now | 18:00 |
| mkoderer | jeblair: I need to create a new project for the telcowg group | 18:00 |
| anteaya | mkoderer: I can help you with that | 18:00 |
| *** openstack` has joined #openstack-infra | 18:05 | |
| anteaya | rcarrillocruz pelix can your conversation wait until after the reboot please? | 18:05 |
| rcarrillocruz | sure | 18:05 |
| anteaya | thanks | 18:05 |
| zaro | rcarrillocruz: i'll test on my dev setup to see. how many jobs do you have? | 18:05 |
| *** ivar-lazzaro has joined #openstack-infra | 18:05 | |
| openstackgerrit | Arvind Tiwari proposed openstack/requirements: Bumping up the testr and subunit versions https://review.openstack.org/150525 | 18:06 |
| *** MarkAtwood has joined #openstack-infra | 18:06 | |
| jeblair | morganfainberg: openstack` should fix itself eventually | 18:06 |
| *** bitblt2 has joined #openstack-infra | 18:06 | |
| *** openstack` is now known as openstack | 18:06 | |
| jeblair | morganfainberg: ande there it goes! :) | 18:06 |
| *** maxbit_ has joined #openstack-infra | 18:06 | |
| *** harlowja has joined #openstack-infra | 18:06 | |
| fungi | okay, one more package update pass running now | 18:07 |
| jeblair | fungi: was eavesdrop updated? | 18:07 |
| fungi | jeblair: yes | 18:07 |
| fungi | it was in the okay set | 18:07 |
| jeblair | whew | 18:08 |
| *** maxbit has quit IRC | 18:09 | |
| *** dizquierdo_ has joined #openstack-infra | 18:09 | |
| *** andreykurilin_ has joined #openstack-infra | 18:10 | |
| *** dizquierdo has quit IRC | 18:10 | |
| openstackgerrit | Allison Randal proposed openstack/requirements: Use oslo.rootwrap without namespace package https://review.openstack.org/150529 | 18:11 |
| *** maxbit_ has quit IRC | 18:11 | |
| fungi | update pass complete, just double checking it now | 18:11 |
| fungi | but it looked like it was catching the stragglers i knew about so hopefully fine now | 18:11 |
| *** bdpayne has joined #openstack-infra | 18:12 | |
| fungi | yep, all upgrades check out now | 18:12 |
| fungi | jeblair: clarkb: we can proceed | 18:12 |
| clarkb | I am still ready to do es | 18:12 |
| fungi | i'll put together a catch-up list of nondisruptive hosts which need another reboot once we're done with this | 18:12 |
| jeblair | okay. i'll stop zuul now | 18:13 |
| clarkb | I am rebooting es07 now | 18:13 |
| jeblair | zuul and nodepool stopped | 18:13 |
| *** achanda has joined #openstack-infra | 18:14 | |
| *** dhritishikhar has quit IRC | 18:14 | |
| *** bdpayne_ has joined #openstack-infra | 18:14 | |
| *** dhritishikhar has joined #openstack-infra | 18:14 | |
| tmcpeak | all: just to check - to be used in a project's gate tests, it is *not* required to be in global requirements? It would only be required if a project will call it with tox? | 18:14 |
| tmcpeak | where *it* is Bandit :) | 18:15 |
| tmcpeak | sorry, that wasn't clear | 18:15 |
| *** esker has quit IRC | 18:15 | |
| anteaya | tmcpeak: plesse save your question for after our reboot | 18:15 |
| tmcpeak | anteaya: yep, sounds good | 18:15 |
| *** andreykurilin|ho has joined #openstack-infra | 18:15 | |
| jeblair | clarkb: the es docs say this is a no downtime thing -- do we need to wait for it? | 18:15 |
| *** andreykurilin_ has quit IRC | 18:15 | |
| anteaya | tmcpeak: thanks | 18:15 |
| pelix | zaro yolanda rcarrillocruz: might have to wait until tomorrow for me, supposed to leave 45mins ago for training :( | 18:16 |
| clarkb | jeblair: that is what I was trying to say its no downtime for es :) but we will most likely index slower and make things backup | 18:17 |
| clarkb | jeblair: so I am not super concerned about doing it all at the same time with gerrit and zuul | 18:17 |
| clarkb | we just have to recognize things will be slow for a bit | 18:17 |
| *** bdpayne has quit IRC | 18:17 | |
| clarkb | 07 is resyncing into the cluster now | 18:17 |
| jeblair | clarkb: okay, so i think we can proceed with restarting gerrit and zuul momentarily, and es should have a good window of an hour before it sees load | 18:18 |
| clarkb | jeblair: yup | 18:18 |
| *** markmcclain has joined #openstack-infra | 18:19 | |
| jeblair | i'm restarting nodepool now so it can delete a bunch of nodes before they finish | 18:19 |
| *** sabeen1 has joined #openstack-infra | 18:19 | |
| *** timcline has joined #openstack-infra | 18:19 | |
| clarkb | kk | 18:19 |
| *** pelix has quit IRC | 18:19 | |
| jeblair | fungi: when it's done, i'll ask you to proceed with reboots | 18:19 |
| fungi | of the servers which didn't get updated in the first pass, only 10 were on the non-disruptive list so i'm rebooting those now | 18:19 |
| fungi | k | 18:19 |
| *** gyee has joined #openstack-infra | 18:20 | |
| clarkb | fungi: were any logstash nodes? they don;t start their workers on boot | 18:20 |
| clarkb | I dealt with that the first round | 18:20 |
| fungi | clarkb: logstash-worker17 logstash-worker19 logstash-worker20 | 18:20 |
| *** Guest28610 has quit IRC | 18:21 | |
| fungi | thanks for the reminder | 18:21 |
| clarkb | kk will kick those in a bit | 18:21 |
| fungi | weird that the sources.list file was so randomly different | 18:21 |
| fungi | i couldn't find any obvious pattern to explain why some were set the way we wanted and some were using rackspace's mirror for security updates | 18:22 |
| jeblair | fungi: i think it was the result of different base images | 18:22 |
| jeblair | ++mordred's work to boot infra from our own | 18:22 |
| fungi | didn't look like it was only systems built in a certain period of time or anything | 18:22 |
| *** ddieterly has quit IRC | 18:22 | |
| clarkb | hrm we have a bunch of small indexes that are taking longer to resync on 07 than I expected. I will probably clear all of them out before continuing (they are for older dates that should've been deleted guessing events came in with funky timestamps so we reindexed to those indexes) | 18:22 |
| *** ddieterl_ has joined #openstack-infra | 18:22 | |
| *** markvoelker has quit IRC | 18:22 | |
| fungi | like, the logstash workers... 17-20 were built at teh same time roughly, but 18 appears to have been not using the mirror for that | 18:23 |
| *** jerryz has quit IRC | 18:24 | |
| *** teran has quit IRC | 18:24 | |
| *** markvoelker has joined #openstack-infra | 18:24 | |
| *** jroll has quit IRC | 18:24 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/reviewstats: Sync tripleo cores for recently removed members https://review.openstack.org/150533 | 18:25 |
| fungi | the oss-security ml is all asplodey over this vulnerability | 18:25 |
| *** kurtmartin has quit IRC | 18:25 | |
| *** patrickeast has quit IRC | 18:25 | |
| *** bswartz has quit IRC | 18:26 | |
| *** jroll has joined #openstack-infra | 18:26 | |
| fungi | on a positive note, so far the risk analysis has only turned up exim as a commonly-used service which can be leveraged to exploit it | 18:26 |
| mordred | jeblair: getting closer | 18:26 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/reviewstats: Sync tripleo cores for recently removed members https://review.openstack.org/150533 | 18:26 |
| mordred | jeblair: if I could get keystone sessions to work with novaclient with both rackspace and hp I'd be much less ragey about it right now | 18:27 |
| mordred | jamielennox: ^^ btw when you're around | 18:27 |
| jamielennox | mordred: i'm here - early keystone meetings. | 18:27 |
| *** MarkAtwood has quit IRC | 18:27 | |
| jamielennox | mordred: what's missing | 18:27 |
| clarkb | speaking of meetings, while I wait for 07 to make the cluster happy again I am going to get tea and breakfast | 18:27 |
| anteaya | mordred jamielennox I have asked for any non-libc update reboot conversations to hold off until the work is done | 18:28 |
| fungi | on a positive note, this situation has sparked a wonderful discussion on why security firms need to _stop_ engaging pr agencies pre-disclosure to help with their "big splash" announcements | 18:28 |
| *** ssam2 has quit IRC | 18:28 | |
| *** markmcclain has quit IRC | 18:28 | |
| *** gokrokve_ has joined #openstack-infra | 18:28 | |
| *** tjones1 has joined #openstack-infra | 18:28 | |
| fungi | hopefully the fad of assigning catchy names to them will soon pass as well | 18:28 |
| clarkb | fungi: does this one have a name yet? | 18:29 |
| fungi | "ghost" | 18:29 |
| clarkb | that isn't catchy enough | 18:29 |
| *** xyang0 has quit IRC | 18:29 | |
| clarkb | should've been ghostheart or similar | 18:29 |
| jeblair | fungi: i think we can proceed with the reboots now | 18:29 |
| fungi | okay, firing now | 18:29 |
| *** JayF has quit IRC | 18:30 | |
| fungi | our world is now rebooting | 18:30 |
| *** jroll has quit IRC | 18:30 | |
| *** jroll has joined #openstack-infra | 18:30 | |
| *** openstackgerrit has quit IRC | 18:30 | |
| * dims cross fingers and toes! | 18:31 | |
| fungi | at least the ubuntu precise bits of it at any rate | 18:31 |
| *** jlibosva has quit IRC | 18:31 | |
| clarkb | still nothing on centos announce or centos6 updates package list | 18:31 |
| jeblair | clarkb: apparently rhel has packages now | 18:31 |
| *** MarkAtwood has joined #openstack-infra | 18:31 | |
| *** JayF has joined #openstack-infra | 18:31 | |
| *** spandhe has joined #openstack-infra | 18:31 | |
| *** gokrokve has quit IRC | 18:31 | |
| fungi | the non-disruptive stragglers i re-rebooted all have 10-minute uptimes now btw | 18:31 |
| fungi | so all seems well on that front | 18:32 |
| clarkb | jeblair: cool hopefully that means centos6 is not far behind | 18:32 |
| *** openstackgerrit has joined #openstack-infra | 18:32 | |
| clarkb | have jenkinses been rebooted yet? | 18:32 |
| clarkb | I was going to suggested stopping the jenkins process first to make sockets clean up cleanly | 18:33 |
| *** gokrokve_ has quit IRC | 18:33 | |
| *** Kerralissa has joined #openstack-infra | 18:33 | |
| *** jlibosva has joined #openstack-infra | 18:34 | |
| jeblair | clarkb: sockets clean up cleanly? | 18:34 |
| fungi | the other end of those sockets were all going away too | 18:35 |
| fungi | servers are all up again, so time to find out what didn't start properly on boot | 18:35 |
| *** jlibosva has quit IRC | 18:35 | |
| *** spzala has quit IRC | 18:36 | |
| fungi | we're at ~4-5 minutes uptime on all of them | 18:36 |
| fungi | gerrit seems to be working | 18:36 |
| jeblair | reloading zuul's queue | 18:36 |
| *** homeless has joined #openstack-infra | 18:36 | |
| fungi | i hope jenkins masters have re-registered jobs in gearman already | 18:36 |
| fungi | looking | 18:36 |
| fungi | there are a ton at any rate | 18:37 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard-webclient: An experimental improvement on the dashboard event list. https://review.openstack.org/149127 | 18:37 |
| dstufft | yay for 2 year old patches | 18:37 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard-webclient: Parse event_info into JSON. https://review.openstack.org/149126 | 18:37 |
| fungi | and i see a ready bare-precise node, so that hopefully won't be a thorn in our side this time around | 18:38 |
| *** e0ne has joined #openstack-infra | 18:38 | |
| *** e0ne is now known as e0ne_ | 18:38 | |
| fungi | dstufft: rebooted all the things already? | 18:39 |
| *** clif_h has quit IRC | 18:39 | |
| fungi | s/rebooted/restarted/ as appropriate | 18:39 |
| dstufft | my things are all on Ubuntu 14.04 | 18:39 |
| fungi | you're ahead of the curve | 18:39 |
| fungi | we're still beating that drum for a while i think | 18:39 |
| clarkb | jeblair we have noticed that nodepool doesnt always close its zmq connections when you just reboot a jenkins | 18:40 |
| *** HeOS has quit IRC | 18:40 | |
| dstufft | there's a moral to be had here about having LTS releases that are too long | 18:40 |
| *** markmcclain has joined #openstack-infra | 18:41 | |
| *** MarkAtwood has quit IRC | 18:42 | |
| *** MarkAtwood has joined #openstack-infra | 18:42 | |
| *** e0ne_ is now known as e0ne | 18:43 | |
| jeblair | clarkb, fungi: so i think we're just waiting on es and centos, right? | 18:43 |
| anteaya | jeblair: can folks converse in channel again? | 18:44 |
| davidlenwell | heya .. im getting a merg conflict message on a review .. but im not seeing any conflicts.. is something broken? https://review.openstack.org/#/c/150536/1 | 18:44 |
| jeblair | anteaya: if you wish it :) | 18:44 |
| anteaya | jeblair: :) | 18:44 |
| anteaya | thanks for your patience and understanding everyone | 18:44 |
| fungi | jeblair: to my knowledge, yes | 18:44 |
| anteaya | we appreciate it | 18:44 |
| clarkb | jeblair yup | 18:44 |
| anteaya | do continue with your regular workflow | 18:44 |
| jeblair | davidlenwell: might have been due to the zuul reboot we just did; try recheck | 18:45 |
| davidlenwell | k .. just wanted to check before overloading you with rechecks | 18:45 |
| jeblair | ValueError: Failed to parse line: 'Total 5 (delta 4), reused 5 (delta 4)' | 18:46 |
| jeblair | hrm, i think we may have some mergers with a bad git python version? | 18:46 |
| clarkb | oh we are hitting that now? its the thing asselin fixed with newer gitpython | 18:46 |
| clarkb | there is a change to bump the min version of that dep | 18:46 |
| zxiiro | so I have a +2 on some of my patches but they are not merged yet. Just wondering what's missing? | 18:46 |
| fungi | there is a patch outstanding for that yeah? rcarrillocruz? | 18:47 |
| fungi | oh, it was asselin_ | 18:47 |
| zxiiro | These are the patches: https://review.openstack.org/#/q/owner:%22Thanh+Ha%22+status:open,n,z | 18:47 |
| asselin_ | fungi, what's up? | 18:47 |
| clarkb | zxiiro you need a second +2 and approval | 18:48 |
| rcarrillocruz | zaro: dunno, do you have a link? | 18:48 |
| *** markmcclain has quit IRC | 18:48 | |
| fungi | asselin_: we're running into your bug now | 18:48 |
| zxiiro | clarkb: oh I see, thanks that explains it. | 18:48 |
| fungi | https://review.openstack.org/149336 | 18:48 |
| asselin_ | oh, zuul merger issues :) https://review.openstack.org/#/c/149336/ | 18:48 |
| *** e0ne has quit IRC | 18:49 | |
| *** SergeyLukjanov has quit IRC | 18:49 | |
| jeblair | fungi: can you ansible that onto all of the mergers and restart them? | 18:49 |
| *** markmcclain has joined #openstack-infra | 18:50 | |
| fungi | jeblair: doing now | 18:50 |
| *** bitblt2 has quit IRC | 18:50 | |
| *** markmcclain has quit IRC | 18:50 | |
| mriedem | this has been around for awhile, has a +2, so i'm going to make a shameless ask for core review https://review.openstack.org/#/c/142193/ | 18:50 |
| jeblair | i guess "pip install GitPython==0.3.3" | 18:50 |
| asselin_ | pip install -U GitPython==0.3.3 | 18:50 |
| *** gokrokve has joined #openstack-infra | 18:50 | |
| jeblair | right that | 18:51 |
| *** che-arne has quit IRC | 18:51 | |
| fungi | -U will update anything else gitpython depends on too though | 18:51 |
| asselin_ | actually they should both work, I had to downgrade... | 18:51 |
| asselin_ | so needed -U | 18:51 |
| fungi | the explicit version match without -U will work and be safer | 18:51 |
| *** markmcclain has joined #openstack-infra | 18:51 | |
| asselin_ | fungi, ++ | 18:51 |
| jeblair | asselin_: your patch says >=0.3.3; are you saying something higher is broken? | 18:51 |
| asselin_ | jeblair, no, everything >= 0.3 works | 18:52 |
| *** SergeyLukjanov has joined #openstack-infra | 18:52 | |
| *** hj-hp has quit IRC | 18:52 | |
| fungi | however earlier versions worked too, right? | 18:52 |
| asselin_ | fungi, no | 18:52 |
| *** harlowja has quit IRC | 18:52 | |
| fungi | then how were we running it? | 18:52 |
| jeblair | fungi: we don't restart mergers very often | 18:53 |
| fungi | oh, maybe we added a dependency on some new behavior which worked in testing and hadn't restarted yet, yeah | 18:53 |
| asselin_ | fungi: no idea. same thing happened to my setup...all of the sudden it stopped working... | 18:53 |
| jeblair | fungi: and someone merged a patch requiring >=0.3.2.1 in december | 18:53 |
| clarkb | I was thinking git version change | 18:53 |
| clarkb | but I coldn't get the people seeing it to confirm that | 18:53 |
| jeblair | fungi: so it was installed then, but not run | 18:53 |
| asselin_ | but my commit message is wrong. sorry 0.3.3 --> 0.3 | 18:53 |
| jeblair | asselin_: your commit message matches your patch | 18:54 |
| jeblair | asselin_: what version are you running? | 18:54 |
| fungi | okay, updated and zuul-merger daemons all restarted | 18:54 |
| rcarrillocruz | erm, fungi: dunno, do you have a link? not aware of it... (sorry, i replied to zaro, got confused) | 18:54 |
| asselin_ | jeblair, now I'm at the latest | 18:54 |
| asselin_ | 0.3.6 | 18:54 |
| asselin_ | sorry. confusing myself | 18:54 |
| fungi | rcarrillocruz: i momentarily mistook you for asselin_. sorry! | 18:54 |
| rcarrillocruz | haha | 18:55 |
| rcarrillocruz | ok, and then I mistook you for zaro | 18:55 |
| rcarrillocruz | /facepalm | 18:55 |
| fungi | rcarrillocruz: it happens. we have the same haircut | 18:55 |
| *** markmcclain has quit IRC | 18:55 | |
| asselin_ | jeblair, I'm at GitPython==0.3.6 | 18:55 |
| asselin_ | , commit message is correct. sorry for the confusion | 18:55 |
| *** baoli has joined #openstack-infra | 18:56 | |
| *** gokrokve has quit IRC | 18:56 | |
| *** gokrokve has joined #openstack-infra | 18:56 | |
| *** BharatK has quit IRC | 18:56 | |
| *** coolsvap is now known as coolsvap|afk | 18:56 | |
| *** spzala has joined #openstack-infra | 18:56 | |
| jeblair | fungi, asselin_: okay, to summarize, our best knowledge is that this is fixed earliest in 0.3.3. it is still fixed in 0.3.6 which asselin_ is currently running. sound about right? | 18:56 |
| asselin_ | yes | 18:57 |
| boris-42 | fungi: jeblair did you notice any issues with merge conflict checker? | 18:57 |
| jeblair | boris-42: read like the last few lines of scrollback please | 18:57 |
| boris-42 | jeblair: oh thanks | 18:57 |
| fungi | jeblair: and we're now running on 0.3.3 | 18:57 |
| fungi | so i guess we'll know shortly if it's not sufficient | 18:57 |
| jeblair | fungi: last error i saw in the zm01 log was at 18:49 | 18:58 |
| jeblair | it has merged several since then | 18:58 |
| fungi | perfect | 18:58 |
| fungi | that roughly coincides with when i updated them all | 18:58 |
| jeblair | i'm restarting zuul | 18:58 |
| clarkb | jeblair: is that restart for libc or gitpython or both? | 18:59 |
| clarkb | (I thought zuul may have already been done with libc) | 18:59 |
| jeblair | and will re-enqueue the original saved queues as well as ones that i have just saved | 18:59 |
| *** ivar-lazzaro has quit IRC | 18:59 | |
| jeblair | to correct for false merger errors | 18:59 |
| fungi | clarkb: to redo the failed merges | 18:59 |
| clarkb | gotcha | 18:59 |
| *** ivar-lazzaro has joined #openstack-infra | 19:00 | |
| *** rgerganov has joined #openstack-infra | 19:00 | |
| asselin_ | one more issue I should mention. I had to fumble a bit with zuul and zuul merger start order. I found this to work: start zuul-merger, start zuul, stop zuul, start zuul. Not sure why.... | 19:00 |
| jeblair | waiting for a bare-precise node to online | 19:00 |
| fungi | pudding^H^H^H^H^H^H^Hmeeting time! | 19:00 |
| mtreinish | clarkb, fungi: so I think every gerrit review is going into a merge conflict state | 19:01 |
| mtreinish | oh, I probably should read before typing... | 19:01 |
| fungi | mtreinish: already in the process of getting fixed | 19:01 |
| zaro | rcarrillocruz: you would look great with fungi's hair | 19:02 |
| clarkb | zaro: ha | 19:02 |
| jeblair | okay, bare-precise is online, so reloading queues now | 19:02 |
| rcarrillocruz | i USED to have long hair | 19:02 |
| *** doug-fish has quit IRC | 19:02 | |
| rcarrillocruz | i'll show you pics sometime :P | 19:02 |
| rcarrillocruz | baby bath time | 19:02 |
| rcarrillocruz | laterz | 19:02 |
| anteaya | rcarrillocruz: sounds better than rebooting | 19:03 |
| *** spzala has quit IRC | 19:03 | |
| *** rm_work|away is now known as rm_work | 19:03 | |
| *** nelsnels_ has joined #openstack-infra | 19:03 | |
| *** unicell has joined #openstack-infra | 19:03 | |
| *** unicell has quit IRC | 19:03 | |
| *** unicell has joined #openstack-infra | 19:03 | |
| jeblair | i see one merge conflict in the status page: https://review.openstack.org/#/c/142534/ | 19:04 |
| *** yolanda has quit IRC | 19:04 | |
| jeblair | maybe it's real | 19:05 |
| *** otter768 has joined #openstack-infra | 19:05 | |
| *** yolanda has joined #openstack-infra | 19:06 | |
| *** nelsnelson has quit IRC | 19:06 | |
| *** baoli has quit IRC | 19:06 | |
| *** annegent_ has joined #openstack-infra | 19:06 | |
| vipul | seeing a mirroring issue.. http://git.openstack.org/cgit/stackforge/python-cueclient/tree/ vs. https://github.com/stackforge/python-cueclient | 19:07 |
| stevemar | soooo... whats with all the non-real-merge-conflicts? | 19:08 |
| *** dhritishikhar has quit IRC | 19:08 | |
| *** baoli has joined #openstack-infra | 19:08 | |
| asselin_ | steve should be fixed now | 19:08 |
| pleia2 | stevemar: a series of reboots due to a security issue is getting things a bit out of sync, the team is working on it | 19:08 |
| stevemar | pleia2, asselin_ wonderful :) | 19:09 |
| *** berendt has joined #openstack-infra | 19:09 | |
| *** hj-hp has joined #openstack-infra | 19:09 | |
| *** dprince has joined #openstack-infra | 19:09 | |
| fungi | vipul: github setup seems to have failed with that project partway through so our gerrit server didn't have the permission it needed. fixed now | 19:09 |
| *** otter768 has quit IRC | 19:09 | |
| vipul | fungi: cool - thanks! | 19:10 |
| *** MarkAtwood has quit IRC | 19:11 | |
| *** mmedvede__ has quit IRC | 19:11 | |
| *** jedimike has quit IRC | 19:12 | |
| *** _nadya_ has quit IRC | 19:12 | |
| *** markvoelker has quit IRC | 19:12 | |
| *** MarkAtwood has joined #openstack-infra | 19:12 | |
| *** baoli_ has joined #openstack-infra | 19:13 | |
| *** markvoelker has joined #openstack-infra | 19:14 | |
| *** BharatK has joined #openstack-infra | 19:15 | |
| *** unicell1 has joined #openstack-infra | 19:15 | |
| *** doug-fish has joined #openstack-infra | 19:15 | |
| *** unicell has quit IRC | 19:16 | |
| *** baoli has quit IRC | 19:16 | |
| *** krtaylor has quit IRC | 19:17 | |
| *** salv-orlando has quit IRC | 19:17 | |
| *** teran has joined #openstack-infra | 19:17 | |
| stevemar | fungi, on the topic of mirroring... http://git.openstack.org/cgit/openstack/oslo.policy/tree/ vs https://github.com/openstack/oslo.policy | 19:17 |
| openstackgerrit | Michael Still proposed openstack-infra/project-config: Create a new python-novaclient-core group https://review.openstack.org/150552 | 19:17 |
| stevemar | it's going through graduation, so maybe it's a bit early still? | 19:18 |
| fungi | stevemar: nope, just the same issue as that other project. i'll fix it. the github api is unreliable | 19:18 |
| stevemar | fungi, yay - thanks :) | 19:18 |
| fungi | stevemar: all better now | 19:19 |
| stevemar | yay | 19:19 |
| *** MarkAtwood has quit IRC | 19:19 | |
| *** MarkAtwood has joined #openstack-infra | 19:20 | |
| *** achanda has quit IRC | 19:22 | |
| *** ivar-laz_ has joined #openstack-infra | 19:23 | |
| *** jistr has quit IRC | 19:23 | |
| openstackgerrit | Michael Still proposed openstack-infra/project-config: Create a new python-novaclient-core group https://review.openstack.org/150552 | 19:24 |
| *** thedodd has quit IRC | 19:24 | |
| *** fandi has quit IRC | 19:24 | |
| *** MarkAtwood has quit IRC | 19:25 | |
| *** ivar-lazzaro has quit IRC | 19:26 | |
| anteaya | fungi: can I trouble you to +A https://review.openstack.org/#/c/150552/ and then add mikal to the new gerrit group since he is awake right now? | 19:26 |
| fungi | anteaya: already did | 19:26 |
| anteaya | fungi: thank you :) | 19:26 |
| fungi | i'll update the group as soon as it shows up in gerrit | 19:27 |
| anteaya | fungi: thank yiou | 19:27 |
| *** MarkAtwood has joined #openstack-infra | 19:27 | |
| *** radez is now known as radez_g0n3 | 19:27 | |
| *** harlowja has joined #openstack-infra | 19:28 | |
| pleia2 | https://review.openstack.org/#/c/144709/ is looking for a +A too, they have a big event coming in a couple weeks and were hoping to start using the list (re: openstack-community list) | 19:28 |
| *** andreykurilin|ho has quit IRC | 19:29 | |
| *** dims has quit IRC | 19:29 | |
| *** fandi has joined #openstack-infra | 19:29 | |
| anteaya | pleia2: will the Korean characters be accepted in the .pp file or will it choke? | 19:29 |
| *** krtaylor has joined #openstack-infra | 19:30 | |
| *** erikmwilson has quit IRC | 19:30 | |
| clarkb | I think puppet should understand utf8 now | 19:30 |
| anteaya | okay, thanks | 19:30 |
| openstackgerrit | Doug Hellmann proposed openstack/requirements: Use oslo.messaging 1.6.0 without namespace package https://review.openstack.org/150556 | 19:30 |
| *** Guest22067 is now known as erikmwilson | 19:31 | |
| *** annegent_ has quit IRC | 19:31 | |
| fungi | i just approved it. i already had +2 on it but SergeyLukjanov didn't approve when he added his +2 | 19:31 |
| pleia2 | thanks | 19:32 |
| *** hdd has quit IRC | 19:34 | |
| tmcpeak | ok now that everything has calmed down :) - just to confirm - to run Bandit in a gate test, it is not required for Bandit to be included in global requirements? | 19:34 |
| *** dims has joined #openstack-infra | 19:34 | |
| clarkb | tmcpeak: what do you mean by run bandit in a gate test? | 19:34 |
| nibalizer | tmcpeak: everything has calmed, but part of that is everyone is in the meeting :) | 19:34 |
| *** talluri has joined #openstack-infra | 19:34 | |
| openstackgerrit | Doug Hellmann proposed openstack/requirements: Use oslo.rootwrap without namespace package https://review.openstack.org/150529 | 19:34 |
| clarkb | tmcpeak: if you want nova to test using bandit then es you need it in global reqs | 19:35 |
| clarkb | tmcpeak: if you want bandit to test itself then no it is not needed in global reqs | 19:35 |
| *** annegent_ has joined #openstack-infra | 19:35 | |
| *** ddieterl_ has quit IRC | 19:36 | |
| tmcpeak | nibalizer: ahh | 19:37 |
| *** e0ne has joined #openstack-infra | 19:37 | |
| tmcpeak | clarkb: ok, even in a gate test? I know that if a project wants to include Bandit in its tox tests, Bandit needs to be in global reqs | 19:37 |
| openstackgerrit | Merged openstack-infra/system-config: Added a language-specific list: Korean https://review.openstack.org/144709 | 19:37 |
| *** Guest28610 has joined #openstack-infra | 19:37 | |
| tmcpeak | but is there another process that is run in the gate? | 19:37 |
| clarkb | tmcpeak: no we use tox in the gate | 19:37 |
| tmcpeak | clarkb: hmm ok, I'm getting some conflicting information | 19:38 |
| tmcpeak | https://review.openstack.org/#/c/150138/3 | 19:38 |
| *** afazekas has quit IRC | 19:38 | |
| *** annegent_ has quit IRC | 19:39 | |
| clarkb | tmcpeak: jd__ is mistaken you need to add it for linting too | 19:39 |
| tmcpeak | ok | 19:40 |
| *** talluri has quit IRC | 19:40 | |
| tmcpeak | I'll restore the change then? | 19:40 |
| tmcpeak | clarkb: ^ | 19:40 |
| *** annegent_ has joined #openstack-infra | 19:40 | |
| clarkb | tmcpeak: yes, also you should pin bandit. always pin static analysis tools | 19:40 |
| tmcpeak | clarkb: pin? | 19:40 |
| clarkb | tmcpeak: only allow a specific version | 19:41 |
| tmcpeak | oh, pin version | 19:41 |
| clarkb | that way you don't break those jos whenever a new version comes out with stricter checks | 19:41 |
| tmcpeak | clarkb: I see | 19:41 |
| tmcpeak | clarkb: I guess that requires us to have some good versioning :) | 19:41 |
| tmcpeak | clarkb: ok, thank you. I'll go set that up | 19:42 |
| openstackgerrit | Lucas Dutra Nunes proposed openstack-infra/jenkins-job-builder: builders: add cmakebuilder plugin support https://review.openstack.org/134199 | 19:44 |
| BharatK | Can any one please tell me how to use this patch https://review.openstack.org/#/c/145321/ | 19:45 |
| BharatK | In my patch https://review.openstack.org/#/c/143308/7/devstack-vm-gate.sh | 19:45 |
| *** Sukhdev has joined #openstack-infra | 19:48 | |
| *** erikmwil_ has joined #openstack-infra | 19:48 | |
| *** erikmwilson has quit IRC | 19:48 | |
| *** erikmwil_ is now known as erikmwilson | 19:48 | |
| *** adalbas has quit IRC | 19:49 | |
| *** erikmwil- has joined #openstack-infra | 19:49 | |
| *** dizquierdo_ has quit IRC | 19:50 | |
| jeblair | zuul has a healthy backlog now, but i haven't seen any more merge conflicts, so i think that's better | 19:50 |
| *** ddieterly has joined #openstack-infra | 19:51 | |
| *** ddieterly has quit IRC | 19:51 | |
| *** ddieterly has joined #openstack-infra | 19:52 | |
| openstackgerrit | Doug Hellmann proposed openstack-dev/pbr: Update README format to match release notes tool https://review.openstack.org/150563 | 19:52 |
| *** patrickeast has joined #openstack-infra | 19:52 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Pass service_name to nova_client constructor https://review.openstack.org/150564 | 19:52 |
| *** nelsnels_ has quit IRC | 19:54 | |
| *** nelsnelson has joined #openstack-infra | 19:54 | |
| *** teran_ has joined #openstack-infra | 19:55 | |
| sigmavirus24 | Is something up with etherpad.openstack.org? | 19:56 |
| *** nelsnelson has quit IRC | 19:56 | |
| clarkb | we rebooted allthe things | 19:56 |
| clarkb | give it a refresh | 19:56 |
| sigmavirus24 | okay | 19:56 |
| *** nelsnelson has joined #openstack-infra | 19:57 | |
| pleia2 | actually, I'm having some issues too, did some hard reloads a few minutes ago, and now it's showing me as disconnected again | 19:57 |
| *** bswartz has joined #openstack-infra | 19:57 | |
| sigmavirus24 | yep | 19:57 |
| sigmavirus24 | == pleia2 | 19:57 |
| *** dimtruck is now known as zz_dimtruck | 19:57 | |
| *** rgerganov has quit IRC | 19:57 | |
| *** bcourt has quit IRC | 19:58 | |
| *** teran has quit IRC | 19:58 | |
| *** zz_dimtruck is now known as dimtruck | 19:58 | |
| fungi | so, we did recently merge a change i think to implement some improved socket handling in apache on that server, right? maybe it didn't take effect until the restart? | 19:59 |
| fungi | and is at fault? | 19:59 |
| pleia2 | it's struggling to load the pads now | 19:59 |
| anteaya | clarkb: sdague is talking dns issues with rackspace folks at nova mid-cycle | 19:59 |
| pleia2 | fungi: could be, etherpad is weird | 19:59 |
| anteaya | clarkb: sdague mentioned you would have requirements for something | 19:59 |
| clarkb | fungi: possibly | 19:59 |
| clarkb | fungi: though wasn't that only on apache 2.4? | 19:59 |
| *** patrickeast has quit IRC | 20:00 | |
| pleia2 | ah yeah, it was | 20:00 |
| clarkb | anteaya: sdague: can has more info? you mean dns as a service or dns resolution on nodes in the cloud? | 20:00 |
| anteaya | the secone one I think | 20:00 |
| anteaya | listening in without slowing down the conversation | 20:00 |
| anteaya | doing the best I can to provide support material to keep the conversation going | 20:01 |
| *** mescanef has quit IRC | 20:01 | |
| clarkb | anteaya: for the second one we want DNSSEC, we want to be able to resolve against the resolver configured by the cloud without running into blacklist problems with recycled IPs | 20:01 |
| *** imcsk8_ has quit IRC | 20:01 | |
| *** dprince has quit IRC | 20:01 | |
| *** imcsk8 has joined #openstack-infra | 20:01 | |
| *** sabeen3 has joined #openstack-infra | 20:01 | |
| *** patrickeast has joined #openstack-infra | 20:01 | |
| fungi | i'm getting apache proxy errors loading the libc6 etherpad we were on | 20:02 |
| fungi | okay, now it's working again | 20:02 |
| fungi | though it says i'm the only one connected to it | 20:02 |
| pleia2 | I got this a couple times (just copied it now) http://paste.openstack.org/show/162895/ | 20:02 |
| anteaya | clarkb: that is the one under discussion yes | 20:02 |
| pleia2 | ctrl f5 shows me back to trying to load the pad (unsuccessfully) | 20:02 |
| *** sabeen1 has quit IRC | 20:02 | |
| pleia2 | ah, there it goes | 20:02 |
| openstackgerrit | Khai Do proposed stackforge/python-jenkins: Update and clean up docs https://review.openstack.org/149694 | 20:03 |
| anteaya | clarkb: sdague is chairing this conversation and will update when he gets in front of a keyboard again | 20:03 |
| *** Kerralissa has quit IRC | 20:03 | |
| fungi | [Tue Jan 27 20:01:33 2015] init: etherpad-lite main process (17993) terminated with status 1 | 20:03 |
| fungi | [Tue Jan 27 20:01:33 2015] init: etherpad-lite main process ended, respawning | 20:03 |
| clarkb | anteaya: thanks. It would also be cool if I got automagic dns resolution for my tenant/project based on names I give nodes | 20:03 |
| fungi | yeah, this is what we were seeing at the summit i bet | 20:03 |
| clarkb | anteaya: so that if I boot a node called foobar it resolves at foobar.local or whatever | 20:03 |
| *** persia has quit IRC | 20:04 | |
| clarkb | fungi: let me check the etherpad log | 20:04 |
| *** persia has joined #openstack-infra | 20:04 | |
| *** persia has quit IRC | 20:04 | |
| *** persia has joined #openstack-infra | 20:04 | |
| clarkb | /var/log/eplite/access.log | 20:04 |
| *** teran has joined #openstack-infra | 20:05 | |
| pleia2 | 74.95.15.41 is me if you want to zero in on something | 20:05 |
| anteaya | clarkb: mikal heard that and spoke up to say that would be a nova feature | 20:05 |
| HenryG | Scrolling back I see that the "every patch sees a merge conflict" issue has been fixed.(?) Do we need to recheck manually? | 20:05 |
| *** arxcruz has quit IRC | 20:05 | |
| anteaya | clarkb: I said that we dont' care where it comes from but you would like it | 20:05 |
| *** aysyd has quit IRC | 20:06 | |
| *** teran_ has quit IRC | 20:06 | |
| *** bradjones has quit IRC | 20:07 | |
| clarkb | logrotate on the etherpad logs doesn't seem to work properly | 20:07 |
| clarkb | we hae two massive log files and thats it | 20:07 |
| pleia2 | ew | 20:08 |
| *** stevemar has quit IRC | 20:08 | |
| *** stevemar has joined #openstack-infra | 20:08 | |
| clarkb | pleia2 fungi: ERROR: Problem while initalizing the database there is a bit of that | 20:09 |
| clarkb | could it be that etherpad is now affected by the thing that seemed to bug logdeit? | 20:09 |
| *** VijayTripathi has joined #openstack-infra | 20:10 | |
| clarkb | I am tailing the running log to see if that continues | 20:10 |
| fungi | that would be seriously unfortunate | 20:11 |
| *** _nadya_ has joined #openstack-infra | 20:13 | |
| pleia2 | it's behaving for me now, but could be people just stopped trying to access it for a bit | 20:13 |
| *** thedodd has joined #openstack-infra | 20:13 | |
| *** hj-hp has quit IRC | 20:13 | |
| clarkb | could be, it is working for me too and I don't see those connection errors either | 20:13 |
| *** bradjones has joined #openstack-infra | 20:13 | |
| clarkb | maybe our db node was rebooted too? | 20:13 |
| fungi | at the summit we were seeing "thundering herd" behavior where a blip on the conference network would dump all the active sessions to the etherpad and everyone's browser would all reconnect at once, then etherpad would get overloaded in the rush, throw its hands up and restart | 20:14 |
| *** ldnunes has quit IRC | 20:14 | |
| clarkb | which may have happened after we restarted | 20:15 |
| fungi | yeah | 20:15 |
| clarkb | but then as things fail a few more times they thunder less | 20:15 |
| openstackgerrit | Aaron Rosen proposed openstack-infra/project-config: Add stackforge/python-cloudfoundryclient https://review.openstack.org/149173 | 20:16 |
| fungi | also possible this is actually being triggered by blips on the local network where the nova meetup is being held? how many people do you have there sharing that space? | 20:16 |
| anteaya | 53 | 20:16 |
| anteaya | fungi: are you talking about etherpad? | 20:16 |
| anteaya | we have a few open | 20:16 |
| fungi | anteaya: yeah | 20:16 |
| fungi | that's probably a bit low to be solely responsible but it might be contributing with everything else going on at the same time | 20:17 |
| *** vigneshvar has quit IRC | 20:17 | |
| *** Hefeweiz1n has quit IRC | 20:17 | |
| clarkb | still no errors in my tailing | 20:18 |
| clarkb | I am going to step out for a bit to do all the things I should've done today that go back burnered | 20:18 |
| fungi | today has been a pretty abject loss for me so far | 20:19 |
| fungi | then again, tuesdays are never very productive | 20:19 |
| *** baoli_ has quit IRC | 20:20 | |
| *** timcline has quit IRC | 20:21 | |
| *** kurtmartin has joined #openstack-infra | 20:21 | |
| mordred | s/tuesdays// | 20:21 |
| *** timcline has joined #openstack-infra | 20:21 | |
| *** openstack has joined #openstack-infra | 20:39 | |
| *** sendak.freenode.net sets mode: +ns | 20:39 | |
| *** sendak.freenode.net sets mode: -o openstack | 20:44 | |
| -sendak.freenode.net- *** Notice -- TS for #openstack-infra changed from 1422391140 to 1315517032 | 20:44 | |
| *** sendak.freenode.net sets mode: +ct-s | 20:44 | |
| *** Hefeweizen has joined #openstack-infra | 20:44 | |
| *** achanda has joined #openstack-infra | 20:44 | |
| *** rackertom_ has joined #openstack-infra | 20:44 | |
| *** bcourt has joined #openstack-infra | 20:44 | |
| *** carl_baldwin has joined #openstack-infra | 20:44 | |
| *** sparkycollier has joined #openstack-infra | 20:44 | |
| *** vigneshvar has joined #openstack-infra | 20:44 | |
| *** ivar-lazzaro has joined #openstack-infra | 20:44 | |
| *** cyeoh has joined #openstack-infra | 20:44 | |
| *** rackertom has joined #openstack-infra | 20:44 | |
| *** roaet- has joined #openstack-infra | 20:44 | |
| *** jvrbanac_ has joined #openstack-infra | 20:44 | |
| *** dimtruck has joined #openstack-infra | 20:44 | |
| *** spzala has joined #openstack-infra | 20:44 | |
| *** dprince has joined #openstack-infra | 20:44 | |
| *** timcline has joined #openstack-infra | 20:44 | |
| *** ZZelle has joined #openstack-infra | 20:44 | |
| *** terryw has joined #openstack-infra | 20:44 | |
| *** mgagne_ has joined #openstack-infra | 20:44 | |
| *** EmilienM has joined #openstack-infra | 20:44 | |
| *** Hunner has joined #openstack-infra | 20:44 | |
| *** dtroyer_zz has joined #openstack-infra | 20:44 | |
| *** russellb has joined #openstack-infra | 20:44 | |
| *** StevenK_ has joined #openstack-infra | 20:44 | |
| *** rossella_s has joined #openstack-infra | 20:44 | |
| *** pabelanger has joined #openstack-infra | 20:44 | |
| *** rm_work has joined #openstack-infra | 20:44 | |
| *** jamielennox has joined #openstack-infra | 20:44 | |
| *** bswartz has joined #openstack-infra | 20:44 | |
| *** _d34dh0r53_ has joined #openstack-infra | 20:44 | |
| *** stevebak` has joined #openstack-infra | 20:44 | |
| *** dutsmoc has joined #openstack-infra | 20:44 | |
| *** rainya_ has joined #openstack-infra | 20:44 | |
| *** bradjones has joined #openstack-infra | 20:44 | |
| *** thedodd has joined #openstack-infra | 20:44 | |
| *** _nadya_ has joined #openstack-infra | 20:44 | |
| *** VijayTripathi has joined #openstack-infra | 20:44 | |
| *** stevemar has joined #openstack-infra | 20:44 | |
| *** teran has joined #openstack-infra | 20:44 | |
| *** persia has joined #openstack-infra | 20:44 | |
| *** patrickeast has joined #openstack-infra | 20:44 | |
| *** sabeen3 has joined #openstack-infra | 20:44 | |
| *** imcsk8 has joined #openstack-infra | 20:44 | |
| *** nelsnelson has joined #openstack-infra | 20:44 | |
| *** ddieterly has joined #openstack-infra | 20:44 | |
| *** erikmwil- has joined #openstack-infra | 20:44 | |
| *** erikmwilson has joined #openstack-infra | 20:44 | |
| *** Sukhdev has joined #openstack-infra | 20:44 | |
| *** annegent_ has joined #openstack-infra | 20:44 | |
| *** e0ne has joined #openstack-infra | 20:44 | |
| *** dims has joined #openstack-infra | 20:44 | |
| *** krtaylor has joined #openstack-infra | 20:44 | |
| *** fandi has joined #openstack-infra | 20:44 | |
| *** harlowja has joined #openstack-infra | 20:44 | |
| *** MarkAtwood has joined #openstack-infra | 20:44 | |
| *** doug-fish has joined #openstack-infra | 20:44 | |
| *** unicell has joined #openstack-infra | 20:44 | |
| *** BharatK has joined #openstack-infra | 20:44 | |
| *** markvoelker has joined #openstack-infra | 20:44 | |
| *** berendt has joined #openstack-infra | 20:44 | |
| *** yolanda has joined #openstack-infra | 20:44 | |
| *** gokrokve has joined #openstack-infra | 20:44 | |
| *** SergeyLukjanov has joined #openstack-infra | 20:44 | |
| *** homeless has joined #openstack-infra | 20:44 | |
| *** openstackgerrit has joined #openstack-infra | 20:44 | |
| *** spandhe has joined #openstack-infra | 20:44 | |
| *** JayF has joined #openstack-infra | 20:44 | |
| *** tjones1 has joined #openstack-infra | 20:44 | |
| *** jroll has joined #openstack-infra | 20:44 | |
| *** gyee has joined #openstack-infra | 20:44 | |
| *** bdpayne_ has joined #openstack-infra | 20:44 | |
| *** ihrachyshka has joined #openstack-infra | 20:44 | |
| *** mtanino has joined #openstack-infra | 20:44 | |
| *** CIBuilds has joined #openstack-infra | 20:44 | |
| *** tonytan4ever has joined #openstack-infra | 20:44 | |
| *** jaypipes has joined #openstack-infra | 20:44 | |
| *** liusheng has joined #openstack-infra | 20:44 | |
| *** marun has joined #openstack-infra | 20:44 | |
| *** ildikov has joined #openstack-infra | 20:44 | |
| *** sarob has joined #openstack-infra | 20:44 | |
| *** notmyname has joined #openstack-infra | 20:44 | |
| *** signed8bit has joined #openstack-infra | 20:44 | |
| *** melwitt has joined #openstack-infra | 20:44 | |
| *** abhirc has joined #openstack-infra | 20:44 | |
| *** rwsu has joined #openstack-infra | 20:44 | |
| *** gema_ has joined #openstack-infra | 20:44 | |
| *** Mithrandir has joined #openstack-infra | 20:44 | |
| *** ociuhandu has joined #openstack-infra | 20:44 | |
| *** kgiusti has joined #openstack-infra | 20:44 | |
| *** ctlaugh has joined #openstack-infra | 20:44 | |
| *** Guest14840 has joined #openstack-infra | 20:44 | |
| *** clarkb has joined #openstack-infra | 20:44 | |
| *** phschwartz has joined #openstack-infra | 20:44 | |
| *** rakhmerov has joined #openstack-infra | 20:44 | |
| *** ruhe has joined #openstack-infra | 20:44 | |
| *** armax has joined #openstack-infra | 20:44 | |
| *** spiffxp has joined #openstack-infra | 20:44 | |
| *** dannywilson has joined #openstack-infra | 20:44 | |
| *** yjiang5_ has joined #openstack-infra | 20:44 | |
| *** timrc_ has joined #openstack-infra | 20:44 | |
| *** tobiash_ has joined #openstack-infra | 20:44 | |
| *** sandywalsh_ has joined #openstack-infra | 20:44 | |
| *** pcm_ has joined #openstack-infra | 20:44 | |
| *** packet has joined #openstack-infra | 20:44 | |
| *** filler has joined #openstack-infra | 20:44 | |
| *** amitgandhinz has joined #openstack-infra | 20:44 | |
| *** andreaf_ has joined #openstack-infra | 20:44 | |
| *** wenlock has joined #openstack-infra | 20:44 | |
| *** tmcpeak has joined #openstack-infra | 20:44 | |
| *** adreznec has joined #openstack-infra | 20:44 | |
| *** dguitarbite has joined #openstack-infra | 20:44 | |
| *** r-daneel has joined #openstack-infra | 20:44 | |
| *** denis_makogon has joined #openstack-infra | 20:44 | |
| *** pcrews has joined #openstack-infra | 20:44 | |
| *** mjturek has joined #openstack-infra | 20:44 | |
| *** dustins has joined #openstack-infra | 20:44 | |
| *** mattfarina has joined #openstack-infra | 20:44 | |
| *** changbl has joined #openstack-infra | 20:44 | |
| *** mbacchi has joined #openstack-infra | 20:44 | |
| *** bhunter71 has joined #openstack-infra | 20:44 | |
| *** bknudson has joined #openstack-infra | 20:44 | |
| *** doude has joined #openstack-infra | 20:44 | |
| *** jp_at_hp has joined #openstack-infra | 20:44 | |
| *** tkelsey has joined #openstack-infra | 20:44 | |
| *** nuritv has joined #openstack-infra | 20:44 | |
| *** weshay has joined #openstack-infra | 20:44 | |
| *** amotoki has joined #openstack-infra | 20:44 | |
| *** woodster_ has joined #openstack-infra | 20:44 | |
| *** Kiall has joined #openstack-infra | 20:44 | |
| *** skolekonov has joined #openstack-infra | 20:44 | |
| *** pblaho has joined #openstack-infra | 20:44 | |
| *** rlandy has joined #openstack-infra | 20:44 | |
| *** tnurlygayanov has joined #openstack-infra | 20:44 | |
| *** achuprin_ has joined #openstack-infra | 20:44 | |
| *** waynr has joined #openstack-infra | 20:44 | |
| *** jyuso1 has joined #openstack-infra | 20:44 | |
| *** greghaynes has joined #openstack-infra | 20:44 | |
| *** mrunge has joined #openstack-infra | 20:44 | |
| *** garyh has joined #openstack-infra | 20:44 | |
| *** camunoz has joined #openstack-infra | 20:44 | |
| *** mwagner_lap has joined #openstack-infra | 20:44 | |
| *** ChuckC has joined #openstack-infra | 20:44 | |
| *** ryanpetrello has joined #openstack-infra | 20:44 | |
| *** fifieldt has joined #openstack-infra | 20:44 | |
| *** chlong has joined #openstack-infra | 20:44 | |
| *** viglesias has joined #openstack-infra | 20:44 | |
| *** asettle has joined #openstack-infra | 20:44 | |
| *** plaurin_ has joined #openstack-infra | 20:44 | |
| *** Ng has joined #openstack-infra | 20:44 | |
| *** Zenet has joined #openstack-infra | 20:44 | |
| *** julim has joined #openstack-infra | 20:44 | |
| *** mriedem has joined #openstack-infra | 20:44 | |
| *** zhiyan has joined #openstack-infra | 20:44 | |
| *** ameade_ has joined #openstack-infra | 20:44 | |
| *** begal-sop has joined #openstack-infra | 20:44 | |
| *** ctracey has joined #openstack-infra | 20:44 | |
| *** enikanorov__ has joined #openstack-infra | 20:44 | |
| *** jgrimm has joined #openstack-infra | 20:44 | |
| *** vishy has joined #openstack-infra | 20:44 | |
| *** maurosr has joined #openstack-infra | 20:44 | |
| *** simonmcc has joined #openstack-infra | 20:44 | |
| *** dtantsur|afk has joined #openstack-infra | 20:44 | |
| *** rkukura has joined #openstack-infra | 20:44 | |
| *** vhoward has joined #openstack-infra | 20:44 | |
| *** jraim has joined #openstack-infra | 20:44 | |
| *** eharney has joined #openstack-infra | 20:44 | |
| *** erlon has joined #openstack-infra | 20:44 | |
| *** NikitaKonovalov has joined #openstack-infra | 20:44 | |
| *** redrobot has joined #openstack-infra | 20:44 | |
| *** jcooley has joined #openstack-infra | 20:44 | |
| *** tlbr has joined #openstack-infra | 20:44 | |
| *** SpamapS has joined #openstack-infra | 20:44 | |
| *** Adri2000 has joined #openstack-infra | 20:44 | |
| *** vponomaryov has joined #openstack-infra | 20:44 | |
| *** tteggel has joined #openstack-infra | 20:44 | |
| *** ilyashakhat has joined #openstack-infra | 20:44 | |
| *** rcarrillocruz has joined #openstack-infra | 20:44 | |
| *** skraynev has joined #openstack-infra | 20:44 | |
| *** mestery has joined #openstack-infra | 20:44 | |
| *** lifeless has joined #openstack-infra | 20:44 | |
| *** dangers has joined #openstack-infra | 20:44 | |
| *** tchaypo has joined #openstack-infra | 20:44 | |
| *** ayoung has joined #openstack-infra | 20:44 | |
| *** andrearosa has joined #openstack-infra | 20:44 | |
| *** nithyag__ has joined #openstack-infra | 20:44 | |
| *** andreaf has joined #openstack-infra | 20:44 | |
| *** mikal has joined #openstack-infra | 20:44 | |
| *** heyongli has joined #openstack-infra | 20:44 | |
| *** grantbow has joined #openstack-infra | 20:44 | |
| *** mmedvede has joined #openstack-infra | 20:44 | |
| *** jpeeler has joined #openstack-infra | 20:44 | |
| *** sbadia has joined #openstack-infra | 20:44 | |
| *** sdake has joined #openstack-infra | 20:44 | |
| *** tsufiev_ has joined #openstack-infra | 20:44 | |
| *** SlickNik has joined #openstack-infra | 20:44 | |
| *** zul has joined #openstack-infra | 20:44 | |
| *** masayukig has joined #openstack-infra | 20:44 | |
| *** coolsvap|afk has joined #openstack-infra | 20:44 | |
| *** ianw has joined #openstack-infra | 20:44 | |
| *** amrith has joined #openstack-infra | 20:44 | |
| *** hamzy has joined #openstack-infra | 20:44 | |
| *** pzhurba__ has joined #openstack-infra | 20:44 | |
| *** SotK has joined #openstack-infra | 20:44 | |
| *** mugsie has joined #openstack-infra | 20:44 | |
| *** tcammann has joined #openstack-infra | 20:44 | |
| *** mtreinish has joined #openstack-infra | 20:44 | |
| *** pradk has joined #openstack-infra | 20:44 | |
| *** dkliban has joined #openstack-infra | 20:44 | |
| *** Shrews has joined #openstack-infra | 20:44 | |
| *** anteaya has joined #openstack-infra | 20:44 | |
| *** arosen has joined #openstack-infra | 20:44 | |
| *** jbryce has joined #openstack-infra | 20:44 | |
| *** dteselkin has joined #openstack-infra | 20:44 | |
| *** d0ugal has joined #openstack-infra | 20:44 | |
| *** dansmith has joined #openstack-infra | 20:44 | |
| *** dhellmann has joined #openstack-infra | 20:44 | |
| *** lbragstad has joined #openstack-infra | 20:44 | |
| *** a2hill has joined #openstack-infra | 20:44 | |
| *** apmelton_ has joined #openstack-infra | 20:44 | |
| *** jgriffith has joined #openstack-infra | 20:44 | |
| *** mika has joined #openstack-infra | 20:44 | |
| *** esmute has joined #openstack-infra | 20:44 | |
| *** crinkle has joined #openstack-infra | 20:44 | |
| *** willroberts_ has joined #openstack-infra | 20:44 | |
| *** annegentle has joined #openstack-infra | 20:44 | |
| *** enikanorov_ has joined #openstack-infra | 20:44 | |
| *** Apsu has joined #openstack-infra | 20:44 | |
| *** dvorak has joined #openstack-infra | 20:44 | |
| *** mrodden has joined #openstack-infra | 20:44 | |
| *** WendellM_ has joined #openstack-infra | 20:44 | |
| *** leifmadsen has joined #openstack-infra | 20:44 | |
| *** jklare_ has joined #openstack-infra | 20:44 | |
| *** markvan has joined #openstack-infra | 20:44 | |
| *** krotscheck has joined #openstack-infra | 20:44 | |
| *** kashyap has joined #openstack-infra | 20:44 | |
| *** dosaboy_ has joined #openstack-infra | 20:44 | |
| *** wolsen_ has joined #openstack-infra | 20:44 | |
| *** rodrigods has joined #openstack-infra | 20:44 | |
| *** david-lyle has joined #openstack-infra | 20:44 | |
| *** toabctl has joined #openstack-infra | 20:44 | |
| *** psedlak has joined #openstack-infra | 20:44 | |
| *** Mmike has joined #openstack-infra | 20:44 | |
| *** isq has joined #openstack-infra | 20:44 | |
| *** pczesno has joined #openstack-infra | 20:44 | |
| *** michchap has joined #openstack-infra | 20:44 | |
| *** dkranz has joined #openstack-infra | 20:44 | |
| *** med_ has joined #openstack-infra | 20:44 | |
| *** pashkin has joined #openstack-infra | 20:44 | |
| *** mwhudson has joined #openstack-infra | 20:44 | |
| *** niedbalski has joined #openstack-infra | 20:44 | |
| *** xianghui has joined #openstack-infra | 20:44 | |
| *** _shaps_ has joined #openstack-infra | 20:44 | |
| *** omrim has joined #openstack-infra | 20:44 | |
| *** devananda has joined #openstack-infra | 20:44 | |
| *** mordred has joined #openstack-infra | 20:44 | |
| *** pfalleno1 has joined #openstack-infra | 20:44 | |
| *** kragniz has joined #openstack-infra | 20:44 | |
| *** gilliard has joined #openstack-infra | 20:44 | |
| *** tristanC has joined #openstack-infra | 20:44 | |
| *** EntropyWorks has joined #openstack-infra | 20:44 | |
| *** sressot has joined #openstack-infra | 20:44 | |
| *** jhesketh has joined #openstack-infra | 20:44 | |
| *** jd__ has joined #openstack-infra | 20:44 | |
| *** gothicmindfood has joined #openstack-infra | 20:44 | |
| *** jeblair has joined #openstack-infra | 20:44 | |
| *** kmartin has joined #openstack-infra | 20:44 | |
| *** boris-42 has joined #openstack-infra | 20:44 | |
| *** dmellado has joined #openstack-infra | 20:44 | |
| *** mkerrin has joined #openstack-infra | 20:44 | |
| *** zigo has joined #openstack-infra | 20:44 | |
| *** sileht has joined #openstack-infra | 20:44 | |
| *** isviridov has joined #openstack-infra | 20:44 | |
| *** Nakato has joined #openstack-infra | 20:44 | |
| *** fbo has joined #openstack-infra | 20:44 | |
| *** cody-somerville has joined #openstack-infra | 20:44 | |
| *** HenryG has joined #openstack-infra | 20:44 | |
| *** hogepodge has joined #openstack-infra | 20:44 | |
| *** ChanServ has joined #openstack-infra | 20:44 | |
| *** msuriar has joined #openstack-infra | 20:44 | |
| *** BobBall has joined #openstack-infra | 20:44 | |
| *** gus has joined #openstack-infra | 20:44 | |
| *** sc68cal has joined #openstack-infra | 20:44 | |
| *** gpocentek has joined #openstack-infra | 20:44 | |
| *** paul-- has joined #openstack-infra | 20:44 | |
| *** trey has joined #openstack-infra | 20:44 | |
| *** bnemec has joined #openstack-infra | 20:44 | |
| *** fabo has joined #openstack-infra | 20:44 | |
| *** cburgess has joined #openstack-infra | 20:44 | |
| *** morganfainberg has joined #openstack-infra | 20:44 | |
| *** Guest74239 has joined #openstack-infra | 20:44 | |
| *** mattoliverau has joined #openstack-infra | 20:44 | |
| *** dougwig has joined #openstack-infra | 20:44 | |
| *** HeOS_ has joined #openstack-infra | 20:44 | |
| *** zxiiro has joined #openstack-infra | 20:44 | |
| *** briancline has joined #openstack-infra | 20:44 | |
| *** sdague has joined #openstack-infra | 20:44 | |
| *** asadoughi has joined #openstack-infra | 20:44 | |
| *** freyes has joined #openstack-infra | 20:44 | |
| *** vladan has joined #openstack-infra | 20:44 | |
| *** mkoderer has joined #openstack-infra | 20:44 | |
| *** loquacities has joined #openstack-infra | 20:44 | |
| *** alaski has joined #openstack-infra | 20:44 | |
| *** alazarev has joined #openstack-infra | 20:44 | |
| *** morgabra has joined #openstack-infra | 20:44 | |
| *** dkehn has joined #openstack-infra | 20:44 | |
| *** saper has joined #openstack-infra | 20:44 | |
| *** dguerri has joined #openstack-infra | 20:44 | |
| *** bogdando has joined #openstack-infra | 20:44 | |
| *** wznoinsk has joined #openstack-infra | 20:44 | |
| *** mattymo has joined #openstack-infra | 20:44 | |
| *** therve has joined #openstack-infra | 20:44 | |
| *** pleia2 has joined #openstack-infra | 20:44 | |
| *** gibi has joined #openstack-infra | 20:44 | |
| *** nibalizer has joined #openstack-infra | 20:44 | |
| *** Clint has joined #openstack-infra | 20:44 | |
| *** hughsaunders has joined #openstack-infra | 20:44 | |
| *** schang has joined #openstack-infra | 20:44 | |
| *** gnuoy` has joined #openstack-infra | 20:44 | |
| *** erw has joined #openstack-infra | 20:44 | |
| *** abramley has joined #openstack-infra | 20:44 | |
| *** cinerama has joined #openstack-infra | 20:44 | |
| *** dmitryme has joined #openstack-infra | 20:44 | |
| *** sendak.freenode.net sets mode: +o ChanServ | 20:44 | |
| *** slagle has joined #openstack-infra | 20:44 | |
| *** NobodyCam has joined #openstack-infra | 20:44 | |
| *** bodepd_ has joined #openstack-infra | 20:44 | |
| *** TheJulia has joined #openstack-infra | 20:44 | |
| *** grue_pm has joined #openstack-infra | 20:44 | |
| *** gaelL has joined #openstack-infra | 20:44 | |
| *** davidlenwell has joined #openstack-infra | 20:44 | |
| *** JoshNang has joined #openstack-infra | 20:44 | |
| *** zaro has joined #openstack-infra | 20:44 | |
| *** LinuxJedi has joined #openstack-infra | 20:44 | |
| *** spiffxp_ has joined #openstack-infra | 20:44 | |
| *** Svedrin has joined #openstack-infra | 20:44 | |
| *** bradm has joined #openstack-infra | 20:44 | |
| *** BadCub has joined #openstack-infra | 20:44 | |
| *** avozza has joined #openstack-infra | 20:44 | |
| *** mfink has joined #openstack-infra | 20:44 | |
| *** darvon has joined #openstack-infra | 20:44 | |
| *** kevinbenton has joined #openstack-infra | 20:44 | |
| *** antonym has joined #openstack-infra | 20:44 | |
| *** nikhil_k has joined #openstack-infra | 20:44 | |
| *** jesusaurus has joined #openstack-infra | 20:44 | |
| *** asselin_ has joined #openstack-infra | 20:44 | |
| *** ekarlso has joined #openstack-infra | 20:44 | |
| *** jogo has joined #openstack-infra | 20:44 | |
| *** funzo has joined #openstack-infra | 20:44 | |
| *** flaper87 has joined #openstack-infra | 20:44 | |
| *** charz has joined #openstack-infra | 20:44 | |
| *** mfisch has joined #openstack-infra | 20:44 | |
| *** s0nea has joined #openstack-infra | 20:44 | |
| *** igorbelikov has joined #openstack-infra | 20:44 | |
| *** niska` has joined #openstack-infra | 20:44 | |
| *** naotokl has joined #openstack-infra | 20:44 | |
| *** ondergetekende_ has joined #openstack-infra | 20:44 | |
| *** radez_g0n3 has joined #openstack-infra | 20:44 | |
| *** dhp_ has joined #openstack-infra | 20:44 | |
| *** DinaBelova has joined #openstack-infra | 20:44 | |
| *** wendar has joined #openstack-infra | 20:44 | |
| *** jkt has joined #openstack-infra | 20:44 | |
| *** timfreund has joined #openstack-infra | 20:44 | |
| *** nijaba has joined #openstack-infra | 20:44 | |
| *** cschwede has joined #openstack-infra | 20:44 | |
| *** hockeynut has joined #openstack-infra | 20:44 | |
| *** jamespage has joined #openstack-infra | 20:44 | |
| *** shardy has joined #openstack-infra | 20:44 | |
| *** dstanek has joined #openstack-infra | 20:44 | |
| *** adam_g has joined #openstack-infra | 20:44 | |
| *** mancdaz has joined #openstack-infra | 20:44 | |
| *** fungi has joined #openstack-infra | 20:44 | |
| *** dolphm has joined #openstack-infra | 20:44 | |
| *** sigmavirus24 has joined #openstack-infra | 20:44 | |
| *** odyssey4me has joined #openstack-infra | 20:44 | |
| *** ttx has joined #openstack-infra | 20:44 | |
| *** zz_gondoi has joined #openstack-infra | 20:44 | |
| *** cloudnull has joined #openstack-infra | 20:44 | |
| *** dstufft has joined #openstack-infra | 20:44 | |
| *** zz_johnthetubagu has joined #openstack-infra | 20:44 | |
| *** sweston has joined #openstack-infra | 20:44 | |
| *** vipul has joined #openstack-infra | 20:44 | |
| *** juice has joined #openstack-infra | 20:44 | |
| *** chmouel has joined #openstack-infra | 20:44 | |
| *** dmsimard has joined #openstack-infra | 20:44 | |
| *** bookwar has joined #openstack-infra | 20:44 | |
| *** sendak.freenode.net sets mode: +bbbb *!*@*PanicBNC.org *!~Energy@* LLKCKfan!*@* *!~rongze@* | 20:44 | |
| *** sendak.freenode.net sets mode: +b *!*@213.140.5 | 20:44 | |
| *** sendak.freenode.net changes topic to "Discussion of OpenStack Developer Infrastructure | Current Python distutils issues: https://etherpad.openstack.org/p/pydistutils-issues" | 20:44 | |
| *** pblaho has quit IRC | 20:44 | |
| anteaya | fungi: looks like the topic is stuck in -meeting | 20:44 |
| anteaya | nope there it goes | 20:44 |
| fungi | it may need fixing after the meeting though | 20:47 |
| fungi | i'm keeping an eye on it | 20:47 |
| *** yjiang5_ is now known as yjiang5 | 20:47 | |
| anteaya | fungi: thanks | 20:47 |
| *** ivar-lazzaro has quit IRC | 20:48 | |
| *** ivar-lazzaro has joined #openstack-infra | 20:49 | |
| *** mrunge has quit IRC | 20:49 | |
| *** hj-hp has joined #openstack-infra | 20:49 | |
| *** annegent_ has quit IRC | 20:52 | |
| *** rgerganov has joined #openstack-infra | 20:52 | |
| *** radez_g0n3 is now known as radez | 20:53 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/project-config: Limit Workflow +/-1 in openstack-specs to tc-chair https://review.openstack.org/150581 | 20:53 |
| *** liusheng has quit IRC | 20:54 | |
| *** sparkycollier has quit IRC | 20:54 | |
| openstackgerrit | Merged openstack-infra/project-config: Create a new python-novaclient-core group https://review.openstack.org/150552 | 20:55 |
| *** annegent_ has joined #openstack-infra | 20:55 | |
| *** liusheng has joined #openstack-infra | 20:56 | |
| *** talluri has joined #openstack-infra | 20:58 | |
| *** stevebak` is now known as stevebaker | 20:59 | |
| *** hashar has joined #openstack-infra | 21:01 | |
| *** SergeyLukjanov has quit IRC | 21:02 | |
| rgerganov | I got +1 from Jenkins and gerrit still says 'patch in merge conflict': https://review.openstack.org/#/c/148509/ | 21:04 |
| rgerganov | any idea how to fix this? | 21:04 |
| openstackgerrit | Merged stackforge/python-jenkins: Update and clean up docs https://review.openstack.org/149694 | 21:04 |
| anteaya | rgerganov: probably left over from the reboot earlier today | 21:05 |
| *** SergeyLukjanov has joined #openstack-infra | 21:05 | |
| anteaya | rgerganov: try a recheck and see how that goes | 21:05 |
| rgerganov | anteaya: recheck didn't help | 21:06 |
| *** otter768 has joined #openstack-infra | 21:06 | |
| rgerganov | and the patch is rebased on latest master | 21:06 |
| *** Kerralissa has joined #openstack-infra | 21:06 | |
| fungi | rgerganov: that's a bug in our javascript overlay in the gerrit webui i think | 21:07 |
| pcm_ | marun: ping | 21:07 |
| *** talluri has quit IRC | 21:07 | |
| marun | pcm_: pong | 21:07 |
| anteaya | rgerganov: I see jenkins at -1 | 21:07 |
| fungi | oh, my bad | 21:07 |
| *** hdd has joined #openstack-infra | 21:07 | |
| fungi | that's still waiting for jenkins to vote on patchset 8 | 21:07 |
| anteaya | rgerganov: yeah, the last jenkins results are from patchset 7 | 21:08 |
| pcm_ | On the function gate review for vnaas repo, there were some questions on pre-kilo support. | 21:08 |
| anteaya | which passed and came in after your issued the recheck | 21:08 |
| pcm_ | marun: source ~/.bashrc | 21:08 |
| rgerganov | anteaya: ok, thanks! | 21:08 |
| pcm_ | marun: https://review.openstack.org/#/c/148616/9/jenkins/jobs/neutron-vpnaas-functional.yaml | 21:08 |
| marun | pcm_: ? | 21:08 |
| fungi | rgerganov: i can see it still in the check pipeline at http://status.openstack.org/zuul/ | 21:09 |
| * pcm_ paste error | 21:09 | |
| rgerganov | fungi: right, I didn't realize that the result is not for that last PS | 21:09 |
| *** tjones1 has quit IRC | 21:09 | |
| marun | pcm_: I'm pretty sure I mentioned that you won't need those conditionals | 21:09 |
| pcm_ | marun: So, this will get setup for Kilo, will we need to support older releases (backporting?) | 21:09 |
| *** tjones1 has joined #openstack-infra | 21:09 | |
| pcm_ | marun: I probably forgot... lot to consume. | 21:09 |
| marun | pcm_: the only reason we need it for neutron is that we have previous branches with the hook script in a different location | 21:10 |
| pcm_ | marun: Ah | 21:10 |
| *** tjones1 has quit IRC | 21:10 | |
| marun | pcm_: vpnaas only has master to worry about, so only a single location is suggested | 21:10 |
| mestery | fungi: Regarding the gitpython issues, this review (https://review.openstack.org/#/c/150055/) passed Jenkins and is not in merge conflict. Best way to resolve this is to push a new revision? | 21:10 |
| marun | pcm_: so, strip the conditionals out entirely and just call the hook script | 21:10 |
| *** otter768 has quit IRC | 21:11 | |
| *** hj-hp has quit IRC | 21:11 | |
| pcm_ | marun: location new/neutron-vpnaas/neutron_vpnaas/... OK though? | 21:12 |
| pcm_ | IOW the tree will be under 'new'? | 21:12 |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Add Parameterized Remote Trigger Plugin support. https://review.openstack.org/150327 | 21:12 |
| fungi | mestery: like with rgerganov's change above, that one has passing votes on patchset #2 but patchset #3 is probably still being tested | 21:12 |
| mestery | fungi: Ah, cool! Thanks sir! :) | 21:13 |
| *** jklare_ has quit IRC | 21:13 | |
| fungi | mestery: yeah, it's still in the check pipeline according to http://status.openstack.org/zuul/ | 21:13 |
| mestery | fungi: Apologies, I missed that somehow. :( Thanks for the pointer! | 21:13 |
| fungi | np | 21:13 |
| marun | pcm_: yes, the location is fine | 21:13 |
| *** abhirc has quit IRC | 21:13 | |
| pcm_ | marun: OK. Will update. | 21:14 |
| pcm_ | marun: Thanks | 21:15 |
| marun | pcm_: np :) | 21:16 |
| *** hj-hp has joined #openstack-infra | 21:17 | |
| *** mjturek has quit IRC | 21:17 | |
| *** HeOS has joined #openstack-infra | 21:18 | |
| openstackgerrit | Paul Michali proposed openstack-infra/project-config: Enable functional test job in openstack ci for neutron-vpnaas https://review.openstack.org/148616 | 21:19 |
| *** jklare has joined #openstack-infra | 21:20 | |
| *** vigneshvar has quit IRC | 21:20 | |
| *** Ryan_Lane has joined #openstack-infra | 21:21 | |
| *** gokrokve has quit IRC | 21:21 | |
| *** abhirc has joined #openstack-infra | 21:22 | |
| *** kurtmartin has joined #openstack-infra | 21:22 | |
| fungi | zaro: fwiw i've been poking at the problem with zuul-dev a little and it doesn't seem to be an apache issue. zuul's not serving status.json, nor writing to its non-debug log for that matter (and writing little of consequence in the debug log). i think it's not configured correctly still | 21:23 |
| clarkb | I still don't see centos pacakges | 21:24 |
| fungi | like on the old zuul-dev server, when i start the zuul process, it creates its pidfile but quickly deletes it again | 21:24 |
| *** rgerganov has quit IRC | 21:24 | |
| fungi | zaro: ^ | 21:24 |
| *** kgiusti has left #openstack-infra | 21:27 | |
| *** stevemar has quit IRC | 21:28 | |
| *** stevemar has joined #openstack-infra | 21:28 | |
| *** sparkycollier has joined #openstack-infra | 21:30 | |
| *** tjones1 has joined #openstack-infra | 21:31 | |
| *** hdd has quit IRC | 21:31 | |
| *** ihrachyshka has quit IRC | 21:31 | |
| *** hdd has joined #openstack-infra | 21:31 | |
| *** vigneshvar has joined #openstack-infra | 21:32 | |
| *** baoli has joined #openstack-infra | 21:32 | |
| *** rackertom has quit IRC | 21:34 | |
| *** rackertom_ is now known as rackertom | 21:34 | |
| *** harlowja has quit IRC | 21:35 | |
| *** kurtmartin has quit IRC | 21:36 | |
| fungi | zaro: the gearman service definitely responds to status requests and has workers registered for lots of jobs | 21:37 |
| fungi | zaro: but after starting fresh the zuul.log only has | 21:37 |
| JayF | dstufft: Hey; not really Openstack related, but thought you'd like to know I've gotten several MD5 mismatch errors from pypi across a few different packages. IDK if something is unhappy there or what. | 21:37 |
| fungi | "INFO zuul.Server: Starting scheduler" | 21:37 |
| *** liusheng has quit IRC | 21:38 | |
| fungi | JayF: there is a bug in pip where network errors get masked and raised as checksum mismatches. not sure if that's fixed in the latest release yet | 21:38 |
| JayF | Aha. | 21:38 |
| *** liusheng has joined #openstack-infra | 21:39 | |
| JayF | fungi: that's really useful info; all these are from travisci so that's very likely! Thanks | 21:39 |
| JayF | jroll: ^ | 21:39 |
| jroll | oh, cool | 21:39 |
| jroll | "cool" | 21:39 |
| *** sabari has joined #openstack-infra | 21:39 | |
| pleia2 | oh gosh, openjdk-6 now :\ | 21:39 |
| fungi | JayF: basically the file retrieval fails because of some network issue, and ends up feeding zero bytes or whatever into the checksum routine, which then fails to match | 21:39 |
| JayF | 'cool' = "I'm terrified and amazed that the internet works sometimes" | 21:39 |
| fungi | JayF: jroll: https://github.com/pypa/pip/issues/2332 | 21:40 |
| jroll | basically | 21:41 |
| *** _nadya_ has quit IRC | 21:41 | |
| dhellmann | fungi: I think whatever gets jammed when I try to release libs got jammed today when I tagged oslo.messaging 1.6.0 -- can you poke the thing you usually poke it to fix it? :-) | 21:41 |
| fungi | dhellmann: taking a look momentarily | 21:41 |
| dhellmann | fungi: thanks, no rush | 21:41 |
| dhellmann | fungi: http://logs.openstack.org/f2/f211fb66c265b3eefa4bec1eddb42e3794d711da/ for the parts of the job that did run | 21:42 |
| clarkb | just two more shards to reinitialize then I can move on to 06 | 21:42 |
| *** hj-hp has quit IRC | 21:43 | |
| fungi | dhellmann: that has no release pipeline associated with it. gonna guess that's the hash of what was tagged, not the hash of the tag? | 21:44 |
| *** tonytan4ever has quit IRC | 21:44 | |
| dhellmann | fungi: maybe? it's commit f211fb66c265b3eefa4bec1eddb42e3794d711da in oslo.messaging | 21:44 |
| dhellmann | oh, yeah, that's the thing that was tagged | 21:44 |
| dhellmann | http://logs.openstack.org/7f/7f63096dcdff73e5c7c917e69bf6313fddee71c7/ shows as file not found | 21:45 |
| *** gokrokve has joined #openstack-infra | 21:46 | |
| *** rlandy has quit IRC | 21:46 | |
| *** kurtmartin has joined #openstack-infra | 21:48 | |
| *** Sukhdev has quit IRC | 21:48 | |
| *** hashar has quit IRC | 21:49 | |
| SergeyLukjanov | fungi, I fear approving mailing lists related commits because I completely not sure how the system works ;) | 21:49 |
| *** _nadya_ has joined #openstack-infra | 21:51 | |
| *** ihrachyshka has joined #openstack-infra | 21:52 | |
| *** dprince has quit IRC | 21:53 | |
| mordred | SergeyLukjanov: ++ | 21:56 |
| jhesketh | Morning | 21:58 |
| *** baoli has quit IRC | 21:58 | |
| *** btran has joined #openstack-infra | 21:59 | |
| fungi | dhellmann: based on the age of the tag, i'm going to guess you pushed it right when we were restarting things and so the release jobs never ran | 21:59 |
| dhellmann | fungi: just my luck :-) | 21:59 |
| fungi | dhellmann: your tag is timestamped 18:58:05 and we started emergency maintenance at 19:00 | 21:59 |
| *** baoli has joined #openstack-infra | 22:00 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add migration to add test attrs column to test_runs table https://review.openstack.org/143239 | 22:00 |
| dhellmann | fungi: I noticed that later, but didn't connection the timestamp | 22:00 |
| fungi | er, sorry, started emergency maintenance an hour earlier | 22:00 |
| fungi | so ignore me | 22:00 |
| *** unicell1 has joined #openstack-infra | 22:00 | |
| fungi | going through logs to find out what's up | 22:00 |
| dhellmann | oh, huh, ok | 22:00 |
| *** tkelsey has quit IRC | 22:00 | |
| *** sparkycollier has quit IRC | 22:01 | |
| fungi | next best guess is that it was queued up in the release pipeline and then lost in a zuul restart since pending release jobs were probably not requeued | 22:01 |
| *** hj-hp has joined #openstack-infra | 22:01 | |
| fungi | will be able to tell in a sec | 22:01 |
| *** unicell has quit IRC | 22:02 | |
| *** sparkycollier has joined #openstack-infra | 22:02 | |
| fungi | 2015-01-27 18:58:25,864 INFO zuul.Gearman: Launch job oslo.messaging-tarball for change <Ref 0x7f52b72832d0 creates refs/tags/1.6.0 on 7f63096dcdff73e5c7c917e69bf6313fddee71c7> with dependent changes [] | 22:02 |
| *** maxbit has joined #openstack-infra | 22:02 | |
| *** dkliban is now known as dkliban_afk | 22:02 | |
| fungi | so it got past the merge task presumably | 22:02 |
| *** unicell has joined #openstack-infra | 22:03 | |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Support the use of lists in trigger-build builder. https://review.openstack.org/150597 | 22:03 |
| *** spzala has quit IRC | 22:03 | |
| openstackgerrit | Wayne Warren proposed openstack-infra/jenkins-job-builder: Support the use of lists in trigger-build publisher. https://review.openstack.org/150598 | 22:03 |
| *** ZZelle has quit IRC | 22:04 | |
| *** baoli has quit IRC | 22:04 | |
| fungi | just trying to figure out which zuul merger handled it, but it may be faster for me to see which one knows about that tag | 22:04 |
| *** unicell1 has quit IRC | 22:05 | |
| fungi | 2015-01-27 18:58:25,815 DEBUG zuul.Scheduler: Adding merge complete event for build set: <BuildSet item: <QueueItem 0x7f52b4309b50 for <Ref 0x7f52b72832d0 creates refs/tags/1.6.0 on 7f63096dcdff73e5c7c917e69bf6313fddee71c7> in release> #builds: 0 merge state: PENDING> | 22:06 |
| fungi | yeah, definitely successfully set up the ref | 22:06 |
| *** mattfarina has quit IRC | 22:07 | |
| dhellmann | fungi: yeah, I have the tag in my local working clone (not the one I used to create the tag) | 22:07 |
| fungi | well, in this case i'm trying to track down the job parameter for which zuul merger to use | 22:07 |
| dhellmann | k | 22:07 |
| fungi | since one of them processed the event | 22:07 |
| *** talluri has joined #openstack-infra | 22:08 | |
| fungi | found it. zm04 | 22:08 |
| fungi | okay, just a sec and i'll have you rerun | 22:08 |
| *** pcm_ has quit IRC | 22:08 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Switch subunit2sql to set attrs in test_runs table https://review.openstack.org/143240 | 22:09 |
| *** ChuckC_ has joined #openstack-infra | 22:09 | |
| clarkb | jeblair fungi: I am restarting 06 now | 22:09 |
| *** VijayTripathi has quit IRC | 22:10 | |
| jeblair | clarkb: oh wow did it take that long? | 22:10 |
| clarkb | jeblair: yes | 22:11 |
| clarkb | jeblair: for whatever reason es did not restore all indexes on the node that had them previously even with that setting set | 22:11 |
| clarkb | so now 07 actually has no shards | 22:11 |
| clarkb | \o/ | 22:11 |
| *** kurtmartin has quit IRC | 22:11 | |
| *** kurtmartin has joined #openstack-infra | 22:12 | |
| *** mbacchi has quit IRC | 22:13 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: Ignore release-tag dirs when running flake8 https://review.openstack.org/150600 | 22:13 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: allow sanity check to report multiple warnings https://review.openstack.org/150601 | 22:13 |
| *** hj-hp has quit IRC | 22:13 | |
| *** ChuckC has quit IRC | 22:13 | |
| *** ihrachyshka has quit IRC | 22:14 | |
| *** liusheng has quit IRC | 22:14 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/devstack-gate: DO NOT MERGE COPY ALL OF .TESTREPOSITORY to log server https://review.openstack.org/149719 | 22:15 |
| jeblair | clarkb: by the end, all nodes will have no shards, right? why not just skip to the end? ;) | 22:17 |
| *** radez is now known as radez_g0n3 | 22:17 | |
| clarkb | jeblair: ha | 22:17 |
| *** kurtmartin has quit IRC | 22:17 | |
| jhesketh | So I seem to have missed all the excitement. What was all the restarting for? | 22:17 |
| *** liusheng has joined #openstack-infra | 22:17 | |
| clarkb | jeblair: this rebalance should get us back to a more normal state. I think we got here due to all of the cruft shards that somehow ended up on the cluster. I cleaned those up and will pay closer attention to it in the future to fix it | 22:18 |
| *** kurtmartin has joined #openstack-infra | 22:18 | |
| openstackgerrit | Matthew Treinish proposed openstack-infra/subunit2sql: Add migration to add test attrs column to test_runs table https://review.openstack.org/143239 | 22:19 |
| *** erikmwilson has quit IRC | 22:19 | |
| *** erikmwil- is now known as erikmwilson | 22:19 | |
| *** salv-orlando has joined #openstack-infra | 22:22 | |
| fungi | dhellmann: okay, 1.6.0 tarball/wheel are up at http://tarballs.openstack.org/oslo.messaging/ and https://pypi.python.org/pypi/oslo.messaging now. apologies for the rough seas | 22:22 |
| dhellmann | fungi: no problem, thanks for fixing it! | 22:22 |
| fungi | any time! | 22:22 |
| fungi | jhesketh: http://www.openwall.com/lists/oss-security/2015/01/27/9 | 22:23 |
| *** ChuckC has joined #openstack-infra | 22:24 | |
| *** _nadya_ has quit IRC | 22:26 | |
| jhesketh | fungi: ouch :-( | 22:26 |
| zaro | fungi: sorry, was away for a little. | 22:27 |
| *** ChuckC_ has quit IRC | 22:27 | |
| *** ChuckC__ has joined #openstack-infra | 22:28 | |
| *** ChuckC has quit IRC | 22:29 | |
| zaro | fungi: all zuul configs are in zuul.conf correct? | 22:29 |
| *** kurtmartin has quit IRC | 22:31 | |
| fungi | zaro: and the *logging.conf files | 22:31 |
| fungi | zaro: and also the layout.yaml | 22:32 |
| *** kurtmartin has joined #openstack-infra | 22:32 | |
| zaro | fungi: i've checked the conf and logging config. seems ok to me. does layout.yaml affect zuul startup? | 22:33 |
| fungi | zaro: oh, also the openstack_functions.py file is mentioned as included in the layout but not present in the /etc/zuul/layout dir | 22:33 |
| fungi | zaro: i _would_ expect it to at least mention that it was starting to read the layout, and it doesn't even get that far | 22:33 |
| fungi | "DEBUG zuul.Scheduler: Performing reconfiguration" is immediately followed by "zuul.Scheduler: Run handler sleeping" in the debug log, no actual layout | 22:34 |
| *** erikmwilson is now known as Guest55741 | 22:36 | |
| *** erikmwilson has joined #openstack-infra | 22:36 | |
| *** erikwilson has joined #openstack-infra | 22:36 | |
| *** erikmwilson has quit IRC | 22:36 | |
| *** erikwilson is now known as erikmwilson | 22:36 | |
| *** ddieterly has quit IRC | 22:37 | |
| *** ddieterl_ has joined #openstack-infra | 22:37 | |
| *** _d34dh0r53_ is now known as d34dh0r53 | 22:38 | |
| openstackgerrit | Yichen Wang proposed openstack-infra/project-config: Register new project "vmtp" into stackforge https://review.openstack.org/150606 | 22:39 |
| *** ddieterl_ has quit IRC | 22:39 | |
| *** ddieterly has joined #openstack-infra | 22:39 | |
| *** maxbit_ has joined #openstack-infra | 22:39 | |
| *** ddieterly has quit IRC | 22:39 | |
| *** dustins has quit IRC | 22:40 | |
| *** ddieterly has joined #openstack-infra | 22:40 | |
| fungi | okay, heading out to get some food. back in a while | 22:40 |
| *** maxbit has quit IRC | 22:41 | |
| *** ddieterly has quit IRC | 22:41 | |
| *** ddieterly has joined #openstack-infra | 22:41 | |
| *** kurtmartin has quit IRC | 22:41 | |
| *** sparkycollier has quit IRC | 22:41 | |
| *** kurtmartin has joined #openstack-infra | 22:42 | |
| *** hj-hp has joined #openstack-infra | 22:42 | |
| *** unicell1 has joined #openstack-infra | 22:44 | |
| *** andreykurilin_ has joined #openstack-infra | 22:44 | |
| *** harlowja has joined #openstack-infra | 22:44 | |
| *** unicell has quit IRC | 22:45 | |
| dstufft | JayF: fungi it's not fixed in a release yet, I'll probably do a release with that fix and another one or two in the next few days | 22:45 |
| jeblair | mordred, morganfainberg, mestery, ttx: https://review.openstack.org/150604 | 22:48 |
| *** andreaf_ has quit IRC | 22:49 | |
| *** harlowja_ has joined #openstack-infra | 22:49 | |
| *** miqui has joined #openstack-infra | 22:49 | |
| clarkb | jeblair: you should add the waldon exception :P | 22:49 |
| clarkb | er name it :) | 22:50 |
| *** unicell has joined #openstack-infra | 22:50 | |
| *** harlowja has quit IRC | 22:50 | |
| *** unicell1 has quit IRC | 22:51 | |
| jeblair | clarkb: well, i included part of it in the rules, and made the exception process for other things (like i think we would need for grizzly or kilo) defined | 22:52 |
| jeblair | "or natural landmark" being that part of it | 22:53 |
| *** unicell has quit IRC | 22:53 | |
| *** maxbit has joined #openstack-infra | 22:54 | |
| *** dhellmann has quit IRC | 22:54 | |
| zaro | fungi: alright, i'm just blind guessing because i don't know how zuul really works. will try a personal install of zuul to see if that helps me debug it. | 22:55 |
| *** kurtmartin has quit IRC | 22:55 | |
| *** dhellmann has joined #openstack-infra | 22:55 | |
| *** kurtmartin has joined #openstack-infra | 22:56 | |
| *** salv-orlando has quit IRC | 22:57 | |
| *** maxbit_ has quit IRC | 22:57 | |
| *** unicell has joined #openstack-infra | 22:57 | |
| clarkb | jeblair: also I think historically the name vote has been open to everyone not just atcs? fwiw I think it should be an atc decision but whatever | 22:59 |
| *** Kerralissa has quit IRC | 22:59 | |
| *** jgrimm is now known as zz_jgrimm | 22:59 | |
| *** timcline has quit IRC | 22:59 | |
| jeblair | clarkb: yeah, it's been a poll of the 'openstack' lp group. i'm anticipating (a) not having LP, and (b) needing a user base to have a proper condorcet election. atcs will get a lot of the community and it re-uses the voting rolls we already have | 23:00 |
| jeblair | i sort of feel like making new voting rolls for the name poll is overkill | 23:00 |
| *** liusheng has quit IRC | 23:01 | |
| clarkb | ya | 23:01 |
| *** liusheng has joined #openstack-infra | 23:01 | |
| clarkb | I still don't see a centos6 glibc package update | 23:02 |
| *** harlowja_ has quit IRC | 23:03 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 23:03 | |
| *** kurtmartin has quit IRC | 23:04 | |
| *** e0ne has quit IRC | 23:05 | |
| *** maxbit has quit IRC | 23:05 | |
| *** unicell has quit IRC | 23:05 | |
| *** kurtmartin has joined #openstack-infra | 23:05 | |
| mordred | jeblair: +100 | 23:05 |
| *** salv-orlando has joined #openstack-infra | 23:06 | |
| *** unicell has joined #openstack-infra | 23:06 | |
| *** otter768 has joined #openstack-infra | 23:07 | |
| clarkb | down to 4 shards to recover before rebooting 05 | 23:07 |
| *** hichihara has joined #openstack-infra | 23:07 | |
| openstackgerrit | Yichen Wang proposed openstack-infra/project-config: Register new project "vmtp" into stackforge https://review.openstack.org/150606 | 23:08 |
| morganfainberg | jeblair, nice | 23:10 |
| marun | clarkb: is there documentation as to the check/queue/approval process? | 23:10 |
| clarkb | marun: for reviewers? | 23:11 |
| marun | clarkb: yeah | 23:11 |
| sdague | dhellmann: so... oslo.messaging needs to be capped on stable/juno | 23:11 |
| *** hj-hp has quit IRC | 23:11 | |
| marun | clarkb: we have a vendor patch that is passing ci and unit tests/pep8/etc | 23:11 |
| *** liusheng has quit IRC | 23:11 | |
| clarkb | marun: http://docs.openstack.org/infra/manual/developers.html#code-review and http://docs.openstack.org/infra/manual/core.html | 23:11 |
| *** andreykurilin_ has quit IRC | 23:12 | |
| *** achanda has quit IRC | 23:12 | |
| *** liusheng has joined #openstack-infra | 23:12 | |
| clarkb | marun: is that what you are looking for? two slightly different audiences with specific info for each | 23:12 |
| *** otter768 has quit IRC | 23:12 | |
| *** bknudson has quit IRC | 23:12 | |
| marun | clarkb: that answers it | 23:12 |
| jeblair | there's also an outstanding review for the last section on that page: https://review.openstack.org/#/c/138595/ (it doesn't look quite ready yet) | 23:13 |
| marun | clarkb: the vendor patch passes its own ci and unit tests + pep8 + lint, but is failing tempest jobs in the check run | 23:13 |
| marun | clarkb: someone suggested approving since all the tests affected by the patch were clean and an approval would put it back in the check queue and then if it passes that in the gate queue | 23:13 |
| marun | clarkb: the docs would seem to back that up | 23:13 |
| jeblair | marun: THE DOCS ARE CORRECT AND USEFUL! HUZZAH! | 23:14 |
| * jeblair does happy dance | 23:14 | |
| marun | jeblair: huzzah indeed. I can never remember the order of operations so it's good to have a reference. | 23:14 |
| *** krtaylor has quit IRC | 23:15 | |
| ociuhandu | hi all, the Hyper-V CI is down due to patch https://review.openstack.org/#/c/149348 | 23:15 |
| ociuhandu | We have submitted a fix for it https://review.openstack.org/#/c/150373 Can anyone help us in getting it merged? It still misses a second +2 | 23:15 |
| clarkb | ociuhandu: you will need neutron core reviewers | 23:16 |
| jroll | looks like marun just approved it :P | 23:16 |
| *** kurtmartin has quit IRC | 23:17 | |
| ociuhandu | jroll: yes, just got it now, a minute ago was still waiting, thank you marun | 23:17 |
| *** kurtmartin has joined #openstack-infra | 23:18 | |
| openstackgerrit | Yichen Wang proposed openstack-infra/project-config: Register new project "vmtp" into stackforge https://review.openstack.org/150606 | 23:18 |
| openstackgerrit | Merged openstack-infra/infra-manual: Remove third party page from the manual https://review.openstack.org/143737 | 23:18 |
| marun | ociuhandu: the current jenkins check run was failing, and I was just confirming whether I needed to wait on a successful recheck before approval. | 23:18 |
| openstackgerrit | Spencer Krum proposed openstack-infra/zuul: Update example gerrit messages for new syntax https://review.openstack.org/150616 | 23:18 |
| *** andreykurilin_ has joined #openstack-infra | 23:18 | |
| *** hj-hp has joined #openstack-infra | 23:18 | |
| *** liusheng has quit IRC | 23:19 | |
| *** liusheng has joined #openstack-infra | 23:19 | |
| *** bswartz has quit IRC | 23:20 | |
| sdague | grenade fix - https://review.openstack.org/150618 | 23:21 |
| ociuhandu | marun: it should be fine as the difference between the successful run on Jenkins and the last one is just a comment and a fix on the unit test parameter | 23:21 |
| ociuhandu | marun: thank you | 23:22 |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/zuul: Add a dequeue command https://review.openstack.org/95035 | 23:23 |
| marun | ociuhandu: the relevant jobs were passing, but what I was confirming was whether the gate was smart enough to force another check run automatically if the previous one had failed. | 23:23 |
| *** weshay has quit IRC | 23:24 | |
| jeblair | timrc_: why did you remove the related changes? | 23:26 |
| *** liusheng has quit IRC | 23:26 | |
| *** liusheng has joined #openstack-infra | 23:27 | |
| *** kurtmartin has quit IRC | 23:27 | |
| *** kurtmartin has joined #openstack-infra | 23:28 | |
| sdague | fungi / clarkb until - https://review.openstack.org/150618 lands, we're wedged as all juno => master grenade is un workable | 23:28 |
| *** ddieterly has quit IRC | 23:29 | |
| *** mgagne_ is now known as mgagne | 23:29 | |
| clarkb | sdague: ok, I have no +2 | 23:29 |
| clarkb | but you have m +1 | 23:30 |
| jeblair | clarkb: since when do you not have +2 on reqs-core? | 23:30 |
| clarkb | jeblair: when its a cahnge to juno | 23:30 |
| jeblair | ah | 23:30 |
| timrc_ | jeblair, Eek. If I did something I wasn't suppose to it was out of pure ignorance. I just fetched Jonathan's patch, made my changes, rebased and pushed back. | 23:30 |
| *** amitgandhinz has quit IRC | 23:30 | |
| sdague | clarkb: really? that seems weird | 23:31 |
| sdague | we should give infra +2 there | 23:31 |
| sdague | even on stable | 23:31 |
| jeblair | we should do that by adding infra-core explicitly to the refs/heads/stable/* acl for openstack/requirements | 23:32 |
| *** annegent_ has quit IRC | 23:32 | |
| jeblair | but we might have to copy the whole stanza there since it's set as exclusive in all-projects | 23:32 |
| timrc_ | jeblair, Ah so you were talking about an implementation detail, I thought I blew something up in gerrit :) | 23:33 |
| *** kurtmartin has quit IRC | 23:33 | |
| *** patrickeast has quit IRC | 23:33 | |
| jeblair | timrc_: heh :) yep | 23:34 |
| *** dizquierdo has joined #openstack-infra | 23:34 | |
| *** markvoelker has quit IRC | 23:35 | |
| timrc_ | jeblair, Thanks for your explanation of what's suppose to happen. I introduced that change because I wasn't seeing the related changes removed from the check queue, but that, apparently is intentional. | 23:35 |
| *** liusheng has quit IRC | 23:36 | |
| jeblair | timrc_: yeah, i think in that case, we should just list all the changes we want to remove | 23:36 |
| *** harlowja has joined #openstack-infra | 23:36 | |
| *** liusheng has joined #openstack-infra | 23:36 | |
| *** baoli has joined #openstack-infra | 23:37 | |
| *** liusheng has quit IRC | 23:41 | |
| *** liusheng has joined #openstack-infra | 23:41 | |
| mordred | sdague, jeblair, clarkb: I support infra-core in stable/* in requirements - it's bit us a few times before not having it | 23:43 |
| *** joel-coffman has joined #openstack-infra | 23:44 | |
| sdague | ok, I just made an executive decision and added infra core to requirements stable | 23:45 |
| *** hdd has quit IRC | 23:45 | |
| mordred | sdague: woot | 23:45 |
| sdague | because everyone else on that list is basically in europe and gone | 23:45 |
| sdague | https://review.openstack.org/#/admin/groups/530,members - except adam_g | 23:45 |
| marun | sdague: oy. I was setting DEST correctly, but before importing devstack/functions-common which then overwrite it :/ | 23:46 |
| Shrews | jeblair: many thanks for the shade reviews. https://review.openstack.org/150158 can be approved since it has no dependencies | 23:46 |
| sdague | oh, that was the wrong thing to do, but it has the right impact now | 23:46 |
| openstackgerrit | Andrey Kurilin proposed openstack-infra/project-config: Make rally-py34 job voting https://review.openstack.org/150621 | 23:46 |
| sdague | mordred: you want to review the requirements change? | 23:46 |
| *** liusheng has quit IRC | 23:46 | |
| mordred | sdague: oh - crap. I opened myself up to that didn't I? | 23:47 |
| sdague | yes | 23:47 |
| mordred | on it | 23:47 |
| sdague | https://review.openstack.org/#/c/150618/ | 23:47 |
| *** liusheng has joined #openstack-infra | 23:47 | |
| jeblair | Shrews: yeah, i was about to go back and do a second pass on aprv | 23:47 |
| adam_g | sdague, eek. when did that break? | 23:47 |
| mordred | +2 from me | 23:47 |
| openstackgerrit | Andrey Kurilin proposed openstack-infra/project-config: Make rally-py34 job voting https://review.openstack.org/150621 | 23:47 |
| Shrews | jeblair: ah, apologies :) | 23:47 |
| jeblair | Shrews: wanted to make sure i had the big picture first | 23:48 |
| mordred | adam_g: I don't know which thing you're talking about - but we learned several new cloud breakages today! | 23:48 |
| adam_g | mordred, the oslo.messaging thing, i assume there was a new release today | 23:48 |
| jeblair | mordred, Shrews: i think i'll rebase 149087 on master and hardcode the interval to 2 | 23:49 |
| adam_g | mordred, what else is broken? | 23:49 |
| tmcpeak | clarkb: still around? | 23:49 |
| clarkb | tmcpeak: yes | 23:49 |
| tmcpeak | I had further thoughts on pinning Bandit version I wanted to run by you | 23:49 |
| mordred | adam_g: I learned new ways that public cloud differences can break things | 23:49 |
| tmcpeak | we've designed Bandit so that it is controllable entirely through a profile | 23:49 |
| tmcpeak | so Keystone could have "profile/keystone.yaml" and another project could have "profile/xxx.yaml" | 23:49 |
| clarkb | tmcpeak: yes flake8 is that way too, I still am against it | 23:49 |
| Shrews | jeblair: sounds smart. the glance-support feature branch has waaaay too many dependencies (though much smaller now) | 23:50 |
| clarkb | there are three things you can count on. death, taxes, and linters breaking on the next release | 23:50 |
| tmcpeak | clarkb: lol | 23:50 |
| tmcpeak | fair enough | 23:50 |
| tmcpeak | so if we pin a version, and want to update, then what's the process? | 23:50 |
| *** dmsimard is now known as dmsimard_away | 23:50 | |
| clarkb | tmcpeak: usually at the beginning of a dev cycle you bump the version in global reqs, then bump it in idividual projects with a change to fix any problems | 23:50 |
| openstackgerrit | Sean Dague proposed openstack-infra/project-config: add infra-core to stable requirements https://review.openstack.org/150626 | 23:51 |
| Shrews | mordred: but... but... but... openstack was supposed to eliminate the vendor differences! ;) | 23:51 |
| sdague | adam_g: yeh, new release today | 23:51 |
| * mordred throws a raging buffalo at Shrews | 23:51 | |
| Shrews | rofl | 23:51 |
| clarkb | mordred: you should've thrown the vendors at him | 23:51 |
| tmcpeak | clarkb: dev cycle meaning 6 month release cycle? | 23:51 |
| clarkb | tmcpeak: yes | 23:51 |
| * mordred throws ALL of the OpenStack vendors at ALL of the OpenStack vendors | 23:51 | |
| mordred | what's bandit? | 23:52 |
| *** achanda has joined #openstack-infra | 23:52 | |
| openstackgerrit | Merged openstack-infra/shade: Fix obj_to_dict type filtering https://review.openstack.org/150158 | 23:52 |
| mordred | woot! | 23:52 |
| tmcpeak | clarkb: even if the gate is set up to be non-blocking? | 23:52 |
| clarkb | mordred: its a non flake8 linter to do security linting | 23:52 |
| clarkb | tmcpeak: the goal should be to be blocking otherwise ti will just be ignored | 23:52 |
| tmcpeak | mordred: yep, ^ | 23:52 |
| clarkb | tmcpeak: see pylint and nova | 23:52 |
| dstufft | instead of linting just make py fmt | 23:53 |
| *** dangers is now known as dangers_away | 23:53 | |
| mordred | oh - right | 23:53 |
| mordred | I remember seeing something about that - cool | 23:53 |
| tmcpeak | clarkb: eventually we'd love it to block, but figured we'd start non-blocking to get projects to at least adopt | 23:53 |
| jeblair | clarkb, fungi, mordred, SergeyLukjanov, reed (who is not here): the mailman site password i have recorded is not correct | 23:53 |
| dstufft | go fmt is great | 23:53 |
| *** hj-hp has quit IRC | 23:53 | |
| dstufft | easily the pest thing about golang | 23:53 |
| mordred | jeblair: AWESOME | 23:53 |
| *** doug-fish has left #openstack-infra | 23:53 | |
| dstufft | people shouldn't have opinions about code formating, that's for the formatter to care about :V | 23:53 |
| *** yamahata has joined #openstack-infra | 23:54 | |
| clarkb | dstufft: this isnt about format but about correctness fwiw | 23:54 |
| clarkb | jeblair: huh | 23:54 |
| tmcpeak | as a trial we could monitor it manually and file bugs whenever the non-blocking gate fails | 23:54 |
| dstufft | clarkb: for bandit or flake8? ;P | 23:54 |
| clarkb | dstufft: bandit | 23:54 |
| clarkb | dstufft: in theory pyflakes too | 23:54 |
| dstufft | yea I meant flake8, security things is harder | 23:54 |
| mordred | yah - pyflakes has caught real bgs for me too | 23:54 |
| dstufft | I don't use pyflakes so i dunno | 23:55 |
| mordred | it's not FREQUENT and there are plenty of things that arent' correctness - but it does happen | 23:55 |
| *** markvoelker has joined #openstack-infra | 23:55 | |
| tmcpeak | here's the wiki for Bandit if anybody is curious: https://wiki.openstack.org/wiki/Security/Projects/Bandit | 23:55 |
| dstufft | I use flake8 and 100% test coverage :V | 23:55 |
| clarkb | dstufft: its half of flake8 :) | 23:55 |
| dstufft | oh | 23:55 |
| dstufft | welp | 23:55 |
| *** andreykurilin_ has quit IRC | 23:55 | |
| clarkb | down to one shard before I can reboot 05 | 23:55 |
| jeblair | flake8 := pyflakes + pep8 | 23:55 |
| mordred | tmcpeak: so - I think the general problem statement is "how do we have a linter that can develop new rules without suddenly breaking existing things" | 23:56 |
| mordred | which turns out to be rather hard | 23:56 |
| tmcpeak | mordred: I completely agree with that | 23:56 |
| tmcpeak | can't profiles handle it though? | 23:56 |
| mordred | at the moment, we've developed the "at the beginning of the cycle" policy mainly to reduce churn in projects | 23:56 |
| mordred | well - with profiles, then we don't have a consistent target that people know to code for | 23:56 |
| tmcpeak | Bandit has capability to have inclusive or exclusive test sets | 23:56 |
| clarkb | tmcpeak: in theory yes but in practice no | 23:56 |
| tmcpeak | if we have "keystone profile" for starters, then people can code against that | 23:57 |
| mordred | and I think you'll find that it will get messier - although I think that profiles _are_ still useful | 23:57 |
| tmcpeak | it can move more conservatively while still allowing Bandit to grow more quickly | 23:57 |
| mordred | all of this to expand on the why our current approach is what it is | 23:57 |
| clarkb | part of the problem is when you break compat regardless of a profile by making a particular rule stronger | 23:57 |
| tmcpeak | mordred: I see | 23:57 |
| clarkb | this happens all the time | 23:57 |
| clarkb | even when people say they will never do it | 23:57 |
| tmcpeak | clarkb: ahh | 23:57 |
| * clarkb glares at puppetlint | 23:57 | |
| dstufft | tmcpeak: I think the problem is that if each project has their own profile then you have to know what the rignt thing to do is per project instead of in general | 23:57 |
| tmcpeak | yeah, I could totally see that happening | 23:57 |
| dstufft | clarkb: arguably that thing was a bug before and it was only jsut working by accident! | 23:58 |
| tmcpeak | dstufft: this is also true | 23:58 |
| mordred | I'm not convinced there is a 1-to-1 mapping - but before we can rethink anything of how it is now, I think we need to make sure we fully understand the ramifications of the current approach | 23:58 |
| *** berendt has quit IRC | 23:58 | |
| mordred | dstufft: yes - but it's in the code and we have captive gating | 23:58 |
| tmcpeak | I'm very open to suggestions :) | 23:58 |
| *** joel-coffman has quit IRC | 23:58 | |
| dstufft | mordred: sounds like someone would fix it quickly then ;) | 23:58 |
| mordred | dstufft: you'd think ... | 23:59 |
| *** salv-orlando has quit IRC | 23:59 | |
| tmcpeak | our main goal is to just get some project using it in a gate somehow | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!