clarkb | mordred: previous to that there was a bug in a js lib that node bundles into its binary | 00:00 |
---|---|---|
clarkb | mordred: so what do you hve to do? recompile | 00:00 |
sdague | marun: so I'm actually slightly confused as this point, because clearly openstack services can call rootwrap after this point | 00:00 |
mordred | clarkb: right. but the distro model does not work for the people who are actually doing web dev and does not provide value | 00:00 |
marun | sdague: :/ | 00:00 |
*** msabramo has joined #openstack-infra | 00:00 | |
marun | sdague: here's the console log: http://logs.openstack.org/43/104043/5/check/check-neutron-dsvm-functional/2a39c8a/console.html | 00:00 |
mordred | clarkb: so I'm not sure why we expect them to bow down at the alter of a system that was designed for and optimized for managing C dependencies | 00:01 |
mordred | mind you - they're assholes | 00:01 |
nibalizer | mordred: so isn't port 8081 available on puppetdb from ci-puppetmaster? | 00:01 |
mordred | giant assholes | 00:01 |
nibalizer | just use that | 00:01 |
clarkb | mordred: except its C :P | 00:01 |
mordred | but I don't thin kthe distros are much better | 00:01 |
clarkb | mordred: this is exactly what the tooling is for | 00:01 |
marun | sdague: if you search for 'Removing sudo privileges' | 00:01 |
mordred | in their lack of flexibility and their inability to deal with solving problems | 00:01 |
sdague | marun: yeh, sure | 00:01 |
marun | sdague: I'm not sure how any services running as the devstack user are going to have permission to do anything. What am I missing? | 00:02 |
sdague | but we *know* that neutron can make rootwrap calls after this point, because it does it all the time | 00:02 |
sdague | otherwise all the tests fail | 00:02 |
marun | sdague: does it though? post_test_hook implies that everything that has to run, has run. or no? | 00:02 |
sdague | hmmmm | 00:02 |
marun | sdague: doesn't sudo use some kind of token that has a lifespan? | 00:03 |
marun | sdague: i.e. what is removed by 'sudo -k' | 00:03 |
sdague | no, we actually do this before we call tempest | 00:03 |
mordred | clarkb: the problem is - deploy-time compilation and inclusion makes technical sense in the web world | 00:03 |
mordred | clarkb: but it violates long-held principles of "don't do that" in the distro world | 00:03 |
mordred | rather than working to figure out how to solve the problem at hand | 00:03 |
mordred | people are just told they're wrong | 00:04 |
mordred | which isn't helpful | 00:04 |
clarkb | mordred: well arguably compiling js into your C binary is wrong no matter how you look at it | 00:04 |
marun | sdague: do you have an example of the config that calls tempest? | 00:04 |
clarkb | mordred: but sure | 00:04 |
mordred | are people going to have to recompile/redeploy on update of bundled deploytime things? maybe | 00:04 |
openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack-infra/config: Create git repo and jenkins jobs for oslo.utils https://review.openstack.org/101230 | 00:04 |
mordred | but why not work on tools that help identify, recompile and help redeploy | 00:04 |
sdague | marun: yeh, the rootwrap sudoers files should still be there | 00:05 |
mordred | as a run-time and not a packaging time activity | 00:05 |
sdague | unless they didn't install for neutron | 00:05 |
marun | sdague: and that should work for the stack user? | 00:05 |
sdague | yep | 00:05 |
clarkb | mordred: I think partially because its a self inflicted wound | 00:05 |
clarkb | mordred: there really is no reason to force yourself to do that | 00:05 |
mordred | clarkb: anywho - we use pip to install things in ways that dstufft tells us not to, and we regularly tell the distros to get over it when they ask us to do things differently | 00:06 |
dims_ | clarkb, thanks for the review. fixed that job to vote | 00:06 |
clarkb | if openssl has a massive vulnerability you update openssl | 00:06 |
sdague | marun: os1:/etc/sudoers.d> sudo more nova-rootwrap | 00:06 |
sdague | sdague ALL=(root) NOPASSWD: /usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf * | 00:06 |
mordred | clarkb: I don't see why us chosing to use javascript tools shouldn't go the same way | 00:06 |
clarkb | dims_: what about the name? where are we on that? | 00:06 |
sdague | sdague is my stack user on this bo | 00:06 |
sdague | box | 00:06 |
clarkb | mordred: I am with you on that. I argued for using the js tools :) | 00:06 |
clarkb | mordred: but I appreciate the issues it poses | 00:06 |
mordred | clarkb: yah! oh, I apprecaite teh issues | 00:06 |
mordred | I just think we should force the issue of working on fixing them | 00:07 |
mordred | rather than pretending that they're python :) | 00:07 |
mordred | of all of the things they are not, python is certainly at the top | 00:07 |
marun | sdague: arg. | 00:07 |
mordred | also, they are not beef | 00:07 |
marun | sdague: the error is: 'sudo: no tty present and no askpass program specified' | 00:07 |
*** arosen has left #openstack-infra | 00:07 | |
sdague | marun: did the !requiretty get added again? | 00:07 |
sdague | because something that *is* in 50_stack_sh | 00:08 |
sdague | Defaults:sdague secure_path=/sbin:/usr/sbin:/usr/bin:/bin:/usr/local/sbin:/usr/local/bin | 00:08 |
sdague | Defaults:sdague !requiretty | 00:08 |
mordred | sdague: do you ever wish we had a bot that read all of the patches and looked for certain strings and then poked some of us in IRC when they show up? | 00:08 |
sdague | maybe | 00:08 |
sdague | I more wish I could tell a bot my review comments for a patch | 00:08 |
sdague | so when someone pinged me for a review, I could have a conversation with them in IRC and it would record that as my review comments | 00:09 |
mordred | sdague: +10000000 | 00:09 |
marun | sdague: How to see the contents of /etc/sudoers.d/neutron-rootwrap on a gate node? | 00:09 |
mordred | sdague: one of the reasons my review numbers aren't as good is that I often chat with people about their patches in IRC | 00:09 |
sdague | marun: ... with sudo? | 00:09 |
mordred | not that numbers are iportant | 00:09 |
mordred | but just saying - I tend to IRC people ... | 00:09 |
sdague | marun: we could make d-g capture it | 00:10 |
clarkb | interactive discussion is useful | 00:10 |
clarkb | oh hey jeblair +2'd my change | 00:10 |
clarkb | I will approve that shortly | 00:10 |
marun | sdague: So I should submit a patch to config that outputs the contents of the file? | 00:11 |
sdague | marun: you could capture that a couple of ways | 00:11 |
*** penguinRaider has joined #openstack-infra | 00:11 | |
sdague | having devstack-gate upload them would be valid | 00:11 |
sdague | but more importantly, do you believe that you've added the !requiretty anywhere in the sudo config? | 00:12 |
sdague | because I think that's the crux of the issue | 00:12 |
sdague | I actually think the rest of it is going to work now | 00:13 |
*** sarob has quit IRC | 00:13 | |
sdague | so maybe in your pre_hook add Defaults:stack !requiretty to /etc/sudoers.d/00_no_tty | 00:13 |
*** sarob has joined #openstack-infra | 00:14 | |
marun | sdague: I haven't changed the sudo config, though. The goal was to reuse the sudo config that neutron already uses in the gate, and that seems to work fine. | 00:14 |
sdague | so, it works fine for things that are daemons | 00:14 |
*** homeless has quit IRC | 00:15 | |
marun | sdague: yes | 00:15 |
sdague | but you aren't a daemon | 00:15 |
marun | sdague: nope. | 00:15 |
marun | sdague: config in question: https://github.com/openstack-infra/config/blob/master/modules/openstack_project/files/jenkins_job_builder/config/neutron-functional.yaml | 00:15 |
marun | sdague: the tox env sets the right environment variables in this test patch: https://review.openstack.org/#/c/104043/5/tox.ini | 00:16 |
sdague | echo "Defaults:stack !requiretty" | sudo tee /etc/sudoers.d/00_no_tty | 00:17 |
sdague | at line 33 | 00:17 |
sdague | sorry before line 32 | 00:17 |
marun | ok | 00:17 |
sdague | I think that's actually the issue | 00:17 |
dstufft | mordred: you should use pip only in dstufft approved ways imo | 00:17 |
dstufft | (just kidding) | 00:17 |
*** hogepodge has quit IRC | 00:18 | |
sdague | clarkb: what do you think? am I off in the woods on this sudo idea? | 00:18 |
*** sarob has quit IRC | 00:18 | |
marun | sdague: so that will have to merge before my test patch can work. is that ok? | 00:18 |
sdague | marun: I think so | 00:18 |
mordred | dstufft: I keep telling people that ... | 00:18 |
mordred | :) | 00:18 |
clarkb | sdague: I am not sure. jeblair is the sudo maestro | 00:18 |
sdague | it doesn't fundamentally violate what we are trying to do | 00:18 |
clarkb | it could be that stuff needs ot move back into test_hook | 00:18 |
sdague | dstufft: you need a stamp | 00:18 |
sdague | dstuff approved! | 00:19 |
marun | clarkb: where is test_hook called? | 00:19 |
clarkb | marun: in devstack_gate | 00:19 |
marun | clarkb: i only see gate_hook and pre/post_test_hook | 00:20 |
clarkb | sorry its called gate_hook | 00:20 |
openstackgerrit | A change was merged to openstack-infra/config: Use local ES balancers on logstash workers https://review.openstack.org/105303 | 00:20 |
marun | well, I | 00:20 |
*** msabramo has quit IRC | 00:21 | |
*** Evgeny has quit IRC | 00:22 | |
*** Evgeny_ has joined #openstack-infra | 00:22 | |
*** wenlock has quit IRC | 00:23 | |
openstackgerrit | Maru Newby proposed a change to openstack-infra/config: Fix neutron func job sudo config. https://review.openstack.org/105926 | 00:23 |
dims_ | clarkb, oslo.utils is good. we are sticking to oslo.* per doug | 00:23 |
clarkb | dims_: why did we rename projects to remove the . then? | 00:23 |
*** gangil_ has quit IRC | 00:24 | |
*** emagana has joined #openstack-infra | 00:24 | |
marun | clarkb, jeblair, sdague: if that makes sense? | 00:24 |
dims_ | clarkb, sphinx was special from what i understand | 00:24 |
marun | ^^ | 00:24 |
marun | biab | 00:25 |
clarkb | dims_: we don't do special... | 00:25 |
*** marun has quit IRC | 00:25 | |
*** alexpilotti has joined #openstack-infra | 00:25 | |
sdague | clarkb: if you override gate_hook, you don't get devstack | 00:26 |
clarkb | sdague: riht you have to add devstack in | 00:26 |
clarkb | but I think that is what you need | 00:26 |
sdague | yeh | 00:26 |
sdague | but I think we can get the exact behavior desired with this post_hook | 00:27 |
dims_ | clarkb, let me see if i can dig up notes from post-sphinx renaming | 00:27 |
sdague | because the *only* difference is a sudoers file with the tty rule | 00:27 |
sdague | and it seems silly to redo all of d-g.sh for that change | 00:27 |
clarkb | sdague: sure, does this edit need to go in pre test hook? | 00:27 |
openstackgerrit | Morgan Fainberg proposed a change to openstack/requirements: Add new keystone projects to projects.txt https://review.openstack.org/103375 | 00:27 |
clarkb | or does sudo work in post test hook until stuff happens? | 00:27 |
sdague | sudo works in post test hook | 00:28 |
sdague | just not for stack user | 00:28 |
clarkb | ok | 00:28 |
*** emagana has quit IRC | 00:28 | |
dims_ | clarkb, btw, the steps and the naming scheme is codified here - https://wiki.openstack.org/wiki/Oslo/CreatingANewLibrary | 00:29 |
*** UtahDave has left #openstack-infra | 00:30 | |
clarkb | dims_: fwiw I am fine with either way. I just don't want special snowflakes and I don't awnt to rename this project later if we can do it right now | 00:30 |
sdague | dims_: I thought we had all these namespace issues | 00:31 |
*** tusharsg has joined #openstack-infra | 00:31 | |
*** msabramo has joined #openstack-infra | 00:32 | |
dims_ | clarkb, sdague looking for notes from Doug that we worked past the namespace issues | 00:34 |
*** tsg has quit IRC | 00:34 | |
openstackgerrit | A change was merged to openstack-infra/elastic-recheck: Extend query for pip download timeout bug 1270710 https://review.openstack.org/105884 | 00:35 |
uvirtbot | Launchpad bug 1270710 in openstack-ci "sporadic pip timeouts during download" [Medium,Incomplete] https://launchpad.net/bugs/1270710 | 00:35 |
*** sballe has quit IRC | 00:35 | |
sdague | dims_: so I wrote a brutal work around in devstack for it, but I'm not convinced that's a definitive work around :) | 00:36 |
sdague | unless something else was done | 00:36 |
*** packet has quit IRC | 00:36 | |
* sdague kind of wishes oslo was 1 library | 00:36 | |
openstackgerrit | Steve Kowalik proposed a change to openstack-infra/config: Sprinkle in more USE_IRONIC to TripleO jobs https://review.openstack.org/105927 | 00:39 |
*** msabramo has quit IRC | 00:43 | |
*** hemna is now known as hemna_ | 00:45 | |
*** thedodd has joined #openstack-infra | 00:51 | |
openstackgerrit | A change was merged to openstack-infra/git-review: Update tests to use Gerrit 2.8.6.1 https://review.openstack.org/104249 | 00:55 |
*** bdpayne has quit IRC | 00:55 | |
*** thedodd has quit IRC | 00:56 | |
openstackgerrit | K Jonathan Harker proposed a change to openstack-infra/jeepyb: Allow for the newbie message to live in its own file https://review.openstack.org/105930 | 00:57 |
openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Add tools to hack on infra with Docker https://review.openstack.org/105917 | 00:57 |
openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Align prepare_node.sh with prepare-node in dib https://review.openstack.org/105931 | 00:57 |
openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Add support for disk-image-builder in nodepool https://review.openstack.org/88479 | 01:01 |
openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Add pre-requisites needed for diskimage-builder https://review.openstack.org/102583 | 01:01 |
openstackgerrit | Monty Taylor proposed a change to openstack-infra/config: Add tools to hack on infra with Docker https://review.openstack.org/105917 | 01:01 |
dims_ | sdague, clarkb - the long discussion in ML was in April (http://markmail.org/message/nr2f2nri43fyvdjp) and Doug updated the wiki with latest discussion in May (https://wiki.openstack.org/w/index.php?title=Oslo/CreatingANewLibrary&diff=53356&oldid=51766). I'll get Doug to post the "why" to the ML so everyone knows tomorrow | 01:02 |
dims_ | s/get/request/ | 01:02 |
clarkb | dhellmann: that thread says to me we should keep using oslo | 01:04 |
clarkb | er dims_ ^ | 01:04 |
clarkb | but it doesn't seem to differentiate between the . and no . | 01:04 |
dims_ | clarkb, the wiki updates are a month after the email discussion | 01:05 |
dims_ | i bet i need to check one of the weekly chats for more info | 01:05 |
sdague | clarkb: is this kosher? - https://review.openstack.org/#/c/98575/6 | 01:07 |
*** shashankhegde has quit IRC | 01:07 | |
clarkb | sdague: I mean it won't hurt anything, but bandersnatch fixed that bug already | 01:08 |
clarkb | sdague: and its sort of assumed you got tox already from somewhere | 01:08 |
sdague | clarkb: ok, can you comment on that then? | 01:08 |
clarkb | (it is weird to me that devstack would install tox) | 01:08 |
sdague | I'd rather not be adding talismans | 01:08 |
sdague | well you need tox to run tempest | 01:08 |
clarkb | sdague: sure, I guess to me tox was the bootstrap tool like pip | 01:09 |
clarkb | you had to have those two before anything else | 01:09 |
sdague | yeh, well you don't need anything for devstack | 01:09 |
sdague | it installs pip as well | 01:09 |
clarkb | sdague: commented. I didn't give a numberic value because its fine to add but it won't necessarily change anything | 01:11 |
sdague | clarkb: actually, that's all confusing to me. That's added just because someone that's not us is using our mirror? | 01:11 |
clarkb | sdague: yes | 01:12 |
sdague | yeh, f that | 01:12 |
clarkb | I mean it doens't hurt anything. But it doesn't necessarily help either | 01:12 |
*** Daisy has joined #openstack-infra | 01:13 | |
sdague | right, but if we don't need it we shouldn't do it. If we add talismans all through here, no one will know later that it's vestigial | 01:14 |
clarkb | sdague: did you see my comment about whitespace on the tip of os-loganalyze stack? | 01:16 |
dims_ | sdague, clarkb - oslo.db vs oslodb came up in ML thread and here's Doug's response - http://markmail.org/message/w4vj5jg454prkbwp | 01:16 |
clarkb | oh you did I masked it by setting my base to ps1 derp | 01:17 |
dims_ | that's all the nuggets i can find :) | 01:17 |
clarkb | dims_: ok, I disagree with that :) but at least there is concrete evidence for why the . is still a thing | 01:17 |
dims_ | clarkb, ack. | 01:18 |
clarkb | (if something is broken to where it doesnt work you fix it even if it sucks...) | 01:18 |
clarkb | sdague: stack is +2 to me | 01:19 |
*** emagana has joined #openstack-infra | 01:25 | |
*** amcrn has quit IRC | 01:25 | |
dims_ | clarkb, :) | 01:28 |
*** emagana has quit IRC | 01:29 | |
*** marcoemorais has quit IRC | 01:33 | |
*** Evgeny_ has quit IRC | 01:35 | |
*** praneshp has quit IRC | 01:36 | |
*** Sukhdev has quit IRC | 01:38 | |
*** praneshp has joined #openstack-infra | 01:41 | |
*** praneshp has quit IRC | 01:42 | |
*** praneshp has joined #openstack-infra | 01:44 | |
*** maxbit has quit IRC | 01:45 | |
*** moted has quit IRC | 01:45 | |
fungi | it's also worth noting that developers (maybe even operators/deployers) who configured their systems to install from our mirror against our recommendation are in for a rude awakening when we eventually delete the openstack pypi tree we're no longer using there in favor of the simple tree | 01:45 |
*** gangil has joined #openstack-infra | 01:46 | |
*** nosnos has joined #openstack-infra | 01:48 | |
*** gangil has quit IRC | 01:50 | |
*** praneshp has quit IRC | 01:51 | |
*** mfer has joined #openstack-infra | 01:56 | |
*** mfer has quit IRC | 01:57 | |
*** nati_uen_ has quit IRC | 02:02 | |
*** oanufriev has joined #openstack-infra | 02:02 | |
*** arnaud has quit IRC | 02:03 | |
oanufriev | guys, hi. I'broke jenkins job. What have i do to abort it? https://jenkins04.openstack.org/job/check-rally-dsvm-rally/177/console | 02:04 |
clarkb | oanufriev: there are timeuots on the jobs. it should die on its own | 02:04 |
*** mwagner_lap has quit IRC | 02:04 | |
oanufriev | oh, thanks. good news | 02:04 |
*** praneshp has joined #openstack-infra | 02:06 | |
*** mmaglana has quit IRC | 02:06 | |
*** zhiyan_ is now known as zhiyan | 02:07 | |
*** alexpilotti has quit IRC | 02:08 | |
*** asettle has quit IRC | 02:09 | |
openstackgerrit | Jamie Lennox proposed a change to openstack-infra/config: Add requests-mock to stackforge https://review.openstack.org/105941 | 02:09 |
openstackgerrit | jizhilong proposed a change to openstack-dev/hacking: Add check: unnecessary list comprehension in set() https://review.openstack.org/105942 | 02:10 |
*** jyuso has joined #openstack-infra | 02:12 | |
*** loquacities has quit IRC | 02:14 | |
*** loquacities has joined #openstack-infra | 02:14 | |
openstackgerrit | patrick-crews proposed a change to openstack-infra/config: Setting environment variables to ensure we execute basic tripleo overcloud upgrade tests. https://review.openstack.org/105944 | 02:15 |
*** asettle has joined #openstack-infra | 02:20 | |
openstackgerrit | Aaron Rosen proposed a change to openstack-infra/config: Add congress-specs as new project to stackforge https://review.openstack.org/105947 | 02:22 |
*** Evgeny has joined #openstack-infra | 02:22 | |
*** praneshp has quit IRC | 02:22 | |
*** gangil has joined #openstack-infra | 02:26 | |
*** trinaths has joined #openstack-infra | 02:27 | |
*** markwash has quit IRC | 02:28 | |
*** [1]trinaths has joined #openstack-infra | 02:30 | |
*** trinaths has quit IRC | 02:32 | |
*** [1]trinaths is now known as trinaths | 02:32 | |
*** Ryan_Lane has quit IRC | 02:32 | |
*** pballand has quit IRC | 02:34 | |
openstackgerrit | Aaron Rosen proposed a change to openstack-infra/config: Add congress-specs as new project to stackforge https://review.openstack.org/105947 | 02:34 |
*** trinaths has quit IRC | 02:36 | |
*** baohua has joined #openstack-infra | 02:39 | |
*** vhoward has joined #openstack-infra | 02:47 | |
*** zz_johnthetubagu has quit IRC | 02:50 | |
*** mancdaz has quit IRC | 02:50 | |
*** zz_johnthetubagu has joined #openstack-infra | 02:52 | |
*** zz_johnthetubagu is now known as johnthetubaguy | 02:52 | |
*** mancdaz has joined #openstack-infra | 02:52 | |
tusharsg | clarkb: I am back to debugging the centos6 + py26 issue with pyeclib .. at this point I have pyeclib building/installing fine with "tox -e py26" in centos6 - but jenkis on a latest recheck still seems unhappy https://jenkins01.openstack.org/job/gate-swift-python26/4546/console | 02:53 |
*** tusharsg is now known as tsg | 02:54 | |
*** baohua has quit IRC | 02:55 | |
tsg | clarkb: wondering what would be the best way to further debug this issue | 02:56 |
*** baohua has joined #openstack-infra | 02:56 | |
clarkb | tsg: how were you testing? | 02:57 |
clarkb | oh I see tox there | 02:57 |
clarkb | I missed that somehow. and that particular test runs? | 02:57 |
tsg | yeah "tox -e py26" runs fine | 02:57 |
*** mmaglana has joined #openstack-infra | 02:57 | |
tsg | also "pip install pyeclib" in a venv works | 02:58 |
tsg | this is on a vagrant centos6.5 box + puppet/modules from config.git | 02:59 |
clarkb | I have just held one of the actual slaves, and will poke around there | 03:02 |
tsg | clarkb: appreciate that! :) | 03:02 |
*** HenryG has joined #openstack-infra | 03:03 | |
*** markwash has joined #openstack-infra | 03:04 | |
*** vhoward has left #openstack-infra | 03:06 | |
*** dstufft|laptop has joined #openstack-infra | 03:11 | |
clarkb | fungi: btw with this held node I am noticing packet loss from hpcloud to git.o.o | 03:14 |
clarkb | fungi: mtr blames routers living in us.above.net | 03:15 |
clarkb | fungi: and http and git protocols both seem happy but https is not | 03:16 |
clarkb | fungi: there is somethingreally funny going on | 03:16 |
*** nati_ueno has joined #openstack-infra | 03:20 | |
*** dims_ has quit IRC | 03:22 | |
clarkb | tsg: ok I have reproduced | 03:22 |
clarkb | tsg: there is no pyeclib package installed at all | 03:22 |
*** dims_ has joined #openstack-infra | 03:23 | |
tsg | clarkb: good to know you are able to see the same thing .. that matches what "pip freeze" output is telling us | 03:23 |
*** nosnos has quit IRC | 03:23 | |
clarkb | now trying to see if I can figure out wy | 03:24 |
tsg | clarkb: are you able to use the slave to try out stuff? such as "pip install pyeclib" etc? or even better "tox -e py26" in the leftover swift dir | 03:24 |
tsg | clarkb: thanks! | 03:24 |
clarkb | tsg: so I did pip install pyeclib>=0.9.2 it returns success, pip freeze | grep pyeclib reports no install | 03:24 |
clarkb | so I think it must be realted to the install of pyeclib | 03:24 |
clarkb | its sayign it succeeded when it fails | 03:24 |
*** elambert has joined #openstack-infra | 03:25 | |
* tsg nods | 03:25 | |
tsg | clarkb: i assume it pulled down pyeclib 0.9.4 .. or tried to, anyway | 03:25 |
tsg | clarkb: could this be an issue with pip version? | 03:26 |
clarkb | tsg: maybe, I have pip 1.5.6 | 03:26 |
clarkb | tsg: more likely it is a bug in tha tcrazy setup.py | 03:26 |
clarkb | I am currently trying to udnerstand what it is doing | 03:27 |
tsg | clarkb: one thing I must mention .. the way it is in requirements.txt is "pyeclib" but actually the package name is "PyECLib" | 03:27 |
clarkb | that may make a difference | 03:27 |
tsg | clarkb: right now it is doing a lot of crazy stuff - we are actively working on cleaning it up .. should be up very soon (next week) | 03:27 |
clarkb | how is it registered in pypi? | 03:28 |
*** mmaglana has quit IRC | 03:28 | |
tsg | PyECLib | 03:28 |
clarkb | always use the same string as it is registered in pypi | 03:28 |
* clarkb tries that | 03:28 | |
tsg | clarkb: gotcha :) | 03:28 |
*** jerryz has quit IRC | 03:29 | |
tsg | clarkb: I have seen pip "figure out" the name to be PyECLib on py27 .. that may have been added in a later ver of pip | 03:29 |
clarkb | tsg: yes pip can figure things out and package names are not case sensitive | 03:29 |
clarkb | tsg: but there are corner cases where if you dont' get it right stuff faisl. so why not use the actual name/ | 03:29 |
clarkb | anyways that didin't change anything | 03:29 |
clarkb | tsg: we are using the lastest version of pip (1.5.6) | 03:30 |
tsg | clarkb: I agree - we'll fix that | 03:30 |
tsg | clarkb: ok I didn't realize | 03:30 |
tsg | clarkb: do you have access to the actual requirements.txt tox was trying to use? | 03:30 |
tsg | just to make sure the package appears in there .. | 03:31 |
clarkb | tsg: yes it is the same as in your cange | 03:31 |
clarkb | tsg: https://review.openstack.org/#/c/103644/2/requirements.txt that is exactly what is used | 03:31 |
tsg | clarkb: ok thanks | 03:31 |
elambert | tsg: shouldn't that be greater than 0.9.4 ? | 03:31 |
elambert | the change has 9.2 | 03:32 |
tsg | elambert: we have >=0.9.2 .. it picks the latest | 03:32 |
elambert | fair'nuff … | 03:33 |
tsg | elambert: clarkb confirmed that it was picking 0.9.4 - but I will get it updated in the next rev of the patch | 03:33 |
* elambert nods | 03:33 | |
*** emagana has joined #openstack-infra | 03:34 | |
*** markwash has quit IRC | 03:35 | |
*** mmaglana has joined #openstack-infra | 03:35 | |
clarkb | right so I think the problem is your *-c_eclib.sh scripts are not set -e | 03:35 |
clarkb | so things can fail silenty | 03:35 |
clarkb | there are explicit checks that can cause failure but nothing eg in the event that make fails | 03:35 |
clarkb | so it silently reports success without doing anything | 03:35 |
*** emagana_ has joined #openstack-infra | 03:35 | |
clarkb | so I guess the next step is to clone pyeclib and see if making some changes clears anything up | 03:36 |
clarkb | tis build process appears to grab random things from the internet | 03:37 |
tsg | clarkb: we are working on changing that :) | 03:37 |
clarkb | sure but that means these tests could fail at any time due to factors completely out of our control | 03:37 |
tsg | clarkb: we are trying to separate c_eclib into separate project (liberasurecode) | 03:37 |
clarkb | ok git tip of master installs properly | 03:38 |
tsg | clarkb: yeah .. it does seem to install fine by hand | 03:38 |
*** emagana has quit IRC | 03:38 | |
tsg | (and on py27) | 03:38 |
openstackgerrit | jizhilong proposed a change to openstack-dev/hacking: Add check: unnecessary list comprehension in set() https://review.openstack.org/105942 | 03:38 |
tsg | clarkb: assume you used https://bitbucket.org/kmgreen2/pyeclib | 03:38 |
clarkb | yes | 03:38 |
clarkb | now to grab the tarball and try isntalling that | 03:39 |
tsg | off of pyeclib .. ok .. that should go fine as well :) | 03:39 |
tsg | sorry s/pyeclib/pypi | 03:39 |
*** emagana_ has quit IRC | 03:40 | |
clarkb | yup that works too | 03:41 |
clarkb | so its a pip + pypi thing? | 03:41 |
clarkb | where pypi may or may not be our mirror | 03:41 |
* clarkb grabs package from the mirror | 03:41 | |
tsg | clarkb: yeah looks like it | 03:41 |
clarkb | ohhh here we go | 03:41 |
clarkb | http://pypi.openstack.org/simple/PyECLib/ | 03:41 |
clarkb | thats only 0.9.2 | 03:42 |
tsg | clarkb: how often is that updated? | 03:42 |
clarkb | tsg: should be continuous but bandersnatch may have had a sad | 03:43 |
clarkb | mordred: ^ | 03:43 |
tsg | clarkb: :) | 03:43 |
tsg | clarkb: we did find some issues on centos6 and pushed it few hours ago | 03:43 |
tsg | may not have been propagated | 03:43 |
clarkb | tsg: http://paste.openstack.org/show/85862/ so thats the problem | 03:44 |
tsg | clarkb: learning a lot here about openstac infra .. heh .. pypi mirror is another one! | 03:44 |
clarkb | tsg: I highly recommend making your install scripts set -2 | 03:44 |
clarkb | er set -e | 03:44 |
clarkb | tsg: you have `make` running and its error code is not interpretted by anything | 03:44 |
clarkb | just as happened above | 03:45 |
tsg | clarkb: will get that change in asap | 03:45 |
elambert | so that was the issue we had fixed in 9/4 | 03:45 |
elambert | err 9.4 | 03:45 |
clarkb | elambert: its not fixed | 03:45 |
clarkb | elambert: it may be that make works on centos6 now | 03:45 |
clarkb | elambert: but if you break it again you won't now | 03:45 |
clarkb | tsg: the reason we use a mirror is the internet is unreliable. THis is why I point out that your install downloads random things from internet | 03:46 |
elambert | clarkb: not disagreeing with -e | 03:46 |
clarkb | tsg: bceause it bypasses any sort of mirroring that your downstreams may attempt to do | 03:46 |
tsg | clarkb: so simply exit(err) from the shell and setup.py doing a sys.exit(err) is not enough .. looks like | 03:46 |
tsg | clarkb: agree with that | 03:46 |
*** arnaud has joined #openstack-infra | 03:46 | |
clarkb | tsg: no because you are ignoring the return codes on many commands | 03:46 |
clarkb | tsg: notably make | 03:46 |
*** emagana has joined #openstack-infra | 03:47 | |
tsg | clarkb: not completely ignoring: | 03:47 |
tsg | make | 03:47 |
tsg | [ $? -ne 0 ] && popd && popd && exit 5 | 03:47 |
clarkb | mordred: dstufft RuntimeError: Could not acquire lock on /srv/static/mirror/.lock. Another instance seems to be running. bandersnatch is complaining about that | 03:47 |
tsg | but I get the point | 03:47 |
elambert | clarkb: so the paste you provide above .. was that from 0.9.4? | 03:48 |
*** emagana has quit IRC | 03:48 | |
clarkb | tsg: https://bitbucket.org/kmgreen2/pyeclib/src/5fc005a96e5263ed20f125b9dda2da59f07f2deb/c_eclib-0.9/install-c_eclib.sh?at=master#cl-97 | 03:48 |
tsg | elambert: from 0.9.2 .. http://pypi.openstack.org/simple/PyECLib/ | 03:48 |
clarkb | elambert: no that is from 0.9.2 which is what we are using | 03:48 |
*** emagana has joined #openstack-infra | 03:48 | |
clarkb | because bandersnatch got itself wedged | 03:48 |
* elambert nods | 03:48 | |
tsg | clarkb: I see that .. certainly missed that one! | 03:49 |
tsg | clarkb: I think it is better we work on separating c_eclib out and eliminate the compile time dependencies on jerasure etc (that we download at compile time) | 03:50 |
elambert | tsg: +1 :-) | 03:50 |
tsg | clarkb: in that version we move to a complete autotools env .. no build scripts | 03:51 |
tsg | clarkb: this is an interim version so Swift development can move forward | 03:51 |
tsg | clarkb: if we split into PyECLib + liberasurecode, I assume we need to get liberasurecode into requirements (you told us where yesterday) | 03:52 |
tsg | for that to happen do we need to have Debian and RedHat packages already? | 03:53 |
clarkb | tsg: for what its worth its not the end of the world to do what you do. But eg libzmq falls back on it rather than enforcing it | 03:53 |
*** emagana has quit IRC | 03:53 | |
openstackgerrit | Joshua Hesketh proposed a change to openstack-infra/os-loganalyze: Log swift errors to stderr https://review.openstack.org/104719 | 03:53 |
clarkb | tsg: no liberasurecode would be a C dep installed by the operating system right? | 03:53 |
*** nosnos has joined #openstack-infra | 03:53 | |
tsg | clarkb: yes | 03:53 |
clarkb | tsg: we would have to isntall it on the slaves if that is the case using apt and yum | 03:53 |
clarkb | the global-requirements list is for python dependencies | 03:54 |
*** blamar has quit IRC | 03:54 | |
tsg | clarkb: gotcha .. so we need to get it into Debian and Redhat before we can request anything | 03:54 |
tsg | clarkb: thankfully zigo has already begun the work on debian | 03:56 |
clarkb | mordred: dstufft: lsof says the process I expect to be bandersnatching has the .lock file open. Could this be an flock put in place by a dead process? I thought flocks only lived as long as a process because process tables | 03:56 |
clarkb | tsg: ubuntu and centos | 03:56 |
tsg | clarkb: but with this newfound Centos6 requirement (for my pov :)), we need to rush into centos as well :) | 03:56 |
tsg | need to talk to zaitcev about it! | 03:56 |
*** dims_ has quit IRC | 03:57 | |
tsg | clarkb: does it have to be on official ubuntu/debian ppa? | 03:57 |
tsg | clarkb: never mind .. :) | 03:59 |
tsg | many thanks for all your help! | 03:59 |
clarkb | tsg: so we don't need debian at all (though debian will want it anyways because they do openstack too and getting it into debian usually makes things trickle into ubuntu) | 03:59 |
clarkb | we would need the package in ubuntu trusty's repos | 03:59 |
tsg | clarkb: ah that's good to know! :) | 03:59 |
clarkb | we try to avoid ppas because they tend to not come with any formal security updates and the like | 03:59 |
tsg | clarkb: that makes sense | 04:00 |
tsg | so Ubuntu and Centos repos specifically | 04:00 |
tsg | gotcha | 04:00 |
tsg | elambert: can you also please make a note of that :) | 04:00 |
elambert | tsg ..noted | 04:01 |
clarkb | mordred: dstufft so the way we are running bandersnatch is via cron on a 5 minute interval | 04:01 |
tsg | elambert: thanks - we need to rush this stuff for certain | 04:01 |
clarkb | mordred: dstufft the crons are complaining because there is a day old bandersnatch that is still alive | 04:01 |
clarkb | mordred: dstufft: is it safe to kill that running bandersnatch? to see if cron will start another happier process? | 04:02 |
clarkb | mordred: also the run_bandersnatch script doesn't seem to be in use yet | 04:02 |
tsg | clarkb, elambert: thanks much .. later | 04:03 |
*** tsg is now known as tsg_away | 04:03 | |
dstufft|laptop | clarkb: yes it should be safe | 04:04 |
clarkb | mordred: dstufft bandersnatch is doing a lot of gettimeofday and select | 04:04 |
clarkb | dstufft|laptop: thanks, I will go ahead and try that then | 04:04 |
clarkb | dstufft|laptop: http://paste.openstack.org/show/85863/ is what it says now which doesn't seem great but also implies bandersnatch is trying | 04:05 |
clarkb | well its late I am not going to worry about it tonight | 04:07 |
*** Daisy has quit IRC | 04:08 | |
*** tsg_away has quit IRC | 04:08 | |
*** blamar has joined #openstack-infra | 04:08 | |
*** ildikov has quit IRC | 04:09 | |
*** chuckC has quit IRC | 04:12 | |
*** mtreinish has quit IRC | 04:19 | |
*** pballand has joined #openstack-infra | 04:19 | |
*** amitpp has joined #openstack-infra | 04:19 | |
*** mtreinish has joined #openstack-infra | 04:20 | |
*** ArxCruz has quit IRC | 04:23 | |
*** asettle has quit IRC | 04:27 | |
*** mmaglana has quit IRC | 04:28 | |
*** emagana has joined #openstack-infra | 04:33 | |
*** pcrews has quit IRC | 04:34 | |
*** chandankumar has joined #openstack-infra | 04:34 | |
*** emagana has quit IRC | 04:34 | |
*** emagana_ has joined #openstack-infra | 04:34 | |
*** pcrews has joined #openstack-infra | 04:36 | |
*** garyk has quit IRC | 04:38 | |
*** emagana_ has quit IRC | 04:39 | |
*** YorikSar has quit IRC | 04:39 | |
*** YorikSar has joined #openstack-infra | 04:41 | |
*** chandankumar has quit IRC | 04:44 | |
*** pcrews has quit IRC | 04:46 | |
*** cody-somerville has quit IRC | 04:47 | |
*** bdpayne has joined #openstack-infra | 04:52 | |
*** dims_ has joined #openstack-infra | 04:53 | |
*** mrmartin has joined #openstack-infra | 04:58 | |
*** dims_ has quit IRC | 05:02 | |
*** Daisy has joined #openstack-infra | 05:05 | |
*** mrmartin has quit IRC | 05:05 | |
*** bdpayne has quit IRC | 05:06 | |
*** cody-somerville has joined #openstack-infra | 05:07 | |
*** pballand has quit IRC | 05:07 | |
*** tsg has joined #openstack-infra | 05:08 | |
openstackgerrit | A change was merged to openstack-infra/git-review: Build universal wheels https://review.openstack.org/104667 | 05:17 |
*** cristov_macbook has joined #openstack-infra | 05:17 | |
*** msabramo has joined #openstack-infra | 05:18 | |
*** bdpayne has joined #openstack-infra | 05:19 | |
tsg | clarkb: after pyeclib 0.9.4 synced to pypi mirror, all looks good .. thanks again | 05:24 |
clarkb | oh good bandersnatch woke up | 05:24 |
*** chandankumar has joined #openstack-infra | 05:24 | |
tsg | clarkb: assume that's the hostname for the mirror? | 05:25 |
clarkb | no bandersnatch is the pypi mirror tool | 05:25 |
clarkb | I had to kick it earlier and it didn't do what I expected but eventually it did | 05:25 |
clarkb | so thats good | 05:25 |
tsg | ah gotcha | 05:26 |
mikal | Remind me of where our elastic search is? | 05:29 |
clarkb | mikal: http://logstash.openstack.org for the kibana web ui | 05:31 |
mikal | Thanks | 05:31 |
clarkb | mikal: http://logstash.openstack.org/elasticsearch for the raw elasticsearch REST api | 05:31 |
*** dstanek_zzz is now known as dstanek | 05:31 | |
*** garyk has joined #openstack-infra | 05:32 | |
*** jpeeler has quit IRC | 05:33 | |
*** sballe has joined #openstack-infra | 05:33 | |
mikal | clarkb: do you have the energy for a conversation about gate failures? Or is it too late in your day? | 05:33 |
clarkb | mikal: and its all cuaght up right now... hopefully we are getting close to a longer term solution for that | 05:34 |
clarkb | mikal: its late but really hot so no sleep anytime soon. whats up | 05:34 |
* jhesketh grabs popcorn | 05:34 | |
mikal | So, I have this guy named gus... | 05:34 |
mikal | He's been tricked into looking into mysql locking problems in neutron tempest runs | 05:34 |
mikal | We think its super common | 05:34 |
mikal | Basically eventlet and mysqldb interact poorly | 05:35 |
*** k4n0 has joined #openstack-infra | 05:35 | |
mikal | If we wanted to change the connection string used for mysql in tempest runs for neutron to see how many failures we removed, that's going to be hard right? | 05:35 |
*** emagana has joined #openstack-infra | 05:35 | |
openstackgerrit | jizhilong proposed a change to openstack-dev/hacking: Add check: unnecessary list comprehension in set() https://review.openstack.org/105942 | 05:35 |
clarkb | mikal: you want to change it for some subset of tempest jenkins runs or some subset of the individual tempest tests? | 05:36 |
*** praneshp has joined #openstack-infra | 05:36 | |
mikal | gus: explain things here please | 05:36 |
gus | how much background do we want? | 05:36 |
mikal | clarkb: I think we probably want to change it for everything eventually, but it would be wise to prove this improves things first | 05:36 |
gus | basically there's a deadlock that happens with eventlet and mysqldb | 05:37 |
clarkb | gus: gotcha | 05:37 |
clarkb | and I assume you want to change the connection string to use a different driver? | 05:37 |
gus | .. if the transaction switches to another eventlet, that then reenters mysqldb and then blocks on the same transaction, then we're screwed. | 05:37 |
mikal | clarkb: to my (possibly incorrect) understanding, this is a searh for failures caused by this problem -- http://logstash.openstack.org/#eyJzZWFyY2giOiJcIkxvY2sgd2FpdCB0aW1lb3V0IGV4Y2VlZGVkOyB0cnkgcmVzdGFydGluZyB0cmFuc2FjdGlvblwiIiwiZmllbGRzIjpbXSwib2Zmc2V0IjowLCJ0aW1lZnJhbWUiOiI2MDQ4MDAiLCJncmFwaG1vZGUiOiJjb3VudCIsInRpbWUiOnsidXNlcl9pbnRlcnZhbCI6MH0sInN0YW1wIjoxNDA0OTcwMzgwMjc0fQ== | 05:37 |
clarkb | because python-mysql or whatever the driver is is blocking and bad | 05:37 |
gus | I want to change the connection string to mysql+mysqlconnecter, yep. | 05:37 |
gus | I have a few small changes outstanding to oslo.db to allow their unittests to be able to be run against non-default mysql drivers. | 05:38 |
gus | but I don't think there's anything blocking switching tempest at this point. | 05:39 |
clarkb | I don't think changing the string will be hard. The tricky bit is going to be getting that python driver on the slaves as it doesn't look like it is on pypi | 05:39 |
gus | it's external ... | 05:39 |
mikal | clarkb: what is involved in getting somehting onto pypi? | 05:39 |
clarkb | mikal: usually we try to get the package owners to push there | 05:40 |
clarkb | mikal: and often it works. libvirt for example | 05:40 |
mikal | clarkb: I could deploy The Richard if that would help | 05:40 |
mikal | clarkb: but I'm not clear on if that would actually help | 05:40 |
*** emagana has quit IRC | 05:40 | |
clarkb | mikal: no I think pypi upstream doesn't want to slurp stuff up for people | 05:41 |
clarkb | mikal: for legal raisins or some such | 05:41 |
clarkb | mordred might know who to yell at in mysql land to publish on pypi | 05:41 |
*** trinaths has joined #openstack-infra | 05:41 | |
mikal | So yeah | 05:42 |
gus | so we need it on the real pypi (not --allow-external)? hrm. | 05:42 |
mikal | I wonder what's the best way to communicate enough background to people to get everyone pulling in the same direction? | 05:42 |
clarkb | gus: yes, we managed to finally avoid all external pypi links finally | 05:42 |
clarkb | gus: and we don't want to regress on that (it took a long time) | 05:42 |
mikal | clarkb: I assume because external is less reliable? | 05:42 |
clarkb | mikal: exactly | 05:42 |
clarkb | mikal: it also breaks mirroring | 05:42 |
mikal | gus: should you write up the problem and the proposed fix in an email to openstack-dev or something? | 05:43 |
gus | mikal: the pypi people seem to hate it because of security mumble mumble. | 05:43 |
mikal | clarkb: would that help get people pulling in the right direction you think? | 05:43 |
gus | mikal: there's already an os-dev thread, and a blueprint. | 05:43 |
clarkb | mikal: so prior to the very recent switch to banderstanthc we had the most hacking pypi-mirror tool that would find externally hosted stuff and host it on the mirror anyways. We now use bandersnatch beacuse no externally hosted packages | 05:43 |
gus | as you said, I think at this point we need a sufficient cabal of people pulling in the same direction. | 05:43 |
mikal | gus: there's the thread from the mirantis guy | 05:44 |
mikal | gus: does that explain the underlying problem well enough? | 05:44 |
mikal | Ahhh, he does provide an intro now that I re-read it | 05:45 |
*** emagana has joined #openstack-infra | 05:45 | |
mikal | And by mirantis I mean red hat | 05:46 |
gus | subject: [openstack-dev] [neutron][all] switch from mysqldb to another eventlet aware mysql client | 05:46 |
gus | for those playing along at home | 05:46 |
*** emagana_ has joined #openstack-infra | 05:47 | |
*** emagana has quit IRC | 05:47 | |
clarkb | ya so first step I think is get https://pypi.python.org/pypi/mysql-connector-python/1.2.2 to host their package | 05:47 |
*** shashankhegde has joined #openstack-infra | 05:47 | |
clarkb | second step is adding that to global-requirements | 05:47 |
clarkb | then we can hit the jobs with hammers | 05:49 |
clarkb | someone should just make libdrizzle work alrady | 05:49 |
clarkb | where is LinuxJedi | 05:49 |
gus | ... so before we can fix this, we need to convince oracle to ship their software via a different repository? | 05:50 |
mikal | clarkb: so, do we really think we can get Oracle to change their packaging? | 05:50 |
gus | snap! | 05:50 |
mikal | LOL | 05:50 |
mikal | mordred: FIX THIS THING! | 05:50 |
clarkb | mikal: I honestly don't know. Other projects have done it | 05:50 |
clarkb | but they weren't oracle | 05:50 |
gus | sigh. | 05:50 |
mikal | Yeah, Oracle | 05:50 |
mikal | I am sure their legal department has thoughts about this | 05:50 |
clarkb | probably all wrong | 05:51 |
mikal | LOL | 05:51 |
* gus just wants to add 15 characters to fix the gate :( | 05:51 | |
mikal | 15 characters? That's 15 weeks work! | 05:51 |
mordred | mikal: ++ | 05:51 |
*** emagana_ has quit IRC | 05:51 | |
clarkb | to attack from a different angle, can we not make mysql-python better? | 05:51 |
clarkb | I think mordred has experience with this too | 05:52 |
*** marcoemorais has joined #openstack-infra | 05:52 | |
*** marcoemorais1 has joined #openstack-infra | 05:53 | |
*** andreykurilin_ has joined #openstack-infra | 05:54 | |
*** cristov_macbook has quit IRC | 05:54 | |
*** bdpayne has quit IRC | 05:55 | |
*** marcoemorais has quit IRC | 05:56 | |
*** marcoemorais1 has quit IRC | 05:57 | |
clarkb | mikal: gus looking at devstack https://git.openstack.org/cgit/openstack-dev/devstack/tree/lib/databases/mysql#n159 the way its currently implemented it is all or nothing | 05:58 |
clarkb | mikal: gus so all projects would have to use the same mysql driver or devstack would need new smarts | 05:59 |
gus | clarkb: that's probably the end result we want, but I guess it means having to convince more people before we can start. | 06:00 |
gus | (that's almost certainly the end result we want) | 06:00 |
clarkb | gus: maybe? you cna probably also just add a second mysql type in devstack and at least keep the old one working | 06:00 |
*** Azher__ has joined #openstack-infra | 06:01 | |
gus | clarkb: thanks for the assistance. | 06:01 |
gus | I'll start some email threads and we can pick it up again there. | 06:01 |
clarkb | mikal: actually isn't oracle participating upstream with openstack now? | 06:02 |
clarkb | mikal: maybe we can get some of those folks to talk to the mysql people | 06:02 |
*** Azher__ has quit IRC | 06:02 | |
clarkb | and maybe buy them beers? | 06:02 |
*** Azher__ has joined #openstack-infra | 06:02 | |
mikal | clarkb: they intend to, it hasn't really meshed yet | 06:03 |
mikal | clarkb: but we coudl ask our solaris contacts for help | 06:03 |
mikal | clarkb: different teams etc etc though | 06:03 |
mikal | clarkb: I told gus to email openstack-infra to talk about this, is that the right place? | 06:03 |
*** doude has joined #openstack-infra | 06:04 | |
clarkb | probably -dev | 06:04 |
clarkb | this is less about infra and more about this is how you play nice with python and so forth | 06:04 |
mikal | So, there's already a thread on -dev | 06:05 |
mikal | It didn't get a lot of love | 06:05 |
clarkb | out of curiousity, do we know why nova and cinder and glance et al apparenetly are not affected? | 06:05 |
clarkb | or are they and its just bad everywhere? | 06:05 |
*** Alexei_987 has quit IRC | 06:06 | |
*** nosnos has quit IRC | 06:08 | |
*** YorikSar has quit IRC | 06:08 | |
clarkb | mikal: gus: I will also be at the ironic/nova meetup so can sit in person too if people will be around | 06:08 |
clarkb | granted this is neutron but whatever | 06:09 |
*** r1chardj0n3s has joined #openstack-infra | 06:09 | |
*** r1chardj0n3s has left #openstack-infra | 06:10 | |
mikal | clarkb: gus isn't going to that unfortunately | 06:10 |
mikal | clarkb: but I am sure we can get him on the phone or something if we need to | 06:10 |
gus | yep, happy to explain what I know to anyone who asks. | 06:10 |
gus | clarkb: we think neutron code structure is more likely to hit this. | 06:11 |
gus | in particular, neutron opens lots of transactions and then does stuff within that transaction that might yield. | 06:11 |
gus | (sending notifications in particular) | 06:11 |
gus | I'm mostly repeating what others have said here, since I haven't gone and looked at coding patterns elsewhere. | 06:12 |
*** jpeeler has joined #openstack-infra | 06:13 | |
clarkb | (I have no idea what I am talking about) PyMysql was brought up in the past but ruled as too slow. What about CyMysql? | 06:13 |
gus | yeah I haven't looked exhaustively at alternatives either. | 06:14 |
gus | we need something that is pure python (and can be monkeypatched), or has some sort of explicit support for eventlet. | 06:14 |
gus | there are several python libraries, I just went straight to mysqlconnector since it's the "official" mysql client. | 06:14 |
StevenK | And then got Oracled | 06:15 |
clarkb | pymsql is pure python, cymsql is a fork that adds cython support | 06:15 |
clarkb | not sure how cython and eventlet monkeypatching interact | 06:15 |
gus | I look forward to seeing zuul tests for all of them. | 06:15 |
gus | if only we had a unittest that exercised this eventlet and sqlalchemy issue. Oh wait, I have one of those! | 06:16 |
*** msabramo has quit IRC | 06:17 | |
*** sballe has quit IRC | 06:17 | |
*** tsg has quit IRC | 06:18 | |
*** msabramo has joined #openstack-infra | 06:18 | |
clarkb | what terms are mysql-connector distributed under? GPL? | 06:20 |
clarkb | I suppose if we make the source available somewhere we can shove it on pypi ourselves (terrible idea but hey) | 06:20 |
gus | gpl | 06:20 |
gus | according to the sidebar on http://dev.mysql.com/downloads/connector/python/ | 06:20 |
*** sweston_irccloud is now known as sweston | 06:21 | |
clarkb | so in theory that is doable | 06:21 |
*** sweston has quit IRC | 06:21 | |
StevenK | That platform selector dropdown makes me go WAT | 06:21 |
*** sweston has joined #openstack-infra | 06:22 | |
StevenK | There's no real 'give me the source, damn it' button | 06:22 |
gus | oh it took me quite a while to actually find the link to the source. | 06:22 |
clarkb | login now or sign up wtf | 06:22 |
* clarkb sees if pypi has a backdoor | 06:22 | |
gus | and then I tried to find pre-oracle versions and couldn't without a google search. | 06:22 |
clarkb | http://cdn.mysql.com/Downloads/Connector-Python/mysql-connector-python-1.2.2.zip#md5=1459adcda19858629585d356ef481180 | 06:23 |
StevenK | I wonder if they could make the "No thanks, just start my download" link any smaller | 06:23 |
clarkb | yup GPLv2 | 06:23 |
StevenK | http://dev.mysql.com/get/Downloads/Connector-Python/mysql-connector-python-1.2.2.tar.gz seems to work | 06:24 |
clarkb | is this pure python too? | 06:24 |
clarkb | will it suffer the same issues as PyMysql? | 06:24 |
gus | suffer? | 06:25 |
gus | mysql connector does _not_ have the same deadlocks as mysqldb. | 06:25 |
gus | I'm guessing pymysql does _not_ either, but I haven't tested it. | 06:25 |
clarkb | gus: right but PyMysql which is also pure python is has been ruled too slow | 06:25 |
gus | aha that problem. | 06:26 |
gus | Someone had a benchmarks page somewhere ... | 06:26 |
*** mkoderer has joined #openstack-infra | 06:26 | |
gus | I can't find the page I was reading earlier today :( | 06:31 |
gus | http://blog.fizyk.net.pl/blog/sqlalchemy-speed-tests-on-mysql-connector-python-mysqldb-and-oursql-drivers.html | 06:31 |
*** jcoufal has joined #openstack-infra | 06:32 | |
*** msabramo has quit IRC | 06:32 | |
gus | ^^ this one has some frankly rather terrible benchmarks (in quality of testing, not in results for mysqlconnector). | 06:32 |
*** liam_ has joined #openstack-infra | 06:32 | |
*** liam_ is now known as Guest5405 | 06:33 | |
gus | https://github.com/Tin/sqlalchemy-gevent-mysql-drivers-comparison/blob/master/README.md | 06:33 |
gus | ^^ aha, that's what I was reading earlier today. | 06:34 |
*** andreykurilin_ has quit IRC | 06:34 | |
gus | so mysqlconnector was substantially faster on one test that benefited from actually supporting python threading (or similar) | 06:34 |
gus | .. and about 2x slower than mysqldb on a general thrash-as-fast-as-you-can test. | 06:35 |
clarkb | and pymsql is slightly worse than mysql-connector | 06:36 |
gus | I gather mysqlconnector is very new code (only a few years old as a project). So that's a concern too. | 06:36 |
clarkb | it might be worth taking a stab at pymysql again | 06:36 |
gus | yep. that implies we're looking at 2-2.5 times slower than mysqldb for things that are DB-bound. | 06:37 |
gus | just to put an order-of-magnitude on C vs python client. | 06:38 |
*** sweston_ has joined #openstack-infra | 06:43 | |
*** harlowja is now known as harlowja_away | 06:47 | |
*** jlibosva has joined #openstack-infra | 06:48 | |
*** shashankhegde has quit IRC | 06:48 | |
*** Evgeny has quit IRC | 06:51 | |
*** msabramo has joined #openstack-infra | 06:52 | |
*** nati_ueno has quit IRC | 06:53 | |
*** mpavone has joined #openstack-infra | 07:01 | |
*** dstanek is now known as dstanek_zzz | 07:02 | |
*** camunoz has quit IRC | 07:03 | |
*** luqas has joined #openstack-infra | 07:04 | |
*** emagana has joined #openstack-infra | 07:12 | |
*** emagana has quit IRC | 07:16 | |
*** amalagon has quit IRC | 07:18 | |
*** mpavone has quit IRC | 07:18 | |
*** Longgeek has joined #openstack-infra | 07:22 | |
*** mrmartin has joined #openstack-infra | 07:22 | |
*** msabramo has quit IRC | 07:23 | |
*** Longgeek has quit IRC | 07:23 | |
*** Longgeek has joined #openstack-infra | 07:25 | |
*** jgallard has joined #openstack-infra | 07:29 | |
*** praneshp_ has joined #openstack-infra | 07:31 | |
*** tkelsey has joined #openstack-infra | 07:32 | |
*** yfried__ has quit IRC | 07:33 | |
*** praneshp has quit IRC | 07:34 | |
*** praneshp_ is now known as praneshp | 07:34 | |
*** luqas has quit IRC | 07:34 | |
*** jp_at_hp has joined #openstack-infra | 07:35 | |
*** luqas has joined #openstack-infra | 07:36 | |
*** Daisy has quit IRC | 07:36 | |
*** luqas has quit IRC | 07:37 | |
*** Daisy has joined #openstack-infra | 07:39 | |
*** sweston_ has quit IRC | 07:43 | |
*** xianghui has joined #openstack-infra | 07:45 | |
*** praneshp has quit IRC | 07:47 | |
*** dstufft|laptop has quit IRC | 07:48 | |
*** zehicle has joined #openstack-infra | 07:49 | |
*** zehicle_at_dell has quit IRC | 07:50 | |
*** mkerrin has quit IRC | 07:51 | |
*** jpich has joined #openstack-infra | 07:52 | |
*** dstanek_zzz is now known as dstanek | 07:53 | |
*** Mithrandir has quit IRC | 07:55 | |
mkoderer | jhesketh: mattoliverau: gents, could you add the email address of Dimitry in https://wiki.openstack.org/wiki/Qa_Infra_Meetup_2014 | 07:56 |
mkoderer | davidlenwell: could you add your address as well into the wiki? | 07:57 |
*** dizquierdo has joined #openstack-infra | 07:57 | |
*** mkerrin has joined #openstack-infra | 07:58 | |
*** Evgeny has joined #openstack-infra | 07:59 | |
jhesketh | mkoderer: can do :-) | 08:00 |
mkoderer | jhesketh: thx :) | 08:00 |
*** Mithrandir has joined #openstack-infra | 08:01 | |
jhesketh | mkoderer: done | 08:01 |
*** dstanek is now known as dstanek_zzz | 08:03 | |
*** nati_ueno has joined #openstack-infra | 08:04 | |
*** viktors has joined #openstack-infra | 08:05 | |
*** YorikSar has joined #openstack-infra | 08:08 | |
*** nati_ueno has quit IRC | 08:09 | |
*** Guest58876 has joined #openstack-infra | 08:12 | |
*** emagana has joined #openstack-infra | 08:13 | |
openstackgerrit | A change was merged to openstack-infra/storyboard: Update the global require https://review.openstack.org/103391 | 08:15 |
*** derekh_ has joined #openstack-infra | 08:15 | |
*** ihrachyshka has joined #openstack-infra | 08:17 | |
*** emagana has quit IRC | 08:18 | |
*** jistr has joined #openstack-infra | 08:18 | |
viktors | hello. Can I ask a question about pypi.openstack.org in this chat? ) | 08:22 |
*** luqas has joined #openstack-infra | 08:23 | |
*** maxbit has joined #openstack-infra | 08:23 | |
*** sweston_ has joined #openstack-infra | 08:24 | |
*** ihrachyshka has quit IRC | 08:24 | |
*** ihrachyshka has joined #openstack-infra | 08:25 | |
*** hashar has joined #openstack-infra | 08:32 | |
*** e0ne has joined #openstack-infra | 08:38 | |
*** IvanBerezovskiy has joined #openstack-infra | 08:45 | |
*** _nadya_ has joined #openstack-infra | 08:51 | |
*** _nadya_ has quit IRC | 08:58 | |
*** luqas has quit IRC | 08:59 | |
*** flaviof_zzz has quit IRC | 09:03 | |
*** ildikov has joined #openstack-infra | 09:04 | |
*** zhiyan is now known as zhiyan_ | 09:04 | |
*** ociuhandu has joined #openstack-infra | 09:04 | |
*** zigo has quit IRC | 09:05 | |
*** nati_ueno has joined #openstack-infra | 09:05 | |
*** Guest58876 has quit IRC | 09:05 | |
*** Guest58876 has joined #openstack-infra | 09:06 | |
*** yaguang has joined #openstack-infra | 09:06 | |
*** zigo has joined #openstack-infra | 09:07 | |
*** cyeoh has quit IRC | 09:08 | |
*** nati_ueno has quit IRC | 09:09 | |
*** nibalizer has quit IRC | 09:10 | |
*** nibalizer has joined #openstack-infra | 09:10 | |
*** emagana has joined #openstack-infra | 09:13 | |
*** cyeoh has joined #openstack-infra | 09:14 | |
*** baohua has quit IRC | 09:16 | |
*** emagana has quit IRC | 09:18 | |
*** Daisy has quit IRC | 09:19 | |
*** johnthetubaguy is now known as zz_johnthetubagu | 09:19 | |
*** zz_johnthetubagu is now known as johnthetubaguy | 09:19 | |
*** e0ne has quit IRC | 09:22 | |
*** e0ne has joined #openstack-infra | 09:25 | |
*** zhiyan_ is now known as zhiyan | 09:27 | |
*** rlandy has joined #openstack-infra | 09:28 | |
*** Evgeny has quit IRC | 09:29 | |
*** pelix has joined #openstack-infra | 09:33 | |
*** luqas has joined #openstack-infra | 09:41 | |
*** dmakogon_ is now known as denis_makogon | 09:43 | |
joa | Hello o/ | 09:44 |
joa | Small question about zuul: There are two services: "zuul" and "zuul-merger"; but zuul cannot be stopped, as it says it cannot find any pid file. Is it something inconsistent within zuul itself or do I have an issue somewhere ? | 09:44 |
*** matrohon has joined #openstack-infra | 09:45 | |
*** saper_ is now known as saper | 09:50 | |
*** afazekas has joined #openstack-infra | 09:51 | |
*** dstanek_zzz is now known as dstanek | 09:52 | |
*** ominakov has joined #openstack-infra | 09:55 | |
rcarrillocruz | joa: have you checked that zuul is really running at all? | 09:57 |
rcarrillocruz | the fact that there's no pid, it may mean it's just not running, thus no need to stop it | 09:57 |
*** alexpilotti has joined #openstack-infra | 10:00 | |
*** jedimike has joined #openstack-infra | 10:02 | |
*** dstanek is now known as dstanek_zzz | 10:02 | |
joa | rcarrillocruz: Well, if by zuul you mean the zuul-server process, yeah it's running | 10:02 |
openstackgerrit | Antoine Musso proposed a change to openstack-infra/nodepool: Drop voluptuous from requirements https://review.openstack.org/106003 | 10:02 |
joa | I have to kill it manually currently, which is kind of strange | 10:03 |
joa | zuul merger can be started/stopped fine | 10:03 |
joa | but zuul itself says nothing when starting and doesnt want to be stopped | 10:03 |
*** Guest58876 has quit IRC | 10:05 | |
*** alexpilotti has quit IRC | 10:06 | |
*** nati_ueno has joined #openstack-infra | 10:06 | |
*** pblaho has joined #openstack-infra | 10:07 | |
*** xianghui has quit IRC | 10:07 | |
*** flaviof_zzz has joined #openstack-infra | 10:08 | |
hashar | joa: zuul and zuul-merger should be two different init script with two different pid files | 10:08 |
*** jd__ has quit IRC | 10:09 | |
joa | hashar: yeah I know | 10:09 |
joa | but one "works" properly | 10:09 |
joa | while the other not :D | 10:09 |
hashar | maybe your defaults are wrong? | 10:09 |
*** gaelL has quit IRC | 10:10 | |
*** saper has quit IRC | 10:10 | |
openstackgerrit | João Cravo proposed a change to openstack-infra/jenkins-job-builder: Add support for reverse build trigger https://review.openstack.org/95734 | 10:11 |
*** nati_ueno has quit IRC | 10:11 | |
*** e0ne has quit IRC | 10:13 | |
*** jd__ has joined #openstack-infra | 10:13 | |
joa | hashar: maybe, but since I'm kind of starting with it, now idea what could be wrong. The zuul.log file contains some logs, nothing talking about exception or crash | 10:13 |
*** Longgeek has quit IRC | 10:13 | |
*** gaelL has joined #openstack-infra | 10:13 | |
*** emagana has joined #openstack-infra | 10:14 | |
joa | Also, I have the two processes properly running: zuul-server and zuul-merger | 10:15 |
joa | so.. it's not like it didn't start or crashed before creating the pid file. | 10:16 |
jgallard | salut mat ! | 10:16 |
*** saper has joined #openstack-infra | 10:17 | |
jgallard | oups sorry... :) | 10:17 |
*** emagana has quit IRC | 10:18 | |
*** Guest58876 has joined #openstack-infra | 10:20 | |
hashar | bonjour jgallard :D | 10:21 |
*** Longgeek has joined #openstack-infra | 10:24 | |
*** Evgeny has joined #openstack-infra | 10:25 | |
*** asselin has quit IRC | 10:25 | |
*** skolekonov has quit IRC | 10:27 | |
*** chuckC has joined #openstack-infra | 10:27 | |
*** jgallard has quit IRC | 10:28 | |
*** kmartin has quit IRC | 10:28 | |
*** Guest58876 has quit IRC | 10:29 | |
dmitryme | Hey people, I am playing with the http://logstash.openstack.org/. I am running the following query as a test | 10:31 |
dmitryme | message:"EC2VolumesTest-1485461725" AND filename:"logs/screen-n-api.txt" | 10:31 |
*** chuckC has quit IRC | 10:31 | |
*** chuckC has joined #openstack-infra | 10:31 | |
dmitryme | the problem is logstash inconsistently reports build_status for entries found | 10:31 |
dmitryme | when I click on ‘build_status’ link, it reports that 7% of found entries failed | 10:31 |
sdague | dmitryme: build_status on the front page is wrong in percentages | 10:32 |
sdague | it's a known bug | 10:32 |
dmitryme | sdague: any known workaround for that? | 10:33 |
sdague | not really, but is it important? | 10:33 |
sdague | build_status is a facet of the hits you've found | 10:35 |
sdague | there is only 1 build_status | 10:35 |
sdague | so it's 100% of your hits | 10:35 |
dmitryme | sdague: I am trying to find a signature for bug I’ve experienced in check job. I’d like to be sure that that the query I’ve made finds failed builds only | 10:35 |
dmitryme | that is outlined in https://wiki.openstack.org/wiki/ElasticRecheck | 10:35 |
sdague | sure | 10:36 |
dmitryme | You need a 100% failure rate for a good e-r query | 10:36 |
sdague | right | 10:36 |
sdague | but you have 100% | 10:36 |
sdague | the facets will show the top 5 facets | 10:36 |
sdague | so if there is < 5 listed | 10:36 |
sdague | then just do the quick math in your head between them | 10:36 |
sdague | however, that's not a good signature | 10:36 |
dmitryme | sgadue: sure, that was just a test query to check my suspition that it incorrectly shows failure rate | 10:37 |
sdague | dmitryme: sure | 10:40 |
sdague | so basically ignore the % absolute numbers | 10:40 |
sdague | and just do the quick math in your head between the facets shown | 10:40 |
dmitryme | sdague: could you please clarify, what fo you mean by “facets”? | 10:41 |
dmitryme | and what is “top 5 facets”? | 10:41 |
dmitryme | I mean, in my perspective logstash just shows log entries corresponding to the query | 10:42 |
*** andreaf has joined #openstack-infra | 10:42 | |
sdague | everything down the left side | 10:43 |
sdague | those are facets | 10:43 |
sdague | pieces of metadata that we store on every result | 10:43 |
openstackgerrit | Sergey Reshetnyak proposed a change to openstack/requirements: Add cm_api to global requirements https://review.openstack.org/106011 | 10:43 |
*** yfried__ has joined #openstack-infra | 10:45 | |
openstackgerrit | Nikita Konovalov proposed a change to openstack-infra/storyboard: Update _route method usage https://review.openstack.org/105766 | 10:51 |
dmitryme | sdague: I think I understood what you mean. So basically for build_status column there could be only 2 facets: “success” and “failure”. Am I right? | 10:52 |
openstackgerrit | Radomir Dopieralski proposed a change to openstack/requirements: Add xstatic-packaged JavaScript libraries for Horizon https://review.openstack.org/97793 | 10:52 |
*** x1b2j has joined #openstack-infra | 10:53 | |
sdague | dmitryme: yep | 10:53 |
*** mrmartin has quit IRC | 10:57 | |
*** Azher__ has quit IRC | 10:58 | |
dmitryme | sdague: thank you for clarification. The problem with the facets is that they are displayed for the current page only (500 entries maximum). So if query returns large number of entries, facets are not really helpful. But seems like I’ve found a way to search for false positives - I am adding ‘AND build_status:”SUCCESS”’ and the query should return 0 entries. Again, thank you for your help. | 10:59 |
*** ZZelle_ has quit IRC | 11:00 | |
*** ZZelle_ has joined #openstack-infra | 11:00 | |
*** dstanek_zzz is now known as dstanek | 11:00 | |
*** ihrachyshka has quit IRC | 11:01 | |
*** hashar has quit IRC | 11:01 | |
*** nati_ueno has joined #openstack-infra | 11:07 | |
*** _nadya_ has joined #openstack-infra | 11:10 | |
*** nati_ueno has quit IRC | 11:11 | |
*** obondarev has joined #openstack-infra | 11:11 | |
*** pcm_ has joined #openstack-infra | 11:12 | |
*** juzuluag has joined #openstack-infra | 11:12 | |
*** emagana has joined #openstack-infra | 11:15 | |
*** ihrachyshka has joined #openstack-infra | 11:15 | |
*** gangil has quit IRC | 11:17 | |
*** Evgeny_ has joined #openstack-infra | 11:18 | |
*** Evgeny has quit IRC | 11:18 | |
*** emagana has quit IRC | 11:19 | |
*** e0ne has joined #openstack-infra | 11:20 | |
*** _nadya_ has quit IRC | 11:20 | |
viktors | hi! i have an issue with pypi.openstack.org mirror. Can someone help me? | 11:22 |
sdague | jhesketh is you are still up - https://review.openstack.org/#/c/102941 and the series after that | 11:25 |
sdague | a bunch of os-loganalyze refactoring and a few new features | 11:25 |
jhesketh | sdague: cool :-) | 11:25 |
sdague | clarkb +2ed the stack, I figure you are the most familiar other infra core on it | 11:26 |
*** k4n0 has quit IRC | 11:26 | |
jhesketh | I just realised my failed the tests, so I'll chuck it behind your stack | 11:26 |
jhesketh | unless you have any objections | 11:26 |
sdague | jhesketh: none at all | 11:26 |
sdague | you might want to check out the stack first, because the refactor is extensive enough that you probably have to tweak a bit where things are | 11:26 |
jhesketh | sure, I'll review first anyway | 11:27 |
viktors | sdague: Hi! Please tell me to what person I should address question about pypi mirror? | 11:28 |
*** jyuso has quit IRC | 11:28 | |
jamielennox | can someone point me at the graphs for the gate's success rate? i want to figure out if there are a lot of issues at the moment or zuul just hates me | 11:36 |
sdague | jamielennox: zuul never just hates anyone | 11:37 |
sdague | http://jogo.github.io/gate/ | 11:37 |
jamielennox | sdague: i have 4 reviews that have failed gate for unrelated issues 3 times each - i feel like it's me | 11:38 |
*** yamahata has quit IRC | 11:38 | |
sdague | jamielennox: yeh, I think this has to land - https://review.openstack.org/#/c/105854/ | 11:39 |
sdague | it bounced of something else failing | 11:39 |
*** amitpp has quit IRC | 11:40 | |
jamielennox | alright - i'll just leave them and try again tomorrow | 11:41 |
*** yamahata has joined #openstack-infra | 11:41 | |
sdague | turns out we run so many daemons in a single node setup, 100 db connections is not enough :) | 11:43 |
*** pblaho has quit IRC | 11:43 | |
*** baohua has joined #openstack-infra | 11:47 | |
*** openstackgerrit has quit IRC | 11:47 | |
*** adalbas has joined #openstack-infra | 11:48 | |
jamielennox | lol, wow that's either impressive or a tad scary | 11:48 |
*** mrda is now known as mrda-away | 11:50 | |
*** mriedem has joined #openstack-infra | 11:50 | |
*** jamielennox is now known as jamielennox|away | 11:50 | |
*** penguinRaider has quit IRC | 11:52 | |
vponomaryov | Who knows, how can be added/enabled triggering of requirements update for stackforge project, like this one: https://github.com/openstack/cinder/commit/c72e8670dd0d49da1787c66e835bbe5a7aee9f79 ? | 11:52 |
*** jgallard has joined #openstack-infra | 11:56 | |
*** dkranz has joined #openstack-infra | 11:56 | |
*** pcm_ has quit IRC | 11:56 | |
*** dkranz has quit IRC | 11:57 | |
*** dkranz has joined #openstack-infra | 11:57 | |
*** ArxCruz has joined #openstack-infra | 11:58 | |
*** trinaths has quit IRC | 11:58 | |
jhesketh | sdague: all looks pretty good to me! :-) | 11:58 |
jhesketh | I was mislead to where it was leading though, so disregard my earlier comments | 11:58 |
jhesketh | I've left it for you to review + babysit | 11:59 |
sdague | jhesketh: if you want to +A, I'll watch, and hot fix anything | 11:59 |
sdague | jhesketh: yeh, the patch order... was a little discombobulated | 12:00 |
jhesketh | sdague: I don't have root access so I'd prefer to make sure somebody else is here too | 12:00 |
jhesketh | eg clarkb ^ | 12:00 |
sdague | because 1, 2 & 5 really were a thing, and 3 & 4 are related | 12:00 |
sdague | jhesketh: ah, well it's CDed, so it's easy to hot fix | 12:00 |
sdague | but that's fine | 12:00 |
jhesketh | heh, it's been a while since I've heard somebody use discombobulated ! | 12:00 |
fungi | viktors: i'm only around for a moment (need to dash off to breakfast shortly) but i might be able to answer your pypi mirror question if you will just ask it | 12:01 |
*** _nadya_ has joined #openstack-infra | 12:01 | |
*** e0ne has quit IRC | 12:02 | |
fungi | vponomaryov: right now adding that will also require you to only use dependencies of openstack (we won't add new dependencies to the openstack/requirements project's global-requirements.txt file at the request of a stackforge project). if that's okay, then add your project in the projects.txt file in the openstack/requirements project | 12:02 |
viktors | fungi: my issue is - I've released oslo.db 0.3.0 yesterday, but I still see old 0.2.0 version on http://pypi.openstack.org/openstack/oslo.db/ What I'm doing wrong? Thanks! | 12:03 |
jhesketh | sdague: https://review.openstack.org/#/c/104719/ a little extra debugging to help us with swift stuff | 12:03 |
fungi | viktors: i'll look, but i believe clarkb found last night that the mirror update process was stuck. he un-stuck it according to the channel scrollback, but i haven't had a chance to check back on its status yet | 12:03 |
viktors | fungi: ok, thank you | 12:04 |
*** afazekas has quit IRC | 12:04 | |
*** hashar has joined #openstack-infra | 12:05 | |
fungi | viktors: i see it on our mirror... http://pypi.openstack.org/simple/oslo.db/ | 12:05 |
fungi | viktors: maybe you need to refresh your browser? | 12:05 |
fungi | viktors: oh, you're looking at the old mirror | 12:05 |
fungi | that one's probably getting deleted soon | 12:06 |
viktors | fungi: so what url is correct? | 12:06 |
sdague | jeblair: lgtm | 12:06 |
fungi | viktors: the correct url is already in use for all our gate jobs | 12:06 |
sdague | jhesketh: lgtm | 12:06 |
fungi | viktors: but http://pypi.openstack.org/simple/oslo.db/ if you're double-checking it yourself | 12:07 |
vponomaryov | fungi: thanks, project already depends on only openstack requirements, it ok. | 12:07 |
*** doug-fish has joined #openstack-infra | 12:07 | |
sdague | jhesketh: though actually there is a wsgiref exception logger | 12:07 |
* fungi disappears to breakfast. back in an hour or so | 12:07 | |
sdague | maybe use that int he 2nd part | 12:07 |
viktors | fungi: ok, sorry for trouble you | 12:08 |
jhesketh | sdague: where now? | 12:09 |
*** dstanek is now known as dstanek_zzz | 12:10 | |
sdague | jhesketh: so https://docs.python.org/2/library/wsgiref.html seems to indicated that using 'warnings' is probably the proper way instead of writing out to sys.stderr directly | 12:11 |
*** mbacchi has joined #openstack-infra | 12:15 | |
*** rfolco has joined #openstack-infra | 12:15 | |
jhesketh | oh right | 12:15 |
jhesketh | sdague: this does get us a quick stacktrace though | 12:15 |
sdague | jhesketh: log_exception | 12:17 |
*** penguinRaider has joined #openstack-infra | 12:17 | |
sdague | that's in wsgiref.handlers | 12:17 |
jhesketh | hmm interesting | 12:18 |
sdague | so I think warnings for the 1 liners, and that might be the "proper" way to do it | 12:18 |
sdague | at least from reading the dosc | 12:19 |
sdague | docs | 12:19 |
*** afazekas has joined #openstack-infra | 12:19 | |
*** sweston__ has joined #openstack-infra | 12:23 | |
*** pcm_ has joined #openstack-infra | 12:23 | |
*** dprince has joined #openstack-infra | 12:23 | |
*** _nadya_ has quit IRC | 12:24 | |
dhellmann | mordred, clarkb : https://wiki.openstack.org/wiki/Oslo/CreatingANewLibrary#Choosing_a_Name | 12:25 |
*** dims has joined #openstack-infra | 12:25 | |
*** markmc has joined #openstack-infra | 12:26 | |
*** rcarrillocruz has quit IRC | 12:27 | |
*** pdmars has joined #openstack-infra | 12:28 | |
jhesketh | sdague: which warnings are you referring to sorry? | 12:28 |
dhellmann | mordred, clarkb: and I see dims found the ML history on that discussion, too | 12:30 |
*** tkelsey has quit IRC | 12:31 | |
*** xianghui has joined #openstack-infra | 12:32 | |
*** rcarrillocruz has joined #openstack-infra | 12:32 | |
sdague | jhesketh: commened :) | 12:36 |
dhellmann | mordred, clarkb, dims : IIRC, I made the final decision on IRC talking with sdague where we decided that the effort to rename the existing libraries wasn't worth it, and we had solved the technical issues that brought it up in the first place. So let's not stall forward motion on an old decision that isn't causing us any trouble, please? | 12:36 |
sdague | dhellmann: so I still don't feel like namespace packages are solved, they are worked around | 12:37 |
dhellmann | sdague: ok, worked around. I still consider this topic closed. | 12:38 |
* dhellmann has to start his commute | 12:38 | |
*** dhellmann is now known as dhellmann_ | 12:38 | |
sdague | and dstufft repeatedly said "namespace packages are a bad idea" :) | 12:38 |
Kiall | dhellmann / viktors - Q re oslo.db. We had an issue a few days ago with a fairly unusual Percona Cluster quirk, it's likely something that needs to be fixed in oslo.db - but I'm not sure what the best approach is. Have a minute and I'll explain? :) | 12:38 |
dhellmann_ | sdague: *after we had committed to that course with at least 2 libs* | 12:38 |
dhellmann_ | Kiall: I'm about to drop offline for about 90 minutes. viktors may be in #openstack-oslo, though | 12:39 |
sdague | dhellmann_: well, if we knew every issue before we hit it, we'd be kings | 12:39 |
Kiall | Sure - didn't know the channel existed :) Enjoy the commute (if that's possible!) | 12:39 |
viktors | Kiall: yes, #openstack-oslo will be the better place | 12:40 |
jhesketh | sdague: thanks.. my brain is clearly not parsing properly so I might return to it in the morning :-) | 12:40 |
*** dkliban_afk is now known as dkliban | 12:41 | |
*** afazekas has quit IRC | 12:44 | |
*** che-arne has joined #openstack-infra | 12:45 | |
joa | Does anyone know what's missing in my jenkins configuration, looking at the error message of the jenkins-jobs command ? : jenkins_jobs.errors.JenkinsJobsException: Failed to find suitable template named 'noop-check-communication' | 12:50 |
joa | (trying to setup basic 3rd-party CI) | 12:50 |
sdague | fungi / SergeyLukjanov: promoting 105854,3 would probably be in order | 12:50 |
sdague | we've got like a 50% fail rate on pg jobs, I think because we're running out of db connections | 12:50 |
*** Evgeny has joined #openstack-infra | 12:51 | |
*** Evgeny_ has quit IRC | 12:51 | |
*** mestery has joined #openstack-infra | 12:51 | |
*** miqui_ is now known as miqui | 12:56 | |
*** afazekas has joined #openstack-infra | 12:57 | |
*** baohua has quit IRC | 12:58 | |
*** HenryG has quit IRC | 13:01 | |
*** dstanek_zzz is now known as dstanek | 13:04 | |
*** rkukura has joined #openstack-infra | 13:05 | |
*** mwagner_lap has joined #openstack-infra | 13:05 | |
denis_makogon | hey, guys, could you please review/approve patch for Trove https://review.openstack.org/#/c/103172/ | 13:06 |
*** radez_g0n3 is now known as radez | 13:06 | |
*** afazekas has quit IRC | 13:08 | |
*** che-arne has quit IRC | 13:08 | |
*** julim has joined #openstack-infra | 13:11 | |
*** sweston__ has quit IRC | 13:12 | |
*** e0ne has joined #openstack-infra | 13:12 | |
*** julim has quit IRC | 13:12 | |
*** habib has joined #openstack-infra | 13:13 | |
*** emagana has joined #openstack-infra | 13:16 | |
*** tsg has joined #openstack-infra | 13:17 | |
*** HenryG has joined #openstack-infra | 13:19 | |
*** rkukura has quit IRC | 13:22 | |
*** ominakov has quit IRC | 13:22 | |
*** emagana has quit IRC | 13:22 | |
*** mfer has joined #openstack-infra | 13:22 | |
hashar | hi smart pythonist. Any clue why installing a pbr software (zuul in this case) yields: TypeError: dist must be a Distribution instance | 13:23 |
*** ominakov has joined #openstack-infra | 13:23 | |
hashar | seems that does not play well with pbr | 13:24 |
*** eharney has joined #openstack-infra | 13:25 | |
hashar | pip works :] | 13:26 |
*** __afazekas is now known as afazekas | 13:27 | |
*** ArxCruz has quit IRC | 13:27 | |
*** ArxCruz has joined #openstack-infra | 13:28 | |
*** julim has joined #openstack-infra | 13:28 | |
*** julim has quit IRC | 13:29 | |
*** julim has joined #openstack-infra | 13:30 | |
afazekas | clarkb: ping | 13:31 |
*** aysyd has joined #openstack-infra | 13:33 | |
*** dangers_away is now known as dangers | 13:33 | |
gilliard_ | I can't set bug 1276530 to "Won't fix" although that seems to be the result of disccusion in https://review.openstack.org/#/c/96757/ | 13:33 |
uvirtbot | Launchpad bug 1276530 in oslo "memorycache#get scans the whole cache for expired items on every fetch" [Low,Triaged] https://launchpad.net/bugs/1276530 | 13:33 |
gilliard_ | Is that a permissions thing? | 13:34 |
*** homeless has joined #openstack-infra | 13:35 | |
*** sballe has joined #openstack-infra | 13:36 | |
*** dustins has joined #openstack-infra | 13:36 | |
ttx | Go Kilo! https://www.surveymonkey.com/s/openstack-k-naming | 13:36 |
*** dkranz has quit IRC | 13:38 | |
joa | Mhh where does the Kilo come from in this listing ? | 13:39 |
gilliard_ | The reference SI Kilogram is kept near Paris | 13:40 |
ttx | joa: see http://lists.openstack.org/pipermail/openstack/2014-July/008342.html and https://wiki.openstack.org/wiki/Release_Naming | 13:40 |
joa | oh okay | 13:40 |
gilliard_ | Although why it's "kilo" not "kilogram" is a question... | 13:40 |
joa | gilliard_: thanks, didn't think of that | 13:40 |
joa | yup, agreed. | 13:40 |
ttx | gilliard_: it's openstack K, not openstack Kg :) But yeah, it's not a perfect strike | 13:42 |
gilliard_ | I like it though | 13:42 |
ttx | none of those options are, except Kleber which really is a street in paris | 13:42 |
ttx | but sounds weird | 13:42 |
joa | well, I don't know the original submissions list | 13:43 |
joa | but no name strikes me in those. | 13:43 |
ttx | "K" is not really used that much in France. Like I in China. | 13:44 |
joa | MHhh.. we do use it.. but not much as a word starter I guess... | 13:44 |
ttx | right. | 13:44 |
ttx | joa: if you're curious the full list of K cities is in the wiki history | 13:45 |
joa | oh ok I'll look then :D | 13:45 |
ttx | joa: Lots of Alsacian names | 13:45 |
ttx | and Brittany obviously | 13:45 |
ttx | and a few good names were striked by legal | 13:46 |
joa | well, I'd expect it, yeah | 13:46 |
joa | brittany names and alsacian are a given for the K as a starter :D | 13:46 |
joa | (if only for the local languages) | 13:46 |
*** signed8bit has joined #openstack-infra | 13:46 | |
*** rakhmerov has quit IRC | 13:47 | |
*** mattymo has quit IRC | 13:47 | |
*** sballe has quit IRC | 13:48 | |
*** akuznetsova has quit IRC | 13:48 | |
*** katyafervent has quit IRC | 13:48 | |
*** sballe has joined #openstack-infra | 13:48 | |
*** jamespage_ has joined #openstack-infra | 13:50 | |
e0ne | hi infra team! please, review my request: https://review.openstack.org/#/c/99041/. it contains two +1s and nothing changes from Jun 17 | 13:52 |
*** dstanek is now known as dstanek_zzz | 13:52 | |
*** prad has joined #openstack-infra | 13:53 | |
fungi | sdague: i tried to promote 105854,3 just now, and everything vanished out of the gate... troubleshooting now | 13:55 |
*** zhiyan is now known as zhiyan_ | 13:56 | |
*** tcammann has joined #openstack-infra | 13:56 | |
*** vhoward has joined #openstack-infra | 13:56 | |
*** jcoufal has quit IRC | 13:56 | |
fungi | ohhhhhh | 13:56 |
*** jamespage_ has quit IRC | 13:56 | |
fungi | pipeline requirements plus clearing the vote when initially enqueuing breaks the promote function | 13:57 |
fungi | on promote zuul tries to reenqueue everything in the gate in a new order | 13:57 |
*** pcrews has joined #openstack-infra | 13:57 | |
fungi | but since none of the changes it wants to reenqueue have a check +1, it doesn't consider them | 13:57 |
*** ominakov has quit IRC | 13:57 | |
*** yfried__ has quit IRC | 13:58 | |
fungi | jeblair: ^ possibly another unforseen side effect of pipeline requirements | 13:58 |
*** obondarev has quit IRC | 13:58 | |
fungi | mriedem: thanks for rechecking that one | 13:59 |
*** ominakov has joined #openstack-infra | 13:59 | |
*** jistr has quit IRC | 13:59 | |
*** emagana has joined #openstack-infra | 14:00 | |
*** rkukura has joined #openstack-infra | 14:00 | |
fungi | i knew the zuul enqueue subcommand didn't work now with pipeline requirements in place for the gate, but didn't realize it was also affecting zuul promote | 14:01 |
*** jgrimm has joined #openstack-infra | 14:01 | |
*** markmcclain has joined #openstack-infra | 14:02 | |
*** jamespage_ has joined #openstack-infra | 14:02 | |
*** zz_gondoi is now known as gondoi | 14:02 | |
*** julim_ has joined #openstack-infra | 14:02 | |
mriedem | fungi: sure | 14:02 |
*** julim has quit IRC | 14:05 | |
*** sballe has quit IRC | 14:06 | |
*** ildikov has quit IRC | 14:06 | |
*** jcoufal has joined #openstack-infra | 14:06 | |
*** melwitt has joined #openstack-infra | 14:06 | |
*** sballe has joined #openstack-infra | 14:07 | |
*** sballe has quit IRC | 14:07 | |
*** sballe has joined #openstack-infra | 14:07 | |
*** dstanek_zzz is now known as dstanek | 14:08 | |
*** duran has joined #openstack-infra | 14:08 | |
*** jamespage_ has quit IRC | 14:10 | |
*** crc32 has quit IRC | 14:14 | |
*** crc32 has joined #openstack-infra | 14:14 | |
*** wayneeseguin has quit IRC | 14:15 | |
*** timrc is now known as timrc-afk | 14:16 | |
*** jswarren has joined #openstack-infra | 14:16 | |
*** yfried__ has joined #openstack-infra | 14:18 | |
*** pballand has joined #openstack-infra | 14:19 | |
*** ZZelle_ has quit IRC | 14:21 | |
*** ZZelle_ has joined #openstack-infra | 14:21 | |
*** sballe has quit IRC | 14:22 | |
*** ildikov has joined #openstack-infra | 14:23 | |
*** sballe has joined #openstack-infra | 14:23 | |
*** nelsnelson has joined #openstack-infra | 14:24 | |
*** Longgeek has quit IRC | 14:25 | |
joa | fungi: do you have some time for a few questions about zuul ? (already read docs and all, I think :p) | 14:25 |
*** yfried__ has quit IRC | 14:25 | |
*** elambert has quit IRC | 14:26 | |
*** jistr has joined #openstack-infra | 14:28 | |
*** tcammann has quit IRC | 14:28 | |
anteaya | ttx how did Kepler not make the list? | 14:28 |
anteaya | I'm so disappointed | 14:28 |
*** amalagon has joined #openstack-infra | 14:28 | |
*** wenlock has joined #openstack-infra | 14:29 | |
*** sballe has quit IRC | 14:29 | |
*** tcammann has joined #openstack-infra | 14:29 | |
*** annegent_ has joined #openstack-infra | 14:29 | |
*** bknudson has joined #openstack-infra | 14:29 | |
*** wenlock has quit IRC | 14:30 | |
*** zz_dimtruck is now known as dimtruck | 14:30 | |
*** sballe has joined #openstack-infra | 14:30 | |
*** annegent_ is now known as annegentl_ | 14:30 | |
ttx | anteaya: blame NVidia | 14:31 |
fungi | anteaya: it was my favorite too, but not a good choice in the market unfortunately | 14:32 |
*** garyk has quit IRC | 14:33 | |
*** datsun180b has joined #openstack-infra | 14:33 | |
fungi | i actually ended up voting for kleber as my #1 pick because it's distinct and not too hard to type | 14:33 |
fungi | kilo is not very distinct | 14:34 |
fungi | challenging in a search engine | 14:34 |
*** dstanek is now known as dstanek_zzz | 14:34 | |
fungi | joa: it sounds like you don't have a template which matches the name you're trying to instantiate | 14:34 |
joa | too many kilo thinigs :p | 14:34 |
joa | fungi: Well, I've gone forward about that. | 14:35 |
fungi | joa: oh, new error message now? | 14:35 |
joa | Now, I simply wonder if having zuul excepting right out of the bat about not being able to start a gearman server... | 14:35 |
fungi | ahh, you've switched to zuul questions. got it | 14:35 |
joa | if it's normal or not | 14:35 |
*** Longgeek has joined #openstack-infra | 14:35 | |
joa | I'm trying to glue things here, so reading the code; fiddling with the conf and all | 14:35 |
joa | and I fail to see if some behaviors are expected or erroneous | 14:36 |
*** morganfainberg_Z is now known as morganfainberg | 14:36 | |
fungi | joa: zuul can either use its internal gearman server *or* optionally connect to a separate gearman server | 14:36 |
fungi | we use the internal gearman server for zuul.openstack.org | 14:36 |
joa | okay; so I shall put false into the gearman section of zuul's conf's "start"; I guess. (since I already have a gearmand running) | 14:37 |
joa | or I need to prevent gearmand from starting.. | 14:37 |
fungi | you have gearmand running on that machine for other reasons, or just installed it because you assumed zuul needed it? | 14:37 |
joa | Installed it at one point I think | 14:38 |
*** yfried__ has joined #openstack-infra | 14:38 | |
joa | the machine is kind of experiment field for my CI; until I manage to make it work "[ | 14:38 |
joa | :p | 14:38 |
*** akuznetsova has joined #openstack-infra | 14:38 | |
fungi | right, so ideally you would just disable or uninstall the gearmand you have now, if that's an option for you, and configure zuul to provide its own | 14:38 |
joa | sure it is, going to do just that | 14:39 |
*** rakhmerov has joined #openstack-infra | 14:39 | |
morganfainberg | mornin | 14:39 |
fungi | while there are features for zuul to use a separate standard gearmand, we don't really test that it works as designed that way beyond maybe some basic unit testing | 14:39 |
anteaya | ttx I will do so | 14:40 |
joa | oh; by the way, do you have any idea about my pid file missing ? | 14:40 |
* anteaya shakes her finger at NVidia | 14:40 | |
joa | (zuul.pid) | 14:40 |
anteaya | fungi: :( | 14:40 |
*** bknudson has left #openstack-infra | 14:40 | |
fungi | and also part of the reason zuul provides its own is that there were some features we needed from gearman that the usual suspects didn't provide | 14:40 |
joa | fungi: okay. | 14:40 |
fungi | joa: usually the missing pidfile would either mean that the service didn't start, or lacked filesystem permissions to write the pidfile | 14:41 |
* joa didnt write anything while he tried setting up things; he'll have to do it again before writing a howto. | 14:41 | |
anteaya | I'm not ready to vote yet, still in mourning over kepler | 14:41 |
joa | fungi: Mhh well, the zuul-server process is running | 14:41 |
joa | and no pidfile exists. which is also a strange point. | 14:41 |
*** arnaud has quit IRC | 14:41 | |
anteaya | morning morganfainberg | 14:41 |
fungi | joa: so it's possible that it's able to start even if it fails to write the pidfile (e.g. for filesystem access reasons) | 14:41 |
morganfainberg | anteaya, how goes today? | 14:42 |
*** wenlock has joined #openstack-infra | 14:42 | |
anteaya | morganfainberg: great breakfast, comfy chair | 14:42 |
morganfainberg | anteaya, woot! | 14:42 |
joa | fungi: sure. But I see no reason for it to fail writing the pid :/ | 14:42 |
anteaya | morganfainberg: disappointment that kepler isn't in the k naming poll: http://lists.openstack.org/pipermail/openstack/2014-July/008342.html | 14:42 |
*** marun has joined #openstack-infra | 14:42 | |
*** sballe has quit IRC | 14:42 | |
anteaya | morganfainberg: so on the plus side anyway | 14:42 |
morganfainberg | anteaya, aww yeah. | 14:42 |
anteaya | morganfainberg: and you? | 14:42 |
fungi | joa: we run our zuul daemon as the "zuul" user and have the /var/run/zuul directory owned by that user | 14:43 |
mtreinish | anteaya: damn trademarks... | 14:43 |
*** katyafervent has joined #openstack-infra | 14:43 | |
anteaya | mtreinish: damn those trademarks | 14:43 |
morganfainberg | anteaya, at the keystone hackathon. discussing lots of stuff :) | 14:43 |
*** sballe has joined #openstack-infra | 14:43 | |
anteaya | morganfainberg: awesome! | 14:43 |
joa | fungi: mhhh.. using service zuul start; so.. that should work.. Unless... | 14:43 |
fungi | zuul drops privs before it tries to open the fd for the pidfile | 14:44 |
joa | whelp, nope; the group is right there. | 14:44 |
*** arnaud has joined #openstack-infra | 14:44 | |
joa | zuul:root on /var/run/zuul -> normal; or mistake ? | 14:44 |
*** mriedem has quit IRC | 14:45 | |
fungi | joa: probably should be fine as long as it's writeable. but ours in production looks like http://paste.openstack.org/show/85958/ | 14:45 |
*** jamespage_ has joined #openstack-infra | 14:45 | |
joa | ok | 14:45 |
*** otherwiseguy has joined #openstack-infra | 14:45 | |
joa | Well, I can touch zuul.pid in there within a zuul session. I dunnow what's wrong. I'd have to fiddle a bit with the code I guess (or the pidfile context manager as far as I could see) | 14:46 |
joa | Okay. | 14:46 |
*** mriedem has joined #openstack-infra | 14:48 | |
joa | what the... | 14:49 |
joa | running with the service utility; zuul seems to have stopped this time. | 14:49 |
joa | Running in foreground, it seems to run properly. | 14:49 |
*** mattymo has joined #openstack-infra | 14:49 | |
joa | Or my brain got left somewhere else... | 14:49 |
*** sballe has quit IRC | 14:50 | |
*** obondarev has joined #openstack-infra | 14:50 | |
*** AJaeger has quit IRC | 14:51 | |
*** jamespage_ has quit IRC | 14:51 | |
joa | Well, yeah seems to have some issues in the init script | 14:52 |
fungi | we're currently continuously deployed from the tip of master on an ubuntu 12.04 lts (precise pangolin) vm | 14:53 |
fungi | if that helps as a point of comparison | 14:53 |
*** trinaths has joined #openstack-infra | 14:53 | |
joa | Well, maybe I do not have master's tip. I think it was installed through jaypipes's scripts | 14:55 |
joa | in /usr/local | 14:55 |
*** zehicle has quit IRC | 14:55 | |
* joa is starting to want to throw tables around for fun | 14:55 | |
*** Guest58876 has joined #openstack-infra | 14:56 | |
anteaya | joa: now you are getting the hang of it | 14:56 |
joa | anteaya: of throwing tables around ? :D | 14:56 |
joa | Honestly, I didn't expect to spend so much time in the CI setup | 14:56 |
joa | I gravely underestimated this. | 14:56 |
jeblair | hey the periodic stable jobs ran! ceilometer, heat, horizon, glance, and tempest failed! | 14:57 |
joa | fun. | 14:57 |
joa | so much fun | 14:57 |
fungi | joa: no idea what init script jaypipes uses, but we have a puppet module which installs zuul with this initscript for the main service http://git.openstack.org/cgit/openstack-infra/config/tree/modules/zuul/files/zuul.init | 14:57 |
*** thedodd has joined #openstack-infra | 14:57 | |
joa | I think he uses puppet scripts (but well, I never did any puppet so it looks like half-shell to me, and half-gibberish) | 14:58 |
fungi | also known as ruby ;) | 14:58 |
joa | but now I'm thinking of doing things manually. | 14:58 |
joa | is it basic ruby ? | 14:58 |
fungi | what puppet? no not really | 14:58 |
fungi | it's some sort of block-based declarative language they made up with bits of embedded ruby | 14:59 |
joa | oh, reassuring. I'd be afraid if I did not manage to recognize ruby itself | 14:59 |
fungi | puppet is fun too, if you like throwing tables around | 14:59 |
fungi | really, computers in general | 15:00 |
joa | well, have had some feedbacks from friends trying to use it | 15:00 |
joa | that brings me to a totallyy unrelated question | 15:00 |
joa | why use puppet and not salt, which is in python for openstack ? Any specific reason you might know about ? | 15:00 |
fungi | historical at this point | 15:01 |
joa | okay | 15:01 |
jeblair | salt did not exist at the time we started, and interest on technical debt is compounding | 15:02 |
fungi | i mean, we have evaluated salt and it too has its benefits and shortcomings, but the effort involved in rewriting everything we have into a new orchestration engine is i think the biggest hurdle | 15:02 |
*** kmartin has joined #openstack-infra | 15:02 | |
anteaya | jeblair: yes | 15:02 |
fungi | i'm just thankful that we have it in any orchestration engine at all | 15:02 |
anteaya | sorry tab complete fail | 15:02 |
anteaya | the yes was to joa | 15:03 |
fungi | s/orchestration engine/configuration management system/ | 15:03 |
fungi | some of both really | 15:04 |
*** garyk has joined #openstack-infra | 15:04 | |
*** garyk has quit IRC | 15:04 | |
fungi | we've started to use ansible in some places for remote execution though | 15:04 |
joa | jeblair: okay, I don't really know either; but if it started before salt it makes sense :) | 15:04 |
*** garyk has joined #openstack-infra | 15:04 | |
*** pballand has quit IRC | 15:04 | |
*** luqas has quit IRC | 15:05 | |
fungi | jeblair: not sure if you saw in scrollback, but i discovered that zuul promote suffers from the same issue as zuul enqueue with our new pipeline requirements configuration | 15:05 |
jeblair | fungi: okay. we should probably fix those soon then :) | 15:06 |
fungi | 'zuul promote' is now a synonym for 'zuul empty-the-gate' | 15:06 |
*** shayneburgess has joined #openstack-infra | 15:06 | |
jeblair | neat! | 15:06 |
fungi | yeah, i certainly thought so | 15:06 |
*** dstanek_zzz is now known as dstanek | 15:08 | |
*** gangil has joined #openstack-infra | 15:09 | |
*** dstanek is now known as dstanek_zzz | 15:09 | |
*** viktors has quit IRC | 15:10 | |
*** david-lyle has joined #openstack-infra | 15:11 | |
*** moted has joined #openstack-infra | 15:13 | |
*** moted has quit IRC | 15:13 | |
*** pballand has joined #openstack-infra | 15:14 | |
*** _nadya_ has joined #openstack-infra | 15:15 | |
*** Longgeek has quit IRC | 15:16 | |
*** morganfainberg is now known as morganfainberg_Z | 15:19 | |
*** morganfainberg_Z is now known as morganfainberg | 15:20 | |
*** Sukhdev has joined #openstack-infra | 15:20 | |
*** luqas has joined #openstack-infra | 15:20 | |
*** ihrachyshka has quit IRC | 15:21 | |
*** luqas has quit IRC | 15:22 | |
*** jistr has quit IRC | 15:24 | |
*** jistr has joined #openstack-infra | 15:24 | |
*** armax has joined #openstack-infra | 15:25 | |
jeblair | fungi: i think the obvious thing to do for both promote and enqueue is to just ignore pipeline requirements (we're essentially trusting the judgement of the operator to override the configuration anyway) | 15:25 |
armax | hi there…is there a way to create an experimental job in the Openstack CI that uses a local.conf rather that the usual way of passing confg to DevStack via env variables? | 15:26 |
fungi | jeblair: i agree that makes sense | 15:26 |
jeblair | fungi: the complicating aspect of that is whether we should also ignore them when considering changes ahead or behind | 15:26 |
*** zzelle__ has joined #openstack-infra | 15:26 | |
jeblair | fungi: i tend to think "no", because that could cause changes that aren't actually ready to be pulled into the queue | 15:26 |
*** crc32 has quit IRC | 15:26 | |
fungi | jeblair: you mean strictly when using the enqueue/promote subcommands, or all the time? | 15:26 |
jeblair | fungi: strictly | 15:27 |
fungi | jeblair: and yeah, it seems dangerous. i don't think we should either | 15:27 |
*** carl_baldwin has joined #openstack-infra | 15:27 | |
jeblair | fungi: note that when using promote, all of the changes ahead or behind that should be in the queue should already be in the queue when the promote command is used | 15:27 |
jeblair | fungi: so they will benefit from the override and still end up back in the queue | 15:27 |
fungi | yeah, that seems fair | 15:28 |
fungi | jeblair: on a related note, did you see my (probably terrible) first attempt at ironing out the reporting failure bug? https://review.openstack.org/104963 mainly a conversation-starter, though i think it at least exposes the problem rather than hiding it in the log | 15:28 |
*** signed8bit has quit IRC | 15:28 | |
jeblair | fungi: i did not | 15:29 |
*** pballand has quit IRC | 15:29 | |
fungi | i think right now any change which gets ejected from the gate because of a failure on another change it depends on is ending up with no -2 in gerrit and no comment from zuul | 15:29 |
mtreinish | hmm, no gerrit bot again? | 15:30 |
fungi | mtreinish: it seems to be a casualty of the recent netsplit storms. i'll kick it back in | 15:30 |
mtreinish | anteaya: anyway I respun https://review.openstack.org/#/c/102392/ | 15:30 |
*** _nadya_ has quit IRC | 15:30 | |
anteaya | mtreinish: thanks | 15:31 |
* anteaya looks | 15:31 | |
mtreinish | fungi: cool thanks | 15:31 |
mtreinish | gerritbot seems to get lost during netsplits a lot... | 15:31 |
*** radez is now known as radez_g0n3 | 15:31 | |
*** chandankumar has quit IRC | 15:31 | |
anteaya | mtreinish: sorry, I wasn't clear I had meant this syntax: node: 'bare-precise || bare-trusty' will specifying just bare-trusty work? | 15:32 |
anteaya | fungi: ^ | 15:32 |
armax | mtreinish, jeblair: is there a way to create an experimental job in the Openstack CI that uses a local.conf rather that the usual way of passing confg to DevStack via env variables? Or do you have suggestions about where I can go look? Thanks | 15:32 |
*** openstackgerrit has joined #openstack-infra | 15:33 | |
*** _nadya_ has joined #openstack-infra | 15:33 | |
anteaya | SergeyLukjanov: I thought I had stated in teh name format guidelines that we would not be using openstack program names in ci names | 15:33 |
fungi | anteaya: uh, probably... unless we end up needing to switch the job from trusty to precise with a parameter function | 15:33 |
*** che-arne has joined #openstack-infra | 15:33 | |
mtreinish | anteaya: ah, I thought you were complaining about the whitespace. | 15:33 |
anteaya | SergeyLukjanov: I had thought you were operating from that understanding, which is why I hadn't said anything on the purestorage email requesting a ci | 15:34 |
*** radez_g0n3 is now known as radez | 15:34 | |
mtreinish | I didn't realize everyone else was using an or there | 15:34 |
*** vhoward has left #openstack-infra | 15:34 | |
anteaya | mtreinish: the empty line and the node: 'bare-precise || bare-trusty', I had two complaints | 15:34 |
SergeyLukjanov | anteaya, /me checking | 15:34 |
mtreinish | anteaya: ok, one more time... | 15:35 |
anteaya | mtreinish: sorry, this is my fault, I need to be clearer | 15:35 |
openstackgerrit | Matthew Treinish proposed a change to openstack-infra/config: Add subunit2sql to stackforge https://review.openstack.org/102392 | 15:35 |
mtreinish | anteaya: ^^^ | 15:35 |
fungi | also, openstackgerrit is back now | 15:35 |
mtreinish | fungi: yep and all's right with the world | 15:36 |
anteaya | mtreinish: yes, that makes me happy | 15:36 |
anteaya | thank you | 15:36 |
*** gondoi is now known as zz_gondoi | 15:37 | |
*** torandu has joined #openstack-infra | 15:37 | |
*** beagles has joined #openstack-infra | 15:37 | |
anteaya | given the exposure of driverlog on stackalytics, I have a growing concern that folks need a ci more for marketing purposes than for actual testing purposes | 15:37 |
SergeyLukjanov | anteaya, I've checked it based on the existing accounts (there is an "HP Cinder CI" already) | 15:37 |
anteaya | right | 15:37 |
anteaya | which was a mistake | 15:38 |
anteaya | which I made | 15:38 |
anteaya | and have been trying to undo ever since I made it | 15:38 |
anteaya | as per the conversation on the patch dealing with naming | 15:38 |
*** asselin has joined #openstack-infra | 15:38 | |
*** wenlock has quit IRC | 15:38 | |
anteaya | I had thought you have been following the comments on that patch | 15:38 |
anteaya | which I hope to discuss next week | 15:38 |
*** doude has quit IRC | 15:39 | |
*** wenlock has joined #openstack-infra | 15:39 | |
SergeyLukjanov | anteaya, unfortunately I'm a bit ahead of the reviews | 15:39 |
SergeyLukjanov | :( | 15:39 |
anteaya | okay, well you have been doing such a good job I didn't want to interfere | 15:39 |
*** signed8bit has joined #openstack-infra | 15:39 | |
anteaya | I can be irritating | 15:39 |
mordred | mtreinish: yay subunit2sql | 15:40 |
SergeyLukjanov | anteaya, I'm sorry :( /me hope to return back to realtime reviews this week | 15:41 |
anteaya | np, I understand | 15:41 |
*** atiwari has joined #openstack-infra | 15:41 | |
anteaya | can you freeze that account, explain that you need to hear from them about their naming choices, and hopefully rename it | 15:41 |
anteaya | and point to the patch so they understand | 15:42 |
*** sweston_ has quit IRC | 15:43 | |
*** luqas has joined #openstack-infra | 15:43 | |
*** jlibosva has quit IRC | 15:43 | |
mordred | SergeyLukjanov: the world is strange when you are not reviewing a billion things a day | 15:45 |
*** sweston_ has joined #openstack-infra | 15:45 | |
*** timrc-afk is now known as timrc | 15:45 | |
SergeyLukjanov | anteaya, I'm not sure that it's a good approach while the patch isn't approved | 15:45 |
SergeyLukjanov | mordred, I was on Paris summit + 4 PTO days for the last 10 days + finishing house repair :) | 15:46 |
*** ArxCruz has quit IRC | 15:46 | |
*** sweston_ has quit IRC | 15:46 | |
mordred | SergeyLukjanov: sounds like fun! | 15:46 |
SergeyLukjanov | mordred, that's why I'm not doing a lot of reviews but I hope to return back to billions of them next week ;) | 15:47 |
SergeyLukjanov | mordred, yeah, it's fun :) | 15:47 |
*** jgriffith has quit IRC | 15:47 | |
mtreinish | mordred: yeah, I think it's pretty cool. It'll also be interesting to start doing longer term tracking of individual tests from the gate with it | 15:47 |
*** ArxCruz has joined #openstack-infra | 15:47 | |
*** msabramo has joined #openstack-infra | 15:50 | |
mtreinish | mordred: it was also super easy to write (albeit probably poorly :) ) | 15:52 |
zaro | morning | 15:52 |
*** jgriffith has joined #openstack-infra | 15:53 | |
*** thedodd has quit IRC | 15:54 | |
*** asettle has joined #openstack-infra | 15:54 | |
jeblair | mtreinish: how are you planning on using it? | 15:55 |
*** atiwari has quit IRC | 15:55 | |
anteaya | SergeyLukjanov: well right now the problem just got worse | 15:55 |
zaro | msabramo: mind taking a look? need to create minor release for python-jenkins https://review.openstack.org/#/c/105897 AND https://review.openstack.org/#/c/105898 | 15:56 |
anteaya | SergeyLukjanov: so what are you comfortable doing to not make the problem worse | 15:56 |
*** thedodd has joined #openstack-infra | 15:56 | |
*** sballe has joined #openstack-infra | 15:57 | |
mtreinish | jeblair: I was thinking we'd just have a DB running (maybe spun up with trove) and at the end of each gate job run we use subunit2sql to upload the results of the test run into it | 15:58 |
zaro | SergeyLukjanov: any reason for not approving? https://review.openstack.org/#/c/94675 | 15:58 |
mtreinish | then on top of the DB we could have some dashboards to show individual run metrics, like job fail rates and run times | 15:58 |
mtreinish | sorry indidvidual test fail rates and run times | 15:58 |
*** ihrachyshka has joined #openstack-infra | 15:59 | |
*** bknudson1 has joined #openstack-infra | 15:59 | |
mtreinish | we can use the longer term data to make decisions about how we slice tests for running in the gate | 15:59 |
mtreinish | if we get close to the run time boundary again | 15:59 |
mtreinish | we can do this kind of analysis with logstash now, but 10 days isn't enough data | 16:00 |
mtreinish | anyway I was planning to bring it up next week | 16:00 |
jeblair | mtreinish: cool; i think we may need to have a post-processing job like the logstash workers actually run subunit2sql (since if we run it on the slaves, the creds will be public) | 16:01 |
SergeyLukjanov | anteaya, so, I think that we should rename accounts when patch will be approved, I'm ready to do the renaming part | 16:01 |
SergeyLukjanov | anteaya, (but will need some consultations about how to do it :) | 16:01 |
jeblair | mtreinish: can you write up an infra-spec for it so we can hammer out all the details? | 16:01 |
SergeyLukjanov | zaro, /me looking | 16:02 |
jeblair | mtreinish: and it sounds like maybe it should be in openstack-infra instead of stackforge | 16:02 |
mtreinish | jeblair: yeah doing it as a post-processing job is fine | 16:02 |
mtreinish | sure I'll draft a spec after lunch | 16:02 |
mtreinish | I made it a stackforge project because the subunit2sql library is more general purpose | 16:02 |
SergeyLukjanov | zaro, good question :) approved | 16:02 |
mtreinish | I didn't really see anything openstack specific about it | 16:02 |
mtreinish | but if you'd rather have it in openstack-infra we can move it there | 16:03 |
davidlenwell | mkoderer: will do | 16:03 |
anteaya | SergeyLukjanov: can you communicate with that account and at least make them aware of the patch | 16:03 |
*** dizquierdo has quit IRC | 16:03 | |
jeblair | mtreinish: we have lots of stuff in infra that's not openstack-specific -- i think the question is "when you are working on this tool, are you advancing the state of the openstack project infrastructure" | 16:04 |
anteaya | SergeyLukjanov: so that they are not caught be surprise when asked to come up with a new name | 16:04 |
SergeyLukjanov | anteaya, yup, sure, I'll do it | 16:04 |
anteaya | SergeyLukjanov: thank you | 16:04 |
*** IvanBerezovskiy has left #openstack-infra | 16:04 | |
jeblair | mtreinish: and i think if we start running a test performance db for all the tests we run, the answer to that is probably 'yes' | 16:04 |
*** luqas has quit IRC | 16:04 | |
*** dstanek_zzz is now known as dstanek | 16:04 | |
*** e0ne has quit IRC | 16:04 | |
anteaya | SergeyLukjanov: and henceforth you can keep an eye out for ci proposed names and request an alternate if the proposed name includes an openstack program name? | 16:05 |
*** melwitt has quit IRC | 16:05 | |
SergeyLukjanov | anteaya, ack | 16:05 |
jeblair | mtreinish: also, subunit to graphite might be interesting | 16:05 |
SergeyLukjanov | anteaya, could you please post a link to your CR about naming? | 16:05 |
*** david-lyle has quit IRC | 16:06 | |
*** emagana has quit IRC | 16:06 | |
*** bknudson1 has quit IRC | 16:06 | |
*** emagana has joined #openstack-infra | 16:06 | |
mtreinish | jeblair: ok that's fair, I just didn't see it's usefulness limited to just infra and running the test performance db. For exmaple, there was talks of using it as the db backend for a tempest test server | 16:07 |
mtreinish | but that being said I don't really care where it lives | 16:07 |
*** david-lyle has joined #openstack-infra | 16:07 | |
mtreinish | I can respin that patch and move it under infra that's no real effort | 16:07 |
mtreinish | jeblair: heh, yeah but I don't know enough about graphite :) | 16:08 |
msabramo | zaro: sure | 16:09 |
*** pdmars has quit IRC | 16:09 | |
*** hashar has quit IRC | 16:09 | |
jeblair | mtreinish: yeah, this in no way has to limit it -- it's more about recognizing that it's part of our work on openstack. it fits into the system we're building as a whole, contributors get atc status, companies get bigger numbers next to their names, etc :) | 16:09 |
msabramo | think I need a better IRC client that tracks mentions better | 16:09 |
*** pdmars has joined #openstack-infra | 16:10 | |
openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: Document the Zuul triggers https://review.openstack.org/77838 | 16:10 |
anteaya | SergeyLukjanov: https://review.openstack.org/#/c/101013/ | 16:10 |
mtreinish | jeblair: ok you don't have to twist my arm, I fully support padding my stats :) | 16:11 |
SergeyLukjanov | anteaya, thx | 16:11 |
*** emagana has quit IRC | 16:11 | |
mtreinish | jeblair: I'll respin it under the infra namespace | 16:11 |
anteaya | SergeyLukjanov: np, sorry I didn't know you weren't aware of the patch | 16:12 |
anteaya | SergeyLukjanov: I should have ensured you were | 16:12 |
clarkb | dhellmann_: sdague I +2'd the change given the discussion. Its just surprising to me that we decided we had a problem that should be fixed and stopped halfway | 16:14 |
clarkb | dhellmann_: sdague and that we wouldn't want to start new projects in a fixed state | 16:14 |
jeblair | sdague: close to final: https://review-dev.openstack.org/#/c/5269/ | 16:15 |
*** kgriffs has left #openstack-infra | 16:15 | |
sdague | jeblair: nice | 16:15 |
jeblair | sdague: hides comments by default | 16:15 |
*** emagana has joined #openstack-infra | 16:15 | |
*** hogepodge has joined #openstack-infra | 16:15 | |
msabramo | zaro: Done! Thanks for taking care of that! | 16:15 |
clarkb | jeblair: that is shiny | 16:16 |
openstackgerrit | James E. Blair proposed a change to openstack-infra/config: WIP: add CI results table https://review.openstack.org/105860 | 16:16 |
jeblair | last todo is new change screen | 16:16 |
sdague | jeblair: you could probably shrink the .addMemberTextBox to 20em to square things up a bunch | 16:16 |
jeblair | sdague: yeah | 16:17 |
openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: multijob: added kill-phase-on option https://review.openstack.org/99903 | 16:18 |
jeblair | rgerganov: when you have a minute, can you add an apache license header and copyright statement to hideci.js? | 16:18 |
clarkb | afazekas: pong | 16:18 |
*** duran_ has joined #openstack-infra | 16:18 | |
openstackgerrit | Matthew Treinish proposed a change to openstack-infra/config: Add subunit2sql to openstack-infra https://review.openstack.org/102392 | 16:19 |
*** duran_ has quit IRC | 16:19 | |
mtreinish | jeblair: ^^^ should have gotten all the stackforge references | 16:19 |
*** duran_ has joined #openstack-infra | 16:20 | |
afazekas | clarkb: is this job definition ok: https://review.openstack.org/#/c/105534/ | 16:20 |
*** bknudson has joined #openstack-infra | 16:21 | |
sdague | fungi: so can we get a re-re promote of - https://review.openstack.org/#/c/105854/ | 16:21 |
fungi | sdague: nope | 16:21 |
sdague | because until that merges, pg tests seem to be at a 50% fail rate | 16:21 |
sdague | how about a ninja merge then? | 16:21 |
fungi | sdague: the reason it dropped out of the gate before was that i tried to promote it | 16:22 |
fungi | and promote no longer works with pipeline requirements | 16:22 |
sdague | we lost promote... :( | 16:22 |
sdague | that makes me a sad panda | 16:22 |
fungi | when i tried, it just helpfully emptied the entire gate instead, because none of those changes had check +1 votes on them at that point | 16:22 |
jeblair | we'll get it back | 16:22 |
*** nati_ueno has joined #openstack-infra | 16:23 | |
*** anonitus has joined #openstack-infra | 16:23 | |
*** bknudson has left #openstack-infra | 16:23 | |
fungi | yeah, the current issue is that the zuul enqueue/promote utility cli subcommands take the same code path that changes moving in and out of pipelines normally take, so are subject to the same configuration restrictions we've got in place | 16:24 |
*** luqas has joined #openstack-infra | 16:24 | |
*** anonitus has left #openstack-infra | 16:24 | |
*** anonitus has joined #openstack-infra | 16:24 | |
fungi | thus we need a way to give them a free pass rather than be subjected to the configured pipeline requirements | 16:24 |
openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/config: Modularized StoryBoard Module https://review.openstack.org/98007 | 16:25 |
openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: Change default Reply-To header to $DEFAULT_REPLYTO. https://review.openstack.org/79331 | 16:25 |
*** markmcclain has quit IRC | 16:25 | |
sdague | fungi / jeblair ok, ninja merge? | 16:26 |
sdague | because - http://jogo.github.io/gate/ | 16:26 |
clarkb | afazekas: reviewed. mostly small things otherwise yes, I think that is a good place to start | 16:26 |
sdague | without promote we're kind of unhealable | 16:26 |
*** marcoemorais has joined #openstack-infra | 16:26 | |
anteaya | mtreinish: jenkins is unhappy | 16:29 |
anteaya | mtreinish: alphabetized failed | 16:29 |
*** radez is now known as radez_g0n3 | 16:30 | |
fungi | sdague: the change itself looks fairly trivial (though that obviously doesn't speak to the gravity of its effect). i'd be okay manually submitting it through gerrit if jeblair/clarkb are in agreement, though in general we shouldn't be bypassing the gate just because it isn't fast enough for us | 16:31 |
*** radez_g0n3 is now known as radez | 16:31 | |
sdague | fungi: well, I'm sure we can have plenty of beer discussions about that next week :) | 16:32 |
*** arnaud has quit IRC | 16:32 | |
*** nati_ueno has quit IRC | 16:32 | |
*** atiwari has joined #openstack-infra | 16:32 | |
*** nati_ueno has joined #openstack-infra | 16:32 | |
fungi | sdague: it looks like 105854,3 is failing on a tempest-postgres job in check right now... is it hitting the same failure it's trying to prevent, or is that a different bug? | 16:33 |
*** arnaud has joined #openstack-infra | 16:33 | |
sdague | fungi: let me look | 16:33 |
fungi | http://logs.openstack.org/54/105854/3/check/check-tempest-dsvm-postgres-full/8a11ce1/ | 16:33 |
*** _nadya_ has quit IRC | 16:33 | |
sdague | if it's failing this fast, I doubt it's the issue | 16:33 |
fungi | yeah, hit something in devstack, not tempest | 16:33 |
mtreinish | anteaya: thanks, let me respin it yet again | 16:33 |
*** [1]trinaths has joined #openstack-infra | 16:34 | |
sdague | failing on rax mirror - http://logs.openstack.org/54/105854/3/check/check-tempest-dsvm-postgres-full/8a11ce1/logs/devstacklog.txt.gz#_2014-07-10_16_27_45_135 | 16:34 |
fungi | rackspace ubuntu mirror fail | 16:34 |
sdague | trying to install libxen of all things | 16:34 |
fungi | okay, so false alarm | 16:34 |
*** elambert has joined #openstack-infra | 16:34 | |
openstackgerrit | Matthew Treinish proposed a change to openstack-infra/config: Add subunit2sql to openstack-infra https://review.openstack.org/102392 | 16:35 |
mtreinish | anteaya: ^^^ | 16:35 |
*** jgriffith has quit IRC | 16:35 | |
*** eglynn-regus is now known as eglynn-office | 16:36 | |
*** jgriffith has joined #openstack-infra | 16:36 | |
*** yaguang has quit IRC | 16:36 | |
openstackgerrit | A change was merged to openstack-infra/jenkins-job-builder: Add support for Managed Script Plugin https://review.openstack.org/99109 | 16:36 |
openstackgerrit | Randy Coulman proposed a change to openstack-infra/jenkins-job-builder: Support the Store SCM plugin https://review.openstack.org/85729 | 16:37 |
*** trinaths has quit IRC | 16:37 | |
*** [1]trinaths is now known as trinaths | 16:37 | |
openstackgerrit | Steve Martinelli proposed a change to openstack-infra/config: Add docs jobs for keystone-specs https://review.openstack.org/106100 | 16:39 |
*** xianghui has quit IRC | 16:39 | |
*** salv-orlando has quit IRC | 16:42 | |
*** markwash has joined #openstack-infra | 16:42 | |
openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/infra-specs: StoryBoard Streaming API specification https://review.openstack.org/105252 | 16:44 |
*** thedodd has quit IRC | 16:44 | |
*** SumitNaiksatam has quit IRC | 16:44 | |
*** tkelsey has joined #openstack-infra | 16:44 | |
*** chandankumar has joined #openstack-infra | 16:45 | |
*** jpich has quit IRC | 16:46 | |
*** duran_ has quit IRC | 16:48 | |
*** duran has quit IRC | 16:48 | |
*** e0ne has joined #openstack-infra | 16:48 | |
openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/infra-specs: StoryBoard Streaming API specification https://review.openstack.org/105252 | 16:50 |
*** sweston_ has joined #openstack-infra | 16:50 | |
marun | fungi, jeblair: when you have the chance, would you take a look at this fix suggested by sdague to fix sudo support for the neutron functional job? | 16:50 |
marun | https://review.openstack.org/#/c/105926/ | 16:51 |
*** flaper87 is now known as flaper87|afk | 16:51 | |
*** liam_ has joined #openstack-infra | 16:51 | |
openstackgerrit | Steve Martinelli proposed a change to openstack-infra/config: Publish docs jobs for keystone-specs https://review.openstack.org/106100 | 16:51 |
*** jistr has quit IRC | 16:52 | |
*** andreaf has quit IRC | 16:52 | |
armax | can anyone help me to understand how to add local.conf support to jobs for the experimental queue? Or am I looking at this all wrong? | 16:52 |
wenlock | clarkb we're looking for when the pip package will show up for this change https://review.openstack.org/#/c/105876/ how does that work? | 16:53 |
*** reed has joined #openstack-infra | 16:54 | |
*** bdpayne has joined #openstack-infra | 16:54 | |
*** e0ne has quit IRC | 16:54 | |
*** stevemar has joined #openstack-infra | 16:54 | |
clarkb | zaro: wenlock's question makes me wonder if python-jenkins pre pbr even honors requirements.txt? | 16:55 |
*** denis_makogon has quit IRC | 16:55 | |
anteaya | mtreinish: do you want openstack-merges to be aware of this repo? | 16:55 |
anteaya | regarding gerritbot | 16:55 |
*** nati_ueno has quit IRC | 16:55 | |
stevemar | Was wondering what the status of creating specs.openstack.org was? (referring heavily to http://lists.openstack.org/pipermail/openstack-dev/2014-March/031234.html) | 16:55 |
clarkb | zaro: https://review.openstack.org/gitweb?p=stackforge/python-jenkins.git;a=blob;f=setup.py;h=53f53d66444ace61038a72a59eb41aee7e5650bc;hb=064c4a2e5a11531700cf4a8828825c550f253fe3 judging by that it won't | 16:55 |
*** johnthetubaguy is now known as zz_johnthetubagu | 16:55 | |
morganfainberg | stevemar, ++ | 16:55 |
clarkb | zaro: I think that means we need to add suport for reading requirements.txt in that setup.py | 16:56 |
jeblair | afaik, no one is working on specs.o.o right now. | 16:56 |
stevemar | morganfainberg, yeah, turns out they won't be published on docs.o.org :( just learned that | 16:56 |
jeblair | clarkb: or just add it to setup.py | 16:56 |
clarkb | jeblair: or that | 16:56 |
*** derekh_ has quit IRC | 16:56 | |
clarkb | zaro: in any case the backport wasn't direct. we will need to make a change to setup.py too | 16:56 |
zaro | clarkb: shoot! i just created another tag. | 16:56 |
anteaya | mtreinish: +1 | 16:56 |
openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Delete select-mirror and all the args https://review.openstack.org/103355 | 16:57 |
openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Stop using select-mirror in slave scripts https://review.openstack.org/106107 | 16:57 |
clarkb | zaro: did you push it yet? | 16:57 |
clarkb | zaro: if you haven't pushed it yet then just delete the tag locally | 16:57 |
zaro | was pushed 5 mins ago. | 16:57 |
*** thedodd has joined #openstack-infra | 16:58 | |
*** annegentl_ has quit IRC | 16:59 | |
*** emagana has quit IRC | 16:59 | |
zaro | clarkb: i'm not sure what's needed. can you make that change? | 17:00 |
*** emagana has joined #openstack-infra | 17:00 | |
*** salv-orlando has joined #openstack-infra | 17:00 | |
*** duran has joined #openstack-infra | 17:01 | |
clarkb | zaro: the setup.py on that branch does not install requirements.txt | 17:02 |
clarkb | zaro: you either need to add six as a requireemnt in the setup.py or read in requirements.txt in the setup.py | 17:02 |
clarkb | I can't make the change now have to run errands will be back this afternoon | 17:02 |
*** SumitNaiksatam has joined #openstack-infra | 17:03 | |
zaro | clarkb: ok. i will propose something. | 17:03 |
wenlock | zaro clarkb thanks! | 17:03 |
*** Ryan_Lane has joined #openstack-infra | 17:04 | |
*** emagana has quit IRC | 17:04 | |
stevemar | jeblair, anyway I can help on getting specs.o.org setup? | 17:05 |
*** SnowDust has joined #openstack-infra | 17:05 | |
*** juzuluag has quit IRC | 17:05 | |
notmyname | lifeless: I've got a heat question. around? | 17:05 |
notmyname | or anyone who knows about heat ^^ | 17:06 |
*** shashankhegde has joined #openstack-infra | 17:06 | |
notmyname | also where do I ask such questions? | 17:06 |
jeblair | stevemar: yep. develop a plan, figure out how the index page should be handled, decide how the jobs should be published, add the appropriate puppet configuration if needed, and write the jobs. | 17:06 |
jeblair | stevemar: basically nothing has been done, and no one is working on it. | 17:07 |
stevemar | jeblair, like a walk in the park! i'll start poking around | 17:08 |
*** elambert_ has joined #openstack-infra | 17:08 | |
*** elambert has quit IRC | 17:08 | |
*** elambert_ is now known as elambert | 17:08 | |
*** maxbit has quit IRC | 17:09 | |
jeblair | stevemar: there's only one or two things that need infra root access (the dns, and if you choose to do ftp to cloudsites rather than scp to static.o.o, setting that up); we can do that no problem when we get to that point. | 17:09 |
*** luqas has quit IRC | 17:10 | |
clarkb | notmyname: I think there is a #heat | 17:10 |
*** Ajaeger has joined #openstack-infra | 17:10 | |
jeblair | jogo: at least, i assume you aren't working on specs.o.o? | 17:10 |
notmyname | clarkb: ah, ok. thanks. (I found that #openstack-heat isn't a thing) | 17:10 |
jeblair | probably should be | 17:11 |
*** SnowDust has quit IRC | 17:11 | |
*** pelix has quit IRC | 17:11 | |
*** jgallard has quit IRC | 17:11 | |
*** harlowja_away is now known as harlowja | 17:13 | |
mtreinish | anteaya: heh, I didn't even think about that. If you think adding it to openstack-merges is important I'll respin it again | 17:14 |
*** shashankhegde has quit IRC | 17:15 | |
Ajaeger | notmyname: yeah, it's #heat - confusing IMHO | 17:17 |
*** shashankhegde has joined #openstack-infra | 17:17 | |
jogo | jeblair: I am not working on creating specs.o.o as I don't even know where to start | 17:18 |
*** dstanek is now known as dstanek_zzz | 17:19 | |
*** Sukhdev has quit IRC | 17:20 | |
*** ominakov has quit IRC | 17:21 | |
openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Stop using select-mirror in slave scripts https://review.openstack.org/106107 | 17:23 |
openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Delete select-mirror and all the args https://review.openstack.org/103355 | 17:23 |
openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Clean up select-mirror backward compatibility https://review.openstack.org/106112 | 17:23 |
krotscheck | If I make a modification to install_modules.sh, does that get run during gate-config-puppet-apply-precise? | 17:24 |
jeblair | krotscheck: i don't think so; it's possible we made a catch-22 there (it's new) | 17:24 |
jeblair | krotscheck: have a test failure from that you can link to? | 17:25 |
krotscheck | jeblair: https://review.openstack.org/#/c/98007/ | 17:25 |
krotscheck | jeblair: Specifically http://logs.openstack.org/07/98007/12/check/gate-config-puppet-apply-precise/3a6374a/ | 17:25 |
fungi | krotscheck: the job just runs http://git.openstack.org/cgit/openstack-infra/config/tree/test.sh | 17:25 |
fungi | krotscheck: and no mention of install_modules.sh in it | 17:26 |
jeblair | so i'm wondering if we can just "sudo install_modules.sh" in test.sh... | 17:26 |
*** praneshp has joined #openstack-infra | 17:26 | |
mordred | jeblair: don't see why not | 17:26 |
fungi | as a first step before all the applies | 17:26 |
jeblair | will do | 17:26 |
fungi | seems like a reasonable addition. should be self-testing too | 17:26 |
mordred | ++ | 17:27 |
*** msabramo has quit IRC | 17:27 | |
fungi | mordred: the select-mirror removal patch breakout has now turned into a three-patch series because i couldn't think of a safe way to do it in two | 17:27 |
*** dhellmann_ is now known as dhellmann | 17:27 | |
dhellmann | clarkb: the "fix" of renaming the existing libs was deemed too onerous after we found how to not trigger the problem | 17:28 |
dhellmann | clarkb: I probably do need to write this up for posterity, when I have time | 17:28 |
openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Run install_modules.sh in puppet apply test https://review.openstack.org/106114 | 17:28 |
jeblair | krotscheck, mordred, fungi: ^ | 17:29 |
fungi | already dying! https://jenkins07.openstack.org/job/gate-config-puppet-apply-centos6/35/console | 17:30 |
*** harlowja has quit IRC | 17:30 | |
fungi | Error: Could not install module 'puppetlabs-stdlib' (v3.2.0); Module 'puppetlabs-stdlib' (v4.2.2) is already installed; Use `puppet module upgrade` to install a different version; Use `puppet module install --force` to re-install only this module | 17:30 |
*** harlowja has joined #openstack-infra | 17:30 | |
*** habib has quit IRC | 17:30 | |
jeblair | what's with the stuff after that? | 17:31 |
fungi | a mystery | 17:31 |
*** shivharis has joined #openstack-infra | 17:31 | |
fungi | hm, and also, that job succeeded anyway | 17:31 |
jeblair | oh, there are git commands in install_modules | 17:31 |
fungi | mildly troubling on its own | 17:31 |
jeblair | fungi: install_modules doesn't errexit | 17:32 |
*** adrian_otto has joined #openstack-infra | 17:32 | |
openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Run install_modules.sh in puppet apply test https://review.openstack.org/106114 | 17:32 |
jeblair | switching to -x so we can see what's going on | 17:32 |
shivharis | fungi: hi, whom should i contact for issues wrt gerrit triggers - i.e. some ci's are not being sent triggers | 17:33 |
*** jedimike has quit IRC | 17:33 | |
*** markmcclain has joined #openstack-infra | 17:33 | |
mordred | I believe we expect for some of the dependencies to be violated | 17:33 |
mordred | s/I believe// | 17:33 |
*** msabramo has joined #openstack-infra | 17:34 | |
mordred | which is one of the reasons we were working towards doing all git commands and not using puppet module install - because the dependencies go bad | 17:34 |
dhellmann | mordred: requirements update checks are still failing for oslo alphas because the integration script in pbr is doing some steps I think we can skip. http://logs.openstack.org/36/103536/2/check/check-requirements-integration-dsvm/52291e0/console.html#_2014-07-09_18_57_18_749 | 17:34 |
*** gyee has joined #openstack-infra | 17:34 | |
*** emagana has joined #openstack-infra | 17:34 | |
jeblair | the git commands in that script don't look correct | 17:35 |
dhellmann | mordred: how much of that "build the mirror" stuff do we need to be doing there, do you think? is it enough to just test install the packages and not compare the requirements lists? do we need a mirror for that? | 17:35 |
adrian_otto | Guys, my understanding is that Gerrit offers a very simple event stream API that allows you to make an SSH connection to it, and get a feed of events on that connection. Who can I ask for access to that so we can put some async CI automation on it? I'm happy to elaborate on the use case if that's interesting, but I'm most interested in who to give our SSH public key to (in the form of a pull request?) and what access controls if any might need to | 17:35 |
fungi | shivharis: not really sure what you're asking. you can test the account with 'ssh -p 29418 username@review.example.com gerrit stream-events' | 17:35 |
fungi | adrian_otto: http://ci.openstack.org/third_party.html | 17:35 |
adrian_otto | fungi: awesomesauce! | 17:36 |
*** crc32 has joined #openstack-infra | 17:36 | |
fungi | shivharis: either you get the event stream or you don't. gerrit itself doesn't know anything about "triggers" there, it just sends you events, what your system does with the json stream to trigger actions on events in it is up to you | 17:36 |
mordred | dhellmann: sorry - I keep meaning to rewrite that script real quick | 17:37 |
mordred | we need to do almost noen of that | 17:37 |
jeblair | krotscheck: try rebasing your change on https://review.openstack.org/106114 and see if it gets the new module | 17:37 |
dhellmann | mordred: I'm looking at it, but don't have the history so I'm not sure of the changes I'm making. | 17:37 |
openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Run install_modules.sh in puppet apply test https://review.openstack.org/106114 | 17:38 |
dhellmann | mordred: so maybe just keep the loop on line 224, and whatever above that is needed for support? | 17:38 |
shivharis | fungi: Thanks, I'll debug a bit more and then get back. | 17:38 |
*** arnaud has quit IRC | 17:38 | |
*** rcarrillocruz has quit IRC | 17:40 | |
anteaya | mtreinish: it just crossed my mind, I'm fine if openstack-merges channel doesn't know about it | 17:40 |
*** dstanek_zzz is now known as dstanek | 17:40 | |
*** Guest49060 has joined #openstack-infra | 17:40 | |
Guest49060 | تحذير | 17:40 |
Guest49060 | warning | 17:40 |
Guest49060 | you may be watched | 17:40 |
Guest49060 | do usa&israel use the internet(facebook,youtube,twitter, chat rooms ..ect)to spy?? | 17:40 |
Guest49060 | do usa&israel use the internet 2 collect informations,,can we call that spying?? | 17:40 |
*** Guest49060 has quit IRC | 17:40 | |
*** Guest49060 has joined #openstack-infra | 17:40 | |
*** Guest49060 has left #openstack-infra | 17:41 | |
anteaya | jeblair: ^^ one for you | 17:41 |
*** jedimike has joined #openstack-infra | 17:42 | |
*** rcarrillocruz has joined #openstack-infra | 17:42 | |
fungi | i added them to chanserv's akick list | 17:44 |
fungi | jeblair: yeah, it looks like the git commands there are leaving out an action verb | 17:44 |
fungi | oh, wait, they do rev-list HEAD | 17:45 |
fungi | looks like it should be --max-count=1 not --max-count 1 | 17:46 |
*** gpilz has joined #openstack-infra | 17:46 | |
*** shashankhegde has quit IRC | 17:46 | |
openstackgerrit | K Jonathan Harker proposed a change to openstack-infra/jeepyb: Allow for the newbie message to live in its own file https://review.openstack.org/105930 | 17:46 |
fungi | though i do like that our spammer visitor managed to get in a plug for internet 2 | 17:47 |
openstackgerrit | K Jonathan Harker proposed a change to openstack-infra/jeepyb: Allow for the newbie message to live in its own file https://review.openstack.org/105930 | 17:47 |
*** msabramo has quit IRC | 17:49 | |
*** eharney has quit IRC | 17:49 | |
openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/config: Modularized StoryBoard Module https://review.openstack.org/98007 | 17:49 |
zaro | clarkb, wenlock : fixed python-jenkins installation of requirements: https://review.openstack.org/#/c/106119 AND https://review.openstack.org/#/c/106121 | 17:49 |
*** Alexei_987 has joined #openstack-infra | 17:50 | |
*** _nadya_ has joined #openstack-infra | 17:51 | |
wenlock | zaro, awesome, checking now | 17:52 |
openstackgerrit | Doug Hellmann proposed a change to openstack-dev/pbr: Remove mirror testing from the integration script https://review.openstack.org/106125 | 17:53 |
dhellmann | mordred: ^^ | 17:53 |
*** shashankhegde has joined #openstack-infra | 17:53 | |
clarkb | zaro you import os but dont use it? | 17:54 |
*** maxbit has joined #openstack-infra | 17:54 | |
krotscheck | Are trusty build nodes a thing? I want to see if I can build storyboard without nodeenv :) | 17:54 |
mordred | krotscheck: yup! | 17:55 |
krotscheck | mordred: Sweeeeeeet | 17:55 |
*** dstanek is now known as dstanek_zzz | 17:55 | |
*** eharney has joined #openstack-infra | 17:55 | |
mordred | dhellmann: we'll need to do something to properly test pbr - but we can come back to that | 17:56 |
*** dstanek_zzz is now known as dstanek | 17:57 | |
*** msabramo has joined #openstack-infra | 17:58 | |
afazekas | clarkb: is the 'devstack-precise-2-node' used by anyone ? can it be replaced with trusty ? | 17:58 |
clarkb | afazekas: I think it can be replaced | 17:58 |
zaro | wenlock, clarkb :fixed now | 17:59 |
mordred | dhellmann: two niggles - but otherwise awesome | 17:59 |
*** nati_ueno has joined #openstack-infra | 18:01 | |
wenlock | zaro, woot | 18:01 |
wenlock | ty | 18:02 |
krotscheck | jeblair: Looks like that fix of yours worked! | 18:03 |
jeblair | neato! | 18:04 |
*** annegentl_ has joined #openstack-infra | 18:04 | |
nibalizer | jeblair: so to follow up from tuesday's meeting, i do think the p3 master is ready to be fired up, and I can be around to help with that today | 18:05 |
openstackgerrit | afazekas proposed a change to openstack-infra/config: Add 2 node experimental job to d-g https://review.openstack.org/105534 | 18:05 |
*** annegentl_ has quit IRC | 18:06 | |
jeblair | nibalizer: cool, let's try to catch up on that after lunch | 18:06 |
fungi | given we use other non-puppetlabs modules, i suppose as long as example42-puppi passes a cursory sanity (license, security) review there should be no serious concerns? | 18:06 |
fungi | krotscheck: ^ | 18:06 |
fungi | seems to be apache-2 licensed | 18:07 |
krotscheck | That’s what my thought was. mordred has an opinion as well. | 18:07 |
*** _nadya_ has quit IRC | 18:08 | |
nibalizer | ya alessandro(example42) knows what he is doing | 18:08 |
openstackgerrit | Doug Hellmann proposed a change to openstack-dev/pbr: Remove mirror testing from the integration script https://review.openstack.org/106125 | 18:08 |
krotscheck | Really, the critical feature there is the “Hey go get me a tarball” implementation. | 18:08 |
* mordred agrees | 18:08 | |
fungi | puppi make me a sandwich? | 18:08 |
mordred | I also did a pass one night at looking at using it for our other places that do that | 18:08 |
mordred | it's not urgent, but when we land this, I think it's not a terrible idea to use it across teh board | 18:08 |
fungi | mordred: groups, openstackid, where else? | 18:09 |
dhellmann | mordred: ^^ addresses your comments | 18:09 |
fungi | oh, i guess for other things not implemented here too | 18:09 |
nibalizer | i'm haarstarstwhat does puppi do? i'm having a hard time groking the readme | 18:09 |
nibalizer | sssssss arst | 18:09 |
nibalizer | go ssh lag go-go | 18:10 |
*** Sukhdev has joined #openstack-infra | 18:12 | |
krotscheck | nibalizer: It’s a toolkit. I’m using one of the submodules called “netinstall” that allows you to go get a tarball from elsewhere, in a stateful way. | 18:12 |
clarkb | afazekas looks good. it just occured to me we need to select the node in zuul layout.yaml while we transition to trusty | 18:12 |
nibalizer | oh nice | 18:12 |
krotscheck | nibalizer: Example, for a while I had my own jenkins build use puppi:netinstall to downoad jenkins-latest and then bounce tomcat. Worked really well except that sometimes tomcat didn’t clean itself up. | 18:13 |
clarkb | afazekas: sorry I forgot that but otherwise looks good | 18:13 |
nibalizer | i think there is some code somewhere in our repo where we do a pretty ugly curl -z on the unless parameter to an exec | 18:13 |
krotscheck | nibalizer: There is, in storyboard. | 18:13 |
krotscheck | nibalizer: I think we use wget for that though | 18:13 |
nibalizer | wel lyea im all for it, can you link the review i can +1 stuff | 18:13 |
nibalizer | or is this that monster patch you have in to totally redo storyboard? | 18:14 |
krotscheck | nibalizer: https://review.openstack.org/#/c/98007/ | 18:14 |
krotscheck | nibalizer: Urrr… yeah. | 18:14 |
krotscheck | :D | 18:14 |
nibalizer | :D | 18:14 |
*** zz_gondoi is now known as gondoi | 18:14 | |
mordred | dhellmann: almost perfect - except you spelled openstack opensatck :) | 18:16 |
mordred | dhellmann: but thank you | 18:16 |
dhellmann | mordred: ugh | 18:16 |
* fungi opens a sack of openstack | 18:16 | |
*** andreaf has joined #openstack-infra | 18:17 | |
* krotscheck is learning the hard way that having large patches is a recipe for not getting my code landed. | 18:17 | |
openstackgerrit | Doug Hellmann proposed a change to openstack-dev/pbr: Remove mirror testing from the integration script https://review.openstack.org/106125 | 18:17 |
dhellmann | mordred: ^^ third time's the charm? | 18:18 |
openstackgerrit | James E. Blair proposed a change to openstack-infra/config: Add CI results table to Gerrit https://review.openstack.org/105860 | 18:18 |
fungi | krotscheck: it's a lesson you only have to learn once | 18:18 |
*** gondoi is now known as zz_gondoi | 18:18 | |
*** ociuhandu has quit IRC | 18:19 | |
krotscheck | fungi: Yeah, well, it’s a thing I sometimes can’t do anything about. Landing a feature in StoryBoard like Project Group admin usually is meningless unless all admin functions are there. | 18:19 |
nibalizer | krotscheck: my first time i put up a patch i put up a 12k line change | 18:19 |
krotscheck | fungi: It doesn’t help that people are allergic to javascript around here ;) | 18:19 |
*** tkelsey has quit IRC | 18:19 | |
krotscheck | nibalizer: Ok, you win. | 18:19 |
nibalizer | anteaya: was all 'yea.... no....' | 18:19 |
fungi | nibalizer: you serve as a good warning to others ;) | 18:20 |
jeblair | krotscheck: is your patch ready? | 18:20 |
*** salv-orlando has quit IRC | 18:20 | |
jeblair | sdague: final version of ci table on review dev and in https://review.openstack.org/105860 | 18:20 |
krotscheck | jeblair: Incorporated all your comments from a while ago, plus some rebase bugs that have come up since, yes. | 18:20 |
*** mwagner_lap has quit IRC | 18:21 | |
openstackgerrit | afazekas proposed a change to openstack-infra/config: Add 2 node experimental job to d-g https://review.openstack.org/105534 | 18:21 |
afazekas | clarkb: ^ | 18:21 |
mordred | dhellmann: looks good! | 18:22 |
dhellmann | mordred: cool, thanks for the assist | 18:22 |
mordred | dhellmann: thank YOU | 18:22 |
openstackgerrit | Cedric Brandily proposed a change to openstack-infra/git-review: Disable ssh/scp password authentication during tests https://review.openstack.org/97025 | 18:22 |
fungi | mordred: dhellmann: see my -1 on 106125 but i'm probably just missing something | 18:23 |
*** blitz has joined #openstack-infra | 18:23 | |
*** sabeen has joined #openstack-infra | 18:24 | |
Ajaeger | fungi, jeblair, clarkb: Is there a chance to get my translation jobs in this week, please? My two top ones are: https://review.openstack.org/98238 https://review.openstack.org/105372 - and then there's 82384, 96132 and 105448 | 18:24 |
*** ihrachyshka has quit IRC | 18:24 | |
dhellmann | fungi: if puppet is configuring those, I'm happy to remove them. Running that script as it is now borked my dev box. :-) | 18:25 |
mordred | fungi: oh - you're right | 18:25 |
blitz | does anyone know if the gate is fixed? seem to be running into this https://bugs.launchpad.net/bugs/1338841 | 18:25 |
uvirtbot | Launchpad bug 1338841 in devstack "asynchronous connection failed in postgresql jobs" [Undecided,In progress] | 18:25 |
*** msabramo has quit IRC | 18:25 | |
dhellmann | fungi: both config files? | 18:25 |
dhellmann | fungi: and does it set the log file up? I don't know if the rest of the job is expecting that log file name | 18:25 |
fungi | dhellmann: yep as far as both files http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/manifests/slave_common.pp#n28 | 18:26 |
*** che-arne has quit IRC | 18:26 | |
fungi | dhellmann: checking on the logging, but it would probably make sense for us to just set pip logging common across all our workers anyway... checking now | 18:26 |
*** melwitt has joined #openstack-infra | 18:26 | |
*** jcoufal-mobile has joined #openstack-infra | 18:27 | |
fungi | dhellmann: yeah, so you could either append it the pip.conf or update http://git.openstack.org/cgit/openstack-infra/config/tree/modules/openstack_project/files/pip.conf | 18:27 |
*** msabramo has joined #openstack-infra | 18:28 | |
dhellmann | fungi: I'll do the latter, thanks for catching that | 18:28 |
fungi | mordred: pip normally just logs to ~/.pip/pip.log right? why were we moving it in that script? | 18:29 |
*** shivharis has quit IRC | 18:29 | |
openstackgerrit | Doug Hellmann proposed a change to openstack-dev/pbr: Remove mirror testing from the integration script https://review.openstack.org/106125 | 18:29 |
fungi | mordred: maybe the job should just collect it from the normal location? | 18:29 |
openstackgerrit | Doug Hellmann proposed a change to openstack-dev/pbr: Remove mirror testing from the integration script https://review.openstack.org/106125 | 18:30 |
*** jcoufal-mobile has quit IRC | 18:30 | |
*** andreaf has quit IRC | 18:31 | |
krotscheck | Hrm, this trusty thing seems to be working.... | 18:31 |
*** arnaud has joined #openstack-infra | 18:31 | |
*** jedimike has quit IRC | 18:31 | |
*** annegent_ has joined #openstack-infra | 18:32 | |
*** marcoemorais has quit IRC | 18:32 | |
*** marcoemorais has joined #openstack-infra | 18:33 | |
*** bknudson has joined #openstack-infra | 18:33 | |
*** marcoemorais has quit IRC | 18:33 | |
*** marcoemorais has joined #openstack-infra | 18:33 | |
*** marcoemorais has quit IRC | 18:34 | |
fungi | mordred: dhellmann: i'm wondering if we can't just leave out the change to the log location there entirely. i see no indication that the script does anything with the logfile afterward, nor does the job collect/publish it | 18:34 |
*** marcoemorais has joined #openstack-infra | 18:34 | |
fungi | so that line may just be cruft | 18:34 |
krotscheck | the place to add a new jenkins node dependency is in jenkins_params, yes? | 18:35 |
*** mfink has joined #openstack-infra | 18:35 | |
*** emagana has quit IRC | 18:36 | |
fungi | krotscheck: well, there and then the slave.pp | 18:36 |
dhellmann | fungi: my latest patch does that, so we'll see if it breaks | 18:37 |
*** jswarren_ has joined #openstack-infra | 18:37 | |
*** emagana has joined #openstack-infra | 18:37 | |
*** rlandy has quit IRC | 18:37 | |
krotscheck | fungi: Thanks. Is there a convention for installing things on one OS but not another? RHEL for instance doesn’t have a recent node package. | 18:37 |
dhellmann | fungi, mordred : I wonder if this job name needs to change now, too, since it's not doing requirements integration testing so much as making sure pbr can install things | 18:37 |
fungi | krotscheck: the params.pp file is for specifying distribution-specific package names, then the slave.pp actually installs the packages by a variable name based on what's in params.pp for the target platform | 18:37 |
*** bknudson has quit IRC | 18:37 | |
fungi | krotscheck: yeah, stick a placeholder comment in the missing location for the other platform, and then in the slave.pp you'll find a conditional block in which to insert the variable for your package | 18:38 |
krotscheck | fungi: Thanks! Ignore my previous question, I’ll read the manifest and figure it out. | 18:38 |
fungi | dhellmann: perhaps. i believe i renamed it when we started using it for per-branch requirements integration testing, so likely it could be named back to whatever the old pbr-specific name used to be | 18:39 |
annegent_ | IRC question, how do I set the topic in the #openstack-doc channel? Apparently I am not a channel operator | 18:40 |
jeblair | annegent_: we make you an op :) | 18:41 |
*** jswarren has quit IRC | 18:41 | |
*** jswarren_ is now known as jswarren | 18:41 | |
*** emagana has quit IRC | 18:41 | |
*** mwagner_lap has joined #openstack-infra | 18:41 | |
annegent_ | jeblair: sweet | 18:41 |
annegent_ | jeblair: oh shoot let me get on a network where I can be me, annegentle, tho | 18:42 |
jeblair | annegent_: yeah, it requires authentication to nickserv | 18:42 |
annegent_ | jeblair: ok got it | 18:42 |
annegent_ | jeblair: I'll ping you in a bit, is that ok? | 18:42 |
jeblair | annegent_: yup | 18:43 |
*** masayukig has quit IRC | 18:45 | |
*** blitz has quit IRC | 18:46 | |
*** jedimike has joined #openstack-infra | 18:47 | |
anteaya | can I see what it looks like if we have more than one ci system comment/verify a patch? https://review-dev.openstack.org/#/c/5269/ | 18:50 |
anteaya | oh and yay! | 18:50 |
*** masayukig has joined #openstack-infra | 18:51 | |
*** marcoemorais has quit IRC | 18:51 | |
openstackgerrit | Doug Hellmann proposed a change to openstack-infra/config: Rename requirements-integration job https://review.openstack.org/106137 | 18:52 |
dhellmann | fungi: ^^ | 18:52 |
*** mkoderer has quit IRC | 18:52 | |
*** maxbit has quit IRC | 18:53 | |
*** maxbit has joined #openstack-infra | 18:53 | |
*** ihrachyshka has joined #openstack-infra | 18:55 | |
dhellmann | fungi, mordred : hmm, do we have another job that tries to install all of our requirements together into one virtualenv or something to make sure there are not conflicting dependencies from somewhere? | 18:55 |
krotscheck | fungi: Are all of our jenkins ubuntu nodes now trusty, or should I add a special exception? | 18:55 |
*** bknudson has joined #openstack-infra | 18:56 | |
dhellmann | fungi, mordred : duh, nevermind, the normal devstack-gate job would do that | 18:56 |
*** maxbit has quit IRC | 18:57 | |
krotscheck | ffff.f…. I swear, sometimes the most annoying thing about the javascript world is how fast they update their things. | 18:57 |
*** ihrachyshka has quit IRC | 18:57 | |
*** shayneburgess has quit IRC | 18:58 | |
*** maxbit has joined #openstack-infra | 18:58 | |
*** marcoemorais has joined #openstack-infra | 18:59 | |
asettle | lunch! | 19:00 |
*** hashar has joined #openstack-infra | 19:00 | |
*** emagana has joined #openstack-infra | 19:01 | |
openstackgerrit | Radoslav Gerganov proposed a change to openstack-infra/config: Add button that shows/hides CI comments in Gerrit https://review.openstack.org/95743 | 19:03 |
openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/config: Added NodeJS and NPM to jenkins node https://review.openstack.org/106139 | 19:03 |
krotscheck | And with that, lunch! | 19:03 |
*** bdpayne has quit IRC | 19:04 | |
fungi | dhellmann: granted, we don't actually try to coinstall everything listed in global-requirements.txt, we just normalize all the project requirements to match lines in that file, so there could in theory be things in that file we don't try to install together in devstack | 19:04 |
*** _nadya_ has joined #openstack-infra | 19:05 | |
*** bdpayne has joined #openstack-infra | 19:05 | |
fungi | krotscheck: i believe the only things we're still running on precise are things which run on long-running workers (instead of nodepool managed single-use workers) and py33/pypy jobs | 19:05 |
dhellmann | fungi: I don't think the changes I'm making change that situation. It was just building the mirror from the global requirements, then trying to install each package in the project list | 19:06 |
fungi | though there might be some we haven't gotten to switching yet which fell through the cracks | 19:06 |
*** primeministerp has quit IRC | 19:06 | |
fungi | dhellmann: yep, probably ~= from our perspective | 19:06 |
*** primeministerp has joined #openstack-infra | 19:07 | |
dhellmann | fungi: yeah | 19:07 |
*** eharney has quit IRC | 19:08 | |
*** _nadya_ has quit IRC | 19:10 | |
openstackgerrit | Christian Berendt proposed a change to openstack-infra/gerritbot: replace dict.iteritems() with six.iteritems(dict) https://review.openstack.org/95727 | 19:16 |
*** andreykurilin_ has joined #openstack-infra | 19:18 | |
*** otherwiseguy has quit IRC | 19:19 | |
*** terryw has joined #openstack-infra | 19:19 | |
*** shashankhegde has quit IRC | 19:20 | |
*** e0ne has joined #openstack-infra | 19:21 | |
krotscheck | fungi: I’m guessing apply-precise should be updated to apply-trusty then? | 19:21 |
jeblair | krotscheck: all of our long-running servers are on precise at the moment; we don't have any servers running trusty | 19:21 |
jeblair | krotscheck: once we have one, we'll add an apply-trusty job, and when we have zero on precise, we'll drop apply-precise | 19:22 |
krotscheck | jeblair: Gotcha. The jenkins slaves are trusty though? | 19:22 |
*** dstufft|laptop has joined #openstack-infra | 19:23 | |
jeblair | krotscheck: both | 19:23 |
krotscheck | jeblair: Aha! So I _do_ need to special case trusty. | 19:23 |
jeblair | krotscheck: it's a project by project (or job by job) move from precise to trusty | 19:23 |
jeblair | krotscheck: most of openstack is on trusty now, i'm not certain of overall progress. we'll be keeping precise around for as long as we're supporting icehouse though | 19:24 |
jeblair | krotscheck: so yeah, both need to continue to work for the forseeable future | 19:24 |
*** chandankumar has quit IRC | 19:25 | |
*** e0ne has quit IRC | 19:25 | |
fungi | which, if pledges for assistance in the last summit's stable maintenance session are to be believed, will be ~this time next year when icehouse gets eol'd | 19:26 |
fungi | (15 months from when it was released) | 19:26 |
annegentle | jeblair: ping as me | 19:26 |
fungi | though if it begins falling apart sooner and nobody steps up to help fix it, possibly much sooner | 19:26 |
jeblair | krotscheck: btw, i'm context-free on this -- what's this in service of? | 19:27 |
*** e0ne has joined #openstack-infra | 19:28 | |
mordred | jeblair: he's investigating being able to do the storyboard stuff without nodeenv since the stuff in trusty is potentially new enough I believe | 19:29 |
krotscheck | jeblair: The JS builds use a package called nodeenv, which downloads nodejs and npm and compiles them from source during the build. Turns out that with trusty that’s not necessary anymore, so I’m adding that to our jenkins nodes. | 19:29 |
krotscheck | What mordred said | 19:29 |
mordred | whee! I got it right | 19:29 |
*** thedodd has quit IRC | 19:29 | |
*** annegent_ has quit IRC | 19:30 | |
sdague | so we're still bouncing on 105854,3 not being merged yet | 19:30 |
*** crc32 has quit IRC | 19:30 | |
*** flaper87|afk is now known as flaper87 | 19:30 | |
sdague | if promote is still dead, can we just merge that? | 19:30 |
fungi | though it is back in the gate, with only foud changes which need to fail out ahead of it | 19:30 |
jeblair | annegentle: you should now be able to set the topic on #openstack-doc; best way to do that is probably to '/msg chanserv topic #openstack-doc topic goes here' | 19:30 |
fungi | s/foud/four/ | 19:30 |
annegentle | awesome jeblair! Giving it a try | 19:30 |
*** pcm_ has quit IRC | 19:31 | |
sdague | fungi: right, but each is going to fail and reset | 19:31 |
*** yfried__ has quit IRC | 19:31 | |
*** jpich has joined #openstack-infra | 19:31 | |
sdague | so it's 4 hrs | 19:31 |
jeblair | annegentle: you can also '/msg chanserv op ...' to make yourself an op... '/msg chanserv help' for all the gory details | 19:31 |
sdague | we're at a 75% failure rate on pg right now | 19:31 |
*** jedimike has quit IRC | 19:31 | |
fungi | it's increased? thought it was 50% earlier today | 19:31 |
sdague | http://jogo.github.io/gate/ | 19:31 |
krotscheck | mordred jeblair: Speaking of which, I’m seeing a thick_slave and a slave… if I really only care about npm on storyboard build nodes, should I use thick_slave? | 19:31 |
sdague | it is *very* bad | 19:31 |
krotscheck | ‘cause I know not everyone will want that. | 19:31 |
*** terryw is now known as otherwiseguy | 19:32 | |
mordred | krotscheck: actually, why not start with adding "sudo apt-get install npm" as the first step in the job | 19:32 |
*** thedodd has joined #openstack-infra | 19:32 | |
krotscheck | mordred: Because that would be easy and make sense. | 19:33 |
morganfainberg | mordred, dhellmann, sdague, anteaya, any advice on the best ML / place to send out a "hey we released keystonemiddleware, packagers, deployers, expect to need it soon™" ? | 19:33 |
*** arnaud has quit IRC | 19:34 | |
Ajaeger | morganfainberg: blog about it and ask reed to add it to his weekly newsletter. If it's a release, why not send to -announce? | 19:35 |
morganfainberg | Ajaeger, that was what i was looking for :) | 19:36 |
morganfainberg | Ajaeger, and my blog broke :( or i would blog about it. | 19:36 |
morganfainberg | Ajaeger, need to fix it before I can blog things :P | 19:37 |
zaro | jeblair: any idea why this issue occurs? https://bugs.launchpad.net/openstack-ci/+bug/1340360 | 19:38 |
uvirtbot | Launchpad bug 1340360 in openstack-ci "Gerrty fails to start on MAC" [Undecided,New] | 19:38 |
mordred | krotscheck: jeblair and I were discussing reducing the amount of slave types by taking advantage of the sudo features on the nodes | 19:38 |
mordred | krotscheck: and in doing pre-download caching of more things during image build | 19:38 |
mordred | so that we're not necessarily downloading on every job | 19:38 |
*** duran has quit IRC | 19:39 | |
sdague | fungi: so we're currently at 11 merges for the whole day right now. Which is basically an OpenStack Summit merge level, because of needing that patch. | 19:40 |
fungi | sdague: i would love to get some consensus from jeblair, mordred, clarkb or really any other infra core reviewers before unilaterally deciding to just bypass gating for that change | 19:40 |
sdague | we've known the fix for 24 hrs, and the system isn't working to get it in. Which is frustrating. | 19:41 |
fungi | jeblair: digging into the changes needed for fixing promote and enqueue, since those are just adding requests to gearman we need some special way to tag those requests so they can be treated differently from normal injection? | 19:41 |
sdague | ok, that's infe | 19:41 |
sdague | fine | 19:41 |
krotscheck | mordred: I think in this case the performance hangup is the 8 minute compile time of node, so the download cache isn’t actually the biggest hangup. Or maybe I’m not understanding you right? | 19:42 |
reed | morganfainberg, general mlist, cc openstack-dev and I'll add it to the weekly newsletter | 19:42 |
jeblair | fungi: no i think the change is in handling the request. i'm planning on hacking on that in a bit. | 19:42 |
reed | morganfainberg, what's keystonmiddleware btw? | 19:42 |
fungi | jeblair: oh, okay. still trying to trace the path of the cli requests through the rpc client implementation | 19:43 |
fungi | it's been a good learning experience | 19:43 |
*** pcrews has quit IRC | 19:44 | |
mordred | krotscheck: no, you're right. the download cache is purely a next step in the future to make it even better | 19:44 |
*** tsg has quit IRC | 19:45 | |
*** zz_gondoi is now known as gondoi | 19:45 | |
*** tsg has joined #openstack-infra | 19:47 | |
openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/config: Added NodeJS and NPM to javascript build https://review.openstack.org/106152 | 19:48 |
krotscheck | mordred: Is this what you had in mind ^^? | 19:48 |
*** sballe has quit IRC | 19:49 | |
sdague | clarkb / jeblair / mordred: we've largely prevented anyone from landing code for integrated projects for 24hrs. I fear we're going to do this for another at least 6 hrs. And we have a 3 line patch that fixes it. It doesn't seem like it should be that contentious to merge that patch. :( | 19:49 |
mordred | krotscheck: looks great! | 19:50 |
*** maxbit_ has joined #openstack-infra | 19:50 | |
mordred | sdague: sorry - I've been in a week of day long meetings- link to patch? | 19:50 |
*** e0ne has quit IRC | 19:50 | |
sdague | https://review.openstack.org/#/c/105854/ | 19:51 |
*** hashar is now known as hasharAccounting | 19:51 | |
*** pcrews has joined #openstack-infra | 19:51 | |
*** shashankhegde has joined #openstack-infra | 19:52 | |
*** zhiyan_ is now known as zhiyan | 19:52 | |
krotscheck | phschwartz: This’ll imact you as well - https://review.openstack.org/106152 | 19:52 |
*** gpilz1 has joined #openstack-infra | 19:53 | |
*** emagana has quit IRC | 19:53 | |
*** maxbit has quit IRC | 19:54 | |
*** yfried__ has joined #openstack-infra | 19:54 | |
*** emagana has joined #openstack-infra | 19:54 | |
*** sballe has joined #openstack-infra | 19:55 | |
*** ominakov has joined #openstack-infra | 19:56 | |
*** gpilz has quit IRC | 19:57 | |
*** emagana_ has joined #openstack-infra | 19:57 | |
*** arnaud has joined #openstack-infra | 19:57 | |
*** emagana has quit IRC | 19:57 | |
*** ominakov has quit IRC | 20:00 | |
*** datsun180b has quit IRC | 20:01 | |
*** marcoemorais has quit IRC | 20:03 | |
*** bknudson has quit IRC | 20:04 | |
*** Evgeny has quit IRC | 20:05 | |
*** bknudson has joined #openstack-infra | 20:06 | |
*** marcoemorais has joined #openstack-infra | 20:09 | |
*** emagana_ has quit IRC | 20:09 | |
*** emagana has joined #openstack-infra | 20:09 | |
*** Sukhdev has quit IRC | 20:12 | |
*** dstufft|laptop has quit IRC | 20:12 | |
*** emagana has quit IRC | 20:14 | |
openstackgerrit | Vitaliy Lotorev proposed a change to openstack-infra/jenkins-job-builder: add logfilesize plugin support (doc,tests) https://review.openstack.org/103372 | 20:15 |
*** bknudson has quit IRC | 20:17 | |
fungi | sdague: looks like 105854,3 is about to merge now | 20:19 |
*** jswarren has quit IRC | 20:19 | |
*** duran has joined #openstack-infra | 20:20 | |
*** msabramo has quit IRC | 20:21 | |
Ajaeger | fungi, jeblair, clarkb: Is there a chance to get my translation jobs in this week, please? Sorry for being impatient... | 20:22 |
*** adalbas has quit IRC | 20:22 | |
Ajaeger | My two top ones are: https://review.openstack.org/98238 https://review.openstack.org/105372 - and then there's 82384, 96132 and 105448. | 20:22 |
Ajaeger | We already have first translations in transifex for e.g. barbican, climate and marconi. | 20:23 |
*** ociuhandu has joined #openstack-infra | 20:26 | |
*** bknudson has joined #openstack-infra | 20:26 | |
*** Guest58876 has quit IRC | 20:26 | |
*** chianingwang has joined #openstack-infra | 20:26 | |
*** pcm_ has joined #openstack-infra | 20:27 | |
*** emagana has joined #openstack-infra | 20:27 | |
openstackgerrit | A change was merged to openstack-infra/config: Make /var/run/puppet in apply test https://review.openstack.org/105916 | 20:28 |
openstackgerrit | Spencer Krum proposed a change to openstack-infra/config: Bump the apt module version from 1.1 to 1.4 https://review.openstack.org/102739 | 20:29 |
*** julim_ has quit IRC | 20:30 | |
*** blamar has quit IRC | 20:30 | |
openstackgerrit | James E. Blair proposed a change to openstack-infra/zuul: Cause the promote command to ignore pipeline reqs https://review.openstack.org/106161 | 20:30 |
openstackgerrit | James E. Blair proposed a change to openstack-infra/zuul: Cause the enqueue command to ignore pipeline reqs https://review.openstack.org/106162 | 20:30 |
*** bknudson has quit IRC | 20:30 | |
jeblair | sdague, fungi: ^ | 20:31 |
fungi | Ajaeger: quick question inline on 98238 | 20:31 |
fungi | Ajaeger: otherwise lgtm | 20:31 |
fungi | oh, so it was the call to addChange() in _doPromoteEvent() i should have been looking at | 20:33 |
fungi | gah | 20:33 |
Ajaeger | fungi: good catch! | 20:34 |
openstackgerrit | Andreas Jaeger proposed a change to openstack-infra/config: Add various translation jobs https://review.openstack.org/98238 | 20:35 |
Ajaeger | fungi: rebased and remove the wrong line. | 20:35 |
Ajaeger | fungi: thanks! | 20:36 |
*** dstufft|laptop has joined #openstack-infra | 20:38 | |
fungi | Ajaeger: that refactoring patch reminds me, you're probably going to want to double check the stack starting at https://review.openstack.org/106107 for possible breakage to the translation scripts | 20:39 |
*** duran has quit IRC | 20:39 | |
fungi | since that's the only remaining place we're passing in project name to a slave script, i think | 20:39 |
Ajaeger | fungi: will review, ,thanks! | 20:40 |
*** pcm_ has quit IRC | 20:40 | |
*** dprince has quit IRC | 20:40 | |
*** maxbit__ has joined #openstack-infra | 20:40 | |
*** pcm_ has joined #openstack-infra | 20:40 | |
*** denis_makogon has joined #openstack-infra | 20:41 | |
anteaya | <-- helping neutron devs learn gerrit queries to maximize efficientcy on review time | 20:42 |
sdague | fungi: thanks! | 20:43 |
*** maxbit_ has quit IRC | 20:44 | |
*** bknudson has joined #openstack-infra | 20:47 | |
*** bknudson has left #openstack-infra | 20:47 | |
*** ociuhandu has quit IRC | 20:48 | |
*** mfink has quit IRC | 20:49 | |
*** dims has quit IRC | 20:49 | |
*** dims has joined #openstack-infra | 20:50 | |
*** salv-orlando has joined #openstack-infra | 20:50 | |
Ajaeger | fungi: That's a nice cleanup series! | 20:52 |
fungi | Ajaeger: mordred wrote most of it | 20:52 |
Ajaeger | Still nice ;) Thanks, mordred ! | 20:52 |
clarkb | ok I am almost mostly back again | 20:53 |
Ajaeger | fungi: Thanks for the approval and reviews! | 20:53 |
boris-42 | clarkb hi | 20:54 |
Ajaeger | clarkb: You're fully welcome! | 20:54 |
*** andreaf has joined #openstack-infra | 20:54 | |
openstackgerrit | A change was merged to openstack-infra/config: Add various translation jobs https://review.openstack.org/98238 | 20:54 |
* Ajaeger will monitor the new translation jobs the next days ;) | 20:55 | |
*** mwagner_lap has quit IRC | 20:56 | |
*** flaper87 is now known as flaper87|afk | 20:57 | |
* Ajaeger calls it a day and hopes for some more reviews for https://review.openstack.org/105372 - and also 82384, 96132 and 105448! Good night! | 20:57 | |
openstackgerrit | Clark Boylan proposed a change to openstack-infra/config: Add 2 node experimental job to d-g https://review.openstack.org/105534 | 20:57 |
clarkb | afazekas: ^ the node selection is a bit convoluted, so I went ahead and added what I think we need. I also think I should work harder on removing node specs from the JJB configs | 20:58 |
clarkb | at least then we will remember to go hit zuul first | 20:58 |
*** Ajaeger has quit IRC | 20:58 | |
*** denis_makogon_ has joined #openstack-infra | 21:00 | |
*** msabramo has joined #openstack-infra | 21:01 | |
*** harlowja is now known as harlowja_away | 21:01 | |
*** mbacchi has quit IRC | 21:02 | |
*** shayneburgess has joined #openstack-infra | 21:03 | |
*** denis_makogon has quit IRC | 21:03 | |
*** denis_makogon_ is now known as denis_makogon | 21:03 | |
afazekas | clarkb: thx | 21:05 |
*** Sukhdev has joined #openstack-infra | 21:05 | |
*** aysyd has quit IRC | 21:05 | |
*** ociuhandu has joined #openstack-infra | 21:06 | |
*** ArxCruz has quit IRC | 21:06 | |
dhellmann | morganfainberg: I usually send to the -dev list. I know zul at least follows there. | 21:07 |
sdague | aiopcpu ? | 21:08 |
*** harlowja_away is now known as harlowja | 21:08 | |
clarkb | sdague: all in one something | 21:08 |
clarkb | afazekas: ^ can we make that clearer? maybe 2node? | 21:08 |
sdague | yeh, or multinode | 21:09 |
sdague | as that's what everyone's been calling it | 21:09 |
*** rkukura has quit IRC | 21:11 | |
*** sballe has quit IRC | 21:11 | |
openstackgerrit | Ben Nemec proposed a change to openstack-dev/hacking: Fix import check interaction with namespace modules https://review.openstack.org/106169 | 21:12 |
openstackgerrit | Ben Nemec proposed a change to openstack-dev/hacking: Relax H305 and H307 checks https://review.openstack.org/106170 | 21:12 |
afazekas | https://review.openstack.org/#/c/106043/1/devstack-vm-gate-wrap.sh,cm | 21:13 |
*** radez is now known as radez_g0n3 | 21:13 | |
afazekas | clarkb: I would like to give names based on the services distribution among the nodes | 21:14 |
*** ociuhandu has quit IRC | 21:14 | |
*** maxbit__ has quit IRC | 21:14 | |
*** atiwari has quit IRC | 21:15 | |
afazekas | clarkb: The d-g setup will be able to handle 1 special node and unlimited from the other (sub) at the first round | 21:15 |
*** mfer has quit IRC | 21:15 | |
*** ociuhandu has joined #openstack-infra | 21:16 | |
openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/config: Added NodeJS and NPM to javascript build https://review.openstack.org/106152 | 21:16 |
afazekas | the comment from 124 explains what the aiopcpu means, but the full logic is not there | 21:17 |
clarkb | sdague: ^ | 21:17 |
fungi | anagram for "cuppa i/o" | 21:18 |
sdague | afazekas: so I think it's going to remain confusing. What about multi and multi-compute | 21:19 |
sdague | I'm not sure what I understand controler + compute is | 21:19 |
*** rkukura has joined #openstack-infra | 21:19 | |
afazekas | sdague: controller type does not have compute service it has , but the others has compute but not api services | 21:20 |
clarkb | right I think we may be overthinking this | 21:21 |
sdague | yeh, I think this is more complicated than we want at this stage | 21:21 |
clarkb | if we just call it multinode or 2node etc we haven't baked in any expectations that may change | 21:21 |
sdague | we want 2 kinds of setup | 21:21 |
sdague | regular, and compute only | 21:21 |
afazekas | regular=aio | 21:22 |
afazekas | cpu = compute only (n-cpu,q-agt, celio agent) | 21:22 |
*** markwash has quit IRC | 21:22 | |
openstackgerrit | Steve Martinelli proposed a change to openstack-infra/config: Publish specs jobs for keystone-specs https://review.openstack.org/106100 | 21:23 |
*** tsg has quit IRC | 21:23 | |
*** SumitNaiksatam has quit IRC | 21:24 | |
openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/config: Added new javascript build targets https://review.openstack.org/106172 | 21:24 |
openstackgerrit | Ben Nemec proposed a change to openstack-dev/hacking: Relax H305 and H307 checks https://review.openstack.org/106170 | 21:25 |
openstackgerrit | Ben Nemec proposed a change to openstack-dev/hacking: Fix import check interaction with namespace modules https://review.openstack.org/106169 | 21:25 |
openstackgerrit | Steve Martinelli proposed a change to openstack-infra/config: Publish specs jobs for keystone-specs https://review.openstack.org/106100 | 21:25 |
*** dkliban is now known as dkliban_afk | 21:25 | |
*** zhiyan is now known as zhiyan_ | 21:26 | |
afazekas | '2node' name itself does not describes the roles of the 2 node | 21:26 |
clarkb | afazekas: right in this case I think it may be desired | 21:26 |
clarkb | afazekas: because I don't think we know yet what the roles will be | 21:26 |
*** hasharAccounting is now known as hashar | 21:27 | |
stevemar | jeblair, mind taking a look @ https://review.openstack.org/#/c/106100/ for the spec publishing... i'd appreciate any input :) | 21:27 |
*** denis_makogon has quit IRC | 21:27 | |
*** jcoufal has quit IRC | 21:27 | |
*** jpich has quit IRC | 21:28 | |
clarkb | ryanpetrello: for those new jobs, are these not tests that should just run in the normal pecan test suite? | 21:28 |
sdague | clarkb / afazekas is there a sketch of the direction this is headed, I'm reading through the patch series now | 21:29 |
afazekas | 'aio plus cpu' says the primary node supposed to be regular/aio setup, the other node(s) supposed to be compute/hypervisor style node | 21:29 |
sdague | I was a little surprised we didn't just generate the sub_node localrc on the master | 21:29 |
clarkb | sdague: well this change starts with adding a job | 21:30 |
clarkb | sdague: then we will add the features to devstack-gate where most of the iteration will happen | 21:30 |
sdague | clarkb: yeh, I mean the devstack-gate patch series | 21:30 |
sdague | I'm actually fine with the job, I think the naming is a little confusing, but we can fix that later | 21:31 |
sdague | let me go +1 that | 21:31 |
clarkb | cool | 21:31 |
*** marcoemorais has quit IRC | 21:32 | |
sdague | afazekas: it's not clear to me why - https://review.openstack.org/#/c/105150 is needed | 21:32 |
afazekas | sdague: I was also hesitant about what / whan and where to do.. | 21:32 |
*** marcoemorais has joined #openstack-infra | 21:32 | |
afazekas | sdague: If we lucky it works without that | 21:32 |
afazekas | The stack user runs the nova compute service | 21:32 |
sdague | so the way I kind of envisioned this.... | 21:32 |
afazekas | and he needs to ssh to the other nodes for migration | 21:33 |
*** marcoemorais has quit IRC | 21:33 | |
sdague | afazekas: right, but it doesn't matter, they don't talk nfs or something else that requires uid match | 21:33 |
*** marcoemorais has joined #openstack-infra | 21:33 | |
ryanpetrello | clark: they’re a bit more complicated than that | 21:33 |
sdague | so the way I envisioned this.... | 21:33 |
afazekas | sdague: I can remove that patch from the chain | 21:33 |
ryanpetrello | they actually rely on tox itself to create virtualenvs, like you would with your own sample project: https://github.com/stackforge/pecan/blob/master/tox.ini#L17 | 21:33 |
sdague | setup_localrc takes a 3rd arg | 21:33 |
clarkb | ryanpetrello: oh its using that nested stuff | 21:34 |
clarkb | ryanpetrello: gotcha | 21:34 |
sdague | takes a 3rd and 4th arg | 21:34 |
*** marcoemorais has quit IRC | 21:34 | |
sdague | which is a type, which gets passed to the feature-matrix | 21:34 |
sdague | and a file to write out to | 21:34 |
*** marcoemorais has joined #openstack-infra | 21:34 | |
sdague | so then if you are in multi node topology, you call that for compute localrc.compute | 21:35 |
*** mrda-away is now known as mrda | 21:35 | |
openstackgerrit | Jeremy Stanley proposed a change to openstack-infra/config: Git rev-list --max-count needs an = for assignment https://review.openstack.org/106174 | 21:35 |
*** jamielennox|away is now known as jamielennox | 21:36 | |
sdague | afazekas: also why do you think supporting n-net is challenging? | 21:37 |
afazekas | sdague: Which network-type do you think is usable with n-net ? | 21:38 |
sdague | whatever's default in devstack, I think dhcp flat | 21:38 |
afazekas | the matadata-api service and the dhcp both can be problematic | 21:39 |
afazekas | is all test vm on the same net ? | 21:39 |
afazekas | Isn't the host system also has these services ? | 21:39 |
sdague | afazekas: yeh, but nova multihost puts a dnsmasq with every n-net | 21:40 |
sdague | dnsmasq isn't on the main network | 21:40 |
sdague | it's just handing out to local computes | 21:40 |
sdague | and then rpc messages are going back and forth to keep the 2 in sync | 21:40 |
*** ociuhandu has quit IRC | 21:40 | |
morganfainberg | sdague, dtroyer, clarkb, mordred, ping https://review.openstack.org/#/c/100747/ this will enable gating on Apache + mod_wsgi by default | 21:40 |
*** dims_ has joined #openstack-infra | 21:41 | |
sdague | morganfainberg: +2 | 21:41 |
morganfainberg | sdague :) | 21:41 |
clarkb | morganfainberg: is that new var set in stackrc or something? | 21:42 |
clarkb | morganfainberg: I am not sure familiar with devstacks many vars | 21:42 |
dtroyer | yeah, just before sdague gets on a plane we change a default ;) | 21:42 |
morganfainberg | clarkb, yes. | 21:42 |
sdague | dtroyer: it makes it more exciting :) | 21:42 |
clarkb | dtroyer: nothing could go wrong | 21:42 |
fungi | just before most of us get on planes, in fact | 21:42 |
fungi | great time to break stuff | 21:42 |
afazekas | sdague: So you do not see any potential issue with a flat/ multi-host n-net systems on the same net ? | 21:42 |
morganfainberg | clarkb, we added that field / var a bit ago (changing how we deploy mod_wsgi + apache) | 21:42 |
dtroyer | I wait until Sunday at least... | 21:42 |
morganfainberg | dtroyer, lol | 21:43 |
*** msabramo1 has joined #openstack-infra | 21:43 | |
sdague | afazekas: I don't think so. And I've actually run that 2nd level in vagrant | 21:43 |
sdague | that's what my vagrant-devstack was actually all about initially | 21:43 |
dtroyer | thar she goes... | 21:43 |
*** dims has quit IRC | 21:43 | |
morganfainberg | sdague, and clarkb, this enables us to disable apache2 for one of the tests in config (for full matrix tests). https://review.openstack.org/#/c/105308/ | 21:44 |
*** msabramo has quit IRC | 21:44 | |
morganfainberg | i'll roll up the config change once we land that so one of the ds-g tempest runs will run keystone under eventlet instead of apache only (we haven't removed eventlet support) | 21:45 |
openstackgerrit | A change was merged to openstack-infra/config: Gate against pecan template scaffolding tests. https://review.openstack.org/105193 | 21:45 |
morganfainberg | thanks guys :) | 21:46 |
*** marcoemorais has quit IRC | 21:47 | |
asselin | clarkb, would you mind reviewing this patch: should be quick and easy: https://review.openstack.org/#/c/105623/1 | 21:49 |
*** david-lyle has quit IRC | 21:49 | |
sdague | was chatting with jamielennox, has the zuul losing jobs thing been sorted - https://review.openstack.org/#/c/104067/ ? | 21:51 |
*** dustins has quit IRC | 21:52 | |
sdague | fungi: or might that have been the failed promote? | 21:52 |
jamielennox | if i've got for example https://review.openstack.org/#/c/100733/ and https://review.openstack.org/#/c/104067/ that are marked as out for review, but aren't on status.openstack.org/zuul does that make them lost? | 21:52 |
jamielennox | (there's at least one other as well | 21:52 |
*** gondoi is now known as zz_gondoi | 21:52 | |
afazekas | sdague: is the n-api-meta sets up the metadata service redirection itself ? | 21:53 |
clarkb | asselin: I take it the default doesn't work for some reason? | 21:53 |
fungi | sdague: jamielennox: hasn't been sorted. there's the issue https://review.openstack.org/104963 tries to solve (patch dequeued on parent failing to merge but gets no comment/-2 vote) and then there's the half a dozen changes which were in the gate with 105854 when i tried to promote it | 21:54 |
asselin | yes, e.g. if there's a port | 21:54 |
asselin | clarkb, yes, e.g. if there's a por | 21:54 |
fungi | sdague: jamielennox: which https://review.openstack.org/106161 should fix | 21:54 |
*** marcoemorais has joined #openstack-infra | 21:54 | |
*** dizquierdo has joined #openstack-infra | 21:54 | |
openstackgerrit | David Lenwell proposed a change to openstack-infra/config: new project called refstack-client https://review.openstack.org/106181 | 21:54 |
*** shayneburgess has quit IRC | 21:55 | |
*** marcoemorais has quit IRC | 21:55 | |
jamielennox | fungi: ok if i recheck will it kick it off again? | 21:55 |
*** marcoemorais1 has joined #openstack-infra | 21:55 | |
fungi | jamielennox: yep | 21:55 |
*** annegent_ has joined #openstack-infra | 21:55 | |
jamielennox | is there a bug # (not mentioned on those reviews) | 21:55 |
*** gpilz1 has quit IRC | 21:56 | |
fungi | i would just use recheck no bug in this case, since you're rechecking due to a lack of feedback rather than due to a negative vote | 21:56 |
clarkb | fungi: jeblair I am going to approve that zuul change now | 21:56 |
clarkb | working on the changes behind | 21:56 |
jamielennox | fungi: will do, thanks | 21:56 |
*** Evgeny has joined #openstack-infra | 21:56 | |
clarkb | fungi: jeblair: any other urgent changes I should look at that came up in the morning? | 21:59 |
*** gpilz has joined #openstack-infra | 22:00 | |
openstackgerrit | A change was merged to openstack-infra/zuul: Cause the promote command to ignore pipeline reqs https://review.openstack.org/106161 | 22:00 |
*** gpilz has left #openstack-infra | 22:00 | |
*** EntropyWorks has joined #openstack-infra | 22:01 | |
*** eharney has joined #openstack-infra | 22:01 | |
*** tsg has joined #openstack-infra | 22:02 | |
*** amalagon has quit IRC | 22:02 | |
openstackgerrit | A change was merged to openstack-infra/config: Add the ability to set zuul's gerrit baseurl https://review.openstack.org/105623 | 22:03 |
asselin | clarkb, thanks! | 22:03 |
openstackgerrit | A change was merged to openstack-infra/zuul: Cause the enqueue command to ignore pipeline reqs https://review.openstack.org/106162 | 22:03 |
*** marcoemorais1 has quit IRC | 22:04 | |
*** blamar has joined #openstack-infra | 22:04 | |
sdague | afazekas: so, honestly, in first attempt we should ignore n-api-meta | 22:04 |
fungi | clarkb: none i'm aware of | 22:04 |
*** marcoemorais has joined #openstack-infra | 22:04 | |
sdague | n-net, config drive | 22:04 |
sdague | get those issued shooken out | 22:04 |
clarkb | cool | 22:04 |
clarkb | sdague: since there is nothing pressing should I approve your loganalyze stack? | 22:04 |
sdague | clarkb: sure | 22:04 |
sdague | I'll be around to hot fix if anything goes wrong | 22:05 |
clarkb | stack is approved | 22:05 |
*** dizquierdo has quit IRC | 22:06 | |
openstackgerrit | David Lenwell proposed a change to openstack-infra/config: new project called refstack-client https://review.openstack.org/106181 | 22:07 |
sdague | clarkb: thanks | 22:07 |
davidlenwell | Does anyone have a minute to tell me if I missed anything on the review above ^^ | 22:08 |
davidlenwell | https://review.openstack.org/#/c/106181/ | 22:08 |
openstackgerrit | A change was merged to openstack-infra/os-loganalyze: move filtering mechanism to separate class https://review.openstack.org/102941 | 22:09 |
openstackgerrit | Steve Martinelli proposed a change to openstack-infra/config: Publish specs jobs for keystone-specs https://review.openstack.org/106100 | 22:09 |
openstackgerrit | A change was merged to openstack-infra/os-loganalyze: introduce limit parameter https://review.openstack.org/102947 | 22:09 |
clarkb | davidlenwell: lgtm | 22:09 |
davidlenwell | thanks clarkb | 22:09 |
davidlenwell | is tomorrow new project friday or did you guys drop that? | 22:09 |
*** juzuluag has joined #openstack-infra | 22:10 | |
openstackgerrit | A change was merged to openstack-infra/os-loganalyze: use wsgi environ https://review.openstack.org/105527 | 22:10 |
clarkb | davidlenwell: we stopped doing that because the tooling is reliable again | 22:10 |
davidlenwell | oh yay | 22:11 |
davidlenwell | so it will merge when it merges then | 22:11 |
clarkb | yup | 22:11 |
davidlenwell | Do you think by early next week is a safe bet? | 22:11 |
openstackgerrit | A change was merged to openstack-infra/os-loganalyze: allow for live stripping of control chars https://review.openstack.org/105528 | 22:11 |
clarkb | maybe? I mean we are all hopping on planes here shortly and spening a week in darmstadt | 22:11 |
clarkb | so my guess is things will lag a bit | 22:12 |
*** kmartin has quit IRC | 22:12 | |
davidlenwell | well being that I'll be there with you guys ;) | 22:12 |
openstackgerrit | A change was merged to openstack-infra/os-loganalyze: Move all presentation layer to view module https://review.openstack.org/105915 | 22:12 |
*** marcoemorais has quit IRC | 22:12 | |
mattoliverau | Morning | 22:13 |
*** kmartin has joined #openstack-infra | 22:14 | |
*** dangers is now known as dangers_away | 22:14 | |
*** marcoemorais has joined #openstack-infra | 22:15 | |
*** msuriar_ is now known as msuriar | 22:15 | |
*** atiwari has joined #openstack-infra | 22:16 | |
*** signed8bit has quit IRC | 22:16 | |
*** marcoemorais has quit IRC | 22:17 | |
*** marcoemorais has joined #openstack-infra | 22:18 | |
*** annegent_ has quit IRC | 22:18 | |
sdague | clarkb: all looks good so far | 22:18 |
clarkb | sdague: cool, it may not have applied yet /me looks at puppetboard | 22:19 |
clarkb | sdague: http://puppetboard.openstack.org/node/static.openstack.org | 22:19 |
sdague | clarkb: ok | 22:19 |
clarkb | sdague: going back to logstash, you will note we caught up after all the logstash daemons were restarted | 22:20 |
clarkb | but then we regressed back to the low throughput state... so hopefully tomorrow I will sit down and spend some time with latest logstash and get it tested | 22:21 |
sdague | cool | 22:21 |
sdague | so by the time I get to germany, you'll have fixed it all? :D | 22:21 |
clarkb | sdague: https://bugs.launchpad.net/openstack-ci/+bug/1340445 is that the pg bug that was just squashed | 22:21 |
uvirtbot | Launchpad bug 1340445 in openstack-ci "gate failing when "asynchronous connection failed" in nova log" [Undecided,New] | 22:21 |
clarkb | sdague: boy I hope so. so sick of it being sad | 22:22 |
sdague | clarkb: yes | 22:22 |
clarkb | sdague: so what bug should I mark it duplicate of? | 22:22 |
*** oomichi has joined #openstack-infra | 22:24 | |
sdague | Clabbe: Bug 1338841 - asynchronous connection failed in postgresql jobs | 22:24 |
uvirtbot | Launchpad bug 1338841 in devstack "asynchronous connection failed in postgresql jobs" [Undecided,Fix released] https://launchpad.net/bugs/1338841 | 22:24 |
clarkb | thanks | 22:24 |
anteaya | mattoliverau: hello, can you review this patch please? https://review.openstack.org/#/c/105926/ | 22:25 |
anteaya | mattoliverau: neutron needs this to unstick their functional tests | 22:25 |
mattoliverau | anteaya: looking now :) | 22:26 |
anteaya | mattoliverau: thank you | 22:26 |
*** armax has quit IRC | 22:26 | |
*** david-lyle has joined #openstack-infra | 22:26 | |
*** jamespage_ has joined #openstack-infra | 22:26 | |
*** hashar has quit IRC | 22:27 | |
*** marcoemorais has quit IRC | 22:29 | |
*** pdmars has quit IRC | 22:29 | |
krotscheck | Anyone know of an example where a tox.ini includes a reference to a path resolved from the current directory? | 22:29 |
anteaya | mattoliverau: thank you | 22:29 |
anteaya | mattoliverau: how soon until jhesketh? | 22:29 |
mattoliverau | anteaya: He usually pops before 9, so hopefully be here in the next 15 minutes or so. | 22:31 |
anteaya | mattoliverau: awesome thank you | 22:31 |
anteaya | is it 8:30am for you? | 22:31 |
clarkb | krotscheck: look at pecan | 22:32 |
clarkb | I think pecan does that | 22:32 |
*** krtaylor has quit IRC | 22:32 | |
krotscheck | clarkb: It does, thansk! | 22:32 |
*** Evgeny has quit IRC | 22:32 | |
*** andreaf has quit IRC | 22:32 | |
*** masayukig has quit IRC | 22:32 | |
*** reed has quit IRC | 22:32 | |
*** trinaths has quit IRC | 22:32 | |
*** ZZelle_ has quit IRC | 22:32 | |
*** jgrimm has quit IRC | 22:32 | |
*** markmc has quit IRC | 22:32 | |
*** yamahata has quit IRC | 22:32 | |
*** chuckC has quit IRC | 22:32 | |
*** skraynev has quit IRC | 22:32 | |
*** shardy has quit IRC | 22:32 | |
*** rwsu has quit IRC | 22:32 | |
*** arun has quit IRC | 22:32 | |
*** mmitchell_ has quit IRC | 22:32 | |
*** froek has quit IRC | 22:32 | |
*** psedlak has quit IRC | 22:32 | |
*** kashyap has quit IRC | 22:32 | |
*** bnemec has quit IRC | 22:32 | |
*** joa has quit IRC | 22:32 | |
*** vipul has quit IRC | 22:32 | |
*** tteggel has quit IRC | 22:32 | |
*** isviridov has quit IRC | 22:32 | |
*** dstanek has quit IRC | 22:32 | |
*** pleia2 has quit IRC | 22:32 | |
*** therve has quit IRC | 22:32 | |
*** hughsaunders has quit IRC | 22:32 | |
*** SergeyLukjanov has quit IRC | 22:32 | |
*** NikitaKonovalov has quit IRC | 22:32 | |
*** dmitryme has quit IRC | 22:32 | |
*** sbadia has quit IRC | 22:32 | |
*** chianingwang has quit IRC | 22:32 | |
*** jgriffith has quit IRC | 22:32 | |
*** hogepodge has quit IRC | 22:32 | |
*** garyk has quit IRC | 22:32 | |
*** obondarev has quit IRC | 22:32 | |
*** marun has quit IRC | 22:32 | |
*** zigo has quit IRC | 22:32 | |
*** blamar has quit IRC | 22:32 | |
*** eharney has quit IRC | 22:32 | |
*** thedodd has quit IRC | 22:32 | |
*** gyee has quit IRC | 22:32 | |
*** adrian_otto has quit IRC | 22:32 | |
*** mattymo has quit IRC | 22:32 | |
*** saper has quit IRC | 22:32 | |
*** atiwari has quit IRC | 22:32 | |
*** tsg has quit IRC | 22:32 | |
*** dstufft|laptop has quit IRC | 22:32 | |
*** asselin has quit IRC | 22:32 | |
*** Mithrandir has quit IRC | 22:32 | |
*** sweston has quit IRC | 22:32 | |
*** mancdaz has quit IRC | 22:32 | |
*** zz_johnthetubagu has quit IRC | 22:32 | |
*** uvirtbot has quit IRC | 22:32 | |
*** krotscheck has quit IRC | 22:32 | |
*** jamespd has quit IRC | 22:32 | |
*** davidlenwell has quit IRC | 22:32 | |
*** _shaps_ has quit IRC | 22:32 | |
*** rgerganov has quit IRC | 22:32 | |
*** sandywalsh has quit IRC | 22:32 | |
*** dims_ has quit IRC | 22:32 | |
*** andreykurilin_ has quit IRC | 22:32 | |
*** bdpayne has quit IRC | 22:32 | |
*** sabeen has quit IRC | 22:32 | |
*** anonitus has quit IRC | 22:32 | |
*** asettle has quit IRC | 22:32 | |
*** rakhmerov has quit IRC | 22:32 | |
*** akuznetsova has quit IRC | 22:32 | |
*** matrohon has quit IRC | 22:33 | |
*** cody-somerville has quit IRC | 22:33 | |
*** enikanorov__ has quit IRC | 22:33 | |
*** dangers_away has quit IRC | 22:33 | |
*** IAX has quit IRC | 22:33 | |
*** hemna_ has quit IRC | 22:33 | |
*** bcrochet has quit IRC | 22:33 | |
*** timrc has quit IRC | 22:33 | |
*** annegentle has quit IRC | 22:33 | |
*** grantbow has quit IRC | 22:33 | |
*** Sukhdev has quit IRC | 22:33 | |
*** pcrews has quit IRC | 22:33 | |
*** wenlock has quit IRC | 22:33 | |
*** mriedem has quit IRC | 22:33 | |
*** prad has quit IRC | 22:33 | |
*** jd__ has quit IRC | 22:33 | |
*** nibalizer has quit IRC | 22:33 | |
*** beagles has quit IRC | 22:33 | |
*** sdague has quit IRC | 22:33 | |
*** SpamapS has quit IRC | 22:33 | |
*** maurosr has quit IRC | 22:33 | |
*** hdd has quit IRC | 22:33 | |
*** chmouel has quit IRC | 22:33 | |
*** dimtruck has quit IRC | 22:33 | |
*** proffalken has quit IRC | 22:33 | |
*** sc68cal has quit IRC | 22:33 | |
*** clarkb has quit IRC | 22:33 | |
*** devananda has quit IRC | 22:33 | |
*** jeblair has quit IRC | 22:33 | |
*** slagle has quit IRC | 22:33 | |
*** SlickNik has quit IRC | 22:33 | |
*** Kiall has quit IRC | 22:33 | |
*** jcooley has quit IRC | 22:33 | |
*** portante has quit IRC | 22:33 | |
*** briancline has quit IRC | 22:33 | |
*** tnurlygayanov has quit IRC | 22:33 | |
*** rkukura has quit IRC | 22:33 | |
*** nati_ueno has quit IRC | 22:33 | |
*** Alexei_987 has quit IRC | 22:33 | |
*** torandu has quit IRC | 22:33 | |
*** zzelle__ has quit IRC | 22:33 | |
*** gangil has quit IRC | 22:33 | |
*** katyafervent has quit IRC | 22:33 | |
*** nelsnelson has quit IRC | 22:33 | |
*** doug-fish has quit IRC | 22:33 | |
*** gaelL has quit IRC | 22:33 | |
*** anteaya has quit IRC | 22:33 | |
*** jogo has quit IRC | 22:33 | |
*** zul has quit IRC | 22:33 | |
*** spiffxp_ has quit IRC | 22:33 | |
*** yamahata__ has quit IRC | 22:33 | |
*** nithyag__ has quit IRC | 22:33 | |
*** kmartin has quit IRC | 22:33 | |
*** arnaud has quit IRC | 22:33 | |
*** miqui has quit IRC | 22:33 | |
*** oanufriev has quit IRC | 22:33 | |
*** dkehn has quit IRC | 22:33 | |
*** changbl has quit IRC | 22:33 | |
*** Shrews has quit IRC | 22:33 | |
*** jamielennox has quit IRC | 22:33 | |
*** Ng has quit IRC | 22:33 | |
*** Hefeweizen has quit IRC | 22:33 | |
*** msuriar has quit IRC | 22:33 | |
*** jraim has quit IRC | 22:33 | |
*** vponomaryov has quit IRC | 22:33 | |
*** bradm has quit IRC | 22:33 | |
*** thingee has quit IRC | 22:33 | |
*** BobBall has quit IRC | 22:33 | |
*** gothicmindfood has quit IRC | 22:33 | |
*** cindyo has quit IRC | 22:33 | |
*** zhiyan_ has quit IRC | 22:33 | |
*** ciypro|afk has quit IRC | 22:33 | |
*** salv-orlando has quit IRC | 22:33 | |
*** otherwiseguy has quit IRC | 22:33 | |
*** rcarrillocruz has quit IRC | 22:33 | |
*** harlowja has quit IRC | 22:33 | |
*** openstackgerrit has quit IRC | 22:33 | |
*** tcammann has quit IRC | 22:33 | |
*** homeless has quit IRC | 22:33 | |
*** jp_at_hp has quit IRC | 22:33 | |
*** mtreinish has quit IRC | 22:33 | |
*** gargola has quit IRC | 22:33 | |
*** mdenny has quit IRC | 22:33 | |
*** vladan has quit IRC | 22:33 | |
*** gema has quit IRC | 22:33 | |
*** gilliard_ has quit IRC | 22:33 | |
*** plars has quit IRC | 22:33 | |
*** kevinbenton has quit IRC | 22:33 | |
*** mugsie has quit IRC | 22:33 | |
*** dkliban_afk has quit IRC | 22:33 | |
*** spiffxp has quit IRC | 22:33 | |
*** mfisch has quit IRC | 22:33 | |
*** jhesketh has quit IRC | 22:33 | |
*** Vek has quit IRC | 22:33 | |
*** ekarlso has quit IRC | 22:33 | |
*** charz has quit IRC | 22:33 | |
*** gmurphy has quit IRC | 22:33 | |
*** s0nea has quit IRC | 22:33 | |
*** morganfainberg has quit IRC | 22:33 | |
*** paul-- has quit IRC | 22:33 | |
*** boris-42 has quit IRC | 22:33 | |
*** david-lyle has quit IRC | 22:33 | |
*** oomichi has quit IRC | 22:33 | |
*** yfried__ has quit IRC | 22:33 | |
*** shashankhegde has quit IRC | 22:33 | |
*** markmcclain has quit IRC | 22:33 | |
*** sweston_ has quit IRC | 22:33 | |
*** carl_baldwin has quit IRC | 22:33 | |
*** x1b2j has quit IRC | 22:33 | |
*** loquacities has quit IRC | 22:33 | |
*** dtroyer has quit IRC | 22:33 | |
*** antonym has quit IRC | 22:33 | |
*** pabelanger has quit IRC | 22:33 | |
*** dougwig has quit IRC | 22:33 | |
*** Alex_Gaynor has quit IRC | 22:33 | |
*** serverascode has quit IRC | 22:33 | |
*** wendar has quit IRC | 22:33 | |
*** nikhil___ has quit IRC | 22:33 | |
*** jroll has quit IRC | 22:33 | |
*** pfallenop has quit IRC | 22:33 | |
*** gnuoy has quit IRC | 22:33 | |
*** mrda has quit IRC | 22:33 | |
*** sileht has quit IRC | 22:33 | |
*** AaronGr has quit IRC | 22:33 | |
*** Daviey has quit IRC | 22:33 | |
*** EntropyWorks has quit IRC | 22:33 | |
*** vishy has quit IRC | 22:33 | |
*** d34dh0r53 has quit IRC | 22:33 | |
*** esmute has quit IRC | 22:33 | |
*** ptoohill has quit IRC | 22:33 | |
*** Hunner has quit IRC | 22:33 | |
*** mrodden has quit IRC | 22:33 | |
*** bodepd has quit IRC | 22:33 | |
*** d0ugal has quit IRC | 22:33 | |
*** phschwartz has quit IRC | 22:33 | |
*** timfreund has quit IRC | 22:33 | |
*** dhellmann has quit IRC | 22:33 | |
*** lyxus has quit IRC | 22:33 | |
*** dosaboy has quit IRC | 22:33 | |
*** med_ has quit IRC | 22:33 | |
*** JoshNang has quit IRC | 22:33 | |
*** Guest56682 has quit IRC | 22:33 | |
*** mnaser has quit IRC | 22:33 | |
*** sulochan_ has quit IRC | 22:33 | |
*** juzuluag has quit IRC | 22:33 | |
*** praneshp has quit IRC | 22:33 | |
*** elambert has quit IRC | 22:33 | |
*** Ryan_Lane has quit IRC | 22:33 | |
*** penguinRaider has quit IRC | 22:33 | |
*** rfolco has quit IRC | 22:33 | |
*** YorikSar has quit IRC | 22:33 | |
*** mkerrin has quit IRC | 22:33 | |
*** greghaynes has quit IRC | 22:33 | |
*** NobodyCam has quit IRC | 22:33 | |
*** GheRivero has quit IRC | 22:33 | |
*** eglynn-office has quit IRC | 22:33 | |
*** rickerc has quit IRC | 22:33 | |
*** cdub has quit IRC | 22:33 | |
*** fifieldt has quit IRC | 22:33 | |
*** msabramo1 has quit IRC | 22:33 | |
*** pcm_ has quit IRC | 22:33 | |
*** primeministerp has quit IRC | 22:33 | |
*** ildikov has quit IRC | 22:33 | |
*** stevemar has quit IRC | 22:33 | |
*** HenryG has quit IRC | 22:33 | |
*** mestery has quit IRC | 22:33 | |
*** flaviof_zzz has quit IRC | 22:33 | |
*** jpeeler has quit IRC | 22:33 | |
*** roaet_ has quit IRC | 22:33 | |
*** mgagne has quit IRC | 22:33 | |
*** Adri2000 has quit IRC | 22:33 | |
*** BadCub_ has quit IRC | 22:33 | |
*** zz_gondoi has quit IRC | 22:33 | |
*** tristanC has quit IRC | 22:33 | |
*** fungi has quit IRC | 22:33 | |
*** jbryce has quit IRC | 22:33 | |
*** dencaval has quit IRC | 22:33 | |
*** enikanorov_ has quit IRC | 22:33 | |
*** michchap has quit IRC | 22:33 | |
*** fabo has quit IRC | 22:33 | |
*** dtantsur has quit IRC | 22:33 | |
*** afazekas has quit IRC | 22:33 | |
*** zaro has quit IRC | 22:33 | |
*** mika has quit IRC | 22:33 | |
*** radez_g0n3 has quit IRC | 22:33 | |
*** ttx has quit IRC | 22:33 | |
*** StevenK has quit IRC | 22:33 | |
*** simonmcc has quit IRC | 22:33 | |
*** comstud has quit IRC | 22:33 | |
*** alaski has quit IRC | 22:33 | |
*** emagana has quit IRC | 22:33 | |
*** melwitt has quit IRC | 22:33 | |
*** cyeoh has quit IRC | 22:33 | |
*** russellb has quit IRC | 22:33 | |
*** cyli has quit IRC | 22:33 | |
*** dolphm has quit IRC | 22:33 | |
*** stevebaker has quit IRC | 22:33 | |
*** adam_g has quit IRC | 22:33 | |
*** plomakin_ has quit IRC | 22:33 | |
*** dguerri has quit IRC | 22:33 | |
*** notmyname has quit IRC | 22:33 | |
*** flaper87|afk has quit IRC | 22:33 | |
*** soren has quit IRC | 22:33 | |
*** rossella_s has quit IRC | 22:33 | |
*** ChanServ has quit IRC | 22:33 | |
*** Clabbe has quit IRC | 22:33 | |
*** mikal has quit IRC | 22:33 | |
*** ruhe has quit IRC | 22:33 | |
*** gpocentek has quit IRC | 22:33 | |
*** tchaypo has quit IRC | 22:33 | |
*** jamespage_ has quit IRC | 22:33 | |
*** vipul has joined #openstack-infra | 22:36 | |
*** isviridov has joined #openstack-infra | 22:36 | |
*** bnemec has joined #openstack-infra | 22:36 | |
*** tteggel has joined #openstack-infra | 22:36 | |
*** kashyap has joined #openstack-infra | 22:36 | |
*** SergeyLukjanov has joined #openstack-infra | 22:36 | |
*** mmitchell_ has joined #openstack-infra | 22:36 | |
*** masayukig has joined #openstack-infra | 22:36 | |
*** Evgeny has joined #openstack-infra | 22:36 | |
*** arun has joined #openstack-infra | 22:36 | |
*** andreaf has joined #openstack-infra | 22:36 | |
*** yamahata has joined #openstack-infra | 22:36 | |
*** rwsu has joined #openstack-infra | 22:36 | |
*** dmitryme has joined #openstack-infra | 22:36 | |
*** NikitaKonovalov has joined #openstack-infra | 22:36 | |
*** markmc has joined #openstack-infra | 22:36 | |
*** jgrimm has joined #openstack-infra | 22:36 | |
*** ZZelle_ has joined #openstack-infra | 22:36 | |
*** chuckC has joined #openstack-infra | 22:36 | |
*** sbadia has joined #openstack-infra | 22:36 | |
*** joa has joined #openstack-infra | 22:36 | |
*** psedlak has joined #openstack-infra | 22:36 | |
*** froek has joined #openstack-infra | 22:36 | |
*** skraynev has joined #openstack-infra | 22:36 | |
*** therve has joined #openstack-infra | 22:36 | |
*** doddstack has joined #openstack-infra | 22:36 | |
*** david-lyle has joined #openstack-infra | 22:36 | |
*** oomichi has joined #openstack-infra | 22:36 | |
*** atiwari has joined #openstack-infra | 22:36 | |
*** kmartin has joined #openstack-infra | 22:36 | |
*** juzuluag has joined #openstack-infra | 22:36 | |
*** blamar has joined #openstack-infra | 22:36 | |
*** tsg has joined #openstack-infra | 22:36 | |
*** eharney has joined #openstack-infra | 22:36 | |
*** EntropyWorks has joined #openstack-infra | 22:36 | |
*** msabramo1 has joined #openstack-infra | 22:36 | |
*** dims_ has joined #openstack-infra | 22:36 | |
*** rkukura has joined #openstack-infra | 22:36 | |
*** Sukhdev has joined #openstack-infra | 22:36 | |
*** salv-orlando has joined #openstack-infra | 22:36 | |
*** pcm_ has joined #openstack-infra | 22:36 | |
*** dstufft|laptop has joined #openstack-infra | 22:36 | |
*** emagana has joined #openstack-infra | 22:36 | |
*** arnaud has joined #openstack-infra | 22:36 | |
*** yfried__ has joined #openstack-infra | 22:36 | |
*** shashankhegde has joined #openstack-infra | 22:36 | |
*** pcrews has joined #openstack-infra | 22:36 | |
*** otherwiseguy has joined #openstack-infra | 22:36 | |
*** andreykurilin_ has joined #openstack-infra | 22:36 | |
*** primeministerp has joined #openstack-infra | 22:36 | |
*** bdpayne has joined #openstack-infra | 22:36 | |
*** melwitt has joined #openstack-infra | 22:36 | |
*** sabeen has joined #openstack-infra | 22:36 | |
*** nati_ueno has joined #openstack-infra | 22:36 | |
*** Alexei_987 has joined #openstack-infra | 22:36 | |
*** rcarrillocruz has joined #openstack-infra | 22:36 | |
*** gyee has joined #openstack-infra | 22:36 | |
*** markmcclain has joined #openstack-infra | 22:36 | |
*** adrian_otto has joined #openstack-infra | 22:36 | |
*** harlowja has joined #openstack-infra | 22:36 | |
*** praneshp has joined #openstack-infra | 22:36 | |
*** elambert has joined #openstack-infra | 22:36 | |
*** Ryan_Lane has joined #openstack-infra | 22:36 | |
*** stevemar has joined #openstack-infra | 22:36 | |
*** sweston_ has joined #openstack-infra | 22:36 | |
*** jgriffith has joined #openstack-infra | 22:36 | |
*** anonitus has joined #openstack-infra | 22:36 | |
*** hogepodge has joined #openstack-infra | 22:36 | |
*** asettle has joined #openstack-infra | 22:36 | |
*** wenlock has joined #openstack-infra | 22:36 | |
*** asselin has joined #openstack-infra | 22:36 | |
*** beagles has joined #openstack-infra | 22:36 | |
*** torandu has joined #openstack-infra | 22:36 | |
*** openstackgerrit has joined #openstack-infra | 22:36 | |
*** carl_baldwin has joined #openstack-infra | 22:36 | |
*** zzelle__ has joined #openstack-infra | 22:36 | |
*** gangil has joined #openstack-infra | 22:36 | |
*** garyk has joined #openstack-infra | 22:36 | |
*** obondarev has joined #openstack-infra | 22:36 | |
*** mattymo has joined #openstack-infra | 22:36 | |
*** mriedem has joined #openstack-infra | 22:36 | |
*** katyafervent has joined #openstack-infra | 22:36 | |
*** marun has joined #openstack-infra | 22:36 | |
*** rakhmerov has joined #openstack-infra | 22:36 | |
*** akuznetsova has joined #openstack-infra | 22:36 | |
*** tcammann has joined #openstack-infra | 22:36 | |
*** nelsnelson has joined #openstack-infra | 22:36 | |
*** ildikov has joined #openstack-infra | 22:36 | |
*** prad has joined #openstack-infra | 22:36 | |
*** homeless has joined #openstack-infra | 22:36 | |
*** HenryG has joined #openstack-infra | 22:36 | |
*** mestery has joined #openstack-infra | 22:36 | |
*** penguinRaider has joined #openstack-infra | 22:36 | |
*** rfolco has joined #openstack-infra | 22:36 | |
*** doug-fish has joined #openstack-infra | 22:36 | |
*** x1b2j has joined #openstack-infra | 22:36 | |
*** saper has joined #openstack-infra | 22:36 | |
*** gaelL has joined #openstack-infra | 22:36 | |
*** jd__ has joined #openstack-infra | 22:36 | |
*** flaviof_zzz has joined #openstack-infra | 22:36 | |
*** matrohon has joined #openstack-infra | 22:36 | |
*** cyeoh has joined #openstack-infra | 22:36 | |
*** nibalizer has joined #openstack-infra | 22:36 | |
*** zigo has joined #openstack-infra | 22:36 | |
*** YorikSar has joined #openstack-infra | 22:36 | |
*** Mithrandir has joined #openstack-infra | 22:36 | |
*** mkerrin has joined #openstack-infra | 22:36 | |
*** jp_at_hp has joined #openstack-infra | 22:36 | |
*** sweston has joined #openstack-infra | 22:36 | |
*** jpeeler has joined #openstack-infra | 22:36 | |
*** cody-somerville has joined #openstack-infra | 22:36 | |
*** mtreinish has joined #openstack-infra | 22:36 | |
*** mancdaz has joined #openstack-infra | 22:36 | |
*** zz_johnthetubagu has joined #openstack-infra | 22:36 | |
*** loquacities has joined #openstack-infra | 22:36 | |
*** oanufriev has joined #openstack-infra | 22:36 | |
*** boris-42 has joined #openstack-infra | 22:36 | |
*** miqui has joined #openstack-infra | 22:36 | |
*** enikanorov__ has joined #openstack-infra | 22:36 | |
*** gargola has joined #openstack-infra | 22:36 | |
*** mdenny has joined #openstack-infra | 22:36 | |
*** greghaynes has joined #openstack-infra | 22:36 | |
*** vladan has joined #openstack-infra | 22:36 | |
*** dkehn has joined #openstack-infra | 22:36 | |
*** NobodyCam has joined #openstack-infra | 22:36 | |
*** uvirtbot has joined #openstack-infra | 22:36 | |
*** anteaya has joined #openstack-infra | 22:36 | |
*** sdague has joined #openstack-infra | 22:36 | |
*** gema has joined #openstack-infra | 22:36 | |
*** jogo has joined #openstack-infra | 22:36 | |
*** krotscheck has joined #openstack-infra | 22:36 | |
*** SpamapS has joined #openstack-infra | 22:36 | |
*** gilliard_ has joined #openstack-infra | 22:36 | |
*** jamespd has joined #openstack-infra | 22:36 | |
*** GheRivero has joined #openstack-infra | 22:36 | |
*** davidlenwell has joined #openstack-infra | 22:36 | |
*** eglynn-office has joined #openstack-infra | 22:36 | |
*** rickerc has joined #openstack-infra | 22:36 | |
*** zul has joined #openstack-infra | 22:36 | |
*** changbl has joined #openstack-infra | 22:36 | |
*** Shrews has joined #openstack-infra | 22:36 | |
*** _shaps_ has joined #openstack-infra | 22:36 | |
*** rgerganov has joined #openstack-infra | 22:36 | |
*** plars has joined #openstack-infra | 22:36 | |
*** cdub has joined #openstack-infra | 22:36 | |
*** fifieldt has joined #openstack-infra | 22:36 | |
*** jamielennox has joined #openstack-infra | 22:36 | |
*** kevinbenton has joined #openstack-infra | 22:36 | |
*** spiffxp_ has joined #openstack-infra | 22:36 | |
*** mugsie has joined #openstack-infra | 22:36 | |
*** BobBall has joined #openstack-infra | 22:36 | |
*** Ng has joined #openstack-infra | 22:36 | |
*** charz has joined #openstack-infra | 22:36 | |
*** maurosr has joined #openstack-infra | 22:36 | |
*** dencaval has joined #openstack-infra | 22:36 | |
*** Hefeweizen has joined #openstack-infra | 22:36 | |
*** yamahata__ has joined #openstack-infra | 22:36 | |
*** sandywalsh has joined #openstack-infra | 22:36 | |
*** nithyag__ has joined #openstack-infra | 22:36 | |
*** dangers_away has joined #openstack-infra | 22:36 | |
*** IAX has joined #openstack-infra | 22:36 | |
*** hemna_ has joined #openstack-infra | 22:36 | |
*** dtroyer has joined #openstack-infra | 22:36 | |
*** bcrochet has joined #openstack-infra | 22:36 | |
*** dkliban_afk has joined #openstack-infra | 22:36 | |
*** spiffxp has joined #openstack-infra | 22:36 | |
*** mfisch has joined #openstack-infra | 22:36 | |
*** zz_gondoi has joined #openstack-infra | 22:36 | |
*** antonym has joined #openstack-infra | 22:36 | |
*** pabelanger has joined #openstack-infra | 22:36 | |
*** roaet_ has joined #openstack-infra | 22:36 | |
*** Alex_Gaynor has joined #openstack-infra | 22:36 | |
*** mgagne has joined #openstack-infra | 22:36 | |
*** dougwig has joined #openstack-infra | 22:36 | |
*** serverascode has joined #openstack-infra | 22:36 | |
*** Adri2000 has joined #openstack-infra | 22:36 | |
*** BadCub_ has joined #openstack-infra | 22:36 | |
*** tristanC has joined #openstack-infra | 22:36 | |
*** msuriar has joined #openstack-infra | 22:36 | |
*** jraim has joined #openstack-infra | 22:36 | |
*** jbryce has joined #openstack-infra | 22:36 | |
*** fungi has joined #openstack-infra | 22:36 | |
*** russellb has joined #openstack-infra | 22:36 | |
*** nikhil___ has joined #openstack-infra | 22:36 | |
*** wendar has joined #openstack-infra | 22:36 | |
*** timrc has joined #openstack-infra | 22:36 | |
*** vponomaryov has joined #openstack-infra | 22:36 | |
*** jhesketh has joined #openstack-infra | 22:36 | |
*** Vek has joined #openstack-infra | 22:36 | |
*** annegentle has joined #openstack-infra | 22:36 | |
*** grantbow has joined #openstack-infra | 22:36 | |
*** ekarlso has joined #openstack-infra | 22:36 | |
*** bradm has joined #openstack-infra | 22:36 | |
*** enikanorov_ has joined #openstack-infra | 22:36 | |
*** jroll has joined #openstack-infra | 22:36 | |
*** thingee has joined #openstack-infra | 22:36 | |
*** pfallenop has joined #openstack-infra | 22:36 | |
*** gmurphy has joined #openstack-infra | 22:36 | |
*** michchap has joined #openstack-infra | 22:36 | |
*** s0nea has joined #openstack-infra | 22:36 | |
*** fabo has joined #openstack-infra | 22:36 | |
*** dtantsur has joined #openstack-infra | 22:36 | |
*** gnuoy has joined #openstack-infra | 22:36 | |
*** d34dh0r53 has joined #openstack-infra | 22:36 | |
*** paul-- has joined #openstack-infra | 22:36 | |
*** afazekas has joined #openstack-infra | 22:36 | |
*** gothicmindfood has joined #openstack-infra | 22:36 | |
*** zhiyan_ has joined #openstack-infra | 22:36 | |
*** cindyo has joined #openstack-infra | 22:36 | |
*** ciypro|afk has joined #openstack-infra | 22:36 | |
*** briancline has joined #openstack-infra | 22:36 | |
*** portante has joined #openstack-infra | 22:36 | |
*** jcooley has joined #openstack-infra | 22:36 | |
*** Kiall has joined #openstack-infra | 22:36 | |
*** SlickNik has joined #openstack-infra | 22:36 | |
*** slagle has joined #openstack-infra | 22:36 | |
*** jeblair has joined #openstack-infra | 22:36 | |
*** devananda has joined #openstack-infra | 22:36 | |
*** clarkb has joined #openstack-infra | 22:36 | |
*** sc68cal has joined #openstack-infra | 22:36 | |
*** proffalken has joined #openstack-infra | 22:36 | |
*** zz_dimtruck has joined #openstack-infra | 22:36 | |
*** chmouel has joined #openstack-infra | 22:36 | |
*** hdd has joined #openstack-infra | 22:36 | |
*** tnurlygayanov has joined #openstack-infra | 22:36 | |
*** mrda has joined #openstack-infra | 22:36 | |
*** sileht has joined #openstack-infra | 22:36 | |
*** AaronGr has joined #openstack-infra | 22:36 | |
*** Daviey has joined #openstack-infra | 22:36 | |
*** zaro has joined #openstack-infra | 22:36 | |
*** mika has joined #openstack-infra | 22:36 | |
*** radez_g0n3 has joined #openstack-infra | 22:36 | |
*** ttx has joined #openstack-infra | 22:36 | |
*** vishy has joined #openstack-infra | 22:36 | |
*** StevenK has joined #openstack-infra | 22:36 | |
*** simonmcc has joined #openstack-infra | 22:36 | |
*** cyli has joined #openstack-infra | 22:36 | |
*** dolphm has joined #openstack-infra | 22:36 | |
*** comstud has joined #openstack-infra | 22:36 | |
*** stevebaker has joined #openstack-infra | 22:36 | |
*** adam_g has joined #openstack-infra | 22:36 | |
*** plomakin_ has joined #openstack-infra | 22:36 | |
*** dguerri has joined #openstack-infra | 22:36 | |
*** alaski has joined #openstack-infra | 22:36 | |
*** notmyname has joined #openstack-infra | 22:36 | |
*** flaper87|afk has joined #openstack-infra | 22:36 | |
*** soren has joined #openstack-infra | 22:36 | |
*** morganfainberg has joined #openstack-infra | 22:36 | |
*** esmute has joined #openstack-infra | 22:36 | |
*** ptoohill has joined #openstack-infra | 22:36 | |
*** Hunner has joined #openstack-infra | 22:36 | |
*** mrodden has joined #openstack-infra | 22:36 | |
*** bodepd has joined #openstack-infra | 22:36 | |
*** d0ugal has joined #openstack-infra | 22:36 | |
*** JoshNang has joined #openstack-infra | 22:36 | |
*** phschwartz has joined #openstack-infra | 22:36 | |
*** timfreund has joined #openstack-infra | 22:36 | |
*** dhellmann has joined #openstack-infra | 22:36 | |
*** lyxus has joined #openstack-infra | 22:36 | |
*** dosaboy has joined #openstack-infra | 22:36 | |
*** med_ has joined #openstack-infra | 22:36 | |
*** mnaser has joined #openstack-infra | 22:36 | |
*** Guest56682 has joined #openstack-infra | 22:36 | |
*** sulochan_ has joined #openstack-infra | 22:36 | |
*** rossella_s has joined #openstack-infra | 22:36 | |
*** ChanServ has joined #openstack-infra | 22:36 | |
*** dickson.freenode.net sets mode: +o ChanServ | 22:36 | |
*** niska has quit IRC | 22:36 | |
*** prad has quit IRC | 22:36 | |
*** Clabbe has joined #openstack-infra | 22:36 | |
*** mikal has joined #openstack-infra | 22:36 | |
*** ruhe has joined #openstack-infra | 22:36 | |
*** gpocentek has joined #openstack-infra | 22:36 | |
*** tchaypo has joined #openstack-infra | 22:36 | |
*** juzuluag has quit IRC | 22:36 | |
nikhil___ | anteaya: hope you'r still there :) | 22:36 |
*** hughsaunders has joined #openstack-infra | 22:37 | |
anteaya | nikhil___: I am in the same space as you | 22:37 |
*** morgabra has quit IRC | 22:37 | |
*** morgabra has joined #openstack-infra | 22:37 | |
*** niska has joined #openstack-infra | 22:37 | |
anteaya | nikhil___: check-tempest-dsvm-full? | 22:37 |
anteaya | nikhil___: that job? | 22:37 |
nikhil___ | anteaya: basically, am hoping to add/modify a test in tempest which is going to use a CONF value to determing where to pick image data bits from the node | 22:37 |
anteaya | okay | 22:37 |
anteaya | do you know which test? | 22:37 |
mattoliverau | anteaya: yeah 8:30.. yay netsplit | 22:37 |
nikhil___ | anteaya: ah, am not sure which job though | 22:37 |
nikhil___ | anteaya: 1 sec | 22:37 |
anteaya | mattoliverau: glad you are back | 22:37 |
*** andreykurilin_ has quit IRC | 22:38 | |
anteaya | well back being where I happen to be | 22:38 |
*** grantbow has quit IRC | 22:38 | |
*** pleia2 has joined #openstack-infra | 22:38 | |
anteaya | yay pleia2 is back | 22:38 |
clarkb | yes it would be that job | 22:38 |
*** trinaths has joined #openstack-infra | 22:38 | |
*** grantbow has joined #openstack-infra | 22:38 | |
pleia2 | ah freenode :) | 22:38 |
*** reed has joined #openstack-infra | 22:39 | |
clarkb | the infra jobs run defaults as much as possible | 22:39 |
anteaya | clarkb: thanks | 22:39 |
clarkb | I dont think we do anything special with images | 22:39 |
anteaya | pleia2: care to review https://review.openstack.org/#/c/105926/ ? | 22:39 |
*** bknudson has joined #openstack-infra | 22:39 | |
anteaya | pleia2: I'm in the neutron sprint and they would like it in | 22:39 |
* pleia2 has a look | 22:39 | |
anteaya | shopping for reviews | 22:39 |
anteaya | thanks | 22:39 |
anteaya | waiting for jhesketh and his mighty +A | 22:40 |
anteaya | clarkb has already +2's and I don't see other cores about | 22:40 |
nikhil___ | anteaya: clarkb : this is the specific set of tests http://git.openstack.org/cgit/openstack/tempest/tree/tempest/api/image/v2/test_images.py | 22:41 |
nikhil___ | clarkb: ah ok, so if I need to add a config value to the tempest tests to get the image data , how would that be possible? | 22:42 |
sdague | nikhil___: it's probably better to bring that to -qa | 22:42 |
pleia2 | anteaya: I think you need single quotes | 22:42 |
pleia2 | anteaya: see typing this in terminal: echo "Defaults:stack !requiretty" | 22:42 |
anteaya | k, I'll ask marun | 22:42 |
pleia2 | anteaya: vs this: echo 'Defaults:stack !requiretty' | 22:42 |
nikhil___ | sdague: gotcha, thanks | 22:43 |
anteaya | pleia2: marun tells me that he just copied what sdague told him to put | 22:45 |
sdague | anteaya: I'm allowed to be wrong some times :) | 22:45 |
anteaya | sdague: no | 22:45 |
anteaya | I don't believe it | 22:45 |
anteaya | sdague: so double or single quotes? | 22:45 |
sdague | I think pleia2 is right | 22:45 |
anteaya | marun is willing to respin | 22:45 |
anteaya | sdague: okay | 22:46 |
pleia2 | it's just that one line because ! is a special character in sh | 22:46 |
*** andreaf has quit IRC | 22:46 | |
*** doug-fish has left #openstack-infra | 22:46 | |
openstackgerrit | Maru Newby proposed a change to openstack-infra/config: Fix neutron func job sudo config. https://review.openstack.org/105926 | 22:48 |
mattoliverau | pleia2: nice spot :) | 22:49 |
anteaya | pleia2: you are correct, I tried it in the terminal | 22:49 |
anteaya | pleia2: yay | 22:49 |
openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/storyboard-webclient: Removed nodeenv dependency https://review.openstack.org/106191 | 22:49 |
*** mmaglana has joined #openstack-infra | 22:49 | |
pleia2 | glad I could help | 22:50 |
*** matrohon has quit IRC | 22:51 | |
anteaya | :D | 22:51 |
*** jerryz has joined #openstack-infra | 22:51 | |
tchaypo | I've only just realised that you guys don't seem to be coming to our mid-cycle #sadness | 22:52 |
anteaya | clarkb: jenkins likes patchset 2 on marun's patch: https://review.openstack.org/#/c/105926/2 | 22:53 |
clarkb | didnt I +2 it? | 22:53 |
clarkb | oh new patchset | 22:53 |
anteaya | tchaypo: :( | 22:54 |
anteaya | sdague: can I get a +1 on marun's respin with single quotes? https://review.openstack.org/#/c/105926/2 jenkins has come back happy | 22:55 |
mikal | Hey, what's the release process for client libraries (novaclient in this case) these days? | 22:55 |
mikal | I know that ttx has taken over tagging releases for the main project repos, as he done that for clients as well? | 22:55 |
morganfainberg | dolphm, ^^ | 22:56 |
*** marcoemorais has joined #openstack-infra | 22:56 | |
dolphm | mikal: release anytime, as necessary | 22:56 |
openstackgerrit | Michael Krotscheck proposed a change to openstack-infra/config: Updated storyboard build to use new test modules https://review.openstack.org/106193 | 22:56 |
dolphm | mikal: use semver as appropriate | 22:56 |
sdague | anteaya: done | 22:56 |
mikal | dolphm: semver? | 22:56 |
anteaya | sdague: thanks | 22:57 |
dolphm | mikal: http://semver.org/ | 22:57 |
*** marcoemorais has quit IRC | 22:57 | |
*** marcoemorais has joined #openstack-infra | 22:57 | |
pleia2 | tchaypo: tripleo? you guys are pretty solid with CI these days, don't need us! :) | 22:57 |
dolphm | mikal: and to release: $ git tag -s %(milestone)s && git push gerrit %(milestone)s | 22:57 |
pleia2 | lots of infra experts on that team now | 22:58 |
tchaypo | pleia2: but we still like you! | 22:58 |
pleia2 | hehe | 22:58 |
tchaypo | I was at the birthday party last night and ended up talking to someone who had lots of... | 22:58 |
tchaypo | let's call them "questions" about the infra and if things could be tweaked | 22:58 |
tchaypo | but had no idea how to find the people who ran it | 22:59 |
tchaypo | which blew my mind | 22:59 |
tchaypo | I guess I've been lucky to be so close to the infra team right from the start | 22:59 |
*** dstufft|laptop has quit IRC | 22:59 | |
*** david-lyle has quit IRC | 23:00 | |
mordred | tchaypo: hang on - you were talking about infra at a party? | 23:00 |
*** marcoemorais has quit IRC | 23:00 | |
tchaypo | openstack birthday party | 23:01 |
pleia2 | some party | 23:01 |
pleia2 | ;) | 23:01 |
*** marcoemorais has joined #openstack-infra | 23:01 | |
*** pcm_ has quit IRC | 23:01 | |
*** marcoemorais has quit IRC | 23:01 | |
*** marcoemorais has joined #openstack-infra | 23:01 | |
dolphm | mikal: maybe useful- https://github.com/dolph/launchpad/blob/master/release_client.py | 23:02 |
clarkb | tchaypo send them ourway | 23:02 |
morganfainberg | annegentle, ping re: doc update (forgot to tag a change a docimpact) [sorry!!] | 23:02 |
clarkb | also ppint out its all in gerrit | 23:02 |
*** armax has joined #openstack-infra | 23:02 | |
mikal | dolphm: yeah, I can't find a client release doc on the wiki | 23:02 |
mikal | dolphm: I am sure its there, but I can't find it | 23:02 |
morganfainberg | annegentle, have an update to a Keystone API HTTP status return (due to breaking differences in apache vs eventlet deploymnet) | 23:03 |
*** dizquierdo has joined #openstack-infra | 23:03 | |
morganfainberg | annegentle, what do i need to provide to help you guys get the api-site updated. | 23:03 |
tchaypo | I was planning to grill them this week than talk to you guys at the mid-cycle | 23:03 |
tchaypo | but | 23:03 |
anteaya | mordred: hey can you review this? it would make marun happy: https://review.openstack.org/#/c/105926/ | 23:04 |
jhesketh | Morning | 23:04 |
anteaya | morning jhesketh | 23:04 |
anteaya | jhesketh: can you put this on your review list? https://review.openstack.org/#/c/105926/ | 23:04 |
*** Sukhdev has quit IRC | 23:05 | |
anteaya | would be great if we go to dinner and neutron is impressed with the efficentcy of infra | 23:05 |
*** harlowja has quit IRC | 23:05 | |
mikal | dolphm: it looks like you run that script before you tag? | 23:05 |
*** harlowja has joined #openstack-infra | 23:05 | |
dolphm | mikal: yes | 23:06 |
jhesketh | anteaya: done | 23:06 |
anteaya | jhesketh: thank you | 23:06 |
anteaya | mordred or clarkb? https://review.openstack.org/#/c/105926/ | 23:07 |
mikal | dolphm: so, I run: "./release_client.py python-novaclient 2.18.0" and then follow the bouncing ball? | 23:07 |
zaro | clarkb: take a look? https://review.openstack.org/#/c/106119/ | 23:09 |
clarkb | zaro: is that tested? | 23:09 |
*** bknudson has quit IRC | 23:09 | |
*** armax has quit IRC | 23:10 | |
*** armax has joined #openstack-infra | 23:10 | |
openstackgerrit | Davanum Srinivas (dims) proposed a change to openstack-infra/elastic-recheck: Adding query for broken rax mirror https://review.openstack.org/106196 | 23:10 |
openstackgerrit | K Jonathan Harker proposed a change to openstack-infra/jeepyb: Allow for the newbie message to live in its own file https://review.openstack.org/105930 | 23:10 |
clarkb | sdague: http://logs.openstack.org/00/100000/2/check-tripleo/check-tripleo-overcloud-f20/5e2fb8b/console.html | 23:10 |
greghaynes | clarkb: oh, hey | 23:11 |
clarkb | sdague: that is 500ing for me. I am assuming that means os loganalyze broke | 23:11 |
greghaynes | clarkb: my logs | 23:11 |
*** stevemar has quit IRC | 23:11 | |
clarkb | sdague: going to pull up server logs shortly | 23:11 |
zaro | clarkb: i tested it | 23:11 |
zaro | clarkb: works as expected. | 23:12 |
sdague | clarkb: yep | 23:12 |
*** carl_baldwin has quit IRC | 23:13 | |
*** rkukura has quit IRC | 23:13 | |
*** mestery has quit IRC | 23:13 | |
dims_ | sdague, review to turn on elastic recheck for broken rax mirror - (https://review.openstack.org/106196) 120+ hits in last 12 hours | 23:13 |
clarkb | sdague: http://paste.openstack.org/show/86016/ | 23:14 |
*** HenryG has quit IRC | 23:14 | |
sdague | clarkb: hmmmm... | 23:14 |
*** emagana has quit IRC | 23:14 | |
*** emagana has joined #openstack-infra | 23:15 | |
clarkb | sdague: its using text view | 23:15 |
sdague | clarkb: yeh, that's weird | 23:15 |
sdague | also, I don't know how that could not contain that item | 23:16 |
clarkb | sdague: oh that may be the logstash workers grabbing data | 23:16 |
clarkb | sdague: and different error for other 500s | 23:17 |
*** obondarev has quit IRC | 23:17 | |
sdague | ok, so I still don't know how that could be doing that | 23:17 |
clarkb | except text view is what logstash workers want | 23:17 |
*** obondarev has joined #openstack-infra | 23:17 | |
clarkb | sdague: because the headers from urllib2 are basically nil | 23:17 |
clarkb | but I think we want text view when doing that | 23:17 |
sdague | right, but text view is fine | 23:17 |
* clarkb greps for specific IPs now | 23:17 | |
sdague | no, I'm more concerned about how line.date doesn't exist :) | 23:18 |
clarkb | oh | 23:18 |
sdague | can you look at the on disk code | 23:18 |
*** mdenny has quit IRC | 23:18 | |
sdague | and make sure it CDed in to latest | 23:18 |
clarkb | sure | 23:19 |
clarkb | 6c2c356a30dee34959ae050ec5af7c89e9c3391d is the commit in git there. Move all presentation layer to view module | 23:19 |
clarkb | now to check pip | 23:19 |
*** emagana has quit IRC | 23:19 | |
clarkb | os-loganalyze==96cdbbb so maybe not wtf | 23:20 |
clarkb | hrm thats old | 23:20 |
clarkb | so maybe there is mixing happening /me does surgery | 23:20 |
*** otherwiseguy has quit IRC | 23:20 | |
*** marun has quit IRC | 23:20 | |
clarkb | http://paste.openstack.org/show/86017/ is my client error | 23:21 |
*** mfink has joined #openstack-infra | 23:21 | |
*** obondarev has quit IRC | 23:22 | |
*** morganfainberg is now known as morganfainberg_Z | 23:22 | |
*** eharney has quit IRC | 23:22 | |
*** armax has quit IRC | 23:22 | |
clarkb | ok surgery complete | 23:22 |
clarkb | greghaynes: should work now | 23:23 |
clarkb | sdague: I completely uninstalled os_loganalyze, reinstalled, then restarted apache | 23:23 |
*** ArxCruz has joined #openstack-infra | 23:23 | |
*** markmcclain has quit IRC | 23:23 | |
mikal | Huh | 23:23 |
*** emagana has joined #openstack-infra | 23:24 | |
mikal | dolphm: python-novaclient has no milestones | 23:24 |
mikal | dolphm: this is apparently a thing keystone does differently | 23:24 |
sdague | clarkb: so it seems good now, right? | 23:24 |
mordred | mikal: milestones are for crazy people | 23:24 |
sdague | clarkb: so before this whole stack, we were self contained | 23:24 |
mikal | mordred: please explain? | 23:24 |
*** pcm_ has joined #openstack-infra | 23:24 | |
greghaynes | clarkb: success! | 23:24 |
sdague | now pip install is going to be important | 23:24 |
clarkb | sdague: ya I think we are good | 23:24 |
mordred | mikal: I'm just talking. ignore me | 23:24 |
sdague | clarkb: ok, great | 23:25 |
mikal | mordred: so, what I was trying to do was ensure the "launchpad bits" happened for a python-novaclient release. Is that now magically done by me applying the tag, or should I do it manually? | 23:25 |
mordred | mikal: manually | 23:25 |
mikal | mordred: so if we don't use milestones for that, how do people know what was in each release? | 23:26 |
*** radez_g0n3 is now known as radez | 23:26 | |
*** armax has joined #openstack-infra | 23:26 | |
*** pcm_ has quit IRC | 23:27 | |
*** gargola has quit IRC | 23:27 | |
*** timrc is now known as timrc-afk | 23:27 | |
mordred | mikal: I'm not sure. maybe milestones are a good idea | 23:27 |
*** pcm_ has joined #openstack-infra | 23:27 | |
mikal | It seems to me I need a launchpad admin to create a milestone for me? | 23:28 |
mikal | I can't see how I can do it as a mortal? | 23:28 |
mikal | fungi: you around? I need your LP admin skills. | 23:30 |
mikal | jeblair: ^-- or you | 23:30 |
fungi | mikal: i can be around. 'sup? | 23:31 |
*** moted has joined #openstack-infra | 23:31 | |
fungi | mikal: lemme guess, you don't have access to create milestones for nova? | 23:31 |
* fungi peeks | 23:32 | |
mikal | fungi: so, I am trying to do a python-novaclient release. Keystone uses milestones to mark things as released by a given release. python-novaclient historically hasn't done this, but it looks like a good idea to me | 23:32 |
mikal | fungi: so, I need a milestone for python-novaclient created | 23:32 |
mikal | fungi: or alteratively, to be granted admin rights to ptyhon-novaclient so I can do it myself | 23:32 |
*** rkukura has joined #openstack-infra | 23:34 | |
jeblair | i think membership in the drivers group should take care of that... | 23:34 |
*** emagana has quit IRC | 23:34 | |
mikal | jeblair: I can't see how to do it, but I've never tried before | 23:34 |
mikal | Certainly there's not actions available to me on the milestone list page | 23:34 |
mikal | Just an empty list | 23:34 |
jeblair | mikal: out of curiousity, why does a client have milestones? | 23:35 |
jeblair | (i ask to make conversation while i continue to poke) | 23:35 |
mikal | jeblair: because no one has told me its a bad idea yet... This is my first time, I might well be wrong. | 23:35 |
mikal | jeblair: keystone does it, and it makes sense to me to want to tag bugs as "fix released" when we release a fix for them | 23:35 |
mikal | jeblair: but it is not something python-novaclient has historically done | 23:35 |
mikal | jeblair: perhaps for a good reason no one has mentioned yet | 23:36 |
fungi | yeah, here i was assuming nova... the client doesn't normally have milestones, it has bugs which get set fix-released when it reeases | 23:36 |
jeblair | how about that | 23:36 |
*** eharney has joined #openstack-infra | 23:36 | |
mikal | fungi: that set is done manually? | 23:36 |
mikal | fungi: keystone (well, dolphm) has a script I am trying to use which does that leg work, but it requires a milestone to exist | 23:36 |
fungi | mikal: normally, i think, though it probably isn't hard to script since any bug which is fix-committed at the time the release is tagged should be switched to fix-released | 23:37 |
fungi | mikal: you're saying dolphm does this for python-keystoneclient? | 23:37 |
mikal | Is there harm in having milestones for clients? | 23:37 |
mikal | Yes | 23:37 |
mikal | https://launchpad.net/python-keystoneclient/+milestones | 23:37 |
fungi | interesting | 23:37 |
jeblair | mikal: do you have the "register a series" button on https://launchpad.net/python-novaclient ? | 23:37 |
jeblair | mikal: which goes here: https://launchpad.net/python-novaclient/+addseries | 23:38 |
fungi | i don't expect there's any harm in it, though they would be fairly arbitrary since the clients tend not to have any release schedule | 23:38 |
*** rkukura has quit IRC | 23:38 | |
mikal | I do have "Register a series" | 23:38 |
mikal | I imagine a world in which the milestones are created at release time | 23:38 |
mikal | And are just named for the release number | 23:38 |
mikal | Which seems to be what keystone does | 23:38 |
jeblair | mikal: so according to that page, "milestones belong to series" | 23:39 |
wenlock | curious, why use LP to tell what was included in a release, why not use git? | 23:39 |
mikal | wenlock: we use LP for this for the projects, just not the clients | 23:39 |
jeblair | mikal: looking at keystoneclient... it looks like they created 0.0.x series... and 1.0.x... etc | 23:39 |
fungi | wenlock: i think it's more about getting bugs closed out if they're appearing fixed in a release | 23:39 |
mikal | wenlock: its really hard to find bugs in git commits sometimes | 23:39 |
mikal | jeblair: they have a "trunk" series as well | 23:39 |
jeblair | mikal: yeah, but with no milestones | 23:40 |
mikal | jeblair: true | 23:40 |
*** pcm_ has quit IRC | 23:40 | |
mikal | jeblair: so, to pick a name for the series... | 23:40 |
jeblair | mikal: so based on that example, i think the process would be to create some number-pattern series for novaclient, then add milestones to it | 23:40 |
wenlock | ohh things don't get taged? | 23:40 |
jeblair | mikal: but i have not done this myself. you may want to seek more expert advice if you're not comfortable | 23:41 |
* mikal shall flail | 23:41 | |
jeblair | mikal: 0.x.x and 1.x.x are the actual series names they used for keystoneclient | 23:41 |
wenlock | i usually just use git whatchanged <lastversion>..<thisversion> | 23:41 |
*** doddstack has quit IRC | 23:42 | |
mikal | Oh look, now I can create a milestone | 23:43 |
jeblair | mikal: the values for the 0.x.x series in keystoneclient are: name:0.x.x; summary:"0.x.x is the current development series."; status:active development; branch and release url pattern are empty | 23:43 |
jeblair | mikal: (if that helps answer "what should i enter when creating a new series?") | 23:43 |
jeblair | mikal: everything you've just done lgtm | 23:45 |
mikal | jeblair: yay! | 23:45 |
mikal | Yeah, I think it makes sense to copy keystone here | 23:45 |
*** homeless has quit IRC | 23:45 | |
mikal | This first release in LP might just look a bit bigger than it deserves | 23:45 |
*** hogepodge has quit IRC | 23:46 | |
*** elambert has quit IRC | 23:47 | |
openstackgerrit | A change was merged to openstack/requirements: Update the version of keyring to avoid bug https://review.openstack.org/93770 | 23:49 |
*** radez is now known as radez_g0n3 | 23:51 | |
*** Evgeny has quit IRC | 23:52 | |
*** atiwari has quit IRC | 23:52 | |
*** jp_at_hp1 has joined #openstack-infra | 23:53 | |
*** jp_at_hp has quit IRC | 23:54 | |
clarkb | zaro: sorry it took so long. those changes lgtm | 23:56 |
*** adrian_otto has quit IRC | 23:58 | |
*** Evgeny has joined #openstack-infra | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!