| *** yamamoto has quit IRC | 00:00 | |
| *** annegentle has quit IRC | 00:02 | |
| *** markvoelker has quit IRC | 00:03 | |
| *** achanda has quit IRC | 00:03 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-nodepool: Parameterise logging config template https://review.openstack.org/164031 | 00:04 |
|---|---|---|
| *** tim_o_ has quit IRC | 00:07 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Revert "Build wheel house during nodepool devstack caching" https://review.openstack.org/164033 | 00:07 |
| *** markvoelker has joined #openstack-infra | 00:08 | |
| clarkb | jogo: mtreinish mordred fungi jeblair pleia2 jhesketh ^ fyi I think that should be done | 00:09 |
| *** dimtruck is now known as zz_dimtruck | 00:09 | |
| *** arxcruz has quit IRC | 00:10 | |
| clarkb | ianw: I am going to test a fedora21 dib build locally, then will use that to review your change | 00:10 |
| clarkb | ianw: but nodepool is restarted so that isn't preventing anything from merging | 00:10 |
| jhesketh | clarkb: seems reasonable to me, but rather than just reverting the patch, should we set up the mirror and other stuff first so not to regress? | 00:11 |
| clarkb | jhesketh: I think we have already regressed. centos7 images can't build due to that change for example | 00:12 |
| *** xgerman has quit IRC | 00:12 | |
| ianw | clarkb: ok | 00:12 |
| clarkb | jhesketh: and the only affect of not having it is ~10 minute longer job builds which I think we can live with while we build the mirror stuff | 00:12 |
| jogo | clarkb: is the mirroring stuff in place already? | 00:13 |
| jhesketh | clarkb: okay, sounds reasonable to me | 00:14 |
| dstufft | someone should do the needful on this https://review.openstack.org/#/c/163228/ :D | 00:14 |
| *** reed has joined #openstack-infra | 00:14 | |
| clarkb | jhesketh: no | 00:14 |
| clarkb | er | 00:14 |
| clarkb | jogo: ^ | 00:14 |
| clarkb | jogo: but that doesn't matter, the current state is broken | 00:15 |
| jogo | clarkb: ok so different question, what is the ETA for getting the wheels mirrored? | 00:15 |
| clarkb | jogo: I don't have one, I haven't been able to start thinking about that | 00:15 |
| clarkb | jogo: but anyone can propose the jobs then an infra root will have to spin up the nodes to build wheels | 00:16 |
| jogo | clarkb: so I am fine with reverting if we have a plan forward | 00:16 |
| jogo | but it doesn't sound like we do | 00:16 |
| clarkb | jogo: the problem is we are broken right now | 00:17 |
| clarkb | reverting is not broken | 00:17 |
| clarkb | I don't think we need a plan forward beyond that | 00:17 |
| clarkb | building wheels for a mirror is a separate problem that we can tackle independently of this revert | 00:17 |
| *** Longgeek has joined #openstack-infra | 00:18 | |
| clarkb | think of it this way, this was a feature add that broke, so we remove the feature until we can properly implement it. But removing broken code isn't contigent upon having a plan to add the feature back in | 00:18 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: zuul-swift-upload fix delete-after https://review.openstack.org/164023 | 00:18 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/project-config: zuul-swift-upload ensure delete after is an int https://review.openstack.org/164024 | 00:18 |
| jogo | what is the failure and is it easy to fix itself? | 00:19 |
| clarkb | jhesketh: oh they are different parameters with formpost? | 00:19 |
| jogo | clarkb: normally we revert if no easy fix to roll forward | 00:19 |
| *** claudiub has quit IRC | 00:20 | |
| *** woodster_ has quit IRC | 00:20 | |
| clarkb | jogo: centos7 fails to build http://paste.openstack.org/show/191984/ | 00:20 |
| clarkb | jogo: I am checking f21 now | 00:20 |
| clarkb | but devstack gives us basically zero logging there so I don't know how to debug | 00:21 |
| clarkb | also it is installing packages which is currently a bug | 00:21 |
| clarkb | less serious because image builds don't fial they just produce images we don't want | 00:21 |
| jhesketh | clarkb: yeah, mattoliverau helped (http://docs.rackspace.com/files/api/v1/cf-devguide/content/Create_the_Form-d1a777.html) | 00:23 |
| clarkb | jhesketh: ya I dug that link up from scrollback and confirmed the parameter so +2 | 00:24 |
| jogo | clarkb: so I don't have the time to debug this now, so unless mtreinish does I am happy to just revert | 00:24 |
| jogo | since not being able to build images is bad | 00:25 |
| mattoliverau | I wrote the X-Delete-At/After in formpost.. so I'm sure it's there and works :P Its was really a question of was RAX running the requred version of the formpost middleware. | 00:25 |
| *** jp_at_hp has joined #openstack-infra | 00:26 | |
| clarkb | mattoliverau: perfect I will bug you for all formpost related items now :) | 00:26 |
| mattoliverau | haha, sure | 00:26 |
| clarkb | mattoliverau: thanks for helping out, really exciting to use this at a much larger scale | 00:26 |
| mattoliverau | nps, my pleasure | 00:26 |
| *** tnovacik has quit IRC | 00:29 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config: Generate nodepool logging configuration https://review.openstack.org/164036 | 00:29 |
| ianw | clarkb / fungi / jeblair : ^ generate the logging config by hand in system-config, pass it through to nodepool, as discussed | 00:29 |
| clarkb | ianw: cool will put it on my list | 00:30 |
| *** woodster_ has joined #openstack-infra | 00:30 | |
| *** sputnik13 has quit IRC | 00:31 | |
| *** dims has joined #openstack-infra | 00:32 | |
| *** Longgeek has quit IRC | 00:32 | |
| clarkb | ianw: ya f21 fails on the same wheel thing as centos7 | 00:34 |
| clarkb | ianw: so we should get the revert of that in before we merge your change. I am going to run f21 with the revert now to test | 00:34 |
| clarkb | https://github.com/openstack/openstack/graphs/commit-activity is neat btw | 00:37 |
| clarkb | almost 1k changes last week and over 200 today | 00:37 |
| *** SumitNaiksatam has quit IRC | 00:39 | |
| *** dpyzhov_ has quit IRC | 00:40 | |
| *** yamamoto has joined #openstack-infra | 00:41 | |
| *** marun has quit IRC | 00:42 | |
| clarkb | dstufft: ok I have a minute to review that apache change. Couple questions, first is this something we should apply across the board or do you think the identity service is specialer? second and this might be more for fungi I think openstack.org is using the id server now which it wasn't when we originally had this conversation does that change anything | 00:42 |
| clarkb | fungi: ^ | 00:42 |
| fungi | clarkb: modern libs shouldn't be impacted by the change, this is mostly only impactful to aged browsers (from what i can tell specifically we lose support for internet explorer 8 on windows xp, which we currently "support" with our existing configuration) | 00:44 |
| *** jaypipes has quit IRC | 00:45 | |
| clarkb | fungi: is this the sort of thing I/we should approve when planning to be around to field questions? mostly its almost EOD for me (finishing up some image uploads) and I don't want to bail and have openstack.org logins break | 00:46 |
| fungi | clarkb: mrmartin did look over the google analytics for groups.o.o and concluded that there weren't statistically significant hits from ie 8 on xp to warrant worrying about supporting logins from it, though i suppose www.o.o might be marginally different in that regard i expect it ultimately won't | 00:46 |
| fungi | clarkb: but yeah, we can approve when there are some of us around paying attention | 00:47 |
| clarkb | cool I will note it for first thing tomorrow activity | 00:47 |
| ianw | clarkb / jogo : so that error in http://paste.openstack.org/show/191984/ is due to the script running with "-u" when it is run standalone, but the ../functions-common not being safe for that. will propose a fix to devstack in a minute | 00:47 |
| clarkb | I have starred the change | 00:47 |
| *** dalgaaf has quit IRC | 00:47 | |
| fungi | clarkb: also, yes we should probably replicate that patch to anywhere else we're doing https, but openstackid is "special" insofar as it's the future auth lynchpin of most of our public-facing services | 00:48 |
| *** bdpayne has quit IRC | 00:51 | |
| *** radez is now known as radez_g0n3 | 00:51 | |
| *** tiswanso has joined #openstack-infra | 00:52 | |
| jogo | ianw: thanks | 00:52 |
| ianw | clarkb / jogo : https://review.openstack.org/#/c/164040/ (Add defaults for yum proxy variables) <- should fix http://paste.openstack.org/show/191984/ . was that the only problem being seen? | 00:52 |
| *** Qiming has joined #openstack-infra | 00:52 | |
| openstackgerrit | Ghanshyam Mann proposed openstack-infra/project-config: Remove Nova v21 neutron job & make one for v2.0 https://review.openstack.org/163731 | 00:53 |
| clarkb | ianw: I am testing that now | 00:53 |
| clarkb | * testing if there are other problems | 00:53 |
| *** mwagner_lap has quit IRC | 00:53 | |
| *** tiswanso has quit IRC | 00:53 | |
| *** saper has joined #openstack-infra | 00:54 | |
| *** tiswanso has joined #openstack-infra | 00:54 | |
| clarkb | ianw: there is the issue that this installs a bunch of stuff we specifically don't want installed on the images | 00:55 |
| clarkb | ianw: which is why I want to solve the wheel problem with the mirrors | 00:55 |
| *** liusheng has quit IRC | 00:56 | |
| *** cody-somerville has quit IRC | 00:56 | |
| ianw | clarkb: i.e. the install_package $(get_packages devlibs) bit? | 00:57 |
| *** saper has quit IRC | 00:57 | |
| *** saper has joined #openstack-infra | 00:57 | |
| clarkb | ya, we don't want devstack (or much of anything else) to install packages on these images because we want devstack to be doing that work during the test to make sure everything works | 00:57 |
| clarkb | this is why we use a virtualenvs for the utilities we place on these nodes so that we don't pollute the global space | 00:58 |
| openstackgerrit | Merged openstack-infra/project-config: Revert "Build wheel house during nodepool devstack caching" https://review.openstack.org/164033 | 00:58 |
| *** annegentle has joined #openstack-infra | 00:58 | |
| fungi | (and why i'm working on making, e.g., unit test jobs install the system packages they need at runtime too rather than expecting them to already be installed on the workers) | 00:59 |
| *** kevinbenton has quit IRC | 00:59 | |
| fungi | pre-caching things is worthwhile complexity, pre-installing things creates more problems than it solves | 01:00 |
| *** asettle is now known as asettle-mtg | 01:00 | |
| ianw | ok, so the wheelhouse cache should be built in a chroot inside the dib chroot? | 01:03 |
| *** annegentle has quit IRC | 01:03 | |
| *** MarkAtwood has joined #openstack-infra | 01:03 | |
| clarkb | ianw: no, I think a better plan is to put the wheels on our pypi mirrors using pypi-mirror or similar | 01:04 |
| clarkb | ianw: then image builds can just grab them and cache them | 01:04 |
| *** amitgandhinz has joined #openstack-infra | 01:05 | |
| *** sarob has joined #openstack-infra | 01:05 | |
| openstackgerrit | Yichen Wang proposed openstack-infra/project-config: Add the create permission for stackforge/vmtp https://review.openstack.org/164044 | 01:06 |
| clarkb | ianw: fwiw with the wheelhouse build revert change in f21 builds locally | 01:06 |
| clarkb | waiting for qemu-img to convert to qcow2 but it seems happy | 01:06 |
| *** ayoung has joined #openstack-infra | 01:06 | |
| *** baoli has joined #openstack-infra | 01:07 | |
| ianw | clarkb: so build the binary wheels suitable for our platforms, and put them in the local openstack mirror? | 01:08 |
| clarkb | ianw: yup | 01:08 |
| *** ddieterly has joined #openstack-infra | 01:09 | |
| clarkb | ianw: we need a job template to do it, should run pypi-mirror since we know it works and can fix it easily. Then we run that on centos6/7 fedora21 precise and trusty and rsync results to mirrors | 01:09 |
| *** zz_dimtruck is now known as dimtruck | 01:09 | |
| *** SumitNaiksatam has joined #openstack-infra | 01:09 | |
| *** sarob has quit IRC | 01:09 | |
| fungi | ideally py27 and py34 on trusty | 01:10 |
| fungi | i assume pypy isn't relevant to this | 01:10 |
| *** ghostpl_ has joined #openstack-infra | 01:10 | |
| clarkb | fungi: I think to start we will just do py27 since that where it hurts with devstack | 01:12 |
| *** rwsu is now known as rwsu-afk | 01:13 | |
| *** ddieterl_ has joined #openstack-infra | 01:13 | |
| ianw | clarkb: right, got it. is there a specific gerrit topic tag for reviews on this scheme yet? | 01:13 |
| clarkb | ianw: no, I mostly conceived it a couple hours ago :) | 01:14 |
| clarkb | so its still in the very early stages, but I should probably write a storyboard story tomorrow | 01:14 |
| *** ghostpl_ has quit IRC | 01:15 | |
| fungi | clarkb: sure, i'm just thinking ahead to making sure we pre-cache wheels for things all our non-devstack jobs may want as well | 01:16 |
| *** ddieterly has quit IRC | 01:16 | |
| ianw | clarkb: ok, that would be good and i can certainly find some time to help with it | 01:17 |
| *** dkranz has joined #openstack-infra | 01:24 | |
| *** enikanorov__ has joined #openstack-infra | 01:24 | |
| *** MarkAtwood has quit IRC | 01:25 | |
| *** enikanorov_ has quit IRC | 01:26 | |
| *** otter768 has joined #openstack-infra | 01:27 | |
| *** jp_at_hp has quit IRC | 01:29 | |
| *** otter768 has quit IRC | 01:32 | |
| *** sarob has joined #openstack-infra | 01:32 | |
| anteaya | jogo: anytime you want to share your thoughts on https://etherpad.openstack.org/p/scaling-election-tooling | 01:33 |
| *** yamahata has quit IRC | 01:33 | |
| jogo | anteaya: thanks will take a look tomorrow | 01:35 |
| anteaya | jogo: thank you | 01:35 |
| *** sarob has quit IRC | 01:36 | |
| *** amotoki has joined #openstack-infra | 01:39 | |
| tchaypo | jeblair: fwiw, even with the latest patches applied, I’m not feeling much difference in the speed | 01:40 |
| tchaypo | and as i say that i wonder if I need to trigger a db migrationto get the new indicies | 01:41 |
| *** ChuckC has joined #openstack-infra | 01:42 | |
| *** baoli has quit IRC | 01:42 | |
| clarkb | any chance I can get reviewers for https://review.openstack.org/#/c/164024/ and its parent today so that new images tomorrow get those changes? | 01:43 |
| clarkb | fungi: anteaya ^ | 01:43 |
| *** baoli has joined #openstack-infra | 01:43 | |
| *** amotoki has quit IRC | 01:44 | |
| *** gokrokve has joined #openstack-infra | 01:45 | |
| *** ChuckC has quit IRC | 01:46 | |
| *** ChuckC has joined #openstack-infra | 01:47 | |
| fungi | yep | 01:48 |
| clarkb | ty | 01:48 |
| *** gokrokve_ has quit IRC | 01:49 | |
| *** gokrokve has quit IRC | 01:50 | |
| fungi | ahh, it goes in the json then? | 01:50 |
| *** sdake has joined #openstack-infra | 01:50 | |
| fungi | i skimmed the earlier conversation | 01:50 |
| clarkb | it goes in the http form data | 01:50 |
| fungi | oh, that's what's being built in the payload there i guess | 01:51 |
| clarkb | ya | 01:51 |
| fungi | anyway, not as an http header | 01:51 |
| *** sdake__ has joined #openstack-infra | 01:52 | |
| *** bswartz has joined #openstack-infra | 01:53 | |
| *** tqtran has quit IRC | 01:54 | |
| *** luqas has quit IRC | 01:55 | |
| *** sdake has quit IRC | 01:56 | |
| *** kevinbenton has joined #openstack-infra | 01:57 | |
| *** tsg has quit IRC | 01:57 | |
| openstackgerrit | Steve Baker proposed openstack-infra/project-config: Use ssh publisher for heat-templates-buildimages https://review.openstack.org/163233 | 01:57 |
| *** saper has quit IRC | 01:58 | |
| clarkb | stevebaker: I am not sure we have that publisherinstalled | 01:58 |
| stevebaker | clarkb: I've not found any other uses of ssh. Any suggestions? symlinks are not preserved for scp copies | 01:59 |
| *** annegentle has joined #openstack-infra | 01:59 | |
| clarkb | stevebaker: you might want to use the swift uploader which is lightly new and may need a bit more thought but swift should protect against these issues | 02:00 |
| clarkb | stevebaker: since swift will either give you old object or new object with same name but never something in between | 02:00 |
| stevebaker | that could work | 02:01 |
| *** macjack has joined #openstack-infra | 02:01 | |
| *** patrickeast has quit IRC | 02:02 | |
| openstackgerrit | Merged openstack-infra/project-config: zuul-swift-upload fix delete-after https://review.openstack.org/164023 | 02:03 |
| openstackgerrit | Merged openstack-infra/project-config: zuul-swift-upload ensure delete after is an int https://review.openstack.org/164024 | 02:03 |
| stevebaker | clarkb: any examples or docs for swift uploader? | 02:03 |
| clarkb | stevebaker ya grep for zuul-swift in the jenkins jobs iirc | 02:03 |
| clarkb | its the script in the above two changes | 02:04 |
| *** annegentle has quit IRC | 02:04 | |
| fungi | it also has the added benefit of here have some more dogfood | 02:05 |
| *** hdd_ has joined #openstack-infra | 02:06 | |
| stevebaker | whose swift does it go to? | 02:06 |
| *** ivar-lazzaro has quit IRC | 02:06 | |
| lifeless | rackspace I suspect | 02:06 |
| fungi | yep | 02:07 |
| clarkb | yes its our rax account | 02:07 |
| *** harlowja is now known as harlowja_away | 02:07 | |
| *** asselin has quit IRC | 02:09 | |
| *** asselin has joined #openstack-infra | 02:10 | |
| *** dustins has quit IRC | 02:11 | |
| *** dustins has joined #openstack-infra | 02:12 | |
| *** asettle-mtg has quit IRC | 02:13 | |
| *** dims has quit IRC | 02:14 | |
| stevebaker | clarkb: does bare-trusty have the /usr/zuul-swift-logs-env venv etc? | 02:15 |
| jhesketh | stevebaker: should be on all the nodes | 02:16 |
| stevebaker | ok | 02:16 |
| *** marun has joined #openstack-infra | 02:16 | |
| *** Longgeek has joined #openstack-infra | 02:18 | |
| fungi | once we have wheel caching, we might want to revisit installing it at job runtime | 02:18 |
| *** unicell has quit IRC | 02:19 | |
| *** annegentle has joined #openstack-infra | 02:19 | |
| ianw | so what's the deal with puppet-apply precise job ... it seems to be skipping a ton of stuff with a lot of errors, but doesn't fail : http://logs.openstack.org/36/164036/1/check/gate-infra-puppet-apply-precise/ec51639/console.html | 02:22 |
| *** marun has quit IRC | 02:22 | |
| fungi | it runs with --noop which causes it to not do a bunch of operations it thinks would be intrusive, and considers those as prerequisites for other stuff | 02:24 |
| *** annegentle has quit IRC | 02:25 | |
| *** annegentle has joined #openstack-infra | 02:26 | |
| openstackgerrit | Emma Barber proposed openstack-infra/system-config: Prepend variables in devstack-gate-secure template with @ https://review.openstack.org/164058 | 02:26 |
| fungi | do we still use that ^ file? | 02:30 |
| fungi | that was from pre-nodepool worker management right? | 02:30 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config: Generate nodepool logging configuration https://review.openstack.org/164036 | 02:31 |
| *** baoli has quit IRC | 02:32 | |
| *** baoli has joined #openstack-infra | 02:32 | |
| *** reed has quit IRC | 02:33 | |
| *** dims has joined #openstack-infra | 02:34 | |
| *** Longgeek has quit IRC | 02:35 | |
| *** apevec has quit IRC | 02:38 | |
| *** dims has quit IRC | 02:39 | |
| fungi | yeah, git log confirms we stopped using it as of https://review.openstack.org/42263 (nearly two years ago) | 02:39 |
| openstackgerrit | Merged openstack-infra/gerritlib: Doc generation support https://review.openstack.org/94861 | 02:42 |
| *** sigmavirus24_awa is now known as sigmavirus24 | 02:42 | |
| *** devlaps has quit IRC | 02:43 | |
| *** mpopow_ has quit IRC | 02:43 | |
| jesusaurus | fungi: ianw: i was thinking about the apply jobs earlier today and had a crazy idea: i wonder how hard it would be to create a multi-node job that actually applied the puppet clases rather than using noop mode | 02:44 |
| jesusaurus | i think the hardest part would be determining the number of subnodes | 02:44 |
| *** achanda has joined #openstack-infra | 02:44 | |
| fungi | jesusaurus: that's sort of been the holy grail, but how about single-node? how much would we have to fix that we couldn't call legitimate bugs to try and install it all on one vm? | 02:45 |
| jesusaurus | well, we would probably have weird bugs related to running two different classes that dont normally apply to the same host | 02:45 |
| jesusaurus | so that route would kinda require a separate job for each node definition in site.pp | 02:45 |
| *** tkelsey has joined #openstack-infra | 02:46 | |
| *** annegentle has quit IRC | 02:46 | |
| *** sdake__ has quit IRC | 02:49 | |
| nibalizer | crinkle: https://review.openstack.org/#/c/162830/ | 02:50 |
| ianw | jesusaurus: yeah, i had a legitimate spelling mistake in https://review.openstack.org/#/c/164036/ , but only one of the three tests seemed to find it | 02:50 |
| *** tkelsey has quit IRC | 02:50 | |
| fungi | jesusaurus: i think that qualifies as actual bugs, for example people have been submitting patches to make it possible to install zuul and nodepool or zuul and jenkins on the same machine | 02:50 |
| openstackgerrit | Emma Barber proposed openstack-infra/system-config: Remove devstack-gate-secure template https://review.openstack.org/164058 | 02:51 |
| jesusaurus | fungi: thats a good point, but doesnt address masked failures (they should fail but dont because of a previous module ran) that would happen if we cycle through all the node definitions on a single host | 02:54 |
| *** baoli has quit IRC | 02:54 | |
| fungi | jesusaurus: that too is an excellent point | 02:54 |
| fungi | so, yes, a ~20-way multinode ;) | 02:55 |
| jesusaurus | or ~20 seperate jobs | 02:55 |
| *** amotoki has joined #openstack-infra | 02:55 | |
| fungi | sure | 02:55 |
| jesusaurus | but yeah, multinode would be preferable | 02:55 |
| fungi | or some compromise in between those two distasteful extremes | 02:56 |
| fungi | or one machine full of separate chroots for all the site manifest entries? | 02:56 |
| fungi | bar napkin diagram forthcoming | 02:57 |
| jesusaurus | oh, now theres an idea | 02:57 |
| jesusaurus | nibalizer: would probably mention docker/rocket right about now | 02:57 |
| nibalizer | wut | 02:58 |
| fungi | or that other thing puppeteers are using to do integration testing these days | 02:58 |
| fungi | cue buzzword i forgot | 02:58 |
| jesusaurus | i think the puppet community still loves vagrant? | 02:59 |
| *** ashleighfarnham has quit IRC | 02:59 | |
| fungi | i.e. a chroot by any other name would smell as sweet | 02:59 |
| nibalizer | no one loves vagrant | 02:59 |
| nibalizer | please replace vagrant with something | 02:59 |
| *** ghostpl_ has joined #openstack-infra | 02:59 | |
| clarkb | d3.sh | 02:59 |
| greghaynes | \O/ | 02:59 |
| greghaynes | I really need to rename the script to that | 02:59 |
| nibalizer | clarkb: so i haven't been able yet to build a machine with dib that doesn't waste several minutes trying to cloud init | 02:59 |
| nibalizer | and i have been trying | 03:00 |
| jesusaurus | but yeah, some sort of chroot would be a good middle ground between 20subnodes and 20 jobs | 03:00 |
| nibalizer | but if you know how please let me know | 03:00 |
| *** amotoki has quit IRC | 03:00 | |
| nibalizer | jesusaurus: so id like to work on an acceptance test that applies only to openstack_project::server using either serverspec or its python equivalent | 03:00 |
| nibalizer | start there, see how that feels, and go from there | 03:00 |
| greghaynes | nibalizer: yea, so I thought I explained this - theres two ways to prevent the web polling: provide a valid datasource that is checked before that one is or disable that one | 03:01 |
| greghaynes | nibalizer: I think just supplying a nocloud datasource is sufficient, actually | 03:01 |
| greghaynes | nibalizer: is nocloud how youre trying to do it? | 03:01 |
| nibalizer | greghaynes: i've tried a lot of combinations of things, cloud-init-nocloud setting manually a datasource, trying to build an element to forcibly remove cloud init | 03:01 |
| nibalizer | none of that has worked | 03:01 |
| nibalizer | i would like your help getting it working though, if you're willing | 03:02 |
| openstackgerrit | Merged openstack-infra/devstack-gate: add oslo.versionedobjects https://review.openstack.org/162218 | 03:02 |
| jesusaurus | nibalizer: well, acceptance tests on the modules is one thing, and the apply test is something else. because the apply test is testing combinations of modules with specific parameters rather than a range of parameters on a single module | 03:02 |
| greghaynes | nibalizer: using the cloudinit-nocloud element (which I think is what you mean?) is equivilent to trying to disable the other datasources. Its possible thats just not tested, in my setup I actually provide a nocloud datasource and dont disable the others | 03:03 |
| *** koolhead17 has joined #openstack-infra | 03:03 | |
| *** koolhead17 has quit IRC | 03:03 | |
| *** koolhead17 has joined #openstack-infra | 03:03 | |
| nibalizer | greghaynes: how do you provide a nocloud datasource? could you help me get through that | 03:04 |
| *** ghostpl_ has quit IRC | 03:04 | |
| *** ddieterl_ has quit IRC | 03:04 | |
| *** bdpayne has joined #openstack-infra | 03:05 | |
| nibalizer | greghaynes: yes i do mean cloudinit-nocloud element | 03:05 |
| greghaynes | well, I guess the first question is, do you need cloud-init? Because if you do then working on disabling it probably isnt the most useful | 03:05 |
| nibalizer | fungi: 'beaker' i believe is the word you are looking for | 03:05 |
| greghaynes | but if you dont then maybe its worth doing that way | 03:05 |
| *** Ryan_Lane has quit IRC | 03:05 | |
| *** bdpayne has quit IRC | 03:06 | |
| nibalizer | I am setting up users and ssh keys in a different element, so I don't think i need cloud-init | 03:06 |
| fungi | nibalizer: thanks, that was it | 03:06 |
| greghaynes | ah, ok | 03:06 |
| greghaynes | so yea, you probably dont need | 03:06 |
| greghaynes | lemme try and repro | 03:06 |
| *** ptoohill has quit IRC | 03:06 | |
| nibalizer | i also dont like the burden of having to set up something to respond to the ec2metadata thing, though if there is a tiny python/go program to do that i would be interested | 03:06 |
| nibalizer | i can give you my disk-image-create lines if you want | 03:07 |
| greghaynes | nibalizer: nocloud is basically that (albeit in a not much easier to use way) | 03:07 |
| greghaynes | http://cloudinit.readthedocs.org/en/latest/topics/datasources.html#no-cloud | 03:07 |
| nibalizer | nocloud is the config-drive thing? | 03:07 |
| nibalizer | mm yep it is | 03:08 |
| *** sdake has joined #openstack-infra | 03:08 | |
| greghaynes | I think they are separate but similar | 03:08 |
| nibalizer | ok | 03:10 |
| *** ptoohill has joined #openstack-infra | 03:11 | |
| *** amitgandhinz has quit IRC | 03:13 | |
| *** jaypipes has joined #openstack-infra | 03:18 | |
| *** sdake__ has joined #openstack-infra | 03:19 | |
| *** nelsnelson has joined #openstack-infra | 03:19 | |
| greghaynes | nibalizer: are you sure its cloud-init thats hanging? | 03:19 |
| * mordred throws llama at everyone | 03:20 | |
| *** ptoohill has quit IRC | 03:20 | |
| greghaynes | broadcast llama | 03:20 |
| fungi | llama fanout | 03:22 |
| *** tsg has joined #openstack-infra | 03:22 | |
| *** sdake has quit IRC | 03:22 | |
| greghaynes | nibalizer: and not that your vm is trying to dhcp? | 03:23 |
| *** gyee has quit IRC | 03:23 | |
| *** ptoohill has joined #openstack-infra | 03:23 | |
| *** dimtruck is now known as zz_dimtruck | 03:24 | |
| *** spzala has quit IRC | 03:25 | |
| *** ptoohill has quit IRC | 03:26 | |
| *** otter768 has joined #openstack-infra | 03:28 | |
| *** MarkAtwood has joined #openstack-infra | 03:30 | |
| *** Longgeek has joined #openstack-infra | 03:31 | |
| *** tiswanso has quit IRC | 03:32 | |
| *** otter768 has quit IRC | 03:33 | |
| greghaynes | nibalizer: yea, that lets me repro (if you have working dhcp then itll try and hit ec2, get a RST, and fail fast) | 03:33 |
| *** ptoohill has joined #openstack-infra | 03:35 | |
| *** cody-somerville has joined #openstack-infra | 03:36 | |
| *** cody-somerville has quit IRC | 03:36 | |
| *** cody-somerville has joined #openstack-infra | 03:36 | |
| nibalizer | ah | 03:38 |
| nibalizer | i haven't set up any dhcp business using d3 | 03:38 |
| nibalizer | er i've been using d3 | 03:38 |
| greghaynes | well by default libvirt will runs dnsmasq on ubuntu | 03:38 |
| nibalizer | so haven't set up anything that isn't default | 03:38 |
| nibalizer | right | 03:38 |
| greghaynes | but I think thats whats going on - cloud-init isnt going to fire until networking is up, and by default I think it tries to dhcp | 03:39 |
| greghaynes | so what datasources are in use is irrelevant | 03:39 |
| *** MarkAtwood has quit IRC | 03:40 | |
| nibalizer | okay dib is running now, i'll report back on the dhcp/dnsmasq situation | 03:41 |
| *** Longgeek has quit IRC | 03:41 | |
| *** asettle has joined #openstack-infra | 03:42 | |
| *** Longgeek has joined #openstack-infra | 03:52 | |
| *** gokrokve has joined #openstack-infra | 03:53 | |
| *** nelsnelson has quit IRC | 03:57 | |
| *** nijaba has quit IRC | 04:01 | |
| *** MarkAtwood has joined #openstack-infra | 04:01 | |
| *** MarkAtwood has quit IRC | 04:01 | |
| *** mpopow_ has joined #openstack-infra | 04:02 | |
| *** mpopow__ has joined #openstack-infra | 04:03 | |
| *** ddieterly has joined #openstack-infra | 04:05 | |
| *** liusheng has joined #openstack-infra | 04:06 | |
| *** bhunter71 has quit IRC | 04:06 | |
| *** nijaba has joined #openstack-infra | 04:07 | |
| *** nijaba has joined #openstack-infra | 04:07 | |
| *** mpopow_ has quit IRC | 04:07 | |
| *** gokrokve has quit IRC | 04:09 | |
| *** sdake__ has quit IRC | 04:09 | |
| *** ddieterly has quit IRC | 04:09 | |
| *** garyh has quit IRC | 04:09 | |
| *** amotoki has joined #openstack-infra | 04:11 | |
| *** BharatK has joined #openstack-infra | 04:12 | |
| *** mpopow has joined #openstack-infra | 04:13 | |
| SumitNaiksatam | jhesketh: hi there | 04:13 |
| *** mpopow_ has joined #openstack-infra | 04:13 | |
| jhesketh | SumitNaiksatam: Howdy | 04:14 |
| SumitNaiksatam | jhesketh: thanks for the review on: https://review.openstack.org/#/c/161511 | 04:14 |
| *** mpopow__ has quit IRC | 04:15 | |
| SumitNaiksatam | jhesketh: pardon my ignorance - i was trying to understand what you meant when you said “don't really need two jobs” | 04:15 |
| *** cody-somerville has quit IRC | 04:15 | |
| *** amotoki has quit IRC | 04:15 | |
| *** mpopow has quit IRC | 04:17 | |
| SumitNaiksatam | jhesketh: i defined the job template in: https://review.openstack.org/#/c/161511/5/jenkins/jobs/group-based-policy.yaml | 04:18 |
| SumitNaiksatam | jhesketh: there? | 04:20 |
| *** unicell has joined #openstack-infra | 04:23 | |
| jhesketh | SumitNaiksatam: sorry was on the phone | 04:25 |
| SumitNaiksatam | jhesketh: no worries | 04:25 |
| jhesketh | SumitNaiksatam: you have a check- and a gate- version of the same job.. Where there is no difference there is no real harm in using the gate- version for both the check and gate pipelines | 04:26 |
| jhesketh | do you need a different job for check vs gate? | 04:26 |
| SumitNaiksatam | jhesketh: no i dont, but i saw the pattern being used throughout projects.yaml | 04:27 |
| SumitNaiksatam | jhesketh: oh are you referring to the job definition in zuul/layout.yaml? | 04:28 |
| jhesketh | SumitNaiksatam: in projects.yaml | 04:29 |
| jhesketh | I think some of them have slight differences, some of them may be duplicates though | 04:29 |
| jhesketh | there's no real harm in duplicating so my -1 is perhaps a little unncessary | 04:29 |
| jhesketh | just something to note, I'm happy to change my vote though re-looking at it | 04:30 |
| SumitNaiksatam | jhesketh: ah okay | 04:30 |
| SumitNaiksatam | jhesketh: thanks for looking at it again | 04:32 |
| jhesketh | no trouble | 04:33 |
| *** dboik_ has quit IRC | 04:34 | |
| *** zz_dimtruck is now known as dimtruck | 04:36 | |
| *** hdd_ has quit IRC | 04:37 | |
| *** sarob has joined #openstack-infra | 04:37 | |
| *** woodster_ has quit IRC | 04:40 | |
| *** sarob has quit IRC | 04:41 | |
| *** sputnik13 has joined #openstack-infra | 04:43 | |
| *** mtanino has quit IRC | 04:46 | |
| *** Longgeek has quit IRC | 04:47 | |
| *** ayoung has quit IRC | 04:47 | |
| *** ghostpl_ has joined #openstack-infra | 04:48 | |
| *** SumitNaiksatam has quit IRC | 04:51 | |
| *** ghostpl_ has quit IRC | 04:52 | |
| *** SumitNaiksatam has joined #openstack-infra | 04:52 | |
| dstufft | clarkb: across the board is good | 04:57 |
| *** ujuc has joined #openstack-infra | 04:59 | |
| *** mpopow_ has quit IRC | 05:00 | |
| *** gnuoy has quit IRC | 05:05 | |
| *** jamespage has quit IRC | 05:05 | |
| *** gnuoy has joined #openstack-infra | 05:05 | |
| *** jamespage has joined #openstack-infra | 05:05 | |
| *** ddieterly has joined #openstack-infra | 05:06 | |
| *** ivar-lazzaro has joined #openstack-infra | 05:10 | |
| *** garyh has joined #openstack-infra | 05:10 | |
| *** ddieterly has quit IRC | 05:10 | |
| *** sputnik13 has quit IRC | 05:11 | |
| openstackgerrit | Anne Gentle proposed openstack/requirements: Updates the openstackdocstheme to 1.0.4 to pick up bug fixes https://review.openstack.org/164077 | 05:13 |
| *** coolsvap|afk is now known as coolsvap | 05:14 | |
| *** ivar-lazzaro has quit IRC | 05:17 | |
| *** vigneshvar has joined #openstack-infra | 05:24 | |
| *** asettle has quit IRC | 05:26 | |
| *** dimtruck is now known as zz_dimtruck | 05:28 | |
| *** otter768 has joined #openstack-infra | 05:29 | |
| *** ghostpl_ has joined #openstack-infra | 05:32 | |
| *** AJaeger has joined #openstack-infra | 05:33 | |
| *** otter768 has quit IRC | 05:34 | |
| *** Longgeek has joined #openstack-infra | 05:48 | |
| *** unicell has quit IRC | 05:53 | |
| *** unicell has joined #openstack-infra | 05:54 | |
| openstackgerrit | Merged openstack-infra/project-config: Turn on post taskflow coverage report https://review.openstack.org/164025 | 05:59 |
| *** ashleighfarnham has joined #openstack-infra | 05:59 | |
| *** faizan has joined #openstack-infra | 06:01 | |
| *** yfried|afk is now known as yfried | 06:02 | |
| *** ashleighfarnham has quit IRC | 06:04 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/164082 | 06:06 |
| *** ddieterly has joined #openstack-infra | 06:07 | |
| *** achanda has quit IRC | 06:10 | |
| *** markvoelker has quit IRC | 06:11 | |
| *** ddieterly has quit IRC | 06:11 | |
| *** markvoelker has joined #openstack-infra | 06:12 | |
| *** achanda has joined #openstack-infra | 06:13 | |
| *** markvoelker has quit IRC | 06:16 | |
| *** sdake_ has quit IRC | 06:17 | |
| *** Sukhdev has joined #openstack-infra | 06:18 | |
| *** vigneshvar has quit IRC | 06:19 | |
| *** sdake_ has joined #openstack-infra | 06:21 | |
| *** Longgeek has quit IRC | 06:21 | |
| *** stevemar has quit IRC | 06:22 | |
| *** amotoki has joined #openstack-infra | 06:23 | |
| *** armax has quit IRC | 06:25 | |
| *** achanda has quit IRC | 06:28 | |
| *** achanda has joined #openstack-infra | 06:34 | |
| *** yfried is now known as yfried|afk | 06:35 | |
| *** stevemar has joined #openstack-infra | 06:35 | |
| *** skraynev has joined #openstack-infra | 06:37 | |
| *** achanda has quit IRC | 06:38 | |
| *** michchap has quit IRC | 06:38 | |
| *** markvoelker has joined #openstack-infra | 06:42 | |
| *** Sukhdev has quit IRC | 06:43 | |
| *** stevemar has quit IRC | 06:44 | |
| *** markvoelker has quit IRC | 06:47 | |
| *** mrda is now known as mrda-weekend | 06:49 | |
| *** jcoufal has joined #openstack-infra | 06:51 | |
| *** coolsvap is now known as coolsvap|afk | 06:54 | |
| *** yfried|afk is now known as yfried | 06:55 | |
| *** michchap has joined #openstack-infra | 06:58 | |
| *** mrunge has quit IRC | 07:00 | |
| *** fdegir has joined #openstack-infra | 07:00 | |
| *** mrunge has joined #openstack-infra | 07:01 | |
| *** afazekas has joined #openstack-infra | 07:04 | |
| *** yfried is now known as yfried|afk | 07:05 | |
| *** scheuran has joined #openstack-infra | 07:05 | |
| *** ddieterly has joined #openstack-infra | 07:08 | |
| *** coolsvap has joined #openstack-infra | 07:09 | |
| *** SumitNaiksatam has quit IRC | 07:09 | |
| *** ddieterly has quit IRC | 07:13 | |
| *** krisgan has quit IRC | 07:16 | |
| *** tkelsey has joined #openstack-infra | 07:17 | |
| *** Longgeek has joined #openstack-infra | 07:18 | |
| *** dims has joined #openstack-infra | 07:23 | |
| *** Qiming has quit IRC | 07:23 | |
| *** Qiming has joined #openstack-infra | 07:23 | |
| *** camunoz has quit IRC | 07:27 | |
| *** tnovacik has joined #openstack-infra | 07:27 | |
| *** dims has quit IRC | 07:27 | |
| *** otter768 has joined #openstack-infra | 07:30 | |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Refactor sources out of triggers https://review.openstack.org/118993 | 07:30 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add gerrit reviews into patchset approvals https://review.openstack.org/97390 | 07:30 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add support for negative requirements https://review.openstack.org/102726 | 07:31 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Configure triggers dynamically https://review.openstack.org/119534 | 07:31 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add support for 'connection' concept https://review.openstack.org/121528 | 07:31 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add base class for triggers https://review.openstack.org/119532 | 07:31 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add base class for sources https://review.openstack.org/119531 | 07:31 |
| openstackgerrit | Joshua Hesketh proposed openstack-infra/zuul: Add base class for reporters https://review.openstack.org/119530 | 07:31 |
| *** jamielennox has quit IRC | 07:31 | |
| *** jamielennox has joined #openstack-infra | 07:34 | |
| *** otter768 has quit IRC | 07:35 | |
| *** yfried|afk is now known as yfried | 07:39 | |
| *** jamielennox has quit IRC | 07:39 | |
| *** mpavone has joined #openstack-infra | 07:39 | |
| *** Longgeek has quit IRC | 07:41 | |
| *** Longgeek has joined #openstack-infra | 07:41 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Make gerritbot report changes from Gerrit 2.9.4 branch https://review.openstack.org/155450 | 07:42 |
| *** markvoelker has joined #openstack-infra | 07:43 | |
| *** markvoelker has quit IRC | 07:48 | |
| *** yfried is now known as yfried|afk | 07:49 | |
| *** jamielennox|away has joined #openstack-infra | 07:55 | |
| openstackgerrit | Merged openstack-infra/project-config: Update dib script usage https://review.openstack.org/163217 | 07:55 |
| *** jamielennox|away is now known as jamielennox | 07:55 | |
| openstackgerrit | Merged openstack-infra/project-config: New project: puppet-modulesync-configs https://review.openstack.org/162902 | 07:58 |
| openstackgerrit | Yichen Wang proposed openstack-infra/project-config: Add the create permission for stackforge/vmtp https://review.openstack.org/164044 | 07:58 |
| *** coolsvap has quit IRC | 07:59 | |
| *** markus_z has joined #openstack-infra | 08:00 | |
| openstackgerrit | Marc Koderer proposed openstack-infra/project-config: Add non-voting job for Manila scenario tests https://review.openstack.org/164102 | 08:02 |
| *** [HeOS] has quit IRC | 08:07 | |
| *** ddieterly has joined #openstack-infra | 08:08 | |
| *** chlong has quit IRC | 08:09 | |
| GheRivero | morning all | 08:09 |
| *** _nadya_ has joined #openstack-infra | 08:10 | |
| *** jistr has joined #openstack-infra | 08:12 | |
| *** ddieterly has quit IRC | 08:13 | |
| *** rlandy has joined #openstack-infra | 08:21 | |
| *** arxcruz has joined #openstack-infra | 08:21 | |
| *** openstackgerrit has quit IRC | 08:21 | |
| *** openstackgerrit has joined #openstack-infra | 08:21 | |
| *** _nadya_ has quit IRC | 08:23 | |
| openstackgerrit | Adam Gandelman proposed openstack-infra/elastic-recheck: Add query for 1431724 https://review.openstack.org/164106 | 08:26 |
| *** hashar has joined #openstack-infra | 08:27 | |
| *** dizquierdo has joined #openstack-infra | 08:29 | |
| *** ihrachyshka has joined #openstack-infra | 08:30 | |
| openstackgerrit | Kevin Carter proposed openstack-infra/project-config: Updates for os-ansible-deployment adding specs repos and doc config https://review.openstack.org/163960 | 08:36 |
| *** jlanoux has joined #openstack-infra | 08:38 | |
| *** markvoelker has joined #openstack-infra | 08:44 | |
| *** yfried|afk is now known as yfried | 08:46 | |
| *** jistr has quit IRC | 08:46 | |
| *** Hal has joined #openstack-infra | 08:48 | |
| openstackgerrit | Tushar Gohad proposed openstack/requirements: Bump PyECLib version to 1.0.3 https://review.openstack.org/164112 | 08:48 |
| *** ihrachyshka has quit IRC | 08:48 | |
| *** Hal is now known as Guest24826 | 08:48 | |
| *** markvoelker has quit IRC | 08:48 | |
| openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/164082 | 08:52 |
| *** andreykurilin_ has joined #openstack-infra | 08:53 | |
| *** amotoki has quit IRC | 08:57 | |
| *** trey has quit IRC | 09:00 | |
| *** trey has joined #openstack-infra | 09:01 | |
| *** luqas has joined #openstack-infra | 09:03 | |
| *** tkelsey has quit IRC | 09:04 | |
| *** jistr has joined #openstack-infra | 09:04 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Parameterize url to clone puppet modules https://review.openstack.org/163376 | 09:04 |
| *** yfried is now known as yfried|afk | 09:05 | |
| *** yolanda has joined #openstack-infra | 09:05 | |
| *** katyafervent is now known as katyafervent_awa | 09:06 | |
| *** kaisers1 has joined #openstack-infra | 09:07 | |
| kaisers1 | Hello Infra! | 09:07 |
| kaisers1 | Can anyone help me with connectivity issues to the openstack backend (gerrit, git servers)? | 09:08 |
| *** ddieterly has joined #openstack-infra | 09:09 | |
| kaisers1 | According to mtr i have serious package loss (~50%) when connecting from europe to e.g. git.openstack.org servers (git-fe02.openstack.org in this example) | 09:10 |
| *** e0ne has joined #openstack-infra | 09:11 | |
| *** tkelsey has joined #openstack-infra | 09:11 | |
| kaisers1 | Seems to be at the connection point between rackspace and 'zayo.com' | 09:11 |
| kaisers1 | Data loss this size makes thirdparty ci integration quite a hassle. :) | 09:12 |
| *** ddieterly has quit IRC | 09:14 | |
| *** katyafervent_awa is now known as katyafervent | 09:15 | |
| *** e0ne has quit IRC | 09:16 | |
| *** hichihara has quit IRC | 09:16 | |
| *** Longgeek has quit IRC | 09:16 | |
| openstackgerrit | Anthony Michon proposed openstack-infra/project-config: Add cerberus-dashboard, python-cerberusclient, sticks, sticks-dashboard, python-sticksclient https://review.openstack.org/163876 | 09:17 |
| *** yfried|afk is now known as yfried | 09:18 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/elastic-recheck: Add query for bug 1431724 https://review.openstack.org/164120 | 09:19 |
| openstack | bug 1431724 in tempest "test_preserve_preexisting_port failing against icehouse" [Undecided,New] https://launchpad.net/bugs/1431724 | 09:19 |
| *** amotoki has joined #openstack-infra | 09:20 | |
| *** e0ne has joined #openstack-infra | 09:20 | |
| andreaf | 43 hits in the last ~7h ^^^^ | 09:21 |
| *** [HeOS] has joined #openstack-infra | 09:23 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 09:24 | |
| *** bnemec has quit IRC | 09:24 | |
| *** bnemec has joined #openstack-infra | 09:25 | |
| *** yfried is now known as yfried|afk | 09:28 | |
| *** zz_johnthetubagu is now known as johnthetubaguy | 09:29 | |
| *** koolhead17 has quit IRC | 09:30 | |
| *** otter768 has joined #openstack-infra | 09:31 | |
| *** andreykurilin_ has quit IRC | 09:31 | |
| *** andreykurilin_ has joined #openstack-infra | 09:32 | |
| andreaf | here - any infra-core / e-r-core around to review https://review.openstack.org/164120 | 09:33 |
| andreaf | s/here/hi | 09:33 |
| AJaeger | kaisers1: you might need to wait for somebody from the US to show up for your question | 09:33 |
| AJaeger | andreaf: see here for the list of cores: https://review.openstack.org/#/admin/groups/218,members | 09:34 |
| mkoderer | vponomaryov: could you have a look to https://review.openstack.org/#/c/164102/, AJaeger suggested to move it into experimental queue instead | 09:34 |
| andreaf | AJaeger: I think apart from SergeyLukjanov they are all US based | 09:34 |
| andreaf | AJaeger: but maybe someone's travelling or can't sleep at night :D | 09:35 |
| *** otter768 has quit IRC | 09:35 | |
| AJaeger | andreaf: ;) | 09:35 |
| *** e0ne has quit IRC | 09:37 | |
| kaisers1 | AJaeger: yep, i fear so. :) | 09:38 |
| mkoderer | andreaf: I bet sdague will be the first one awake :) | 09:39 |
| andreaf | mkoderer: indeed :) | 09:40 |
| *** dims has joined #openstack-infra | 09:42 | |
| andreaf | mkoderer: but maybe you want to have a look at https://review.openstack.org/#/c/164121/ - revert for the commit which introduced the issue | 09:42 |
| mkoderer | __afazekas: time for +A this one? ^ | 09:43 |
| *** markvoelker has joined #openstack-infra | 09:45 | |
| *** yfried|afk is now known as yfried | 09:46 | |
| *** dims has quit IRC | 09:47 | |
| *** vigneshvar has joined #openstack-infra | 09:47 | |
| vponomaryov | mkoderer: https://review.openstack.org/#/c/164102/ completely duplicates existing tempest job with API tests. And yes, it should be experimental job | 09:48 |
| vponomaryov | mkoderer: I guess we can update our "post_test_hook" to handle test suites by job name, but it is not described in infra commit | 09:49 |
| *** markvoelker has quit IRC | 09:49 | |
| mkoderer | vponomaryov: yep this was my idea.. to use $JOB_NAME for that | 09:50 |
| *** ssam2 has joined #openstack-infra | 09:50 | |
| mkoderer | vponomaryov: all right, I will move it to experimental and add it in the commit msg | 09:50 |
| *** Qiming has quit IRC | 09:50 | |
| *** prabhu has joined #openstack-infra | 09:52 | |
| prabhu | i am creating third party ci setup ..i would like to know how to push the result back to review board | 09:53 |
| *** dims has joined #openstack-infra | 09:54 | |
| prabhu | i see http log links on right side of every review ID from third party (non-voting) | 09:55 |
| *** Ala has joined #openstack-infra | 09:56 | |
| prabhu | i am creating third party ci setup ..i would like to know how to push the result back to review board | 09:57 |
| *** derekh has joined #openstack-infra | 09:57 | |
| AJaeger | prabhu: see http://ci.openstack.org/third_party.html - and join the weekly meeting of third part CI admins | 09:58 |
| *** prabhu has quit IRC | 10:01 | |
| openstackgerrit | Kevin Carter proposed openstack-infra/project-config: Updates for os-ansible-deployment adding specs repos and doc config https://review.openstack.org/163960 | 10:01 |
| *** ujuc has quit IRC | 10:02 | |
| *** luqas has quit IRC | 10:04 | |
| openstackgerrit | Alvaro Lopez Ortega proposed openstack-infra/project-config: Updates the #rdo-puppet entry https://review.openstack.org/164129 | 10:04 |
| *** yfried is now known as yfried|afk | 10:06 | |
| *** ihrachyshka has joined #openstack-infra | 10:08 | |
| *** [HeOS] is now known as HeOS | 10:10 | |
| *** ddieterly has joined #openstack-infra | 10:10 | |
| *** yamamoto has quit IRC | 10:11 | |
| openstackgerrit | Marc Koderer proposed openstack-infra/project-config: Add experimental job for Manila scenario tests https://review.openstack.org/164102 | 10:11 |
| openstackgerrit | Alvaro Lopez Ortega proposed openstack-infra/project-config: Updated Packstack project https://review.openstack.org/164130 | 10:14 |
| *** ddieterly has quit IRC | 10:15 | |
| *** jp_at_hp has joined #openstack-infra | 10:15 | |
| *** Longgeek has joined #openstack-infra | 10:17 | |
| *** e0ne has joined #openstack-infra | 10:17 | |
| *** e0ne is now known as e0ne_ | 10:17 | |
| *** skraynev has quit IRC | 10:19 | |
| *** vigneshvar has quit IRC | 10:19 | |
| *** skraynev has joined #openstack-infra | 10:19 | |
| openstackgerrit | Alvaro Lopez Ortega proposed openstack-infra/project-config: Updated Packstack project https://review.openstack.org/163331 | 10:21 |
| *** e0ne_ is now known as e0ne | 10:22 | |
| *** koolhead17 has joined #openstack-infra | 10:22 | |
| *** e0ne_ has joined #openstack-infra | 10:28 | |
| *** e0ne has quit IRC | 10:29 | |
| *** yfried|afk is now known as yfried | 10:29 | |
| *** pc_m has joined #openstack-infra | 10:29 | |
| *** Longgeek has quit IRC | 10:32 | |
| *** luqas has joined #openstack-infra | 10:35 | |
| *** yamamoto has joined #openstack-infra | 10:37 | |
| BobBall | clarkb: Do you feel your comment on https://review.openstack.org/#/c/161165/ still stands given my replies? | 10:39 |
| *** andreykurilin_ has quit IRC | 10:39 | |
| *** dizquierdo has quit IRC | 10:40 | |
| *** luqas has quit IRC | 10:40 | |
| *** vigneshvar has joined #openstack-infra | 10:40 | |
| sdague | mkoderer: awake now, what's up? | 10:41 |
| *** fdegir has quit IRC | 10:45 | |
| *** ildikov_ has quit IRC | 10:45 | |
| *** pelix has joined #openstack-infra | 10:45 | |
| *** markvoelker has joined #openstack-infra | 10:46 | |
| andreaf | sdague: https://review.openstack.org/#/c/164120/ - but not sure if it's worth adding an e-r query now, as the revert is going through gate | 10:48 |
| andreaf | sdague: thanks for approving that | 10:48 |
| sdague | andreaf: it always is worth the ER query | 10:48 |
| sdague | because it handles the unclassified case | 10:49 |
| sdague | is that up somewhere? | 10:49 |
| andreaf | sdague: yes, https://review.openstack.org/#/c/164120/ | 10:49 |
| andreaf | sdague: is there a way to say something like "build_name = *icehouse" ? | 10:49 |
| sdague | build_branch="stable/icehouse" | 10:50 |
| *** markvoelker has quit IRC | 10:50 | |
| sdague | I guess in er language | 10:50 |
| sdague | build_branch:"stable/icehouse" | 10:50 |
| andreaf | sdague: that doesn't show all hits | 10:52 |
| andreaf | sdague: we run icehouse jobs agaist master as well (e.g. d-g / tempest) | 10:52 |
| andreaf | sdague: actually one example of branch master is gate-tempest-dsvm-neutron-src-python-ceilometerclient-icehouse | 10:53 |
| andreaf | sdague: so I would live the query as is | 10:54 |
| *** jamielennox has quit IRC | 10:55 | |
| *** yfried is now known as yfried|afk | 10:58 | |
| *** harlowja_away has quit IRC | 10:59 | |
| sdague | ok, but is there a reason to restrict by branch? | 11:00 |
| *** erlon has joined #openstack-infra | 11:01 | |
| andreaf | sdague: well until know the issue has shown-up only on icehouse jobs | 11:02 |
| *** jamielennox|away has joined #openstack-infra | 11:02 | |
| andreaf | sdague: but the proposed e-r query does not filter, and we could leave it as-is | 11:02 |
| *** jamielennox|away is now known as jamielennox | 11:02 | |
| openstackgerrit | Alvaro Lopez Ortega proposed openstack-infra/project-config: Updated Packstack project https://review.openstack.org/163331 | 11:02 |
| openstackgerrit | Alvaro Lopez Ortega proposed openstack-infra/project-config: Updated Packstack project https://review.openstack.org/163331 | 11:05 |
| *** mpaolino has joined #openstack-infra | 11:06 | |
| *** Guest24826 has quit IRC | 11:10 | |
| *** Hal has joined #openstack-infra | 11:11 | |
| *** ddieterly has joined #openstack-infra | 11:11 | |
| *** Hal is now known as Guest8104 | 11:11 | |
| *** bhunter71 has joined #openstack-infra | 11:11 | |
| *** aysyd has joined #openstack-infra | 11:13 | |
| *** jamielennox has quit IRC | 11:14 | |
| *** ddieterly has quit IRC | 11:16 | |
| *** Guest8104 has quit IRC | 11:17 | |
| *** yfried|afk is now known as yfried | 11:18 | |
| *** marcusvrn has joined #openstack-infra | 11:19 | |
| *** aysyd has quit IRC | 11:20 | |
| *** marcusvrn1 has joined #openstack-infra | 11:22 | |
| *** _nadya_ has joined #openstack-infra | 11:23 | |
| *** jamielennox|away has joined #openstack-infra | 11:24 | |
| *** jamielennox|away is now known as jamielennox | 11:24 | |
| *** marcusvrn has quit IRC | 11:25 | |
| *** _nadya_ has quit IRC | 11:28 | |
| SergeyLukjanov | andreaf, +2 from me | 11:32 |
| *** otter768 has joined #openstack-infra | 11:32 | |
| *** otter768 has quit IRC | 11:36 | |
| *** dhritishikhar has joined #openstack-infra | 11:37 | |
| andreaf | SergeyLukjanov: cool | 11:38 |
| *** jedimike has joined #openstack-infra | 11:39 | |
| *** dizquierdo has joined #openstack-infra | 11:41 | |
| *** baoli has joined #openstack-infra | 11:41 | |
| *** ildikov_ has joined #openstack-infra | 11:43 | |
| *** baoli has quit IRC | 11:44 | |
| *** cdent has joined #openstack-infra | 11:44 | |
| *** baoli has joined #openstack-infra | 11:44 | |
| *** ldnunes has joined #openstack-infra | 11:45 | |
| *** jcoufal_ has joined #openstack-infra | 11:45 | |
| *** markvoelker has joined #openstack-infra | 11:46 | |
| *** ujuc has joined #openstack-infra | 11:48 | |
| *** jcoufal has quit IRC | 11:49 | |
| *** dpyzhov_ has joined #openstack-infra | 11:50 | |
| *** vigneshvar has quit IRC | 11:51 | |
| *** markvoelker has quit IRC | 11:51 | |
| *** Vivek has joined #openstack-infra | 11:55 | |
| *** mwagner_lap has joined #openstack-infra | 11:57 | |
| *** fdegir has joined #openstack-infra | 11:58 | |
| *** mpaolino has quit IRC | 12:00 | |
| *** dpyzhov_ has quit IRC | 12:01 | |
| pc_m | Hi, getting a function test failure, where it looks like the gate-hook.sh cannot access devstack's lib.config file to source it. However, that file is there. Anyone know what may be amiss? | 12:01 |
| pc_m | Ref: http://logs.openstack.org/91/144391/62/check/check-neutron-vpnaas-dsvm-functional/9b261cd/ | 12:01 |
| *** nicodemos has quit IRC | 12:01 | |
| *** yfried is now known as yfried|afk | 12:02 | |
| *** ujuc has quit IRC | 12:02 | |
| *** aysyd has joined #openstack-infra | 12:04 | |
| openstackgerrit | Max Rasskazov proposed openstack-infra/jenkins-job-builder: Add support of multiple credentials for ssh-agent-credentials wrapper https://review.openstack.org/156681 | 12:05 |
| openstackgerrit | Lucas Alvares Gomes proposed openstack-infra/project-config: Ironic: Create and enable pxe_ipa-src-nv on ironic-python-agent https://review.openstack.org/163344 | 12:05 |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-zuul: Add fetch_url and poll parameters to zuul.conf https://review.openstack.org/162591 | 12:06 |
| *** Ala has quit IRC | 12:06 | |
| *** markvoelker has joined #openstack-infra | 12:07 | |
| *** ujuc has joined #openstack-infra | 12:11 | |
| *** ddieterly has joined #openstack-infra | 12:12 | |
| pc_m | dtroyer: ping | 12:13 |
| *** Longgeek has joined #openstack-infra | 12:15 | |
| *** bswartz has quit IRC | 12:16 | |
| *** ddieterly has quit IRC | 12:16 | |
| *** bknudson has joined #openstack-infra | 12:21 | |
| *** radez_g0n3 is now known as radez | 12:22 | |
| *** Hal has joined #openstack-infra | 12:23 | |
| *** Hal is now known as Guest22364 | 12:23 | |
| *** chlong has joined #openstack-infra | 12:24 | |
| *** Longgeek has quit IRC | 12:31 | |
| *** macjack has quit IRC | 12:32 | |
| *** dizquierdo has quit IRC | 12:37 | |
| *** yamamoto has quit IRC | 12:37 | |
| *** yamamoto has joined #openstack-infra | 12:41 | |
| *** dprince has joined #openstack-infra | 12:42 | |
| *** hdd_ has joined #openstack-infra | 12:47 | |
| *** weshay has joined #openstack-infra | 12:52 | |
| *** kgiusti has joined #openstack-infra | 12:54 | |
| *** marcusvrn has joined #openstack-infra | 12:57 | |
| *** mriedem_away is now known as mriedem | 12:58 | |
| *** bswartz has joined #openstack-infra | 13:00 | |
| *** marcusvrn1 has quit IRC | 13:01 | |
| *** mattfarina has joined #openstack-infra | 13:02 | |
| *** ujuc has quit IRC | 13:03 | |
| *** ildikov_ has quit IRC | 13:04 | |
| *** dkliban_afk is now known as dkliban | 13:04 | |
| *** marcusvrn1 has joined #openstack-infra | 13:04 | |
| *** eharney has joined #openstack-infra | 13:06 | |
| *** xyang1 has joined #openstack-infra | 13:06 | |
| *** marcusvrn1 has quit IRC | 13:06 | |
| *** marcusvrn1 has joined #openstack-infra | 13:07 | |
| *** marcusvrn has quit IRC | 13:07 | |
| *** ildikov_ has joined #openstack-infra | 13:08 | |
| *** gordc has joined #openstack-infra | 13:09 | |
| *** radez is now known as radez_g0n3 | 13:10 | |
| *** skolekonov has joined #openstack-infra | 13:11 | |
| *** spredzy is now known as spredzy|afk | 13:12 | |
| *** ddieterly has joined #openstack-infra | 13:12 | |
| *** vigneshvar has joined #openstack-infra | 13:15 | |
| *** rfolco has joined #openstack-infra | 13:15 | |
| *** markvoelker has quit IRC | 13:16 | |
| *** markvoelker has joined #openstack-infra | 13:17 | |
| *** ddieterly has quit IRC | 13:17 | |
| *** scheuran has quit IRC | 13:19 | |
| *** dboik has joined #openstack-infra | 13:21 | |
| *** marcusvrn1 has quit IRC | 13:21 | |
| *** peristeri has joined #openstack-infra | 13:22 | |
| *** marcusvrn has joined #openstack-infra | 13:22 | |
| *** mpaolino has joined #openstack-infra | 13:24 | |
| *** yfried|afk has quit IRC | 13:24 | |
| *** tiswanso has joined #openstack-infra | 13:26 | |
| *** yamamoto has quit IRC | 13:27 | |
| AJaeger | sdague: what do you think about https://review.openstack.org/#/c/156260/ ? The requirement jobs fails because of nova-docker... | 13:28 |
| tristanC | Hello folks, I can't find what is the status of change 163034... Jenkins said it entered the gate yesterday but it did not reported back and it is not in the zuul status page | 13:28 |
| *** mpaolino has quit IRC | 13:31 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/elastic-recheck: Add query for bug 1431724 https://review.openstack.org/164120 | 13:32 |
| openstack | bug 1431724 in tempest "test_preserve_preexisting_port failing against icehouse" [High,Fix released] https://launchpad.net/bugs/1431724 - Assigned to Andrea Frittoli (andrea-frittoli) | 13:32 |
| *** otter768 has joined #openstack-infra | 13:33 | |
| ekarlso | long waiting time at the gate atm :/ | 13:33 |
| fungi | kaisers1: can you post the ip address you're coming from? chances are you're seeing packet loss on the return route, but that routing is asymmetric so to you it looks like it's at the hop where they diverge/converge at the far side | 13:34 |
| *** ujuc has joined #openstack-infra | 13:34 | |
| fungi | kaisers1: if i know where to trace to from our servers i can hopefully pinpoint the actual network at fault | 13:34 |
| *** dhritishikhar has quit IRC | 13:36 | |
| *** otter768 has quit IRC | 13:37 | |
| fungi | tristanC: it looks like what happened to 163034 was that apevec removed his approval vote while the change was in the gate pipeline yesterday so the change never merged. when adam_g and ttx reapproved it, there was no check +1 any more (because jenkins removed it when it entered the gate the previous time around). leave a recheck comment on it to get it moving again | 13:38 |
| *** fdegir has quit IRC | 13:38 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Allow for passing cache class in as a parameter https://review.openstack.org/162148 | 13:38 |
| *** BharatK has quit IRC | 13:39 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Small fixes found working on ansible modules https://review.openstack.org/162140 | 13:39 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add initial compute functional tests to Shade https://review.openstack.org/158463 | 13:40 |
| mestery | Any takers on a super simple infra patch to make our new functional job voting for check and gate in python-neutronclient? https://review.openstack.org/#/c/163868/ :) | 13:41 |
| *** spzala has joined #openstack-infra | 13:42 | |
| tristanC | fungi: alright, thanks! | 13:44 |
| *** _nadya_ has joined #openstack-infra | 13:45 | |
| *** mkj_wk has quit IRC | 13:46 | |
| *** mkj_wk has joined #openstack-infra | 13:47 | |
| mordred | mestery: that sounds like the kind of thing I'd be in favor of | 13:47 |
| sdague | AJaeger: ask dims | 13:48 |
| mestery | mordred: lol, thank you sir! :) | 13:48 |
| *** faizan has quit IRC | 13:48 | |
| dims | AJaeger: pong | 13:48 |
| *** ujuc has quit IRC | 13:49 | |
| mordred | mestery: done | 13:49 |
| mestery | mordred: Awesome, thanks! | 13:49 |
| *** dboik has quit IRC | 13:50 | |
| *** dboik has joined #openstack-infra | 13:50 | |
| dims | AJaeger: i picked up the latest nova-docker review https://review.openstack.org/#/c/160487/ and i don't see a "propose-requirements" job | 13:50 |
| dims | AJaeger: where/who triggers this job? | 13:51 |
| fungi | dims: the job which does that runs in the post pipeline for merges to the openstack/requirements repo | 13:51 |
| fungi | dims: it iterates over the list of projects in the requirements repo's projects.txt file | 13:52 |
| dims | fungi: ah i see | 13:52 |
| AJaeger | dims: that's the daily proposal job | 13:52 |
| fungi | dims: so if nova-docker needs to get requirements updates proposed to it, then make sure it's added to that projects.txt file | 13:52 |
| fungi | AJaeger: what's daily? | 13:53 |
| dims | fungi: it was there and apparently failing so AJaeger filed to remove it https://review.openstack.org/#/c/156260/2/projects.txt,cm | 13:53 |
| fungi | AJaeger: are you talking about translations proposals? | 13:53 |
| fungi | dims: oh, got it | 13:54 |
| fungi | i assume you're looking for a log with details of the failure. i'll grab a recent one | 13:55 |
| dims | fungi: yes, thanks! | 13:55 |
| *** Qiming has joined #openstack-infra | 13:56 | |
| *** ddieterly has joined #openstack-infra | 13:56 | |
| fungi | dims: http://logs.openstack.org/d6/d6c8439ab05dbf906e77bfe882fd388355241032/post/propose-requirements-updates/880a043/console.html#_2015-03-12_01_35_29_160 "'docker-py' is not in global-requirements.txt" | 13:57 |
| *** dansmith is now known as superdan | 13:59 | |
| dims | sdague: fungi: so we are running dsvm jobs with the export REQUIREMENTS_MODE=soft flag isn't there a way to tolerate this? | 13:59 |
| fungi | dims: i believe if you're not strictly following global-requirements.txt then it's up to you to check and update your requirements lists | 14:00 |
| *** gordc has quit IRC | 14:00 | |
| sdague | fungi: we actually allowed for this mode for dsvm jobs, I think it was just a half implemented feature | 14:01 |
| sdague | and didn't consider the proposal side | 14:01 |
| *** julim has quit IRC | 14:01 | |
| fungi | dims: sdague: i don't think our requirements proposal job currently supports figuring out whether your project should or shouldn't diverge. not saying that it wouldn't be a potential new feature | 14:01 |
| dims | sdague: AJaeger: we had not changed anything on nova-docker end for a while, is this a new restriction that came up? | 14:01 |
| sdague | dims: no, people just started noticing I think | 14:01 |
| *** gordc has joined #openstack-infra | 14:01 | |
| dims | yes, easiest solution is to remove nova-docker (but big tent...) | 14:02 |
| sdague | I don't think you were getting proposed updates right | 14:02 |
| sdague | global-requirements != big tent | 14:02 |
| *** amitgandhinz has joined #openstack-infra | 14:02 | |
| dims | ack, AJaeger +1 to remove it | 14:02 |
| *** radez_g0n3 is now known as radez | 14:02 | |
| fungi | dims: yeah, looks like it's probably been breaking in the proposal updates since december when the change to add nova-docker to projects.txt merged | 14:03 |
| dims | fungi: thanks! | 14:03 |
| fungi | np | 14:03 |
| AJaeger | fungi, sorry got confused. This is indeed the post job, not a daily. | 14:03 |
| AJaeger | dims: it's failing since over a month, see when I proposed the job. That's when I first noticed the failure. | 14:04 |
| AJaeger | sdague, fungi, dims: The other project failing is because of ironic-discoverd but there are patches to add that. | 14:04 |
| dims | AJaeger: thanks | 14:05 |
| *** tmorin has joined #openstack-infra | 14:05 | |
| AJaeger | https://review.openstack.org/#/c/158210/ for ironic-discoverd | 14:05 |
| AJaeger | sdague: care to review it, please? | 14:05 |
| yolanda | hi, i'm interested on pushing a project to stackforge, what are the rules for that? it's a puppet module for proxy settings, didn't want to propose to upstream infra because it's not used there, but i think it's useful for puppet downstream, and i want to share it | 14:05 |
| AJaeger | dims: thanks for looking into this! | 14:05 |
| dims | AJaeger: apologies, i thought i had all the bases covered :) | 14:06 |
| *** r-daneel has joined #openstack-infra | 14:06 | |
| AJaeger | I'll be back later... | 14:06 |
| *** dims has quit IRC | 14:06 | |
| *** jaypipes is now known as leakypipes | 14:07 | |
| mkoderer | yolanda: did you already have a look to http://docs.openstack.org/infra/manual/creators.html ? | 14:07 |
| fungi | yolanda: just follow the creator chapter in the infra manual. as for guidelines, nothing in particular | 14:07 |
| yolanda | sorry, on it right now | 14:07 |
| *** dims has joined #openstack-infra | 14:07 | |
| yolanda | just saw the link on github but hadn't found that link before | 14:07 |
| *** _nadya_ has quit IRC | 14:09 | |
| yolanda | fungi, so the idea for stackforge is that they are finally moved to openstack? | 14:09 |
| *** matrohon has joined #openstack-infra | 14:09 | |
| mkoderer | puppet modules will never move to openstack... | 14:09 |
| yolanda | so i have this one... https://github.com/yrobla/puppet-setproxy | 14:10 |
| openstackgerrit | Merged openstack-infra/project-config: Make neutronclient-dsvm-functional gating for neutronclient https://review.openstack.org/163868 | 14:10 |
| yolanda | mkodered, fungi, it's useful for us for puppet-downstream, but i don't see it's going to be used in infra as you are not under a proxy | 14:10 |
| *** yamamoto has joined #openstack-infra | 14:11 | |
| yolanda | do you think i could push there ? want to have it public, but i really don't like that living only in my github repo, and i think it could be useful as well for puppet-downstream | 14:11 |
| *** jp_at_hp has quit IRC | 14:13 | |
| *** dizquierdo has joined #openstack-infra | 14:13 | |
| *** dboik has quit IRC | 14:15 | |
| *** Longgeek has joined #openstack-infra | 14:15 | |
| *** spredzy|afk is now known as spredzy | 14:15 | |
| *** nelsnelson has joined #openstack-infra | 14:16 | |
| *** amotoki has quit IRC | 14:16 | |
| *** nelsnelson has quit IRC | 14:16 | |
| *** dboik has joined #openstack-infra | 14:16 | |
| *** ChuckC_ has joined #openstack-infra | 14:16 | |
| *** ChuckC has quit IRC | 14:17 | |
| *** afazekas has quit IRC | 14:18 | |
| *** vigneshvar has quit IRC | 14:18 | |
| *** dboik has quit IRC | 14:21 | |
| *** nelsnelson has joined #openstack-infra | 14:21 | |
| *** fdegir has joined #openstack-infra | 14:21 | |
| *** dboik has joined #openstack-infra | 14:21 | |
| *** dims is now known as dimsum__ | 14:21 | |
| *** ChuckC_ has quit IRC | 14:23 | |
| *** rlandy has quit IRC | 14:25 | |
| *** pblaho_ is now known as pblaho | 14:27 | |
| *** wenlock has joined #openstack-infra | 14:29 | |
| *** tmorin has left #openstack-infra | 14:32 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config: Add stackforge/puppet-setproxy https://review.openstack.org/164197 | 14:32 |
| *** aysyd has quit IRC | 14:32 | |
| openstackgerrit | Doug Hellmann proposed openstack/requirements: Cap Oslo libraries for kilo https://review.openstack.org/162656 | 14:33 |
| *** Nakato has quit IRC | 14:33 | |
| *** Nakato has joined #openstack-infra | 14:34 | |
| *** ociuhandu has joined #openstack-infra | 14:35 | |
| *** aysyd has joined #openstack-infra | 14:36 | |
| *** thedodd has joined #openstack-infra | 14:36 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for bug 1431724 https://review.openstack.org/164120 | 14:37 |
| openstack | bug 1431724 in tempest "test_preserve_preexisting_port failing against icehouse" [High,Fix released] https://launchpad.net/bugs/1431724 - Assigned to Andrea Frittoli (andrea-frittoli) | 14:37 |
| *** sabeen has joined #openstack-infra | 14:37 | |
| *** tonytan4ever has joined #openstack-infra | 14:38 | |
| *** _nadya_ has joined #openstack-infra | 14:39 | |
| *** mrmartin has joined #openstack-infra | 14:40 | |
| AJaeger | sdague: based on the discussion, what's your comment now on https://review.openstack.org/156260? Should it go in or should I abandon it? | 14:41 |
| *** spzala has quit IRC | 14:41 | |
| AJaeger | dhellmann: same question for you ^ | 14:42 |
| *** _nadya_ has quit IRC | 14:42 | |
| dhellmann | AJaeger: does the nova-docker team want to have requirements synced? | 14:43 |
| *** _nadya_ has joined #openstack-infra | 14:43 | |
| * dhellmann missed the discussion | 14:43 | |
| *** ashishb has joined #openstack-infra | 14:44 | |
| AJaeger | just half an hour ago here - dims, you removed your -1, but did not gave a +1. | 14:44 |
| AJaeger | dims, so do you want to fix it in nova-docker or should my patch go in? | 14:45 |
| dhellmann | dimsum__: ^^ | 14:45 |
| dimsum__ | AJaeger: your patch needs to go in | 14:45 |
| dimsum__ | sorry | 14:45 |
| AJaeger | dimsum__: thanks! | 14:46 |
| fungi | dhellmann: if they do, the options are to get docker-py into global requirements, take docker-py out of nova-docker requirements, or implement some sort of soft requirements update mechanism in the requirements change proposal script | 14:46 |
| dhellmann | AJaeger, dimsum__ , fungi : +2 | 14:46 |
| ashishb | Hi there, I submitted a patch in nova-docker and seems there is issue with pep8/flake8 | 14:46 |
| ashishb | I see this message: | 14:46 |
| *** amotoki has joined #openstack-infra | 14:46 | |
| dimsum__ | fungi: i lost the battle to add docker-py to global req. though magnum, nova-docker and heat all use it one way or another (heat it's an optional component) | 14:47 |
| AJaeger | dhellmann: thanks! annegentle would also appreciate review of a version jump: https://review.openstack.org/164077 | 14:47 |
| dimsum__ | fungi: maybe for Liberty | 14:47 |
| ashishb | /home/jenkins/workspace/gate-nova-docker-pep8$ /home/jenkins/workspace/gate-nova-docker-pep8/.tox/pep8/bin/flake8 2015-03-13 12:56:00.587 | ERROR: InvocationError: '/home/jenkins/workspace/gate-nova-docker-pep8/.tox/pep8/bin/flake8' 2015-03-13 12:56:00.587 | ___________________________________ summary ____________________________________ 2015-03-13 12:56:00.587 | ERROR: pep8: commands failed 2015-03-13 12:56:00.592 | + rc=1 2015-03-13 12:56:00 | 14:47 |
| ashishb | I feel something wrong with the flake8/pep8 config for nova-docker project | 14:47 |
| AJaeger | ashishb: what's the review that fails? | 14:47 |
| *** alaski is now known as lascii | 14:48 | |
| ashishb | https://review.openstack.org/#/c/160487/ | 14:48 |
| fungi | ashishb: you might want to bring this up with the nova-docker developers on whatever channel they normally hang out in | 14:48 |
| ashishb | oh ..ok | 14:48 |
| ashishb | sure | 14:48 |
| *** thedodd has quit IRC | 14:48 | |
| *** Longgeek has quit IRC | 14:49 | |
| openstackgerrit | Lucas Alvares Gomes proposed openstack-infra/project-config: Ironic: Create and enable pxe_ipa-src-nv on ironic-python-agent https://review.openstack.org/163344 | 14:50 |
| fungi | ashishb: assuming you suspect it's failing for all nova-docker changes | 14:50 |
| AJaeger | fungi, seems to be the case - fails for me locally on head ;( | 14:51 |
| AJaeger | fungi: I'd like to remove my last line - it's still setting up... | 14:51 |
| AJaeger | another patches for nova-docker passed yesterday... | 14:52 |
| *** thedodd has joined #openstack-infra | 14:53 | |
| *** ildikov_ has quit IRC | 14:53 | |
| fungi | yeah, that pep8 job isn't collecting the tox/pip logs, so it's hard to know what might have gone wrong there. but chances are something's breaking with setup of one of its dependencies since there's no relevant output | 14:54 |
| ashishb | in my local env, however, the tests are passing with tox for nova-docker | 14:54 |
| *** hodos has joined #openstack-infra | 14:54 | |
| AJaeger | ashishb: it fails for me with these messages: http://paste.openstack.org/show/192113/, you might have an older hacking installed | 14:54 |
| AJaeger | ashishb: I'll do a fresh run now... | 14:55 |
| fungi | ashishb: make sure you run it like 'tox -r -e pep8' | 14:55 |
| fungi | ashishb: you might also want to 'git clean -dfx' beforehand just to make sure there aren't other stale files in your checkout too | 14:56 |
| ashishb | ok, i ran it locally with: ./run_tests.sh | 14:56 |
| *** _nadya_ has quit IRC | 14:57 | |
| clarkb | BobBall: sort of, I think that change is addressing only half of the problem. Which is probably fine just not quite what it appears to have set out to do | 14:57 |
| ashishb | ok, I'll try again with a fresh one | 14:57 |
| *** carl_baldwin_ has joined #openstack-infra | 14:58 | |
| fungi | ashishb: it's possible that ./run_tests.sh does different things than happen in the ci, which is why i recommend invoking tox directly | 14:58 |
| *** carl_baldwin_ is now known as carl_baldwin | 14:58 | |
| BobBall | clarkb: Ah - well the problem I was trying to solve was that jenkins couldn't co-exist with zuul. It seems that having the FQDN in the tag rather than ServerName was binding more tightly somehow, and so trying to access http://zuul.openstack.xenproject.org got redirected to https://jenkins.openstack.xenproject.org | 14:59 |
| ashishb | fungi, I'll do that with tox | 14:59 |
| *** sdake has joined #openstack-infra | 15:00 | |
| BobBall | clarkb: Perhaps I assumed too much history (the patch came out of https://review.openstack.org/#/c/160997/) and haven't explained enough. I'll update commit message. | 15:00 |
| clarkb | BobBall: yes and jenkins can't coexit with zuul without ssl hamedhosts | 15:00 |
| ashishb | however, my problem is: from the error log for pep8/flake8, it seems there is issue with the CI / Jenkins setup for nova-docker | 15:00 |
| clarkb | BobBall: because zuul wants ssl too | 15:00 |
| BobBall | clarkb: I haven't added ssl namedhosts and it works for me... | 15:00 |
| fungi | does zuul want ssl now? did my patch merge? | 15:00 |
| BobBall | Ah - my zuul doesn't - not sure how that came about | 15:00 |
| clarkb | BobBall: is your zuul config up to date? | 15:00 |
| clarkb | fungi: I thought it did maybe its still up for review | 15:01 |
| BobBall | It certainly was a week or so ago | 15:01 |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config: Move Gnocchi from Stackforge to OpenStack https://review.openstack.org/162146 | 15:01 |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config: Add more tests to Gnocchi https://review.openstack.org/164211 | 15:01 |
| clarkb | https://review.openstack.org/#/c/155471/ not sure why jeblair didn't approve it | 15:02 |
| BobBall | fungi: https://review.openstack.org/#/c/155471/ ? Not merged yet | 15:02 |
| fungi | clarkb: BobBall: anyway, with some careful tweaking the puppet modules could probably be made to have a means of disabling the default vhosts and then proxy from an https apache vhost to something listening on localhost | 15:02 |
| *** radez is now known as radez_g0n3 | 15:02 | |
| BobBall | I see | 15:04 |
| *** mriedem has quit IRC | 15:04 | |
| *** gokrokve has joined #openstack-infra | 15:04 | |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config: Add more tests to Gnocchi https://review.openstack.org/164211 | 15:04 |
| *** asselin_ has joined #openstack-infra | 15:05 | |
| AJaeger | ashishb: jd__ ping | 15:05 |
| jd__ | AJaeger: pong! | 15:05 |
| jd__ | what did I do wrong? :( | 15:05 |
| *** radez_g0n3 is now known as radez | 15:05 | |
| AJaeger | jd__: looking at the number of tests you're adding to Gnocchi, do you want to do a new record? The project with the most jobs running? ;) | 15:06 |
| jd__ | AJaeger: will I get a cup for that? | 15:06 |
| jd__ | or a medal? :) | 15:06 |
| *** fdegir has quit IRC | 15:06 | |
| jd__ | AJaeger: these are tests we already run actually, I just split it in different job | 15:06 |
| ashishb | fungi and Ajaeger: locally, I'll run with tox, however, my problem is: from the error log for pep8/flake8, it seems there is issue with the CI / Jenkins setup for nova-docker | 15:06 |
| *** thedodd has quit IRC | 15:06 | |
| jd__ | s/it/them/ | 15:06 |
| AJaeger | jd__: I won't be in Vancouver to hand them out, sorry ;( | 15:06 |
| clarkb | Conflict: Instance 717da90b-516f-45b8-a2e3-dfc1462f277f is locked (HTTP 409) anyone know what a locked instance is? | 15:06 |
| jd__ | AJaeger: :( | 15:06 |
| jd__ | clarkb: isn't that a thing an admin can do with nova lock or something? | 15:07 |
| clarkb | jd__: no idea but that gives me a place to look for docs | 15:07 |
| AJaeger | jd__: let's see what others say - my impression is that we should not have that many jobs | 15:07 |
| *** ChuckC_ has joined #openstack-infra | 15:07 | |
| jd__ | AJaeger: first time I'll hear a project have too much testing! | 15:08 |
| mordred | clarkb, fungi, jeblair, SergeyLukjanov, pleia2: (wow that's a lot of people): could I get a second +2 on https://review.openstack.org/#/c/158463/ ? (also, reviewing the open stack would be nice - but that one needs to go in before anything else can) | 15:08 |
| AJaeger | jd__: That's not what I'm saying - I'm just saying: It uses too many jobs to do the job ;) | 15:08 |
| *** xgerman has joined #openstack-infra | 15:08 | |
| AJaeger | jd__: if it's technically fine, you'll get a +1 - and let's see whether clarkb or fungi agree with the too many jobs | 15:09 |
| jd__ | AJaeger: I can reduce the number of job if there's a way to merge the "tox -e" runs – but I don't know how to do it | 15:09 |
| *** marcusvrn has quit IRC | 15:09 | |
| jeblair | clarkb: i was not prepared to babysit; 155471 aprvd now | 15:09 |
| *** bswartz has quit IRC | 15:10 | |
| jeblair | http://logs.openstack.org/63/158463/21/check/check-shade-dsvm-functional/4ff6036/console.html | 15:10 |
| AJaeger | jd__: you could duplicate the jobs - have one tox target that runs them all and several for local testing | 15:10 |
| clarkb | AJaeger: jd__ so once upon a time we had the idea of a common test inteface that utilized tox | 15:10 |
| jd__ | AJaeger: to you know if the current layout support "tox -epy27,py27-foobar" for example? | 15:10 |
| jeblair | mordred: OMG OMG OMG! it's really doing it isn't it? :) | 15:10 |
| clarkb | for better or worse everyone seems to have ignored that and gone off and done whatever they wanted | 15:10 |
| clarkb | our test tooling strives to implemented the interface | 15:10 |
| mordred | jeblair: yah! | 15:11 |
| clarkb | because thats what we have tried to get people to implement | 15:11 |
| *** erlon has quit IRC | 15:11 | |
| Shrews | clarkb: your statement makes me sad | 15:11 |
| clarkb | mordred: ya I need to rereview that one | 15:11 |
| clarkb | Shrews: why? if we need to change the interface we can totally do it | 15:11 |
| AJaeger | jd__: don't think so | 15:11 |
| clarkb | Shrews: problem is no one says "maybe this interface doesn't work how do we make it better" instead we just get a proliferation of one of jobs for all the things | 15:12 |
| jd__ | AJaeger: :-( | 15:12 |
| Shrews | clarkb: no, the whole divergence from test iface thing | 15:12 |
| mordred | Shrews: ++ | 15:12 |
| jeblair | http://governance.openstack.org/reference/project-testing-interface.html | 15:13 |
| *** mtanino has joined #openstack-infra | 15:13 | |
| jeblair | why does gnocchi need things split into different test environments? | 15:13 |
| *** bknudson has quit IRC | 15:13 | |
| *** jgrimm has quit IRC | 15:13 | |
| jd__ | jeblair: we tests our drivers | 15:14 |
| *** jgrimm has joined #openstack-infra | 15:14 | |
| AJaeger | jd__: write one script that does all of it and call it from tox... | 15:14 |
| *** tnovacik has quit IRC | 15:14 | |
| jd__ | AJaeger: yeah I guess I'll end up doing that | 15:14 |
| AJaeger | or just merge the lines, tox can call several commands for one execution | 15:14 |
| AJaeger | jd__: like you do with the docs environment already | 15:15 |
| *** ashishb has quit IRC | 15:15 | |
| jeblair | yeah, think of it as "all the tests that should run under py27", "all the tests that should run under py34", "all the tests that should run in a functional environment", etc... | 15:15 |
| clarkb | mordred: did you see my comments on patchset 15 of that change? | 15:16 |
| clarkb | mordred: I was +2 at the time because wanted test data, I still think I am +2 now that tests run but I believe that most of those comments need to be addressed at some point | 15:16 |
| mordred | clarkb: kk. | 15:16 |
| clarkb | mordred: in particular the async calls make the tests mostly nooops | 15:17 |
| clarkb | (some of them rather) | 15:17 |
| jeblair | rcarrillocruz: if you could please respond in some way when people leave comments on your change that would be great. either implement changes, or leave comments indicating why you don't want to, or leave comments saying that you will address them later. | 15:18 |
| *** ashishb has joined #openstack-infra | 15:18 | |
| AJaeger | jeblair: I would appreciate another review from you of https://review.openstack.org/#/c/159512/ if possible - thanks | 15:18 |
| openstackgerrit | Merged openstack-infra/project-config: Create experimental job for group-based-policy https://review.openstack.org/161511 | 15:19 |
| *** stevemar has joined #openstack-infra | 15:19 | |
| rcarrillocruz | jeblair: sure, i'm on paternity leave since 2nd March, have been looking at changes whenever possible | 15:21 |
| rcarrillocruz | i'm back on Monday | 15:21 |
| rcarrillocruz | i assume you mean the shade func tests | 15:21 |
| rcarrillocruz | ? | 15:21 |
| *** fdegir has joined #openstack-infra | 15:21 | |
| clarkb | we seem to be having trouble building nodes again. According to my script we only have 3 ports leaked so I don't think that is the problem | 15:21 |
| *** yfried|afk has joined #openstack-infra | 15:21 | |
| *** dannywilson has joined #openstack-infra | 15:21 | |
| *** bswartz has joined #openstack-infra | 15:21 | |
| clarkb | and only 385 floating IPs so that should be fine too | 15:21 |
| openstackgerrit | Merged openstack-infra/puppet-zuul: Option to allow HTTPS for the proxy https://review.openstack.org/155471 | 15:22 |
| mordred | rcarrillocruz: yah - I think we're going to land it - when you get back, add "address clarkb's comments from patchset 15" to your todo list? | 15:22 |
| *** Qiming_ has joined #openstack-infra | 15:22 | |
| rcarrillocruz | yeah, i chatted with him last night as a matter of fact | 15:23 |
| rcarrillocruz | i'm ok addressing before landing | 15:23 |
| rcarrillocruz | or afterwards | 15:23 |
| rcarrillocruz | i understood last night he would re-review | 15:23 |
| rcarrillocruz | either way, works for me | 15:23 |
| clarkb | yup I am rereviewing it now and didn't realize how many new patchsets we had without even addressing the simple comments | 15:24 |
| clarkb | which is why I bring it up again | 15:24 |
| clarkb | but sounds like you shouldn't be here at all :) | 15:25 |
| *** Qiming has quit IRC | 15:25 | |
| rcarrillocruz | hah, didn't want to leave that change rotting for 2 weeks | 15:26 |
| rcarrillocruz | tried to keep it alive as much as i could | 15:26 |
| rcarrillocruz | will check your comments later on then clarkb | 15:26 |
| jeblair | rcarrillocruz: cool, thanks, and enjoy parenting :) | 15:26 |
| *** dpyzhov_ has joined #openstack-infra | 15:28 | |
| mtreinish | ooh, what's going on to cause that on the zuul status page :) | 15:28 |
| jeblair | wow that's pretty | 15:28 |
| * jeblair digs into logs | 15:29 | |
| *** erlon has joined #openstack-infra | 15:29 | |
| mtreinish | jeblair: heh, that was my first thought too, I took a screenshot | 15:29 |
| * ttx bets we can draw Zuul art the same way we can draw ASCII art | 15:29 | |
| AJaeger | Let's make Zuul art for the next summit ;) | 15:30 |
| *** sputnik13 has joined #openstack-infra | 15:30 | |
| *** tsg has quit IRC | 15:30 | |
| jeblair | (this is slow, i really look forward to turning down zuul's logging again) | 15:30 |
| *** esker has joined #openstack-infra | 15:31 | |
| *** zz_dimtruck is now known as dimtruck | 15:31 | |
| clarkb | I have found some alien nodes in rax-iad and dfw that appear to possibly have been caught during rax reboots | 15:32 |
| clarkb | cleaning those up as a start | 15:32 |
| jeblair | GitCommandError: 'git remote update origin' returned with exit code 1 | 15:33 |
| *** david-lyle_afk is now known as david-lyle | 15:33 | |
| mordred | jeblair: that doesn't seem great | 15:33 |
| jeblair | i'm guessing the fact that we have a string of merge failures are because the mergers all had problems talking to upstream git | 15:33 |
| *** otter768 has joined #openstack-infra | 15:33 | |
| jeblair | and the "art" represents the time period where that was the case | 15:34 |
| mtreinish | jeblair: oh, yeah that would probably explain it | 15:34 |
| *** mriedem has joined #openstack-infra | 15:34 | |
| jeblair | mind you, upstream git in this case is gerrit | 15:34 |
| openstackgerrit | Joshua Harlow proposed openstack/requirements: Add contextlib2 lib to aid in py2/py3 compatability https://review.openstack.org/164222 | 15:35 |
| *** ashishb has quit IRC | 15:35 | |
| jeblair | oh there's more | 15:36 |
| jeblair | stderr: 'error: object file .git/objects/0d/e885bacc2f6960e2c62d573929cc6315efdd86 is empty | 15:36 |
| jeblair | fatal: loose object 0de885bacc2f6960e2c62d573929cc6315efdd86 (stored in .git/objects/0d/e885bacc2f6960e2c62d573929cc6315efdd86) is corrupt | 15:36 |
| clarkb | so thinking about the testing inferface a bit, is this the sort of thing that maybe we should collect feedback on during the next summit? considering how we had a large push for functional tests maybe this interface can be refined a bit to accomdate that use and other use cases that are growing out of different needs? | 15:36 |
| clarkb | I think the trouble I have today is we don't have enough input to know what the needs are | 15:36 |
| jeblair | and that keeps happening | 15:36 |
| *** skolekonov has quit IRC | 15:36 | |
| clarkb | jeblair: nice, try a git fsck and see if it can figure it out? | 15:36 |
| *** yfried|afk has quit IRC | 15:36 | |
| jeblair | clarkb: i think most projects are doing 'tox -e functional'. maybe add that to the pti? | 15:36 |
| *** cody-somerville has joined #openstack-infra | 15:37 | |
| clarkb | jeblair: ya, I think some are also doing functional-dsvm and functional to distinguish env requirements | 15:37 |
| clarkb | maybe a mailing list thread is sufficient here | 15:37 |
| clarkb | to gather input on what people are doing that works so we can better advertise it and make those jobs run in a templated way | 15:38 |
| mtreinish | clarkb: that's what sdague did for nova I think | 15:38 |
| *** sputnik13 has quit IRC | 15:38 | |
| sdague | we've not yet created the functional-dsvm one yet | 15:38 |
| jeblair | clarkb: i don't think we need a thread, i think we know what needs to happen | 15:38 |
| *** otter768 has quit IRC | 15:38 | |
| sdague | but that was the proposal | 15:38 |
| clarkb | jeblair: ok | 15:38 |
| jeblair | we don't just need a tox env, we also need standard ways to do additional setup and teardown around that | 15:39 |
| *** reed has joined #openstack-infra | 15:39 | |
| jeblair | so eventually we have a standard job that devstacks, preps, tox -e functional, tears down, etc. | 15:39 |
| *** thedodd has joined #openstack-infra | 15:39 | |
| zaro | morning | 15:39 |
| openstackgerrit | Merged openstack-infra/project-config: Run some project-config jobs only if needed https://review.openstack.org/159512 | 15:39 |
| jeblair | i think once we have a few instances of that, we can refactor out | 15:40 |
| clarkb | jeblair: that would be neat | 15:40 |
| zaro | pelix: have a question on custum yaml tags | 15:41 |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config: Remove some tests to Gnocchi https://review.openstack.org/164211 | 15:41 |
| mtreinish | jeblair: there should already be a few for the python clients | 15:41 |
| zaro | pelix: regarding to https://review.openstack.org/#/c/63580/ | 15:42 |
| *** dhritishikhar has joined #openstack-infra | 15:42 | |
| *** jcoufal_ has quit IRC | 15:42 | |
| *** dboik_ has joined #openstack-infra | 15:43 | |
| *** dboik has quit IRC | 15:43 | |
| clarkb | I remember the other place the interface is breaking: when a project wants to run py27 multiple times with different dependencies. Eg django1.5 vs 1.6. or different versions of sqlalchemy | 15:43 |
| clarkb | though in general I think cases of ^ are not very common | 15:43 |
| *** spzala has joined #openstack-infra | 15:43 | |
| *** ayoung has joined #openstack-infra | 15:44 | |
| zaro | fungi: would you like to push a change for your suggestion in https://review.openstack.org/163104 or would you like me to? | 15:44 |
| *** mpopow has joined #openstack-infra | 15:44 | |
| fungi | zaro: if you can that would be great. i'm currently trying to do the ask.o.o test migration | 15:44 |
| mordred | clarkb: fwiw, you said you were +2 on the shade patch in channel, but you did not actually vote +2 on the patch | 15:44 |
| zaro | fungi: no problem, will do | 15:45 |
| *** bknudson has joined #openstack-infra | 15:45 | |
| clarkb | mordred: ya I need to swing back and actually approve the change | 15:45 |
| gordc | ianw: just wondering, for https://review.openstack.org/#/c/161256/, i'm not sure what local config i should be updating? | 15:45 |
| clarkb | mordred: will do that now | 15:45 |
| clarkb | mordred: the clouds are distracting me | 15:45 |
| *** esker has quit IRC | 15:45 | |
| mordred | clarkb: they do that | 15:45 |
| jeblair | clarkb: git fsck repeats the error about the object being corrupt/empty | 15:47 |
| clarkb | I am trying to get a full set of up to date jobs built so that we can move forward on swift logs while also trying to sort out why we have such a high error rate | 15:47 |
| clarkb | jeblair: ya usually I have found it cannot fix the problems | 15:47 |
| *** resker has joined #openstack-infra | 15:47 | |
| clarkb | jeblair: but sometimes it gives good results | 15:47 |
| jeblair | clarkb: it's the ceilo repo, and ansible says it's only on zm01. i will delete that repo | 15:48 |
| *** ChuckC_ has quit IRC | 15:49 | |
| clarkb | jeblair: ok | 15:49 |
| rcarrillocruz | alright, clarkb saw you approved change | 15:49 |
| rcarrillocruz | thx | 15:49 |
| rcarrillocruz | i'll address comments on a subsequent patch then | 15:49 |
| rcarrillocruz | and add MOAR tests now that func tests are in place | 15:49 |
| clarkb | we do have a bunch of ~12 hour delete state nodes I am going to see if I can more forecefull delete those and if not hopefully determine why they won't delete | 15:49 |
| *** thedodd has quit IRC | 15:49 | |
| clarkb | (they appear to all be in dfw) | 15:50 |
| jeblair | mtreinish: one of the zuul mergers had a corrupted git repo for ceilometer; i have removed it, and it should be re-cloned the next time it needs it. | 15:50 |
| mgagne | how can one run a single ansible task without having to create an inventory file? I'm looking at https://github.com/openstack-infra/ansible-puppet and I'm wondering how it's used by infra. | 15:51 |
| *** armax has joined #openstack-infra | 15:52 | |
| clarkb | mgagne: what I did was create an inventory with only localhost in it then ran ansible-playbook -i thatfile someplaybook.yaml | 15:52 |
| *** unicell1 has joined #openstack-infra | 15:52 | |
| fungi | jeblair: clarkb: i'm betting the server got rebooted mid-write to that repo | 15:52 |
| clarkb | mgagne: according to jlk you can also pass in raw json inventory to -i so -i 'somehost,' I think | 15:52 |
| mgagne | clarkb: ok so ansible has to be installed on target host and ansible repo cloned there, etc. ? | 15:52 |
| clarkb | mgagne: but I haven't tried that method yet | 15:52 |
| clarkb | mgagne: no, you only need it installed on the source/calling host | 15:52 |
| clarkb | mgagne: for that I just pip installed to a virtualenv | 15:53 |
| *** unicell has quit IRC | 15:53 | |
| jeblair | fungi, clarkb: i wonder if a git fsck on merger startup would be a good idea | 15:53 |
| *** ghostpl_ has quit IRC | 15:53 | |
| clarkb | jeblair: ooh ya probably and any errors would lead to not starting | 15:53 |
| mtreinish | jeblair: ok, thanks | 15:53 |
| *** ChuckC has joined #openstack-infra | 15:53 | |
| fungi | jeblair: clarkb: that's not a bad idea. would at least catch latent corruption from rackspace randomly rebooting instances for maintenance | 15:53 |
| mgagne | clarkb: how those running it with localhost makes it work for remote host? unless I'm missing something :P | 15:53 |
| *** marun has joined #openstack-infra | 15:54 | |
| clarkb | mgagne: you would put something other than localhost in your inventory then ansible ssh's to that location, copies anything it needs, then runs | 15:54 |
| clarkb | mgagne: so the only thing you need on the remote side is ssh access to the remote from wherever you are running ansible (this is one of the nice things about ansible, bootstrapping is so easy) | 15:54 |
| clarkb | mgagne: the simplest case to test is just to localhost though as it can run without ssh against localhost | 15:55 |
| *** amotoki has quit IRC | 15:56 | |
| mgagne | clarkb: but it all comes down to the idea of creating a (tmp) inventory file or using ansible to somehow bootstrap itself on the remote host? | 15:56 |
| mordred | mgagne: you don't have to install ansible on the remote host at all | 15:56 |
| mgagne | (and use localhost) | 15:56 |
| *** thedodd has joined #openstack-infra | 15:57 | |
| clarkb | mgagne: for testing yes I think tmp inventory file is simplest. The way we run it in production is it lists our puppet cert list and uses that list as the inventory | 15:57 |
| openstackgerrit | Marton Kiss proposed openstack-infra/system-config: Upgrade openstackid to 1.0.6 https://review.openstack.org/164230 | 15:57 |
| mgagne | mordred: with localhost, I'm not sure how it is supposed to work if ansible isn't installed on the host you are running ansible on. | 15:57 |
| *** yamamoto has quit IRC | 15:57 | |
| mgagne | clarkb: ok, tmp inventory file it will be then | 15:58 |
| clarkb | fungi: ^ that reminds me, I will review dstuffts change now. Should I go ahead and approve it if it looks good? I feel like I may not be in a great position to babysit right now with me trying to figure out why clouds don't like us | 15:58 |
| mordred | mgagne: gotcha. yes, you're right | 15:58 |
| mordred | clarkb: whcih change? | 15:58 |
| clarkb | mordred: will link | 15:58 |
| clarkb | mordred: https://review.openstack.org/#/c/163228/ that one | 15:58 |
| *** Sukhdev has joined #openstack-infra | 15:59 | |
| *** asselin_ has quit IRC | 15:59 | |
| mrmartin | fungi: openstackid release again, a better fix for the crypt-collision problem. anyway congrats to your media presence :) | 15:59 |
| *** e0ne_ has quit IRC | 15:59 | |
| *** amotoki has joined #openstack-infra | 16:00 | |
| mordred | clarkb: thanks | 16:00 |
| mordred | clarkb: if we like that there and it works out and all, should we port that over to all of our SSL vhosts? | 16:00 |
| clarkb | mordred: yes | 16:01 |
| clarkb | random sample dfw node that is ~12 hours old timed out when deleting. Will give it one more attempt (since delete timeouts are a thing iirc) and if that doesnt' work go play the nova show game | 16:02 |
| *** peristeri has quit IRC | 16:03 | |
| clarkb | mrmartin: https://review.openstack.org/#/c/163228/3/templates/vhost.erb did you review that yet? | 16:03 |
| *** peristeri has joined #openstack-infra | 16:03 | |
| pelix | zaro: so for lazy loading there is no difference between behaviour of !include-raw & !include-raw-escape, both will work identically. It's where you wish to perform substitution on the contents of the file being included in a template you would use !include-raw and if you wanted to prevent substitution occurring you would use !include-raw-escape. However I'm tempted to see if I can rewrite the behaviour and make the tags more consistent so | 16:04 |
| *** sdake has quit IRC | 16:04 | |
| clarkb | fungi: what is difference between ECDHE-RSA-AES128-GCM-SHA256 and ECDH+AESGCM ? | 16:04 |
| mrmartin | clarkb: not yet, I was not added as a reviewer | 16:05 |
| clarkb | fungi: mozilla and wikimedia both do the first, dstufft's change does the second | 16:05 |
| dstufft | the difference is just in the verbosity | 16:05 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/infra-specs: Added backup/recovery description to askbot migration spec https://review.openstack.org/160693 | 16:05 |
| fungi | mrmartin: ^ | 16:05 |
| fungi | mrmartin: that's updated with the adjustments i had to make to get the instructions to work | 16:05 |
| clarkb | mrmartin: we typically do not add people as reviewers, it is usually better to let individuals subscriibe to projects they care about and follow changes in them (because adding someone as a reviewer isn't often very visible) | 16:05 |
| openstackgerrit | Merged openstack-infra/shade: Add initial compute functional tests to Shade https://review.openstack.org/158463 | 16:05 |
| dstufft | ECDHE+AESGCM matches any cipher suite that uses the ECDHE key exchange with the AESGCM cipher | 16:05 |
| dstufft | ECDHE-RSA-AES128-GCM-SHA256 is an example of one of them | 16:06 |
| fungi | mrmartin: if you're around the test server should have current content now based on those migration steps | 16:06 |
| *** dhritishikhar has quit IRC | 16:06 | |
| mrmartin | fungi: oh nice | 16:06 |
| dstufft | so they more or less jsut expanded out the list to mention every cipher suite indivdiually, instead of using OpenSSL's ability to use abbreviated selectors | 16:07 |
| clarkb | dstufft: I also notice your string does not explicitly remove export ciphers, not sure if that matters when explicitly listing them | 16:07 |
| clarkb | dstufft: gotcha | 16:07 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for detach_volume NoneType bug 1327218 https://review.openstack.org/164235 | 16:08 |
| openstack | bug 1327218 in OpenStack Compute (nova) "Volume detach failure because of invalid bdm.connection_info" [High,Confirmed] https://launchpad.net/bugs/1327218 | 16:08 |
| openstackgerrit | Merged openstack-infra/system-config: Default to a bogus rsa key on puppetmaster https://review.openstack.org/163267 | 16:08 |
| clarkb | second delete pass on that dfw node worked | 16:08 |
| clarkb | dstufft: fungi so I think my only naive comment at this point is why not exclude export ciphers and friends explicitly? | 16:08 |
| openstackgerrit | Merged openstack-infra/system-config: Move openstack_project::server to node def https://review.openstack.org/162819 | 16:08 |
| dstufft | clarkb: it doesn't matter really because they'll never match any of the strings I included (the same is true of !eNULL, but not !aNULL) | 16:08 |
| AJaeger | jeblair, fungi, clarkb: Do we have any guidelines on "external" IRC channels? https://review.openstack.org/#/c/163331/ adds rdo-puppet channel for notifications... | 16:09 |
| dstufft | you can explicitly exclude them if you want of coruse, it won't hurt anything | 16:09 |
| openstackgerrit | Merged openstack-infra/system-config: Remove devstack-gate-secure template https://review.openstack.org/164058 | 16:09 |
| *** amotoki has quit IRC | 16:10 | |
| *** mpopow has quit IRC | 16:10 | |
| fungi | AJaeger: if they're in our accessbot list and have founder permission granted to the openstackinfra account then it's fine, but we don't let our bots inhabit channels if we don't have control over those channels | 16:11 |
| fungi | clarkb: yeah, that set won't allow old "export-grade" ciphers to negotiate anyway | 16:12 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Small fixes found working on ansible modules https://review.openstack.org/162140 | 16:12 |
| zaro | pelix: ok. i think i get that. Im a bit confused why there's no test/example that shows variables passed to the shell builder? | 16:12 |
| clarkb | fungi: dstufft then why are we negating any ciphers? | 16:12 |
| fungi | clarkb: honestly, you have to have a pretty crufty server for that to even be the case. the "freak" attack is overhyped and not really a risk except with some pretty dated software | 16:12 |
| clarkb | think of it this way. ciphers are really confusing enough as it is | 16:13 |
| AJaeger | fungi: they've setup accessbot now properly | 16:13 |
| clarkb | and we should make it easier to understand what is going on not harder | 16:13 |
| zaro | fungi: should i use a my.cnf.erb template or should i make puppet insert that single entry into the existing my.cnf file? | 16:13 |
| dstufft | clarkb: Current negations: !AES256:!aNULL:!eNULL:!MD5:!DSS:!PSK:!SRP | 16:13 |
| AJaeger | fungi: so on technical level it looks fine, I was just not sure whether there were any other concerns. | 16:13 |
| fungi | zaro: i'd just do a template | 16:13 |
| *** peristeri_ has joined #openstack-infra | 16:13 | |
| AJaeger | fungi: thanks, will review again later in favor. | 16:14 |
| *** Qiming_ has quit IRC | 16:14 | |
| fungi | zaro: or even just straight up install the modified my.cnf file | 16:14 |
| * AJaeger has to leave now and waves good bye - wishing everybody a great weekend | 16:14 | |
| dstufft | clarkb: the !AES256 is because we don't limit the AES size to only 128 bit ciphers, AES 256 isn't meanignfully more secure than 128, it's just slower, but negating it like this makes it easier to add it back in, in the future | 16:14 |
| *** AJaeger has quit IRC | 16:14 | |
| openstackgerrit | Merged openstack-infra/system-config: Add configurable url for OpenStack status https://review.openstack.org/162169 | 16:14 |
| zaro | fungi: the existing my.cnf file has a bunch of entries commented out, do you typically keep those in the template or strip out all the comments? | 16:15 |
| openstackgerrit | Merged openstack-infra/system-config: Update the Gerrit javamelody plugin version on review-dev.o.o https://review.openstack.org/161875 | 16:15 |
| dstufft | clarkb: the !aNull because cipher strings like ECDHE+AESGCM don't specificy an authentication, so techincally a null authentication is fine with that | 16:15 |
| *** rwsu-afk is now known as rwsu | 16:15 | |
| pelix | zaro: I'll look at adding that | 16:15 |
| *** _nadya_ has joined #openstack-infra | 16:15 | |
| dstufft | clarkb: the !eNULL isn't really needed, I just include it for symmetry's sake for !aNULL | 16:15 |
| clarkb | dstufft: I see, this is because we are using the aliases for the long form cipher list | 16:16 |
| fungi | zaro: we usually just grab the file verbatim and put it in puppet, so that it's easier to compare against the distro package provided version later | 16:16 |
| zaro | pelix: it looks like there are examples that attempt to do that but i don't think it's working | 16:16 |
| *** dannywilson has quit IRC | 16:16 | |
| dstufft | the !MD5 is because, like the !aNULL, we aren't specifying hashes, so we make sure not to use md5 | 16:16 |
| *** woodster_ has joined #openstack-infra | 16:16 | |
| zaro | fungi: gotcha, thanks | 16:16 |
| clarkb | er actually looks like !aNULL is needed even with the long form? so only aes256 is a result of that | 16:16 |
| dstufft | and !DSS, !PSK, !SRP is jsut to make the list shorter | 16:16 |
| dstufft | because you can't really get DSS certs, so including DSS ciphers is a waste of time | 16:17 |
| dstufft | and nobody uses PSK or SRP for web traffic | 16:17 |
| dstufft | (You can see what matches the cipher string by doing -> openssl ciphers -v 'ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:RSA+AESGCM:RSA+AES:!AES256:!aNULL:!eNULL:!MD5:!DSS:!PSK:!SRP' | 16:18 |
| clarkb | dstufft: so maybe a note about !aNULL and !eNULL are worthwhile in the commit message? you have noted a bunch of the other decisions making. I dunno I was asked to review. This is my feedback | 16:18 |
| *** dannywilson has joined #openstack-infra | 16:18 | |
| *** dhritishikhar has joined #openstack-infra | 16:19 | |
| *** dannywilson has quit IRC | 16:19 | |
| dstufft | clarkb: sure | 16:20 |
| *** dannywilson has joined #openstack-infra | 16:20 | |
| *** amotoki has joined #openstack-infra | 16:22 | |
| *** jogo is now known as flashgordon | 16:22 | |
| *** mpopow has joined #openstack-infra | 16:22 | |
| *** sdake has joined #openstack-infra | 16:23 | |
| *** ashleighfarnham has joined #openstack-infra | 16:24 | |
| clarkb | I have a list of deletes running to try and cleanup some room in dfw now | 16:24 |
| pelix | zaro: do you mean a job that defines properties so that they available to the environment of the included script, or an example that shows the substitution taking place on the included file contents if you use '!include-raw <filename>'? | 16:25 |
| *** amotoki has quit IRC | 16:27 | |
| *** dannywilson has quit IRC | 16:33 | |
| *** tqtran has joined #openstack-infra | 16:33 | |
| *** Longgeek has joined #openstack-infra | 16:34 | |
| *** HeOS has quit IRC | 16:35 | |
| *** dboik_ has quit IRC | 16:36 | |
| *** dboik has joined #openstack-infra | 16:37 | |
| *** resker has quit IRC | 16:37 | |
| *** melwitt has joined #openstack-infra | 16:41 | |
| zaro | pelix: yes, should either !include-raw or !include-raw-escape pass variables down to an included shell script? | 16:43 |
| zaro | pelix: that's what i was expecting when i read the description again. | 16:43 |
| *** ttx has quit IRC | 16:43 | |
| *** ttx has joined #openstack-infra | 16:43 | |
| *** hashar has quit IRC | 16:44 | |
| *** mpopow has quit IRC | 16:44 | |
| zaro | pelix: so for the example here: http://ci.openstack.org/jenkins-job-builder/definition.html#module-jenkins_jobs.local_yaml can the yaml pass ${VAR1} down to the shell builder script? | 16:44 |
| *** matrohon has quit IRC | 16:49 | |
| *** ashleighfarnham has quit IRC | 16:49 | |
| *** mestery has quit IRC | 16:50 | |
| *** mpaolino has joined #openstack-infra | 16:50 | |
| *** mestery has joined #openstack-infra | 16:51 | |
| pelix | zaro: probably should change it to define a properties section in the yaml specifying values for VAR1 and add a comment to the yaml to indicate the difference | 16:52 |
| pelix | !include-raw will allow template substitution, !include-raw-escape prevents, so guess that's definitely a few examples to be trashed out. | 16:53 |
| openstack | pelix: Error: "include-raw" is not a valid command. | 16:53 |
| pelix | oops | 16:53 |
| *** ghostpl_ has joined #openstack-infra | 16:53 | |
| *** Longgeek has quit IRC | 16:56 | |
| *** harlowja has joined #openstack-infra | 16:57 | |
| clarkb | anyone else want to review 163467? I can make sure the service is restarted with new code once that lands | 16:57 |
| *** ghostpl_ has quit IRC | 16:58 | |
| *** ujuc has joined #openstack-infra | 16:58 | |
| *** dustins_ has joined #openstack-infra | 16:59 | |
| jeblair | clarkb: should we subscribe a restart to the vcsrepo? | 17:00 |
| clarkb | jeblair: possibly, I haven't in the past because it can do things like db migrations which might want to be scheduled | 17:01 |
| *** ivar-lazzaro has joined #openstack-infra | 17:02 | |
| clarkb | jeblair: thank you | 17:02 |
| *** dustins has quit IRC | 17:03 | |
| *** sputnik13 has joined #openstack-infra | 17:03 | |
| *** jlanoux has quit IRC | 17:03 | |
| openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Set mysql client character encoding to utf8 https://review.openstack.org/164264 | 17:04 |
| *** ujuc_ has joined #openstack-infra | 17:04 | |
| *** arxcruz has quit IRC | 17:05 | |
| *** ivar-laz_ has joined #openstack-infra | 17:05 | |
| *** ashleighfarnham has joined #openstack-infra | 17:05 | |
| *** ivar-lazzaro has quit IRC | 17:07 | |
| *** mpavone has quit IRC | 17:07 | |
| *** ujuc has quit IRC | 17:07 | |
| zaro | fungi: ^ | 17:07 |
| *** timcline has joined #openstack-infra | 17:11 | |
| odyssey4me | Hi everyone - a quick semantics, or perhaps nomanclature, question. Unfortunately AJaeger isn't here for me to approach directly. With regards to https://review.openstack.org/#/c/163960/ I'd like to revise the patch with an appropriate description. Any advice regarding what would be more appropriate? Please see the comments in https://review.openstack.org/#/c/163960/6/gerrit/projects.yaml | 17:11 |
| *** cody-somerville has quit IRC | 17:11 | |
| *** mpaolino has quit IRC | 17:11 | |
| *** cody-somerville has joined #openstack-infra | 17:11 | |
| jeblair | odyssey4me: are you Jesse Pertorius? | 17:13 |
| jeblair | odyssey4me: i think the first suggestion of 'Design Specifications for os-ansible-deployment' is my favorite. | 17:13 |
| jeblair | odyssey4me: also, i would recommend splitting that commit into two: one to add the new project, and one to add the skip-if | 17:14 |
| odyssey4me | jeblair yup :) | 17:14 |
| *** elarson has joined #openstack-infra | 17:15 | |
| *** timcline has quit IRC | 17:15 | |
| odyssey4me | jeblair great feedback, thanks - I would guess that I should make the skip-if go in first and depend the other one on it? | 17:15 |
| openstackgerrit | yolanda.robla proposed openstack-infra/system-config: Add configurable graphite url on zuul status https://review.openstack.org/162177 | 17:16 |
| openstackgerrit | Merged openstack-infra/system-config: Deploy latest version of etherpad-lite https://review.openstack.org/163467 | 17:16 |
| *** patrickeast has joined #openstack-infra | 17:16 | |
| *** mpaolino has joined #openstack-infra | 17:16 | |
| jeblair | odyssey4me: they seem independent to me, and unlikely to conflict. so unless i'm missing some reason why they are actually related, i would make them independent. | 17:17 |
| odyssey4me | hmm, ok - now that I see what it's doing (I'm just helping a colleague get this done) I agree - separate patch :) | 17:17 |
| *** ildikov has joined #openstack-infra | 17:17 | |
| *** pelix has quit IRC | 17:18 | |
| openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Updates for os-ansible-deployment adding specs repos and doc config https://review.openstack.org/163960 | 17:19 |
| *** tsg_ has joined #openstack-infra | 17:19 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-zuul: Add fetch_url and poll parameters to zuul.conf https://review.openstack.org/162591 | 17:19 |
| *** markus_z has quit IRC | 17:20 | |
| clarkb | fungi: looks like mordred +2'd the cipher list change so you are good to approve it if you are ready | 17:22 |
| odyssey4me | jeblair let me make sure I understand this correctly to ensure that I get the commit message right... that skip-if will skip checks if an rst/doc file is edited in the os-ansible-deployment repo, right? | 17:22 |
| clarkb | fungi: I can be mostly around to help baby sit too | 17:22 |
| jeblair | odyssey4me: i believe that's the intent and sounds reasonable. i did not closely review. :) | 17:24 |
| *** sdake__ has joined #openstack-infra | 17:24 | |
| openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Add gate check skip for rst/doc files os-ansible-deployment repository https://review.openstack.org/164271 | 17:24 |
| odyssey4me | jeblair thanks - both reviews are in :) | 17:24 |
| openstackgerrit | Jesse Pretorius proposed openstack-infra/project-config: Updates for os-ansible-deployment adding specs repos and doc config https://review.openstack.org/163960 | 17:26 |
| *** sdake has quit IRC | 17:28 | |
| *** dpyzhov_ has quit IRC | 17:29 | |
| *** eharney has quit IRC | 17:30 | |
| *** bdpayne has joined #openstack-infra | 17:31 | |
| *** erlon has quit IRC | 17:31 | |
| *** jistr has quit IRC | 17:31 | |
| *** Ryan_Lane has joined #openstack-infra | 17:31 | |
| *** achanda has joined #openstack-infra | 17:33 | |
| *** pblaho has quit IRC | 17:33 | |
| openstackgerrit | Donald Stufft proposed openstack-infra/puppet-openstackid: Use a set of secure ciphers optimizing for security and performance https://review.openstack.org/163228 | 17:33 |
| *** ashleighfarnham has quit IRC | 17:33 | |
| *** dustins_ has quit IRC | 17:33 | |
| *** otter768 has joined #openstack-infra | 17:34 | |
| openstackgerrit | Donald Stufft proposed openstack-infra/puppet-openstackid: Specify ciphers that optimize for security and performance https://review.openstack.org/163228 | 17:35 |
| dstufft | clarkb: https://review.openstack.org/#/c/163228/ better | 17:36 |
| dstufft | ? | 17:36 |
| *** ayoung has quit IRC | 17:36 | |
| clarkb | dstufft: much, thank you | 17:36 |
| *** otter768 has quit IRC | 17:39 | |
| *** _nadya_ has quit IRC | 17:40 | |
| *** tkelsey has quit IRC | 17:41 | |
| *** johnthetubaguy is now known as zz_johnthetubagu | 17:42 | |
| *** eharney has joined #openstack-infra | 17:42 | |
| *** ayoung has joined #openstack-infra | 17:43 | |
| *** BobBall is now known as BobBall_AWOL | 17:43 | |
| *** dustins has joined #openstack-infra | 17:44 | |
| *** derekh has quit IRC | 17:45 | |
| *** ChuckC has quit IRC | 17:45 | |
| *** dizquierdo has quit IRC | 17:46 | |
| *** prad has joined #openstack-infra | 17:47 | |
| *** signed8bit has joined #openstack-infra | 17:48 | |
| *** sarob has joined #openstack-infra | 17:51 | |
| tsg_ | clarkb: thoughts on https://review.openstack.org/#/c/164112/? | 17:51 |
| *** Sukhdev has quit IRC | 17:52 | |
| clarkb | tsg_: not really, infra core tries to defer those changes to requirements core unless the gate is broken | 17:52 |
| openstackgerrit | Swaminathan Vasudevan proposed openstack-infra/project-config: Append Neutron full aiopcpu job with DVR https://review.openstack.org/158415 | 17:53 |
| *** Longgeek has joined #openstack-infra | 17:53 | |
| *** gokrokve has quit IRC | 17:54 | |
| *** ghostpl_ has joined #openstack-infra | 17:54 | |
| tsg_ | clarkb: okay :) this is being reported as an issue because the swift requirements still has pyeclib>=0.9.2 when we in fact need at least 1.0.3 .. "tox" runs fail as a result | 17:55 |
| tsg_ | clarkb: "tox" runs not in jenkins sense, but in developers' local envs I meant | 17:56 |
| clarkb | tsg_: you will need to get the requirements core group to review | 17:56 |
| *** dprince has quit IRC | 17:56 | |
| tsg_ | clarkb: sure thank you | 17:56 |
| clarkb | tsg_: also if you tox -r it will rebuild your env and fix that locally while you wait | 17:57 |
| *** omnibus7 is now known as davidlenwell | 17:57 | |
| tsg_ | clarkb: ack .. for me it has always worked (given I am the ec lib owner :)) - mostly a complaint from other folks. And you are right in that this is not a showstopper at this point | 17:58 |
| *** sarob has quit IRC | 17:59 | |
| *** alexpilotti has joined #openstack-infra | 18:00 | |
| clarkb | woot X-Delete-At: 1441819791 is set on http://logs.openstack.org/64/164264/1/check/gate-infra-puppet-apply-precise/ab4c6db/ | 18:01 |
| clarkb | now to convert that to a human readable timestamp | 18:01 |
| clarkb | fungi: ^ thank you for merging that change last night | 18:01 |
| *** gokrokve has joined #openstack-infra | 18:01 | |
| greghaynes | clarkb: your clock isnt in epoch format? | 18:01 |
| *** alexpilotti has quit IRC | 18:01 | |
| clarkb | greghaynes: nope, and ya thats for september 9 2015 so looks good | 18:02 |
| *** ghostpl_ has quit IRC | 18:02 | |
| *** alexpilotti has joined #openstack-infra | 18:02 | |
| clarkb | anteaya: as soon as I get these images updated I think we can merge the change to roll this out more widely | 18:02 |
| *** sarob has joined #openstack-infra | 18:02 | |
| clarkb | anteaya: I am working on that now so likely we can do this today | 18:02 |
| *** peristeri_ has quit IRC | 18:04 | |
| *** peristeri has quit IRC | 18:04 | |
| *** esker has joined #openstack-infra | 18:04 | |
| clarkb | hrm I think you may need ensure => latest even when supplying a specific ref to vcsrepo | 18:07 |
| clarkb | thats unintuitive | 18:07 |
| *** ajmiller has joined #openstack-infra | 18:07 | |
| openstackgerrit | Eric Brown proposed openstack/requirements: Bump cryptography version to latest https://review.openstack.org/164289 | 18:10 |
| *** ashleighfarnham has joined #openstack-infra | 18:10 | |
| fungi | clarkb: btw `date -d@1441819791` on gnu systems | 18:11 |
| clarkb | fungi: wow it is that simple | 18:12 |
| fungi | that's what i always end up using to do it anyway | 18:12 |
| *** peristeri has joined #openstack-infra | 18:12 | |
| clarkb | fungi: I remember how non gnu data didn't have the %s format option | 18:12 |
| *** mpaolino has quit IRC | 18:12 | |
| *** sarob has quit IRC | 18:12 | |
| clarkb | and using perl instead | 18:12 |
| fungi | yeah, it's a good trick for scripts. i think bsd has a different way i've used in portable shell scripts | 18:12 |
| fungi | not remembering it right off the top of my head though | 18:13 |
| fungi | `date -t 1441819791` or something like that | 18:13 |
| *** fdegir has quit IRC | 18:14 | |
| fungi | i tend to use epochs in cramped conditions where a full iso 8601 won't fit but i still want seconds resolution | 18:14 |
| clarkb | they are easy to do math on in scripts too :) | 18:14 |
| fungi | that too | 18:15 |
| *** ssam2 has quit IRC | 18:16 | |
| *** sarob has joined #openstack-infra | 18:16 | |
| *** fdegir has joined #openstack-infra | 18:16 | |
| *** tim_o has joined #openstack-infra | 18:18 | |
| EmilienM | does somebody know how tag are managed in openstack-dev mailing list? What should I do if I want to propose a new tag? Is there any repo to commit or is it manual config in mailman? | 18:19 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for detach_volume NoneType bug 1327218 https://review.openstack.org/164235 | 18:19 |
| openstack | bug 1327218 in OpenStack Compute (nova) "Volume detach failure because of invalid bdm.connection_info" [High,Confirmed] https://launchpad.net/bugs/1327218 | 18:19 |
| *** woodster_ has quit IRC | 18:20 | |
| *** fandi has joined #openstack-infra | 18:20 | |
| *** bswartz has quit IRC | 18:20 | |
| ekarlso | gates wedged today or smth ? | 18:21 |
| *** fandi has quit IRC | 18:21 | |
| spzala | jeblair: Hello | 18:21 |
| *** Guest22364 has quit IRC | 18:21 | |
| *** Hal has joined #openstack-infra | 18:22 | |
| clarkb | reading vcsrepo code I think we do need latest but it blindly resets even if you are on the thing to be reset to | 18:22 |
| *** Hal is now known as Guest38487 | 18:22 | |
| clarkb | ekarlso: its not wedged, just bogged down, currently not booting nodes fast enough in our clouds, I have been looking into it | 18:22 |
| *** Longgeek has quit IRC | 18:22 | |
| *** sarob has quit IRC | 18:22 | |
| ekarlso | clarkb: well... my patch has been limboing for 5 hours :( | 18:22 |
| clarkb | ekarlso: what change? | 18:23 |
| ekarlso | https://review.openstack.org/#/c/123408/ | 18:23 |
| ekarlso | dunno why it didnt get checked when I uploaded the PS | 18:23 |
| clarkb | ekarlso: it was just enqueued a minute ago | 18:23 |
| clarkb | and it was tested after you pushed ps6 earlier today | 18:23 |
| ekarlso | clarkb: rly, why does pep8 say it fails then ? :P | 18:24 |
| clarkb | ekarlso: http://logs.openstack.org/08/123408/6/check/gate-cloudkitty-pep8/f0946b2/console.html#_2015-03-13_14_15_33_084 and it does not pass pep8 | 18:24 |
| *** shardy has quit IRC | 18:24 | |
| clarkb | ekarlso: because it failed | 18:24 |
| ekarlso | weird that that doesn't fail locally :U | 18:24 |
| *** wenlock has quit IRC | 18:25 | |
| clarkb | I will need to think a bit about how to handle the etherpad install | 18:26 |
| clarkb | we could update vcsrepo or try something like a git archive instead | 18:26 |
| nibalizer | clarkb: hrm? | 18:27 |
| nibalizer | whats the problem with it? | 18:27 |
| clarkb | nibalizer: I set a specific ref and ensure => present but ensure present really just means make sure the repo is there it doesn't touch it after that | 18:27 |
| clarkb | nibalizer: but if I ensure latest then it git reset --hard $ref each puppet run even if $ref is already checked out | 18:28 |
| jesusaurus | clarkb: ensure => latest didnt do what we wanted? | 18:28 |
| clarkb | jesusaurus: we don't want to ensure latest on the prod server | 18:28 |
| clarkb | jesusaurus: because it will git reset --hard $specificsha1 every 45 minutes | 18:29 |
| nibalizer | what about ensure => $ref, then have admins bump that variable whenever we want to upgrade? | 18:29 |
| clarkb | nibalizer: so thats what I am trying to do essentially but I don't think it works | 18:29 |
| *** dpyzhov_ has joined #openstack-infra | 18:30 | |
| clarkb | nibalizer: https://git.openstack.org/cgit/openstack-infra/puppet-etherpad_lite/tree/manifests/init.pp#n88 | 18:30 |
| *** bswartz has joined #openstack-infra | 18:31 | |
| jesusaurus | clarkb: oh, because someone could hit it between the time of the reset and the robot.txt fix? | 18:32 |
| fungi | EmilienM: official list tags need to be added/modified/deleted by the mailman list admins for the list in question | 18:32 |
| clarkb | jesusaurus: yes | 18:32 |
| EmilienM | fungi: so nothing I can commit somewhere, right ? | 18:32 |
| *** eharney has quit IRC | 18:32 | |
| fungi | EmilienM: unfortunately no, it's done through the mailman admin webui | 18:32 |
| *** Guest38487 has quit IRC | 18:33 | |
| nibalizer | maybe its supposed to ensure => latest, revision => $ref | 18:33 |
| EmilienM | fungi: ok, thx! | 18:33 |
| clarkb | nibalizer: ya thats the behavior that git reset --hard $ref every 45 minutes | 18:33 |
| nibalizer | ya | 18:33 |
| fungi | EmilienM: i think it ends up in the picklefile, which is pretty opaque. there are some utilities for dumping, modifying and recompiling it, but hooking that into configuration management would be a daunting task | 18:33 |
| nibalizer | so what we need is a vcsrepo provider that can fetch, decide if there is stuff to change, and be smart about changing only when needed? | 18:34 |
| clarkb | one nasty thing we could do is fork the project, apply our robots.txt edits only then deploy that | 18:34 |
| clarkb | jesusaurus: ^ and that won't have any reset problems | 18:34 |
| *** e0ne has joined #openstack-infra | 18:34 | |
| clarkb | but I need breakfast/lunch so will think about it while i eat | 18:34 |
| clarkb | nibalizer: pretty much | 18:34 |
| crinkle | fungi: so is it appropriate to ask here for a tag, or is there another group to ask? | 18:34 |
| fungi | EmilienM: the new mailman (3?) might make that easier and we should probably eventually consider modernizing our listserv | 18:34 |
| fungi | crinkle: look at the info page for the list in question and ask the people who are mentioned as list admins for it | 18:35 |
| EmilienM | fungi: ok, thanks. I was wondering because Puppet community may ask for a new tag in the future. | 18:35 |
| crinkle | fungi: ty | 18:35 |
| *** Sukhdev has joined #openstack-infra | 18:35 | |
| *** esker has quit IRC | 18:35 | |
| fungi | you're welcome | 18:35 |
| jesusaurus | clarkb: where are we overwriting robots.txt? | 18:36 |
| jesusaurus | nevermind, found it | 18:36 |
| clarkb | https://git.openstack.org/cgit/openstack-infra/puppet-etherpad_lite/tree/manifests/site.pp#n42 for those following along | 18:36 |
| clarkb | jesusaurus: actually | 18:36 |
| clarkb | jesusaurus: what if we just aliased robots.txt in apache vhost to some other location? | 18:37 |
| clarkb | jesusaurus: that may work and then we don't need new vcsrepo | 18:37 |
| clarkb | fungi: ^ your apache foo is better than mine, is that sane? | 18:37 |
| *** esker has joined #openstack-infra | 18:38 | |
| nibalizer | oh! | 18:39 |
| nibalizer | nanliu has his own vcsrepo provider | 18:39 |
| jesusaurus | clarkb: oh, ++ | 18:39 |
| nibalizer | clarkb: +1 to solving this problem for now, but Im totes gonna look into 'make vcsrepo not suck' | 18:39 |
| clarkb | sounds good | 18:39 |
| jesusaurus | i think this is less an issue with vcsrepo and more an issue with the static file in the etherpad_lite project | 18:40 |
| clarkb | ya | 18:41 |
| jesusaurus | but 'overwrite specific file in project' is probably common enough that it would be useful in the vcsrepo provider | 18:41 |
| nibalizer | this partictuarl thing yes, but there are bigger issues with vcsrepo | 18:41 |
| nibalizer | if taht makes any sense | 18:41 |
| jesusaurus | ah, yeah | 18:41 |
| *** ayoung has quit IRC | 18:42 | |
| nibalizer | https://github.com/nanliu/puppet-git | 18:43 |
| *** ayoung has joined #openstack-infra | 18:43 | |
| pleia2 | anteaya: I have a new found respect for openstack election officials, and welcome our new scaling-election-tools robot overloads (tristanC got me up to speed with confirming nominees, hoo boy) | 18:43 |
| pleia2 | anteaya: so thank you for your work on this | 18:43 |
| *** funzo has joined #openstack-infra | 18:46 | |
| greghaynes | clarkb: thoughts on adding mox as a dep to nodepool as part of this testing deal? | 18:46 |
| greghaynes | or is there another mocking tool youall prefer | 18:47 |
| *** andreykurilin_ has joined #openstack-infra | 18:49 | |
| clarkb | whatever the one in py3k is | 18:49 |
| greghaynes | ah, mock | 18:49 |
| pleia2 | heading off to a lunch meeting, bbiab | 18:51 |
| *** james_li has joined #openstack-infra | 18:51 | |
| *** esker has quit IRC | 18:52 | |
| *** james_li is now known as james_li_ | 18:56 | |
| *** ivar-laz_ has quit IRC | 18:56 | |
| *** liusheng has quit IRC | 18:56 | |
| *** ivar-lazzaro has joined #openstack-infra | 18:56 | |
| *** liusheng has joined #openstack-infra | 18:57 | |
| *** james_li_ is now known as james_li | 18:57 | |
| *** ivar-laz_ has joined #openstack-infra | 18:58 | |
| pc_m | clarkb: hi | 18:58 |
| *** ghostpl_ has joined #openstack-infra | 18:58 | |
| clarkb | hello | 18:58 |
| *** james_li is now known as james_li_ | 18:58 | |
| *** ivar-laz_ has quit IRC | 18:58 | |
| pc_m | clarkb: Had a question about Openstack API documentation - wondering if you can point me in the right direction (saw your name on a commit)? | 18:58 |
| *** james_li_ is now known as james_li | 18:59 | |
| fungi | clarkb: looking | 18:59 |
| *** ivar-laz_ has joined #openstack-infra | 19:00 | |
| *** hdd_ has quit IRC | 19:00 | |
| pc_m | clarkb: For VPNaaS we had API documentation on the web, but at some point that documentation was overhauled and there is no longer any VPNaaS documentation. I see the files in the old netconn-api area, and heard something about the API doc needs to be converted to WADL. | 19:00 |
| clarkb | pc_m: sorry I don't know much about how the api docs are managed | 19:01 |
| pc_m | clarkb: Do you know who I can ask about info on how to convert this stuff over, and the process/procedure? | 19:01 |
| clarkb | but annegentle is the person I would ask | 19:01 |
| *** dprince has joined #openstack-infra | 19:01 | |
| fungi | clarkb: yeah, aliasing robots.txt should work just fine | 19:01 |
| pc_m | clarkb: Any idea who may know? | 19:01 |
| *** _nadya_ has joined #openstack-infra | 19:01 | |
| *** ivar-lazzaro has quit IRC | 19:01 | |
| clarkb | fungi: cool I will cook them up right now | 19:01 |
| fungi | pc_m: depends on what you mean by api documentation. do you have a specific example url? | 19:01 |
| *** james_li has quit IRC | 19:02 | |
| pc_m | Well all of the REST API. Here is really old doc (before it was put in the API documentation, and before that was all changed and VPN info excluded): https://wiki.openstack.org/wiki/Neutron/VPNaaS#REST_API | 19:03 |
| *** cody-somerville has quit IRC | 19:03 | |
| fungi | ianw: latest patchset on https://review.openstack.org/157978 adds your epoch recommendation (along with some additional testing) | 19:04 |
| pc_m | It shows v1.0, but we had v2.0 up on docs.openstack.org/api | 19:04 |
| *** cody-somerville has joined #openstack-infra | 19:04 | |
| fungi | pc_m: okay, so rest api documentation not library api documentation. the terms tend to get overloaded | 19:04 |
| pc_m | fungi: yeah. | 19:05 |
| fungi | pc_m: i believe the docs team are gatekeepers for the rest api documentation (as opposed to the library api documentation which is autogenerated) | 19:05 |
| pc_m | for networking | 19:05 |
| pc_m | Is there an IRC channel for them? | 19:05 |
| *** ghostpl_ has quit IRC | 19:05 | |
| fungi | pc_m: according to https://wiki.openstack.org/wiki/IRC it should be #openstack-doc | 19:06 |
| *** mpopow has joined #openstack-infra | 19:06 | |
| pc_m | fungi: Thanks! I check that out. | 19:06 |
| *** gordc has quit IRC | 19:06 | |
| fungi | pc_m: i believe there's been talk of mechanisms by which to autogenerate rest api documentation but as far as i know it's manually curated right now. i might be wrong of course | 19:07 |
| *** dkliban is now known as dkliban_afk | 19:07 | |
| pc_m | fungi: That would be nice. Kyle wants me to try to restore the documentation... I'm hoping it's not much to convert. | 19:07 |
| *** dkliban_afk is now known as dkliban_brb | 19:08 | |
| *** dustins has quit IRC | 19:10 | |
| *** thedodd has quit IRC | 19:12 | |
| *** dustins has joined #openstack-infra | 19:12 | |
| *** tqtran is now known as tqtran_afk | 19:16 | |
| *** ivar-laz_ has quit IRC | 19:16 | |
| openstackgerrit | K Jonathan Harker proposed openstack-infra/project-config: Remove unneeded workaround https://review.openstack.org/164311 | 19:16 |
| *** ivar-lazzaro has joined #openstack-infra | 19:17 | |
| *** ashleighfarnham has quit IRC | 19:17 | |
| mordred | greghaynes: although we tend towards using fakes in nodepool rather than mocks | 19:17 |
| mordred | greghaynes: but I don't fully have the context of what you're hacking towards ... | 19:18 |
| mordred | jeblair: ^^ ? | 19:18 |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-etherpad_lite: Don't host robots.txt from etherpad repo install https://review.openstack.org/164312 | 19:19 |
| clarkb | jesusaurus: nibalizer fungi ^ that isn't tested, but I think I did it correcntly. Even the [L] flag to the rewrite to prevent it from continuing to be rewritten | 19:19 |
| *** zul has quit IRC | 19:19 | |
| clarkb | I will give that a go on etherpad-dev in a few | 19:19 |
| * jeblair searches for context | 19:20 | |
| greghaynes | mordred: yep, ive noticed. Im using fakes as much as possible but theres some cases where I think mocks go a long way, probably easiest if I just show you the code | 19:20 |
| mordred | greghaynes: nod | 19:21 |
| mordred | greghaynes: I tend to talk that way a lot aroudn here | 19:21 |
| jeblair | greghaynes: that sounds good. i think you've picked that up correctly, that in general we want to test actual real code. as clarkb says: mocks tend toward "assert true" for tests. but i would not say they are off the table, so if there's something really compelling, we can look into it. | 19:21 |
| greghaynes | Yea, actually easy case I am running into is I want to test the output on command tests - this is easy if I mock prettytable and check that | 19:22 |
| *** rkukura_ has joined #openstack-infra | 19:24 | |
| fungi | clarkb: left some comments | 19:24 |
| clarkb | fungi: looking | 19:24 |
| jeblair | greghaynes: that sounds sensible... :) | 19:25 |
| *** rkukura has quit IRC | 19:25 | |
| *** rkukura_ is now known as rkukura | 19:25 | |
| fungi | i'm about to head out to an early dinner with the inlaws, but should be back on later. once 163228 merges can someone check openstackid.org on https://www.ssllabs.com/ and make sure it looks reasonable? | 19:25 |
| jeblair | greghaynes: that's replacing minimal actual functionality and more aimed toward capturing output that is otherwise difficult to measure | 19:26 |
| greghaynes | hehe. ++ on the avoiding the whle mock -> tuatology testing | 19:26 |
| spzala | jeblair: Hi. When you get a chance - stevemar had a discussion with you earlier about problem we are having with heat-translator project commit message not showing up launchpad (https://launchpad.net/heat-translator) blueprint link and as per that discussion I have moved Driver from an individual to team. I am going to change the ownership for new driver to 'openstack-admins', does that sound OK? | 19:26 |
| jeblair | fungi: ack | 19:27 |
| clarkb | fungi: can you see my response to the rewrite comment | 19:27 |
| fungi | thanks jeblair | 19:27 |
| clarkb | fungi: if you have a moment before going | 19:27 |
| fungi | clarkb: looking real quick | 19:27 |
| jeblair | spzala: that sounds good, thanks | 19:27 |
| *** esker has joined #openstack-infra | 19:27 | |
| spzala | jeblair: cool. no problem, Thank you! | 19:28 |
| *** esker has quit IRC | 19:28 | |
| *** esker has joined #openstack-infra | 19:28 | |
| jeblair | spzala: i have to run right now, but after you do that, if you can add the project to the "openstack" project group, that should finish the work. i can try to take care of that later if you have trouble finding the option (i am not certain about where it is right now) | 19:29 |
| fungi | clarkb: yeah, you're right, i missed there was a RewriteCond there | 19:29 |
| spzala | jeblair: Sounds great. Thanks! Let me work on it, I will update you. | 19:29 |
| jeblair | for reference our ssllabs grade is "B" now with rc4 and no forward secrecy as highlighted problems. | 19:30 |
| fungi | spzala: if you configure the project in launchpad you can set the "part of" option to openstack | 19:31 |
| *** ujuc_ has quit IRC | 19:31 | |
| fungi | spzala: it's named a little strangely, but you should be able to find it most of the way down the configure page | 19:32 |
| openstackgerrit | Joe Gordon proposed openstack-infra/project-config: Add new keystone tempest job to only run keystone and scenario tests https://review.openstack.org/164314 | 19:32 |
| spzala | fungi: awesome, I just did that and seeing the changes are in effect. | 19:32 |
| *** dhritishikhar has quit IRC | 19:32 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-etherpad_lite: Don't host robots.txt from etherpad repo install https://review.openstack.org/164312 | 19:33 |
| *** Hal has joined #openstack-infra | 19:33 | |
| *** dannywilson has joined #openstack-infra | 19:33 | |
| spzala | fungi: jeblair: thanks, seems like it's all set :-) | 19:34 |
| *** Hal is now known as Guest3273 | 19:34 | |
| *** dkliban_brb is now known as dkliban | 19:34 | |
| *** otter768 has joined #openstack-infra | 19:35 | |
| stevemar | spzala, sounds like heat-translator is all fixed up! | 19:36 |
| *** gordc has joined #openstack-infra | 19:36 | |
| *** esker has quit IRC | 19:37 | |
| spzala | stevemar: yup :-), it looks great now. | 19:37 |
| clarkb | ok I have applied that change to etherpad-dev and it seems to work | 19:38 |
| *** dannywilson has quit IRC | 19:38 | |
| clarkb | I edited the old robots.txt location too to double check I was getting the content from docroot and not the etherpad service | 19:38 |
| *** esker has joined #openstack-infra | 19:38 | |
| openstackgerrit | Merged openstack-infra/puppet-nodepool: Upgrade dependent libraries when we upgrade https://review.openstack.org/161951 | 19:38 |
| *** dustins has quit IRC | 19:39 | |
| *** otter768 has quit IRC | 19:40 | |
| *** radez is now known as radez_g0n3 | 19:40 | |
| *** dpyzhov_ has quit IRC | 19:40 | |
| *** esker has quit IRC | 19:41 | |
| tim_o | It appears that the instructions at http://ci.openstack.org/third_party.html#posting-result-to-gerrit may need to be revised | 19:41 |
| *** jedimike has quit IRC | 19:41 | |
| *** imcsk8 has quit IRC | 19:42 | |
| *** imcsk8 has joined #openstack-infra | 19:42 | |
| *** dpyzhov_ has joined #openstack-infra | 19:42 | |
| openstackgerrit | Merged openstack-infra/puppet-storyboard: Added a Vagrant module and manifest for easier development. https://review.openstack.org/157465 | 19:42 |
| tim_o | slightly, as the end "... --verified=-1 c0ff33" -- 6 characters do not work I need the full string... | 19:43 |
| *** esker has joined #openstack-infra | 19:44 | |
| *** esker has quit IRC | 19:44 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Ensure latest on etherpad vcsrepo https://review.openstack.org/164323 | 19:44 |
| clarkb | ok ^ and its dependency should make etherpad puppets happy | 19:44 |
| *** esker has joined #openstack-infra | 19:44 | |
| clarkb | tim_o: feel free to propose an update to the docs. They live in the openstack-infra/system-config repo | 19:45 |
| mtreinish | clarkb, fungi: I was about to push the subunit2sql release with the migration, but I was thinking what's the puppet timeout for the execs? because I imagine the alter table will take quite some time with >65M rows | 19:46 |
| jeblair | the node graph looks very unhappy | 19:46 |
| mordred | clarkb: +3 on the depend ... +2'd the patch above | 19:46 |
| clarkb | mordred: thank you | 19:46 |
| jeblair | i think we've dropped back down to ~60 hpcloud nodes | 19:46 |
| clarkb | mtreinish: its 5 minutes iirc | 19:47 |
| clarkb | mtreinish: but can be set if you want | 19:47 |
| mtreinish | clarkb: hmm, yeah I'm pretty sure 5min will just cause things to timeout | 19:47 |
| jeblair | 561 ports, so we shouldn't be hitting the limit there | 19:47 |
| jeblair | 387 floating ips | 19:48 |
| jeblair | does that mean we've leaked 180 ports? | 19:48 |
| mtreinish | clarkb: I expect it to be really slow | 19:48 |
| clarkb | jeblair: no my script says we have leaked 3 | 19:49 |
| jeblair | clarkb: which script reports that? | 19:49 |
| clarkb | could be a bug in my script but aiui there is no 1:1 mapping between floating IPs and ports since floating IPs are nat rules | 19:50 |
| clarkb | jeblair: ~clarkb/list-leaked-ports.sh on puppetmaster | 19:50 |
| jeblair | clarkb: yeah, though i don't quite see why they would be drastically different? | 19:50 |
| *** Longgeek has joined #openstack-infra | 19:50 | |
| clarkb | jeblair: source the hpcloud region-b env file thing then run it out of my homedir (it doesn't fully path things) | 19:50 |
| clarkb | jeblair: floating IPs are only assigned after the node boots successfully iirc | 19:50 |
| rcarrillocruz | clarkb: hiya, just saw you are fiddling with etherpad | 19:51 |
| clarkb | so we may not be getting nodes booted to that point | 19:51 |
| *** esker has quit IRC | 19:51 | |
| rcarrillocruz | you having migration to trusty in mind by any chance | 19:51 |
| rcarrillocruz | ? | 19:51 |
| clarkb | rcarrillocruz: not yet, trying to address the suggestion that we have some security vulnerabilities | 19:51 |
| rcarrillocruz | ah ok | 19:52 |
| clarkb | rcarrillocruz: but these changes should make it easier to redeploy on trusty | 19:52 |
| openstackgerrit | Merged openstack-infra/puppet-storyboard: Moved working_directory configuration element into correct block. https://review.openstack.org/158437 | 19:52 |
| openstackgerrit | Merged openstack-infra/puppet-openstackid: Specify ciphers that optimize for security and performance https://review.openstack.org/163228 | 19:52 |
| openstackgerrit | Merged openstack-infra/puppet-storyboard: Updated storyboard configuration for pymysql. https://review.openstack.org/156755 | 19:52 |
| openstackgerrit | Merged openstack-infra/puppet-storyboard: Added new OAuth Parameters https://review.openstack.org/157464 | 19:52 |
| jeblair | clarkb: did you do alien cleanup on hpcloud yesterday? | 19:52 |
| rcarrillocruz | no big deal, i have a change pending to enable websockets, which we can do from trusty onwards due to apache module for websocket passhthru only available in trusty | 19:52 |
| clarkb | jeblair: I did not | 19:52 |
| jeblair | novaclient.exceptions.ClientException: An unexpected error prevented the server from fulfilling your request: [Errno 12] Cannot allocate memory (Disable debug mode to suppress these details.) (HTTP 500) | 19:53 |
| jeblair | um. | 19:53 |
| *** sabeen has quit IRC | 19:53 | |
| * fungi is still around for half an hour or so, so will check openstackid.org out thoroughly once puppet picks up 163228 | 19:53 | |
| clarkb | was that part of the list of things to do? sorry I ended up doing them in rax today because I noticed rax had alien nodes from the rax reboots last week | 19:53 |
| jeblair | that was ci-overcloud.hp1.tripleo.org | 19:53 |
| clarkb | jeblair: I can do alien listings now though | 19:53 |
| *** thedodd has joined #openstack-infra | 19:53 | |
| jeblair | clarkb: no, i think we're hitting quota on hpcloud and suspect aliens are involved. | 19:53 |
| jeblair | just wanted to know when the invasion might have started | 19:54 |
| jeblair | (note alien lists on hpcloud are weird, you have to do "nodepool alien-list hpcloud-b1|grep hpcloud-b1" because of the whole 5x fake providers thing) | 19:54 |
| *** dpyzhov_ has quit IRC | 19:55 | |
| *** tqtran_afk is now known as tqtran | 19:55 | |
| jeblair | actually it's: "nodepool alien-list hpcloud-b1|grep hpcloud-b1-" | 19:55 |
| clarkb | ya because of the overloaded providers | 19:56 |
| clarkb | and the hpcloud-b1 shows up in all rows | 19:56 |
| clarkb | so there are aliens there | 19:56 |
| clarkb | jeblair: I will collect the info and run an xargs delete against them | 19:56 |
| *** stevemar has quit IRC | 19:56 | |
| *** ajmiller_ has joined #openstack-infra | 19:56 | |
| jeblair | clarkb: ok -- might want to take 2 snapshots since it's really busy | 19:56 |
| fungi | i've also noticed that i get a cleaner list if i do it twice about 10 minutes apart and then only consider nodes from the second list which were also present in the first | 19:57 |
| jeblair | clarkb: (sometimes a node can appear as an alien if it's just booting up) | 19:57 |
| jeblair | fungi: yeah that :) | 19:57 |
| clarkb | noted | 19:57 |
| jeblair | clarkb: i had already started a list; ~root/aliens has an hpcloud snapshot that just finished | 19:57 |
| jeblair | clarkb: but i'm about to grab lunch so if you are around and want to continue, all yours | 19:58 |
| fungi | yeah, me too | 19:58 |
| fungi | i suspect all three of us started one | 19:58 |
| clarkb | also the 2-node subnodes show up in those lists :/ | 19:58 |
| clarkb | but there are few of those so I can filter them out if they belong to valid multinode test envs | 19:58 |
| jeblair | oh, oops. | 19:58 |
| fungi | oh, interesting point | 19:58 |
| *** ajmiller has quit IRC | 20:00 | |
| mtreinish | clarkb: do you have a pointer to how I can change the timeout for the db upgrade call? | 20:00 |
| clarkb | mtreinish: https://docs.puppetlabs.com/references/latest/type.html#exec-attribute-timeout | 20:00 |
| *** penguinRaider has joined #openstack-infra | 20:01 | |
| mtreinish | clarkb: ah, ok thanks | 20:02 |
| fungi | i'm showing 172 aliens in hpcloud, but that's without filtering out the multinodes | 20:03 |
| clarkb | fungi: there is only one 2 node | 20:03 |
| fungi | that's filtering on a second list with a 10-minute delay | 20:03 |
| *** hdd_ has joined #openstack-infra | 20:03 | |
| fungi | got it. so we've probably got right at 170 | 20:03 |
| clarkb | well that subnode looks like it leaked because its primary node is not in nodepool list output so we can delete it | 20:04 |
| fungi | which, yeah, could be causing some issues but shouldn't account for only being able to build 60 nodes | 20:04 |
| clarkb | anyways I will do a second listing now and diff against jeblairs then run some deletions | 20:04 |
| *** esker has joined #openstack-infra | 20:04 | |
| *** hashar has joined #openstack-infra | 20:06 | |
| *** achanda has quit IRC | 20:06 | |
| mtreinish | clarkb: for the mysqldump do you have any idea on how long that will take? or should I just play it safe and set the timeout to 0 too? | 20:07 |
| *** _nadya_ has quit IRC | 20:07 | |
| *** ashleighfarnham has joined #openstack-infra | 20:08 | |
| *** esker has quit IRC | 20:08 | |
| *** spzala has quit IRC | 20:08 | |
| clarkb | I don't have any idea | 20:08 |
| clarkb | its quite a few gigs rght? | 20:08 |
| mtreinish | yeah it was ~90GB a couple weeks ago | 20:09 |
| *** yamahata has joined #openstack-infra | 20:09 | |
| krotscheck | Is there data on how often we build and/or run horizon related things in the gate? I'm trying to figure out whether a thing I'm doing for them won't fall down. | 20:09 |
| mtreinish | krotscheck: in devstack? or elsewhere? | 20:09 |
| *** mpopow has quit IRC | 20:09 | |
| *** esker has joined #openstack-infra | 20:10 | |
| clarkb | ok I have hpcloud-b1 deletions running serially (to avoid getting rate limited if possible) | 20:10 |
| krotscheck | mtreinish: I... guess? I'm trying to figure how many hits a bower mirror would receive if it's introduced. | 20:10 |
| *** achanda has joined #openstack-infra | 20:11 | |
| krotscheck | mtreinish: So anytime that horizon is cloned and installed I suppose. | 20:11 |
| *** esker has quit IRC | 20:11 | |
| clarkb | graphite tracks how many jobs run, so you can basically take the count of those jobs | 20:11 |
| mtreinish | clarkb: I just ran a mysqldump locally from the infra db with similar options and it took ~18min. | 20:11 |
| clarkb | right now I think we peak at ~35k jobs total across the board per day | 20:11 |
| clarkb | so horizon would be installed less than 35k times per day | 20:11 |
| *** gordc has quit IRC | 20:11 | |
| mtreinish | krotscheck: well in a tempest devstack job horizon is only hit once after its installed (to login) | 20:12 |
| david-lyle | 35K, we're famous | 20:12 |
| david-lyle | infamous? | 20:12 |
| david-lyle | eh | 20:12 |
| mtreinish | krotscheck: but there are horizon selinium jobs which I think spin things up | 20:12 |
| mtreinish | david-lyle: heh | 20:12 |
| krotscheck | Hrm. ok, so roughly one run per second. | 20:13 |
| krotscheck | That's easy enough to simulate. | 20:13 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/puppet-subunit2sql: Set timeouts for db upgrade operations https://review.openstack.org/164333 | 20:16 |
| mtreinish | clarkb: ^^^ | 20:16 |
| *** Longgeek has quit IRC | 20:18 | |
| tim_o | How do I get my log files to post correctly from our CI? | 20:18 |
| clarkb | tim_o: do you mean the links in gerrit? | 20:19 |
| clarkb | it should be automatic if using zuul, otherwise you can dig up the format zuul uses in the comments | 20:19 |
| tim_o | I believe I emitted the correct URL for them in the Gerrit message: http://144.49.208.28:8000/build_logs/2015-03-13_16-03-11/ is the URL can folks get to it ok? | 20:20 |
| *** mrmartin has quit IRC | 20:20 | |
| clarkb | yes, my only suggestion would be to use a DNS record if possible so that if your IP changes you can just update DNS | 20:21 |
| tim_o | oh, let me try that too, it maybe setup already. If I set that up, will the log link show up correctly? | 20:22 |
| clarkb | tim_o: I am not sure what you mean by show up correctly. Can you show me where it isn't correct or how? | 20:22 |
| openstackgerrit | Merged openstack-infra/shade: Add cover to .gitignore https://review.openstack.org/162064 | 20:23 |
| *** achanda has quit IRC | 20:25 | |
| *** e0ne has quit IRC | 20:25 | |
| tim_o | Here is where I'm looking, on the review page: https://review.openstack.org/#/c/154709/ | 20:26 |
| openstackgerrit | Jesse DeFer proposed openstack-infra/jenkins-job-builder: Add 'Job Log Logger' wrapper https://review.openstack.org/164338 | 20:27 |
| *** HeOS has joined #openstack-infra | 20:27 | |
| clarkb | tim_o: it looks like your BUILD_TIMESTAMP variable isn't getting interpolated, that would be the first thing to fix. It would be dependent on how yo uare running your tests and uploading the logs | 20:28 |
| fungi | https://www.ssllabs.com/ssltest/analyze.html?d=openstackid.org looks great. thanks dstufft! | 20:31 |
| * fungi heads out to eat | 20:31 | |
| *** tnovacik has joined #openstack-infra | 20:31 | |
| clarkb | tim_o: how are you running these jobs? are you using zuul? | 20:33 |
| tim_o | Jenkins | 20:34 |
| clarkb | tim_o: using the gerrit trigger plugin? | 20:34 |
| *** Sukhdev has quit IRC | 20:35 | |
| *** BharatK has joined #openstack-infra | 20:35 | |
| clarkb | tim_o: https://issues.jenkins-ci.org/browse/JENKINS-26520 perhaps that is related? but in general ou need to make sure that BUILD_TIMESTAMP is part of your build environment for the job | 20:36 |
| BharatK | clarkb: When you have some time please review these two patches: https://review.openstack.org/163323 https://review.openstack.org/163324 | 20:36 |
| *** alexpilotti has quit IRC | 20:37 | |
| tim_o | Gerrit patch sets trigger them | 20:37 |
| *** eharney has joined #openstack-infra | 20:37 | |
| anteaya | clarkb: okay thanks for letting me know the status | 20:38 |
| anteaya | clarkb: been trying to follow but hard to keep up | 20:38 |
| anteaya | pleia2: glad you are up to speed | 20:38 |
| anteaya | pleia2: welcome | 20:39 |
| clarkb | BharatK: done, if there is a reason you have two changes instead of one (which is what I suggest) let me know and I can flip my vote | 20:39 |
| clarkb | anteaya: no worries | 20:39 |
| *** ociuhandu has quit IRC | 20:39 | |
| *** sdake__ has quit IRC | 20:40 | |
| tim_o | BUILD_TIMESTAMP is part of the build environment...I'm just trying to find out what the requirement is here | 20:41 |
| clarkb | tim_o: the requirement is that the logs be reachable from the links you post in gerrit | 20:41 |
| *** _nadya_ has joined #openstack-infra | 20:41 | |
| clarkb | tim_o: currently BUILD_TIMESTAMP is not being interpolated so your links do not meet the requirement | 20:41 |
| BharatK | clarkb: these two patches does two different changes. 1. Changes the devstack job template which effects glusterfs, sheepdog jobs and 2. Purely related to devstack-plugin-glusterfs project | 20:42 |
| clarkb | tim_o: I would double check that BUILD_TIMESTAMP is in jenkins environment not just the test environment (look at the job parameters list) | 20:42 |
| BharatK | clarkb: that is why I sent as two different patches. | 20:42 |
| clarkb | BharatK: its really just one change right? you are adding a non voting test to cinder | 20:42 |
| clarkb | BharatK: you don't need to change the testing that happens against the plugin twice | 20:42 |
| BharatK | clarkb: okay I will merge these two patches | 20:45 |
| BharatK | clarkb: thanks clark | 20:45 |
| *** _nadya_ has quit IRC | 20:46 | |
| anteaya | pleia2: if you have any questions ask tristanC first and then if he needs to he can ask me, that way you both learn | 20:46 |
| anteaya | pleia2: happy to support with anything you both need, but decisions are up to tristanC and yourself | 20:46 |
| clarkb | anteaya: just one more image to go until we can merge the swift logs change | 20:48 |
| openstackgerrit | Joe Gordon proposed openstack-infra/project-config: Stop running useless tests on horizon https://review.openstack.org/164344 | 20:48 |
| clarkb | need all the bare-* nodes updated because that is wher those jobs run | 20:48 |
| anteaya | clarkb: okay | 20:49 |
| anteaya | ah I didn't know that, thank you | 20:49 |
| *** ghostpl_ has joined #openstack-infra | 20:49 | |
| tim_o | I'm using the EnvInject plugin to add BUILD_TIMESTAMP to the build environemthn for the job, so I'm still puzzled here | 20:49 |
| anteaya | when the devstack and bare node setups are folded into one, what will they be called? | 20:49 |
| anteaya | do we know yet? | 20:50 |
| tim_o | here is a link: https://wiki.jenkins-ci.org/display/JENKINS/EnvInject+Plugin | 20:50 |
| clarkb | tim_o: maybe that isn't running in a way that makes it available to the gerrit plugin? | 20:50 |
| clarkb | anteaya: I think just 'trusty' and 'centos7' | 20:51 |
| *** stevemar has joined #openstack-infra | 20:52 | |
| anteaya | that seems reasonable | 20:53 |
| mordred | anteaya: I think we shoudl call them Wilhem and Brunhilda | 20:54 |
| *** bswartz has quit IRC | 20:54 | |
| anteaya | that will go over well too, I'm sure | 20:54 |
| mordred | anteaya: "anybody know why tests are failing on wilhem?" | 20:55 |
| mordred | see - it has a good ring to it | 20:55 |
| clarkb | ha | 20:55 |
| openstackgerrit | Bharat Kumar Kobagana proposed openstack-infra/project-config: Modifying devstack plugin job template https://review.openstack.org/163323 | 20:56 |
| anteaya | when tests fail on wilhem can he scream? https://www.youtube.com/watch?v=cdbYsoEasio | 20:56 |
| clarkb | anteaya: I was mistaken, rax-dfw image builds are all kinds of craz right now | 20:56 |
| clarkb | anteaya: so ~4 more images | 20:56 |
| *** ghostpl_ has quit IRC | 20:56 | |
| anteaya | no worries, I have pizza to warm and eat first | 20:57 |
| anteaya | and I just came back from my walk | 20:57 |
| mordred | anteaya: YES | 20:57 |
| anteaya | mordred: then wilhem has my vote | 20:57 |
| mordred | anteaya: in fact, I think every test failure should use asterisk to make a phone call to the dev who's patch it was and just play the wilhelm scream | 20:57 |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: Add unit test for create_server https://review.openstack.org/160155 | 20:57 |
| *** achanda has joined #openstack-infra | 20:57 | |
| openstackgerrit | Clint 'SpamapS' Byrum proposed openstack-infra/shade: Add basic unit test for shade.openstack_cloud https://review.openstack.org/159674 | 20:57 |
| *** melwitt has quit IRC | 20:58 | |
| anteaya | mordred: I am considering the ramifications of such behaviour | 20:59 |
| clarkb | greghaynes: link mordred your sqlite thing | 20:59 |
| *** rfolco has quit IRC | 20:59 | |
| clarkb | mordred: you will like this because it is very similar to your suggestion above | 20:59 |
| greghaynes | https://github.com/mackyle/sqlite/blob/3cf493d4018042c70a4db733dd38f96896cd825f/src/os.h#L52 | 20:59 |
| greghaynes | clarkb: ^ ? | 20:59 |
| clarkb | ya | 20:59 |
| *** melwitt has joined #openstack-infra | 21:00 | |
| greghaynes | You can sense the rage in that commiters tone | 21:00 |
| *** harlowja has quit IRC | 21:00 | |
| mordred | BWAHAHAHAHAHAHAHA | 21:00 |
| *** melwitt has quit IRC | 21:00 | |
| *** ddieterly has quit IRC | 21:00 | |
| mordred | that wins all the prizes | 21:00 |
| *** esker has joined #openstack-infra | 21:00 | |
| *** koolhead17 has quit IRC | 21:01 | |
| jroll | lol | 21:02 |
| *** jedimike has joined #openstack-infra | 21:02 | |
| tim_o | do you mean using $BUILD_TIMESTAMP in the ssh post? | 21:03 |
| tim_o | or something with https://wiki.jenkins-ci.org/display/JENKINS/Gerrit+Trigger | 21:04 |
| clarkb | tim_o: Gerrit Trigger is what you use to comment back to gerrit right? | 21:04 |
| clarkb | tim_o: whatever you are using to comment in gerrit | 21:05 |
| clarkb | ok all aliens but one have been deleted | 21:05 |
| clarkb | the single non alien node, 9a89245c-6604-45af-a39d-0b20f0c8e9c7, is locked and nova unlock gives a 400 error | 21:05 |
| jeblair | clarkb: we recently managed to get 200 nodes out of hpcloud. it's down to 120 now, but much better. | 21:06 |
| clarkb | mordred: jeblair ^ maybe that something the noc can sort out? | 21:06 |
| *** harlowja has joined #openstack-infra | 21:06 | |
| jeblair | clarkb: i'll pass it on | 21:06 |
| clarkb | its a py3k-precise node so pretty sure we don't need it at all | 21:06 |
| *** melwitt has joined #openstack-infra | 21:07 | |
| mtreinish | jeblair: do you have any thoughts on: https://review.openstack.org/#/c/164333/ (it's a 2 liner :) ) | 21:08 |
| jeblair | clarkb: did you delete 6911addb-584f-442b-88c1-8eb3cb3aee1c ? | 21:09 |
| *** esker has quit IRC | 21:10 | |
| jeblair | (not terribly important, apparently it was on a nova host they rebooted and wondered if it was okay) | 21:13 |
| *** dangers_away is now known as dangers | 21:13 | |
| *** marun has quit IRC | 21:14 | |
| *** esker has joined #openstack-infra | 21:15 | |
| *** esker has quit IRC | 21:15 | |
| *** ldnunes has quit IRC | 21:15 | |
| *** mattfarina has quit IRC | 21:15 | |
| *** pc_m has quit IRC | 21:16 | |
| *** tkelsey has joined #openstack-infra | 21:18 | |
| *** angela-s has joined #openstack-infra | 21:18 | |
| *** jedimike has quit IRC | 21:20 | |
| tim_o | I'm currently using ssh to comment in Gerrit | 21:20 |
| *** tkelsey has quit IRC | 21:22 | |
| *** andreykurilin_ has quit IRC | 21:23 | |
| *** andreykurilin_ has joined #openstack-infra | 21:23 | |
| clarkb | jeblair: yes it is i nmy list | 21:24 |
| clarkb | tim_o: then yes ssh would need access to that var | 21:24 |
| krotscheck | All the dependencies on https://review.openstack.org/#/c/158434/ have merged. This will re-enable JS draft builds. | 21:25 |
| krotscheck | All it needs is a couple of reviews. | 21:26 |
| openstackgerrit | Swaminathan Vasudevan proposed openstack-infra/project-config: Add Neutron DVR aiopcpu job for multi-node testing https://review.openstack.org/158415 | 21:26 |
| *** achanda has quit IRC | 21:27 | |
| *** fdegir has quit IRC | 21:28 | |
| *** mrunge has quit IRC | 21:29 | |
| pleia2 | anteaya: thanks, I'll be sure to let you know if I have questions :) | 21:29 |
| BharatK | clarkb: merged those two patches | 21:29 |
| BharatK | clarkb: please review https://review.openstack.org/#/c/163323/ | 21:29 |
| *** tnovacik has quit IRC | 21:29 | |
| clarkb | BharatK: looks good, thanks | 21:30 |
| *** hodos|2 has joined #openstack-infra | 21:30 | |
| BharatK | clarkb: Thanks for the quick review. | 21:31 |
| *** kgiusti has left #openstack-infra | 21:31 | |
| clarkb | anteaya: ok https://review.openstack.org/#/c/156521/7 should be good to go | 21:33 |
| *** achanda has joined #openstack-infra | 21:33 | |
| *** hodos has quit IRC | 21:33 | |
| clarkb | I would approve but I am about to step out beacuse its >70F outside in march | 21:34 |
| clarkb | on a friday | 21:34 |
| *** jgrimm_ has joined #openstack-infra | 21:34 | |
| *** lascii is now known as alaski | 21:35 | |
| *** maurosr has quit IRC | 21:35 | |
| *** zz_ja has quit IRC | 21:35 | |
| *** bknudson has quit IRC | 21:35 | |
| *** jgrimm- has joined #openstack-infra | 21:36 | |
| *** otter768 has joined #openstack-infra | 21:36 | |
| *** jgrimm has quit IRC | 21:36 | |
| *** maurosr has joined #openstack-infra | 21:36 | |
| jeblair | yeah, it's stupid nice outside. | 21:37 |
| *** zz_ja has joined #openstack-infra | 21:37 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: Add script for creating stable releases of libraries https://review.openstack.org/163880 | 21:39 |
| *** jgrimm_ has quit IRC | 21:39 | |
| JayF | question about depends-on: ... not sure if this is a feature or a bug. https://review.openstack.org/#/c/161066/ depends on https://review.openstack.org/#/c/161453/ ; 161453 is in merge conflict, but 161066 is not. 161066 shows patch in metge conflict because the one it depends on is in merge conflict. Just really confusing (we re-uploaded the "OK" change 3 times before realizing it was a depends-on) | 21:40 |
| *** bknudson has joined #openstack-infra | 21:41 | |
| *** otter768 has quit IRC | 21:41 | |
| *** tiswanso has quit IRC | 21:41 | |
| *** andreykurilin_ has quit IRC | 21:41 | |
| *** andreykurilin_ has joined #openstack-infra | 21:42 | |
| jeblair | JayF: lemme look into that | 21:42 |
| JayF | JoshNang is fixing 161453, so if you want the state preserved might wanna have him stop :) | 21:42 |
| JoshNang | JayF: i'm fixing another patch right now, so no worries :P | 21:42 |
| *** nelsnelson has quit IRC | 21:43 | |
| JayF | JoshNang, a man of many patches | 21:43 |
| JoshNang | JayF: ugh :( | 21:43 |
| jeblair | nah, carry on. i'm reading logs. | 21:43 |
| *** tqtran is now known as tqtran_afk | 21:44 | |
| *** marun has joined #openstack-infra | 21:44 | |
| *** sambetts has quit IRC | 21:45 | |
| *** dboik has quit IRC | 21:46 | |
| *** dprince has quit IRC | 21:46 | |
| *** prad has quit IRC | 21:46 | |
| anteaya | pleia2: okay | 21:47 |
| anteaya | clarkb: nice | 21:47 |
| *** sambetts has joined #openstack-infra | 21:47 | |
| *** peristeri has quit IRC | 21:48 | |
| *** sdake has joined #openstack-infra | 21:48 | |
| *** dangers is now known as dangers_away | 21:51 | |
| jeblair | JayF: yeah, let's call that a design oversight. would you mind filing a bug in storyboard? | 21:52 |
| notmyname | clarkb: dhellmann: sdague: can you take a look at this global reqs update? https://review.openstack.org/#/c/164112/ | 21:52 |
| JayF | jeblair: sure, I can swing that. Assuming I can find storyboard and grok how to use it :P | 21:52 |
| jeblair | JayF: https://storyboard.openstack.org/#!/project/679 | 21:53 |
| dhellmann | notmyname: +2 | 21:53 |
| JayF | perfect, was about to ask what project | 21:53 |
| tsg_ | dhellman: thanks! | 21:53 |
| notmyname | dhellmann: thanks | 21:53 |
| tsg_ | notmyname: needless to say, but thanks as always :) | 21:53 |
| pleia2 | anteaya: unrelated, can you help me understand Liu's question on the infra mailing list? | 21:54 |
| pleia2 | anteaya: I'm not hugely familiar with the 3rd party stuff in gerrit | 21:55 |
| *** asselin_ has joined #openstack-infra | 21:55 | |
| JayF | jeblair: https://storyboard.openstack.org/#!/story/2000203 | 21:55 |
| anteaya | pleia2: okay thanks for asking | 21:57 |
| anteaya | pleia2: so to start head over here: https://wiki.openstack.org/wiki/ThirdPartySystems/Huawei_volume_CI | 21:57 |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Load in nanliu/git module https://review.openstack.org/164355 | 21:58 |
| *** mpopow has joined #openstack-infra | 21:58 | |
| anteaya | which it appears has the email address as the maintainer of the person writing the email | 21:58 |
| pleia2 | anteaya: yeah, so I see he has his own address there, and in Gerrit itself Huawei volume CI does not have an address assigned | 21:58 |
| anteaya | so (s)he is asking how to add it to the gerrit account | 21:58 |
| pleia2 | he's also searching for owner: when I think he should be searching for reviewer: (CIs should not have patches) | 21:58 |
| anteaya | right | 21:59 |
| pleia2 | got it, so does he have the power to add an email address? | 21:59 |
| openstackgerrit | Merged openstack-infra/project-config: Enable swift logs for python jobs https://review.openstack.org/156521 | 21:59 |
| *** asselin_ has quit IRC | 22:00 | |
| anteaya | https://review.openstack.org/#/q/reviewer:%22Huawei+Volume+CI+%2813628%29%22,n,z | 22:00 |
| *** ddieterly has joined #openstack-infra | 22:00 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: WIP Check image-list output in cmd tests https://review.openstack.org/164356 | 22:00 |
| pleia2 | anteaya: yeah, that worked for me too | 22:00 |
| anteaya | if he created the account using our self service instructions, yes he does | 22:00 |
| *** rwsu has quit IRC | 22:00 | |
| anteaya | pleia2: if he didn't then no he doesn't | 22:00 |
| anteaya | at the very bottom of https://wiki.openstack.org/wiki/ThirdPartySystems | 22:00 |
| anteaya | there is a link | 22:00 |
| pleia2 | ah, got it | 22:01 |
| anteaya | read how here: https://wiki.openstack.org/wiki/OldtoNewGerritCIAccount | 22:01 |
| *** carl_baldwin has quit IRC | 22:01 | |
| *** SumitNaiksatam has joined #openstack-infra | 22:01 | |
| anteaya | so bascially the response is that if he didn't follow our self-service instructions when he set up the account | 22:01 |
| *** hodos|2 has quit IRC | 22:01 | |
| anteaya | he needs to do so now, following those instructions | 22:01 |
| *** carl_baldwin has joined #openstack-infra | 22:02 | |
| pleia2 | understood, thank you :) I'll reply now | 22:02 |
| anteaya | now we do aske people to tell us what the old accounts are so we can deactivate them, but noone ever does | 22:02 |
| anteaya | pleia2: welcome thanks for asking | 22:02 |
| *** Longgeek has joined #openstack-infra | 22:03 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Erb linting shell script prototype https://review.openstack.org/164357 | 22:03 |
| *** nilasae has joined #openstack-infra | 22:03 | |
| *** harlowja has quit IRC | 22:04 | |
| *** tiswanso has joined #openstack-infra | 22:04 | |
| *** gokrokve has quit IRC | 22:05 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-storyboard: Parameterized working directories. https://review.openstack.org/157587 | 22:05 |
| anteaya | clarkb: 156521 merged, so I guess we wait for the next round of image builds before we see that change, yeah? | 22:05 |
| *** gokrokve has joined #openstack-infra | 22:05 | |
| *** harlowja has joined #openstack-infra | 22:06 | |
| *** gokrokve has quit IRC | 22:06 | |
| *** harlowja has quit IRC | 22:06 | |
| *** gokrokve has joined #openstack-infra | 22:06 | |
| *** harlowja has joined #openstack-infra | 22:06 | |
| openstackgerrit | Swaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu https://review.openstack.org/158525 | 22:07 |
| mtreinish | pleia2: oh, I just remembered I can pester your about approving my puppet patches now too :) | 22:08 |
| mtreinish | https://review.openstack.org/164333 | 22:08 |
| pleia2 | oh goodie | 22:10 |
| pleia2 | :) | 22:10 |
| *** nelsnelson has joined #openstack-infra | 22:13 | |
| *** cdent has quit IRC | 22:13 | |
| mtreinish | pleia2: heh, the floodgates have opened now you're no longer safe :) | 22:14 |
| pleia2 | inorite | 22:15 |
| *** dkliban is now known as dkliban_afk | 22:15 | |
| SpamapS | morganfainberg: I know you were interested in oslo.messaging w/ gearman as a backend. | 22:15 |
| morganfainberg | yess. | 22:15 |
| SpamapS | morganfainberg: https://github.com/SpamapS/gearhorn <-- the README.rst shows my new thinking on fanout | 22:15 |
| *** melwitt has quit IRC | 22:15 | |
| SpamapS | morganfainberg: and now I need a store-and-forward worker to handle durability. | 22:16 |
| morganfainberg | hehe | 22:16 |
| morganfainberg | right | 22:16 |
| SpamapS | morganfainberg: and a spec for oslo to have things start explicitly stating whether they want durability. :) | 22:16 |
| *** melwitt has joined #openstack-infra | 22:16 | |
| SpamapS | because rabbit users can benefit there too. | 22:16 |
| morganfainberg | agreed | 22:16 |
| SpamapS | I think the store-and-forward worker might be called 'gearhouse' | 22:16 |
| openstackgerrit | Swaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu https://review.openstack.org/158525 | 22:17 |
| SpamapS | hrm | 22:17 |
| SpamapS | gearhouse might have trademark issues | 22:17 |
| *** ihrachyshka has quit IRC | 22:19 | |
| *** melwitt has quit IRC | 22:19 | |
| *** melwitt has joined #openstack-infra | 22:19 | |
| mtreinish | pleia2: of course once that lands I'm going to push the release and then I expect everything to explode :) | 22:21 |
| *** sarob has joined #openstack-infra | 22:21 | |
| openstackgerrit | Swaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu https://review.openstack.org/158525 | 22:21 |
| tim_o | So in my ssh to Gerrit i use: ssh -p 29418 Brocade-Openstack-CI@review.openstack.org gerrit review -m '"Test complete on Brocade-Openstack-CI <http://144.49.208.28:8000/build_logs/${BUILD_TIMESTAMP}/>"' ... | 22:22 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for neutron db deadlock bug 1432065 https://review.openstack.org/164358 | 22:22 |
| openstack | bug 1432065 in neutron "DBDeadlock: (OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') 'DELETE FROM ipallocationpools WHERE ipallocationpools.id" [Critical,Confirmed] https://launchpad.net/bugs/1432065 | 22:22 |
| pleia2 | mtreinish: tempting fate, not only is this a friday afternoon, it's friday the 13th | 22:22 |
| tim_o | is this OK? | 22:22 |
| *** ashleighfarnham has quit IRC | 22:22 | |
| *** amitgandhinz has quit IRC | 22:23 | |
| mtreinish | pleia2: heh, it was just too good to pass up | 22:23 |
| pleia2 | haha | 22:23 |
| *** stevemar has quit IRC | 22:24 | |
| *** ashleighfarnham has joined #openstack-infra | 22:25 | |
| *** Longgeek has quit IRC | 22:25 | |
| *** tonytan4ever has quit IRC | 22:25 | |
| openstackgerrit | Merged openstack-infra/puppet-subunit2sql: Set timeouts for db upgrade operations https://review.openstack.org/164333 | 22:25 |
| *** mtanino has quit IRC | 22:27 | |
| *** dvorak is now known as clayton | 22:28 | |
| *** melwitt has quit IRC | 22:28 | |
| *** clayton is now known as dvorak | 22:28 | |
| openstackgerrit | Swaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu https://review.openstack.org/158525 | 22:30 |
| *** dimtruck is now known as zz_dimtruck | 22:30 | |
| *** nilasae has quit IRC | 22:31 | |
| *** rwsu has joined #openstack-infra | 22:33 | |
| openstackgerrit | Swaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu https://review.openstack.org/158525 | 22:34 |
| openstackgerrit | Swaminathan Vasudevan proposed openstack-infra/devstack-gate: Configure sub-nodes for Neutron DVR aiopcpu https://review.openstack.org/158525 | 22:35 |
| *** sdake__ has joined #openstack-infra | 22:38 | |
| *** tiswanso has quit IRC | 22:39 | |
| *** tiswanso has joined #openstack-infra | 22:39 | |
| *** _2_Ajanay has joined #openstack-infra | 22:39 | |
| *** ghostpl_ has joined #openstack-infra | 22:41 | |
| mtreinish | pleia2: to be fair part of the reason for doing a friday release is less traffic to the db because the gate is lighter | 22:41 |
| * mtreinish hopes no one realizes he just thought of that | 22:41 | |
| *** penguinRaider has quit IRC | 22:41 | |
| *** sdake has quit IRC | 22:41 | |
| pleia2 | mtreinish: your secret is safe with me | 22:42 |
| *** tqtran_afk is now known as tqtran | 22:42 | |
| *** jedimike has joined #openstack-infra | 22:42 | |
| *** _2_Ajanay has quit IRC | 22:42 | |
| *** thedodd has quit IRC | 22:43 | |
| *** esker has joined #openstack-infra | 22:46 | |
| mtreinish | released pushed now comes the waiting game... | 22:47 |
| *** dpyzhov_ has joined #openstack-infra | 22:47 | |
| *** spzala has joined #openstack-infra | 22:47 | |
| anteaya | followed by the crying game | 22:48 |
| *** ghostpl_ has quit IRC | 22:49 | |
| *** sarob has quit IRC | 22:50 | |
| mtreinish | anteaya: heh, more like followed by me smashing something in rage and running away for a week | 22:50 |
| *** jedimike has quit IRC | 22:50 | |
| *** mpopow has quit IRC | 22:52 | |
| mtreinish | https://pypi.python.org/pypi/subunit2sql/0.4.0 now time to spam f5 on puppetboard | 22:52 |
| *** mpopow has joined #openstack-infra | 22:53 | |
| anteaya | mtreinish: well there's that too | 22:54 |
| anteaya | a buddy of mine once took a splitting ax to a plastic cooler in the garage when his four wheeler quit in the bush and he had to walk back home | 22:54 |
| *** saper has joined #openstack-infra | 22:54 | |
| anteaya | he felt much better afterwards and then could go in the house and talk to his wife | 22:55 |
| anteaya | I'm guessing the walk back home part was in teh neighbourhood of about 15 k or so to upset him that much | 22:56 |
| openstackgerrit | Jaime Flynn proposed openstack-infra/jenkins-job-builder: updated conditional_publisher to support plugin changes https://review.openstack.org/155514 | 22:56 |
| *** markvoelker has quit IRC | 22:56 | |
| *** mpopow has quit IRC | 22:57 | |
| openstackgerrit | Jay Faulkner proposed openstack-infra/project-config: Add coreos-image-builder project https://review.openstack.org/155868 | 22:58 |
| mtreinish | anteaya: yeah that would probably make anyone upset | 22:59 |
| mtreinish | it's probably for the best that I leave my axe at my parents house, where there are actually trees on the property (as opposed to in my apt.) | 23:00 |
| jeblair | mtreinish: we're actually running at capacity now. it's just capacity is unusually low because of, well, clouds. | 23:00 |
| *** spzala_ has joined #openstack-infra | 23:02 | |
| *** hashar has quit IRC | 23:02 | |
| mtreinish | jeblair: well I was thinking more about having less incoming inserts from the subunit worker. Things will probably be blocked for a bit by doing the alter table to add 2 columns to the big table with ~65M rows | 23:03 |
| mtreinish | having less total capacity probably helps with that too | 23:03 |
| anteaya | mtreinish: good call on the axe decision | 23:04 |
| *** spzala has quit IRC | 23:04 | |
| *** spzala_ is now known as spzala | 23:04 | |
| *** nelsnelson has quit IRC | 23:05 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for neutron db deadlock bug 1432065 https://review.openstack.org/164358 | 23:05 |
| openstack | bug 1432065 in neutron "DBDeadlock: (OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') 'DELETE FROM ipallocationpools WHERE ipallocationpools.id" [Critical,Confirmed] https://launchpad.net/bugs/1432065 | 23:05 |
| *** hdd_ has quit IRC | 23:06 | |
| *** mpopow has joined #openstack-infra | 23:06 | |
| *** tiswanso has quit IRC | 23:11 | |
| *** tiswanso has joined #openstack-infra | 23:11 | |
| *** bswartz has joined #openstack-infra | 23:12 | |
| mtreinish | is there anyway to actually tell if it's doing a thing? I just realized puppetboard probably won't help if its in the middle of doing the backup or db upgrade | 23:13 |
| *** spzala has quit IRC | 23:13 | |
| *** aysyd has quit IRC | 23:13 | |
| openstackgerrit | James E. Blair proposed openstack-infra/infra-specs: Add Zuul v3 Nodepool spec https://review.openstack.org/164371 | 23:15 |
| *** sdake__ has quit IRC | 23:15 | |
| *** tiswanso has quit IRC | 23:15 | |
| *** ddieterly has quit IRC | 23:16 | |
| jeblair | mtreinish: i don't think you'd see anything there until it's complete | 23:16 |
| jeblair | mtreinish: if you suspect something is awry, we can poke around | 23:16 |
| mtreinish | yeah, that's what I just figured out. | 23:16 |
| mtreinish | no I don't think anythings going wrong, it's just the update will probably be pretty slow | 23:17 |
| mtreinish | I'm just itching to watch my paint dry :) | 23:18 |
| anteaya | don't touch it when it's wet | 23:18 |
| *** tkelsey has joined #openstack-infra | 23:19 | |
| *** tsg_ has quit IRC | 23:19 | |
| mtreinish | fwiw, the logstash.o.o cacti graph shows a spike in cpu use which I would expect is probably the gzip from the mysqldump | 23:20 |
| *** tkelsey has quit IRC | 23:23 | |
| *** SumitNaiksatam has quit IRC | 23:24 | |
| anteaya | there's a good sign | 23:25 |
| *** timcline has joined #openstack-infra | 23:26 | |
| SpamapS | oohh | 23:27 |
| SpamapS | I just remembered Garivini | 23:27 |
| SpamapS | https://github.com/dormando/Garivini | 23:27 |
| SpamapS | in perl. :( | 23:27 |
| *** timcline has quit IRC | 23:28 | |
| *** timcline has joined #openstack-infra | 23:28 | |
| *** david-lyle is now known as david-lyle_afk | 23:29 | |
| flashgordon | clarkb: so your caching wheel idea | 23:29 |
| flashgordon | clarkb: that should speed up all pep8 doc and unit tests in a massive way | 23:30 |
| flashgordon | clarkb: most of the time in nova's pep8 job i spent installing | 23:30 |
| *** timcline has quit IRC | 23:31 | |
| flashgordon | greghaynes: ping | 23:31 |
| *** patrickeast has quit IRC | 23:32 | |
| *** zz_dimtruck is now known as dimtruck | 23:32 | |
| greghaynes | flashgordon: ohai | 23:34 |
| greghaynes | flashgordon: clarkb and I are currently grilling | 23:34 |
| greghaynes | so somewhat afk | 23:34 |
| flashgordon | greghaynes: mmmm grilling | 23:34 |
| flashgordon | greghaynes: was just going to say sounds like you have some ideas for how we can set up some linux wheel mirroring | 23:35 |
| flashgordon | greghaynes: I think it would save a ton of time of a ton of jobs | 23:35 |
| *** rwsu has quit IRC | 23:35 | |
| flashgordon | all pep8,unit,doc jobs | 23:35 |
| flashgordon | greghaynes: but it can wait till monday | 23:35 |
| mtreinish | ooh, cpu spike just dropped, maybe that means the backup is done | 23:36 |
| greghaynes | yea, I think its fairly straightforward - just resurrect pypi-mirror how clarkb was saying, via timer trigger + job and then rsync to mirror and use pip extra-index-url | 23:36 |
| greghaynes | but yes, monday :) | 23:36 |
| *** ajmiller_ has quit IRC | 23:37 | |
| *** otter768 has joined #openstack-infra | 23:37 | |
| flashgordon | greghaynes: excellent, you just volunteered right ? | 23:37 |
| *** rwsu has joined #openstack-infra | 23:38 | |
| greghaynes | haha | 23:39 |
| *** esker has quit IRC | 23:40 | |
| greghaynes | I am looking at things to poke at so yea ill help, im also pretty new so I dont think I can just own it | 23:40 |
| greghaynes | but yea, ill poke at it with a stick | 23:40 |
| *** ChuckC has joined #openstack-infra | 23:41 | |
| *** bdpayne has quit IRC | 23:41 | |
| *** bdpayne has joined #openstack-infra | 23:41 | |
| greghaynes | (pretty new to the infra stuff, that is) | 23:42 |
| *** otter768 has quit IRC | 23:42 | |
| flashgordon | greghaynes: well I don't know this corner of things at all | 23:42 |
| *** dimtruck is now known as zz_dimtruck | 23:42 | |
| mtreinish | pleia2, jeblair: are there errors in the subunit2sql worker logs, I expect things to be failing because the package just upgraded, but as far as I can tell the db migration hasn't finished (not even able to tell if it's running) | 23:42 |
| greghaynes | I just know how to buy clarkb beers in exchange for info on how zuul works | 23:42 |
| *** sarob has joined #openstack-infra | 23:45 | |
| pleia2 | mtreinish: well that's something new for me, I'll see what I can do | 23:46 |
| mtreinish | pleia2: oh, you know what I bet we'd have to restart the subunit2sql gearman worker daemon for it to use the new version it installed | 23:48 |
| mtreinish | so there might not be any errors in the logs | 23:48 |
| jeblair | mtreinish, pleia2: we can subscribe the worker to whatever installs it in puppet so that it automatically gets restarted on upgrade | 23:48 |
| jeblair | that's probably a good thing to do for this | 23:49 |
| *** melwitt has joined #openstack-infra | 23:49 | |
| mtreinish | jeblair: oh, thats a good idea | 23:49 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/puppet-subunit2sql: Subscribe worker service to subunit2sql package https://review.openstack.org/164374 | 23:51 |
| mtreinish | jeblair: ^^^ like that? | 23:51 |
| *** dimsum__ has quit IRC | 23:52 | |
| openstackgerrit | James E. Blair proposed stackforge/gertty: Handle change id in simple searches https://review.openstack.org/164375 | 23:54 |
| *** dims_ has joined #openstack-infra | 23:55 | |
| *** markvoelker has joined #openstack-infra | 23:57 | |
| *** dims_ has quit IRC | 23:57 | |
| *** dims_ has joined #openstack-infra | 23:57 | |
| jeblair | mtreinish: almost; i don't think the refreshonly is needed (or used) | 23:58 |
| jeblair | but otherwise yes | 23:59 |
| mtreinish | jeblair: when I didn't have the refreshonly on the server.pp to run the db migration it ran the migration command ever puppet cycle | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!