| clarkb | but to avoid breaking devstack by not installing those packages in devstack we force it to do th eowrk itself | 00:00 |
|---|---|---|
| *** heyongli has joined #openstack-infra | 00:00 | |
| *** lawrancejing has quit IRC | 00:00 | |
| tonyb | clarkb: Thanks. I expect that hard part will be working out what the righ package names for suse are :) | 00:02 |
| *** aysyd has joined #openstack-infra | 00:02 | |
| openstackgerrit | Merged openstack-infra/puppet-grafyaml: Make config_dir a required variable https://review.openstack.org/237104 | 00:02 |
| openstackgerrit | Merged openstack-infra/project-config: Add check-requirements job for python-scciclient https://review.openstack.org/234211 | 00:03 |
| pabelanger | any dogpile.cache experts around? First time I seen this exception: http://logs.openstack.org/34/237134/5/check/gate-grafyaml-python34/0dc42d7/console.html#_2015-10-19_23_34_26_593 | 00:03 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: puppet: retire beaker-upgrade jobs https://review.openstack.org/235572 | 00:03 |
| *** ybathia has quit IRC | 00:04 | |
| *** jaypipes has quit IRC | 00:04 | |
| *** achanda has quit IRC | 00:05 | |
| *** dims_ has left #openstack-infra | 00:05 | |
| *** vilobhmm11 has joined #openstack-infra | 00:05 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: puppet: retire beaker-upgrade jobs https://review.openstack.org/235572 | 00:05 |
| *** ybathia has joined #openstack-infra | 00:05 | |
| *** ybathia has quit IRC | 00:06 | |
| pabelanger | fungi: I think this is the last piece for puppet-grafyaml today: https://review.openstack.org/#/c/237179/ | 00:08 |
| vilobhmm11 | have some question about devstack…is it the right channel to ask for one | 00:08 |
| vilobhmm11 | fungi : ^^ | 00:08 |
| nibalizer | vilobhmm11: best to just ask your question | 00:09 |
| *** heyongli has quit IRC | 00:09 | |
| pabelanger | fungi: once that lands, the update command in puppet will also invoke when the vcsrepo for grafyaml changes | 00:09 |
| nibalizer | if someone knows the answer they'll help you out, or redirect you | 00:09 |
| *** heyongli has joined #openstack-infra | 00:10 | |
| vilobhmm11 | nibalizer : have 1 16GB virtual box created to setup devstack…trying to boot a small flavor vm (4G RAM) it fails with no valid host found…no valid host error is mostly found when nova-compute is down or doesn't have enough resource i my case none is true | 00:11 |
| openstackgerrit | Merged openstack/diskimage-builder: Add flake8 to requirements https://review.openstack.org/229780 | 00:11 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image delete using gearman https://review.openstack.org/198114 | 00:12 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Move nodepool config loading into module https://review.openstack.org/231592 | 00:12 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Make secure.conf optional and backwards-compat https://review.openstack.org/232800 | 00:12 |
| *** DericHorn-HP has quit IRC | 00:12 | |
| *** amotoki has joined #openstack-infra | 00:14 | |
| vilobhmm11 | nibalizer : ^^ | 00:14 |
| greghaynes | ianw: you dib changed merged, so releasing now | 00:14 |
| *** asettle is now known as asettle-afk | 00:15 | |
| *** angdraug has quit IRC | 00:15 | |
| pabelanger | \o/ | 00:16 |
| jeblair | rm_work: sorry i missed the convo with clarkb and mordred earlier; would be happy to join you all in chatting about this at the summit :) | 00:16 |
| jroll | clarkb: rm_work: mordred: just kicked off a thread internally, let's see where this goes | 00:16 |
| jroll | jeblair: ^ ditto for you apparently :) | 00:17 |
| *** salv-orlando has quit IRC | 00:17 | |
| jeblair | jroll: thanks! :) | 00:18 |
| *** amotoki has quit IRC | 00:18 | |
| *** rockyg has quit IRC | 00:19 | |
| *** heyongli has quit IRC | 00:19 | |
| clarkb | vilobhmm11: check the nova compute logs it should tell you what resources it thnks it has | 00:19 |
| *** heyongli has joined #openstack-infra | 00:20 | |
| *** amit213 has quit IRC | 00:20 | |
| *** amit213 has joined #openstack-infra | 00:21 | |
| vilobhmm11 | clarkb : it has enough resources i can boot a tiny vm but having problem booting small flavor | 00:23 |
| *** otter768 has quit IRC | 00:24 | |
| *** laughterwym has joined #openstack-infra | 00:24 | |
| *** otter768 has joined #openstack-infra | 00:24 | |
| clarkb | vilobhmm11: right, I think the nova compute log should tell you exactly how many resources it thinks it has | 00:25 |
| openstackgerrit | Tony Breeds proposed openstack/requirements: Remove upper cap on Pillow https://review.openstack.org/236850 | 00:25 |
| clarkb | vilobhmm11: if virtualbox isn't claiming all of the memory upfront n-cpu may think it has far less memory than it does in reality for example | 00:25 |
| vilobhmm11 | clarkb : I think thats happening is there a way to not let virtualbox claim all of memory upfront | 00:26 |
| *** heyongli has quit IRC | 00:29 | |
| *** heyongli has joined #openstack-infra | 00:30 | |
| openstackgerrit | Merged openstack-infra/project-config: puppet: retire beaker-upgrade jobs https://review.openstack.org/235572 | 00:30 |
| clarkb | jenkins07 is finally gtting the shutdown script run again | 00:31 |
| *** lawrancejing has joined #openstack-infra | 00:32 | |
| openstackgerrit | Alexey Shtokolov proposed openstack-infra/project-config: Enabled python27 and pep8 gates and fixed checks for Fuel repos https://review.openstack.org/236068 | 00:36 |
| *** gyee has quit IRC | 00:36 | |
| *** glauco___ has quit IRC | 00:36 | |
| patrickeast | hey, so i'm in the process of updating my nodepool configs to use the most recent stuff and am having a problem with the authentication now like so http://paste.openstack.org/show/476784/ | 00:37 |
| *** armax has quit IRC | 00:37 | |
| patrickeast | any ideas what i might be missing? the error isn't super specific :( | 00:37 |
| *** dims_ has joined #openstack-infra | 00:38 | |
| patrickeast | my old nodepool.yaml -> cloud.yaml looks like this http://paste.openstack.org/show/476785/ username and password are the same, urls match up, i think i got the format right... | 00:38 |
| *** rguillebert has quit IRC | 00:38 | |
| *** heyongli has quit IRC | 00:40 | |
| asselin | patrickeast, I think it's an issue with shade that mordred fixed...not sure it was released yet | 00:40 |
| patrickeast | asselin: oh sweet | 00:40 |
| *** Sukhdev has quit IRC | 00:40 | |
| *** heyongli has joined #openstack-infra | 00:40 | |
| *** vilobhmm11 has quit IRC | 00:40 | |
| *** armax has joined #openstack-infra | 00:41 | |
| asselin | well..maybe it's a different issue: http://lists.openstack.org/pipermail/openstack-dev/2015-September/075368.html | 00:41 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Remove devstack install job for networking-ovn. https://review.openstack.org/237112 | 00:42 |
| patrickeast | bummer | 00:42 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Add zaqar integration builder https://review.openstack.org/236958 | 00:42 |
| patrickeast | yea it looks like the latest shade was released very recently anyway | 00:42 |
| patrickeast | which i've got (shade==0.16.0) | 00:42 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Refactoring GlusterFS jobs https://review.openstack.org/236727 | 00:42 |
| openstackgerrit | Merged openstack/requirements: Updated oslo.db to 3.0.0 https://review.openstack.org/234015 | 00:44 |
| asselin | patrickeast, from my tests, using clouds.yaml is still optional. You need to use secure.conf howerver. | 00:45 |
| *** asettle-afk has quit IRC | 00:45 | |
| *** pc_m has joined #openstack-infra | 00:45 | |
| patrickeast | asselin: hehe yea i got burned trying to take a shortcut and not use the secure.conf stuff | 00:45 |
| *** annegentle has joined #openstack-infra | 00:45 | |
| patrickeast | asselin: ok so i guess for now i'll go back to not using the cloud.yaml | 00:46 |
| patrickeast | and see how that works | 00:46 |
| asselin | yeah...if it still fails, seems to be an issue with keystone client update or something related | 00:46 |
| *** annegentle has quit IRC | 00:47 | |
| *** pvaneck has quit IRC | 00:48 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/diskimage-builder: Updated from global requirements https://review.openstack.org/237351 | 00:49 |
| openstackgerrit | Adam Spiers proposed openstack-infra/project-config: Add openstack-resource-agents project https://review.openstack.org/236227 | 00:50 |
| *** heyongli has quit IRC | 00:50 | |
| *** heyongli has joined #openstack-infra | 00:51 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 00:52 | |
| *** Swami has quit IRC | 00:52 | |
| *** jjohnson2 has joined #openstack-infra | 00:53 | |
| *** ddieterl_ has quit IRC | 00:53 | |
| *** ashleighfarnham has quit IRC | 00:57 | |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: (Re)add midonet tempest jobs https://review.openstack.org/230932 | 00:59 |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: Add experimental Neutron Fwaas api tests https://review.openstack.org/236762 | 00:59 |
| *** signed8bit has quit IRC | 01:00 | |
| *** heyongli has quit IRC | 01:00 | |
| mordred | patrickeast: your clouds.yaml looks fine - I expect that to work | 01:01 |
| *** heyongli has joined #openstack-infra | 01:01 | |
| *** xyang1 has joined #openstack-infra | 01:01 | |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: Add experimental Neutron Fwaas api tests https://review.openstack.org/236762 | 01:01 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Fix oslo.messaging+amqp1+dsvm to run from master https://review.openstack.org/236168 | 01:01 |
| patrickeast | mordred: ok cool, thats good to know | 01:02 |
| mordred | patrickeast: try this: | 01:03 |
| mordred | from shade import * | 01:03 |
| mordred | simple_logging(debug=True) | 01:03 |
| *** aeng has quit IRC | 01:03 | |
| mordred | cloud = openstack_cloud(cloud='cinder-init2') | 01:04 |
| mordred | print cloud.list_flavors() | 01:04 |
| mordred | patrickeast: just from python | 01:04 |
| mordred | in that account, so that it can see the clouds.yaml | 01:04 |
| mordred | that'll test whether there is a problem with shade and libraries and stuff talking to your cloud | 01:04 |
| * patrickeast testing it | 01:04 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Disable tacker dsvm functional test on kilo branch https://review.openstack.org/235586 | 01:07 |
| openstackgerrit | Martin André proposed openstack/diskimage-builder: Fix uniqueness check of initrd in fedora-minimal https://review.openstack.org/235705 | 01:07 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Update gerrit javamelody plugin builds https://review.openstack.org/236035 | 01:08 |
| patrickeast | mordred: ok so that seems to work fine http://paste.openstack.org/show/476793/ | 01:08 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Make openstack-health npm lint job voting https://review.openstack.org/236138 | 01:09 |
| mordred | patrickeast: yes! that's fantastic. That means it contacted keystone, got a token, found the compute url and then contacted nova | 01:10 |
| openstackgerrit | Alex Schultz proposed openstack-infra/project-config: Add puppet gating jobs to fuel-library https://review.openstack.org/235550 | 01:10 |
| mordred | patrickeast: which is GREAT | 01:10 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Add a ceilometer-functional job for mysql https://review.openstack.org/235784 | 01:10 |
| mordred | patrickeast: in that it means that today's shade release did not lose the ability to talk to your cloud | 01:10 |
| *** heyongli has quit IRC | 01:10 | |
| mordred | patrickeast: otoh - why is nodepool not working :) | 01:10 |
| *** FallenPegasus has joined #openstack-infra | 01:10 | |
| *** asettle has joined #openstack-infra | 01:11 | |
| mordred | patrickeast: you have 'cinder-init2' listed as cloud: now in your clouds.yaml yah? | 01:11 |
| patrickeast | mordred: yep | 01:11 |
| *** heyongli has joined #openstack-infra | 01:11 | |
| mordred | hrm | 01:11 |
| patrickeast | and over in nodepool a provider with "- name: cinder-init2" | 01:12 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Don't run dsvm tests on rst/unit test changes https://review.openstack.org/234550 | 01:12 |
| *** yamamoto has quit IRC | 01:12 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Add ambari images for sahara-image-elements https://review.openstack.org/231983 | 01:13 |
| mordred | patrickeast: yah. you've got "providers: - name: cinder-init2\n cloud: cinder-init2" | 01:14 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Experimental fedora-22 node for puppet-apply tests https://review.openstack.org/231679 | 01:14 |
| openstackgerrit | Paul Belanger proposed openstack-infra/grafyaml: Tag dashboards with grafyaml label https://review.openstack.org/237134 | 01:16 |
| *** zhenguo has joined #openstack-infra | 01:16 | |
| patrickeast | derp | 01:18 |
| *** DericHorn-HP has joined #openstack-infra | 01:18 | |
| patrickeast | mordred: ok yea so with name *and* cloud set in nodepool.yaml it works better.. | 01:18 |
| patrickeast | i was missing the 'cloud' param | 01:19 |
| *** heyongli has quit IRC | 01:21 | |
| patrickeast | mordred: sure enough everything is great now, nodes are happily building | 01:22 |
| *** heyongli has joined #openstack-infra | 01:22 | |
| patrickeast | mordred: thanks for the help! | 01:22 |
| openstackgerrit | Merged openstack-infra/project-config: Disable tacker dsvm functional test on kilo branch https://review.openstack.org/235586 | 01:22 |
| mordred | patrickeast: woot! | 01:29 |
| *** bpokorny_ has joined #openstack-infra | 01:29 | |
| mordred | patrickeast: yah - name is the name of the provider for nodepool. cloud is the refernce to the clouds.yaml name | 01:29 |
| openstackgerrit | Dave McCowan proposed openstack-infra/project-config: Add Project Marshal https://review.openstack.org/234530 | 01:29 |
| patrickeast | mordred: haha yea, it makes a lot of sense... i guess i figured nodepool made the assumption that the names were the same | 01:30 |
| *** heyongli has quit IRC | 01:31 | |
| *** heyongli has joined #openstack-infra | 01:32 | |
| *** ddieterly has joined #openstack-infra | 01:32 | |
| *** bpokorny has quit IRC | 01:32 | |
| *** DericHorn-HP has quit IRC | 01:33 | |
| *** bpokorny_ has quit IRC | 01:33 | |
| openstackgerrit | Patrick East proposed openstack-infra/project-config-example: Add some documentation for using os-client-config with nodepool.yaml https://review.openstack.org/237365 | 01:34 |
| patrickeast | mordred: asselin: ^ hopefully that will help avoid more folks doing what i did | 01:35 |
| openstackgerrit | Merged openstack-infra/project-config: Don't run dsvm tests on rst/unit test changes https://review.openstack.org/234550 | 01:35 |
| openstackgerrit | Sachi King proposed openstack-infra/project-config: Add non-voting constraints jobs to nova https://review.openstack.org/219582 | 01:36 |
| *** markvoelker has joined #openstack-infra | 01:40 | |
| openstackgerrit | Merged openstack/diskimage-builder: Fix devuser pubkey defaults https://review.openstack.org/234490 | 01:41 |
| *** sridhar_ram has quit IRC | 01:41 | |
| *** dims_ has quit IRC | 01:41 | |
| *** heyongli has quit IRC | 01:41 | |
| *** sridhar_ram1 has joined #openstack-infra | 01:41 | |
| *** aysyd has quit IRC | 01:42 | |
| *** heyongli has joined #openstack-infra | 01:42 | |
| *** DericHorn-HP has joined #openstack-infra | 01:46 | |
| *** Daisy has joined #openstack-infra | 01:46 | |
| *** sridhar_ram1 has quit IRC | 01:46 | |
| openstackgerrit | Patrick East proposed openstack-infra/project-config-example: Add some documentation for using os-client-config with nodepool.yaml https://review.openstack.org/237365 | 01:46 |
| *** tqtran has quit IRC | 01:46 | |
| *** Daisy has quit IRC | 01:46 | |
| mordred | patrickeast: awesome - thanks!!! | 01:47 |
| *** rfolco_ has joined #openstack-infra | 01:47 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config: Add job for the ovs mechanism driver with native mode https://review.openstack.org/221143 | 01:47 |
| *** aeng has joined #openstack-infra | 01:47 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/grafyaml: Tag dashboards with grafyaml label https://review.openstack.org/237134 | 01:47 |
| *** burgerk has joined #openstack-infra | 01:49 | |
| *** yamamoto has joined #openstack-infra | 01:50 | |
| *** yamahata has quit IRC | 01:51 | |
| *** heyongli has quit IRC | 01:51 | |
| *** tiswanso has joined #openstack-infra | 01:51 | |
| *** heyongli has joined #openstack-infra | 01:52 | |
| *** pc_m has quit IRC | 01:53 | |
| *** ivar-laz_ has joined #openstack-infra | 01:54 | |
| *** ivar-lazzaro has quit IRC | 01:58 | |
| *** ivar-laz_ has quit IRC | 01:58 | |
| *** laughterwym_ has joined #openstack-infra | 01:59 | |
| *** heyongli has quit IRC | 02:02 | |
| *** unicell has quit IRC | 02:02 | |
| *** laughterwym has quit IRC | 02:02 | |
| *** heyongli has joined #openstack-infra | 02:03 | |
| *** BharatK has joined #openstack-infra | 02:06 | |
| *** cody-somerville has quit IRC | 02:08 | |
| clarkb | the jenkins restarting completed | 02:09 |
| jeblair | mordred, clarkb, fungi, sdague: ovh improved their custom filters and nodepool is capable of launching instances at normal rate now. | 02:09 |
| openstackgerrit | Paul Belanger proposed openstack-infra/grafyaml: Disable cache for cmd testcases https://review.openstack.org/237373 | 02:10 |
| jeblair | infra continues to help production clouds :) | 02:11 |
| clarkb | yay | 02:11 |
| clarkb | so I think the ansible cron is ready for friday and shouldn't blow up too badly while we are all away | 02:11 |
| openstackgerrit | Paul Belanger proposed openstack-infra/grafyaml: Tag dashboards with grafyaml label https://review.openstack.org/237134 | 02:11 |
| *** FallenPegasus has quit IRC | 02:12 | |
| *** heyongli has quit IRC | 02:12 | |
| jeblair | yolo! | 02:12 |
| *** FallenPegasus has joined #openstack-infra | 02:12 | |
| *** otter768 has quit IRC | 02:13 | |
| *** heyongli has joined #openstack-infra | 02:13 | |
| jeblair | (i saw that on a 'gravestone' haloween decoration and chuckled) | 02:13 |
| *** otter768 has joined #openstack-infra | 02:13 | |
| *** amotoki has joined #openstack-infra | 02:14 | |
| *** Daisy has joined #openstack-infra | 02:15 | |
| *** devlaps has quit IRC | 02:15 | |
| mordred | jeblair: I chuckle every time I drive past the town of Yolo, CA on the way to Redding | 02:15 |
| jeblair | mordred: it's a whole county too :) | 02:16 |
| *** tiswanso_ has joined #openstack-infra | 02:16 | |
| mordred | https://www.smugmug.com/gallery/n-4DhTvc/i-Ww2RjdP/A | 02:16 |
| openstackgerrit | Augustina Ragwitz proposed openstack/diskimage-builder: Sanitize distro elements for minimal vs cloud https://review.openstack.org/211859 | 02:18 |
| clarkb | I bet they make great tshirts just like weed, CA | 02:18 |
| jeblair | mordred: is that a random internet find, or do you know the photographer? | 02:18 |
| mordred | jeblair: I do know the photographer - I'm sitting in the same chair as he | 02:18 |
| jeblair | mordred: i like his work | 02:19 |
| mordred | jeblair: thanks! | 02:19 |
| mordred | https://www.smugmug.com/gallery/n-4DhTvc/i-wMdkg7m/A is from the same series | 02:19 |
| *** tiswanso has quit IRC | 02:19 | |
| *** amotoki has quit IRC | 02:19 | |
| mordred | jeblair: (I may have moved the photo collection to smugmug, which may have involved learning how rest apis _actually_ work one weekend) | 02:19 |
| mordred | teaser: it's not how they work in openstack | 02:20 |
| *** aeng has quit IRC | 02:20 | |
| clarkb | mordred: do they actually work anywhere? | 02:20 |
| clarkb | I have yet to find a good REST api | 02:20 |
| jeblair | mordred: those urls end up showing me the same thing | 02:20 |
| mordred | jeblair: awesome | 02:20 |
| mordred | jeblair: oh! those are for the album | 02:21 |
| jeblair | mordred: (the pic of 2 trees, which seems to be the start of the 11 pic series) | 02:21 |
| mordred | the first time I thought I was sending you the far away yolo sign | 02:21 |
| *** inteq has joined #openstack-infra | 02:21 | |
| mordred | the second time the close up yolo sign | 02:21 |
| mordred | clarkb: I actually think the smugmug one is good | 02:21 |
| mordred | clarkb: the docs were a little shoddy one one point when I was doing uploads | 02:21 |
| mordred | clarkb: BUT - they actually include api descriptions with readable docs in the actual resource responses | 02:22 |
| *** heyongli has quit IRC | 02:22 | |
| mordred | clarkb: so the link type things work - AND - you know what they're for | 02:22 |
| *** ashleighfarnham has joined #openstack-infra | 02:22 | |
| clarkb | mordred: I find that most apis anymore are "mass of undocumented parameters at undocumented path and none of them make sense" | 02:23 |
| *** heyongli has joined #openstack-infra | 02:23 | |
| mordred | yah | 02:23 |
| mordred | that was not the case with smugmug | 02:23 |
| mordred | the problem there | 02:23 |
| mordred | is that I'm so used to "mass of undocumented parameters at undocumented path and none of them make sense" | 02:23 |
| mordred | that I had a hard time following the clearly self-documenting api | 02:23 |
| *** achanda has joined #openstack-infra | 02:24 | |
| mordred | clarkb: that said - when I was doing it - the image payload portion had docs problems | 02:25 |
| mordred | clarkb: as they have noticed the glance image upload concern and addressed it | 02:25 |
| mordred | so the actual uploading of image content is to a differernt url (that iirc is returned from the image resource) | 02:25 |
| clarkb | that the api gets slow if you shove content through it? | 02:25 |
| mordred | but how you were supposed to send data to it was unclear | 02:25 |
| *** armax has quit IRC | 02:25 | |
| mordred | I sent bug reports | 02:25 |
| mordred | and they were like "yeah, it's a new api rev and we're working on those docs" | 02:26 |
| *** jjohnson2 has quit IRC | 02:27 | |
| *** devlaps has joined #openstack-infra | 02:29 | |
| mordred | mtreinish: if you're awake ... https://review.openstack.org/#/c/237148/ | 02:29 |
| mordred | mtreinish: if you're not, that's more sensible | 02:29 |
| *** FallenPegasus has quit IRC | 02:30 | |
| lifeless | StevenK: ping | 02:31 |
| *** heyongli has quit IRC | 02:32 | |
| *** heyongli has joined #openstack-infra | 02:33 | |
| mordred | look! it's lifeless! | 02:34 |
| *** salv-orlando has joined #openstack-infra | 02:34 | |
| openstackgerrit | Sachi King proposed openstack-infra/project-config: Add tarball-constraints jobs https://review.openstack.org/228346 | 02:35 |
| lifeless | mordred: o/ | 02:36 |
| StevenK | lifeless: Now that I've had lunch, pong | 02:36 |
| lifeless | StevenK: hi! following up on yesterdays start | 02:37 |
| lifeless | since I've only an hour left before heading into town for a meetup, and thats not enough time to get into a new patch of my own | 02:38 |
| *** devlaps has quit IRC | 02:40 | |
| *** dims_ has joined #openstack-infra | 02:41 | |
| StevenK | lifeless: I looked at trello, PRs and issues, and sighed about probably needing to sign up for github | 02:42 |
| *** heyongli has quit IRC | 02:43 | |
| lifeless | StevenK: I am amazed you've survived this long w/o that | 02:43 |
| *** heyongli has joined #openstack-infra | 02:43 | |
| *** DericHorn-HP has quit IRC | 02:44 | |
| StevenK | Handy, stevenk already exists, but has done nothing ever | 02:47 |
| *** dims_ has quit IRC | 02:47 | |
| *** rfolco_ has quit IRC | 02:49 | |
| *** aeng has joined #openstack-infra | 02:51 | |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: Add a job for Neutron FWaaS scenario tests https://review.openstack.org/237376 | 02:53 |
| *** lawrancejing has quit IRC | 02:53 | |
| *** heyongli has quit IRC | 02:53 | |
| *** lawrancejing has joined #openstack-infra | 02:54 | |
| *** heyongli has joined #openstack-infra | 02:54 | |
| *** achanda has quit IRC | 02:54 | |
| StevenK | lifeless: So while I ponder signing up, is there something you want to help guide me through? | 02:54 |
| *** ashleighfarnham has quit IRC | 02:55 | |
| *** salv-orlando has quit IRC | 02:55 | |
| *** zz_dimtruck is now known as dimtruck | 02:57 | |
| *** kozhukalov_ has quit IRC | 02:59 | |
| *** heyongli has quit IRC | 03:03 | |
| lifeless | StevenK: looking, dstufft has merged some bits | 03:03 |
| *** heyongli has joined #openstack-infra | 03:04 | |
| lifeless | StevenK: I suspect cloning https://github.com/pypa/pip/pull/3105 | 03:04 |
| lifeless | StevenK: and adding the additional tests I've asked for in the review would be a good warm-up thing | 03:04 |
| lifeless | Nakato: ^ do you concur? | 03:05 |
| Nakato | lifeless: Yes | 03:08 |
| *** heyongli has quit IRC | 03:13 | |
| *** nadya has joined #openstack-infra | 03:14 | |
| *** heyongli has joined #openstack-infra | 03:14 | |
| *** burgerk has quit IRC | 03:17 | |
| *** julim has joined #openstack-infra | 03:17 | |
| *** armax has joined #openstack-infra | 03:21 | |
| *** salv-orlando has joined #openstack-infra | 03:22 | |
| *** amotoki has joined #openstack-infra | 03:23 | |
| *** heyongli has quit IRC | 03:24 | |
| *** heyongli has joined #openstack-infra | 03:24 | |
| lifeless | StevenK: ok, -> town, will be online again in a while | 03:27 |
| *** salv-orlando has quit IRC | 03:29 | |
| *** bpokorny has joined #openstack-infra | 03:30 | |
| *** thorst has quit IRC | 03:31 | |
| *** heyongli has quit IRC | 03:34 | |
| *** heyongli has joined #openstack-infra | 03:35 | |
| *** asselin__ has joined #openstack-infra | 03:36 | |
| *** asselin_ has quit IRC | 03:37 | |
| *** ddieterly has quit IRC | 03:38 | |
| *** links has joined #openstack-infra | 03:39 | |
| *** tlian2 has quit IRC | 03:41 | |
| *** dims_ has joined #openstack-infra | 03:43 | |
| *** heyongli has quit IRC | 03:44 | |
| *** heyongli has joined #openstack-infra | 03:45 | |
| *** Sukhdev_ has joined #openstack-infra | 03:47 | |
| *** vilobhmm11 has joined #openstack-infra | 03:47 | |
| *** laughterwym_ has quit IRC | 03:48 | |
| *** dims_ has quit IRC | 03:48 | |
| *** dougshelley66 has quit IRC | 03:49 | |
| *** schang has quit IRC | 03:50 | |
| *** dougshelley66 has joined #openstack-infra | 03:50 | |
| *** pahuang has quit IRC | 03:50 | |
| *** Sukhdev_ has quit IRC | 03:51 | |
| *** schang has joined #openstack-infra | 03:52 | |
| *** unicell has joined #openstack-infra | 03:52 | |
| *** links has quit IRC | 03:52 | |
| *** cody-somerville has joined #openstack-infra | 03:54 | |
| *** Ramanjaneya has joined #openstack-infra | 03:54 | |
| *** heyongli has quit IRC | 03:54 | |
| *** pahuang has joined #openstack-infra | 03:55 | |
| *** heyongli has joined #openstack-infra | 03:55 | |
| *** yfried has quit IRC | 03:57 | |
| *** amotoki has quit IRC | 03:58 | |
| *** xyang1 has quit IRC | 04:00 | |
| *** dimtruck is now known as zz_dimtruck | 04:01 | |
| *** lawrancejing has quit IRC | 04:01 | |
| *** Daisy has quit IRC | 04:02 | |
| openstackgerrit | fumihiko kakuma proposed openstack-infra/project-config: Add job for the ovs mechanism driver with native mode https://review.openstack.org/221143 | 04:02 |
| *** lawrancejing has joined #openstack-infra | 04:02 | |
| *** heyongli has quit IRC | 04:05 | |
| *** heyongli has joined #openstack-infra | 04:05 | |
| *** FallenPegasus has joined #openstack-infra | 04:06 | |
| openstackgerrit | Mikhail S Medvedev proposed openstack-infra/project-config: Add puppet-ciwatch module to openstack-infra https://review.openstack.org/231699 | 04:07 |
| *** sridhar_ram has joined #openstack-infra | 04:09 | |
| SpamapS | fungi: wow, I'm guessing that dump file is still growing... | 04:09 |
| SpamapS | | 1066062 | query | 10.181.6.142:49381 | subunit2sql | Query | 27258 | Writing to net | SELECT /*!40001 SQL_NO_CACHE */ * FROM `test_run_metadata` | | 04:09 |
| *** amotoki has joined #openstack-infra | 04:11 | |
| *** cody-somerville has quit IRC | 04:11 | |
| *** Sukhdev_ has joined #openstack-infra | 04:12 | |
| *** gongysh has quit IRC | 04:12 | |
| *** igorbelikov has quit IRC | 04:13 | |
| *** heyongli has quit IRC | 04:15 | |
| *** BharatK has quit IRC | 04:15 | |
| *** links has joined #openstack-infra | 04:15 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config: Switch Fedora 22 nodes to fedora-minimal build https://review.openstack.org/237389 | 04:15 |
| *** amotoki has quit IRC | 04:15 | |
| ianw | greghaynes / mordred : ^ with dib release today, i think that's good to go... | 04:16 |
| *** heyongli has joined #openstack-infra | 04:16 | |
| *** Sukhdev_ has quit IRC | 04:18 | |
| *** reed_ has joined #openstack-infra | 04:18 | |
| *** sridhar_ram has quit IRC | 04:18 | |
| *** sridhar_ram has joined #openstack-infra | 04:18 | |
| *** amotoki has joined #openstack-infra | 04:19 | |
| *** Sukhdev_ has joined #openstack-infra | 04:19 | |
| *** Sukhdev__ has joined #openstack-infra | 04:20 | |
| *** sridhar_ram1 has joined #openstack-infra | 04:23 | |
| *** Sukhdev__ has quit IRC | 04:23 | |
| *** Sukhdev_ has quit IRC | 04:23 | |
| *** Sukhdev_ has joined #openstack-infra | 04:24 | |
| *** sridhar_ram has quit IRC | 04:24 | |
| *** amotoki_ has joined #openstack-infra | 04:25 | |
| *** heyongli has quit IRC | 04:25 | |
| *** heyongli has joined #openstack-infra | 04:26 | |
| *** vilobhmm11 has quit IRC | 04:26 | |
| *** ashleighfarnham has joined #openstack-infra | 04:26 | |
| *** amotoki has quit IRC | 04:28 | |
| *** BharatK has joined #openstack-infra | 04:28 | |
| *** sridhar_ram1 has quit IRC | 04:28 | |
| *** sridhar_ram has joined #openstack-infra | 04:29 | |
| *** olaph has quit IRC | 04:30 | |
| *** mwagone_ has joined #openstack-infra | 04:30 | |
| *** mwagone has quit IRC | 04:30 | |
| *** olaph has joined #openstack-infra | 04:31 | |
| *** nadya has quit IRC | 04:32 | |
| *** denisra has quit IRC | 04:33 | |
| *** armax has quit IRC | 04:33 | |
| *** stevemar_ has quit IRC | 04:34 | |
| openstackgerrit | Angus Lees proposed openstack-infra/project-config: Add new oslo.privsep project https://review.openstack.org/204477 | 04:34 |
| *** alex_xu has quit IRC | 04:34 | |
| *** bpokorny has quit IRC | 04:34 | |
| *** asettle has quit IRC | 04:35 | |
| *** alex_xu has joined #openstack-infra | 04:35 | |
| *** heyongli has quit IRC | 04:35 | |
| *** heyongli has joined #openstack-infra | 04:36 | |
| *** rlandy has quit IRC | 04:38 | |
| *** vilobhmm11 has joined #openstack-infra | 04:39 | |
| *** ddieterly has joined #openstack-infra | 04:39 | |
| *** amotoki_ has quit IRC | 04:40 | |
| *** BharatK has quit IRC | 04:41 | |
| *** Daisy has joined #openstack-infra | 04:41 | |
| *** ashleighfarnham has quit IRC | 04:41 | |
| *** BharatK has joined #openstack-infra | 04:44 | |
| *** salv-orlando has joined #openstack-infra | 04:44 | |
| *** ddieterly has quit IRC | 04:44 | |
| *** dims_ has joined #openstack-infra | 04:45 | |
| *** heyongli has quit IRC | 04:46 | |
| *** yfried has joined #openstack-infra | 04:46 | |
| *** amotoki has joined #openstack-infra | 04:46 | |
| *** heyongli has joined #openstack-infra | 04:46 | |
| *** Ramanjaneya has quit IRC | 04:48 | |
| *** Ramanjaneya has joined #openstack-infra | 04:49 | |
| *** dims_ has quit IRC | 04:50 | |
| *** tiswanso_ has quit IRC | 04:50 | |
| *** mohankumar has joined #openstack-infra | 04:52 | |
| *** oomichi has joined #openstack-infra | 04:52 | |
| *** heyongli has quit IRC | 04:56 | |
| *** salv-orlando has quit IRC | 04:56 | |
| *** heyongli has joined #openstack-infra | 04:57 | |
| *** e0ne has joined #openstack-infra | 05:01 | |
| *** stevemar_ has joined #openstack-infra | 05:02 | |
| *** sergmelikyan has joined #openstack-infra | 05:03 | |
| *** achanda has joined #openstack-infra | 05:04 | |
| *** heyongli has quit IRC | 05:06 | |
| *** heyongli has joined #openstack-infra | 05:07 | |
| StevenK | lifeless: I have a testcase added that runs 'pip install bar bar[simple] bar[singlemodule]' and it fails with Double requirement given: bar[simple] (already in bar, name='bar') | 05:08 |
| *** boris-42 has joined #openstack-infra | 05:09 | |
| *** spredzy_ has joined #openstack-infra | 05:12 | |
| *** yfried has quit IRC | 05:14 | |
| *** heyongli has quit IRC | 05:16 | |
| *** heyongli has joined #openstack-infra | 05:17 | |
| openstackgerrit | Merged openstack-infra/project-config: Make openstack-health npm lint job voting https://review.openstack.org/236138 | 05:17 |
| *** mohankumar has quit IRC | 05:18 | |
| *** aukhan has joined #openstack-infra | 05:18 | |
| *** mohankumar has joined #openstack-infra | 05:19 | |
| openstackgerrit | Merged openstack-infra/project-config: Fix oslo.messaging+amqp1+dsvm to run from master https://review.openstack.org/236168 | 05:20 |
| lifeless | StevenK: \o/ means its not fixed :) | 05:23 |
| *** e0ne has quit IRC | 05:23 | |
| *** salv-orlando has joined #openstack-infra | 05:23 | |
| lifeless | StevenK: or rather the narrow special case we'd initially identified was fixed, but not the broader set of (still simply-addressable) cases | 05:24 |
| lifeless | StevenK: btw, #pypa-dev is the channel we discuss upstream packaging work on | 05:24 |
| *** abregman has joined #openstack-infra | 05:25 | |
| *** reed_ has quit IRC | 05:25 | |
| *** reed_ has joined #openstack-infra | 05:26 | |
| *** e0ne has joined #openstack-infra | 05:26 | |
| *** heyongli has quit IRC | 05:27 | |
| *** heyongli has joined #openstack-infra | 05:27 | |
| *** stevemar_ has quit IRC | 05:28 | |
| *** stevemar_ has joined #openstack-infra | 05:29 | |
| *** amotoki_ has joined #openstack-infra | 05:30 | |
| *** salv-orl_ has joined #openstack-infra | 05:31 | |
| *** skylerberg has quit IRC | 05:33 | |
| *** salv-orlando has quit IRC | 05:34 | |
| *** skylerberg has joined #openstack-infra | 05:34 | |
| *** reed_ has quit IRC | 05:36 | |
| *** heyongli has quit IRC | 05:37 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Add a repository for I18n team https://review.openstack.org/235280 | 05:37 |
| *** heyongli has joined #openstack-infra | 05:38 | |
| *** jamielennox is now known as jamielennox|away | 05:39 | |
| *** ddieterly has joined #openstack-infra | 05:40 | |
| *** edmondsw has quit IRC | 05:41 | |
| *** cody-somerville has joined #openstack-infra | 05:44 | |
| *** ddieterly has quit IRC | 05:45 | |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: (Re)add midonet tempest jobs https://review.openstack.org/230932 | 05:46 |
| *** dims_ has joined #openstack-infra | 05:47 | |
| *** heyongli has quit IRC | 05:47 | |
| *** heyongli has joined #openstack-infra | 05:48 | |
| *** stevemar_ has quit IRC | 05:51 | |
| *** dims_ has quit IRC | 05:52 | |
| *** amotoki_ has quit IRC | 05:54 | |
| *** aeng has quit IRC | 05:55 | |
| *** heyongli has quit IRC | 05:57 | |
| *** heyongli has joined #openstack-infra | 05:58 | |
| *** amotoki_ has joined #openstack-infra | 05:59 | |
| *** amotoki_ has quit IRC | 06:00 | |
| *** adreznec has quit IRC | 06:00 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/237409 | 06:02 |
| *** adreznec has joined #openstack-infra | 06:03 | |
| *** e0ne has quit IRC | 06:05 | |
| *** heyongli has quit IRC | 06:08 | |
| *** heyongli has joined #openstack-infra | 06:08 | |
| *** asettle has joined #openstack-infra | 06:09 | |
| *** sergmelikyan has quit IRC | 06:09 | |
| *** sergmelikyan has joined #openstack-infra | 06:10 | |
| *** manas has joined #openstack-infra | 06:10 | |
| *** yfried has joined #openstack-infra | 06:12 | |
| *** unicell1 has joined #openstack-infra | 06:12 | |
| *** achanda has quit IRC | 06:12 | |
| *** shardy_a1k has joined #openstack-infra | 06:13 | |
| *** unicell has quit IRC | 06:13 | |
| *** shardy_afk has quit IRC | 06:14 | |
| *** stevemar_ has joined #openstack-infra | 06:14 | |
| *** ParsectiX has joined #openstack-infra | 06:15 | |
| *** yfried_ has joined #openstack-infra | 06:16 | |
| *** yfried has quit IRC | 06:16 | |
| *** sergmelikyan has quit IRC | 06:16 | |
| *** sergmelikyan has joined #openstack-infra | 06:17 | |
| *** sergmelikyan has quit IRC | 06:17 | |
| *** heyongli has quit IRC | 06:18 | |
| *** shardy_a1k has quit IRC | 06:18 | |
| *** shardy_afk has joined #openstack-infra | 06:19 | |
| *** heyongli has joined #openstack-infra | 06:19 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/requirements: Updated from generate-constraints https://review.openstack.org/237420 | 06:23 |
| *** markvoelker_ has joined #openstack-infra | 06:26 | |
| *** heyongli has quit IRC | 06:28 | |
| *** markvoelker has quit IRC | 06:29 | |
| *** heyongli has joined #openstack-infra | 06:29 | |
| *** e0ne has joined #openstack-infra | 06:30 | |
| *** aukhan has quit IRC | 06:30 | |
| *** ildikov has quit IRC | 06:31 | |
| *** shashank_hegde has quit IRC | 06:32 | |
| *** aukhan has joined #openstack-infra | 06:33 | |
| *** asmigala has joined #openstack-infra | 06:35 | |
| *** yfried_ is now known as yfried|afk | 06:35 | |
| *** sergmelikyan has joined #openstack-infra | 06:37 | |
| *** yfried|afk is now known as yfried_ | 06:37 | |
| *** heyongli has quit IRC | 06:38 | |
| *** heyongli has joined #openstack-infra | 06:39 | |
| *** amotoki_ has joined #openstack-infra | 06:40 | |
| *** ddieterly has joined #openstack-infra | 06:41 | |
| *** sergmelikyan has quit IRC | 06:42 | |
| *** fifieldt has joined #openstack-infra | 06:43 | |
| *** stevemar_ has quit IRC | 06:44 | |
| *** ddieterly has quit IRC | 06:45 | |
| *** kragniz has quit IRC | 06:46 | |
| *** dims_ has joined #openstack-infra | 06:48 | |
| *** heyongli has quit IRC | 06:49 | |
| *** heyongli has joined #openstack-infra | 06:49 | |
| *** peristeri has joined #openstack-infra | 06:50 | |
| *** AJaeger has joined #openstack-infra | 06:51 | |
| *** flepied1 has joined #openstack-infra | 06:51 | |
| AJaeger | yolanda, ianw: Here're two new repos to create - could you review these, please? https://review.openstack.org/#/c/235280/ https://review.openstack.org/#/c/236227/ | 06:52 |
| *** dims_ has quit IRC | 06:53 | |
| *** flepied has quit IRC | 06:54 | |
| *** flepied1 has quit IRC | 06:56 | |
| *** ParsectiX has quit IRC | 06:56 | |
| *** heyongli has quit IRC | 06:59 | |
| *** k4n0 has joined #openstack-infra | 07:00 | |
| *** heyongli has joined #openstack-infra | 07:00 | |
| *** amotoki_ has quit IRC | 07:01 | |
| *** nmagnezi has joined #openstack-infra | 07:02 | |
| *** e0ne has quit IRC | 07:05 | |
| *** ifarkas has joined #openstack-infra | 07:06 | |
| *** jcoufal has joined #openstack-infra | 07:07 | |
| *** skylerberg has quit IRC | 07:07 | |
| *** e0ne has joined #openstack-infra | 07:09 | |
| *** heyongli has quit IRC | 07:09 | |
| *** woodster_ has quit IRC | 07:09 | |
| *** heyongli has joined #openstack-infra | 07:10 | |
| *** e0ne has quit IRC | 07:11 | |
| *** nadya has joined #openstack-infra | 07:12 | |
| *** arxcruz has joined #openstack-infra | 07:12 | |
| openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/237409 | 07:12 |
| *** asettle has quit IRC | 07:13 | |
| *** scheuran has joined #openstack-infra | 07:14 | |
| *** ildikov has joined #openstack-infra | 07:16 | |
| *** e0ne has joined #openstack-infra | 07:16 | |
| *** markus_z has joined #openstack-infra | 07:16 | |
| *** HeOS has quit IRC | 07:17 | |
| *** camunoz is now known as camunoz_gone | 07:18 | |
| *** e0ne has quit IRC | 07:19 | |
| *** asettle has joined #openstack-infra | 07:19 | |
| *** heyongli has quit IRC | 07:19 | |
| *** asettle has quit IRC | 07:20 | |
| *** heyongli has joined #openstack-infra | 07:20 | |
| *** dizquierdo has joined #openstack-infra | 07:25 | |
| *** shardy_afk is now known as shardy | 07:27 | |
| openstackgerrit | Jean-Emile DARTOIS proposed openstack-infra/project-config: Add watcher-specs https://review.openstack.org/233679 | 07:27 |
| *** flepied has joined #openstack-infra | 07:28 | |
| *** flepied1 has joined #openstack-infra | 07:29 | |
| *** mpavone has joined #openstack-infra | 07:29 | |
| *** heyongli has quit IRC | 07:30 | |
| *** heyongli has joined #openstack-infra | 07:30 | |
| yolanda | morning AJaeger | 07:31 |
| yolanda | looking | 07:31 |
| AJaeger | morning, yolanda ! Thanks | 07:31 |
| *** flepied has quit IRC | 07:32 | |
| StevenK | AJaeger: Maybe we need Zanata to throw errors when translators attempt to save a string with invalid Unicode :-( | 07:34 |
| StevenK | I can't see a project setting WRT that | 07:34 |
| AJaeger | StevenK: Feature request? | 07:34 |
| StevenK | AJaeger: I'm hoping aeng will pop up on the -i18n thread | 07:35 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Revert "Temporarily remove zuul-cloner before tarball" https://review.openstack.org/237442 | 07:36 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Revert "Temporarily remove zuul-cloner before tarball" https://review.openstack.org/207201 | 07:38 |
| *** vilobhmm11 has quit IRC | 07:39 | |
| *** heyongli has quit IRC | 07:40 | |
| AJaeger | StevenK: If not, please ask aeng directly | 07:40 |
| yolanda | ok approved | 07:40 |
| *** Sukhdev_ has quit IRC | 07:40 | |
| *** heyongli has joined #openstack-infra | 07:41 | |
| *** ddieterly has joined #openstack-infra | 07:42 | |
| *** Ala has joined #openstack-infra | 07:42 | |
| *** ParsectiX has joined #openstack-infra | 07:43 | |
| *** asettle has joined #openstack-infra | 07:44 | |
| openstackgerrit | Merged openstack-infra/project-config: Add a repository for I18n team https://review.openstack.org/235280 | 07:44 |
| *** ParsectiX has quit IRC | 07:44 | |
| openstackgerrit | Merged openstack-infra/project-config: Add openstack-resource-agents project https://review.openstack.org/236227 | 07:45 |
| *** asettle has quit IRC | 07:45 | |
| *** jlanoux has joined #openstack-infra | 07:46 | |
| *** openstackgerrit has quit IRC | 07:46 | |
| *** asettle has joined #openstack-infra | 07:46 | |
| *** ddieterly has quit IRC | 07:46 | |
| *** openstackgerrit has joined #openstack-infra | 07:46 | |
| *** dtantsur|afk is now known as dtantsur | 07:47 | |
| *** asettle has quit IRC | 07:48 | |
| *** jordanP has joined #openstack-infra | 07:48 | |
| *** asettle has joined #openstack-infra | 07:48 | |
| openstackgerrit | Stéphane Albert proposed openstack-infra/project-config: Updated CloudKitty information due to big tent integration https://review.openstack.org/237084 | 07:49 |
| *** dims_ has joined #openstack-infra | 07:49 | |
| *** asettle has quit IRC | 07:49 | |
| *** heyongli has quit IRC | 07:50 | |
| *** asettle has joined #openstack-infra | 07:50 | |
| *** sshnaidm has joined #openstack-infra | 07:50 | |
| *** heyongli has joined #openstack-infra | 07:51 | |
| *** asettle has quit IRC | 07:51 | |
| *** yfried_ is now known as yfried|afk | 07:51 | |
| Daisy | Hello. The patch "Add a repository for I18n team" is merged. Who could help to give me the right to edit ACL of i18n repo ? | 07:52 |
| *** bexelbie has joined #openstack-infra | 07:52 | |
| openstackgerrit | Merged openstack-infra/project-config: open stable/liberty for ceilometer https://review.openstack.org/237098 | 07:52 |
| *** asettle has joined #openstack-infra | 07:52 | |
| *** asettle has quit IRC | 07:53 | |
| AJaeger | yolanda: https://review.openstack.org/#/admin/groups/1132,members | 07:53 |
| yolanda | shall i add Daisy? | 07:53 |
| openstackgerrit | Merged openstack-infra/project-config: Remove devstack install job for networking-ovn. https://review.openstack.org/237112 | 07:53 |
| *** yfried|afk is now known as yfried_ | 07:54 | |
| AJaeger | yolanda: yes, please | 07:54 |
| yolanda | AJaeger, daisy-ycguo right? | 07:54 |
| Daisy | Yes. | 07:54 |
| yolanda | done | 07:54 |
| Daisy | It's me. | 07:54 |
| yolanda | hi :) | 07:54 |
| Daisy | I see. Thank you, yolanda | 07:55 |
| yolanda | anytime | 07:55 |
| AJaeger | Daisy: you're setup now ;) | 07:55 |
| *** dims_ has quit IRC | 07:55 | |
| *** salv-orl_ has quit IRC | 07:56 | |
| Daisy | Thank you, AJaeger. | 07:56 |
| openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config: Add a non-voting Ironic job to Neutron https://review.openstack.org/236964 | 07:58 |
| *** heyongli has quit IRC | 08:00 | |
| *** fhubik has joined #openstack-infra | 08:01 | |
| *** salv-orlando has joined #openstack-infra | 08:01 | |
| *** heyongli has joined #openstack-infra | 08:01 | |
| *** nmagnezi has quit IRC | 08:02 | |
| *** ParsectiX has joined #openstack-infra | 08:03 | |
| *** salv-orlando has quit IRC | 08:05 | |
| *** salv-orlando has joined #openstack-infra | 08:05 | |
| *** sshnaidm has quit IRC | 08:05 | |
| openstackgerrit | Merged openstack-infra/project-config: Refactoring GlusterFS jobs https://review.openstack.org/236727 | 08:06 |
| *** jhesketh has quit IRC | 08:07 | |
| *** luqas has quit IRC | 08:09 | |
| *** jhesketh has joined #openstack-infra | 08:09 | |
| openstackgerrit | Marian Horban proposed openstack-infra/project-config: [WIP]Make job tempest-dsvm-nova-wsgi-full voteable https://review.openstack.org/236969 | 08:09 |
| *** luqas has joined #openstack-infra | 08:09 | |
| *** heyongli has quit IRC | 08:11 | |
| *** fhubik is now known as fhubik_brb | 08:11 | |
| *** heyongli has joined #openstack-infra | 08:11 | |
| *** kiran-r has joined #openstack-infra | 08:13 | |
| *** hashar has joined #openstack-infra | 08:15 | |
| *** luqas has quit IRC | 08:16 | |
| openstackgerrit | Merged openstack-infra/project-config: Add ambari images for sahara-image-elements https://review.openstack.org/231983 | 08:16 |
| openstackgerrit | Merged openstack-infra/project-config: Experimental fedora-22 node for puppet-apply tests https://review.openstack.org/231679 | 08:17 |
| openstackgerrit | Merged openstack-infra/project-config: Add zaqar integration builder https://review.openstack.org/236958 | 08:17 |
| *** rossella_s has joined #openstack-infra | 08:17 | |
| *** kozhukalov_ has joined #openstack-infra | 08:18 | |
| *** aeng has joined #openstack-infra | 08:18 | |
| *** boris-42 has quit IRC | 08:18 | |
| *** rguillebert has joined #openstack-infra | 08:19 | |
| *** luqas has joined #openstack-infra | 08:20 | |
| *** heyongli has quit IRC | 08:21 | |
| *** derekh has joined #openstack-infra | 08:21 | |
| *** aukhan has quit IRC | 08:21 | |
| *** cylopez has joined #openstack-infra | 08:21 | |
| cylopez | Hi | 08:22 |
| *** heyongli has joined #openstack-infra | 08:22 | |
| *** BobBall_AWOL is now known as BobBall | 08:23 | |
| cylopez | I tried to sign Contributor Agreement in gerrit without success... I got "Cannot store contact information". Someone could help me please ? | 08:23 |
| openstackgerrit | Merged openstack-infra/puppet-grafyaml: Run grafana_dashboard_update when install_grafyaml changes https://review.openstack.org/237179 | 08:24 |
| *** jistr has joined #openstack-infra | 08:27 | |
| *** fhubik_brb is now known as fhubik | 08:30 | |
| *** heyongli has quit IRC | 08:31 | |
| *** heyongli has joined #openstack-infra | 08:32 | |
| openstackgerrit | Merged openstack-infra/puppet-openstackci: Add pass through for project-config revision https://review.openstack.org/198546 | 08:32 |
| *** _skolekonov is now known as skolekonov | 08:33 | |
| openstackgerrit | Merged openstack-infra/puppet-phabricator: Update SQL Migration Script https://review.openstack.org/235802 | 08:33 |
| openstackgerrit | Merged openstack-infra/puppet-httpd: Fix proxy and redirect configuration file names. https://review.openstack.org/225331 | 08:36 |
| *** aukhan has joined #openstack-infra | 08:37 | |
| *** cylopez has left #openstack-infra | 08:37 | |
| openstackgerrit | Merged openstack-infra/puppet-httpd: Grant access for vhosts on Apache >= 2.4 https://review.openstack.org/228604 | 08:39 |
| *** jed56 has joined #openstack-infra | 08:41 | |
| *** kragniz_ has joined #openstack-infra | 08:41 | |
| *** alexpilotti has joined #openstack-infra | 08:41 | |
| *** kragniz_ is now known as kragniz | 08:41 | |
| *** heyongli has quit IRC | 08:41 | |
| openstackgerrit | Stéphane Albert proposed openstack-infra/project-config: Updated CloudKitty information due to big tent integration https://review.openstack.org/237084 | 08:42 |
| *** ddieterly has joined #openstack-infra | 08:42 | |
| *** heyongli has joined #openstack-infra | 08:42 | |
| jed56 | hi | 08:43 |
| yolanda | hi | 08:43 |
| jed56 | yolanda : I have one question for you regarding python jobs for watcher-specs | 08:43 |
| jed56 | I was not sure. But I saw the same thing in several projects . For example in ceilometer-specs. We want to have tests. | 08:43 |
| yolanda | i want to know... if that's an spec, why do you need to run python jobs? | 08:43 |
| jed56 | it's seems that we can have tests | 08:44 |
| jed56 | for example : https://github.com/openstack/ceilometer-specs/tree/master/tests | 08:44 |
| jed56 | But maybe is not a good practice | 08:44 |
| yolanda | let me check ,if that's a general rule i am ok | 08:45 |
| yolanda | but it raised my attention | 08:45 |
| jed56 | thanks a lot | 08:46 |
| *** luqas has quit IRC | 08:46 | |
| *** ddieterly has quit IRC | 08:47 | |
| yolanda | jed56, i see some projects with python tests, some others without. If your plan is to have python code in the specs, and tests it is good to add them. But if you just plan to add some text specs, these jobs are not needed, and better skip them | 08:47 |
| *** sergmelikyan has joined #openstack-infra | 08:47 | |
| jed56 | yolanda : yes we want to add tests like in the ceilometer project | 08:48 |
| yolanda | ok | 08:48 |
| yolanda | what was the link for your change? | 08:48 |
| jed56 | https://review.openstack.org/#/c/233679/ | 08:49 |
| jed56 | One more question : I'm not familiar with gerrit i tried to response to your comment did you see it ? | 08:49 |
| yolanda | last comment in the review it's mine | 08:50 |
| yolanda | what did you try? | 08:50 |
| *** dingyichen has quit IRC | 08:50 | |
| jed56 | my comment is marked as a draft | 08:51 |
| *** dims_ has joined #openstack-infra | 08:51 | |
| *** amotoki has quit IRC | 08:51 | |
| jed56 | I can edit it | 08:51 |
| lennyb | yolanda: Hi, could you review the following commit #link https://review.openstack.org/#/c/206513/ . It's a small documentation issue and missing one core only. | 08:51 |
| yolanda | ah, then you have to click on review, and publish comments | 08:51 |
| *** HeOS has joined #openstack-infra | 08:52 | |
| *** heyongli has quit IRC | 08:52 | |
| *** sergmelikyan has quit IRC | 08:52 | |
| *** FallenPegasus has quit IRC | 08:52 | |
| *** heyongli has joined #openstack-infra | 08:52 | |
| jed56 | yolanda : thanks i got it ! | 08:53 |
| yolanda | np | 08:54 |
| openstackgerrit | Dimitri Mazmanov proposed openstack-infra/project-config: Add Kingbird to the project list https://review.openstack.org/235253 | 08:54 |
| yolanda | lennyb, .looking | 08:54 |
| sileht | hum is http://logs.openstack.org/ dead ? | 08:56 |
| *** sergmelikyan has joined #openstack-infra | 08:56 | |
| *** lawranc__ has joined #openstack-infra | 08:56 | |
| yolanda | sileht, wow yes | 08:56 |
| yolanda | looking | 08:56 |
| sileht | yolanda, thx | 08:57 |
| *** dims_ has quit IRC | 08:57 | |
| sileht | yolanda, the serves look alive, but not the webserver | 08:57 |
| sileht | serves/servers | 08:57 |
| yolanda | ok, there is a bug in some apache config, checking | 08:57 |
| lennyb | yolanda: thanks. | 08:58 |
| yolanda | sileht, fixed | 08:59 |
| yolanda | thanks for the alert | 08:59 |
| *** shardy_ has joined #openstack-infra | 08:59 | |
| *** aopincar has joined #openstack-infra | 08:59 | |
| sileht | yolanda, thx for the quick fix | 08:59 |
| *** lawrancejing has quit IRC | 08:59 | |
| yolanda | i'll check other endpoints as well | 08:59 |
| *** stevemar_ has joined #openstack-infra | 09:00 | |
| *** shardy has quit IRC | 09:00 | |
| *** nmagnezi has joined #openstack-infra | 09:01 | |
| openstackgerrit | Merged openstack-infra/system-config: Send email on merge-failure instead of commenting https://review.openstack.org/206513 | 09:01 |
| *** tdasilva has quit IRC | 09:02 | |
| *** heyongli has quit IRC | 09:02 | |
| *** heyongli has joined #openstack-infra | 09:03 | |
| *** stevemar_ has quit IRC | 09:03 | |
| *** sergmelikyan has quit IRC | 09:04 | |
| *** sergmelikyan has joined #openstack-infra | 09:04 | |
| *** shardy_ has quit IRC | 09:04 | |
| *** nadya has quit IRC | 09:04 | |
| *** frickler has quit IRC | 09:05 | |
| *** luqas has joined #openstack-infra | 09:05 | |
| *** Mmike has quit IRC | 09:05 | |
| *** shardy has joined #openstack-infra | 09:05 | |
| *** jcoufal has quit IRC | 09:06 | |
| *** marzif has joined #openstack-infra | 09:07 | |
| *** e0ne has joined #openstack-infra | 09:07 | |
| *** manas has quit IRC | 09:08 | |
| AJaeger | yolanda: specs often have tests - to ensure the RST is valid | 09:08 |
| yolanda | AJaeger, new thing learnt :) | 09:08 |
| *** jcoufal has joined #openstack-infra | 09:09 | |
| *** Daisy has quit IRC | 09:09 | |
| AJaeger | yolanda: specs publish HTML documents built from RST - so testing that the RST can be published is nice ;) | 09:09 |
| *** amotoki has joined #openstack-infra | 09:10 | |
| *** Mmike has joined #openstack-infra | 09:11 | |
| *** luqas has quit IRC | 09:11 | |
| *** heyongli has quit IRC | 09:12 | |
| *** yamahata has joined #openstack-infra | 09:13 | |
| *** heyongli has joined #openstack-infra | 09:13 | |
| *** dkehn has quit IRC | 09:14 | |
| AJaeger | yolanda: something else to mention: publishing to specs.openstack.org and docs.openstack.org is only available for official projects - the repo needs to be in governance/reference/projects.yaml. Watcher is not there, so is not allowed to publish to specs.openstack.org. | 09:14 |
| *** lawranc__ has quit IRC | 09:15 | |
| yolanda | ah, thanks for the info. So in that case we need to ask for the owner to create the change to governance | 09:15 |
| AJaeger | yolanda: yes - first to become part of the big tent. | 09:15 |
| *** lawrancejing has joined #openstack-infra | 09:15 | |
| AJaeger | But for watcher-specs, they can just setup the specs and not publish for now. | 09:15 |
| *** dkehn has joined #openstack-infra | 09:15 | |
| *** notnownikki has joined #openstack-infra | 09:16 | |
| *** kiran-r has quit IRC | 09:16 | |
| openstackgerrit | Emma Foley proposed openstack-infra/project-config: Opening a repository for a ceilometer plugin for collectd. https://review.openstack.org/222763 | 09:17 |
| openstackgerrit | Gael Chamoulaud proposed openstack-infra/project-config: zuul/layout: Enable non-voting puppet check jobs on tripleo-heat-templates. https://review.openstack.org/234129 | 09:18 |
| AJaeger | yolanda: didn't you see my comment on https://review.openstack.org/237112 ? | 09:18 |
| *** frickler has joined #openstack-infra | 09:18 | |
| AJaeger | yolanda: for certain repos - most notably neutron family but also glance - we have liasons that should review any change, see https://wiki.openstack.org/wiki/CrossProjectLiaisons#Infra | 09:19 |
| *** sergmelikyan has quit IRC | 09:19 | |
| *** luqas has joined #openstack-infra | 09:19 | |
| *** sergmelikyan has joined #openstack-infra | 09:20 | |
| *** ihrachys has joined #openstack-infra | 09:20 | |
| *** tdasilva has joined #openstack-infra | 09:21 | |
| AJaeger | yolanda: I don't think harm done and we can revert if necessary - but please check comments next time. | 09:22 |
| *** heyongli has quit IRC | 09:22 | |
| *** heyongli has joined #openstack-infra | 09:23 | |
| yolanda | AJaeger so i missed that sorry | 09:24 |
| openstackgerrit | Gael Chamoulaud proposed openstack-infra/project-config: zuul/layout: Enable non-voting puppet check jobs on tripleo-heat-templates. https://review.openstack.org/234129 | 09:25 |
| *** gchamoul has joined #openstack-infra | 09:25 | |
| *** jamielennox|away is now known as jamielennox | 09:26 | |
| *** nadya has joined #openstack-infra | 09:27 | |
| *** sergmelikyan has quit IRC | 09:28 | |
| openstackgerrit | John Garbutt proposed openstack-infra/devstack-gate: DO NOT MERGE - testing tempest-dsvm-lxc https://review.openstack.org/237480 | 09:29 |
| openstackgerrit | Emma Foley proposed openstack-infra/project-config: Opening a repository for a ceilometer plugin for collectd. https://review.openstack.org/222763 | 09:31 |
| *** heyongli has quit IRC | 09:33 | |
| *** heyongli has joined #openstack-infra | 09:34 | |
| *** alex_xu has quit IRC | 09:34 | |
| *** lawrancejing has quit IRC | 09:34 | |
| *** sergmelikyan has joined #openstack-infra | 09:35 | |
| *** alex_xu has joined #openstack-infra | 09:36 | |
| *** sergmelikyan has quit IRC | 09:36 | |
| *** manas has joined #openstack-infra | 09:36 | |
| *** amotoki has quit IRC | 09:37 | |
| *** sergmelikyan has joined #openstack-infra | 09:37 | |
| *** dtardivel has joined #openstack-infra | 09:38 | |
| openstackgerrit | John Garbutt proposed openstack-infra/project-config: Add tempest-dsvm-lxc as experimental https://review.openstack.org/226565 | 09:39 |
| *** dtantsur is now known as dtantsur|bbl | 09:39 | |
| *** amotoki has joined #openstack-infra | 09:43 | |
| *** heyongli has quit IRC | 09:43 | |
| *** ddieterly has joined #openstack-infra | 09:43 | |
| *** heyongli has joined #openstack-infra | 09:44 | |
| *** rlu has joined #openstack-infra | 09:44 | |
| *** fawadkhaliq has joined #openstack-infra | 09:46 | |
| openstackgerrit | Jean-Emile DARTOIS proposed openstack-infra/project-config: Add watcher-specs https://review.openstack.org/233679 | 09:47 |
| *** ddieterly has quit IRC | 09:48 | |
| *** markus_z is now known as markus_z_lunch | 09:49 | |
| *** dims_ has joined #openstack-infra | 09:49 | |
| *** sergmelikyan has quit IRC | 09:49 | |
| jed56 | AJaeger : Hi | 09:50 |
| AJaeger | hi jed56 | 09:51 |
| *** aeng has quit IRC | 09:52 | |
| *** ihrachys has quit IRC | 09:52 | |
| *** amotoki has quit IRC | 09:53 | |
| *** heyongli has quit IRC | 09:53 | |
| jed56 | I'm trying to add watcher-specs and I thought that there is not more difference between stackforge project and openstack project | 09:54 |
| *** heyongli has joined #openstack-infra | 09:54 | |
| *** rlu has quit IRC | 09:54 | |
| AJaeger | jed56: we only merged the namespaces, the idea of stackforge still exists | 09:54 |
| *** rlu has joined #openstack-infra | 09:55 | |
| *** dtardivel has quit IRC | 09:56 | |
| jed56 | but not we have http://github.com/openstack/watcher | 09:57 |
| jed56 | *now | 09:57 |
| jed56 | so your code will be on openstack and the specs will be on stackforge ? | 09:57 |
| jed56 | I'm not sure to understand | 09:57 |
| *** dtardivel has joined #openstack-infra | 09:58 | |
| openstackgerrit | John Garbutt proposed openstack-infra/devstack-gate: DO NOT MERGE - testing tempest-dsvm-lxc https://review.openstack.org/237480 | 09:58 |
| openstackgerrit | John Garbutt proposed openstack-infra/devstack-gate: DO NOT MERGE - testing tempest-dsvm-lxc https://review.openstack.org/237480 | 09:59 |
| jed56 | One collegue of my asked this question : Question (Oct 9) : Hi Infra team. I want to create a new "stackforge" project. Do I need to wait for Stackforge/OpenStack projects migration, or can I create it now and update your wiki page for migration? Thanks | 09:59 |
| jed56 | => mordred dtardivel: you can create a new project now, just do it in the openstack namespace | 10:00 |
| jed56 | the response was given by mordred the 9 oct | 10:00 |
| jed56 | mordred : hi | 10:01 |
| Clint | jed56: you can be in openstack/ and not be an official openstack project | 10:02 |
| *** amotoki has joined #openstack-infra | 10:02 | |
| AJaeger | jed56: and that answer is correct - as Clint says | 10:02 |
| AJaeger | Official openstack projects are those that are recorded in governance repository. | 10:03 |
| AJaeger | Projects can use the openstack namespace, even those that are not official | 10:03 |
| *** zhenguo has quit IRC | 10:03 | |
| *** heyongli has quit IRC | 10:03 | |
| AJaeger | jed56: the specs will not be on stackforge! | 10:03 |
| AJaeger | jed56: watcher-specs will be part of openstack namespace. | 10:04 |
| AJaeger | BUT you cannot publish to specs.openstack.org unless you are an official project | 10:04 |
| *** heyongli has joined #openstack-infra | 10:04 | |
| AJaeger | So, don't use the template for publishing to specs.openstack.org but use the template for projects that do not publish - which is called stackforge-specs-job | 10:04 |
| AJaeger | jed56: is that clearer? | 10:04 |
| jed56 | yes, this more clear now. So i will change openstack-specs-jobs by stackforge-specs-jobs. | 10:06 |
| jed56 | in the new patchset | 10:06 |
| jed56 | next | 10:06 |
| AJaeger | jed56: exactly | 10:08 |
| lennyb | btw, http://stackalytics.com is down. Is it 'ours' ? | 10:09 |
| AJaeger | lennyb: no | 10:09 |
| lennyb | Ajaeger: thanks. | 10:09 |
| openstackgerrit | YAMAMOTO Takashi proposed openstack-infra/project-config: (Re)add midonet tempest jobs https://review.openstack.org/230932 | 10:10 |
| *** marzif has quit IRC | 10:10 | |
| *** bdemers has quit IRC | 10:11 | |
| *** tlbr has joined #openstack-infra | 10:11 | |
| openstackgerrit | Jean-Emile DARTOIS proposed openstack-infra/project-config: Add watcher-specs https://review.openstack.org/233679 | 10:11 |
| jed56 | AJaeger: thanks | 10:12 |
| *** markvoelker_ has quit IRC | 10:13 | |
| *** heyongli has quit IRC | 10:14 | |
| *** fhubik is now known as fhubik_brb | 10:14 | |
| *** heyongli has joined #openstack-infra | 10:15 | |
| *** jed56 is now known as identity | 10:15 | |
| *** lawrancejing has joined #openstack-infra | 10:16 | |
| *** identity is now known as jed56 | 10:16 | |
| *** SamYaple has joined #openstack-infra | 10:18 | |
| *** Kennan2 has quit IRC | 10:19 | |
| *** amotoki_ has joined #openstack-infra | 10:21 | |
| *** amotoki has quit IRC | 10:23 | |
| *** Kennan has joined #openstack-infra | 10:24 | |
| *** heyongli has quit IRC | 10:24 | |
| *** heyongli has joined #openstack-infra | 10:25 | |
| openstackgerrit | Dmitriy Ukhlov proposed openstack-infra/project-config: Oslo to adopt dukhlov's devstack pika plugin https://review.openstack.org/237001 | 10:25 |
| *** pc_m has joined #openstack-infra | 10:28 | |
| *** sergmelikyan has joined #openstack-infra | 10:31 | |
| *** claudiub has joined #openstack-infra | 10:32 | |
| *** heyongli has quit IRC | 10:34 | |
| *** aukhan has quit IRC | 10:35 | |
| *** sergmelikyan has quit IRC | 10:35 | |
| *** yfried_ is now known as yfried|afk | 10:35 | |
| *** heyongli has joined #openstack-infra | 10:35 | |
| *** aukhan has joined #openstack-infra | 10:35 | |
| *** markus_z_lunch is now known as markus_z | 10:36 | |
| *** sergmelikyan has joined #openstack-infra | 10:38 | |
| *** yfried|afk is now known as yfried_ | 10:38 | |
| aspiers | yolanda / anyone: please could I be added to openstack-resource-agents-core? my gerrit username is adam.spiers. https://review.openstack.org/#/admin/groups/1133,members | 10:39 |
| *** sergmelikyan has quit IRC | 10:39 | |
| *** sergmelikyan has joined #openstack-infra | 10:39 | |
| *** sergmelikyan has quit IRC | 10:42 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/project-config: Add tripleo F22 periodic jobs https://review.openstack.org/235321 | 10:43 |
| openstackgerrit | Derek Higgins proposed openstack-infra/project-config: Remove redundant sections of tripleo job names https://review.openstack.org/235395 | 10:43 |
| *** nadya has quit IRC | 10:44 | |
| *** ddieterly has joined #openstack-infra | 10:44 | |
| *** heyongli has quit IRC | 10:44 | |
| *** heyongli has joined #openstack-infra | 10:45 | |
| AJaeger | aspiers: you should get added to -release as well - https://review.openstack.org/#/admin/groups/1134,members | 10:45 |
| *** bdemers has joined #openstack-infra | 10:48 | |
| *** ddieterly has quit IRC | 10:48 | |
| openstackgerrit | Emma Foley proposed openstack-infra/project-config: Opening a repository for a ceilometer plugin for collectd. https://review.openstack.org/222763 | 10:49 |
| *** ParsectiX has quit IRC | 10:50 | |
| *** aysyd has joined #openstack-infra | 10:50 | |
| *** ldnunes has joined #openstack-infra | 10:52 | |
| *** ZZelle has joined #openstack-infra | 10:52 | |
| *** ihrachys has joined #openstack-infra | 10:52 | |
| *** nadya has joined #openstack-infra | 10:54 | |
| *** aysyd has quit IRC | 10:54 | |
| *** heyongli has quit IRC | 10:55 | |
| *** paboldin has joined #openstack-infra | 10:55 | |
| *** heyongli has joined #openstack-infra | 10:56 | |
| *** manas has quit IRC | 10:56 | |
| paboldin | Hello channel. I'm here to complain about logs.openstack.org giving out css files with a 'x-asm' content type. This breaks things like this: http://logs.openstack.org/23/231423/6/check/rally-coverage/8eb0ab1/cover/ | 10:56 |
| *** rvba has quit IRC | 10:57 | |
| *** dtardivel has quit IRC | 10:58 | |
| *** ociuhandu has quit IRC | 11:00 | |
| *** jamielennox is now known as jamielennox|away | 11:00 | |
| *** aysyd has joined #openstack-infra | 11:01 | |
| aspiers | AJaeger: true | 11:02 |
| *** fhubik_brb is now known as fhubik | 11:03 | |
| *** EricGonczer_ has joined #openstack-infra | 11:03 | |
| *** weihan has joined #openstack-infra | 11:04 | |
| *** heyongli has quit IRC | 11:05 | |
| *** rlu has quit IRC | 11:05 | |
| *** heyongli has joined #openstack-infra | 11:06 | |
| *** dtantsur|bbl is now known as dtantsur | 11:08 | |
| *** ParsectiX has joined #openstack-infra | 11:09 | |
| *** nadya has quit IRC | 11:11 | |
| *** EricGonc_ has joined #openstack-infra | 11:12 | |
| *** markvoelker has joined #openstack-infra | 11:14 | |
| *** heyongli has quit IRC | 11:15 | |
| *** amotoki_ has quit IRC | 11:15 | |
| *** manas has joined #openstack-infra | 11:15 | |
| *** EricGonczer_ has quit IRC | 11:16 | |
| *** heyongli has joined #openstack-infra | 11:16 | |
| *** sergmelikyan has joined #openstack-infra | 11:17 | |
| *** EricGonc_ has quit IRC | 11:19 | |
| *** e0ne has quit IRC | 11:21 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: Create openstack/puppet-openstack-release-tools https://review.openstack.org/235513 | 11:23 |
| *** yamamoto has quit IRC | 11:24 | |
| *** jyuso1 has joined #openstack-infra | 11:24 | |
| *** heyongli has quit IRC | 11:25 | |
| *** ociuhandu has joined #openstack-infra | 11:26 | |
| *** heyongli has joined #openstack-infra | 11:26 | |
| *** ildikov has quit IRC | 11:26 | |
| *** flip214 has joined #openstack-infra | 11:27 | |
| flip214 | Hi. I've got a link to graphite.openstack.org, but it doesn't show any new data since 2 days. Have the CI jobs been renamed or something like that? | 11:27 |
| flip214 | It's about gate-tempest-dsvm-full-drbd-devstack-nv in cinder. | 11:28 |
| flip214 | URL: http://graphite.openstack.org/render/?width=600&height=344&_salt=1434709688.361&from=-3days&xFormat=%25b%25d-%25T&title=DRBD%20Cinder%2FDevstack%20stats&colorList=red%2Cgreen%2Cblue&target=stats_counts.zuul.pipeline.check.job.gate-tempest-dsvm-full-drbd-devstack-nv.FAILURE&target=stats_counts.zuul.pipeline.check.job.gate-tempest-dsvm-full-drbd-devstack-nv.SUCCESS | 11:28 |
| *** sergmelikyan has quit IRC | 11:30 | |
| *** aysyd has quit IRC | 11:30 | |
| *** aysyd has joined #openstack-infra | 11:31 | |
| openstackgerrit | Bruno Tavares proposed openstack-infra/zuul: Adds information about metric types. https://review.openstack.org/237523 | 11:31 |
| *** salv-orl_ has joined #openstack-infra | 11:31 | |
| *** sergmelikyan has joined #openstack-infra | 11:32 | |
| *** markvoelker has quit IRC | 11:32 | |
| sdague | yeh, I think graphite stopped taking data over the weekend | 11:32 |
| sdague | fungi / jhesketh / SergeyLukjanov anyone able to look? | 11:33 |
| sdague | http://graphite.openstack.org/render/?from=-200hours&height=500&until=now&width=800&bgcolor=ffffff&fgcolor=000000&yMax=100&yMin=0&vtitle=Failure%20Rate%20in%20Percent&title=Test%20failure%20rates%20over%20last%20200%20hours&&target=lineWidth(color(alias(movingAverage(asPercent(stats.zuul.pipeline.check.job.gate-grenade-dsvm.FAILURE,sum(stats.zuul.pipeline.check.job.gate-grenade-dsvm.{SUCCESS,FAILURE})),%2712hours%27),%20%27gate-grenade-dsvm%20 | 11:33 |
| sdague | %28check%29%27),%27ff0000%27),1)&target=lineWidth(color(alias(movingAverage(asPercent(stats.zuul.pipeline.gate.job.gate-grenade-dsvm.FAILURE,sum(stats.zuul.pipeline.gate.job.gate-grenade-dsvm.{SUCCESS,FAILURE})),%2712hours%27),%20%27gate-grenade-dsvm%20%28gate%29%27),%27b00000%27),2) | 11:33 |
| sdague | sorry - http://tinyurl.com/nd5blp7 | 11:33 |
| SergeyLukjanov | sdague, here | 11:33 |
| sdague | is another instance demonstrating that we stopped having job data in graphite sometime over the weekend | 11:33 |
| SergeyLukjanov | oh | 11:33 |
| SergeyLukjanov | sdague, any ideas? | 11:34 |
| sdague | SergeyLukjanov: no idea, I just see the problem | 11:34 |
| *** marcusvrn_ has joined #openstack-infra | 11:34 | |
| sdague | I saw it yesterday, but assumed it was something wrong with my tools | 11:34 |
| *** salv-orlando has quit IRC | 11:34 | |
| SergeyLukjanov | sdague, but we still have info on status.o.o/zuul for example | 11:34 |
| SergeyLukjanov | http://graphite.openstack.org/render/?from=-24hours&height=180&until=now&width=334&bgcolor=ffffff&fgcolor=000000&areaMode=stacked&target=color(alias(sumSeries(stats.gauges.nodepool.target.building),%20'Building'),%20'ffbf52')&target=color(alias(sumSeries(stats.gauges.nodepool.target.ready),%20'Available'),%20'00c868')&target=color(alias(sumSeries(stats.gauges.nodepool.target.used),%20'In%20Use'),%20'6464ff')&target=color(alias(sumSeries(st | 11:34 |
| SergeyLukjanov | ats.gauges.nodepool.target.delete),%20'Deleting'),%20'c864ff')&title=Test%20Nodes&_t=0.1131824217736721#1445340858476 | 11:34 |
| SergeyLukjanov | http://status.openstack.org/zuul/ | 11:34 |
| sdague | yep, so it's specific to the job data | 11:35 |
| *** heyongli has quit IRC | 11:36 | |
| *** maiteb has joined #openstack-infra | 11:36 | |
| *** ParsectiX has quit IRC | 11:36 | |
| SergeyLukjanov | we have gate-grenade-dsvm jobs running even right now - https://jenkins04.openstack.org/job/gate-grenade-dsvm/ | 11:37 |
| *** heyongli has joined #openstack-infra | 11:37 | |
| SergeyLukjanov | hm | 11:37 |
| *** manas has quit IRC | 11:38 | |
| *** yamahata has quit IRC | 11:38 | |
| *** markvoelker has joined #openstack-infra | 11:39 | |
| *** markvoelker has quit IRC | 11:39 | |
| sdague | right, that's why I'm sure it's wrong | 11:40 |
| *** gordc has joined #openstack-infra | 11:40 | |
| flip214 | so, it's nothing to do with that specific job, but some general graphite problem? okay, thanks - then I can stop looking. | 11:43 |
| *** salv-orl_ has quit IRC | 11:44 | |
| *** dprince has joined #openstack-infra | 11:44 | |
| *** ddieterly has joined #openstack-infra | 11:45 | |
| *** salv-orlando has joined #openstack-infra | 11:45 | |
| *** stevemar_ has joined #openstack-infra | 11:45 | |
| *** heyongli has quit IRC | 11:46 | |
| *** heyongli has joined #openstack-infra | 11:47 | |
| openstackgerrit | Jean-Emile DARTOIS proposed openstack-infra/project-config: Add watcher-specs https://review.openstack.org/233679 | 11:47 |
| *** stevemar_ has quit IRC | 11:48 | |
| *** lawrancejing has quit IRC | 11:49 | |
| *** ddieterly has quit IRC | 11:49 | |
| *** glauco has joined #openstack-infra | 11:50 | |
| *** dtardivel has joined #openstack-infra | 11:53 | |
| openstackgerrit | Derek Higgins proposed openstack/diskimage-builder: Nothing to see here https://review.openstack.org/139627 | 11:53 |
| *** ParsectiX has joined #openstack-infra | 11:55 | |
| *** heyongli has quit IRC | 11:56 | |
| *** fhubik is now known as fhubik_brb | 11:56 | |
| *** heyongli has joined #openstack-infra | 11:57 | |
| *** fawadkhaliq has quit IRC | 11:58 | |
| *** ParsectiX has quit IRC | 11:58 | |
| *** jordanP has quit IRC | 11:58 | |
| *** jyuso has joined #openstack-infra | 12:00 | |
| *** ildikov has joined #openstack-infra | 12:01 | |
| *** amuller has joined #openstack-infra | 12:02 | |
| *** bdemers has quit IRC | 12:02 | |
| *** jyuso1 has quit IRC | 12:03 | |
| *** rfolco_ has joined #openstack-infra | 12:06 | |
| *** heyongli has quit IRC | 12:06 | |
| *** weihan has quit IRC | 12:07 | |
| *** heyongli has joined #openstack-infra | 12:07 | |
| *** otter768 has quit IRC | 12:07 | |
| *** otter768 has joined #openstack-infra | 12:08 | |
| *** zeih has joined #openstack-infra | 12:08 | |
| *** dtardivel has quit IRC | 12:09 | |
| *** yfried__ has joined #openstack-infra | 12:09 | |
| *** thorst1 has joined #openstack-infra | 12:09 | |
| *** mrmartin has joined #openstack-infra | 12:10 | |
| *** yfried_ has quit IRC | 12:10 | |
| *** trown|outttypeww is now known as trown | 12:13 | |
| *** Daisy has joined #openstack-infra | 12:13 | |
| *** ParsectiX has joined #openstack-infra | 12:14 | |
| *** heyongli has quit IRC | 12:17 | |
| *** heyongli has joined #openstack-infra | 12:18 | |
| openstackgerrit | Bruno Tavares proposed openstack-infra/zuul: Adds information about metric types. https://review.openstack.org/237523 | 12:18 |
| *** doug-fish has quit IRC | 12:19 | |
| *** doug-fish has joined #openstack-infra | 12:19 | |
| *** yamamoto has joined #openstack-infra | 12:20 | |
| *** doug-fish has quit IRC | 12:21 | |
| *** fhubik_brb is now known as fhubik | 12:21 | |
| *** doug-fish has joined #openstack-infra | 12:21 | |
| shardy | Hi all, can anyone please direct me to the process for creating new stable branches on repos which don't currently have them? | 12:21 |
| shardy | I've found various stable branch content in the docs/wiki but not spotted how that's supposed to work | 12:21 |
| *** aopincar has quit IRC | 12:24 | |
| *** jaypipes has joined #openstack-infra | 12:24 | |
| *** yfried__ has quit IRC | 12:24 | |
| AJaeger | shardy: does this work for you: http://docs.openstack.org/infra/manual/drivers.html#create-proposed-branch | 12:24 |
| *** pradk has joined #openstack-infra | 12:24 | |
| *** burgerk has joined #openstack-infra | 12:25 | |
| AJaeger | dhellman, fungi, I think we need to update the Infra Manual a bit, it still contains proposed branches... http://docs.openstack.org/infra/manual/drivers.html | 12:25 |
| *** dtardivel has joined #openstack-infra | 12:25 | |
| *** otter768 has quit IRC | 12:25 | |
| AJaeger | shardy: as mentioned in that document, you can do this in webui - can't you? | 12:25 |
| shardy | AJaeger: Thanks! I think I looked at that, but I lack the superpowers to create the branch in gerrit I think | 12:26 |
| * shardy checks again | 12:26 | |
| AJaeger | shardy: which repo? | 12:26 |
| *** otter768 has joined #openstack-infra | 12:26 | |
| *** dguitarbite has quit IRC | 12:26 | |
| shardy | AJaeger: Several TripleO repos, ref https://review.openstack.org/#/c/221811/ | 12:26 |
| *** hashar has quit IRC | 12:26 | |
| *** nadya has joined #openstack-infra | 12:27 | |
| shardy | AJaeger: I'm tripleo core, but I was assuming this required interaction with the release manager, or other infra process | 12:27 |
| *** heyongli has quit IRC | 12:27 | |
| AJaeger | shardy: correct, looking at https://review.openstack.org/#/admin/projects/openstack/tripleo-common,access there's no branch creation setup | 12:27 |
| *** hashar has joined #openstack-infra | 12:27 | |
| shardy | https://review.openstack.org/#/admin/projects/openstack/tripleo-heat-templates,branches | 12:27 |
| shardy | Yeah, same there, it's just a read-only view of the current master | 12:27 |
| *** heyongli has joined #openstack-infra | 12:28 | |
| AJaeger | shardy: http://docs.openstack.org/infra/manual/creators.html#creating-of-branches explains the needed permissions | 12:28 |
| *** jordanP has joined #openstack-infra | 12:28 | |
| AJaeger | you miss a "create" line | 12:28 |
| *** yamamoto has quit IRC | 12:29 | |
| *** amotoki has joined #openstack-infra | 12:29 | |
| AJaeger | shardy: do you want to tag releases from those branches as well? | 12:29 |
| shardy | AJaeger: aha, so it's a project-config thing, I see, thanks! | 12:29 |
| *** rossella_s has quit IRC | 12:30 | |
| shardy | AJaeger: not sure, that's not part of the current proposal, we're initially just planning to cut a new branch per openstack release | 12:30 |
| shardy | so we can support deploying e.g stable/liberty of all other projects | 12:30 |
| AJaeger | shardy: yes, send a patch to project-config for these files, we review, approve, you will get added manually to the release group and then have the superpowers to use and delegate ;) | 12:30 |
| AJaeger | shardy: so, just add the create line for the repos... | 12:30 |
| shardy | AJaeger: Great, thanks for the explanation, will do! :) | 12:31 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: Expose extras information in requirements https://review.openstack.org/237544 | 12:31 |
| SamYaple | can someone point me to some documentation about how i get the proposal bot to start proposing things for a project? | 12:31 |
| AJaeger | SamYaple: all documented in the Infra Manual... | 12:32 |
| AJaeger | http://docs.openstack.org/infra/manual/creators.html explains the setup | 12:32 |
| AJaeger | SamYaple: wait, sorry. | 12:32 |
| *** edmondsw has joined #openstack-infra | 12:32 | |
| AJaeger | I misparsed your line. What do you want to propose? | 12:32 |
| *** e0ne has joined #openstack-infra | 12:33 | |
| SamYaple | AJaeger: currently the openstack proposal bot does not propose changes to the Kolla project, I want to make it do that thing | 12:34 |
| AJaeger | SamYaple: Proposal bots are documented basically only in source ;) | 12:34 |
| AJaeger | SamYaple: REquirements changes? | 12:34 |
| SamYaple | yup | 12:34 |
| *** markvoelker_ has joined #openstack-infra | 12:35 | |
| AJaeger | SamYaple: That's done via the requirements repo, add your project to projects.txt and run the check-requirements changes as well on kolla. See also http://docs.openstack.org/developer/requirements/ | 12:35 |
| AJaeger | project-config needs updating for the check-requirements change | 12:35 |
| SamYaple | AJaeger: awesome! thats what i needed to know | 12:35 |
| *** heyongli has quit IRC | 12:37 | |
| SamYaple | AJaeger: yup that looks like everything. thanks will get patches submitted | 12:37 |
| *** heyongli has joined #openstack-infra | 12:38 | |
| *** sshnaidm has joined #openstack-infra | 12:39 | |
| *** jyuso has quit IRC | 12:39 | |
| SamYaple | AJaeger: do you know the order for these patches? requirements first or project-config? | 12:39 |
| *** amotoki has quit IRC | 12:43 | |
| *** dguitarbite has joined #openstack-infra | 12:43 | |
| openstackgerrit | Sam Yaple proposed openstack-infra/project-config: Add check-requirements for Kolla https://review.openstack.org/237550 | 12:44 |
| openstackgerrit | Sam Yaple proposed openstack/requirements: Add kolla to projects.txt https://review.openstack.org/237551 | 12:44 |
| AJaeger | SamYaple: project-config first | 12:45 |
| SamYaple | cool thanks | 12:45 |
| *** ddieterly has joined #openstack-infra | 12:45 | |
| AJaeger | SamYaple: Let me just comment, no need to change... | 12:46 |
| SamYaple | ok i was just going to drop in a depends-on | 12:46 |
| SamYaple | works for me though | 12:46 |
| *** heyongli has quit IRC | 12:47 | |
| AJaeger | SamYaple: depends-on would be nicer indeed ;) | 12:48 |
| *** annegentle has joined #openstack-infra | 12:48 | |
| *** heyongli has joined #openstack-infra | 12:48 | |
| SamYaple | yea its going to bug me if i dont add it | 12:48 |
| openstackgerrit | Sam Yaple proposed openstack/requirements: Add kolla to projects.txt https://review.openstack.org/237551 | 12:49 |
| *** ddieterly has quit IRC | 12:50 | |
| *** esker has joined #openstack-infra | 12:51 | |
| *** weshay_xchat has joined #openstack-infra | 12:51 | |
| *** esker has quit IRC | 12:52 | |
| *** ddieterly has joined #openstack-infra | 12:52 | |
| *** esker has joined #openstack-infra | 12:52 | |
| *** markvoelker_ has quit IRC | 12:54 | |
| *** doug-fish has quit IRC | 12:54 | |
| SamYaple | AJaeger: I dont see the 'gate-{name}-requirements' added to any of the other projects in projects.yaml | 12:55 |
| *** doug-fish has joined #openstack-infra | 12:55 | |
| *** dramalho has joined #openstack-infra | 12:55 | |
| SamYaple | oh i do see a few | 12:56 |
| AJaeger | SamYaple: Most projects use python-jobs job-group and that includes requirments. You can do that as well or do it as openstack-doc-tools does where it's included | 12:56 |
| SamYaple | ah that makes more sense | 12:56 |
| openstackgerrit | Sam Yaple proposed openstack-infra/project-config: Add check-requirements for Kolla https://review.openstack.org/237550 | 12:58 |
| *** heyongli has quit IRC | 12:58 | |
| SamYaple | thanks for your help | 12:58 |
| *** fhubik is now known as fhubik_brb | 12:58 | |
| *** yamamoto has joined #openstack-infra | 12:58 | |
| *** fawadkhaliq has joined #openstack-infra | 12:59 | |
| *** heyongli has joined #openstack-infra | 12:59 | |
| *** doug-fish has quit IRC | 13:00 | |
| *** ddieterly has quit IRC | 13:01 | |
| *** sshnaidm has quit IRC | 13:01 | |
| *** derekh is now known as derekh_afk | 13:01 | |
| *** regXboi has joined #openstack-infra | 13:03 | |
| *** fawadkhaliq has quit IRC | 13:04 | |
| *** mjb has quit IRC | 13:04 | |
| *** Daisy has quit IRC | 13:04 | |
| *** jjohnson2 has joined #openstack-infra | 13:04 | |
| *** heyongli has quit IRC | 13:08 | |
| *** heyongli has joined #openstack-infra | 13:09 | |
| *** jjohnson2 has quit IRC | 13:09 | |
| *** rlandy has joined #openstack-infra | 13:10 | |
| *** yfried__ has joined #openstack-infra | 13:10 | |
| fungi | sdague: i'm looking into it. odd that just some data isn't ending up in graphite but other data is (for example, zuul's job queue and pipeline counts are used to create the graphs on the status page successfully) | 13:13 |
| *** jed56 has quit IRC | 13:13 | |
| *** ParsectiX has quit IRC | 13:13 | |
| *** sshnaidm has joined #openstack-infra | 13:14 | |
| sdague | fungi: I agree that it is odd | 13:14 |
| *** maiteb has quit IRC | 13:14 | |
| fungi | filesystem isn't full, oom killer hasn't fired for a week... i wonder if there was a recent code change in zuul which regressed job stats | 13:15 |
| *** changbl has quit IRC | 13:16 | |
| *** Zhongjun has joined #openstack-infra | 13:16 | |
| *** thorst1 has quit IRC | 13:16 | |
| fungi | that timing could coincide with the zuul restart for our maintenance | 13:17 |
| *** AzherKhan has joined #openstack-infra | 13:17 | |
| *** aukhan has quit IRC | 13:17 | |
| *** sergmelikyan has quit IRC | 13:17 | |
| fungi | most recent patch to zuul was "Adds missing statsd counter increment." which merged on friday | 13:17 |
| *** mjb has joined #openstack-infra | 13:17 | |
| fungi | though it's possible we hadn't restarted zuul since https://review.openstack.org/202867 merged on october 6 | 13:18 |
| *** heyongli has quit IRC | 13:18 | |
| fungi | which brings much more intrusive alterations to job statistics | 13:18 |
| fungi | checking now to see if i can narrow down the window between when restarts happened | 13:19 |
| *** heyongli has joined #openstack-infra | 13:19 | |
| *** alivigni has joined #openstack-infra | 13:19 | |
| *** doug-fish has joined #openstack-infra | 13:20 | |
| *** tlian has joined #openstack-infra | 13:20 | |
| *** BharatK has quit IRC | 13:21 | |
| *** baoli has joined #openstack-infra | 13:21 | |
| *** baoli has quit IRC | 13:21 | |
| *** tiswanso has joined #openstack-infra | 13:23 | |
| fungi | yep, saturday was the first time in a month we've restarted zuul | 13:23 |
| *** nelsnelson has quit IRC | 13:23 | |
| *** BharatK has joined #openstack-infra | 13:24 | |
| fungi | so i suspect 202867 is likely the cause | 13:24 |
| *** baoli has joined #openstack-infra | 13:25 | |
| *** yamamoto has quit IRC | 13:27 | |
| *** baoli_ has joined #openstack-infra | 13:27 | |
| *** ddieterly has joined #openstack-infra | 13:28 | |
| *** heyongli has quit IRC | 13:28 | |
| *** Daisy has joined #openstack-infra | 13:29 | |
| *** heyongli has joined #openstack-infra | 13:29 | |
| *** zeih has quit IRC | 13:30 | |
| *** dims_ has quit IRC | 13:30 | |
| *** baoli has quit IRC | 13:30 | |
| *** dims_ has joined #openstack-infra | 13:30 | |
| *** yfried__ has quit IRC | 13:31 | |
| *** burgerk has quit IRC | 13:31 | |
| *** jsavak has joined #openstack-infra | 13:32 | |
| warpc | Hi, guys. I need help. We use gevent eggs in fuel-ostf. According to the log http://logs.openstack.org/91/237491/1/check/gate-fuel-ostf-python26/612c605/console.html this eggs is failed to install. What can i do to fix it and pass tests? | 13:32 |
| fungi | oh, wait, my math is off by a day | 13:32 |
| *** ParsectiX has joined #openstack-infra | 13:32 | |
| fungi | it looks like this actually started around 05:00 utc sunday, not saturday | 13:32 |
| dims_ | fungi: has anyone poked at "E: Unable to correct problems, you have held broken packages." problems? | 13:33 |
| dims_ | fungi: http://logs.openstack.org/44/237544/1/check/gate-tempest-dsvm-full/140ecc3/logs/devstacklog.txt.gz#_2015-10-20_12_43_44_651 | 13:33 |
| *** mpavone has quit IRC | 13:33 | |
| *** pradk has quit IRC | 13:34 | |
| *** pradk has joined #openstack-infra | 13:34 | |
| *** derekh_afk is now known as derekh | 13:35 | |
| fungi | dims_: http://logs.openstack.org/44/237544/1/check/gate-tempest-dsvm-full/140ecc3/logs/devstacklog.txt.gz#_2015-10-20_12_43_43_283 | 13:35 |
| fungi | dims_: there's the actual error | 13:35 |
| fungi | dims_: bad distro package repo | 13:35 |
| fungi | us.archive.ubuntu.com seems to have a bad sources file for trusty-updates | 13:36 |
| *** zeih has joined #openstack-infra | 13:36 | |
| *** amotoki has joined #openstack-infra | 13:36 | |
| dims_ | fungi: ugh! thanks | 13:37 |
| *** jcoufal has quit IRC | 13:37 | |
| dims_ | fungi: what should we do? guessing recheck will not help | 13:37 |
| *** Piet has quit IRC | 13:38 | |
| *** heyongli has quit IRC | 13:39 | |
| sdague | dims_: it will probably, the mirrors aren't atomic | 13:39 |
| dims_ | sdague: ack thanks | 13:39 |
| sdague | so they are in corrupt states for windows every dya | 13:39 |
| *** jcoufal has joined #openstack-infra | 13:40 | |
| mordred | fungi: wow: http://logs.openstack.org/63/236763/2/gate/gate-shade-dsvm-functional-keystone2/96e5acf/console.html#_2015-10-20_13_05_59_117 | 13:40 |
| *** heyongli has joined #openstack-infra | 13:40 | |
| mordred | fungi: read only filesystem FTW | 13:40 |
| mordred | fungi: clouds \0/ | 13:40 |
| *** yamamoto has joined #openstack-infra | 13:40 | |
| *** abregman has quit IRC | 13:41 | |
| *** amotoki has quit IRC | 13:41 | |
| fungi | indeed | 13:41 |
| fungi | read-only /tmp no less! | 13:42 |
| fungi | that's rather unhelpful | 13:42 |
| sdague | mordred: that's the second weird filesystem issue on rax in a few days | 13:42 |
| *** wenlock has joined #openstack-infra | 13:42 | |
| sdague | I wonder if they are blowing physical disks | 13:42 |
| dims_ | whoa | 13:42 |
| mtreinish | fungi: heh, I like that | 13:43 |
| fungi | if that job also collected syslog i might be able to see why, but i suspect i/o errors caused the kernel to remount the rootfs read-only at some point during the job | 13:43 |
| sdague | fungi: yeh, there were no other logs for that reason | 13:44 |
| *** eharney has quit IRC | 13:44 | |
| fungi | oh... right-oh. jenkins agent barfed before it collected any | 13:44 |
| mrmartin | morgen | 13:45 |
| *** weihan has joined #openstack-infra | 13:47 | |
| sdague | fungi: also, something is wrong with the indexer, where it's merging 2 jobs | 13:48 |
| *** heyongli has quit IRC | 13:49 | |
| *** armax has joined #openstack-infra | 13:49 | |
| fungi | the index generator for os-loganalyze? | 13:50 |
| *** heyongli has joined #openstack-infra | 13:50 | |
| mrmartin | fungi, krotscheck: I've restored the old stackmeat.org from backup, you can check the project catalog here: http://dev.stackmeat.org/catalog | 13:50 |
| fungi | sdague: as for the missing graphite data, i'm noticing that the wait_time value is the only one still reporting data in the per-job pipeline stats | 13:51 |
| *** oomichi has quit IRC | 13:51 | |
| *** thorst1 has joined #openstack-infra | 13:52 | |
| *** AzherKhan has quit IRC | 13:52 | |
| *** rossella_s has joined #openstack-infra | 13:52 | |
| sdague | fungi: no, sorry, the es indexer | 13:52 |
| sdague | let me find you an anomoly | 13:52 |
| fungi | still not convinced it's the wait_time patch that has caused this regression, since i can't explain the ~12-hour delay | 13:52 |
| *** peristeri has quit IRC | 13:53 | |
| mtreinish | fungi: did we ever create the server for health.o.o? I'm not seeing it in puppetboard or anything | 13:53 |
| sdague | fungi: @timestamp:"2015-10-20T12:31:49.956+00:00" | 13:53 |
| fungi | mtreinish: not to my knowledge | 13:53 |
| sdague | fungi: so that entry is accounted against 2 jobs | 13:54 |
| fungi | sdague: seems possible there were two jobs with log lines with the same timestamp, but i'm unsure what behavior you're expecting | 13:55 |
| sdague | fungi: look at the *single* line returned by that | 13:55 |
| sdague | there is one line returned | 13:55 |
| sdague | with 2 masters | 13:55 |
| fungi | lemme see if this netbook will load kibana without falling over | 13:55 |
| *** fawadkhaliq has joined #openstack-infra | 13:56 | |
| fungi | graphite just about oom'd the browser a moment ago | 13:57 |
| mtreinish | sdague: http://logstash.openstack.org/#dashboard/file/logstash.json?query=_id:YA4MnFMoT5OaKLZIKJHAdA is a query to show exactly what you're looking at | 13:57 |
| *** dramalho has quit IRC | 13:57 | |
| sdague | mtreinish: nope | 13:58 |
| mtreinish | it has 2 sets of metadata on one document | 13:58 |
| sdague | I think _id relies on the writable indexes | 13:58 |
| sdague | which we don't have | 13:58 |
| mtreinish | you might have to bump the date range, it looks | 13:58 |
| mtreinish | like clarkb's share patch doesnt copy that bit to the url | 13:59 |
| *** mestery has joined #openstack-infra | 13:59 | |
| sdague | oh, yeh, have to bump that | 13:59 |
| *** heyongli has quit IRC | 13:59 | |
| sdague | yeh, it's kind of unfortunate that we can't come up with a better share model here, because timerange keeps getting reset | 13:59 |
| sdague | and all the perspectives that you can build can't be shared | 14:00 |
| *** Daisy has quit IRC | 14:00 | |
| *** heyongli has joined #openstack-infra | 14:00 | |
| *** Daisy has joined #openstack-infra | 14:00 | |
| fungi | sounds like you figured it out while i'm still waiting for this browser to stop being unresponsive | 14:01 |
| mtreinish | sdague: it should be doable, I think we just overlooked it on the hotpatch to fix the share button | 14:01 |
| *** trown is now known as trown|mtg | 14:02 | |
| *** aukhan has joined #openstack-infra | 14:02 | |
| mtreinish | sdague: https://review.openstack.org/#/c/236070/ | 14:02 |
| sdague | fungi: well, we know what's wrong | 14:02 |
| *** doug-fish has quit IRC | 14:02 | |
| sdague | but why is really unclear | 14:02 |
| sdague | why do we smash in someone else's metadata to the document | 14:02 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: make intermediary.sh support stable branches https://review.openstack.org/237595 | 14:03 |
| *** Piet has joined #openstack-infra | 14:03 | |
| *** alexpilotti has quit IRC | 14:04 | |
| *** dramalho has joined #openstack-infra | 14:04 | |
| *** Daisy has quit IRC | 14:04 | |
| *** hdd has joined #openstack-infra | 14:05 | |
| warpc | Hi! If some of eggs won't install during testing in case of gate-X-py27, what can i do to fix it? | 14:06 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: make intermediary.sh support stable branches https://review.openstack.org/237595 | 14:06 |
| *** hashar has quit IRC | 14:07 | |
| *** fawadkhaliq has quit IRC | 14:07 | |
| *** ParsectiX has quit IRC | 14:08 | |
| fungi | sdague: hrm, got that query loaded and i see four log lines with that timestamp. doesn't seem unusual to me but i probably have no clue what i'm looking for | 14:08 |
| *** aukhan has quit IRC | 14:08 | |
| *** annegentle has quit IRC | 14:08 | |
| *** burgerk has joined #openstack-infra | 14:08 | |
| mtreinish | fungi: look at the document with the id from the link I posted | 14:08 |
| *** nelsnelson has joined #openstack-infra | 14:08 | |
| *** aukhan has joined #openstack-infra | 14:08 | |
| mtreinish | there are 2 sets of metadata associated with it | 14:08 |
| openstackgerrit | Steven Hardy proposed openstack-infra/project-config: Enable stable branches for tripleo repositories https://review.openstack.org/237597 | 14:09 |
| sdague | fungi: the line that starts with 'set +o xtrace' | 14:09 |
| *** burgerk_ has joined #openstack-infra | 14:09 | |
| sdague | it's 2nd in my list of the 4 | 14:09 |
| *** hashar has joined #openstack-infra | 14:09 | |
| *** heyongli has quit IRC | 14:09 | |
| fungi | looks like i have to change the default query range when following links like that | 14:10 |
| sdague | fungi: ye | 14:10 |
| *** heyongli has joined #openstack-infra | 14:10 | |
| fungi | yeah, mtreinish's link gets me just one log line with a set +o xtrace interleaved with an authentication failure | 14:11 |
| mtreinish | hmm, adding a &from= to the query links is hanging firefox for me | 14:11 |
| mtreinish | that might be a problem... | 14:11 |
| sdague | fungi: right, so look at the metadata on that doc | 14:11 |
| sdague | another way to make these things pop is: | 14:11 |
| sdague | build_status:SUCCESS AND build_status:FAILURE | 14:11 |
| *** tonytan4ever has joined #openstack-infra | 14:12 | |
| fungi | oh, and it has two different log urls? | 14:12 |
| sdague | yes | 14:12 |
| sdague | it has 2 different everything | 14:12 |
| sdague | 2 different build_names | 14:12 |
| *** glauco___ has joined #openstack-infra | 14:12 | |
| sdague | even 2 different build_status | 14:12 |
| *** burgerk has quit IRC | 14:13 | |
| fungi | got it. yep this looks strange. i wonder if it's happening on indexing or retrieval | 14:13 |
| sdague | build_status:SUCCESS AND build_status:FAILURE is honestly the best way to see how big the problem is | 14:13 |
| fungi | could this be a hash collision? | 14:14 |
| sdague | build_status:SUCCESS AND build_status:FAILURE (26822) count per 1h | (26822 hits) | 14:14 |
| sdague | fungi: don't know | 14:14 |
| *** glauco has quit IRC | 14:15 | |
| fungi | yeah, i'm not familiar enough with es internals to know how the correlation for the index is maintained | 14:15 |
| sdague | if I had to guess, I'd say it's a race on indexing | 14:15 |
| *** eharney has joined #openstack-infra | 14:15 | |
| sdague | that doc id is allocated some how | 14:15 |
| sdague | and there is time between that and add for metadata | 14:16 |
| *** zhenguo has joined #openstack-infra | 14:16 | |
| sdague | I tripped over this a couple of weeks ago when trying to build the "what will fail in M-1" devstack list | 14:16 |
| sdague | and put up a link in channel for that oddity | 14:16 |
| *** ajmiller has joined #openstack-infra | 14:16 | |
| sdague | but just hit it again randomly searching for things | 14:16 |
| fungi | the the filename and timestamp are common between those two lines, but so is the id | 14:16 |
| *** stevemar_ has joined #openstack-infra | 14:16 | |
| *** aukhan has quit IRC | 14:17 | |
| *** ayoung has quit IRC | 14:17 | |
| sdague | they do seem to always have the "multiline" tag | 14:17 |
| sdague | so it may be a grok parser issue | 14:18 |
| *** aukhan has joined #openstack-infra | 14:18 | |
| fungi | so wondering whether two entries happened to get identical ids though sheer chance, or as you suggest some race caused one id to get assigned to two lines | 14:18 |
| sdague | anyway, we probably need clarkb involved to figure it out further | 14:18 |
| fungi | yep, but agreed it's strange | 14:18 |
| sdague | anyway, back to graphite :) | 14:19 |
| sdague | because zuul not reporting to graphite is kind of hard to figure out what's up with jobs | 14:19 |
| *** heyongli has quit IRC | 14:20 | |
| *** stevemar_ has quit IRC | 14:20 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:20 | |
| fungi | warpc: no idea. looks like gevent is not successfully compiling. there's a lot of gcc spew in there you can hopefully search on | 14:20 |
| *** heyongli has joined #openstack-infra | 14:21 | |
| fungi | sdague: agreed. i'm still at a loss to explain why the wait_time value hasn't stopped being reported even though the others have, but the reporting seems to have stopped 12 hours after we restarted zuul, not when we restarted zuul | 14:21 |
| sdague | fungi: oh, are you looking at my graphs? | 14:22 |
| sdague | those have a 12 hr rolling average | 14:22 |
| fungi | sdague: ohhh | 14:22 |
| sdague | so 12 hr delay would be expected | 14:22 |
| fungi | i'll see if i can narrow it down with direct graphite queries in that case | 14:23 |
| warpc | fungi: thank you for answer. As i know, such error can be fixed if libevent-dev will present in the system. Can i somehow install it on test env? | 14:23 |
| sdague | fungi: that would point directly to the restart time | 14:23 |
| sdague | because that's when we'd loose data | 14:23 |
| fungi | sdague: in that case we likely do have a regression introduced by the wait_time stats implementation | 14:24 |
| sdague | so 12 hrs later we'd finally have nothing in the window and it would go blank | 14:24 |
| fungi | timrc: ^ | 14:24 |
| fungi | i need to step away for just a few minutes, but will continue looking at this shortly | 14:24 |
| *** hdd has quit IRC | 14:24 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Destroy previous test env VM's earlier https://review.openstack.org/230129 | 14:26 |
| *** weshay_xchat is now known as weshay | 14:28 | |
| *** aukhan has quit IRC | 14:30 | |
| *** heyongli has quit IRC | 14:30 | |
| *** heyongli has joined #openstack-infra | 14:31 | |
| *** mohankumar has quit IRC | 14:31 | |
| *** mohankumar has joined #openstack-infra | 14:33 | |
| *** jsavak has quit IRC | 14:33 | |
| *** zeih has quit IRC | 14:33 | |
| openstackgerrit | Marios Andreou proposed openstack-infra/irc-meetings: Update tripleo meeting to weekly https://review.openstack.org/237609 | 14:33 |
| *** jsavak has joined #openstack-infra | 14:34 | |
| openstackgerrit | Merged openstack-infra/grafyaml: Update pypi metadata to reference -infra https://review.openstack.org/231589 | 14:36 |
| *** Daisy has joined #openstack-infra | 14:36 | |
| *** MarkAtwood has joined #openstack-infra | 14:37 | |
| *** aukhan has joined #openstack-infra | 14:37 | |
| *** AJaeger has quit IRC | 14:38 | |
| *** heyongli has quit IRC | 14:40 | |
| openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Create fuel-menu project https://review.openstack.org/235177 | 14:40 |
| *** aukhan has quit IRC | 14:40 | |
| *** aukhan has joined #openstack-infra | 14:41 | |
| *** heyongli has joined #openstack-infra | 14:41 | |
| *** angdraug has joined #openstack-infra | 14:42 | |
| *** bradjones has joined #openstack-infra | 14:42 | |
| *** bradjones has quit IRC | 14:42 | |
| *** bradjones has joined #openstack-infra | 14:42 | |
| *** EricGonczer_ has joined #openstack-infra | 14:44 | |
| paboldin | Hello channel. I'm here to complain about logs.openstack.org giving out css files with a 'x-asm' content type. This breaks things like this: http://logs.openstack.org/23/231423/6/check/rally-coverage/8eb0ab1/cover/ | 14:45 |
| *** EricGonc_ has joined #openstack-infra | 14:46 | |
| *** BharatK has quit IRC | 14:47 | |
| *** aukhan has quit IRC | 14:48 | |
| *** aukhan has joined #openstack-infra | 14:49 | |
| pabelanger | fungi: have some time to help troubleshoot grafana.o.o again? | 14:49 |
| *** EricGonczer_ has quit IRC | 14:49 | |
| *** heyongli has quit IRC | 14:50 | |
| pabelanger | fungi: trying to see if syslog reported a puppet error | 14:51 |
| *** heyongli has joined #openstack-infra | 14:51 | |
| *** pauloewerton has joined #openstack-infra | 14:52 | |
| *** sabeen1 has joined #openstack-infra | 14:54 | |
| *** dtardivel_ has joined #openstack-infra | 14:54 | |
| fungi | warpc: would need to add it to http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/jenkins_params.pp | 14:55 |
| fungi | warpc: and http://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/thick_slave.pp | 14:55 |
| fungi | warpc: and also http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/data/bindep-fallback.txt | 14:55 |
| fungi | warpc: and then the next time worker images are generated, new nodes will boot with it preinstalled | 14:55 |
| *** esker has quit IRC | 14:55 | |
| openstackgerrit | Cyril Roelandt proposed openstack-infra/project-config: Add a gate-dsvm-functional-py34 job to Neutron https://review.openstack.org/233177 | 14:56 |
| *** boris-42 has joined #openstack-infra | 14:56 | |
| fungi | pabelanger: in a bit. about to get on a conference call and still looking into zuul's recent stats reporting regression | 14:56 |
| *** jsavak has quit IRC | 14:58 | |
| *** tiswanso has quit IRC | 14:58 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: Expose extras information in requirements https://review.openstack.org/237544 | 14:59 |
| *** sergmelikyan has joined #openstack-infra | 14:59 | |
| *** jsavak has joined #openstack-infra | 14:59 | |
| *** sabeen3 has joined #openstack-infra | 14:59 | |
| *** tiswanso has joined #openstack-infra | 14:59 | |
| *** e0ne has quit IRC | 15:00 | |
| *** trown|mtg is now known as trown | 15:00 | |
| *** heyongli has quit IRC | 15:01 | |
| *** sabeen1 has quit IRC | 15:01 | |
| *** hdd has joined #openstack-infra | 15:01 | |
| *** mrc3 has joined #openstack-infra | 15:01 | |
| *** fhubik_brb is now known as fhubik | 15:02 | |
| *** heyongli has joined #openstack-infra | 15:02 | |
| kozhukalov_ | clarkb, fungi, anteaya, SergeyLukjanov, other, could you guys please review? https://review.openstack.org/#/c/235177 | 15:02 |
| *** e0ne has joined #openstack-infra | 15:02 | |
| *** links has quit IRC | 15:02 | |
| *** yamamoto has quit IRC | 15:04 | |
| openstackgerrit | Merged openstack-infra/shade: Rely on devstack for clouds.yaml https://review.openstack.org/236763 | 15:04 |
| *** annegentle has joined #openstack-infra | 15:06 | |
| *** ujuc has joined #openstack-infra | 15:06 | |
| *** acabot has joined #openstack-infra | 15:06 | |
| *** doug-fish has joined #openstack-infra | 15:06 | |
| pauloewerton | hi all. is there any way to recheck a patch against a specific gate bug? I keep hitting the same bug but elastic-recheck does not seem to detect it no matter how many recheck comments I leave in my patch =\ | 15:07 |
| *** fhubik is now known as fhubik_brb | 15:08 | |
| mwhahaha | hey openstack-infra folks, where are the rules for gate jobs & their voting settings documented? | 15:08 |
| *** mahatic has joined #openstack-infra | 15:09 | |
| *** ashleighfarnham has joined #openstack-infra | 15:10 | |
| *** jlvillal has quit IRC | 15:11 | |
| *** heyongli has quit IRC | 15:11 | |
| *** ashleighfarnham has quit IRC | 15:11 | |
| *** Ala has quit IRC | 15:11 | |
| *** dramalho has quit IRC | 15:12 | |
| *** heyongli has joined #openstack-infra | 15:12 | |
| fungi | pauloewerton: if the bug isn't listed at http://status.openstack.org/elastic-recheck/ then follow the instructions on that page to add it to the queries list | 15:12 |
| fungi | mwhahaha: can you be more specific as to what you mean by "rules"? (procedural? social?) | 15:13 |
| *** abregman has joined #openstack-infra | 15:13 | |
| pauloewerton | fungi, it is listed there already http://status.openstack.org/elastic-recheck/#1491646 | 15:13 |
| *** k4n0 has quit IRC | 15:14 | |
| mwhahaha | well, people keep referring to "please don't add non-voting jobs to the gate" (https://review.openstack.org/#/c/235550/) trying to figure out what best practice is | 15:14 |
| *** nmagnezi has quit IRC | 15:14 | |
| *** abregman has quit IRC | 15:14 | |
| *** yfried__ has joined #openstack-infra | 15:15 | |
| *** changbl has joined #openstack-infra | 15:15 | |
| *** yamamoto has joined #openstack-infra | 15:16 | |
| mwhahaha | and if it's documented somewhere so i could understand what is ok and what isn't. if you look at what is in the code, there's a whole bunch of non-voting items so i'm not sure what is right | 15:16 |
| *** jlvillal has joined #openstack-infra | 15:17 | |
| fungi | mwhahaha: that convention is probably not currently documented, but rather mostly tribal knowledge: just about nobody looks at gate pipeline jobs which are non-voting because they don't report until the change merges, and some qa data analysis relies on assuming failures in the gate pipeline are impactful | 15:17 |
| *** salv-orlando has quit IRC | 15:18 | |
| *** rossella_s has quit IRC | 15:18 | |
| *** xyang1 has joined #openstack-infra | 15:20 | |
| pabelanger | fungi: Ya, cannot figure out why the Exec is not logging in puppetdb for grafana.o.o. This works locally for what ever reason | 15:21 |
| mwhahaha | fungi: thanks | 15:21 |
| fungi | mwhahaha: also don't combine other check or gate pipeline jobs with the noop-jobs template (that's another one we likely should document somewhere) | 15:21 |
| *** heyongli has quit IRC | 15:21 | |
| mwhahaha | ok i'll try and figure something out | 15:21 |
| *** sergmelikyan has quit IRC | 15:22 | |
| *** heyongli has joined #openstack-infra | 15:22 | |
| *** denisra has joined #openstack-infra | 15:23 | |
| warpc | fungi: thank you! | 15:24 |
| fungi | pauloewerton: it looks like at least some hits for that bug have been recorded recently, and the logstash job queue doesn't seem to be high... which change did you hit it on recently? maybe the query is too strict | 15:25 |
| *** mrmartin has quit IRC | 15:26 | |
| *** bpokorny has joined #openstack-infra | 15:26 | |
| *** rlandy has quit IRC | 15:27 | |
| *** Zhongjun has quit IRC | 15:27 | |
| *** rlandy has joined #openstack-infra | 15:28 | |
| *** mrmartin has joined #openstack-infra | 15:28 | |
| *** juggler has joined #openstack-infra | 15:29 | |
| *** bpokorny has quit IRC | 15:29 | |
| *** Ramanjaneya has quit IRC | 15:29 | |
| glauco___ | Hey, did anybody else noticed that some pages just vanished from the project | 15:29 |
| *** bpokorny has joined #openstack-infra | 15:29 | |
| glauco___ | I can't find job detail page | 15:29 |
| *** mohankumar has quit IRC | 15:29 | |
| glauco___ | sorry, wrong window! :) | 15:30 |
| clarkb | fungi: pauloewerton: usually the way I like to debug that is find the specific run you expected to fail in logstash using the build_short_uuid:"someuuidhere" and go from there | 15:30 |
| fungi | clarkb: did you see earlier discussion on the merged log line in ls/es from two separate jobs? | 15:31 |
| clarkb | fungi: no, but it does that when we confuse the line merging | 15:31 |
| *** heyongli has quit IRC | 15:31 | |
| clarkb | fungi: its one of those things that happens in .01% or less of events so tracking down is hard | 15:31 |
| fungi | clarkb: recent example is id:YA4MnFMoT5OaKLZIKJHAdA | 15:32 |
| *** heyongli has joined #openstack-infra | 15:32 | |
| clarkb | its a known issue and has been there for years | 15:33 |
| *** dims__ has joined #openstack-infra | 15:33 | |
| clarkb | is there a specific reason it has come up today? | 15:33 |
| fungi | seems that the filename and timestamp are identical but everthing else (aside from id) is not | 15:33 |
| fungi | i think it must be rare enough it keeps taking people by surprise | 15:33 |
| sdague | clarkb: mostly, I've started hitting it more failure analysis stuff | 15:33 |
| *** aukhan has quit IRC | 15:34 | |
| sdague | which kind of makes the results suspect | 15:34 |
| sdague | when you say "this job will break" except, it won't, because it's randomly munged into an unrelated job | 15:34 |
| *** wenlock has quit IRC | 15:34 | |
| *** rhe00 has joined #openstack-infra | 15:34 | |
| clarkb | sdague: the filters are published and you know where the two pieces of data originated from. Anyone can debug that | 15:35 |
| sdague | anyway, more of a back burner concern, but it would be good to get to the bottom of if we could, because it does mud up the data | 15:35 |
| *** sridhar_ram has joined #openstack-infra | 15:35 | |
| clarkb | it has been a low enough incidence and the multiline munging is naive enough that it has not been a priority for me | 15:35 |
| clarkb | if we want to properly fix it we would switch to json or some other form of structured logging everywhere | 15:35 |
| *** dims_ has quit IRC | 15:36 | |
| fungi | i do find it interesting that the filename is the same for both. makes me wonder if that matches in other occurrences as well | 15:36 |
| fungi | or if it was just random chance | 15:36 |
| *** wenlock has joined #openstack-infra | 15:36 | |
| openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Create network-checker project https://review.openstack.org/235822 | 15:36 |
| *** hichihara has quit IRC | 15:37 | |
| clarkb | fungi: it shouldn't be random. logstash looks at one line at a time and checks if the event is complete or if it needs to inspect the next line | 15:37 |
| *** weshay is now known as weshay_mtg | 15:37 | |
| sdague | clarkb: so why does it roll across jobs? I guess that's the big that's confusing to me | 15:37 |
| *** aukhan has joined #openstack-infra | 15:37 | |
| clarkb | fungi: then when it decides the line is complete it sends it through. so in these cases something is making logstash decide to hold the current event as incomplete and look at the next one | 15:38 |
| *** amotoki has joined #openstack-infra | 15:38 | |
| clarkb | sdague: because we shove multiple streams of data through at a time | 15:38 |
| fungi | i see, and events are interleaved from multiple jobs | 15:38 |
| clarkb | yes identified by what should be a unique string (the source location) | 15:38 |
| clarkb | I thinkt he source is also recordred in the event data | 15:38 |
| sdague | oh, I think this is because of ansible | 15:38 |
| sdague | why it started cropping up a lot more | 15:39 |
| sdague | because these logs - http://logs.openstack.org/07/237607/1/check/gate-aodh-dsvm-functional-mysql/6c6af22/logs/devstack-gate-cleanup-host.txt | 15:39 |
| sdague | which get scanned for "are we done" start with a line with no datestamp | 15:39 |
| clarkb | ya "host" is the source key, its an ip:port combo identifying the tcp connection the file was streamed from | 15:40 |
| openstackgerrit | Alex Schultz proposed openstack-infra/project-config: Add puppet jobs to fuel-library https://review.openstack.org/235550 | 15:40 |
| *** shardy_ has joined #openstack-infra | 15:41 | |
| fungi | clarkb: in unrelated news, the bug 1348954 fix is getting a do-over http://packages.ubuntu.com/trusty-updates/python3.4 (appearing there a few hours ago now) | 15:41 |
| openstack | bug 1348954 in python3-defaults (Ubuntu) "update Python3 for trusty" [Undecided,Confirmed] https://launchpad.net/bugs/1348954 | 15:41 |
| *** fhubik_brb is now known as fhubik | 15:41 | |
| fungi | maybe it'll stick this time | 15:41 |
| clarkb | we can hope | 15:41 |
| clarkb | though at this rate upgrading to 16.04 might be quicker | 15:41 |
| fungi | it's taken them until almost 16.04 lts to fix this regression in 14.04 lts | 15:41 |
| fungi | heh, yep, what i was just thinking | 15:42 |
| *** heyongli has quit IRC | 15:42 | |
| *** shardy has quit IRC | 15:42 | |
| *** MarkAtwood has quit IRC | 15:42 | |
| *** heyongli has joined #openstack-infra | 15:43 | |
| *** bexelbie has quit IRC | 15:43 | |
| *** stevemar_ has joined #openstack-infra | 15:43 | |
| pabelanger | yolanda: timrc: mind the review? https://review.openstack.org/#/c/237373/ | 15:44 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: add support for ZUUL_CACHE_DIR https://review.openstack.org/237645 | 15:44 |
| *** ldnunes has quit IRC | 15:44 | |
| pabelanger | that fixes 2 issue. Bouncing test cases, and rotating md5hash | 15:44 |
| pabelanger | which is causing an issue with grafana.o.o | 15:44 |
| *** ldnunes has joined #openstack-infra | 15:46 | |
| *** shardy_ has quit IRC | 15:46 | |
| *** ddieterl_ has joined #openstack-infra | 15:46 | |
| *** ZZelle has quit IRC | 15:46 | |
| *** shardy has joined #openstack-infra | 15:47 | |
| *** dtantsur is now known as dtantsur|afk | 15:48 | |
| *** Piet has quit IRC | 15:48 | |
| *** ddieterly has quit IRC | 15:49 | |
| *** annegentle has quit IRC | 15:50 | |
| *** amuller is now known as amuller_afk | 15:51 | |
| krotscheck | mrmartin: stackmeat. Nice. | 15:51 |
| *** amotoki has quit IRC | 15:51 | |
| krotscheck | mrmartin: Huhn. | 15:52 |
| *** heyongli has quit IRC | 15:52 | |
| krotscheck | mrmartin: That's actually rather nice | 15:52 |
| *** rlandy has quit IRC | 15:52 | |
| sdague | clarkb: yeh, so this is clearly mostly related to ansible. Any idea if we can change that ansible line 1 to have a timestamp? | 15:52 |
| *** jcoufal_ has joined #openstack-infra | 15:52 | |
| *** fawadkhaliq has joined #openstack-infra | 15:53 | |
| *** heyongli has joined #openstack-infra | 15:53 | |
| fungi | timrc: if you're around yet, trying to figure out what about the wait_time implementation caused job result stats to stop getting sent | 15:53 |
| *** flepied has joined #openstack-infra | 15:53 | |
| fungi | timrc: http://graphite.openstack.org/render/?width=586&height=308&_salt=1445356331.002&from=00%3A00_20151017&until=23%3A59_20151020&target=stats.zuul.pipeline.check.job.gate-tempest-dsvm-full.FAILURE&target=stats.zuul.pipeline.check.job.gate-tempest-dsvm-full.SUCCESS&target=stats.zuul.pipeline.check.job.gate-tempest-dsvm-full.wait_time | 15:53 |
| *** nadya has quit IRC | 15:54 | |
| fungi | timrc: it's a pretty clear delineation between getting success/failure stats and the zuul restart for saturday's maintenance at which point we started getting only wait_time stats | 15:54 |
| *** rkukura has quit IRC | 15:54 | |
| anteaya | <-- still trying to get home after watching the election tonight, people keep dropping in, hoping to get home in time for the meeting | 15:54 |
| anteaya | s/tonight/last night | 15:55 |
| *** jcoufal has quit IRC | 15:55 | |
| *** gyee has joined #openstack-infra | 15:56 | |
| *** flepied1 has quit IRC | 15:56 | |
| *** yamamoto has quit IRC | 15:56 | |
| *** mahatic_ has joined #openstack-infra | 15:57 | |
| mrmartin | krotscheck: so it is using an apache solr as a backend, and if we like to make the projects searchable, we need to refactor the actual project content to represent the project's yaml file with groups and delivarables. | 15:57 |
| *** mahatic has quit IRC | 15:57 | |
| *** hashar is now known as hasharMeeting | 15:57 | |
| krotscheck | mrmartin: Honestly, I feel like the majority of that can just be done in the browser. Openstack's not _that_ big that fancy search engines are needed. | 15:58 |
| *** fawadkhaliq has quit IRC | 15:58 | |
| mrmartin | and find out how to sync the projects yaml with the solr backend. | 15:58 |
| mrmartin | ok, it was just an idea, i have this project archived somewhere | 15:58 |
| *** ifarkas has quit IRC | 15:59 | |
| mrmartin | a nice angularjs project with a bootstrap theme can solve that problem. | 15:59 |
| *** pradk has quit IRC | 15:59 | |
| clarkb | sdague: I am not sure but can look into it | 15:59 |
| sdague | nothing is popping out to me in the ansible docs | 16:00 |
| pauloewerton | fungi, clarkb, sorry, I was afk. this is the query: https://github.com/openstack-infra/elastic-recheck/blob/master/queries/1491646.yaml | 16:00 |
| fungi | pauloewerton: yep, i know where to find the queries... was wanting an example where that should have matched and didn't | 16:01 |
| pauloewerton | fungi, oh I see | 16:01 |
| *** BharatK has joined #openstack-infra | 16:02 | |
| *** scheuran has quit IRC | 16:02 | |
| *** asmigala has quit IRC | 16:02 | |
| pauloewerton | not sure how to do that though | 16:02 |
| *** jsavak has quit IRC | 16:02 | |
| *** jsavak has joined #openstack-infra | 16:02 | |
| *** heyongli has quit IRC | 16:02 | |
| fungi | pauloewerton: you said you had a change which failed a job because of that bug and elastic-recheck never commented on it. can you please link the change? | 16:02 |
| *** vilobhmm11 has joined #openstack-infra | 16:02 | |
| pauloewerton | first time trying to debug gate failures ;) | 16:02 |
| *** dizquierdo has quit IRC | 16:03 | |
| fungi | no problem. just trying to get sufficient information so i can look at the same failure you are | 16:03 |
| pauloewerton | fungi, sure, here's the patch https://review.openstack.org/#/c/192438/ | 16:03 |
| openstackgerrit | Alex Schultz proposed openstack-infra/project-config: Add puppet jobs to fuel-library https://review.openstack.org/235550 | 16:03 |
| *** heyongli has joined #openstack-infra | 16:03 | |
| clarkb | sdague: jenkins is adding the timestamps not ansible | 16:04 |
| openstackgerrit | Vladimir Sharshov proposed openstack-infra/project-config: Support egg Gevent (http://www.gevent.org/) https://review.openstack.org/237657 | 16:05 |
| *** amotoki has joined #openstack-infra | 16:05 | |
| clarkb | sdague: or are we looking at different parts of the lgo? | 16:06 |
| *** jlanoux has quit IRC | 16:06 | |
| *** yamamoto has joined #openstack-infra | 16:06 | |
| sdague | clarkb: at least one of the wrap issues is the following | 16:07 |
| clarkb | s/jenkins/whateverourwrapperthingis/ | 16:07 |
| sdague | devstack-gate-cleanup-host.txt is being parsed as potentially multiline | 16:07 |
| sdague | so it gets to the end of the file | 16:07 |
| sdague | which is | 16:07 |
| sdague | {datetimestam} set +o xtrace | 16:07 |
| sdague | the first line of a follow on file is a thing without a {datetimestamp} | 16:08 |
| sdague | so it appends that to this document | 16:08 |
| sdague | even though it's from an entirely different run | 16:08 |
| sdague | and then you get merged metadata | 16:09 |
| fungi | pauloewerton: interesting. so if i search the last 6 hours at http://logstash.openstack.org/ for message:".tox/functional/bin/python: can't open file '/usr/local/jenkins/slave_scripts/subunit2html.py': [Errno 2] No such file or directory" AND tags:"console" | 16:09 |
| fungi | pauloewerton: i do see your run as the only match | 16:09 |
| *** woodster_ has joined #openstack-infra | 16:09 | |
| fungi | pauloewerton: it's possible something happened to elastic-recheck that caused it to not find this or timeout waiting for the resulty | 16:10 |
| *** rlandy has joined #openstack-infra | 16:10 | |
| fungi | i'm checking its logs next | 16:10 |
| sdague | clarkb: http://logstash.openstack.org/#/dashboard/file/logstash.json?query=_id:AH13fgoeQnqMh-7rzSxsfQ as an instance | 16:10 |
| *** zz_dimtruck is now known as dimtruck | 16:10 | |
| *** flepied has quit IRC | 16:11 | |
| pauloewerton | fungi, ok, thanks | 16:12 |
| openstackgerrit | Vladimir Sharshov proposed openstack-infra/system-config: Support egg Gevent (http://www.gevent.org/) https://review.openstack.org/237660 | 16:12 |
| clarkb | I see its the localhost | success | rc = 0 leading line iwthout a timestamp causing problems | 16:12 |
| *** heyongli has quit IRC | 16:12 | |
| *** BharatK has quit IRC | 16:13 | |
| sdague | clarkb: right | 16:13 |
| *** unicell has joined #openstack-infra | 16:13 | |
| clarkb | and thats a layer above the timestamp wrapping | 16:13 |
| sdague | yeh | 16:13 |
| *** heyongli has joined #openstack-infra | 16:13 | |
| zaro | morning | 16:13 |
| *** unicell1 has quit IRC | 16:14 | |
| sdague | so, there might be other collisions as well, but this is definitely one of the bigger ones, and might be why it popped to my radar more recently | 16:14 |
| anteaya | morning zaro | 16:14 |
| *** flepied has joined #openstack-infra | 16:14 | |
| sdague | so, I don't know if there is anyway to say "build_uuid is different, stop" | 16:14 |
| sdague | but conceptually that's what we'd want | 16:14 |
| clarkb | sdague: no thats the problem | 16:15 |
| zaro | wow! gerrit test migration took all night and still didn't finish. | 16:15 |
| clarkb | logstash is naive there is no way to inject a stop | 16:15 |
| anteaya | zaro: :( | 16:15 |
| warpc | fungi: Please have a look if you have time: https://review.openstack.org/#/c/237657/ and https://review.openstack.org/#/c/237660/ Thank you! | 16:15 |
| clarkb | sdague: one alternative would be to always write an event that would force a flush | 16:15 |
| *** aukhan has quit IRC | 16:15 | |
| anteaya | zaro: where do you feel we are to start discussing timing an upgrade? | 16:15 |
| clarkb | but then we are modifying the logs to work around a logstash derp | 16:15 |
| clarkb | which isn't really better imo | 16:15 |
| anteaya | zaro: do you feel we need to continue to test 2.11 before we can set a time? | 16:15 |
| *** aukhan has joined #openstack-infra | 16:15 | |
| sdague | clarkb: yeh | 16:15 |
| sdague | so, honestly, I suspect we won't end up doing structured logs until we're on 16.04 with journalctl | 16:16 |
| zaro | anteaya: yes, i was testing on my laptop which was probably cpu limited | 16:16 |
| anteaya | zaro: ah okay | 16:16 |
| * anteaya references https://etherpad.openstack.org/p/test-gerrit-2.11 | 16:16 | |
| zaro | planning to test on beefy VM next | 16:17 |
| anteaya | zaro: sounds good | 16:17 |
| anteaya | zaro: so you want to ensure that works first before we start talking about timeing for an upgrade? | 16:17 |
| *** krtaylor has quit IRC | 16:17 | |
| aspiers | is anyone around who could add me to these two -core and -release groups on gerrit? https://review.openstack.org/#/admin/projects/openstack/openstack-resource-agents,access | 16:17 |
| sdague | clarkb: I suppose we could build an output filter which dumps the ansible reporting line, we did that for devstack | 16:17 |
| *** shashank_hegde has joined #openstack-infra | 16:17 | |
| zaro | yes, just testing that it works. but would be nice to get an estimate on the migration as well. | 16:17 |
| clarkb | sdague: https://github.com/ansible/ansible/issues/2454 looks like ansible isn't interested in fixing this | 16:18 |
| anteaya | zaro: yes, well I think the estimate would include your thoughts | 16:18 |
| *** david-lyle has quit IRC | 16:18 | |
| clarkb | sdague: ya that was going to be my next suggestion, but the return code info is useful | 16:18 |
| anteaya | zaro: do you think we are ready to upgrade? | 16:18 |
| *** flepied has quit IRC | 16:18 | |
| clarkb | sdague: maybe we can get it to not multiline and get an injected timestamp to at least preserve that info | 16:18 |
| anteaya | zaro: are you confident in 2.11? | 16:18 |
| *** david-lyle has joined #openstack-infra | 16:18 | |
| clarkb | sdague: something like word | word | rc=digit is special | 16:19 |
| *** dizquierdo has joined #openstack-infra | 16:19 | |
| *** dstanek has quit IRC | 16:19 | |
| sdague | clarkb: yeh, it sort of sucks to have to build such a filter, but it could be a thing | 16:20 |
| *** salv-orlando has joined #openstack-infra | 16:20 | |
| *** ashleighfarnham has joined #openstack-infra | 16:21 | |
| zaro | anteaya: not done testing yet, i think a few more things to test: gerritlib, zuul pipelines, manage projects and migration. | 16:22 |
| *** dstanek has joined #openstack-infra | 16:22 | |
| anteaya | zaro: and that is all on the etherpad? https://etherpad.openstack.org/p/test-gerrit-2.11 | 16:22 |
| zaro | also we might need some sort of rollback script. might need mordred help to do that. | 16:22 |
| *** aukhan has quit IRC | 16:22 | |
| zaro | yes, it's on there. | 16:23 |
| *** heyongli has quit IRC | 16:23 | |
| anteaya | zaro: awesome | 16:23 |
| anteaya | zaro: do you want a gerrit upgrade item on today's agenda? | 16:23 |
| *** dramalho has joined #openstack-infra | 16:23 | |
| zaro | anteaya: do you think there's anything special we need to test for thirdy party as it pertains to ACLs? | 16:23 |
| zaro | i've already added it. | 16:24 |
| anteaya | zaro: hmmmmm, nothing immediate comes to mind | 16:24 |
| anteaya | zaro: thank you | 16:24 |
| *** heyongli has joined #openstack-infra | 16:24 | |
| anteaya | zaro: can you add the ehterpad link to the agenda under gerrit upgrade? | 16:24 |
| anteaya | that way we signal we have something to discuss today | 16:24 |
| zaro | i can't seem to find the priority effort gerrit search anymore, do you know where it's at? | 16:24 |
| anteaya | let me see what the topic | 16:25 |
| anteaya | is | 16:25 |
| anteaya | give me a minute and I will look for it | 16:25 |
| openstackgerrit | Sebastian Schuberth proposed openstack-infra/jenkins-job-builder: quick-start: Fix the configuration file argument to read "--conf" https://review.openstack.org/237664 | 16:25 |
| clarkb | sdague: so I see why the stream_identity isn't good enough, the filenames can match | 16:25 |
| *** salv-orlando has quit IRC | 16:25 | |
| SpamapS | fungi: so, whats the word on that dump? | 16:25 |
| clarkb | sdague: so I think we want to add build uuid to that then rely on the periodic flushing of multilines to dump the last one through after a while | 16:25 |
| clarkb | double checking on the docs to make sure that will work properly | 16:26 |
| *** bdemers has joined #openstack-infra | 16:26 | |
| clarkb | but logstash seems to have killed their doc hosting | 16:26 |
| openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Create fuel-menu project https://review.openstack.org/235177 | 16:26 |
| clarkb | so I need to read the source | 16:26 |
| openstackgerrit | Derek Higgins proposed openstack/diskimage-builder: Use DIB_EPEL_MIRROR when finding the epel-release package https://review.openstack.org/237676 | 16:27 |
| openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Create fuel-menu project https://review.openstack.org/235177 | 16:27 |
| clarkb | hrm the version we have may not flush | 16:27 |
| *** jistr has quit IRC | 16:27 | |
| *** sridhar_ram has quit IRC | 16:28 | |
| *** shashank_hegde has quit IRC | 16:28 | |
| *** Daisy has quit IRC | 16:29 | |
| *** Daisy has joined #openstack-infra | 16:30 | |
| *** krtaylor has joined #openstack-infra | 16:30 | |
| fungi | SpamapS: it completed while i was sleeping. compressed size (with xz at default compression level) is 14gb, uncompressed looks like just shy of 50gb | 16:30 |
| mtreinish | fungi: that's not too bad | 16:31 |
| *** shashank_hegde has joined #openstack-infra | 16:31 | |
| *** sridhar_ram has joined #openstack-infra | 16:31 | |
| fungi | now i just need to figure out how to serve it up | 16:31 |
| clarkb | sdague: ya so the trick is getting the pending event to be flushed | 16:32 |
| mtreinish | clarkb: ^^^ that answers our questions about the subunit2sql backups too | 16:32 |
| *** weihan has quit IRC | 16:32 | |
| mtreinish | I think we've got 14gb free on logstash.o.o | 16:32 |
| clarkb | mtreinish: we do | 16:32 |
| *** weihan has joined #openstack-infra | 16:33 | |
| clarkb | sdague: it uses the stream_identity as an array index into a list of pending events. Which means if we never get an event with the same key as something pending we never flush | 16:33 |
| *** dimtruck is now known as zz_dimtruck | 16:33 | |
| SpamapS | fungi: I realized after saying 40:1 that there are 118 million uuids in there | 16:33 |
| *** heyongli has quit IRC | 16:33 | |
| SpamapS | fungi: those aren't likely to compress at all ;) | 16:33 |
| *** e0ne has quit IRC | 16:33 | |
| fungi | pauloewerton: based on a review of the elastic-recheck bot logs and some additional discussion in #openstack-qa, our best guess is that the gerrit event stream reader in it is buggy and has blind spots | 16:33 |
| *** aukhan has joined #openstack-infra | 16:33 | |
| *** jordanP has quit IRC | 16:33 | |
| fungi | needs deeper analysis when someone has time | 16:33 |
| zxiiro | zaro: Ok I'm back to work for a week before heading to OpenStack Summit, any JJB Gerrits I should prioritize review for this week? | 16:34 |
| *** heyongli has joined #openstack-infra | 16:34 | |
| fungi | pauloewerton: but it seems to have not noticed job results posted for that change in gerrit, basically | 16:34 |
| openstackgerrit | Alex Schultz proposed openstack-infra/project-config: Add puppet jobs to fuel-library https://review.openstack.org/235550 | 16:34 |
| *** Daisy has quit IRC | 16:34 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack/requirements: Expose extras information in requirements https://review.openstack.org/237544 | 16:34 |
| anteaya | zaro: looks like it might be topic:gerrit-upgrade https://review.openstack.org/#/c/172534/ | 16:34 |
| *** kozhukalov_ has quit IRC | 16:34 | |
| *** arxcruz has quit IRC | 16:35 | |
| anteaya | zaro: I am offline for lunch and more celebration of the election, hoping to be home in time for the meeting | 16:35 |
| SpamapS | greghaynes: crinkle pabelanger I just remembered that we have this https://storyboard.openstack.org/#!/story/2000175 | 16:36 |
| *** Swami has joined #openstack-infra | 16:36 | |
| SpamapS | and it is probably woefully out of date | 16:36 |
| crinkle | SpamapS: yes, and it's sort of hard to figure out what from that is still relevant | 16:37 |
| pauloewerton | fungi, I see. I thought that maybe it had something to do with the change being submitted to a feature branch | 16:37 |
| SpamapS | crinkle: indeed | 16:37 |
| *** mrmartin has quit IRC | 16:37 | |
| pauloewerton | fungi, thank you for your help o/ | 16:37 |
| SpamapS | Well, "Write manifest for one node deployment cloud" is still relevant | 16:37 |
| *** weihan has quit IRC | 16:37 | |
| crinkle | SpamapS: I think we skipped over that into writing a multinode deployment cloud | 16:38 |
| crinkle | SpamapS: https://review.openstack.org/231631 and https://review.openstack.org/231632 | 16:38 |
| SpamapS | crinkle: ok, I'd count your bifrost work as that. Would you say it is done? | 16:38 |
| zaro | anteaya: yes, topic will be gerrit-upgrade but i'm looking for the Gerrit search for all priority efforts. not sure what happened to that but i can't seem to find it anymore | 16:39 |
| crinkle | SpamapS: I need to test it again but it is basically done | 16:39 |
| zaro | maybe fungi knows?^^ | 16:39 |
| crinkle | SpamapS: I rolled some bits from https://review.openstack.org/231632 into https://review.openstack.org/231757 | 16:39 |
| *** shashank_hegde has quit IRC | 16:40 | |
| SpamapS | crinkle: ok, I redid that taks to be pointed at you and status of Review | 16:40 |
| SpamapS | crinkle: so now it is just "write manifest for deployment cloud" | 16:40 |
| crinkle | SpamapS: cool | 16:40 |
| SpamapS | You know.. | 16:40 |
| SpamapS | I really don't like not having direct 1:1 review<->task | 16:40 |
| *** amuller_afk is now known as amuller | 16:40 | |
| *** achanda has joined #openstack-infra | 16:41 | |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: heat: ceilometer-alarm is deprecated https://review.openstack.org/237683 | 16:41 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: rally: ceilometer-alarm is deprecated https://review.openstack.org/237684 | 16:41 |
| openstackgerrit | Mehdi Abaakouk (sileht) proposed openstack-infra/project-config: heat: remove legacy functional jobs https://review.openstack.org/237685 | 16:41 |
| *** hdd has quit IRC | 16:41 | |
| *** AJaeger has joined #openstack-infra | 16:41 | |
| *** markus_z has quit IRC | 16:41 | |
| zaro | zxiiro: welcome back for a short bit, i think pelix is keen to land this change. https://review.openstack.org/180463 | 16:42 |
| *** rkukura has joined #openstack-infra | 16:42 | |
| SpamapS | crinkle: are you working on the script to move vlan config onto bridge/veths, or is greghaynes ? | 16:42 |
| crinkle | SpamapS: I am not working on it | 16:43 |
| *** heyongli has quit IRC | 16:43 | |
| *** pradk has joined #openstack-infra | 16:43 | |
| zaro | zxiiro: i've reviewed it before the last few rebases. looks good, just need someone to test it if you are interested to tackle that :) | 16:43 |
| *** heyongli has joined #openstack-infra | 16:44 | |
| fungi | zaro: the priority efforts search is linked at http://specs.openstack.org/openstack-infra/infra-specs/ | 16:44 |
| *** blogan is now known as testudp | 16:44 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/system-config: Special case ansible logs https://review.openstack.org/237686 | 16:44 |
| *** testudp is now known as blogan | 16:44 | |
| clarkb | sdague: ^ something like that maybe, not tested with logstash but tested with http://grokconstructor.appspot.com/do/match#result | 16:44 |
| crinkle | SpamapS: though actually i added half of it in puppet, which should be removed when the script exists https://review.openstack.org/#/c/231631/3/manifests/veth.pp | 16:45 |
| crinkle | SpamapS: that doesn't include creating the bridge or the vlan interface though | 16:45 |
| zxiiro | zaro: cool. I'll add it to my todo list for this week. I'll see if I can run it at least once. | 16:45 |
| *** derekh has quit IRC | 16:46 | |
| *** kozhukalov_ has joined #openstack-infra | 16:47 | |
| *** unicell has quit IRC | 16:50 | |
| *** trown is now known as trown|lunch | 16:50 | |
| openstackgerrit | Ihar Hrachyshka proposed openstack-infra/project-config: Gate neutron-lbaas on -minimal job https://review.openstack.org/234643 | 16:50 |
| *** stevemar_ has quit IRC | 16:52 | |
| *** flepied has joined #openstack-infra | 16:52 | |
| *** heyongli has quit IRC | 16:53 | |
| *** fawadkhaliq has joined #openstack-infra | 16:54 | |
| *** heyongli has joined #openstack-infra | 16:54 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Make designate record methods private for now https://review.openstack.org/237692 | 16:55 |
| mordred | Shrews: ^^ | 16:56 |
| *** jsavak has quit IRC | 16:57 | |
| *** zz_dimtruck is now known as dimtruck | 16:57 | |
| sdague | clarkb: cool | 16:57 |
| *** bswartz has joined #openstack-infra | 16:57 | |
| *** jsavak has joined #openstack-infra | 16:58 | |
| *** aukhan has quit IRC | 16:58 | |
| *** aukhan has joined #openstack-infra | 16:58 | |
| *** fawadkhaliq has quit IRC | 16:58 | |
| *** sergmelikyan has joined #openstack-infra | 16:58 | |
| *** ivar-lazzaro has joined #openstack-infra | 16:58 | |
| *** stevemar_ has joined #openstack-infra | 16:59 | |
| *** dramalho has quit IRC | 16:59 | |
| *** achanda has quit IRC | 17:00 | |
| openstackgerrit | Sebastian Schuberth proposed openstack-infra/jenkins-job-builder: cmd: Add a fallback for jenkins_jobs.ini to the user's home directory https://review.openstack.org/237694 | 17:00 |
| *** claudiub has quit IRC | 17:01 | |
| *** ZZelle has joined #openstack-infra | 17:01 | |
| *** shashank_hegde has joined #openstack-infra | 17:01 | |
| *** vilobhmm11 has quit IRC | 17:02 | |
| fungi | timrc: sdague: i should have dug into zuul's logs sooner... 2015-10-20 06:48:34,900 ERROR zuul.Scheduler: Exception reporting runtime stats | 17:02 |
| SpamapS | greghaynes: ok, so you're working on the veth/vlan init script, yes? | 17:02 |
| *** yamamoto has quit IRC | 17:02 | |
| *** dizquierdo has quit IRC | 17:02 | |
| fungi | timrc: sdague: https://git.openstack.org/cgit/openstack-infra/zuul/tree/zuul/scheduler.py#n562 is trying to iterate over build.node_labels but it's coming up as a NoneType | 17:03 |
| clarkb | sdague: I have also confirmed that my test of ansible 2.0 doesn't have a different log output format | 17:03 |
| clarkb | sdague: so we should be fine with that rule after the upcoming ansible release | 17:03 |
| *** dtardivel_ has quit IRC | 17:03 | |
| *** heyongli has quit IRC | 17:04 | |
| *** heyongli has joined #openstack-infra | 17:04 | |
| *** aukhan has quit IRC | 17:05 | |
| *** aukhan has joined #openstack-infra | 17:05 | |
| sdague | clarkb: sounds good to me | 17:05 |
| sdague | clarkb: thanks for looking at it | 17:05 |
| *** dzamboni has joined #openstack-infra | 17:06 | |
| fungi | timrc: sdague: oh... i wonder if https://review.openstack.org/205097 is missing on the jenkins masters | 17:08 |
| openstackgerrit | Sebastian Schuberth proposed openstack-infra/jenkins-job-builder: builder: Fix hashing arbitrary job configurations https://review.openstack.org/237699 | 17:08 |
| *** hasharMeeting has quit IRC | 17:09 | |
| * timrc reads up | 17:10 | |
| timrc | fungi: I do not think the new gearman-plugin is deployed. | 17:11 |
| fungi | timrc: it is not. i just confirmed | 17:11 |
| timrc | fungi: I had a review up to add it to jenkins_dev for testing as per zaro's recommendation. | 17:11 |
| *** kozhukalov_ has quit IRC | 17:11 | |
| fungi | timrc: so anyway, the fallback to set that to [] in zuul seems to not be happening | 17:11 |
| timrc | fungi: So I should create a patch for zuul that defaults to [] and not NoneType if the labels are missing. | 17:11 |
| timrc | fungi: (hivemind) | 17:12 |
| fungi | timrc: yep | 17:12 |
| fungi | timrc: once we have that i can do a zuul restart with the fix in place | 17:12 |
| timrc | fungi: fwiw: https://review.openstack.org/#/c/236019/ | 17:12 |
| fungi | and hopefully we'll start getting job stats again after that | 17:12 |
| timrc | fungi: Cool. Let me work on that patch then. | 17:12 |
| *** achanda has joined #openstack-infra | 17:13 | |
| fungi | thanks timrc!!! | 17:13 |
| *** heyongli has quit IRC | 17:14 | |
| openstackgerrit | Khai Do proposed openstack-infra/infra-specs: add gerrit-upgrade to priority efforts query https://review.openstack.org/237701 | 17:14 |
| nibalizer | fungi: what is our procedure for a zuul restart? just the zuul-changes/zuul-enqueue stuff from here? http://docs.openstack.org/infra/zuul/zuul.html#starting-zuul | 17:14 |
| *** mahatic_ has quit IRC | 17:14 | |
| *** nmagnezi has joined #openstack-infra | 17:15 | |
| *** jsavak has quit IRC | 17:15 | |
| *** heyongli has joined #openstack-infra | 17:15 | |
| *** mahatic has joined #openstack-infra | 17:15 | |
| fungi | nibalizer: yup | 17:15 |
| * nibalizer nods | 17:15 | |
| openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Create fuel-menu project https://review.openstack.org/235177 | 17:15 |
| nibalizer | I can do it if you want to do more interesting things | 17:15 |
| clarkb | you can do a safe shutdown but it requires all queues to quiesce which takes forever | 17:16 |
| fungi | nibalizer: or wait until a really dead time and so a graceful restart (and cross your fingers it works) | 17:16 |
| nibalizer | after we get tims patch | 17:16 |
| fungi | yeah, that | 17:16 |
| *** dramalho has joined #openstack-infra | 17:16 | |
| *** dkranz has joined #openstack-infra | 17:16 | |
| fungi | nibalizer: you're awesome. i'll leave it to you while i get back to prepping for meetings and adding details to our summit schedule items | 17:16 |
| nibalizer | o7 | 17:16 |
| nibalizer | do you do the #notice thing when you bounce zuul like this? or just hope no one noticees? | 17:17 |
| *** nadya has joined #openstack-infra | 17:17 | |
| jeblair | it's close to functionally equivalent to a gate reset, so we don't usually #notice it unless it will impact people | 17:18 |
| *** boris-42 has quit IRC | 17:18 | |
| *** annegentle has joined #openstack-infra | 17:19 | |
| nibalizer | ok | 17:19 |
| *** trown|lunch is now known as trown | 17:19 | |
| *** fhubik has quit IRC | 17:19 | |
| jeblair | clarkb, sdague, mordred: apparently in ovh we have dedicated compute hosts (i guess our flavor is tied to them?). the perf characteristics we observed are related to that -- we oertaxed our oversubscribed hosts; and i think the 2-tier performnace was probably different hosts (at different levels of usage) | 17:20 |
| jeblair | we have a less-oversubscribed flavor now | 17:20 |
| *** unicell has joined #openstack-infra | 17:20 | |
| sdague | jeblair: the probably put us in a host aggregate | 17:21 |
| jeblair | aha | 17:21 |
| jeblair | i have to fly now, but we have next steps at least | 17:22 |
| sdague | yep | 17:22 |
| clarkb | we probably doubled up the use of the hypervisors when we doubled the size of the flavor | 17:22 |
| mordred | jeblair: ah | 17:23 |
| *** salv-orlando has joined #openstack-infra | 17:24 | |
| *** salv-orlando has quit IRC | 17:24 | |
| *** heyongli has quit IRC | 17:24 | |
| *** mahatic has quit IRC | 17:24 | |
| *** salv-orlando has joined #openstack-infra | 17:25 | |
| *** austin81 has joined #openstack-infra | 17:25 | |
| *** heyongli has joined #openstack-infra | 17:25 | |
| openstackgerrit | Merged openstack-infra/shade: Rename designate domains to zones https://review.openstack.org/237172 | 17:25 |
| openstackgerrit | Merged openstack-infra/shade: Rename identity_domain to domain https://review.openstack.org/237177 | 17:25 |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/zuul: Use default if gearman-plugin None for node_labels https://review.openstack.org/237703 | 17:25 |
| timrc | fungi: https://review.openstack.org/#/c/237703/ | 17:26 |
| *** kozhukalov_ has joined #openstack-infra | 17:26 | |
| *** dims__ has quit IRC | 17:27 | |
| fungi | clarkb: nibalizer: a second review ^? | 17:28 |
| fungi | lgtm | 17:28 |
| *** dims_ has joined #openstack-infra | 17:28 | |
| *** Sukhdev has joined #openstack-infra | 17:29 | |
| *** tonytan4ever has quit IRC | 17:30 | |
| *** ujuc has quit IRC | 17:30 | |
| clarkb | fungi: aroo? Sorry I am reviewing the glance image upload spec now | 17:30 |
| *** dkranz has quit IRC | 17:30 | |
| *** harlowja has quit IRC | 17:30 | |
| *** ociuhandu has quit IRC | 17:31 | |
| *** dkranz has joined #openstack-infra | 17:31 | |
| fungi | clarkb: no worries. this was just addressing the problem where we haven't been sending job stats to graphite since saturday's maintenance | 17:31 |
| *** aukhan has quit IRC | 17:34 | |
| *** aukhan has joined #openstack-infra | 17:34 | |
| *** heyongli has quit IRC | 17:34 | |
| greghaynes | clarkb: image upload spec? | 17:35 |
| clarkb | timrc: fungi nibalizer why not [] | 17:35 |
| greghaynes | clarkb: that sounds relavent to my interests | 17:35 |
| clarkb | timrc: otherwise we are relying on a default that may change? | 17:35 |
| timrc | clarkb: It is that []... the Build initializes it to [] | 17:35 |
| clarkb | greghaynes: https://review.openstack.org/#/c/232371/4 | 17:35 |
| clarkb | timrc: until that changes | 17:35 |
| *** heyongli has joined #openstack-infra | 17:35 | |
| fungi | clarkb: would also be fine. i don't have an opinion on explicit vs implicit there | 17:35 |
| timrc | clarkb: How many onCompletes would there be? | 17:36 |
| timrc | The only time that value changes is when the job finishes. | 17:36 |
| *** harlowja has joined #openstack-infra | 17:36 | |
| clarkb | timrc: just one, but if the model changes you may run into problems again | 17:36 |
| * nibalizer has no opinion | 17:36 | |
| clarkb | my point is we know explicitly what the value should be | 17:36 |
| timrc | I'm happy to do [] | 17:36 |
| clarkb | so we should set the value explicitly | 17:36 |
| timrc | Give me a sec. | 17:36 |
| fungi | though i guess a test with the default value would be useful in either case (since it's possible the default or the expected type might change in the future) | 17:36 |
| greghaynes | SpamapS: Not so much - The plan was to get terrible cloud up just doing eni with hard coded interfaces via element. As of yesterday there were some hardware issues being sorted out | 17:36 |
| clarkb | fungi: that would be good too | 17:36 |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/zuul: Use default if gearman-plugin None for node_labels https://review.openstack.org/237703 | 17:37 |
| clarkb | greghaynes: if you refresh I just posted comments to it | 17:37 |
| greghaynes | SpamapS: I think they replaced a few mobos, but the ILOs were no longer pingable so \O/ | 17:37 |
| nibalizer | timrc: now the commit message is wrong | 17:37 |
| timrc | Doh. | 17:37 |
| *** jsavak has joined #openstack-infra | 17:37 | |
| fungi | third time's a charm | 17:37 |
| timrc | If this is not hugely urgent I could be persuaded to write a test as part of this change. | 17:37 |
| *** nadya has quit IRC | 17:38 | |
| *** yamahata has joined #openstack-infra | 17:38 | |
| clarkb | timrc: a followup would be fine too | 17:38 |
| fungi | timrc: it would be nice to get it merged and zuul restarted sometime todayish | 17:38 |
| *** Sukhdev has quit IRC | 17:38 | |
| fungi | since the qa team and others are starved for health stats on jobs at the moment | 17:38 |
| *** tonytan4ever has joined #openstack-infra | 17:38 | |
| *** nadya has joined #openstack-infra | 17:38 | |
| *** kragniz has quit IRC | 17:39 | |
| kevinbenton | hi, stackforge networking-bigswitch code was replaced with a commit message indicating that it's no longer maintained because someone didn't update the wiki | 17:39 |
| *** achanda has quit IRC | 17:39 | |
| *** kragniz has joined #openstack-infra | 17:39 | |
| fungi | kevinbenton: sounds like it's abandoned? we sent multiple e-mails to the listed maintainers for it | 17:39 |
| fungi | over a span of months | 17:40 |
| openstackgerrit | Timothy R. Chavez proposed openstack-infra/zuul: Use default if gearman-plugin None for node_labels https://review.openstack.org/237703 | 17:40 |
| kevinbenton | fungi: it's not abandoned. the force into the openstack namespace where they would be under the neutron stadium put them into an untenable situation WRT stable policies | 17:41 |
| kevinbenton | fungi: so they were waiting to discuss this at the summit | 17:41 |
| *** jpeeler has quit IRC | 17:41 | |
| AJaeger | kevinbenton: openstack namespace != under neutron | 17:41 |
| fungi | kevinbenton: the namespace move is unrelated to governance. it was just a cosmetic change so that repos switching to official status later didn't need separate renames | 17:41 |
| kevinbenton | fungi: ah, that was the confusion then | 17:42 |
| *** sabeen3 has quit IRC | 17:42 | |
| openstackgerrit | Merged openstack-infra/project-config: Add a ceilometer-functional job for mysql https://review.openstack.org/235784 | 17:42 |
| kevinbenton | fungi: can it be moved to openstack then? | 17:42 |
| fungi | kevinbenton: the announcements and e-mail notifications explained that, and also mentioned the deadline (which was before the summit obviously) | 17:42 |
| *** nmagnezi has quit IRC | 17:42 | |
| *** sshnaidm has quit IRC | 17:42 | |
| * AJaeger wonders why nobody spoke up before the deadline... | 17:42 | |
| *** baoli_ has quit IRC | 17:43 | |
| fungi | kevinbenton: we can, though we didn't discuss how we're going to handle getting the stragglers moved later if there are more like this one | 17:43 |
| *** jpeeler has joined #openstack-infra | 17:43 | |
| *** jpeeler has quit IRC | 17:43 | |
| *** jpeeler has joined #openstack-infra | 17:43 | |
| AJaeger | dhellmann, dims_: Is it time to merge the trove liberty switch to post-versioning? It passes now: https://review.openstack.org/#/c/235149/ | 17:44 |
| kevinbenton | the email went to a gerrit email address which i think most were filtering because of CI noise | 17:44 |
| *** sridhar_ram has quit IRC | 17:44 | |
| dims_ | AJaeger: i don't know the intricacies :) so would wait on dhellmann | 17:44 |
| fungi | kevinbenton: it's a good thing we also announced it broadly on mailing lists, and more than once | 17:45 |
| *** heyongli has quit IRC | 17:45 | |
| fungi | (in case people were filtering their personal e-mail addresses) | 17:45 |
| kevinbenton | fungi: yeah, it's a good thing there isn't much email traffic on the mailing lists :) | 17:45 |
| *** heyongli has joined #openstack-infra | 17:45 | |
| *** amotoki has quit IRC | 17:46 | |
| fungi | kevinbenton: participating in the openstack community is hard, i get it. not sure what we could have done that we didn't already do | 17:46 |
| fungi | multiple prominent announcements (including mailing lists, cross-project meetings, a mention in the weekly newsletter at least once) and also direct e-mails just in case all the announcements went unnoticed | 17:47 |
| *** achanda has joined #openstack-infra | 17:47 | |
| *** shashank_hegde has quit IRC | 17:48 | |
| *** aukhan has quit IRC | 17:48 | |
| kevinbenton | fungi: thank you for explaining all of the things i did wrong | 17:48 |
| kevinbenton | is there any way that this can be fixed? | 17:48 |
| *** nadya has quit IRC | 17:48 | |
| *** bnemec has quit IRC | 17:48 | |
| fungi | kevinbenton: yes, i did say we can fix it, we just haven't discussed how we're going to handle people who missed all the notices (frankly we didn't expect any, and you're the first to my knowledge) | 17:49 |
| AJaeger | clarkb: do you want to merge https://review.openstack.org/#/c/234510/ now? It was approved before the depends-on was approved. I waited with another +A to give you time to monitor any fallout. Do you want to +A or shall I? title is "Add grenade to PROJECTS list in grenade jobs" | 17:50 |
| kevinbenton | to clarify, not unnoticed. the issue was that it was carefully read enough. we didn't realize the project would be replaced with the 'no longer maintained' graffiti and we didn't realize that 'openstack/' networking projects didn't have to be under neutron | 17:50 |
| kevinbenton | not carefully* | 17:50 |
| *** vilobhmm11 has joined #openstack-infra | 17:51 | |
| kevinbenton | the commit freeze was not an issue because we had the summit coming up to figure out if it should live under neutron | 17:51 |
| AJaeger | fungi: What about adding this as topic for the infra meeting - and have kevinbenton add a section in the wiki with the project mentioned. | 17:51 |
| clarkb | AJaeger: I can approve it | 17:51 |
| fungi | kevinbenton: understood. the unmaintained/retirement commit on them was to make sure people didn't continue to rely on software which had been abandoned by its authors | 17:51 |
| *** weshay_mtg is now known as weshay | 17:51 | |
| fungi | AJaeger: yeah, i expect we'll treat it like a normal rename, but in the meantime we need a commit to restore the previos acl so the core reviewers on it can approve a change reverting the last commit | 17:52 |
| fungi | er, previous acl | 17:52 |
| fungi | i'm working on the acl change right now | 17:53 |
| fungi | acl and jobs that is | 17:53 |
| nibalizer | timrc: failed in the gate? | 17:54 |
| aspiers | infra-root: please could someone add me to these two -core and -release groups on gerrit? https://review.openstack.org/#/admin/projects/openstack/openstack-resource-agents,access | 17:54 |
| nibalizer | aspiers: i got ya' | 17:54 |
| aspiers | thanks! | 17:54 |
| *** pradk has quit IRC | 17:54 | |
| *** heyongli has quit IRC | 17:55 | |
| nibalizer | aspiers: what is the email you use with gerrit? | 17:55 |
| timrc | nibalizer: Looking | 17:55 |
| aspiers | aspiers@suse.com, username adam.spiers | 17:55 |
| AJaeger | wow, we have around 100 open reviews for project-config - and I guess more than 70 have a -1 by Jenkins, probably merge conflicts. More than 50 older than 6 days... | 17:55 |
| aspiers | AJaeger: I'm guessing the resort caused a lot of conflicts | 17:56 |
| fungi | yep, my expectation as well | 17:56 |
| aspiers | AJaeger: it did for my review anyway | 17:56 |
| *** heyongli has joined #openstack-infra | 17:56 | |
| nibalizer | aspiers: done! | 17:56 |
| aspiers | nibalizer: awesome, many thanks! | 17:56 |
| fungi | AJaeger: did you have a change proposed to delete all the stackforge repos from zuul/layout.yaml? i notice most are still in there | 17:57 |
| AJaeger | aspiers: it did - but the -1 is older than 6 days, so before the resort | 17:57 |
| AJaeger | fungi: I didn't sign up for that task and didn't notice yet. | 17:57 |
| * timrc scratches head and zuul test | 17:58 | |
| AJaeger | fungi: shall I do it? | 17:58 |
| fungi | AJaeger: not trying to assign work! just thought that seemed like something you probably would have done while working on the resort | 17:58 |
| openstackgerrit | Merged openstack-infra/project-config: Add grenade to PROJECTS list in grenade jobs https://review.openstack.org/234510 | 17:58 |
| fungi | i was starting to add back the networking-bigswitch jobs and noticed they were still there | 17:58 |
| AJaeger | fungi: I probably should but was looking elsewhere. I can take it... | 17:58 |
| AJaeger | fungi: I'll base my change on top of yours | 17:58 |
| fungi | AJaeger: it's not urgent. just want to make sure we don't delete any for this repo since it's going to get renamed in some weeks | 17:59 |
| AJaeger | I guess we need to cleanup jenkins/projects as well... | 17:59 |
| timrc | Oh I think I know. | 17:59 |
| fungi | AJaeger: and if you already had one proposed i wanted to make sure we amended it to avoid blowing these away | 18:00 |
| *** sergmelikyan has quit IRC | 18:00 | |
| AJaeger | ;) | 18:00 |
| openstackgerrit | Merged openstack-infra/project-config: Be explicit when installing clients from src https://review.openstack.org/234511 | 18:01 |
| *** jamielennox|away is now known as jamielennox | 18:02 | |
| *** tiswanso has quit IRC | 18:02 | |
| *** yamamoto has joined #openstack-infra | 18:03 | |
| *** tiswanso has joined #openstack-infra | 18:03 | |
| *** ybathia has joined #openstack-infra | 18:03 | |
| *** ihrachys has quit IRC | 18:04 | |
| *** heyongli has quit IRC | 18:05 | |
| openstackgerrit | Merged openstack-infra/project-config: Use Barbican gate_hook in preparation for removal of extras.d https://review.openstack.org/234538 | 18:06 |
| *** heyongli has joined #openstack-infra | 18:06 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove stackforge IRC notification https://review.openstack.org/237718 | 18:07 |
| AJaeger | fungi: I'll do some cleanup now like the above ^ | 18:07 |
| kevinbenton | fungi, AJaeger: i added an item to open discussion for the meeting. is it still needed? | 18:07 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Unretire the stackforge/networking-bigswitch repo https://review.openstack.org/237720 | 18:08 |
| fungi | kevinbenton: AJaeger: ^ | 18:08 |
| *** yamamoto has quit IRC | 18:08 | |
| fungi | i have a revert of the head commit for that repo prepared to send as soon as manage-projects applies the acl there | 18:08 |
| timrc | fungi: nibalizer So I dunno why zuul failed.. tox locally ran successfully | 18:09 |
| *** notnownikki has quit IRC | 18:09 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: Enable configurable uris in uncategorized_fails.py https://review.openstack.org/235044 | 18:09 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: Enable configurable uris in graph.py https://review.openstack.org/236171 | 18:09 |
| timrc | Should I just attempt a recheck and light a candle and say prayer? | 18:09 |
| AJaeger | fungi: LGTM. | 18:09 |
| kevinbenton | fungi: thanks. want me to pull that off the meeting agenda then? | 18:09 |
| fungi | kevinbenton: i think what AJaeger was suggesting was adding it to the project renames list at the bottom of our agenda | 18:10 |
| nibalizer | timrc: sgtm | 18:11 |
| *** achanda has quit IRC | 18:11 | |
| kevinbenton | fungi: ack | 18:11 |
| *** dprince has quit IRC | 18:11 | |
| fungi | timrc: i'm trying to spot why/what failed there | 18:11 |
| *** ociuhandu has joined #openstack-infra | 18:12 | |
| fungi | process-returncode ended up with a 142 | 18:12 |
| fungi | and also test_client_enqueue_ref went sideways oddly | 18:13 |
| fungi | even if it's not related to the proposed change, it would be good to get a handle on what's possibly nondeterministic in those tests | 18:13 |
| fungi | or whether they're being caused by some sort of setup error which didn't get caught and short-circuit the job | 18:14 |
| *** jpeeler has quit IRC | 18:15 | |
| *** jpeeler has joined #openstack-infra | 18:15 | |
| *** jpeeler has joined #openstack-infra | 18:15 | |
| *** heyongli has quit IRC | 18:15 | |
| *** heyongli has joined #openstack-infra | 18:16 | |
| *** marzif has joined #openstack-infra | 18:16 | |
| *** shashank_hegde has joined #openstack-infra | 18:17 | |
| stevemar_ | fungi: who should i bug about removing a feature branch in keystoneclient? | 18:17 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: WIP: Stackforge retirement: Job cleanup https://review.openstack.org/237727 | 18:17 |
| *** sabeen has joined #openstack-infra | 18:18 | |
| fungi | stevemar_: infra or release managers. which branch? i can delete it now | 18:18 |
| *** kozhukalov_ has quit IRC | 18:18 | |
| *** Sukhdev has joined #openstack-infra | 18:18 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: Enable configurable uris in uncategorized_fails.py https://review.openstack.org/235044 | 18:19 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: Enable configurable uris in graph.py https://review.openstack.org/236171 | 18:19 |
| stevemar_ | fungi: this one https://review.openstack.org/#/q/status:open+project:openstack/python-keystoneclient+branch:feature/keystoneauth_integration,n,z | 18:19 |
| *** Sukhdev has quit IRC | 18:19 | |
| *** Sukhdev has joined #openstack-infra | 18:20 | |
| *** Mmike has quit IRC | 18:20 | |
| *** Mmike has joined #openstack-infra | 18:20 | |
| fungi | stevemar_: you have a few open changes on that branch still which will need to be abandoned first | 18:21 |
| *** ayoung has joined #openstack-infra | 18:21 | |
| stevemar_ | fungi: i'll abandon them | 18:21 |
| fungi | stevemar_: let me know once that's done and i'll delete the branch for you | 18:21 |
| stevemar_ | fungi: should be good now | 18:22 |
| *** vilobhmm11 has left #openstack-infra | 18:22 | |
| openstackgerrit | Merged openstack-infra/zuul: Use default if gearman-plugin None for node_labels https://review.openstack.org/237703 | 18:22 |
| openstackgerrit | Paul Belanger proposed openstack-infra/grafyaml: Create hidden row for md5 hash https://review.openstack.org/237729 | 18:23 |
| *** marzif has quit IRC | 18:23 | |
| pabelanger | timrc: ^ came up with that idea to better compare dashboards with grafyaml | 18:23 |
| *** Sukhdev has quit IRC | 18:24 | |
| openstackgerrit | Merged openstack-infra/project-config: Unretire the stackforge/networking-bigswitch repo https://review.openstack.org/237720 | 18:24 |
| *** heyongli has quit IRC | 18:26 | |
| timrc | pabelanger: I'll look soon. Will add to review queue | 18:26 |
| fungi | stevemar_: done. final state of feature/keystoneauth_integration was commit 4e498a54d0034b2ce5c87130f080ff580d241600 prior to deletion | 18:26 |
| *** heyongli has joined #openstack-infra | 18:26 | |
| timrc | fungi: So.. a little scary :) https://review.openstack.org/#/c/237703/ but that merged after the recheck | 18:26 |
| *** nadya has joined #openstack-infra | 18:28 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/grafyaml: Create hidden row for md5 hash https://review.openstack.org/237729 | 18:28 |
| *** nadya has quit IRC | 18:28 | |
| *** dprince has joined #openstack-infra | 18:28 | |
| *** marzif has joined #openstack-infra | 18:29 | |
| *** kmartin has quit IRC | 18:31 | |
| *** pvaneck has joined #openstack-infra | 18:31 | |
| pabelanger | yolanda: do you mind adding https://review.openstack.org/#/c/225228/ to your list too | 18:32 |
| AJaeger | fungi, anteaya: Why do we have gerrit/acls/openstack/swiftsync.config in project-config? That looks wrong, isn't it? | 18:33 |
| *** achanda has joined #openstack-infra | 18:33 | |
| AJaeger | anteaya: argh, that's wrong for ages... | 18:34 |
| AJaeger | fungi, anteaya : Found my answer, sorry for the noise | 18:34 |
| *** heyongli has quit IRC | 18:36 | |
| *** heyongli has joined #openstack-infra | 18:37 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Stackforge retirement: Job cleanup https://review.openstack.org/237727 | 18:37 |
| AJaeger | fungi, here's the big cleanup ^ | 18:37 |
| AJaeger | "3 files changed, 875 deletions(-)" | 18:37 |
| fungi | AJaeger: wow--nice! | 18:38 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Remove unused gerrit ACLs https://review.openstack.org/237732 | 18:39 |
| *** achanda has quit IRC | 18:39 | |
| AJaeger | fungi: and one more cleanup ^ | 18:39 |
| * AJaeger run "git grep" over all removed repositories, so I hope I got all | 18:40 | |
| AJaeger | Only noise was puppet-openstack ;) | 18:40 |
| *** xyz has joined #openstack-infra | 18:40 | |
| *** xyz is now known as Guest89652 | 18:41 | |
| *** sergmelikyan has joined #openstack-infra | 18:41 | |
| *** sridhar_ram has joined #openstack-infra | 18:44 | |
| *** fawadkhaliq has joined #openstack-infra | 18:44 | |
| Guest89652 | I just signed up to be an openstack contributor. When I ran "git review -v", it ran happily and then asked me to "review your contact information" at https://review.openstack.org/#/settings/contact. I did just that and hit the "save changes" button. Then the browser shows "server error. Cannot save contact information". | 18:45 |
| *** dramalho has quit IRC | 18:45 | |
| pabelanger | nibalizer: you got time spare cycles to help with grafana.o.o puppet issue? | 18:45 |
| fungi | Guest89652: were you following the instructions at http://docs.openstack.org/infra/manual/developers.html#account-setup or something else? | 18:45 |
| fungi | Guest89652: that error is usually a sign that the foundation membership step was skipped | 18:46 |
| Guest89652 | I think I have signed up. But I'll check. Thx. | 18:46 |
| *** heyongli has quit IRC | 18:46 | |
| fungi | Guest89652: some additional troubleshooting suggestions for that error are at https://ask.openstack.org/question/56720 | 18:46 |
| AJaeger | infra-root, I would appreciate some reviews for 237718 and 237727 - part of stackforge retirement. These are merge-conflict potential changes, so let's keep the window small before everybody rebased, ;) please | 18:46 |
| AJaeger | With those changes Jenkins jobs go down from 7419 to 7052 | 18:47 |
| *** heyongli has joined #openstack-infra | 18:47 | |
| mordred | fungi: I have slow derpy l=plane wifi - could you add a topic about hound onto the meeting today? | 18:47 |
| fungi | mordred: you bet | 18:48 |
| *** dramalho has joined #openstack-infra | 18:48 | |
| *** achanda has joined #openstack-infra | 18:48 | |
| mordred | fungi: thanks! | 18:49 |
| nibalizer | pabelanger: after lunch sure | 18:51 |
| *** bhuvan has joined #openstack-infra | 18:51 | |
| anteaya | AJaeger: thank you | 18:51 |
| openstackgerrit | Alexey Shtokolov proposed openstack-infra/project-config: Enabled python27 and pep8 gates and fixed checks for Fuel repos https://review.openstack.org/236068 | 18:51 |
| anteaya | zaro: oh I think I understand what you are looking for now | 18:52 |
| anteaya | zaro: I'm going to have to think where to find that or compose a new one | 18:52 |
| *** pradk has joined #openstack-infra | 18:52 | |
| openstackgerrit | Alexey Shtokolov proposed openstack-infra/project-config: Enabled python27 and pep8 gates and fixed checks for Fuel repos https://review.openstack.org/236068 | 18:52 |
| AJaeger | anteaya, fungi: If there's further cleanup to do, feel free to point it out. | 18:53 |
| *** harlowja has quit IRC | 18:53 | |
| zaro | anteaya: fungi pointed me to it, it's in infra-specs | 18:53 |
| anteaya | AJaeger: I'm sure you will spot it before I will, but will do if I beat you to one | 18:53 |
| anteaya | zaro: awesome | 18:53 |
| AJaeger | anteaya: since I was travelling last weekend I missed all the fun and fungi needed to point out the obvious to me | 18:55 |
| jhesketh | Morning | 18:55 |
| fungi | kevinbenton: https://review.openstack.org/237741 is the retirement revert for your repo | 18:56 |
| *** heyongli has quit IRC | 18:56 | |
| fungi | infra-root: protip... you can't apply an acl to a project in gerrit without manually switching it from read-only to active first. manage-projects was failing until i did that | 18:57 |
| *** heyongli has joined #openstack-infra | 18:57 | |
| AJaeger | morning, jhesketh ! | 18:57 |
| *** HeOS has quit IRC | 18:58 | |
| mordred | fungi: nice | 18:59 |
| anteaya | AJaeger: you pick up the obvious quickly :) | 18:59 |
| anteaya | morning jhesketh | 18:59 |
| *** rkukura has quit IRC | 19:00 | |
| anteaya | fungi: good to know | 19:00 |
| fungi | meeting time! | 19:00 |
| anteaya | kevinbenton: I asked about bigswitch | 19:00 |
| Guest89652 | fungi: I'm a community member of openstack. Do I have to be a foundation member? | 19:00 |
| anteaya | kevinbenton: you know there is no way I wanted to retire a project you wanted, right? | 19:00 |
| fungi | Guest89652: yes | 19:00 |
| Guest89652 | alright, thanks. | 19:01 |
| *** jsavak has quit IRC | 19:04 | |
| *** jsavak has joined #openstack-infra | 19:04 | |
| *** shardy has quit IRC | 19:04 | |
| openstackgerrit | Sam Yaple proposed openstack-infra/project-config: Add gates for deploying Kolla https://review.openstack.org/237745 | 19:04 |
| *** jcoufal_ has quit IRC | 19:05 | |
| AJaeger | kevinbenton: can you propose a proper rename switch to move your repo to openstack? Check the project-config repo for examples on how this was done in the past. | 19:05 |
| *** gyee has quit IRC | 19:05 | |
| *** shardy has joined #openstack-infra | 19:06 | |
| *** heyongli has quit IRC | 19:07 | |
| *** heyongli has joined #openstack-infra | 19:07 | |
| *** rguillebert has quit IRC | 19:08 | |
| *** armax has quit IRC | 19:10 | |
| openstackgerrit | Sam Yaple proposed openstack-infra/project-config: Add gates for deploying Kolla https://review.openstack.org/237745 | 19:10 |
| *** harlowja has joined #openstack-infra | 19:11 | |
| *** jsavak has quit IRC | 19:13 | |
| *** jsavak has joined #openstack-infra | 19:13 | |
| Guest89652 | fungi: I can't apply for foundation membership (email in use). So how do I switch from community membership to foundation? | 19:13 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Remove dib-lint flake8 requirement https://review.openstack.org/235020 | 19:14 |
| fungi | Guest89652: there's a button in your profile, as pictured in the screenshot at https://ask.openstack.org/question/56720 | 19:14 |
| *** megm_ has quit IRC | 19:15 | |
| *** megm has joined #openstack-infra | 19:15 | |
| kevinbenton | anteaya: sorry. i dropped the ball by failing to read the warning closely. i thought it would just go read-only which they were fine with while they figured out their Neutron stadium strategy | 19:16 |
| kevinbenton | anteaya: but then the change to show that it was an unmaintained project forced things to pick up the pace | 19:16 |
| kevinbenton | AJaeger: yep, i'll do that | 19:16 |
| *** heyongli has quit IRC | 19:17 | |
| anteaya | kevinbenton: okay I don't know when our next rename window is scheduled | 19:17 |
| anteaya | kevinbenton: :( | 19:17 |
| anteaya | kevinbenton: next time can you ping just to be sure, saves a ton of work | 19:17 |
| *** heyongli has joined #openstack-infra | 19:18 | |
| *** abetterlie_ has joined #openstack-infra | 19:19 | |
| *** bdemers has quit IRC | 19:19 | |
| *** bdemers has joined #openstack-infra | 19:20 | |
| Guest89652 | fungi: found the way. Also saw your reply. Thanks! | 19:20 |
| *** jsavak has quit IRC | 19:22 | |
| *** salv-orlando has quit IRC | 19:23 | |
| openstackgerrit | Kevin Benton proposed openstack-infra/project-config: Move networking-bigswitch from stackforge to openstack https://review.openstack.org/237753 | 19:23 |
| *** achanda has quit IRC | 19:23 | |
| kevinbenton | AJaeger: ^^ does that look right? | 19:23 |
| *** bdemers has quit IRC | 19:23 | |
| kevinbenton | anteaya: definitely will watch the infra notifications more closely next time :) | 19:24 |
| AJaeger | anteaya: that's for you ^ ;) | 19:24 |
| anteaya | AJaeger: we both can help :) but sure can take this one | 19:25 |
| openstackgerrit | Kevin Benton proposed openstack-infra/project-config: Move networking-bigswitch from stackforge to openstack https://review.openstack.org/237753 | 19:25 |
| anteaya | kevinbenton: I'm just a ping away | 19:25 |
| kevinbenton | anteaya: you'll be in tokyo, right? | 19:26 |
| anteaya | kevinbenton: yes | 19:26 |
| *** qba73 has joined #openstack-infra | 19:26 | |
| anteaya | kevinbenton: let's have a drink | 19:26 |
| *** bdemers has joined #openstack-infra | 19:26 | |
| kevinbenton | anteaya: sounds like a plan! | 19:26 |
| *** tiswanso has quit IRC | 19:26 | |
| anteaya | kevinbenton: thank you, sorry this got missed, it will be a while before we have another window to change it back | 19:26 |
| anteaya | kevinbenton: just so you know there will be a wait | 19:27 |
| kevinbenton | anteaya: will the stackforge project be unblocked so they can revert the change that deleted everything? | 19:27 |
| *** heyongli has quit IRC | 19:27 | |
| *** marzif has quit IRC | 19:27 | |
| anteaya | no | 19:27 |
| anteaya | we can fix it | 19:27 |
| anteaya | but it won't be fixed for a while | 19:27 |
| anteaya | it will be after summit | 19:28 |
| *** bdemers has quit IRC | 19:28 | |
| *** qba73 has quit IRC | 19:28 | |
| *** marzif has joined #openstack-infra | 19:28 | |
| anteaya | before the maintenance is scheduled | 19:28 |
| *** heyongli has joined #openstack-infra | 19:28 | |
| *** jsavak has joined #openstack-infra | 19:28 | |
| kevinbenton | is it possible for someone with commit rights to at least revert that change so it doesn't look like an abandoned project? | 19:28 |
| *** tiswanso has joined #openstack-infra | 19:29 | |
| kevinbenton | or is it frozen for everyone? | 19:29 |
| anteaya | no | 19:29 |
| anteaya | it is frozen | 19:29 |
| anteaya | that is the point | 19:29 |
| anteaya | and why we worked on this for 3 months | 19:29 |
| anteaya | and sent posts to the mailing list | 19:29 |
| anteaya | and individually emailed maintainters twice | 19:29 |
| anteaya | and why I asked in -neutron the wednesday prior to the rename | 19:30 |
| *** dangers_away is now known as dangers | 19:30 | |
| *** bdemers has joined #openstack-infra | 19:30 | |
| AJaeger | anteaya: I understand fungi that he unfroze the repo, let's wait for him to chime in after the infra meeting | 19:32 |
| anteaya | AJaeger: oh | 19:32 |
| anteaya | well then that is news to me | 19:32 |
| anteaya | and I haven't read all the backscroll | 19:32 |
| anteaya | kevinbenton: well I may be wrong here then | 19:33 |
| *** hdd has joined #openstack-infra | 19:33 | |
| AJaeger | kevinbenton: please add a link to the review to https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting#Upcoming_Project_Renames | 19:34 |
| kevinbenton | anteaya: ok. i'll stay tuned | 19:34 |
| *** tonytan4ever has quit IRC | 19:34 | |
| anteaya | kevinbenton: okay thanks | 19:34 |
| angdraug | AJaeger: can you have a look again: https://review.openstack.org/235550 -- mwhahaha has fixed it up | 19:34 |
| kevinbenton | AJaeger: done | 19:34 |
| openstackgerrit | Jamie Lennox proposed openstack/requirements: Update upper keystoneauth to latest version https://review.openstack.org/237756 | 19:35 |
| *** dtardivel has quit IRC | 19:35 | |
| AJaeger | angdraug: please get https://review.openstack.org/#/c/235582/ reviewed and merged first | 19:36 |
| AJaeger | angdraug: I'll look at it again later or tomorrow | 19:36 |
| *** bpokorny has quit IRC | 19:36 | |
| openstackgerrit | Alex Schultz proposed openstack-infra/project-config: Add puppet jobs to fuel-library https://review.openstack.org/235550 | 19:37 |
| *** heyongli has quit IRC | 19:37 | |
| AJaeger | angdraug: is the dependency wrong? | 19:38 |
| angdraug | removed the Depends-On for https://review.openstack.org/235582 -- no longer depends since it's non-voting now | 19:38 |
| AJaeger | angdraug: ah... | 19:38 |
| AJaeger | angdraug: that's cheating ;) | 19:38 |
| *** rkukura has joined #openstack-infra | 19:38 | |
| angdraug | no, that just makes it easier for us to test https://review.openstack.org/235582 :) | 19:38 |
| *** heyongli has joined #openstack-infra | 19:38 | |
| *** annegentle has quit IRC | 19:39 | |
| *** rguillebert has joined #openstack-infra | 19:40 | |
| *** annegentle has joined #openstack-infra | 19:40 | |
| *** nadya has joined #openstack-infra | 19:40 | |
| *** dprince has quit IRC | 19:42 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/grafyaml: Create hidden row for md5 hash https://review.openstack.org/237729 | 19:43 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API https://review.openstack.org/221964 | 19:44 |
| *** pradk has quit IRC | 19:46 | |
| angdraug | pretty please? :) | 19:46 |
| mwhahaha | gotta wait for CI | 19:46 |
| mwhahaha | which just popped through :o | 19:47 |
| *** claudiub has joined #openstack-infra | 19:47 | |
| *** heyongli has quit IRC | 19:48 | |
| AJaeger | ianw: you have some old changes like 175625, 179329, 175626 in the review queue for project-config. Could you either rework or abandon them, please? | 19:48 |
| *** heyongli has joined #openstack-infra | 19:48 | |
| *** armax has joined #openstack-infra | 19:49 | |
| *** EricGonc_ has quit IRC | 19:50 | |
| *** mrmartin has joined #openstack-infra | 19:51 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API https://review.openstack.org/221964 | 19:53 |
| *** erikwilson has joined #openstack-infra | 19:55 | |
| *** rkukura has quit IRC | 19:56 | |
| *** shardy has quit IRC | 19:56 | |
| openstackgerrit | Merged openstack-infra/shade: Make designate record methods private for now https://review.openstack.org/237692 | 19:57 |
| *** rkukura has joined #openstack-infra | 19:57 | |
| *** shardy has joined #openstack-infra | 19:58 | |
| *** heyongli has quit IRC | 19:58 | |
| *** Piet has joined #openstack-infra | 19:58 | |
| *** fawadkhaliq has quit IRC | 19:58 | |
| *** heyongli has joined #openstack-infra | 19:59 | |
| anteaya | nibalizer: can you review these for the gerrit work? https://review.openstack.org/#/q/status:open+project:openstack-infra/gerrit+branch:openstack/2.11.4+topic:gerrit-upgrade,n,z | 19:59 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools: make intermediary.sh support stable branches https://review.openstack.org/237595 | 20:00 |
| openstackgerrit | Kevin Benton proposed openstack-infra/project-config: Move networking-bigswitch from stackforge to openstack https://review.openstack.org/237753 | 20:00 |
| *** notnownikki has joined #openstack-infra | 20:00 | |
| *** HeOS has joined #openstack-infra | 20:01 | |
| *** mnencia has quit IRC | 20:01 | |
| *** sridhar_ram1 has joined #openstack-infra | 20:01 | |
| taron | ah, I'd forgotten the power of dumping your thoughts in a text file while debugging | 20:02 |
| * taron finds a whole bunch of at least questionable, if not faulty logic while poking around hound again | 20:02 | |
| anteaya | fungi: can you share with kevinbenton the current status of networking-bigswitch? | 20:02 |
| *** boris-42 has joined #openstack-infra | 20:02 | |
| anteaya | fungi: sorry I haven't read all the backscroll | 20:02 |
| anteaya | taron: yay! | 20:02 |
| fungi | taron: aka rubber duck debugging | 20:03 |
| *** bnemec has joined #openstack-infra | 20:03 | |
| *** sridhar_ram has quit IRC | 20:03 | |
| taron | I knew there was a term for it I was forgetting | 20:03 |
| fungi | it's surprisingly useful | 20:03 |
| fungi | well, technically it's explaining your problems to a fictional or inanimate conversant | 20:03 |
| fungi | but a text file is a close proxy | 20:03 |
| nibalizer | anteaya: when i get back to my main pc, yes | 20:03 |
| anteaya | kevinbenton: did you ever have -bigswitch report patches submitted and merged to any of the channels? | 20:03 |
| anteaya | nibalizer: thanks | 20:03 |
| nibalizer | in transit at the moment | 20:04 |
| anteaya | nibalizer: /me nods | 20:04 |
| anteaya | nibalizer: from somewhere where clarkb was I'm guessing | 20:04 |
| kevinbenton | anteaya: no | 20:04 |
| anteaya | kevinbenton: okay thank you | 20:04 |
| nibalizer | yep. infratacolunch | 20:04 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Set cache information from clouds.yaml https://review.openstack.org/237050 | 20:04 |
| fungi | kevinbenton: so i see from my proposed https://review.openstack.org/237741 change that your unit tests have bit-rotted | 20:04 |
| anteaya | nibalizer: nice | 20:04 |
| nibalizer | a pdx openstack tradition | 20:04 |
| anteaya | nibalizer: I'm going to have to time a visit | 20:05 |
| taron | los gorditos? | 20:05 |
| fungi | kevinbenton: we should trim those down so gate-networking-bigswitch-python27 only runs in the check pipeline and is non-voting | 20:05 |
| fungi | kevinbenton: that'll allow the revert to merge and whatever else until you can fix your unit tests | 20:05 |
| *** salv-orlando has joined #openstack-infra | 20:05 | |
| *** jsavak has quit IRC | 20:06 | |
| *** jsavak has joined #openstack-infra | 20:06 | |
| fungi | anteaya: did you want to help with that? ^ | 20:06 |
| *** bpokorny has joined #openstack-infra | 20:06 | |
| mordred | Shrews: ^ I figured out what was breaking in that nodepool-shade-src job | 20:06 |
| kevinbenton | fungi: ah, the wonders of depending on unstable neutron internals | 20:06 |
| mordred | shardy: it was that the upper-constraints file hadn't been updated | 20:06 |
| fungi | indeed | 20:06 |
| kevinbenton | fungi: either that or i could ammend your commit with a fix for those | 20:06 |
| fungi | kevinbenton: if it's easy, then go for it | 20:07 |
| kevinbenton | fungi: sure, i think it's just an import statement. one sec | 20:07 |
| zaro | yolanda: i'm interested about your kubertnetes solution for running ci. | 20:07 |
| anteaya | fungi: I can try, sure | 20:07 |
| AJaeger | fungi, before changing layout.yaml for kevinbenton , let's merge https://review.openstack.org/237727, please ;) | 20:07 |
| anteaya | fungi: so right now the repo is unfrozen? | 20:08 |
| taron | nibalizer: https://review.openstack.org/#/c/216549/7/modules/openstack_project/manifests/codesearch.pp would I be correct in assuming that since this exec is set to refreshonly and has nothing to notify it it'll never run? | 20:08 |
| fungi | anteaya: well, sounds like kevinbenton may have a solution | 20:08 |
| anteaya | fungi: kevinbenton is so smart | 20:08 |
| fungi | anteaya: yeah, it's been unfrozen since before the infra meeting | 20:08 |
| anteaya | fungi: ah okay thanks, was confused | 20:08 |
| *** heyongli has quit IRC | 20:08 | |
| taron | nibalizer: because if so, well, no wonder it's breaking, there's been no config.json the whole time :P | 20:09 |
| openstackgerrit | Paul Belanger proposed openstack-infra/grafyaml: Check for existing md5 hash in dashboard https://review.openstack.org/237764 | 20:09 |
| openstackgerrit | Merged openstack-infra/shade: Create neutron floating ips with server info https://review.openstack.org/235402 | 20:09 |
| *** heyongli has joined #openstack-infra | 20:09 | |
| openstackgerrit | Merged openstack-infra/shade: Make a few IP methods private https://review.openstack.org/237020 | 20:09 |
| AJaeger | kevinbenton: you need to sort *all* files - https://review.openstack.org/#/c/237753/3/zuul/layout.yaml is not sorted properly... | 20:10 |
| *** adam_g has quit IRC | 20:10 | |
| AJaeger | thanks for the reviews, anteaya ! | 20:11 |
| anteaya | kevinbenton: you'll never get past AJaeger without things in alphabetical order | 20:11 |
| anteaya | AJaeger: :) | 20:11 |
| fungi | i'm going to step out and get a bite to eat momentarily, since there's no tc meeting to skulk around in and no cross-project meeting i need to be around for. let me know if there's anything else urgent, otherwise i can help with things in a couple hours | 20:11 |
| anteaya | kevinbenton: he let us turn it off for Saturday so I don't think we can ask again for about 2 years | 20:11 |
| anteaya | fungi: enjoy! | 20:11 |
| AJaeger | anteaya: we have it automated, just wanted to help him debugging ;) | 20:13 |
| *** mrmartin has quit IRC | 20:13 | |
| AJaeger | fungi: enjoy! | 20:13 |
| anteaya | AJaeger: yup | 20:13 |
| anteaya | :) | 20:13 |
| openstackgerrit | Bruno Tavares proposed openstack-infra/puppet-httpd: Fixes vhost and vhost::proxy on Precise. https://review.openstack.org/237765 | 20:14 |
| *** adam_g has joined #openstack-infra | 20:14 | |
| *** adam_g has quit IRC | 20:14 | |
| *** adam_g has joined #openstack-infra | 20:14 | |
| openstackgerrit | Sam Yaple proposed openstack/requirements: Block requests 2.8.1 https://review.openstack.org/237766 | 20:15 |
| *** ldnunes has quit IRC | 20:15 | |
| *** rfolco_ has quit IRC | 20:15 | |
| mtreinish | infra-root: if someone gets a second creating a server for: http://git.openstack.org/cgit/openstack-infra/system-config/commit/?id=05c16e2e35077260b21e286a8eb0948c085750c7 would unblock the deployment side of that | 20:16 |
| *** rfolco_ has joined #openstack-infra | 20:16 | |
| mtreinish | it'd be awesome if we could get that running before the summit session next week | 20:16 |
| clarkb | anteaya: yes we decided it was a taco day but meeting from taco grocery store didn't work so great | 20:16 |
| anteaya | clarkb: ah | 20:17 |
| anteaya | clarkb: and you have no phone currently | 20:17 |
| anteaya | clarkb: nibalizer was a good proxy | 20:17 |
| anteaya | clarkb: were tacos good/ | 20:17 |
| anteaya | ? | 20:17 |
| * AJaeger waves good night... | 20:17 | |
| clarkb | yes they were excellent | 20:17 |
| clarkb | AJaeger: good night | 20:17 |
| anteaya | AJaeger: night | 20:17 |
| anteaya | AJaeger: thank you | 20:17 |
| anteaya | clarkb: wonderful | 20:17 |
| *** AJaeger has quit IRC | 20:17 | |
| mtreinish | clarkb: wait, there's a taco grocery store? do they only sell taco ingredients? | 20:18 |
| * mtreinish remebers it is portland | 20:18 | |
| *** kgiusti has left #openstack-infra | 20:18 | |
| anteaya | a grocery store that also serves tacos? | 20:18 |
| mordred | it's also probably a food truck | 20:18 |
| *** heyongli has quit IRC | 20:18 | |
| clarkb | anteaya: ya you go into a grocery store, walk through the back to a place with a counter and bunch of plastic chairs and tables | 20:19 |
| mtreinish | mordred: haha, that's very likely | 20:19 |
| anteaya | mtreinish: I think you might have to find someone to take that on | 20:19 |
| anteaya | clarkb: nice | 20:19 |
| zaro | seattle has em. usually pretty good too | 20:19 |
| anteaya | mtreinish: who most needs a favour from you? | 20:19 |
| anteaya | zaro: what is em? | 20:19 |
| *** heyongli has joined #openstack-infra | 20:19 | |
| zaro | them | 20:19 |
| anteaya | ah | 20:20 |
| anteaya | nice | 20:20 |
| zaro | canadian don't use em? | 20:20 |
| anteaya | mtreinish: hey I would ask nibalizer as practice for him | 20:20 |
| nibalizer | haha | 20:20 |
| anteaya | mtreinish: try that angle | 20:20 |
| anteaya | :) | 20:20 |
| nibalizer | saw that comming | 20:20 |
| mtreinish | anteaya: that works for me | 20:20 |
| mtreinish | nibalizer: want to create the health.o.o server? | 20:21 |
| anteaya | nibalizer: ha ha ha, new guy gets all the tasks | 20:21 |
| nibalizer | :) | 20:21 |
| clarkb | its good learning | 20:21 |
| anteaya | zaro: yes, often I see it as 'em | 20:21 |
| clarkb | nibalizer: I can walk through it and the zuul thing if you want | 20:21 |
| clarkb | once your laundry is started | 20:21 |
| anteaya | ha ha ha | 20:21 |
| anteaya | laundry first | 20:21 |
| zaro | my bad, i can see how you would be confused | 20:22 |
| nibalizer | tacos and laundry | 20:22 |
| anteaya | zaro: not at all, glad I understand now :) | 20:22 |
| anteaya | nibalizer: nice | 20:22 |
| *** marzif has quit IRC | 20:22 | |
| nibalizer | i have no secrets from infra | 20:22 |
| zaro | nibalizer: i thought i heard you moved? but still in portland? | 20:22 |
| anteaya | I'm so glad I work with a team that has its priorities figured out | 20:22 |
| anteaya | nibalizer: good approach | 20:22 |
| mtreinish | anteaya: tacos being the priority right? | 20:23 |
| *** smyers has left #openstack-infra | 20:23 | |
| anteaya | mtreinish: of course | 20:24 |
| *** achanda has joined #openstack-infra | 20:24 | |
| anteaya | you always have to eat first | 20:24 |
| anteaya | you can order and load landry in the washer | 20:24 |
| anteaya | then get it started and eat | 20:24 |
| anteaya | then into the dryer as you digest | 20:24 |
| anteaya | depends on the line up for food and for washers | 20:25 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: Enable configurable uris in uncategorized_fails.py https://review.openstack.org/235044 | 20:25 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/elastic-recheck: Enable configurable uris in graph.py https://review.openstack.org/236171 | 20:25 |
| *** marzif has joined #openstack-infra | 20:25 | |
| openstackgerrit | Kevin Benton proposed openstack-infra/project-config: Move networking-bigswitch from stackforge to openstack https://review.openstack.org/237753 | 20:25 |
| *** achanda has quit IRC | 20:25 | |
| *** pc_m has quit IRC | 20:26 | |
| clarkb | ianw: +2 on https://review.openstack.org/#/c/237389/ | 20:27 |
| clarkb | is an easy one and nothing uses it yet so best to just try | 20:27 |
| *** kozhukalov_ has joined #openstack-infra | 20:27 | |
| *** tonytan4ever has joined #openstack-infra | 20:28 | |
| *** hdd has quit IRC | 20:28 | |
| ianw | clarkb: thanks, yep as usual i'm sure there's something i missed, but am around to debug it | 20:28 |
| *** heyongli has quit IRC | 20:29 | |
| *** skylerberg has joined #openstack-infra | 20:29 | |
| anteaya | kevinbenton: I have to grab something to eat, let me know if you can get your unit tests passing | 20:29 |
| dims_ | anteaya: talking about food. found any good vegetarian places for tokyo? | 20:29 |
| *** heyongli has joined #openstack-infra | 20:29 | |
| anteaya | dims_: not so far | 20:30 |
| anteaya | dims_: I understand the benito flakes might be an issue | 20:30 |
| dims_ | ah i see | 20:30 |
| anteaya | my plan thus far is to stay close to mtreinish | 20:30 |
| dims_ | ++ :) | 20:30 |
| anteaya | and have him assign me someone who lives in japan as a guide my first night | 20:30 |
| kevinbenton | anteaya: ack. i think they're happy now | 20:30 |
| anteaya | and then if I have to eat at the same restaurant all week, I have no problem with that | 20:30 |
| anteaya | kevinbenton: awesome thank you | 20:31 |
| anteaya | dims_: I'm under obligation to go to the fish market in tokyo and I don't want to go | 20:31 |
| anteaya | dims_: I'm going to have to find a proxy for taht task | 20:31 |
| anteaya | dims_: I'm to see the fish market | 20:31 |
| mtreinish | dims_: I know a decent indian restaurant so I've got that meal covered | 20:31 |
| anteaya | I don't want to see it | 20:31 |
| anteaya | mtreinish: yay | 20:31 |
| dims_ | mtreinish: nice, what's the name? | 20:31 |
| anteaya | dims_: when are you there? | 20:31 |
| dims_ | anteaya: sunday evening | 20:32 |
| mtreinish | dims_: dipmahal | 20:32 |
| anteaya | dims_: cool I am going to be at the tc/board meeting | 20:32 |
| anteaya | dims_: let's see what develops for dinner that night | 20:32 |
| dims_ | mtreinish: cool. will look up | 20:32 |
| dims_ | anteaya: ++ | 20:32 |
| nibalizer | ok im actually back now | 20:32 |
| anteaya | dims_: great, I just have to check if I have you on text, I thinnk I do | 20:33 |
| nibalizer | zaro: i moved inside portland | 20:33 |
| mtreinish | dims_: google isn't pointing it to the right place, I'll dig up a link | 20:33 |
| *** marzif has quit IRC | 20:33 | |
| mtreinish | dims_: https://goo.gl/maps/gLJjw1tmECk | 20:34 |
| *** baoli has joined #openstack-infra | 20:34 | |
| dims_ | mtreinish: thanks | 20:34 |
| mtreinish | dims_: there might be good ones closer to the summit. I just know that one because it's not far from where I've stayed before | 20:35 |
| anteaya | meh I'd go there | 20:36 |
| *** moravec1 has quit IRC | 20:36 | |
| *** moravec has joined #openstack-infra | 20:36 | |
| *** bpokorny has quit IRC | 20:37 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Match on dsvm-fedora-22 and dsvm-f21 nodes https://review.openstack.org/237771 | 20:38 |
| *** sdake has joined #openstack-infra | 20:38 | |
| sdake | hey, is it possible that someone in the infra core team could attend a kolla gating session | 20:38 |
| sdake | at summit | 20:39 |
| sdake | we have a big ask of openstack infra team | 20:39 |
| *** heyongli has quit IRC | 20:39 | |
| pabelanger | ianw: nibalizer ^ do you mind? That will fix our gate-infra-puppet-apply-dsvm-fedora-22 NOT_REGISTERED issue | 20:39 |
| clarkb | sdake: we do tend to spend lots of our time in other folk ssessions helping with things like that. Can you link the session and maybe give us a heads up on what youexpect to happen (link to etherpad or agenda is good for that) | 20:39 |
| timrc | fungi: What is the curses slide deck software you used for your OSCON 2015 talk called again? | 20:39 |
| pabelanger | ianw: nibalizer https://review.openstack.org/#/c/231681/ | 20:39 |
| sdake | the etherpad isn't filled out yet | 20:39 |
| clarkb | timrc: presentty | 20:39 |
| sdake | but here is the session - sec | 20:40 |
| timrc | clarkb: Thanks | 20:40 |
| nibalizer | zaro: anteaya gerrit upgrade revviews done | 20:40 |
| *** heyongli has joined #openstack-infra | 20:40 | |
| sdake | https://etherpad.openstack.org/p/kolla-mitaka-all-sessions | 20:40 |
| sdake | thursday at 2:40 | 20:41 |
| zaro | nibalizer: thanks! | 20:41 |
| nibalizer | timrc: presentty? | 20:41 |
| sdake | basically clarkb we want mirrors of all of the external rpm repos we use | 20:41 |
| sdake | that are internal to openstack so we can vote our gates | 20:41 |
| *** sergmelikyan has quit IRC | 20:41 | |
| timrc | nibalizer: Yeah, that's it. | 20:41 |
| sdake | its probably 200-300gb of storage | 20:41 |
| *** sergmelikyan has joined #openstack-infra | 20:41 | |
| timrc | fungi: If you just wait long enough, questions directed to you may just get answered without you doing any of the work :) | 20:42 |
| asselin | Hi, I'm running into an issue where elastic recheck keeps spawning new processes every time there's an update. I noticed that there's no pid file being created. would an infra root be able to see if upstream has the same issue? /var/run/elastic-recheck/elastic-recheck.pid | 20:42 |
| sdake | not concerned with fast updates, once eveyr couple of days sync is good enough | 20:42 |
| nibalizer | i found that the current pip version of presentty is unable to pip install because of pillow issues | 20:42 |
| ianw | pabelanger: cool, yeah i think as we retire f21 we should move things to "fedora" | 20:42 |
| nibalizer | or maybe it can't install from git | 20:42 |
| nibalizer | or maybe jeblair fixed it | 20:42 |
| pabelanger | ianw: Ya, fedora-22, fedora-23, etc | 20:42 |
| timrc | nibalizer: Requires a little Pillo talk. That's all. | 20:42 |
| timrc | Pillow* | 20:42 |
| pabelanger | ianw: that ubuntu-trusty, centos-7, fedora-23 | 20:42 |
| *** gyee has joined #openstack-infra | 20:43 | |
| nibalizer | pabelanger: +2 | 20:43 |
| clarkb | sdake: distro mirrors are a thing that various groups hvae wanted. I think its mostly a matter of somoene doing the work | 20:43 |
| anteaya | nibalizer: thank you! | 20:43 |
| sdake | clarkb the problem is the usptream repos fail and then our gates fail, which means we can never make our gates voting, which means our gates are always busted | 20:43 |
| clarkb | sdake: write the puppet to run the mirror software, figure out how much cinder volume is required for it, then babysit it when the indexes break because distro mirroring seems to do that | 20:43 |
| clarkb | sdake: sure I am saying we just need someone to do the work | 20:43 |
| sdake | clarkb if I can find someone to do the work, infra can sponsor the effort financially? | 20:44 |
| clarkb | its been a thing that we have said ya lets do that its just lo wenough priority because the current setup sort of mostly works (I think fedora is actually the only one that fails consistently) | 20:44 |
| sdake | sorry wrong wording | 20:44 |
| sdake | i mean resource wise | 20:44 |
| sdake | not people resource hardware resource | 20:44 |
| *** notnownikki has quit IRC | 20:44 | |
| clarkb | sdake: yes we already run mirror hosts, we just need to have puppet configure the distro mirror and need to know how much disk you need upfront. Mordred would be ebetter person to ask as he has thought about this problem space a lot more | 20:45 |
| pabelanger | ianw: want to +1 workflow too? | 20:45 |
| clarkb | sdake: we will probably also ask that you don't limit yourself to rpms/fedora | 20:45 |
| sdague | zaro: neat about the gerrit hash tags, what is the state in 2.11? (you said they weren't fully baked) | 20:45 |
| pabelanger | ianw: now that we have 2 +2 | 20:45 |
| clarkb | sdake: if you want to do the owrk we will want it for ubuntu too | 20:45 |
| sdake | clarkb oh ya we want deb too sorry didnt' mention that | 20:45 |
| anteaya | and I think krotscheck has already stood up an npm mirror for something | 20:45 |
| *** skylerberg has quit IRC | 20:45 | |
| ianw | pabelanger: i'll just wait for jenkins | 20:45 |
| clarkb | anteaya: ya its mostly done I think we just need to redo the apache setup for pypi so they can live side by side | 20:45 |
| pabelanger | ianw: Perfect | 20:46 |
| anteaya | cool | 20:46 |
| anteaya | clarkb: on the same server you mean? | 20:46 |
| clarkb | anteaya: yes | 20:46 |
| anteaya | cool, thanks | 20:46 |
| sdake | clarkb i dont know a thing about puppet but I can see if I can find someone that does :) | 20:46 |
| *** bswartz has quit IRC | 20:46 | |
| sdake | and after that I can babysit the mirrors for our stuff | 20:46 |
| clarkb | anteaya: so we would hvae http://mirror.dfw.openstack.org/pypi and http://mirror.dfw.openstack.org/npm | 20:46 |
| *** baoli has quit IRC | 20:46 | |
| clarkb | anteaya: whereas right no / is pypi | 20:47 |
| sdake | i'll speak to mordred, but it sounds like what we are after is in the realm of possibility | 20:47 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources: Summit Application API https://review.openstack.org/221964 | 20:47 |
| anteaya | clarkb: which 404 right now | 20:47 |
| clarkb | s/right no/right now/ | 20:47 |
| *** baoli has joined #openstack-infra | 20:47 | |
| anteaya | clarkb: ah yeah, okay cool, thanks for explaining | 20:47 |
| clarkb | sdake: also at least in rax you can use their local mirror | 20:47 |
| *** achanda has joined #openstack-infra | 20:47 | |
| clarkb | if you want something for now | 20:47 |
| sdake | clarkb the mirrors are for things like rdo, ceph, etc | 20:48 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/shade: Normalize user information https://review.openstack.org/237774 | 20:48 |
| sdake | the distro mirrors work well enough for us already | 20:48 |
| clarkb | sdake: I don't think we would want to make super specialized mirrors | 20:49 |
| *** sergmelikyan has quit IRC | 20:49 | |
| sdake | its the things that dont hae any mirrors at all | 20:49 |
| clarkb | sdake: we would just want generic distro mirrors | 20:49 |
| clarkb | sdake: oh you mean pulling from rdo repo itself? | 20:49 |
| sdake | the problem is alot of mirrors we need are not in distro | 20:49 |
| *** baoli has quit IRC | 20:49 | |
| sdake | clarkb roger we do | 20:49 |
| *** heyongli has quit IRC | 20:49 | |
| sdake | clarkb half our gates install every bit of files in the rdo repos | 20:49 |
| *** baoli has joined #openstack-infra | 20:49 | |
| sdake | and we install all the ceph files | 20:50 |
| sdake | and a few other non-distro mirrors | 20:50 |
| sdake | that are properly licensed | 20:50 |
| SamYaple | does rdo package ceph sdake? | 20:50 |
| *** sergmelikyan has joined #openstack-infra | 20:50 | |
| *** heyongli has joined #openstack-infra | 20:50 | |
| sdake | rdo does not package ceph | 20:50 |
| SamYaple | i know cloud-archive does for ubuntu | 20:50 |
| SamYaple | hmm | 20:50 |
| clarkb | sdake: fwiw the mirrors would be expected to mirror the distros | 20:50 |
| nibalizer | okay im getting ready to do the zuul restart clarkb fungi | 20:50 |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: use cp always instead of mv / cp logic https://review.openstack.org/236901 | 20:50 |
| nibalizer | w/ zuul-changes do I have to get queues other than gate and check? http://docs.openstack.org/infra/zuul/zuul.html#starting-zuul | 20:51 |
| clarkb | sdake: adding extra stuff probably isn't a problem too, but we defnitely want that base | 20:51 |
| sdake | i'm good with mirroring all of rdo, is that what you mean? | 20:51 |
| clarkb | nibalizer: I normally just do check and gate | 20:51 |
| sdague | clarkb: hey, so how bad would it be to just do the cp all the time in d-g for cache as proposed here - https://review.openstack.org/236901 | 20:51 |
| sdake | or you mean all of epel ? | 20:51 |
| clarkb | sdague: no I mean all of fedora | 20:51 |
| *** dkranz has quit IRC | 20:51 | |
| clarkb | for x86_64 | 20:51 |
| sdake | ok well that is a much bigger disk chunk but i'd be good with that | 20:51 |
| sdake | if we could mirror *everything* we depend on I'd love that | 20:52 |
| sdake | that way if the mirror breaks, and our gate breaks, we can fix it in one place | 20:52 |
| clarkb | sdake: any idea how big f22 x86_64 is? | 20:52 |
| sdake | well we use centos | 20:52 |
| sdake | but I am not sure how large the mirror is no | 20:52 |
| clarkb | sdake: ok centos7 x86_64 then | 20:52 |
| nibalizer | okay, got the queues | 20:52 |
| nibalizer | stoppign zuul | 20:52 |
| sdake | I would expect very large however | 20:52 |
| sdake | 200gb perhaps | 20:53 |
| *** sridhar_ram1 has quit IRC | 20:53 | |
| sdake | but just atotal random guess | 20:53 |
| SamYaple | sdake: just the binary side, i dont think its that large | 20:53 |
| sdake | i can find out if it would help | 20:53 |
| *** baoli has quit IRC | 20:53 | |
| *** achanda has quit IRC | 20:53 | |
| greghaynes | sdake: clarkb http://dl.fedoraproject.org/pub/DIRECTORY_SIZES.txt | 20:53 |
| SamYaple | clarkb: just to be clear, does this mean you are also good with mirroring ubuntu-trusty? | 20:53 |
| *** pauloewerton has quit IRC | 20:53 | |
| *** eharney has quit IRC | 20:53 | |
| SamYaple | this will affect the work | 20:53 |
| *** baoli has joined #openstack-infra | 20:53 | |
| clarkb | sdake: well we just need to proprely size the volume ahead of time | 20:53 |
| sdake | clarkb ack, so there isn't reallly a cost issue on the disk size then? | 20:54 |
| clarkb | SamYaple: yes I think if we mirroed anything we would want to do it properly for ubuntu and centos/fedora | 20:54 |
| SamYaple | sounds good to me | 20:54 |
| clarkb | sdake: I mean they are donated resources so we try to us them properly | 20:54 |
| *** rfolco_ has quit IRC | 20:54 | |
| sdake | yes we want to mirror atleast ubuntu and centos | 20:54 |
| sdake | and i'd be good with fedora too | 20:54 |
| *** baoli has quit IRC | 20:55 | |
| *** sergmelikyan has quit IRC | 20:55 | |
| greghaynes | FWIW dib *really* wants fedora mirros because that is about 90% of our failures | 20:55 |
| *** sergmelikyan has joined #openstack-infra | 20:55 | |
| SamYaple | clarkb: looks like ubuntu is 777GB for a full mirror... | 20:55 |
| SamYaple | but thats probably source packages too | 20:55 |
| nibalizer | okay its back on, but the 'enqueue' commands are not working | 20:55 |
| sdake | fedora 20 looks like 90gb | 20:55 |
| clarkb | SamYaple: we don't want fuul | 20:56 |
| *** baoli has joined #openstack-infra | 20:56 | |
| clarkb | SamYaple: we are x86_64 only | 20:56 |
| clarkb | and we only use 1 release ish | 20:56 |
| clarkb | same with cnetos we wouldn't care about 6 only 7 | 20:56 |
| SamYaple | oh sure. let me figure that out for x86_64 and no source | 20:56 |
| clarkb | and for fedora we wouldn't care about 21 just 22 etc | 20:56 |
| nibalizer | nvm I think I figured it out | 20:56 |
| *** eharney has joined #openstack-infra | 20:56 | |
| clarkb | nibalizer: oyu may need sudo powers | 20:56 |
| *** sridhar_ram has joined #openstack-infra | 20:57 | |
| nibalizer | ya, zuul needed its configs | 20:57 |
| nibalizer | and -c /etc/zuul/zuul.conf didn't work | 20:57 |
| sdake | clarkb right I was just using it as a guess on size | 20:57 |
| clarkb | nibalizer: also, generally we do gate before check but not a big deal | 20:57 |
| sdake | so about 100gb for fedora | 20:57 |
| *** baoli has quit IRC | 20:57 | |
| nibalizer | still running, but i see things appearing in the status page | 20:57 |
| clarkb | sdake: according to the link greghaynes posted f22 is 24GB | 20:57 |
| *** alivigni has quit IRC | 20:58 | |
| clarkb | sdague: looking | 20:58 |
| sdake | for updates and x86_64? | 20:58 |
| *** baoli has joined #openstack-infra | 20:58 | |
| *** dramalho has quit IRC | 20:58 | |
| nibalizer | complete | 20:58 |
| clarkb | oh there is an everything path thats 72GB | 20:59 |
| clarkb | so 72GB for f22 | 20:59 |
| clarkb | 72G/pub/fedora/linux/releases/22/Everything/x86_64 | 20:59 |
| *** bdemers has quit IRC | 20:59 | |
| sdake | everything isn't the updates sdir tho | 20:59 |
| sdake | thats separate i think | 20:59 |
| sdake | so its everything + updates | 20:59 |
| SamYaple | yea i dont think 72gb is right | 20:59 |
| *** heyongli has quit IRC | 20:59 | |
| clarkb | wow I don't think fedora knows how english works | 20:59 |
| sdake | I could be wrong :) | 21:00 |
| sdake | wouldn't be first or last time | 21:00 |
| jesusaurus | why did zuul need a restart? | 21:00 |
| clarkb | jesusaurus: pick up a bugfix | 21:00 |
| jesusaurus | ah | 21:00 |
| *** sergmelikyan has quit IRC | 21:00 | |
| *** baoli has quit IRC | 21:00 | |
| *** sergmelikyan has joined #openstack-infra | 21:00 | |
| *** heyongli has joined #openstack-infra | 21:00 | |
| *** baoli has joined #openstack-infra | 21:01 | |
| clarkb | sdague: ya Ithink it was for space reasons, we would run out of disk on / just doing openstack things if we didn't clean up behind ourselves | 21:01 |
| sdague | clarkb: ok, but that doesn't seem to be the case atm | 21:01 |
| SamYaple | clarkb: im not going to guess. im going to do the mirror and du it. ill get back to you on the size | 21:02 |
| sdague | especially now that we don't go and slice off the lvm partition | 21:02 |
| clarkb | sdague: the lvm partition was always on a different device anyways | 21:02 |
| clarkb | sdague: the problem is that / runs out | 21:02 |
| clarkb | SamYaple: cool | 21:02 |
| sdague | clarkb: ok, so / is where /opt is? | 21:02 |
| *** dzamboni has quit IRC | 21:03 | |
| clarkb | sdague: no /opt is remounted ephemeral drive if it exists and / is the root device of the VM | 21:03 |
| SamYaple | nvm clarkb apt-mirror is clever. 82.6 GiB will be downloaded into archive. | 21:03 |
| sdague | clarkb: ah, so the concern is to delete the cache after we're good? | 21:03 |
| clarkb | sdague: yes | 21:03 |
| clarkb | sdague: so that myslq and other things not using /opt are happy | 21:03 |
| *** weshay has quit IRC | 21:03 | |
| *** regXboi has quit IRC | 21:03 | |
| SamYaple | ok did we get an exact number on centos 7? | 21:04 |
| *** burgerk_ has quit IRC | 21:04 | |
| SamYaple | ubuntu is ~83GB | 21:04 |
| sdague | clarkb: ok, has this failed like this any time in recent memory? | 21:04 |
| sdague | because this did pass all the tests | 21:04 |
| clarkb | sdague: no because we clean up the disk properly | 21:04 |
| sdake | apevec says rdo is about 600mb, so i think with 5 gb of storage there we wouldn't run out anytime soon | 21:04 |
| *** aeng has joined #openstack-infra | 21:04 | |
| sdague | clarkb: right, but when I moved to a straight cp, it passes all the tests as well | 21:04 |
| sdake | clarkb so the process should be for us to produce a list of mirrors we need and disk space usage, then submit that perhaps to the mailing lsit? | 21:05 |
| *** serg_melikyan has joined #openstack-infra | 21:05 | |
| clarkb | SamYaple: sdake so if we think large and figure 120GB per distro release + fudge factor for smaller repos we would be good | 21:05 |
| *** sergmelikyan has quit IRC | 21:05 | |
| SamYaple | clarkb: that sounds very good | 21:05 |
| clarkb | sdake: yes but did they run on both clouds? what about OVH with only 40GB of disk total? | 21:05 |
| SamYaple | the smaller repos are tiny, like 2-300mb most of the time | 21:05 |
| sdake | what is ovh? | 21:05 |
| clarkb | sdake: er sorry that was for sdague | 21:05 |
| nibalizer | its a new cloud provider | 21:05 |
| clarkb | tab complete fail | 21:06 |
| sdake | oh got it :) | 21:06 |
| sdake | get that alot | 21:06 |
| *** aysyd has quit IRC | 21:06 | |
| sdague | clarkb: so... how about if I mv to /opt/cache early | 21:06 |
| sdague | then cp -l from there | 21:06 |
| clarkb | sdague: well I am trying to understand why grenade fails at all | 21:06 |
| clarkb | sdague: because I distinctly remember fixing grenade | 21:06 |
| clarkb | we would do the cp to old then the mv to new | 21:06 |
| clarkb | thats why that flag exists | 21:06 |
| sdague | clarkb: nope, there is some code to do that, but apparently things keep getting refactored and the flags get dropped | 21:07 |
| clarkb | sdague: so why not just fix that? | 21:07 |
| sdague | because it's just going to get broken again | 21:07 |
| clarkb | it doesn't have to | 21:07 |
| *** achanda has joined #openstack-infra | 21:07 | |
| clarkb | sdague: I am just concerned that 2 weeks from now we will hvae a lot of flaky tests and no one will understand why | 21:08 |
| clarkb | and its because we reverted a fix to a known problem without proper testing | 21:08 |
| clarkb | rather than just fixing the fix to not break | 21:08 |
| clarkb | SamYaple: sdake: the other thing that mordred and jeblair were interested in was maybe using AFS for the mirrors but I don't think thats a strict requirements because both pypi and npm mirrors are just local disk to the cloud region | 21:09 |
| clarkb | SamYaple: sdake but probably good to get their input as a result | 21:09 |
| nibalizer | taron: did you rubber-duck to victory or do you still need me on hound? | 21:09 |
| sdake | afs is ? | 21:09 |
| clarkb | sdake: its like global nfs | 21:09 |
| SamYaple | lets let mordred work on shade.... :) | 21:09 |
| nibalizer | andrew filesystem | 21:09 |
| sdake | oh andrew file system? | 21:09 |
| nibalizer | its from the before times | 21:10 |
| krotscheck | sdake: Sorry, came late to this. | 21:10 |
| *** heyongli has quit IRC | 21:10 | |
| sdake | yes I am from before time :) | 21:10 |
| sdague | clarkb: ok, but did you understand my next fix | 21:10 |
| sdague | which is mv to /opt/cache, so we end up off of / | 21:10 |
| sdague | then cp -l from there | 21:10 |
| sdague | which means we can get the same results without a flag that will get lost | 21:10 |
| *** heyongli has joined #openstack-infra | 21:11 | |
| clarkb | sdague: the problem is that not all clouds have a separate disk for /opt | 21:11 |
| sdague | https://review.openstack.org/#/c/177017/28/devstack-vm-gate-wrap.sh,cm - patch that merged in May | 21:11 |
| clarkb | sdague: so that will work fine for rax and hpcloud but not ovh | 21:11 |
| clarkb | (not sure about bluebox cloud) | 21:11 |
| krotscheck | Did someone already mention that we want to rename pypi.<region>.openstack.org to mirrors.<region>.openstack.org? | 21:11 |
| sdague | clarkb: it will be exactly the same impact | 21:11 |
| sdague | as the "fixed" code | 21:11 |
| clarkb | sdague: no you will have two copies under /opt | 21:11 |
| sdague | no, I won't | 21:11 |
| sdague | *cp -l* | 21:11 |
| clarkb | oh you want to hardlink | 21:12 |
| sdague | yes | 21:12 |
| *** baoli has quit IRC | 21:12 | |
| sdague | I actually tried that as the first attempt, but the second filesystem got in the way | 21:12 |
| clarkb | hardlinking would be fine if we mv to /opt first as that should work if separate device exists and if not | 21:12 |
| *** baoli has joined #openstack-infra | 21:12 | |
| *** jsavak has quit IRC | 21:12 | |
| sdague | well, mv it unconditionally | 21:12 |
| sdague | there is no harm in moving if it's the same fs, it will just be a rename and be fast | 21:13 |
| clarkb | yes | 21:13 |
| openstackgerrit | Cyril Roelandt proposed openstack-infra/project-config: Add a gate-dsvm-functional-py34 job to Neutron https://review.openstack.org/233177 | 21:14 |
| clarkb | instead of cp -l could we just teach grenade and devstack to look at one location for the files? | 21:14 |
| *** trown is now known as trown|outttypeww | 21:14 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Decouple nodepool db and config from builders https://review.openstack.org/222398 | 21:14 |
| *** achanda has quit IRC | 21:15 | |
| *** abetterlie_ has quit IRC | 21:15 | |
| *** changbl has quit IRC | 21:15 | |
| clarkb | it looks like the copycache flag was removed as part of the ansible refactor, so that was missed | 21:16 |
| clarkb | I am happy to just add the flag back or do a hardlink that is device aware. But I don't think we should make >1 copy if we can avoid it | 21:17 |
| clarkb | hardlinking has the benefit of always being one copy regardless | 21:17 |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: use cp always instead of mv / cp logic https://review.openstack.org/236901 | 21:18 |
| *** tiswanso has quit IRC | 21:18 | |
| sdague | right, hardlinking seems better for something like this | 21:18 |
| *** mwagner_ has quit IRC | 21:19 | |
| sdague | ok, so lets see if that's usable | 21:19 |
| *** jamielennox is now known as jamielennox|away | 21:20 | |
| *** heyongli has quit IRC | 21:20 | |
| *** tiswanso has joined #openstack-infra | 21:20 | |
| *** heyongli has joined #openstack-infra | 21:21 | |
| clarkb | SamYaple: StevenK is the person to talk to about ubuntu mirrors too | 21:23 |
| clarkb | since he runs at least one set of mirrors and is ubuntuy | 21:23 |
| *** skylerberg has joined #openstack-infra | 21:23 | |
| SamYaple | yea i run one myself, but im not quite qure of the integration point with infra here | 21:23 |
| openstackgerrit | Sean Dague proposed openstack-infra/devstack-gate: use cp always instead of mv / cp logic https://review.openstack.org/236901 | 21:23 |
| nibalizer | clarkb: any objection or commentary on me running https://git.openstack.org/cgit/openstack-infra/system-config/tree/launch/README to build out the openstack-health server for mtreinish | 21:24 |
| sdague | clarkb: updated the commit message to reflect the latest version of the code | 21:24 |
| sdake | clarkb thanks a bunch for working with us on this - means alot for the kolla community | 21:25 |
| *** tiswanso has quit IRC | 21:25 | |
| sdake | our inability to have a voting gate really drags down our productivity | 21:25 |
| clarkb | SamYaple: currently we have a mirror host in each region that is configured by puppet so we would update the pupept there to add in the extra stuff | 21:26 |
| clarkb | SamYaple: and an infra root will hve to make sure we have enough disk | 21:26 |
| clarkb | but like I said would be good to get mordred to sanity check as I know he has thought about the problem a lot more than me | 21:26 |
| SamYaple | will do clarkb thanks for the infos | 21:26 |
| sdake | we spend all kinds of time bisecting broken changes | 21:26 |
| openstackgerrit | Merged openstack-infra/shade: Replace Bunch with compatible fork Munch https://review.openstack.org/237073 | 21:27 |
| clarkb | nibalizer: nope, the only thing I would keep in mind is that you want to make sure you boot a trusty host and I am not sure what flavor we think we need | 21:27 |
| SamYaple | I suppose ill finally have to dig into infra.... | 21:27 |
| clarkb | SamYaple: start in openstack-infra/system-config/manifests/site.pp | 21:27 |
| SamYaple | will do | 21:27 |
| *** rossella_s has joined #openstack-infra | 21:27 | |
| mtreinish | clarkb, nibalizer: fungi and I were briefly discussing it yesterday, we probably can start small | 21:27 |
| mtreinish | if we end up having load issues we can resize up to something bigger | 21:27 |
| clarkb | mtreinish: nibalizer cool, I would do maybe 4GB performance then | 21:27 |
| openstackgerrit | Merged openstack-infra/project-config: Match on dsvm-fedora-22 and dsvm-f21 nodes https://review.openstack.org/237771 | 21:27 |
| nibalizer | ok | 21:28 |
| nibalizer | so many firsts today | 21:28 |
| clarkb | nibalizer: that will require you set both the flavor and image explicitly | 21:28 |
| *** jamielennox|away is now known as jamielennox | 21:28 | |
| *** nadya has quit IRC | 21:28 | |
| *** thorst1 has quit IRC | 21:29 | |
| clarkb | nibalizer: feel free to run commands or whatever by me if you have questions | 21:30 |
| nibalizer | clarkb: http://paste.openstack.org/show/476920/ i get that just trying to flavor-list, what gives? | 21:30 |
| *** heyongli has quit IRC | 21:30 | |
| nibalizer | should i be using a novaclient from a venv in my users homedir? | 21:30 |
| taron | nibalizer: I think I rubber ducked to victory but see earlier highlights in here | 21:31 |
| taron | either way I probably won't need to poke you before devops | 21:31 |
| *** heyongli has joined #openstack-infra | 21:31 | |
| clarkb | nibalizer: nice I hvaen't seen that before | 21:31 |
| clarkb | nibalizer: let me try | 21:32 |
| nibalizer | taron: ok! | 21:32 |
| nibalizer | I didn't check your work but the logic was sound, if you have a refreshonly exec and nothing notifying it, it will never fire | 21:32 |
| taron | heh | 21:32 |
| taron | well, I have my problem then. | 21:32 |
| * taron will see how well they can write puppet whilst half awake in cs250 | 21:33 | |
| clarkb | nibalizer: the nova in /home/clarkb/venv/bin/nova works | 21:33 |
| clarkb | nibalizer: so I think novaclient has made a non backward compatible change for older clouds | 21:33 |
| *** salv-orlando has quit IRC | 21:33 | |
| clarkb | nibalizer: or maybe we need newer | 21:33 |
| clarkb | let me compare versions | 21:33 |
| nibalizer | ill try a venv and see where I get | 21:33 |
| clarkb | nibalizer: ya my venv has 2.26.0 which works but 2.32.0 does not | 21:34 |
| clarkb | sdague: ^ fyi | 21:34 |
| *** nadya has joined #openstack-infra | 21:34 | |
| *** lykinsb__ has quit IRC | 21:34 | |
| *** salv-orlando has joined #openstack-infra | 21:34 | |
| nibalizer | clarkb: fyi openstack 1.8.0 works | 21:35 |
| nibalizer | aka latest on pypi | 21:35 |
| *** achanda has joined #openstack-infra | 21:35 | |
| clarkb | sdake: your d-g patch is mostly ok except the first find mv moves to the wrong path | 21:35 |
| clarkb | er sdague ^ | 21:35 |
| clarkb | nibalizer: what about novaclient | 21:35 |
| nibalizer | i have 2.32.0 | 21:36 |
| nibalizer | haven't tried downgrading it | 21:36 |
| openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Create network-checker project https://review.openstack.org/235822 | 21:38 |
| clarkb | ianw: for https://review.openstack.org/#/c/236814/ isthere another change that adds bashate to the d-g job list? | 21:39 |
| clarkb | ianw: I am not seeing it in the list of check josb | 21:39 |
| pabelanger | ianw: might be back later tonight. Not sure yet. Want to try fedora-22 stuff for system-config | 21:39 |
| *** hashar has joined #openstack-infra | 21:40 | |
| *** heyongli has quit IRC | 21:40 | |
| *** baoli has quit IRC | 21:41 | |
| *** baoli has joined #openstack-infra | 21:41 | |
| *** heyongli has joined #openstack-infra | 21:42 | |
| *** nadya has quit IRC | 21:44 | |
| *** dizquierdo has joined #openstack-infra | 21:44 | |
| *** bpokorny has joined #openstack-infra | 21:46 | |
| *** alex_xu has quit IRC | 21:46 | |
| *** baoli has quit IRC | 21:47 | |
| *** achanda has quit IRC | 21:47 | |
| sdake | clarkb getting not registered images on centos builds | 21:47 |
| sdake | https://review.openstack.org/#/c/237722/ | 21:47 |
| *** alex_xu has joined #openstack-infra | 21:48 | |
| *** baoli has joined #openstack-infra | 21:48 | |
| clarkb | sdake: I think they need to be 'centos7' | 21:48 |
| clarkb | are those new jobs? | 21:48 |
| sdake | they are old | 21:48 |
| sdake | 3-4 months | 21:48 |
| sdake | there was a special override for them at one point someone added | 21:49 |
| sdake | I think you iirc | 21:49 |
| sdake | but it could have been someone else | 21:49 |
| sdake | it was a "buid-images" override | 21:49 |
| sdake | the override was designed to make it honor the distro name in the job rather then guess | 21:49 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Decouple nodepool db and config from builders https://review.openstack.org/222398 | 21:50 |
| sdake | i suspected someone would end up breaking it :) | 21:50 |
| *** dkranz has joined #openstack-infra | 21:50 | |
| *** heyongli has quit IRC | 21:51 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Decouple builders from nodepool instance https://review.openstack.org/232135 | 21:51 |
| *** heyongli has joined #openstack-infra | 21:52 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Builders can be run on their own https://review.openstack.org/232251 | 21:52 |
| *** amuller has quit IRC | 21:52 | |
| openstackgerrit | Emma Barber proposed openstack-infra/system-config: Add codesearch.o.o node and module https://review.openstack.org/216549 | 21:53 |
| *** bpokorny has quit IRC | 21:54 | |
| *** ociuhandu has quit IRC | 21:54 | |
| sdake | clarkb the only thing i can find that might be relevant is 29a714741b24c1247dfaf9fd2863fce3d8438602 | 21:56 |
| *** achanda has joined #openstack-infra | 21:57 | |
| sdake | but I dont know how that kolla_image_re thing works | 21:57 |
| sdake | not the faintest idea :) | 21:57 |
| openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Create network-checker project https://review.openstack.org/235822 | 21:57 |
| *** stevemar_ has quit IRC | 21:58 | |
| *** stevemar_ has joined #openstack-infra | 21:58 | |
| *** edmondsw has quit IRC | 21:59 | |
| *** hashar has quit IRC | 21:59 | |
| clarkb | sdake: do you have links to jobs that worked? | 22:01 |
| *** heyongli has quit IRC | 22:01 | |
| *** Piet has quit IRC | 22:01 | |
| sdake | clarkb yes i can find one | 22:01 |
| *** bpokorny has joined #openstack-infra | 22:01 | |
| sdake | https://review.openstack.org/#/c/237598/ | 22:01 |
| *** achanda has quit IRC | 22:02 | |
| sdake | note the gates sdont quite work - but atleast there isnt' a non-registered error :) | 22:02 |
| sdake | they fail because our gate is a leaky sieve | 22:02 |
| *** heyongli has joined #openstack-infra | 22:02 | |
| sdake | (hence the need for a mirror of our repos we depend on:) | 22:02 |
| *** stevemar_ has quit IRC | 22:02 | |
| *** dkranz has quit IRC | 22:02 | |
| *** eharney has quit IRC | 22:03 | |
| sdake | SamYaple said he did a recheck and zuul shows the jobs running | 22:03 |
| sdake | maybe enodepool went out to lunch for a short period? | 22:03 |
| clarkb | sdake: thats what I am beginning to think | 22:03 |
| sdake | cool | 22:03 |
| clarkb | sdake: zuul was restarted which restarts gearman | 22:04 |
| sdake | i'll just wait then, i'll be in contct if we get stuck | 22:04 |
| sdake | oh right a restart | 22:04 |
| sdake | that does it :) | 22:04 |
| clarkb | sdake: and if nodepool didn't register centos7 build hosts prior to your patch then NOT_REGISTERED | 22:04 |
| clarkb | sdake: so I would try a recheck and see if that makes it better | 22:04 |
| sdake | yup thanks | 22:04 |
| sdake | i thought maybe omeone broke that special regex logic we have | 22:04 |
| sdake | but soudns like no t :) | 22:04 |
| *** ociuhandu has joined #openstack-infra | 22:05 | |
| SamYaple | jobs are going as of about 10 minutes ago after a recheck | 22:05 |
| sdake | the reason we have the regex xlogic is we want to add a gate-kolla-build-images- oraclelinux | 22:05 |
| SamYaple | i wouldnt worry | 22:05 |
| *** claudiub has quit IRC | 22:05 | |
| sdake | and we wan't to use centos7 for that | 22:05 |
| *** doug-fish has quit IRC | 22:05 | |
| *** serg_melikyan has quit IRC | 22:05 | |
| sdake | but build oracleliux with it | 22:05 |
| sdake | so we ignore the distro name in our job name | 22:06 |
| anteaya | kevinbenton: sorry for the long delay | 22:06 |
| sdake | clarkb ^^ if that makees sense | 22:06 |
| anteaya | kevinbenton: was away yesterday, doing all the returning home things | 22:06 |
| clarkb | sdake: yup Iremember that now | 22:06 |
| openstackgerrit | Merged openstack/requirements: Updated from generate-constraints https://review.openstack.org/237420 | 22:06 |
| sdake | but wit hthe renames, we didn't get around to adding oralcelinux just yet | 22:06 |
| clarkb | and I have reread things and it should be working | 22:07 |
| sdake | I guess if I wasn't so jammed for time i'd do it now | 22:07 |
| clarkb | zuul restart is the culprit I think | 22:07 |
| sdake | cool thanks | 22:07 |
| anteaya | kevinbenton: what do you need to merge this patch? https://review.openstack.org/#/c/237741/ | 22:07 |
| anteaya | kevinbenton: who else has +2 on that repo? | 22:07 |
| *** baoli has quit IRC | 22:08 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Decouple nodepool db and config from builders https://review.openstack.org/222398 | 22:08 |
| *** baoli has joined #openstack-infra | 22:08 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Decouple builders from nodepool instance https://review.openstack.org/232135 | 22:08 |
| fungi | nibalizer: zuul restart went without a hitch? | 22:08 |
| *** ZZelle has quit IRC | 22:08 | |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Builders can be run on their own https://review.openstack.org/232251 | 22:08 |
| fungi | are we getting job stats again? | 22:08 |
| anteaya | kevinbenton: your rename patch looks good to me, and it is listed in the infra meeting agenda - well done, now we just have to schedule a rename window after summit | 22:10 |
| clarkb | fungi: it seems to have worked fine, haven't checked graphite yet and sdake did notice that centos7 jobs were NOT_REGISTERED for a bit | 22:10 |
| clarkb | fungi: also there is scrollback about distro mirros if you are interested | 22:10 |
| clarkb | fungi: also novaclient on puppetmaster is too new for rackspace | 22:11 |
| anteaya | clarkb fungi I'm going to request reviews on zaro's patches which create a 2.11.4 branch for him to work off of: https://review.openstack.org/#/q/status:open+project:openstack-infra/gerrit+branch:openstack/2.11.4+topic:gerrit-upgrade,n,z | 22:11 |
| clarkb | fungi: the novaclient (2.26.0) in my homedir venv does work | 22:11 |
| nibalizer | fungi: yep | 22:11 |
| *** heyongli has quit IRC | 22:11 | |
| anteaya | they already have nibalizer's +2s | 22:11 |
| anteaya | thank you nibalizer | 22:11 |
| *** achanda has joined #openstack-infra | 22:12 | |
| *** heyongli has joined #openstack-infra | 22:12 | |
| *** austin81 has left #openstack-infra | 22:13 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/diskimage-builder: Updated from global requirements https://review.openstack.org/237351 | 22:13 |
| openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Create network-checker project https://review.openstack.org/235822 | 22:14 |
| openstackgerrit | Merged openstack/diskimage-builder: Fix tests/test_functions.bash https://review.openstack.org/229334 | 22:15 |
| *** ZZelle has joined #openstack-infra | 22:17 | |
| anteaya | clarkb: thank you | 22:17 |
| ianw | clarkb: no, that's todo once it passes | 22:17 |
| fungi | clarkb: i want to say this is not the first time latest novaclient has stopped working on rackspace. what's the issue this time--do you know? | 22:17 |
| clarkb | fungi: microversions are not available in rax | 22:18 |
| clarkb | fungi: so I think its related to the old issue where it tries to list the versions andhits an api that is blocked or non existsant | 22:18 |
| *** sdake has quit IRC | 22:18 | |
| fungi | clarkb: and latest novaclient breaks anywhere with no microversion support? | 22:18 |
| *** gildub has joined #openstack-infra | 22:18 | |
| clarkb | fungi: it should probably fall back to base 2.0 api instead but I am not sure of all the specifics | 22:18 |
| clarkb | fungi: I guess? I only tried against rax after nibalizer ran into it | 22:18 |
| *** sdake has joined #openstack-infra | 22:18 | |
| fungi | johnthetubaguy: i know it's late there, but heads up ^ | 22:19 |
| fungi | jroll: you might be interested too, at least tangentially | 22:19 |
| *** armax has quit IRC | 22:19 | |
| mtreinish | fungi, clarkb: the microversion fixes should all be landed now | 22:19 |
| mtreinish | the latest should work | 22:19 |
| clarkb | also 2.32.0 is what failed | 22:20 |
| fungi | latest not yet released? | 22:20 |
| jroll | seems like novaclient should handle servers without microversion support... | 22:20 |
| openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Create network-checker project https://review.openstack.org/235822 | 22:20 |
| jroll | were nova microversions released in liberty or kilo? | 22:20 |
| clarkb | mtreinish: latest is what failed | 22:20 |
| mtreinish | fungi: latest released, sdague was in firedrill mode after the release using version discovery broke everything | 22:20 |
| jroll | (and why doesn't rackspace have it if it was released in kilo) | 22:20 |
| clarkb | was released 27 hours ago | 22:20 |
| *** rossella_s has quit IRC | 22:21 | |
| clarkb | jroll: its a load balancer/l7 firewall isse iiec | 22:21 |
| jroll | oh joy | 22:21 |
| * jroll assumes repose | 22:21 | |
| clarkb | mtreinish: so I think we rebroke it | 22:21 |
| *** nelsnelson has quit IRC | 22:21 | |
| *** heyongli has quit IRC | 22:21 | |
| *** asettle has joined #openstack-infra | 22:22 | |
| mtreinish | melwitt: ^^^ have you head about this? | 22:22 |
| *** heyongli has joined #openstack-infra | 22:22 | |
| openstackgerrit | Sridhar Ramaswamy proposed openstack-infra/project-config: Add tacker tarballs and python jobs https://review.openstack.org/235602 | 22:22 |
| openstackgerrit | Vladimir Kozhukalov proposed openstack-infra/project-config: Create fuel-menu project https://review.openstack.org/235177 | 22:23 |
| *** skylerberg has quit IRC | 22:23 | |
| *** tonytan4ever has quit IRC | 22:23 | |
| openstackgerrit | Merged openstack-infra/irc-meetings: Update tripleo meeting to weekly https://review.openstack.org/237609 | 22:24 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/puppet-elastic_recheck: Use the new --conf option to pass in values https://review.openstack.org/237796 | 22:24 |
| clarkb | jroll: nova has had the version url thing forever but classic security response is dont publish your version | 22:25 |
| clarkb | jroll: and everything breaks | 22:25 |
| jroll | clarkb: yeah, I was just surprised I guess | 22:25 |
| jroll | dunno why | 22:25 |
| anteaya | tonyb: I see I am the only reviewer so far on the latest patchset for getting the skipped meetings feature into yaml2ical: https://review.openstack.org/#/c/232312/ | 22:26 |
| mtreinish | clarkb: I wonder if this is part of the problem: https://review.openstack.org/#/c/230024/ | 22:26 |
| mtreinish | that was included in 2.32.0 which released recently | 22:27 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/puppet-elastic_recheck: Use the new --conf option to pass in values https://review.openstack.org/237796 | 22:27 |
| tonyb | anteaya: Yeah, this is true. ttx is busy and he needs to at least +2 them. | 22:27 |
| fungi | mtreinish: clarkb: where "recently" means... yesterday | 22:27 |
| tonyb | anteaya: then there is the process of releaseing yaml2ical. | 22:27 |
| anteaya | tonyb: okay so I guess it won't happen before this summit | 22:28 |
| anteaya | tonyb: thank you for listening to me and for trying | 22:28 |
| anteaya | tonyb: you are awesome | 22:28 |
| anteaya | tonyb: well we will have them for christmas then maybe | 22:28 |
| tonyb | anteaya: it's looking that way. | 22:28 |
| mtreinish | fungi: did nodepool get updated though? because if this was an issue I'm surprised we're not seeing it there | 22:28 |
| anteaya | tonyb: yup | 22:28 |
| clarkb | mtreinish: no it hasnt | 22:29 |
| anteaya | tonyb: just wanted to say how much I appreciate your work here | 22:29 |
| anteaya | tonyb: thank you | 22:29 |
| clarkb | would require nodepool patch to merge and restart the service | 22:29 |
| tonyb | anteaya: You're very welcome. | 22:29 |
| anteaya | tonyb: :) | 22:29 |
| mtreinish | clarkb: ah ok. That's probably a good policy | 22:29 |
| *** jamielennox is now known as jamielennox|away | 22:31 | |
| *** heyongli has quit IRC | 22:32 | |
| *** heyongli has joined #openstack-infra | 22:33 | |
| melwitt | mtreinish: have not heard about it until now | 22:34 |
| *** baoli has quit IRC | 22:34 | |
| * nibalizer runs launch_node | 22:35 | |
| nibalizer | (using novaclinet 2.26.0) | 22:35 |
| clarkb | nibalizer: you set trusty PVHVM image and 4GB performance flavor? | 22:35 |
| *** baoli has joined #openstack-infra | 22:35 | |
| clarkb | melwitt: basically it looks like novaclient is looking to negotiate versions again even if the cloud doesn't allow that | 22:35 |
| clarkb | melwitt: I can probably get --debug output if that will help | 22:35 |
| nibalizer | actually, I didn't | 22:35 |
| clarkb | nibalizer: :) | 22:36 |
| nibalizer | https://git.openstack.org/cgit/openstack-infra/system-config/tree/launch/README#n15 doesn't have an 'image' setting in the rackspace area | 22:36 |
| clarkb | nibalizer: it does in the next section | 22:36 |
| nibalizer | hwoever, launch_node failed on not having paramiko available to import, so I'm saved | 22:36 |
| nibalizer | yea | 22:36 |
| clarkb | woot | 22:36 |
| *** jongchoi has joined #openstack-infra | 22:36 | |
| clarkb | nibalizer: so you want to use the dotfile from the first section but invoke launch_node like the second section to specify flavor and image | 22:36 |
| *** jongchoi has quit IRC | 22:36 | |
| nibalizer | IMAGE='Ubuntu 14.04 LTS (Trusty Tahr) (PVHVM)' seem right to you? | 22:36 |
| clarkb | I wonder why we pretend that defaults are ever what we want | 22:36 |
| clarkb | nibalizer: yes | 22:36 |
| nibalizer | cool | 22:37 |
| clarkb | PVHVM is the important modifier | 22:37 |
| openstackgerrit | Hongbin Lu proposed openstack-infra/project-config: Magnum: run functional test in liberty branch https://review.openstack.org/237798 | 22:37 |
| clarkb | nibalizer: and flavor-list should igve you a list of flavors you want performance | 22:37 |
| nibalizer | its working! | 22:37 |
| clarkb | nibalizer: and I think 4GB | 22:37 |
| nibalizer | and urrlib3 loves to errror | 22:37 |
| *** gordc has quit IRC | 22:37 | |
| clarkb | which may actually be the default | 22:37 |
| nibalizer | I have a flavor set | 22:37 |
| melwitt | clarkb: hm, okay. and 2.31.0 was working fine? | 22:38 |
| nibalizer | the insecure platform setting stuff is really quite irritating | 22:38 |
| clarkb | melwitt: sdague did a bunch of work to make sure some recent release worked. I will confirm 2.31.0 works or doesn | 22:38 |
| clarkb | nibalizer: yes | 22:38 |
| *** annegentle has quit IRC | 22:39 | |
| clarkb | melwitt: confirmed that 2.31.0 works against rax | 22:39 |
| *** dimtruck is now known as zz_dimtruck | 22:40 | |
| melwitt | clarkb: okay, thanks. looking to see what could have caused it | 22:40 |
| anteaya | fungi: your patch merged, bigswitch lives again: http://git.openstack.org/cgit/stackforge/networking-bigswitch/tree/ | 22:41 |
| nibalizer | puppet running on hte new node | 22:41 |
| *** heyongli has quit IRC | 22:42 | |
| *** bpokorny has quit IRC | 22:42 | |
| anteaya | nibalizer: \o/ | 22:43 |
| *** heyongli has joined #openstack-infra | 22:43 | |
| *** sabeen has quit IRC | 22:44 | |
| *** nadya has joined #openstack-infra | 22:45 | |
| *** ddieterl_ has quit IRC | 22:45 | |
| clarkb | nibalizer: at the end it will print out a list of commands to run to set up dns, I personally like to ssh into the ip address first and do some initial poking around before commiting to the dns records | 22:46 |
| clarkb | nibalizer: simplifies cleanup if something went horribly wrong | 22:46 |
| nibalizer | cool | 22:46 |
| nibalizer | so the dns is an api but not designate? | 22:46 |
| clarkb | nibalizer: correct | 22:46 |
| *** baoli has quit IRC | 22:46 | |
| nibalizer | oh wow 'rackdns rdns-create' ya thats janky | 22:48 |
| nibalizer | well at least there is an api! | 22:48 |
| *** sdake_ has joined #openstack-infra | 22:48 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 22:49 | |
| *** sdake has quit IRC | 22:49 | |
| nibalizer | ok dns 'created' | 22:49 |
| *** nadya has quit IRC | 22:49 | |
| nibalizer | I don't want to bust my cache when it wont work but I'll verify in a few minutes | 22:50 |
| nibalizer | now doing the host key dance | 22:50 |
| nibalizer | mtreinish: errors: http://health.openstack.org/ ! | 22:51 |
| nibalizer | but we have them | 22:51 |
| *** EricGonczer_ has joined #openstack-infra | 22:51 | |
| mtreinish | nibalizer: cool | 22:51 |
| mtreinish | so that's actually a bug in openstack-health there isn't a response on / | 22:52 |
| *** heyongli has quit IRC | 22:52 | |
| *** EricGonc_ has joined #openstack-infra | 22:53 | |
| mtreinish | but it doesn't look like it's setup properly: http://health.openstack.org/tests | 22:53 |
| mtreinish | still returns a 404 | 22:53 |
| *** heyongli has joined #openstack-infra | 22:53 | |
| nibalizer | hrm | 22:53 |
| clarkb | nibalizer: first plcae I would look is /var/log/apache2/error_log | 22:54 |
| clarkb | then the site specific error_log | 22:54 |
| *** marcusvrn_ has quit IRC | 22:55 | |
| openstackgerrit | Spencer Krum proposed openstack-infra/system-config: Use the 40char fingerprint of the puppetlabs key https://review.openstack.org/237802 | 22:55 |
| *** EricGonczer_ has quit IRC | 22:56 | |
| clarkb | nibalizer: ^ I thought we already made that change/ | 22:56 |
| nibalizer | clarkb: thats possible? | 22:56 |
| nibalizer | i'm still getting the error so | 22:56 |
| nibalizer | i made the change | 22:56 |
| *** shashank_hegde has quit IRC | 22:56 | |
| clarkb | ok I will have to look closer | 22:57 |
| *** jhesketh has quit IRC | 23:00 | |
| *** denisra has quit IRC | 23:01 | |
| clarkb | nibalizer: Target WSGI script not found or unable to stat: /opt/openstack-health/.venv/bin/openstack-health | 23:02 |
| *** shashank_hegde has joined #openstack-infra | 23:02 | |
| nibalizer | also our puppet code isn't converging | 23:02 |
| *** heyongli has quit IRC | 23:02 | |
| *** heyongli has joined #openstack-infra | 23:03 | |
| nibalizer | http://paste.openstack.org/show/476932/ | 23:03 |
| mtreinish | clarkb: hmm, it should be installing into a venv. I didn't write that puppet, let me check | 23:03 |
| *** jhesketh has joined #openstack-infra | 23:03 | |
| nibalizer | thanks for your help today clark with zuul and launching nodes | 23:04 |
| clarkb | there is a .venv there | 23:05 |
| clarkb | so guessing that it just didn't install right? | 23:05 |
| mtreinish | clarkb: yeah, from nibalizer's paste it doesn't look like the install ever got triggered | 23:06 |
| openstackgerrit | Ian Wienand proposed openstack-infra/project-config: Add bashate test to devstack-gate https://review.openstack.org/237803 | 23:06 |
| mtreinish | http://git.openstack.org/cgit/openstack-infra/puppet-openstack-health/tree/manifests/api.pp | 23:06 |
| *** salv-orlando has quit IRC | 23:06 | |
| *** yamahata__ has quit IRC | 23:11 | |
| mtreinish | nibalizer: hmm, from that paste it doesn't look like it cloned properly | 23:11 |
| *** alex_xu has quit IRC | 23:11 | |
| mtreinish | bzr wasn't the right choice :) | 23:11 |
| *** isq has joined #openstack-infra | 23:12 | |
| clarkb | the repo dir did exist | 23:12 |
| *** alex_xu has joined #openstack-infra | 23:12 | |
| melwitt | clarkb: what error do you see from novaclient when you run it against rax? I think the patch mtreinish linked earlier is probably responsible but I don't yet see how | 23:13 |
| *** heyongli has quit IRC | 23:13 | |
| mtreinish | clarkb: hmm, then I dunno | 23:13 |
| clarkb | melwitt: ERROR (UnsupportedVersion): Server doesn't support microversions | 23:13 |
| *** heyongli has joined #openstack-infra | 23:14 | |
| *** bpokorny has joined #openstack-infra | 23:14 | |
| clarkb | I can paste a traceback if yo uwant it too | 23:15 |
| melwitt | clarkb: okay, that's what I expected. and I see why that change caused it | 23:15 |
| *** xyang1 has quit IRC | 23:15 | |
| melwitt | clarkb: yeah, we need to open a bug about this anyway. can put the trace in there | 23:16 |
| clarkb | melwitt: ok I will start that | 23:17 |
| mtreinish | clarkb, nibalizer: actually the install in the venv says it's running, it's an exec I didn't realize that | 23:17 |
| openstackgerrit | Merged openstack-infra/devstack-gate: Remove jeepyb and pypi-mirror from PROJECTS https://review.openstack.org/235506 | 23:17 |
| melwitt | clarkb: thanks | 23:18 |
| mtreinish | although that probably should have a subscribe on the vcsrepo to trigger re-installing on new commits. But, that's probably a follow on fix | 23:18 |
| clarkb | melwitt: https://bugs.launchpad.net/python-novaclient/+bug/1508244 | 23:19 |
| openstack | Launchpad bug 1508244 in python-novaclient "Version 2.32.0 doesn't work against rackspace" [Undecided,New] | 23:19 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Add dib deletion test https://review.openstack.org/215275 | 23:21 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image delete using gearman https://review.openstack.org/198114 | 23:21 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image uploads using gearman https://review.openstack.org/197722 | 23:21 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Builders can be run on their own https://review.openstack.org/232251 | 23:21 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Decouple builders from nodepool instance https://review.openstack.org/232135 | 23:21 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Make secure.conf optional and backwards-compat https://review.openstack.org/232800 | 23:21 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Move nodepool config loading into module https://review.openstack.org/231592 | 23:21 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Trigger image builds using gearman https://review.openstack.org/195175 | 23:21 |
| openstackgerrit | greghaynes proposed openstack-infra/nodepool: Decouple nodepool db and config from builders https://review.openstack.org/222398 | 23:21 |
| *** armax has joined #openstack-infra | 23:22 | |
| *** heyongli has quit IRC | 23:23 | |
| *** heyongli has joined #openstack-infra | 23:24 | |
| *** EricGonc_ has quit IRC | 23:25 | |
| *** EricGonczer_ has joined #openstack-infra | 23:26 | |
| openstackgerrit | Sridhar Ramaswamy proposed openstack-infra/project-config: Add tacker tarballs and python jobs https://review.openstack.org/235602 | 23:26 |
| *** yamamoto has joined #openstack-infra | 23:28 | |
| sridhar_ram | infra-team: trying line up things to push pypi packages for tacker project. This will be our first time pushing pkg. I'm looking for the minimal recipe required to do this. I gave an attempt using https://review.openstack.org/#/c/235602/ but I'm not 100%. Looking for your guidance & help. Thanks! | 23:29 |
| mordred | clarkb, melwitt: should we just ban 2.32.0 in our things for now? | 23:29 |
| nibalizer | mtreinish: 'using bzr' its just puppet being confused, it can be ignored | 23:30 |
| nibalizer | very old bug | 23:30 |
| mordred | nibalizer: aren't we switching to a git module at some point? | 23:31 |
| *** angdraug has quit IRC | 23:31 | |
| nibalizer | yes | 23:31 |
| mtreinish | nibalizer: yeah, clarkb said the repo was there | 23:32 |
| crinkle | the upstream vcsrepo fixed that bug btw | 23:32 |
| mtreinish | nibalizer: do you have any ideas on what is going wrong? | 23:32 |
| nibalizer | mordred: already started: https://review.openstack.org/#/c/235389/ | 23:32 |
| *** jamielennox|away is now known as jamielennox | 23:32 | |
| mordred | cinerama: :) | 23:33 |
| mordred | gah | 23:33 |
| mordred | crinkle: :) | 23:33 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Support private address override in inventory https://review.openstack.org/237809 | 23:33 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Use OCC to create clouds in inventory https://review.openstack.org/237810 | 23:33 |
| mordred | cinerama: you can also have a :) | 23:33 |
| *** heyongli has quit IRC | 23:33 | |
| crinkle | :) | 23:34 |
| *** heyongli has joined #openstack-infra | 23:34 | |
| *** yamamoto has quit IRC | 23:34 | |
| nibalizer | mordred: looking | 23:34 |
| *** jaypipes has quit IRC | 23:36 | |
| *** ZZelle has quit IRC | 23:37 | |
| melwitt | mordred: I wasn't sure if we should revert and release a new version vs ban 2.32.0 | 23:37 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: Support private address override in inventory https://review.openstack.org/237809 | 23:37 |
| nibalizer | so yea we're refenrecening a wsgi file that doesn't exist | 23:37 |
| nibalizer | I don't see where in the module it sets up the wsgi script | 23:37 |
| *** Sukhdev has joined #openstack-infra | 23:38 | |
| mtreinish | nibalizer: which file? | 23:38 |
| nibalizer | WSGIScriptAlias / /opt/openstack-health/.venv/bin/openstack-health | 23:38 |
| nibalizer | that file doesn't exist | 23:38 |
| pabelanger | any core have some spare time to troubleshoot grafana.o.o and see if there are puppet errors? | 23:38 |
| nibalizer | maybe it was supposed to be created by pip install? | 23:38 |
| mtreinish | nibalizer: that should be installed when the python package gets installed | 23:38 |
| mordred | melwitt: good question. I may put a !2.32.0 in shade anyway just on general principle | 23:39 |
| mtreinish | openstack-health is the wsgi_script entrypoint that pbr will automagically create for us: http://git.openstack.org/cgit/openstack/openstack-health/tree/setup.cfg#n30 | 23:39 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade: python-novaclient does not work against rackspace https://review.openstack.org/237811 | 23:40 |
| *** skylerberg has joined #openstack-infra | 23:40 | |
| openstackgerrit | Ivan Udovichenko proposed openstack-infra/project-config: Adds the 1st initial package for upstream infra packaging https://review.openstack.org/216292 | 23:40 |
| nibalizer | Notice: /Stage[main]/Openstack_health::Api/Exec[package-application]/returns: executed successfully | 23:40 |
| nibalizer | let me try the pip install manually | 23:41 |
| *** bpokorny has quit IRC | 23:41 | |
| *** fitoduarte has joined #openstack-infra | 23:42 | |
| nibalizer | ah I think its currently | 23:42 |
| nibalizer | WSGIScriptAlias / /opt/openstack-health/.venv/bin/openstack-health | 23:42 |
| nibalizer | and it should be | 23:42 |
| nibalizer | WSGIScriptAlias / /opt/openstack-health/.venv/bin/openstack-health | 23:42 |
| nibalizer | er /opt/openstack-health/.venv/bin/openstack-health-api | 23:42 |
| *** dizquierdo has quit IRC | 23:42 | |
| melwitt | mordred: okay. I'll post on the ML about it to get some input about a revert | 23:42 |
| tlbr | could you please merge https://review.openstack.org/#/c/216292 we rebased it too many times | 23:43 |
| mtreinish | nibalizer: openstack-health-api is something different | 23:43 |
| tlbr | i'm just getting desperate | 23:43 |
| nibalizer | oh :( | 23:43 |
| mtreinish | it's just for local debugging, it's not a real wsgi script | 23:43 |
| mtreinish | nibalizer: oh, what is the pbr version in the venv? | 23:43 |
| *** heyongli has quit IRC | 23:43 | |
| mtreinish | I wonder if pbr is too old, so it doesn't know the wsgi_scripts stuff | 23:44 |
| *** heyongli has joined #openstack-infra | 23:44 | |
| pabelanger | Cannot remember, are updates to zuul/openstack_functions.py realtime or does zuul need to be restarted? | 23:44 |
| mordred | \o/ | 23:44 |
| *** dims_ has quit IRC | 23:45 | |
| mordred | I would now like to announce that all of the old OpenStack modules in ansible have been derecated and replaced with new shade-based ones | 23:45 |
| nibalizer | mordred: looks like 1.8.1 | 23:45 |
| pabelanger | Ah crap | 23:45 |
| pabelanger | I know why | 23:45 |
| *** dims has joined #openstack-infra | 23:46 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config: Run puppet-apply tests with fedora 22 https://review.openstack.org/231681 | 23:46 |
| mtreinish | nibalizer: hmm that's the latest | 23:46 |
| pabelanger | okay, maybe not | 23:46 |
| mtreinish | I guess it's not that | 23:46 |
| nibalizer | mtreinish: i verified locally that pip install of the head of openstakc-health produces the openstack-health file in bin | 23:46 |
| *** camunoz_gone is now known as camunoz | 23:46 | |
| pabelanger | ianw: seems zuul thinks gate-infra-puppet-apply-dsvm-fedora-22 still not registered\ | 23:47 |
| pabelanger | can only think the update for openstack_functions.py is not live yet | 23:47 |
| ianw | did we all miss somthing in the regex ...? | 23:47 |
| mtreinish | nibalizer: :/ I wonder why it's not working in that venv | 23:48 |
| ianw | pabelanger: or, there was a restart, maybe test got hit by that (https://review.openstack.org/#/c/236901/ had issues with centos7 too) | 23:48 |
| pabelanger | ianw: hmm, curious to see what zuul logs report | 23:49 |
| mtreinish | nibalizer: nuke the venv and try again? :) | 23:49 |
| nibalizer | so I just made a new venv, as my nibz user | 23:50 |
| nibalizer | and installed from /opt/openstack-health and it didn't produce the wsgi script | 23:50 |
| nibalizer | whats the official name? wsgi script? wsgi entrypoint? | 23:50 |
| openstackgerrit | Dave McCowan proposed openstack-infra/project-config: Add Project Marshal https://review.openstack.org/234530 | 23:50 |
| openstackgerrit | Sridhar Ramaswamy proposed openstack-infra/project-config: Add tacker tarballs and python jobs https://review.openstack.org/235602 | 23:51 |
| *** sridhar_ram has quit IRC | 23:51 | |
| mtreinish | nibalizer: dunno, I call it the wsgi_script entrypoint | 23:51 |
| mtreinish | nibalizer: hmm, is the repo up to date? | 23:51 |
| *** thorst has joined #openstack-infra | 23:52 | |
| mtreinish | nibalizer: the entrypoint was added a while ago: http://git.openstack.org/cgit/openstack/openstack-health/commit/?id=0dcbd6e583df294e690a013c1788968e58e3082c | 23:52 |
| nibalizer | ya so I just ran git clone openstack-health; pip install openstack-health on my machine and it produced the wsgi entrypoint | 23:53 |
| nibalizer | then I ran the same set of commands on the health node (as my user) and it didn't produce the wsgi entrypoin | 23:54 |
| nibalizer | which is pretty confusing | 23:54 |
| *** heyongli has quit IRC | 23:54 | |
| mtreinish | nibalizer: yeah, that is bizarre | 23:54 |
| nibalizer | can you try, and give me another datapoint? | 23:54 |
| mtreinish | nibalizer: check the pip version in the virtualenv maybe? | 23:54 |
| *** heyongli has joined #openstack-infra | 23:55 | |
| mtreinish | I'm wondering if the venv is using the ubuntu package which will be older everything | 23:55 |
| mtreinish | nibalizer: it works locally for me, I've been playing with things locally for a couple of weeks | 23:55 |
| nibalizer | 7.1.0 on the host, 7.0.1 on my laptop | 23:55 |
| mtreinish | nibalizer: in the health.o.o venv? virtualenv will bundle pip | 23:56 |
| nibalizer | ya by host i mean a venv I created on health.o.o | 23:56 |
| *** alivigni has joined #openstack-infra | 23:57 | |
| mtreinish | hmm, I'm running 7.1.2 locally, but none of those are old enough to be the cause | 23:57 |
| mtreinish | mordred: ^^^ do you have any ideas? | 23:57 |
| mtreinish | weird python packaging behavior is your cup of tea | 23:57 |
| nibalizer | also the python/virtualenv on openstack systems are provided by get-pip I think | 23:57 |
| nibalizer | so we're likely not (directly) hitting a 'trusty is old' issue | 23:58 |
| *** Swami has quit IRC | 23:58 | |
| mtreinish | nibalizer: well I was thinking maybe the puppet modules had a dep on the apt package or something | 23:58 |
| mtreinish | I didn't know where the virtualenv module came from | 23:58 |
| openstackgerrit | Lucas Alvares Gomes proposed openstack/diskimage-builder: Install IPA in a virtual enviroment https://review.openstack.org/235843 | 23:59 |
| nibalizer | mtreinish: http://paste.openstack.org/show/476935/ | 23:59 |
| ianw | pabelanger: yeah, devstack experimental not working either. regex seems ok | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!