| *** spzala has quit IRC | 00:00 | |
| tonyb | clarkb: :) | 00:00 |
|---|---|---|
| *** spzala has joined #openstack-infra | 00:00 | |
| clarkb | tonyb: you I am pretty sure must have a couple clones sitting in the office with you | 00:00 |
| jhesketh | clarkb: I'm around, although in approximately 1.5 hours I will be in meetings | 00:01 |
| *** spzala has joined #openstack-infra | 00:01 | |
| clarkb | jhesketh: ok ~1.5 ish hours is when the current image uploads will time out in nodepoold and I wanted to wait for that to happen before restarting to apply the fix for the timeouts | 00:01 |
| *** zul has quit IRC | 00:01 | |
| *** spzala has quit IRC | 00:01 | |
| tonyb | clarkb: thanks :) | 00:01 |
| *** spzala has joined #openstack-infra | 00:01 | |
| tonyb | clarkb: I just make a lot of noise ;P | 00:01 |
| *** xarses has quit IRC | 00:01 | |
| pabelanger | ianw: to add to your review queue: https://review.openstack.org/366862 another glean update | 00:02 |
| *** tphummel has quit IRC | 00:03 | |
| jhesketh | clarkb: ah, so you're hanging around to restart it ? | 00:03 |
| clarkb | jhesketh: ya | 00:03 |
| jhesketh | cool, well I should be around | 00:03 |
| clarkb | ok thanks | 00:03 |
| *** spzala has quit IRC | 00:04 | |
| ianw | pabelanger: ok :) yeah i am around | 00:06 |
| ianw | looking at merging a bunch of dib 2.0 stuff atm | 00:06 |
| pabelanger | ianw: k | 00:08 |
| pabelanger | pushing up a new patch, figured out my gentoo issue | 00:08 |
| clarkb | pabelanger: did you build a gentoo image to test? | 00:08 |
| pabelanger | clarkb: I have not | 00:08 |
| pabelanger | We should do that to be safe | 00:08 |
| *** kzaitsev_mb has quit IRC | 00:08 | |
| clarkb | aww, I was hoping you did just beacuse making random gentoo thing to test openrc + glean seems like a fun thing :P | 00:08 |
| pabelanger | Well, since I've never used gentoo could be some fun | 00:09 |
| ianw | pabelanger: i started on a larger refactor, espeically around some of the interface matching, etc but lost motivation pretty quickly | 00:10 |
| ianw | the other thing i had a poke at was using a virtual-filesystem for the test-cases. the patching etc atm is barely hanging together imo | 00:11 |
| *** Benj_ has quit IRC | 00:12 | |
| pabelanger | okay, I fail | 00:12 |
| *** zhurong has quit IRC | 00:12 | |
| pabelanger | how should I be line wrapping: http://paste.openstack.org/show/568487/ | 00:12 |
| ianw | pabelanger: umm, split it up :) | 00:13 |
| anteaya | tonyb: depends on what you want from the third party ci | 00:13 |
| anteaya | tonyb: you can just email them if you like, you can email them and cc the infra list if you like | 00:14 |
| anteaya | tonyb: your call based on what you want to accomplish | 00:14 |
| tonyb | anteaya: I want them to updated a config setting and hopfully with haste ;P | 00:15 |
| tonyb | anteaya: I'd use IRC but the point of contact isn't around | 00:15 |
| anteaya | either if fine then | 00:15 |
| anteaya | yup | 00:15 |
| anteaya | do you want them disabled if they don't respond/ | 00:15 |
| anteaya | ? | 00:15 |
| anteaya | if yes ccing infra is the way to go | 00:15 |
| openstackgerrit | Paul Belanger proposed openstack-infra/glean: Append to interface definition for multi-address https://review.openstack.org/366862 | 00:22 |
| openstackgerrit | Paul Belanger proposed openstack-infra/glean: Index networks using id, not links https://review.openstack.org/366937 | 00:22 |
| pabelanger | ianw: okay^ should be good now | 00:22 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add IMAGE_ELEMENT_YAML https://review.openstack.org/335265 | 00:23 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Making element overriding explicit https://review.openstack.org/334785 | 00:23 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Convert pkg-map and svc-map copies to explicit variables https://review.openstack.org/335308 | 00:23 |
| *** Apoorva_ has joined #openstack-infra | 00:24 | |
| ianw | pabelanger: i might have to get a coffee before i context switch into those :) | 00:25 |
| pabelanger | ianw: indeed | 00:25 |
| clarkb | fungi: thank you for responding to the ES on cloud thread. I kept meaning to then never did it | 00:26 |
| *** adrian_otto has quit IRC | 00:26 | |
| *** Apoorva has quit IRC | 00:27 | |
| *** claudiub|2 has quit IRC | 00:28 | |
| *** Apoorva_ has quit IRC | 00:28 | |
| *** harlowja has joined #openstack-infra | 00:29 | |
| *** roxanaghe has quit IRC | 00:30 | |
| ianw | ok, does anyone know how to get git review to switch a patch series to a new branch? | 00:36 |
| clarkb | ianw: git review $branch | 00:37 |
| clarkb | or edit.gitreview | 00:38 |
| ianw | clarkb: that's what i thought, but "no new changes" | 00:38 |
| *** tqtran has quit IRC | 00:39 | |
| *** akshai has joined #openstack-infra | 00:39 | |
| clarkb | if the commita dont chamge it may not let you | 00:39 |
| ianw | hmm, ok | 00:40 |
| openstackgerrit | Shu Muto proposed openstack-infra/project-config: Add new project Zun-UI to openstack repo https://review.openstack.org/366489 | 00:40 |
| *** kaisers1 has joined #openstack-infra | 00:42 | |
| *** Mary has joined #openstack-infra | 00:42 | |
| *** shu-mutou-AFK is now known as shu-mutou | 00:43 | |
| *** kaisers has quit IRC | 00:43 | |
| *** Mary is now known as Guest9052 | 00:43 | |
| *** thorst has joined #openstack-infra | 00:43 | |
| *** ddieterly has joined #openstack-infra | 00:44 | |
| clarkb | downto 15 image uploads with half an hour to go | 00:44 |
| *** Guest9052 has quit IRC | 00:47 | |
| *** Julien-zte has joined #openstack-infra | 00:48 | |
| *** spzala has joined #openstack-infra | 00:48 | |
| *** yanyanhu has joined #openstack-infra | 00:48 | |
| *** akshai has quit IRC | 00:48 | |
| *** gyee_ has quit IRC | 00:48 | |
| *** eharney has quit IRC | 00:49 | |
| *** dahoo has quit IRC | 00:51 | |
| *** gouthamr_ has quit IRC | 00:51 | |
| anteaya | I haven't been keeping track, but yay | 00:52 |
| *** Julien-zte has quit IRC | 00:53 | |
| *** Julien-zte has joined #openstack-infra | 00:54 | |
| *** Julien-zte has quit IRC | 00:55 | |
| *** Julien-zte has joined #openstack-infra | 00:57 | |
| *** Julien-zte has quit IRC | 00:57 | |
| *** gongysh has joined #openstack-infra | 00:58 | |
| *** Julien-zte has joined #openstack-infra | 00:59 | |
| *** dimtruck is now known as zz_dimtruck | 01:00 | |
| *** rfolco has quit IRC | 01:02 | |
| *** chlong has quit IRC | 01:03 | |
| *** akshai has joined #openstack-infra | 01:03 | |
| clarkb | it is like watching paint dry but its almost over | 01:04 |
| clarkb | and I think this fixes a fairly major issue we have been suffering from in nodepool once I get the services restarted | 01:05 |
| *** zz_dimtruck is now known as dimtruck | 01:06 | |
| *** gouthamr has joined #openstack-infra | 01:06 | |
| anteaya | yay, congratulations | 01:06 |
| anteaya | I hope it works | 01:07 |
| anteaya | and i wonder how many on the team get the watching paint dry badge | 01:07 |
| anteaya | a fair few I think | 01:08 |
| *** Sukhdev_ has quit IRC | 01:10 | |
| *** pvaneck has quit IRC | 01:11 | |
| openstackgerrit | Shu Muto proposed openstack-infra/project-config: Add new project Zun-UI to openstack repo https://review.openstack.org/366489 | 01:14 |
| *** zhurong has joined #openstack-infra | 01:14 | |
| clarkb | ok timeout happend | 01:19 |
| clarkb | going to restart nodepoold and the builder now | 01:20 |
| openstackgerrit | Merged openstack-infra/system-config: add openstack-ec2api irc channel to list of logged channels https://review.openstack.org/357636 | 01:20 |
| * anteaya crosses her fingers | 01:20 | |
| *** thcipriani is now known as thcipriani|afk | 01:21 | |
| clarkb | looks happy so far. We won't erally know if the image leak is fixed until we let it run a few days then check for leaks | 01:21 |
| *** fguillot has quit IRC | 01:21 | |
| anteaya | so far so good | 01:21 |
| anteaya | thank you clarkb | 01:21 |
| *** salv-orlando has joined #openstack-infra | 01:23 | |
| ianw | do releasenotes jobs not run on !master? | 01:25 |
| clarkb | #status log restarted nodepoold and nodepool builder to pick up change that should prevent leaking iamges when we hit the 8 hour image timeout. | 01:26 |
| openstackstatus | clarkb: finished logging | 01:26 |
| *** salv-orlando has quit IRC | 01:26 | |
| clarkb | jhesketh: ^ thats all done the service looks happy to me and I will keep an eye on it for a bit | 01:26 |
| *** fguillot has joined #openstack-infra | 01:30 | |
| jhesketh | clarkb: awesome, thanks :-) | 01:30 |
| *** caowei has joined #openstack-infra | 01:30 | |
| fungi | clarkb: i'm around--anything going wild yet? | 01:32 |
| fungi | looks like no. excellent! | 01:32 |
| *** sdake has joined #openstack-infra | 01:32 | |
| fungi | ianw: i believe releasenotes jobs are supposed to run *for* all branches but they always switch to master before processing and read the notes from there | 01:33 |
| *** fguillot_ has joined #openstack-infra | 01:35 | |
| *** fguillot has quit IRC | 01:35 | |
| clarkb | fungi: ya it looks happy | 01:35 |
| *** ddieterly has quit IRC | 01:35 | |
| *** tqtran has joined #openstack-infra | 01:36 | |
| ianw | fungi: yeah, silly me, it seems they're smart enough to only run when there's a new release note :) sorry, too many changes on the go at once | 01:36 |
| clarkb | then tomorrow I clear out the existing leaked images and later we swing around and see if they persist | 01:36 |
| *** armax has quit IRC | 01:36 | |
| fungi | clarkb: i missed some of the detail for this latest update... so the restart brings a potential fix for the image leak? | 01:37 |
| clarkb | fungi: yup. Basically after 8 hours we were deleting all record of uploading images from the db. Then some time later those uploads finish and we have leaked the images | 01:37 |
| clarkb | fungi: the fix is basically going to let uploading images stay in that state until they either succeed or fail to upload | 01:37 |
| fungi | got it. that's a remarkably subtle bug! | 01:38 |
| *** tqtran has quit IRC | 01:40 | |
| *** openstack has joined #openstack-infra | 01:43 | |
| *** ddieterly has quit IRC | 01:46 | |
| *** asettle has joined #openstack-infra | 01:47 | |
| *** zshuo has joined #openstack-infra | 01:48 | |
| *** gouthamr has quit IRC | 01:48 | |
| *** gouthamr has joined #openstack-infra | 01:49 | |
| *** baoli has joined #openstack-infra | 01:50 | |
| *** asettle has quit IRC | 01:51 | |
| *** spzala has quit IRC | 02:04 | |
| *** spzala has joined #openstack-infra | 02:05 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Make builder recognize manual build requests https://review.openstack.org/365112 | 02:05 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Make builder recognize scheduled builds https://review.openstack.org/366934 | 02:05 |
| *** ddieterly has joined #openstack-infra | 02:06 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Disable sahara tests in tempest https://review.openstack.org/361936 | 02:06 |
| *** spzala has quit IRC | 02:07 | |
| *** spzala has joined #openstack-infra | 02:07 | |
| *** baoli has quit IRC | 02:08 | |
| *** Julien-zte has quit IRC | 02:10 | |
| *** Julien-zte has joined #openstack-infra | 02:10 | |
| *** dimtruck is now known as zz_dimtruck | 02:14 | |
| *** ociuhandu has joined #openstack-infra | 02:18 | |
| *** chlong has joined #openstack-infra | 02:19 | |
| *** ddieterly has quit IRC | 02:19 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Implement undercloud upgrade job - Mitaka -> Newton https://review.openstack.org/346995 | 02:20 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: scenario001: deploy Ceph https://review.openstack.org/366810 | 02:20 |
| *** yamahata has quit IRC | 02:21 | |
| *** ddieterly has joined #openstack-infra | 02:22 | |
| AJaeger | nikhil: you have a note but no jobs configured ;( | 02:23 |
| *** Swami has quit IRC | 02:25 | |
| *** ociuhandu has quit IRC | 02:26 | |
| *** xarses has joined #openstack-infra | 02:29 | |
| *** ociuhandu has joined #openstack-infra | 02:30 | |
| *** Benj_ has joined #openstack-infra | 02:31 | |
| *** sarob has joined #openstack-infra | 02:32 | |
| *** Benj_ has quit IRC | 02:32 | |
| *** salv-orlando has joined #openstack-infra | 02:33 | |
| openstackgerrit | Varun Gadiraju proposed openstack-infra/project-config: Migrating vars that devstack_gate uses to vars in DEVSTACK_LOCAL_CONFIG https://review.openstack.org/354344 | 02:33 |
| *** spzala has quit IRC | 02:33 | |
| *** spzala has joined #openstack-infra | 02:33 | |
| *** ociuhandu has quit IRC | 02:34 | |
| *** armax has joined #openstack-infra | 02:34 | |
| *** spzala has quit IRC | 02:35 | |
| *** spzala has joined #openstack-infra | 02:35 | |
| *** baoli has joined #openstack-infra | 02:37 | |
| nikhil | AJaeger: oh dearness goodness... Lemme take care of that tomorrow. Thanks for pointing out this ! | 02:38 |
| eliqiao | hi AJaeger, there? | 02:39 |
| *** ddieterly has quit IRC | 02:41 | |
| *** salv-orlando has quit IRC | 02:43 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: scenario001: deploy Ceph https://review.openstack.org/366810 | 02:44 |
| *** Mary has joined #openstack-infra | 02:44 | |
| *** Mary is now known as Guest77818 | 02:44 | |
| AJaeger | eliqiao: briefly. Why? | 02:44 |
| AJaeger | nikhil: sure, should be a two-liner ;) | 02:45 |
| stevemar | AJaeger needs to stop working and start sleeping :) | 02:45 |
| * AJaeger has a cough and was awake getting some water - and then read some HPE/Micro Focus news... | 02:45 | |
| eliqiao | AJaeger: oh, you are still stand up for working? | 02:46 |
| eliqiao | AJaeger: if that, nothing .. :_ | 02:46 |
| * stevemar hands AJaeger some cough syrup and a tea | 02:46 | |
| AJaeger | eliqiao: not really. If it's a quick question, I can answer, otherwise later... | 02:46 |
| *** yuanying has quit IRC | 02:47 | |
| AJaeger | eliqiao: or somebody else will comment here - just leave the message and people will read backscroll | 02:47 |
| eliqiao | AJaeger: just wonder why I set up tempest on gate, but I can not get tempest.conf | 02:47 |
| eliqiao | http://logs.openstack.org/12/363412/3/check/gate-zun-devstack-dsvm/f7dd453/console.html#_2016-09-08_01_06_27_873171 | 02:47 |
| eliqiao | ^^ | 02:47 |
| stevemar | AJaeger: oh wow, i've never heard of micro focus | 02:47 |
| AJaeger | stevemar: thanks a lot! That helps ;) | 02:47 |
| AJaeger | stevemar: SUSE is part of Micro Focus ;) | 02:48 |
| AJaeger | eliqiao: better ask on #openstack-qa | 02:48 |
| * AJaeger is back to sleep now | 02:49 | |
| *** Guest77818 has quit IRC | 02:49 | |
| eliqiao | the gate setup devstack, how can I get password of the new stack? and http://logs.openstack.org/12/363412/3/check/gate-zun-devstack-dsvm/f7dd453/console.html#_2016-09-08_01_05_32_975381 , anyone konws that? | 02:49 |
| eliqiao | thanks AJ .. | 02:49 |
| *** fguillot_ has quit IRC | 02:50 | |
| *** spzala has quit IRC | 02:50 | |
| *** spzala has joined #openstack-infra | 02:51 | |
| clarkb | its in the openrc which you can source | 02:54 |
| *** spzala has quit IRC | 02:55 | |
| *** winggundamth has quit IRC | 02:57 | |
| *** winggundamth has joined #openstack-infra | 03:01 | |
| *** bstinson has quit IRC | 03:06 | |
| gouthamr | Would appreciate a +2/+W on https://review.openstack.org/#/c/366771/ from any infra-core reviewers.. Would resolve a voting job breakage in the manila project | 03:08 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/lpmqtt: Add config option to set QOS of published messages https://review.openstack.org/367061 | 03:09 |
| *** vikrant has joined #openstack-infra | 03:09 | |
| *** ociuhandu has joined #openstack-infra | 03:14 | |
| *** ociuhandu has quit IRC | 03:19 | |
| *** tphummel has joined #openstack-infra | 03:27 | |
| prometheanfire | pabelanger: https://review.openstack.org/366862 right? | 03:27 |
| *** ociuhandu has joined #openstack-infra | 03:29 | |
| *** vikrant has quit IRC | 03:33 | |
| *** ociuhandu has quit IRC | 03:34 | |
| *** vikrant has joined #openstack-infra | 03:34 | |
| *** tongli has quit IRC | 03:38 | |
| *** bstinson has joined #openstack-infra | 03:41 | |
| *** bstinson has quit IRC | 03:42 | |
| *** salv-orlando has joined #openstack-infra | 03:42 | |
| *** rfolco has joined #openstack-infra | 03:44 | |
| *** Mary has joined #openstack-infra | 03:45 | |
| *** Mary is now known as Guest94183 | 03:45 | |
| *** bstinson has joined #openstack-infra | 03:47 | |
| *** rfolco has quit IRC | 03:47 | |
| *** salv-orlando has quit IRC | 03:49 | |
| *** Guest94183 has quit IRC | 03:50 | |
| *** yuanying has joined #openstack-infra | 03:51 | |
| *** thorst has quit IRC | 03:53 | |
| *** thorst has joined #openstack-infra | 03:53 | |
| *** thorst has quit IRC | 03:58 | |
| *** thorst has joined #openstack-infra | 03:59 | |
| *** jgriffith is now known as jgriffith_away | 04:00 | |
| *** baoli has quit IRC | 04:01 | |
| jhesketh | gouthamr: looking | 04:01 |
| jhesketh | gouthamr: +w | 04:02 |
| gouthamr | thank you jhesketh! | 04:02 |
| *** sarob has quit IRC | 04:02 | |
| *** ociuhandu has joined #openstack-infra | 04:03 | |
| *** thorst has quit IRC | 04:04 | |
| *** ociuhandu has quit IRC | 04:08 | |
| *** sflanigan has quit IRC | 04:10 | |
| openstackgerrit | Merged openstack-infra/project-config: [Manila] Fix for LVM job template https://review.openstack.org/366771 | 04:15 |
| *** thorst has joined #openstack-infra | 04:15 | |
| *** rfolco has joined #openstack-infra | 04:20 | |
| *** amotoki has joined #openstack-infra | 04:23 | |
| *** oanson has joined #openstack-infra | 04:23 | |
| *** senk has joined #openstack-infra | 04:25 | |
| *** sflanigan has joined #openstack-infra | 04:26 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Move element-info a standard entry-point https://review.openstack.org/330893 | 04:26 |
| *** links has joined #openstack-infra | 04:28 | |
| *** harlowja_at_home has joined #openstack-infra | 04:29 | |
| *** Rockyg has quit IRC | 04:30 | |
| *** markvoelker has quit IRC | 04:30 | |
| *** thorst has quit IRC | 04:30 | |
| *** markvoelker has joined #openstack-infra | 04:31 | |
| openstackgerrit | Omer Anson proposed openstack-infra/project-config: Add Dragonflow fullstack test for ML2 module https://review.openstack.org/366033 | 04:31 |
| *** thorst has joined #openstack-infra | 04:33 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Move element-info a standard entry-point https://review.openstack.org/330893 | 04:36 |
| *** psachin has joined #openstack-infra | 04:36 | |
| *** thorst has quit IRC | 04:38 | |
| *** woodster_ has quit IRC | 04:39 | |
| *** tphummel has quit IRC | 04:42 | |
| *** tphummel has joined #openstack-infra | 04:45 | |
| *** Mary has joined #openstack-infra | 04:46 | |
| *** Mary is now known as Guest56517 | 04:46 | |
| *** Guest56517 has quit IRC | 04:50 | |
| *** salv-orlando has joined #openstack-infra | 04:52 | |
| *** pgadiya has joined #openstack-infra | 04:52 | |
| *** gongysh has quit IRC | 04:52 | |
| *** abregman has joined #openstack-infra | 04:52 | |
| *** tphummel has quit IRC | 04:53 | |
| *** sdake has quit IRC | 04:56 | |
| *** senk has quit IRC | 04:57 | |
| *** akshai has quit IRC | 04:58 | |
| *** salv-orl_ has joined #openstack-infra | 04:59 | |
| *** salv-orl_ has quit IRC | 04:59 | |
| *** salv-orlando has quit IRC | 04:59 | |
| *** salv-orlando has joined #openstack-infra | 05:00 | |
| *** takashi has joined #openstack-infra | 05:00 | |
| *** sdake has joined #openstack-infra | 05:00 | |
| *** Jeffrey4l__ has joined #openstack-infra | 05:00 | |
| *** Jeffrey4l_ has quit IRC | 05:03 | |
| *** sshnaidm|afk has quit IRC | 05:07 | |
| *** thorst has joined #openstack-infra | 05:07 | |
| *** thorst has quit IRC | 05:09 | |
| *** jaosorior has joined #openstack-infra | 05:10 | |
| *** ilyashakhat_mobi has joined #openstack-infra | 05:11 | |
| takashi | Hi. I'd like to ask a question about gate job settings. | 05:11 |
| takashi | Is there any configurable timeout in gate job setting? | 05:11 |
| takashi | Currently I see some gate job failues, which seem to be caused by timeout while executing tox | 05:12 |
| *** chlong has quit IRC | 05:14 | |
| takashi | I saw some projects set build-timeout wrappers in their job configs, and I'm wondering it can solve that problem | 05:14 |
| *** ilyashakhat_mobi has quit IRC | 05:19 | |
| openstackgerrit | Masahito Muroi proposed openstack-infra/project-config: Add releasenotes jobs for Congress https://review.openstack.org/367081 | 05:20 |
| *** hashar has joined #openstack-infra | 05:21 | |
| clarkb | takashi either that ir determine if the tests can be made to run quicker | 05:23 |
| *** spzala has joined #openstack-infra | 05:27 | |
| *** abregman has quit IRC | 05:28 | |
| *** sandanar has joined #openstack-infra | 05:28 | |
| *** chlong has joined #openstack-infra | 05:30 | |
| *** links has quit IRC | 05:31 | |
| *** spzala has quit IRC | 05:31 | |
| *** senk has joined #openstack-infra | 05:31 | |
| *** rfolco has quit IRC | 05:32 | |
| *** sflanigan has quit IRC | 05:32 | |
| *** HeOS has joined #openstack-infra | 05:33 | |
| *** roxanaghe has joined #openstack-infra | 05:37 | |
| *** tqtran has joined #openstack-infra | 05:38 | |
| *** ilyashakhat_mobi has joined #openstack-infra | 05:42 | |
| *** tqtran has quit IRC | 05:42 | |
| *** roxanaghe has quit IRC | 05:46 | |
| *** sflanigan has joined #openstack-infra | 05:46 | |
| *** harlowja_at_home has quit IRC | 05:46 | |
| *** Mary has joined #openstack-infra | 05:46 | |
| *** links has joined #openstack-infra | 05:46 | |
| *** Mary is now known as Guest92162 | 05:47 | |
| *** Guest92162 has quit IRC | 05:51 | |
| *** abregman has joined #openstack-infra | 05:52 | |
| *** _nadya_ has joined #openstack-infra | 05:55 | |
| *** gouthamr has quit IRC | 05:55 | |
| *** tphummel has joined #openstack-infra | 05:55 | |
| *** sdake_ has joined #openstack-infra | 05:56 | |
| *** _nadya_ has quit IRC | 05:56 | |
| *** gouthamr has joined #openstack-infra | 05:56 | |
| *** thorst has joined #openstack-infra | 05:57 | |
| *** hferenc has joined #openstack-infra | 05:58 | |
| *** sdake has quit IRC | 05:58 | |
| *** thorst_ has joined #openstack-infra | 05:58 | |
| takashi | clarkb: The test speed is determined by the perfonance where we run that test, and I'm afraid that we have nothing to 'speed' up the test in gate | 05:59 |
| *** furlongm_ has joined #openstack-infra | 05:59 | |
| *** furlongm has quit IRC | 06:00 | |
| *** Julien-zte has quit IRC | 06:00 | |
| *** thorst_ has quit IRC | 06:00 | |
| clarkb | takashi: which job is it? have an example log from a time out failure? | 06:01 |
| *** thorst has quit IRC | 06:01 | |
| *** senk has quit IRC | 06:02 | |
| *** sarob has joined #openstack-infra | 06:03 | |
| *** thorst has joined #openstack-infra | 06:03 | |
| *** Ravikiran_K has joined #openstack-infra | 06:04 | |
| *** Julien-zte has joined #openstack-infra | 06:04 | |
| *** snarwade has joined #openstack-infra | 06:05 | |
| *** senk has joined #openstack-infra | 06:07 | |
| *** sarob has quit IRC | 06:08 | |
| *** yuval has joined #openstack-infra | 06:09 | |
| *** florianf has joined #openstack-infra | 06:10 | |
| *** ilyashakhat_mobi has quit IRC | 06:11 | |
| *** Julien-zte has quit IRC | 06:12 | |
| *** baoli has joined #openstack-infra | 06:13 | |
| *** chlong has quit IRC | 06:13 | |
| *** furlongm_ has quit IRC | 06:15 | |
| *** Julien-zte has joined #openstack-infra | 06:16 | |
| *** baoli has quit IRC | 06:17 | |
| *** gongysh has joined #openstack-infra | 06:20 | |
| *** e0ne has joined #openstack-infra | 06:22 | |
| *** amitgandhinz has quit IRC | 06:23 | |
| *** amitgandhinz has joined #openstack-infra | 06:23 | |
| *** furlongm has joined #openstack-infra | 06:23 | |
| *** _nadya_ has joined #openstack-infra | 06:24 | |
| *** Hal1 has joined #openstack-infra | 06:24 | |
| takashi | clarkb: gate-storlets-functional in storlets project | 06:25 |
| *** aeng has quit IRC | 06:25 | |
| *** chlong has joined #openstack-infra | 06:26 | |
| takashi | clarkb: This is one sample log for job failue http://logs.openstack.org/64/364764/3/gate/gate-storlets-functional/6ba983f/console.html We don't see test result generated by nose at the end. | 06:26 |
| *** yamahata has joined #openstack-infra | 06:26 | |
| takashi | clarkb: If we successfully pass gate job, we expect that console log looks like http://logs.openstack.org/64/364764/3/check/gate-storlets-functional/014e331/console.html | 06:27 |
| clarkb | if you are using nose thats one item you could address to speed things up. nose runs tests serially in a single thread/prpcess | 06:28 |
| clarkb | we switchedany projects to testr amd run their tests in parallel | 06:28 |
| clarkb | often leads to more reliable tests and code too when you do that as it forces you to remove assumptions about test order and so on | 06:30 |
| takashi | clarkb: That is surely one thing we need to check. Currently testr is listed our to-do list. | 06:32 |
| clarkb | you can also adda bindeo file to only install the system packages you depend on | 06:34 |
| clarkb | *add a bindep | 06:34 |
| takashi | clarkb: Chcking... As far as I know we need to add bindep.txt or other-requirements.txt to use bindep. Is it right? | 06:36 |
| openstackgerrit | Chaoyi Huang proposed openstack-infra/project-config: Add new project Trio2o https://review.openstack.org/367114 | 06:36 |
| *** ilyashakhat_mobi has joined #openstack-infra | 06:37 | |
| *** gongysh has quit IRC | 06:37 | |
| clarkb | takashi: yes | 06:37 |
| clarkb | overall thpugh looks like most time is spent running nose and you are only using one of many available cpus there | 06:38 |
| clarkb | also if you switch to xenial you shouldnt need the java8 ppa anymore | 06:41 |
| takashi | clarkb: yes. That is also addressed. | 06:42 |
| takashi | clarkb: Thanks for your many useful suggestions! Currently they make it clear what we need to work about, to improve gate stability. | 06:44 |
| *** yuval has quit IRC | 06:45 | |
| *** mikelk has joined #openstack-infra | 06:46 | |
| *** berendt has joined #openstack-infra | 06:47 | |
| *** Mary has joined #openstack-infra | 06:47 | |
| *** gouthamr_ has joined #openstack-infra | 06:47 | |
| *** Mary is now known as Guest16370 | 06:47 | |
| *** tonytan4ever has quit IRC | 06:49 | |
| *** gouthamr has quit IRC | 06:51 | |
| *** _nadya_ has quit IRC | 06:51 | |
| *** Guest16370 has quit IRC | 06:51 | |
| *** ttx has quit IRC | 06:54 | |
| *** salv-orlando has quit IRC | 06:54 | |
| *** ttx has joined #openstack-infra | 06:54 | |
| *** ttx has quit IRC | 06:54 | |
| yolanda | good morning | 06:55 |
| *** ttx has joined #openstack-infra | 06:55 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: WIP -- clean full upgrade review https://review.openstack.org/364859 | 06:55 |
| *** Jeffrey4l__ has quit IRC | 07:00 | |
| *** claudiub|2 has joined #openstack-infra | 07:01 | |
| *** Na3iL has joined #openstack-infra | 07:02 | |
| *** Jeffrey4l__ has joined #openstack-infra | 07:02 | |
| *** tesseract- has joined #openstack-infra | 07:04 | |
| *** dtardivel has joined #openstack-infra | 07:07 | |
| *** matrohon has joined #openstack-infra | 07:08 | |
| *** yuval has joined #openstack-infra | 07:08 | |
| *** pahuang has quit IRC | 07:09 | |
| AJaeger | takashi: for bindep.txt, read http://jaegerandi.blogspot.de/2016/08/document-binary-package-dependencies.html | 07:10 |
| AJaeger | good morning! | 07:10 |
| *** yuval has quit IRC | 07:10 | |
| *** yuval has joined #openstack-infra | 07:12 | |
| *** ilyashakhat_mobi has quit IRC | 07:12 | |
| *** yuval has quit IRC | 07:12 | |
| *** yuval has joined #openstack-infra | 07:12 | |
| *** drifterza has joined #openstack-infra | 07:18 | |
| *** ilyashakhat_mobi has joined #openstack-infra | 07:18 | |
| *** oomichi has quit IRC | 07:18 | |
| openstackgerrit | Merged openstack-infra/project-config: Add new project Zun-UI to openstack repo https://review.openstack.org/366489 | 07:18 |
| *** oomichi has joined #openstack-infra | 07:19 | |
| *** shu-mutou has quit IRC | 07:21 | |
| *** e0ne has quit IRC | 07:22 | |
| openstackgerrit | Merged openstack-infra/project-config: Add Dragonflow fullstack test for ML2 module https://review.openstack.org/366033 | 07:22 |
| *** jlanoux has joined #openstack-infra | 07:24 | |
| openstackgerrit | Merged openstack-infra/project-config: Create fuel-nailgun-extension-iac project https://review.openstack.org/366779 | 07:25 |
| AJaeger | yolanda: could you review https://review.openstack.org/#/c/365615/ as well, please? | 07:25 |
| yolanda | ok | 07:26 |
| openstackgerrit | Merged openstack-infra/project-config: fix logic for adding new release notes pages https://review.openstack.org/366962 | 07:27 |
| openstackgerrit | Merged openstack-infra/project-config: Remove LXD tests from unsupported branches https://review.openstack.org/366968 | 07:27 |
| openstackgerrit | Merged openstack-infra/project-config: Remove check-requirements for the independent sahara-test https://review.openstack.org/367013 | 07:27 |
| AJaeger | yolanda: and if possible: https://review.openstack.org/#/c/366428/ and https://review.openstack.org/#/c/366719/ , please | 07:28 |
| *** yaume has joined #openstack-infra | 07:28 | |
| *** yaume is now known as yaume[away] | 07:28 | |
| *** armax has quit IRC | 07:29 | |
| *** abregman_ has joined #openstack-infra | 07:29 | |
| openstackgerrit | Merged openstack-infra/project-config: Create python-openstackclient-stable-maint group https://review.openstack.org/366989 | 07:30 |
| openstackgerrit | Merged openstack-infra/project-config: Add releasenotes jobs for Congress https://review.openstack.org/367081 | 07:30 |
| *** yaume[away] is now known as yaume | 07:30 | |
| yolanda | done | 07:30 |
| AJaeger | thanks! | 07:30 |
| *** yaume is now known as yaume[away] | 07:30 | |
| yolanda | AJaeger, i saw several changes from Clark about neutron. We wait for neutron ptl there? | 07:31 |
| *** abregman has quit IRC | 07:32 | |
| openstackgerrit | Rui Chen proposed openstack-infra/project-config: Create a new project python-nimbleclient https://review.openstack.org/367146 | 07:32 |
| openstackgerrit | Merged openstack-infra/system-config: Add tripleo-test-clouds AFS mirrors to cacti.o.o https://review.openstack.org/355644 | 07:32 |
| *** jed56 has joined #openstack-infra | 07:33 | |
| AJaeger | looking at these two: I would not wait and merge directly - but let me try to catch armax later today and discuss with him what he wants to have done here. I'd like a global go-ahead for these xenial renames ;) | 07:33 |
| AJaeger | So, let's wait until tonight | 07:33 |
| *** ifarkas_afk is now known as ifarkas | 07:33 | |
| yolanda | ok | 07:33 |
| *** openstackgerrit has quit IRC | 07:33 | |
| *** openstackgerrit has joined #openstack-infra | 07:34 | |
| *** gouthamr_ has quit IRC | 07:35 | |
| openstackgerrit | Merged openstack-infra/project-config: Add jenkins-plugins-for-murano project to Openstack https://review.openstack.org/366154 | 07:36 |
| openstackgerrit | Merged openstack-infra/project-config: tripleo: run scenarios jobs on tripleo-ci project https://review.openstack.org/366814 | 07:36 |
| openstackgerrit | Merged openstack-infra/project-config: [Rally] enable panko project in rally jobs https://review.openstack.org/366865 | 07:36 |
| openstackgerrit | Merged openstack-infra/project-config: Promote working OSA CentOS nv jobs to voting https://review.openstack.org/366880 | 07:36 |
| *** thorst has quit IRC | 07:36 | |
| *** yaume[away] is now known as yaume | 07:37 | |
| *** yaume is now known as yaume[away] | 07:37 | |
| *** matthewbodkin has joined #openstack-infra | 07:37 | |
| openstackgerrit | Merged openstack-infra/project-config: Set whole disk image options directly in devstack https://review.openstack.org/359285 | 07:38 |
| openstackgerrit | Merged openstack-infra/project-config: Give better error description in check_valid_gerrit_projects.py https://review.openstack.org/366727 | 07:38 |
| openstackgerrit | Merged openstack-infra/project-config: tripleo: enable voting for scenarios https://review.openstack.org/366428 | 07:38 |
| openstackgerrit | Merged openstack-infra/system-config: Create space for governance.o.o/uc publication https://review.openstack.org/365615 | 07:39 |
| *** ihrachys has joined #openstack-infra | 07:39 | |
| *** tqtran has joined #openstack-infra | 07:39 | |
| *** nherciu has joined #openstack-infra | 07:40 | |
| takashi | AJaeger: thanks! | 07:41 |
| *** dtantsur|afk is now known as dtantsur | 07:42 | |
| openstackgerrit | Merged openstack-infra/project-config: Enable QoS on neutron for python-openstackclient functional tests https://review.openstack.org/366719 | 07:43 |
| *** tqtran has quit IRC | 07:43 | |
| *** ihrachys has quit IRC | 07:45 | |
| *** ilyashakhat_mobi has quit IRC | 07:47 | |
| *** Mary has joined #openstack-infra | 07:48 | |
| *** Mary is now known as Guest28785 | 07:48 | |
| *** tonytan4ever has joined #openstack-infra | 07:50 | |
| *** jpich has joined #openstack-infra | 07:52 | |
| *** yaume[away] is now known as yaume | 07:52 | |
| *** yaume is now known as yaume[away] | 07:52 | |
| *** Guest28785 has quit IRC | 07:52 | |
| *** chlong has quit IRC | 07:52 | |
| *** tonytan4ever has quit IRC | 07:54 | |
| openstackgerrit | Merged openstack-infra/project-config: Set up publication jobs for governance-uc https://review.openstack.org/365616 | 07:54 |
| *** sflanigan has quit IRC | 07:55 | |
| *** andreas_s has joined #openstack-infra | 07:56 | |
| *** takashi has quit IRC | 07:58 | |
| *** salv-orlando has joined #openstack-infra | 07:59 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** zzzeek has joined #openstack-infra | 08:00 | |
| *** yamahata has quit IRC | 08:01 | |
| *** salv-orlando has quit IRC | 08:01 | |
| *** pgadiya has quit IRC | 08:01 | |
| *** _nadya_ has joined #openstack-infra | 08:02 | |
| *** sarob has joined #openstack-infra | 08:04 | |
| *** Na3iL has quit IRC | 08:05 | |
| *** adriant has quit IRC | 08:06 | |
| *** sarob has quit IRC | 08:09 | |
| *** yaume[away] is now known as yaume | 08:10 | |
| openstackgerrit | Rui Chen proposed openstack-infra/project-config: Create a new project python-nimbleclient https://review.openstack.org/367146 | 08:11 |
| *** kaisers has joined #openstack-infra | 08:12 | |
| *** dingyichen has quit IRC | 08:13 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE: WIP: Nothing here https://review.openstack.org/365324 | 08:13 |
| *** sshnaidm|afk has joined #openstack-infra | 08:14 | |
| *** sshnaidm|afk is now known as sshnaidm | 08:14 | |
| *** ajo_ has quit IRC | 08:16 | |
| *** sdake_ is now known as sdake | 08:17 | |
| *** jogo has quit IRC | 08:20 | |
| *** Jeffrey4l__ has quit IRC | 08:20 | |
| *** xarses has quit IRC | 08:21 | |
| *** gildub has quit IRC | 08:21 | |
| *** yaume_ has joined #openstack-infra | 08:22 | |
| *** gildub has joined #openstack-infra | 08:22 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/367196 | 08:23 |
| *** salv-orlando has joined #openstack-infra | 08:23 | |
| *** jogo has joined #openstack-infra | 08:25 | |
| *** yaume has quit IRC | 08:25 | |
| *** shardy has joined #openstack-infra | 08:26 | |
| *** gildub has quit IRC | 08:27 | |
| *** gildub has joined #openstack-infra | 08:27 | |
| *** mhickey__ has joined #openstack-infra | 08:29 | |
| *** salv-orl_ has joined #openstack-infra | 08:30 | |
| *** ihrachys has joined #openstack-infra | 08:31 | |
| *** abregman_ has quit IRC | 08:32 | |
| *** jordanP has joined #openstack-infra | 08:32 | |
| *** Na3iL has joined #openstack-infra | 08:32 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: WIP -- clean full upgrade review https://review.openstack.org/364859 | 08:32 |
| *** salv-orlando has quit IRC | 08:33 | |
| *** xarses has joined #openstack-infra | 08:33 | |
| lennyb | corvus, pls review tiny vfio permission patch https://review.openstack.org/#/c/365333/ . Thanks in advance. | 08:34 |
| *** pblaho has joined #openstack-infra | 08:35 | |
| *** jaosorior is now known as jaosorior_lunch | 08:40 | |
| *** asettle has joined #openstack-infra | 08:40 | |
| *** drifterza has quit IRC | 08:41 | |
| *** drifterza has joined #openstack-infra | 08:43 | |
| *** abregman_ has joined #openstack-infra | 08:44 | |
| *** esikachev has joined #openstack-infra | 08:46 | |
| *** gongysh has joined #openstack-infra | 08:48 | |
| *** Mary has joined #openstack-infra | 08:48 | |
| *** Mary is now known as Guest24846 | 08:49 | |
| *** apetrich has quit IRC | 08:50 | |
| *** Guest24846 has quit IRC | 08:53 | |
| *** Julien-zte has quit IRC | 08:54 | |
| openstackgerrit | yinxiulin proposed openstack-infra/project-config: tricircle: Enable neutron in tricircle tempest https://review.openstack.org/367220 | 08:54 |
| *** derekh has joined #openstack-infra | 08:55 | |
| *** samuelBartel has joined #openstack-infra | 08:55 | |
| *** Julien-zte has joined #openstack-infra | 08:55 | |
| *** thorst has joined #openstack-infra | 08:56 | |
| *** pilgrimstack1 has quit IRC | 08:57 | |
| *** Hal1 has quit IRC | 08:59 | |
| *** thorst has quit IRC | 09:01 | |
| *** pilgrimstack has joined #openstack-infra | 09:01 | |
| *** Julien-zte has quit IRC | 09:01 | |
| *** thorst has joined #openstack-infra | 09:01 | |
| AJaeger | yolanda: we have again a github syncing problem, could you check https://github.com/openstack/deb-networking-cisco https://github.com/openstack/deb-networking-l2gw https://github.com/openstack/deb-networking-midonet https://github.com/openstack/deb-networking-nec https://github.com/openstack/deb-networking-odl https://github.com/openstack/deb-networking-ovn | 09:01 |
| AJaeger | https://github.com/openstack/deb-neutron-taas , please? | 09:01 |
| AJaeger | lennyb: corvus is out this week, for devstack better ask on #openstack-qa | 09:02 |
| lennyb | AJaeger, thanks. | 09:03 |
| *** thorst has quit IRC | 09:04 | |
| yolanda | AJaeger, all those failed? | 09:06 |
| *** dizquierdo has joined #openstack-infra | 09:07 | |
| AJaeger | yolanda: yeah ;( | 09:08 |
| *** joehuang has joined #openstack-infra | 09:08 | |
| AJaeger | looking at https://review.openstack.org/367196, only one of the deb repositories worked - and all the others in there. | 09:08 |
| AJaeger | yolanda: I had asked zigo to split is change into smaller pieces already but apparently we still hit the API when merging. Might need to do merging at more idle times ;( | 09:09 |
| AJaeger | Or give up on github ;( | 09:09 |
| *** thorst has joined #openstack-infra | 09:09 | |
| yolanda | it's EMEA time, not the rush of US... an even on that time fails | 09:10 |
| yolanda | maybe the call shall be retried several times... | 09:11 |
| AJaeger | yolanda: those deb repos were approved during US time - around 9pm our time. | 09:12 |
| yolanda | ok i fixed all, luckily it can be easy fixed with few clicks | 09:13 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/puppet-openstackci: Alternative external FQDN for log server https://review.openstack.org/259955 | 09:13 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/puppet-openstackci: Pin Jenkins version https://review.openstack.org/367232 | 09:13 |
| *** thorst has quit IRC | 09:15 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: WIP -- clean full upgrade review https://review.openstack.org/364859 | 09:16 |
| *** Jeffrey4l__ has joined #openstack-infra | 09:17 | |
| AJaeger | thanks, yolanda | 09:17 |
| openstackgerrit | Maciej Relewicz proposed openstack-infra/project-config: Added new repos for Murano chef cookbook https://review.openstack.org/366729 | 09:17 |
| *** thorst has joined #openstack-infra | 09:19 | |
| openstackgerrit | Chaoyi Huang proposed openstack-infra/project-config: Add new project Trio2o https://review.openstack.org/367114 | 09:20 |
| *** thorst has quit IRC | 09:20 | |
| *** lucasagomes is now known as lucas-relocate | 09:21 | |
| rcarrillocruz | pabelanger , clarkb : i don't see what's up with those timeouts on the controller | 09:22 |
| rcarrillocruz | if you want to take a peek, the logs have DEBUG level now | 09:22 |
| *** acoles_ is now known as acoles | 09:23 | |
| *** asettle has quit IRC | 09:23 | |
| *** asettle has joined #openstack-infra | 09:23 | |
| *** asettle has quit IRC | 09:23 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: WIP -- clean full upgrade review https://review.openstack.org/364859 | 09:24 |
| openstackgerrit | Lin Yang proposed openstack-infra/project-config: Add new project RSC to openstack repo https://review.openstack.org/341966 | 09:25 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/puppet-openstackci: Pin Jenkins version https://review.openstack.org/367232 | 09:26 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/puppet-openstackci: Alternative external FQDN for log server https://review.openstack.org/259955 | 09:26 |
| *** joehuang has quit IRC | 09:30 | |
| *** r-mibu has quit IRC | 09:33 | |
| *** r-mibu has joined #openstack-infra | 09:33 | |
| *** gildub has quit IRC | 09:34 | |
| *** gildub has joined #openstack-infra | 09:34 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Fix promote script and add logs https://review.openstack.org/367244 | 09:36 |
| *** thorst has joined #openstack-infra | 09:37 | |
| *** thorst has quit IRC | 09:38 | |
| *** thorst has joined #openstack-infra | 09:38 | |
| *** thorst has quit IRC | 09:39 | |
| *** thorst has joined #openstack-infra | 09:40 | |
| *** asettle has joined #openstack-infra | 09:41 | |
| *** zshuo has quit IRC | 09:41 | |
| *** apetrich has joined #openstack-infra | 09:41 | |
| *** pilgrimstack has quit IRC | 09:42 | |
| *** pgadiya has joined #openstack-infra | 09:43 | |
| *** sambetts|afk is now known as sambetts | 09:44 | |
| flip214 | AJaeger: I told smcginnis yesterday that the DRBD CI is currently broken, because of a DRBD Manage bug in the version that we released yesterday afternoon. | 09:44 |
| flip214 | we're working on a fix. | 09:44 |
| *** e0ne has joined #openstack-infra | 09:44 | |
| *** sshnaidm is now known as sshnaidm|lnch | 09:44 | |
| *** pilgrimstack has joined #openstack-infra | 09:45 | |
| *** dukov has joined #openstack-infra | 09:47 | |
| *** Mary has joined #openstack-infra | 09:49 | |
| *** Mary is now known as Guest87023 | 09:50 | |
| dukov | AJaeger: Hi, what should I do to join fuel-iac-core group. This group has been created as a result of https://review.openstack.org/#/c/366779/ | 09:50 |
| *** thorst has quit IRC | 09:51 | |
| *** isaacb has joined #openstack-infra | 09:51 | |
| *** spzala has joined #openstack-infra | 09:52 | |
| openstackgerrit | Dmitry Tantsur proposed openstack-infra/project-config: Add ironic-inspector tempest jobs to ironic and IPA https://review.openstack.org/367255 | 09:54 |
| *** Guest87023 has quit IRC | 09:54 | |
| AJaeger | flip214: ah, thanks. | 09:56 |
| *** spzala has quit IRC | 09:56 | |
| AJaeger | dukov: an infra-admin needs to setup the first member - and that one can then add others. You're here now: http://docs.openstack.org/infra/manual/creators.html#update-the-gerrit-group-members. I'm not an admin and thus cannot help you further, hope somebody else will later help you | 09:57 |
| dukov | Thanks. | 09:59 |
| rcarrillocruz | dukov: what's your email address | 10:00 |
| rcarrillocruz | dukov@mirantis.com ? | 10:01 |
| dukov | dukov@mirantis.com | 10:01 |
| dukov | yep | 10:01 |
| rcarrillocruz | done | 10:01 |
| dukov | rcarrillocruz: Thanks a lot! | 10:01 |
| rcarrillocruz | np | 10:01 |
| *** zhurong has quit IRC | 10:02 | |
| *** sarob has joined #openstack-infra | 10:05 | |
| *** lucas-relocate is now known as lucasagomes | 10:05 | |
| *** sarob has quit IRC | 10:09 | |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack-infra/project-config: Revert "Enable QoS on neutron for python-openstackclient functional tests" https://review.openstack.org/367259 | 10:09 |
| *** yanyanhu has quit IRC | 10:12 | |
| openstackgerrit | Matthew Bodkin proposed openstack-infra/storyboard-webclient: Make tags reusable https://review.openstack.org/366188 | 10:12 |
| *** kuromagi has quit IRC | 10:15 | |
| *** dizquierdo has quit IRC | 10:18 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: WIP -- clean full upgrade review https://review.openstack.org/364859 | 10:20 |
| *** sshnaidm|lnch is now known as sshnaidm | 10:21 | |
| *** gongysh has quit IRC | 10:21 | |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack-infra/project-config: Enable QoS on neutron for python-openstackclient. https://review.openstack.org/367266 | 10:22 |
| *** kzaitsev_mb has joined #openstack-infra | 10:22 | |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack-infra/project-config: Revert "Enable QoS on neutron for python-openstackclient functional tests" https://review.openstack.org/367267 | 10:22 |
| zigo | AJaeger: Or maybe delay REST API requests by like 1 per 5 seconds or something? | 10:24 |
| zigo | yolanda: Thanks for your work. | 10:25 |
| zigo | AJaeger: FYI, I'm currently adding upstream: and options: - track-upstream to repositories, otherwise I wont be able to do merge commits. | 10:25 |
| zigo | It's quite painful to write for 3rd party libs, because of so many different URLs. | 10:25 |
| zigo | I first attempted to script it, and quickly gave up to do it by hand. | 10:26 |
| zigo | There's just too many exceptions. | 10:26 |
| *** cdent has joined #openstack-infra | 10:26 | |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: setup post job for sahara-extra https://review.openstack.org/367271 | 10:28 |
| *** cdent has quit IRC | 10:28 | |
| *** ramishra has quit IRC | 10:29 | |
| *** ramishra has joined #openstack-infra | 10:32 | |
| *** gildub has quit IRC | 10:33 | |
| *** kuromagi has joined #openstack-infra | 10:39 | |
| *** tqtran has joined #openstack-infra | 10:42 | |
| *** yaume_ has quit IRC | 10:43 | |
| vgridnev | who can take a look on https://review.openstack.org/#/c/367271/1/jenkins/jobs/sahara.yaml ? Is it right way to get branch in builder? | 10:45 |
| *** apetrich has quit IRC | 10:45 | |
| *** tqtran has quit IRC | 10:46 | |
| *** caowei has quit IRC | 10:47 | |
| *** amotoki has quit IRC | 10:48 | |
| *** Mary has joined #openstack-infra | 10:50 | |
| *** jcoufal has quit IRC | 10:50 | |
| *** Mary is now known as Guest35980 | 10:51 | |
| *** sshnaidm is now known as sshnaidm|afk | 10:54 | |
| *** Guest35980 has quit IRC | 10:55 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: WIP -- clean full upgrade review https://review.openstack.org/364859 | 10:55 |
| yolanda | zigo, anytime | 10:57 |
| *** baoli has joined #openstack-infra | 10:57 | |
| *** cdent has joined #openstack-infra | 10:58 | |
| *** pgadiya has quit IRC | 10:59 | |
| *** rpodolyaka is now known as rpodolyakaLunch | 10:59 | |
| *** baoli has quit IRC | 11:05 | |
| *** sdague has joined #openstack-infra | 11:06 | |
| *** pgadiya has joined #openstack-infra | 11:07 | |
| *** Hal1 has joined #openstack-infra | 11:11 | |
| AJaeger | zigo: What about trying it on *one* repo first? | 11:13 |
| *** baoli has joined #openstack-infra | 11:13 | |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: setup post job for sahara-extra https://review.openstack.org/367271 | 11:13 |
| *** jkilpatr has joined #openstack-infra | 11:17 | |
| *** Hal1 has quit IRC | 11:17 | |
| *** Hal1 has joined #openstack-infra | 11:18 | |
| *** Hal1 has quit IRC | 11:19 | |
| *** Hal1 has joined #openstack-infra | 11:19 | |
| openstackgerrit | Rodolfo Alonso Hernandez proposed openstack-infra/project-config: Enable QoS on neutron for python-openstackclient. https://review.openstack.org/367266 | 11:19 |
| *** baoli has quit IRC | 11:19 | |
| *** _degorenko|afk is now known as degorenko | 11:19 | |
| *** sambetts is now known as sambetts|afk | 11:20 | |
| *** coolsvap is now known as _coolsvap_ | 11:21 | |
| *** yar_ has quit IRC | 11:22 | |
| *** salv-orl_ has quit IRC | 11:22 | |
| *** baoli has joined #openstack-infra | 11:24 | |
| *** MaryM has joined #openstack-infra | 11:26 | |
| *** rtheis has joined #openstack-infra | 11:27 | |
| *** baoli has quit IRC | 11:30 | |
| Zara | anyone free to look at https://review.openstack.org/#/c/360668/ (documenting commit message syntax for gerrit plugin)? it needs another +2. in the meantime I'm just linking people to that patch when they ask... | 11:33 |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: WIP -- clean full upgrade review https://review.openstack.org/364859 | 11:34 |
| *** apetrich has joined #openstack-infra | 11:35 | |
| *** MaryM has quit IRC | 11:35 | |
| *** Hal1 has quit IRC | 11:36 | |
| *** gongysh has joined #openstack-infra | 11:37 | |
| *** Hal1 has joined #openstack-infra | 11:37 | |
| *** Hal1 has quit IRC | 11:38 | |
| *** Hal1 has joined #openstack-infra | 11:38 | |
| *** Hal1 has quit IRC | 11:40 | |
| *** baoli has joined #openstack-infra | 11:43 | |
| *** rfolco has joined #openstack-infra | 11:44 | |
| *** apetrich has quit IRC | 11:46 | |
| *** notnownikki has joined #openstack-infra | 11:46 | |
| *** apetrich has joined #openstack-infra | 11:46 | |
| *** jcoufal has joined #openstack-infra | 11:46 | |
| *** yar_ has joined #openstack-infra | 11:46 | |
| *** lucasagomes is now known as lucas-hungry | 11:48 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Make tags reusable https://review.openstack.org/366188 | 11:48 |
| *** tonytan4ever has joined #openstack-infra | 11:51 | |
| *** netsin has quit IRC | 11:52 | |
| *** links has quit IRC | 11:52 | |
| *** ldnunes has joined #openstack-infra | 11:53 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: WIP -- clean full upgrade review https://review.openstack.org/364859 | 11:53 |
| *** esberglu has joined #openstack-infra | 11:54 | |
| AJaeger | yolanda: those repositories on github are still empty ;( Is puppet not running? | 11:54 |
| *** jaosorior_lunch is now known as jaosorior | 11:56 | |
| yolanda | AJaeger, that may explain why we had such massive fail | 11:56 |
| yolanda | let me check | 11:56 |
| *** apetrich has quit IRC | 11:56 | |
| *** tonytan4ever has quit IRC | 11:56 | |
| *** baoli_ has joined #openstack-infra | 11:56 | |
| *** rhallisey has joined #openstack-infra | 11:57 | |
| AJaeger | ah, checking puppetmaster myself - we have some recent runs and then nothing for 2:40h - so nothing since you made your change. | 11:58 |
| AJaeger | puppet might be "hang", perhaps recovering now? | 11:58 |
| *** apetrich has joined #openstack-infra | 11:58 | |
| *** esberglu has quit IRC | 11:58 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Reduce bluebox-sjc1 by 1 node https://review.openstack.org/367319 | 11:58 |
| yolanda | i see puppet running per the logs | 11:59 |
| yolanda | going to check on review.o.o logs | 11:59 |
| AJaeger | yolanda: looking at http://puppetboard.openstack.org/node/proposal.slave.openstack.org - no results since 11:15 | 11:59 |
| AJaeger | But others reported, see http://puppetboard.openstack.org/ | 12:00 |
| *** baoli has quit IRC | 12:00 | |
| AJaeger | morning, pabelanger | 12:00 |
| yolanda | on logs, puppet is now running on logstash workers | 12:00 |
| *** sambetts|afk is now known as sambetts | 12:00 | |
| pabelanger | morning | 12:00 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: scenarios: set Debug to True https://review.openstack.org/366896 | 12:00 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: scenario001: deploy Ceph https://review.openstack.org/366810 | 12:00 |
| *** sshnaidm|afk is now known as sshnaidm | 12:00 | |
| *** kgiusti has joined #openstack-infra | 12:01 | |
| AJaeger | yolanda: ok, then let's wait for the run to finish... Strange that it takes that long... | 12:01 |
| yolanda | AJaeger, last run of puppet was some minutes ago | 12:01 |
| *** psachin has quit IRC | 12:01 | |
| yolanda | i see an error in jeepyb Sep 8 11:48:36 review puppet-user[102721]: Unrecognised escape sequence '\%' in file /etc/puppet/modules/jeepyb/manifests/fetch_remotes.pp at line 25 | 12:01 |
| *** psachin has joined #openstack-infra | 12:01 | |
| AJaeger | Ah... | 12:01 |
| *** rpodolyakaLunch is now known as rpodolyaka | 12:02 | |
| AJaeger | so, what's wrong in that file? | 12:03 |
| *** Mary has joined #openstack-infra | 12:04 | |
| *** Mary is now known as Guest46095 | 12:04 | |
| yolanda | AJaeger, manage-project has not run since this morning, going to launch manually now | 12:04 |
| AJaeger | thanks, yolanda . I wonder what's wrong with it that it didn't run? | 12:05 |
| *** apetrich has quit IRC | 12:05 | |
| yolanda | AJaeger, actually it may not run on a cronjob now, but subscribed to changes of files | 12:06 |
| yolanda | on changes on projects.yaml or acls | 12:06 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Add TripleO scenarios jobs in status dashboard https://review.openstack.org/367324 | 12:06 |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: Enable QoS on neutron for python-openstackclient. https://review.openstack.org/367266 | 12:06 |
| yolanda | i saw last run from 4 hours ago, that actually matches the time where we normally review | 12:07 |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: Enable QoS on neutron for python-openstackclient. https://review.openstack.org/367266 | 12:07 |
| *** vikrant has quit IRC | 12:07 | |
| openstackgerrit | Steve Martinelli proposed openstack-infra/project-config: cleanup sdk functional test definition https://review.openstack.org/366914 | 12:08 |
| *** psilvad has joined #openstack-infra | 12:08 | |
| *** dprince has joined #openstack-infra | 12:09 | |
| *** trown|outtypewww is now known as trown | 12:09 | |
| AJaeger | yolanda: could you review https://review.openstack.org/#/c/367266 and https://review.openstack.org/366914 as well, please? | 12:09 |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: WIP -- clean full upgrade review https://review.openstack.org/364859 | 12:10 |
| AJaeger | thanks, rcarrillocruz ! | 12:10 |
| *** mriedem has joined #openstack-infra | 12:10 | |
| rcarrillocruz | sure | 12:10 |
| *** askb has quit IRC | 12:11 | |
| yolanda | rcarrillocruz, faster than me! | 12:11 |
| AJaeger | pabelanger: feel free to merge https://review.openstack.org/#/c/337821/ when conveninient... | 12:13 |
| yolanda | pabelanger, i'm seeing some errors of ansible-puppet launches, out of memory problems, are you aware of those? | 12:14 |
| pabelanger | AJaeger: I think I'm going to hold off until our recent glean issues are solved. Doing WIP | 12:14 |
| *** psilvad has quit IRC | 12:14 | |
| pabelanger | yolanda: yes, know issue. It is related to posting facts to puppetdb. For now, we've just ignored them | 12:15 |
| pabelanger | yolanda: maybe we should just make our swap bigger for now | 12:15 |
| *** raildo has joined #openstack-infra | 12:17 | |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/puppet-openstackci: Pin Jenkins version https://review.openstack.org/367232 | 12:19 |
| openstackgerrit | Evgeny Antyshev proposed openstack-infra/puppet-openstackci: Alternative external FQDN for log server https://review.openstack.org/259955 | 12:19 |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: setup post job for sahara-extra https://review.openstack.org/367271 | 12:19 |
| yolanda | lunch time... AJaeger , i left manage-projects running, i'll let you know when it finishes | 12:20 |
| *** netsin has joined #openstack-infra | 12:21 | |
| *** pradk has joined #openstack-infra | 12:22 | |
| *** esberglu has joined #openstack-infra | 12:27 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: WIP -- clean full upgrade review https://review.openstack.org/364859 | 12:29 |
| openstackgerrit | Merged openstack-infra/project-config: Enable QoS on neutron for python-openstackclient. https://review.openstack.org/367266 | 12:30 |
| *** mdrabe has joined #openstack-infra | 12:31 | |
| openstackgerrit | Merged openstack-infra/project-config: cleanup sdk functional test definition https://review.openstack.org/366914 | 12:32 |
| *** akshai has joined #openstack-infra | 12:32 | |
| *** honza has joined #openstack-infra | 12:34 | |
| *** honza is now known as Guest43969 | 12:34 | |
| *** gordc has joined #openstack-infra | 12:34 | |
| dtroyer | Good morning -infra! Can I get someone to add me to the new python-openstackclient-stable-maint group to get things started? | 12:35 |
| pabelanger | ianw: fun never stops, fedora-24 not booting in rax-ord too | 12:36 |
| *** akshai_ has joined #openstack-infra | 12:36 | |
| pabelanger | ianw: will debug that later | 12:36 |
| *** lucas-hungry is now known as lucasagomes | 12:38 | |
| *** akshai has quit IRC | 12:39 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: Fix promote script and add logs https://review.openstack.org/367244 | 12:40 |
| *** yaume has joined #openstack-infra | 12:45 | |
| *** burgerk has joined #openstack-infra | 12:46 | |
| *** apetrich has joined #openstack-infra | 12:47 | |
| openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: WIP: upstream: and track-upstream for deb-* https://review.openstack.org/367343 | 12:47 |
| pabelanger | prometheanfire: I'm going to add ipv6 support for gentoo the next patch series, since ipv6 is skipped right now | 12:47 |
| *** rlandy has joined #openstack-infra | 12:47 | |
| *** amotoki has joined #openstack-infra | 12:48 | |
| openstackgerrit | Vladimir Kuklin proposed openstack-infra/project-config: Add a Fuel extension to support Serializers Conversion https://review.openstack.org/367345 | 12:48 |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config: Switch Gnocchi functional jobs to Xenial https://review.openstack.org/366573 | 12:49 |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config: Switch Telemetry jobs to Xenial https://review.openstack.org/366574 | 12:49 |
| *** mmedvede has quit IRC | 12:49 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE: WIP: Nothing here https://review.openstack.org/365324 | 12:49 |
| *** jaosorior has quit IRC | 12:51 | |
| *** jaosorior has joined #openstack-infra | 12:51 | |
| *** rhallisey has quit IRC | 12:52 | |
| *** xyang1 has joined #openstack-infra | 12:57 | |
| *** shardy is now known as shardy_mtg | 12:57 | |
| apuimedo | any advice on debugging devstack plugins? | 12:57 |
| *** pabelanger has quit IRC | 12:59 | |
| *** migi has quit IRC | 13:00 | |
| AJaeger | apuimedo: I suggest to ask on #openstack-qa | 13:00 |
| apuimedo | AJaeger: thanks! | 13:00 |
| vgridnev | AJaeger, about https://review.openstack.org/#/c/367271/3/jenkins/jobs/sahara.yaml , is it right way to get branch in builder? | 13:02 |
| *** oanson has quit IRC | 13:04 | |
| *** zhurong has joined #openstack-infra | 13:04 | |
| AJaeger | vgridnev: you're not setting {branch} anywhere. Have a look at the compare-xml output... | 13:04 |
| *** Guest43969 is now known as honza | 13:05 | |
| *** jcoufal has quit IRC | 13:05 | |
| *** dukov has quit IRC | 13:05 | |
| openstackgerrit | Brad P. Crochet proposed openstack-infra/tripleo-ci: Add Zaqar to scenario002 https://review.openstack.org/365026 | 13:05 |
| *** spzala has joined #openstack-infra | 13:06 | |
| AJaeger | vgridnev: it's wrong - but I need some more time to dig into this and give advice. Perhaps somebody else can - and you could write down in teh review what you want to do there exactly. | 13:06 |
| *** jcoufal has joined #openstack-infra | 13:07 | |
| *** tonytan4ever has joined #openstack-infra | 13:07 | |
| *** jheroux has joined #openstack-infra | 13:09 | |
| *** yamahata has joined #openstack-infra | 13:09 | |
| *** Goneri has joined #openstack-infra | 13:11 | |
| *** tonytan4ever has quit IRC | 13:12 | |
| *** jraju has joined #openstack-infra | 13:12 | |
| *** timello has quit IRC | 13:13 | |
| *** tonytan4ever has joined #openstack-infra | 13:14 | |
| *** psilvad has joined #openstack-infra | 13:14 | |
| *** shardy_mtg is now known as shardy | 13:14 | |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: setup post job for sahara-extra https://review.openstack.org/367271 | 13:15 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE: WIP: Nothing here https://review.openstack.org/365324 | 13:15 |
| *** eharney has joined #openstack-infra | 13:15 | |
| *** mmedvede has joined #openstack-infra | 13:17 | |
| *** rossella_s has quit IRC | 13:18 | |
| *** rossella_s has joined #openstack-infra | 13:19 | |
| *** cardeois has joined #openstack-infra | 13:19 | |
| *** HeOS has quit IRC | 13:19 | |
| *** pgadiya has quit IRC | 13:19 | |
| *** sdake_ has joined #openstack-infra | 13:20 | |
| *** timello has joined #openstack-infra | 13:20 | |
| *** snarwade has quit IRC | 13:20 | |
| *** sdake has quit IRC | 13:22 | |
| *** sshnaidm is now known as sshnaidm|afk | 13:23 | |
| *** yamahata has quit IRC | 13:25 | |
| *** ddieterly has joined #openstack-infra | 13:27 | |
| *** sshnaidm|afk has quit IRC | 13:27 | |
| *** baoli_ has quit IRC | 13:29 | |
| *** ddieterly has quit IRC | 13:31 | |
| *** dizquierdo has joined #openstack-infra | 13:31 | |
| *** pgadiya has joined #openstack-infra | 13:32 | |
| *** pgadiya has quit IRC | 13:33 | |
| *** Julien-zte has joined #openstack-infra | 13:33 | |
| *** eeiden has quit IRC | 13:34 | |
| *** skipp has quit IRC | 13:34 | |
| *** wcriswell has quit IRC | 13:34 | |
| *** stewie925 has quit IRC | 13:34 | |
| *** salv-orlando has joined #openstack-infra | 13:34 | |
| *** stewie925 has joined #openstack-infra | 13:36 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool: Disable searching for discoverable private keys https://review.openstack.org/367381 | 13:38 |
| *** esikachev has quit IRC | 13:38 | |
| *** gongysh has quit IRC | 13:38 | |
| *** jamesdenton has joined #openstack-infra | 13:40 | |
| *** weshay is now known as weshay_pto | 13:41 | |
| yolanda | AJaeger, finally i'm starting to see some success on github | 13:42 |
| *** salv-orlando has quit IRC | 13:42 | |
| AJaeger | wow, that took ages ;( | 13:42 |
| AJaeger | yolanda: thanks! | 13:42 |
| AJaeger | yeah, 6 repos fine - https://github.com/openstack/deb-neutron-taas still to go. | 13:43 |
| *** woodster_ has joined #openstack-infra | 13:45 | |
| *** khivin has joined #openstack-infra | 13:48 | |
| *** fguillot has joined #openstack-infra | 13:48 | |
| *** psachin has quit IRC | 13:49 | |
| *** spzala has quit IRC | 13:49 | |
| *** spzala has joined #openstack-infra | 13:50 | |
| *** drawsmcgraw1 has joined #openstack-infra | 13:51 | |
| *** drawsmcgraw has quit IRC | 13:51 | |
| *** pabelanger has joined #openstack-infra | 13:52 | |
| pabelanger | mrhillsman: raddaoui: morning, we look to be having some issues with osic-cloud8. Do you mind looking? | 13:53 |
| pabelanger | mrhillsman: raddaoui: we are seeing timeout exceptions when accessing the API, http://grafana.openstack.org/dashboard/db/nodepool-osic will highlight the times we see | 13:54 |
| pabelanger | for example, here is an exception we are seeing: | 13:54 |
| pabelanger | SSLError: SSL exception connecting to https://cloud8.weareopenstack.org:9005/v2.1/d969e01ffd924c2380d985b006c09be4/servers/cdc2c53f-15f8-4b75-9f2a-3fdcb66b2ce5: [Errno 8] _ssl.c:510: EOF occurred in violation of protocol | 13:54 |
| *** spzala has quit IRC | 13:55 | |
| pabelanger | others are: OpenStackCloudException: Error in creating instance (Inner Exception: Unknown Error (HTTP 504)) | 13:55 |
| khivin | yolanda, Hello! Can I ask you about the new repo? The project was created recently https://review.openstack.org/#/c/366154/ . But I have no access to it. How I can become a member an owner or how I can become jenkins-plugins-for-murano-core member? | 13:55 |
| khivin | yolanda, Hello! Can I ask you about the new repo? The project was created recently https://review.openstack.org/#/c/366154/ . But I have no access to it. How I can become an owner or how I can become jenkins-plugins-for-murano-core member? | 13:56 |
| yolanda | hi khivin i can add you there | 13:56 |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config: Switch Gnocchi functional jobs to Xenial https://review.openstack.org/366573 | 13:57 |
| openstackgerrit | Julien Danjou proposed openstack-infra/project-config: Switch Telemetry jobs to Xenial https://review.openstack.org/366574 | 13:57 |
| yolanda | done | 13:57 |
| khivin | yolanda, thank you! | 13:58 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: scenario001: deploy Ceph https://review.openstack.org/366810 | 13:59 |
| *** Na3iL has quit IRC | 13:59 | |
| *** skipp has joined #openstack-infra | 14:00 | |
| *** xarses has quit IRC | 14:01 | |
| *** eeiden has joined #openstack-infra | 14:01 | |
| *** amotoki has quit IRC | 14:01 | |
| *** rajinir has joined #openstack-infra | 14:02 | |
| *** amotoki has joined #openstack-infra | 14:02 | |
| *** ddieterly has joined #openstack-infra | 14:02 | |
| *** esikachev has joined #openstack-infra | 14:02 | |
| *** hongbin has joined #openstack-infra | 14:03 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: scenario002: deploy Swift https://review.openstack.org/367401 | 14:03 |
| *** matt-borland has joined #openstack-infra | 14:03 | |
| mordred | pabelanger: is your glean patch in good shape for review? | 14:04 |
| *** burgerk has quit IRC | 14:05 | |
| pabelanger | mordred: I believe so, feedback is most welcome | 14:05 |
| *** mrjk has quit IRC | 14:06 | |
| mordred | pabelanger: ah - I see now that you made a patch, then fixed the patch I did- so there are two patches | 14:06 |
| mordred | cool | 14:06 |
| openstackgerrit | Merged openstack-infra/infra-manual: Document commit message syntax for StoryBoard https://review.openstack.org/360668 | 14:06 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: tripleo/scenario002: add swift https://review.openstack.org/367404 | 14:06 |
| pabelanger | mordred: Ya, 2 for now, but can squash once everybody agrees to them | 14:06 |
| mordred | I don't really have any issue with it remaining two | 14:07 |
| mordred | like, the first one should be able to land already I think - while we poke at the gentoo networking bit with prometheanfire | 14:07 |
| mordred | also - "for intf in interfs:" is possible the best line I've read all morning | 14:07 |
| mordred | it's almost like we're networking with smurfs | 14:08 |
| AJaeger | yolanda: https://github.com/openstack/deb-neutron-taas is not yet synced, do you have any idea on this? | 14:08 |
| *** hashar is now known as hasharAway | 14:08 | |
| pabelanger | Ya, I was going to stack gentoo on to 366862 since ipv6 support is skipped today. Then we can decided to squash | 14:08 |
| yolanda | replication to github is super slow | 14:08 |
| yolanda | i saw queue and there are several retries for github | 14:08 |
| mordred | pabelanger: ++ | 14:09 |
| *** _coolsvap_ is now known as coolsvap | 14:09 | |
| mordred | pabelanger: also, while your brain is in glean land ... NobodyCam has a patch that looks worthwhile https://review.openstack.org/#/c/359471/ | 14:09 |
| fungi | yolanda: well, gerrit doesn't have permission to push into that repo in github yet | 14:09 |
| *** tongli has joined #openstack-infra | 14:09 | |
| mordred | fungi: that will make it take a long time to replicate to it | 14:10 |
| fungi | yolanda: if you go to https://github.com/openstack/deb-neutron-taas and click on the green "add teams and collaborators" button you'll see the teams box is empty | 14:10 |
| *** sdake has joined #openstack-infra | 14:10 | |
| fungi | yolanda: click the drop-down for "add a team: select team" and pick "Gerrit" from the list | 14:10 |
| fungi | yolanda: then switch the permission for it from read-only to read-write | 14:11 |
| yolanda | fungi yes, i did that for tons of repos today | 14:11 |
| yolanda | was this not done? | 14:11 |
| NobodyCam | Good morning infra folk ;) | 14:11 |
| AJaeger | fungi, yolanda fixed the other 6 repos that were failing already. Seems, this one did not work out | 14:11 |
| pabelanger | mordred: sure | 14:11 |
| fungi | yolanda: yeah, that one doesn't have permission for gerrit yet that i can see | 14:12 |
| *** sdake_ has quit IRC | 14:12 | |
| fungi | which will cause replication for it to queue up in gerrit | 14:12 |
| yolanda | ok done on that one, i missed then | 14:12 |
| *** Na3iL has joined #openstack-infra | 14:12 | |
| yolanda | AJaeger, actually that was not on the list. Do you know if there can be more? | 14:12 |
| mordred | morning NobodyCam ! | 14:13 |
| NobodyCam | Hey hey mordred good morning. ;) | 14:13 |
| AJaeger | yolanda: it was the last entry on the list, you might have missed it. The list was too long ;( | 14:13 |
| yolanda | AJaeger, that one worked | 14:13 |
| zynzel | fungi: can you check http://lists.openstack.org/pipermail/openstack-infra/2016-September/004707.html ?:) | 14:14 |
| AJaeger | yolanda: everything should be fine now. Thanks! | 14:14 |
| mordred | NobodyCam: your patch conflicts with https://review.openstack.org/#/c/359430 which I think I'd like to land - you mind rebasing? | 14:14 |
| zynzel | nothing happend since september 2. | 14:14 |
| fungi | it seems that we get random http failures back from github's create project api method (sometimes it's that we've made too many api calls with the account in the past hour, sometimes it's just random github brokenness), but the project still ends up created when manage-projects thinks it failed so it never follows up to try adding permissions for gerrit | 14:14 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Skip OSA scenario jobs for liberty/mitaka https://review.openstack.org/367408 | 14:14 |
| yolanda | AJaeger, i see now... in another line so it was not highlighted and missed it :) | 14:14 |
| AJaeger | Ah ;( | 14:14 |
| prometheanfire | mordred: hi? | 14:14 |
| prometheanfire | pabelanger: also hi | 14:15 |
| fungi | zynzel: yeah, that message reflects what you and i discussed on irc. i was hoping others would reply on the ml but i'll just go ahead and reply to it | 14:15 |
| prometheanfire | pabelanger: I was actually working on v6 support in gentoo | 14:15 |
| *** wcriswell has joined #openstack-infra | 14:15 | |
| prometheanfire | pabelanger: now that my attention is turned there | 14:15 |
| fungi | zynzel: since nobody objected, it must be a good plan! ;) | 14:15 |
| zynzel | fungi: i hope :) | 14:15 |
| AJaeger | fungi, I asked zigo already to split up his patch with 41 repos in 5 changes - still this did not work, there were 8 repos in the review and only one setup in github | 14:15 |
| NobodyCam | mordred: happy to but will take me a bit to get to a actual computer | 14:15 |
| *** zhurong has quit IRC | 14:16 | |
| *** thorst has joined #openstack-infra | 14:16 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: WIP -- clean full upgrade review https://review.openstack.org/364859 | 14:16 |
| *** rbrndt has joined #openstack-infra | 14:16 | |
| fungi | AJaeger: yep, we probably need a rallying call for people who care about github support to help us figure out why it's so fragile and make this work more reliably | 14:16 |
| *** zhurong has joined #openstack-infra | 14:17 | |
| openstackgerrit | Merged openstack-infra/release-tools: update release dashboard output for newton https://review.openstack.org/360776 | 14:17 |
| fungi | because i don't personally have a ton of interest in keeping it working | 14:17 |
| pabelanger | prometheanfire: if you give me a second, about to push up ipv6 for gentoo. Will get you to review | 14:17 |
| *** amotoki has quit IRC | 14:17 | |
| mordred | NobodyCam: no rush | 14:17 |
| prometheanfire | pabelanger: cool | 14:17 |
| openstackgerrit | Merged openstack-infra/release-tools: move stable branch tools to project-config https://review.openstack.org/362419 | 14:18 |
| openstackgerrit | Merged openstack-infra/release-tools: use utf-8 for reading the readme files https://review.openstack.org/362345 | 14:18 |
| openstackgerrit | Merged openstack-infra/release-tools: Fix update_upper_constraints removing additional ' ' char https://review.openstack.org/365372 | 14:18 |
| fungi | NobodyCam: eventually i'll get an actual computer implanted directly, and then i'll stop having to make that same excuse ;) | 14:18 |
| *** pabelanger has quit IRC | 14:18 | |
| *** zz_dimtruck is now known as dimtruck | 14:19 | |
| *** thorst_ has joined #openstack-infra | 14:19 | |
| mordred | SpamapS: I totally agree with your "integration tests for glean in the gate" comment | 14:19 |
| mordred | SpamapS: (on https://review.openstack.org/#/c/279818 for glean) | 14:19 |
| mordred | SpamapS: I have no idea how we do that - but I think it would be spectacular | 14:19 |
| openstackgerrit | Merged openstack-infra/release-tools: sort output of latest-deliverable-versions by team https://review.openstack.org/363763 | 14:19 |
| openstackgerrit | Merged openstack-infra/glean: Add logging around interface carrier detection https://review.openstack.org/359430 | 14:19 |
| *** yaume_ has joined #openstack-infra | 14:20 | |
| *** zul has joined #openstack-infra | 14:20 | |
| *** pabelanger has joined #openstack-infra | 14:20 | |
| NobodyCam | fungi: lol.. I think I saw a movie like that, "circuitry man" I believe, not sure I remember the ending but I don't think it went well :p | 14:22 |
| *** thorst has quit IRC | 14:22 | |
| *** zul has quit IRC | 14:22 | |
| openstackgerrit | Merged openstack-infra/project-config: Normalize projects.yaml https://review.openstack.org/367196 | 14:22 |
| *** yaume has quit IRC | 14:23 | |
| fungi | NobodyCam: "tetsuo the iron man"? or maybe "videodrome"? yeah, it tends to be fraught with peril and insanity | 14:23 |
| *** sshnaidm|afk has joined #openstack-infra | 14:23 | |
| *** sshnaidm|afk is now known as sshnaidm | 14:23 | |
| *** zul has joined #openstack-infra | 14:23 | |
| *** mrjk has joined #openstack-infra | 14:24 | |
| NobodyCam | ;) | 14:24 |
| *** bnemec has quit IRC | 14:24 | |
| * fungi expects he has a high resistance to cyberpsychosis though | 14:25 | |
| *** ihrachys has quit IRC | 14:25 | |
| * NobodyCam expects the iPhone 27 will be implanted... | 14:26 | |
| fungi | something tells me it won't take them that many revisions to get there | 14:27 |
| NobodyCam | Lol | 14:27 |
| *** ihrachys has joined #openstack-infra | 14:27 | |
| *** bnemec has joined #openstack-infra | 14:27 | |
| *** amotoki has joined #openstack-infra | 14:28 | |
| openstackgerrit | Lin Yang proposed openstack-infra/project-config: Add new project RSC to openstack repo https://review.openstack.org/341966 | 14:28 |
| zigo | Does OpenStack gerrit support hg::https:// scheme for the upstream: field? | 14:29 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE: WIP: Nothing here https://review.openstack.org/365324 | 14:29 |
| zigo | IMO, it should be only a mater of adding the git remote plugin. | 14:30 |
| fungi | zigo: no, we only have support implemented for git. we don't have any mercurial converter as part of the current tooling | 14:30 |
| fungi | but it could probably be implemented, yes | 14:31 |
| zigo | fungi: apt-get install git-remote-hg | 14:31 |
| zigo | fungi: And that's done ... | 14:31 |
| zigo | :) | 14:31 |
| zigo | I've been using it for years, and it works really well. | 14:31 |
| zigo | It accesses mercurial repos just as if they were Git repos. | 14:31 |
| zigo | Just prefix with hg:: | 14:31 |
| fungi | zigo: yep, i've used it before, and if you're not trying to push back into mercurial it seems to be good for a read-only feed | 14:32 |
| wznoinsk | hi, anyone seen this before https://bugs.launchpad.net/diskimage-builder/+bug/1621501 ? | 14:32 |
| openstack | Launchpad bug 1621501 in diskimage-builder "Unsupported device type 772 for "lo" caused by dhcp-all-interfaces" [Undecided,New] | 14:32 |
| zigo | Which is exactly what I need to track upstream for xstatic-jquery. | 14:32 |
| *** burgerk has joined #openstack-infra | 14:32 | |
| fungi | wznoinsk: i have not, but dib has its own irc channel so you might find more people there with ideas | 14:33 |
| *** amotoki has quit IRC | 14:33 | |
| wznoinsk | fungi: been there, done that hence came here | 14:33 |
| fungi | wznoinsk: oh, unfortunate | 14:34 |
| fungi | well, someone here may have run into it i suppose (just not me!) | 14:34 |
| *** rodrigods has quit IRC | 14:35 | |
| *** rodrigods has joined #openstack-infra | 14:35 | |
| wznoinsk | fungi: I've switched to simple-init for a test for now, I know how to fix the above but I was just wondering is just happening in my setup only | 14:35 |
| SpamapS | mordred: if we could make glean work on cirros or something similarly tiny that boots fast.. | 14:35 |
| fungi | wznoinsk: some brief searching indicates that this happens when you tell dhclient to try and listen on the loopback interface | 14:35 |
| *** scarab_ has joined #openstack-infra | 14:35 | |
| *** _nadya_ has quit IRC | 14:36 | |
| *** scarab_ has left #openstack-infra | 14:37 | |
| wznoinsk | fungi: yes, hence my comments in the lp that dhcp-all-interfaces configures lo for dhcp instead of as loopback type | 14:37 |
| fungi | wznoinsk: can you paste your /etc/network/interfaces and /etc/dhclient.conf from that image to paste.openstack.org? | 14:37 |
| fungi | oh, maybe it's already in the bug | 14:37 |
| mhayden | i have a need to create some automatically generated docs content in a particular openstack repository -- is that possible? (not docs generated from docstrings in code, but rather from a script) | 14:38 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Add skeleton for DIB build cleanup https://review.openstack.org/367423 | 14:39 |
| mordred | mhayden: we do things like that in a few places, yeah - sphinx plugins is how people have been doing it - let me find you an example | 14:39 |
| zigo | fungi: By the way, I finally understood why I do need the track-upstream stuff. Thanks for your explanation. I'm preparing the project-config patch for it. | 14:39 |
| mhayden | mordred: many thanks! :) | 14:39 |
| zigo | fungi: It takes a long time to write because of so many different URLs for 3rd party python modules... | 14:39 |
| fungi | wznoinsk: yeah, we're only using simple-init, not dhcp-all-interfaces, which is why we wouldn't have run into this | 14:39 |
| *** xarses has joined #openstack-infra | 14:40 | |
| *** salv-orlando has joined #openstack-infra | 14:40 | |
| fungi | zigo: you'll be our first heavy user of that feature upstream. right now we're only using it for our openstack/gerrit repo (a fork of gerrit's codebase we use to backport fixes to the version we're running in production) | 14:40 |
| mordred | mhayden: the doc/source/_exts dir in the openstack/governance repo has five different extensions | 14:41 |
| mhayden | mordred: thanks -- i'll go have a looksee | 14:41 |
| mordred | mhayden: woot! dhellman is also a great human to poke with questions about how it all works - he knows everything | 14:41 |
| mhayden | mordred: you're not the first to tell me such things about dhellmann | 14:42 |
| fungi | wznoinsk: was this a recent regression in that element, or is this the first time you've tried to use it? | 14:42 |
| openstackgerrit | Merged openstack-infra/shade: Add support for jmespath filter expressions https://review.openstack.org/366906 | 14:42 |
| fungi | wznoinsk: i'm skimming the shell scripts from it now to see if i can spot the bug | 14:43 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Add skeleton for DIB build cleanup https://review.openstack.org/367423 | 14:43 |
| *** baoli has joined #openstack-infra | 14:43 | |
| openstackgerrit | Vitaly Gridnev proposed openstack-infra/project-config: setup post job for sahara-extra https://review.openstack.org/367271 | 14:46 |
| wznoinsk | fungi: I doesn't seem like any of my other dib elements is interfering | 14:47 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Add skeleton for DIB build cleanup https://review.openstack.org/367423 | 14:47 |
| *** armax has joined #openstack-infra | 14:49 | |
| fungi | wznoinsk: which ubuntu release are you seeing this on? just still skimming the scripts and knowing which branches of the conditionals you're hitting will speed this up | 14:49 |
| *** vinaypotluri has joined #openstack-infra | 14:53 | |
| *** baoli has quit IRC | 14:53 | |
| wznoinsk | fungi: VERSION="16.04.1 LTS (Xenial Xerus)" | 14:54 |
| *** baoli has joined #openstack-infra | 14:54 | |
| mrhillsman | pabelanger reachong out to raddaoui | 14:54 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Add skeleton for DIB build cleanup https://review.openstack.org/367423 | 14:54 |
| *** kzaitsev_mb has quit IRC | 14:55 | |
| *** rhallisey has joined #openstack-infra | 14:56 | |
| odyssey4me | project-config cores, I'd appreciate a quick review of https://review.openstack.org/367408 | 14:57 |
| *** dprince has quit IRC | 14:57 | |
| *** sandanar has quit IRC | 14:57 | |
| *** dprince has joined #openstack-infra | 14:57 | |
| *** kzaitsev_mb has joined #openstack-infra | 14:59 | |
| *** gouthamr has joined #openstack-infra | 14:59 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Add skeleton for DIB build cleanup https://review.openstack.org/367423 | 14:59 |
| *** jraju has quit IRC | 14:59 | |
| clarkb | odyssey4me: how is the log "cleanup" going? manage to get the renamed logs hosted off of the log server? | 14:59 |
| *** gouthamr_ has joined #openstack-infra | 15:00 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Skip OSA scenario jobs for liberty/mitaka https://review.openstack.org/367408 | 15:00 |
| odyssey4me | clarkb thanks for the review - I've corrected an error with the releasenotes job name | 15:01 |
| openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: upstream: and options: track-upstream for deb-* https://review.openstack.org/367343 | 15:01 |
| zigo | fungi: ^ | 15:01 |
| *** yuval has quit IRC | 15:01 | |
| AJaeger | odyssey4me: see http://logs.openstack.org/08/367408/1/check/gate-project-config-layout/850d726/console.html#_2016-09-08_14_25_43_994989 - that branch condition looks wrong to me, doesn't it? | 15:01 |
| *** ddieterly has quit IRC | 15:01 | |
| odyssey4me | clarkb yeah, so we found and fixed up the thing that was causing the huge log sizes... I'm now working on compressing them - renaming them to .txt, then compressing them works | 15:01 |
| zigo | Woops, I'm deleting deb-trove... | 15:02 |
| zigo | Fixing. | 15:02 |
| openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: upstream: and options: track-upstream for deb-* https://review.openstack.org/367343 | 15:02 |
| fungi | wznoinsk: thanks, wondering if this is an issue specifically with the systemd-specific implementation in that element, but i'll see what i can spot | 15:03 |
| odyssey4me | AJaeger looking | 15:03 |
| *** gouthamr has quit IRC | 15:04 | |
| openstackgerrit | Lin Yang proposed openstack-infra/project-config: Add new project RSC to openstack repo https://review.openstack.org/341966 | 15:04 |
| *** akshai_ has quit IRC | 15:04 | |
| odyssey4me | AJaeger it looks fine to me - that's the rule which is ensuring that we run all trusty jobs (except docs/releasenotes) for Newton/master | 15:05 |
| *** eggshell has joined #openstack-infra | 15:05 | |
| odyssey4me | AJaeger I'm not sure what is catching your eye though? | 15:05 |
| AJaeger | odyssey4me: I would have expected the regex from https://review.openstack.org/#/c/367408/2/zuul/layout.yaml getting applied... | 15:06 |
| *** _nadya_ has joined #openstack-infra | 15:06 | |
| *** jlanoux has quit IRC | 15:06 | |
| AJaeger | odyssey4me: you have too many regexes that could fire, this is complicated ;( | 15:07 |
| odyssey4me | AJaeger yeah, I would love to try and cut them down | 15:07 |
| wznoinsk | fungi: it looks like it happens on systemd-backed OSs but that don't use /etc/sysconfig/network-script so it happens on Ubuntu 16 | 15:07 |
| AJaeger | odyssey4me: you have one regex: Don't run on liberty, the next one: Run on liberty. That'S confusing. | 15:07 |
| *** thcipriani|afk is now known as thcipriani | 15:07 | |
| wznoinsk | fedora (at least ver21 I have) uses systemd + /etc/sysconfig/network-scripts/ifcfg-lo which would prevent the issue from happening | 15:08 |
| wznoinsk | but since dhcp-all-interfaces uses 'ifquery lo' which doesn't return anything it confiugures it for dhcp | 15:08 |
| wznoinsk | (uses ifquery on ubuntu 16) | 15:09 |
| *** zhurong has quit IRC | 15:09 | |
| AJaeger | odyssey4me: please find a way to simplify it. | 15:10 |
| odyssey4me | AJaeger yeah, trying to figure something out | 15:10 |
| AJaeger | odyssey4me: if that means beeing a bit more explicit, so be it... | 15:10 |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: WIP -- clean full upgrade review https://review.openstack.org/364859 | 15:10 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Use a DNS server local to rh1 https://review.openstack.org/367444 | 15:12 |
| *** akshai has joined #openstack-infra | 15:14 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Fix some Typos https://review.openstack.org/367448 | 15:14 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: tripleo: make scenario001 non voting https://review.openstack.org/367453 | 15:14 |
| EmilienM | hi, I have an outstanding request, https://review.openstack.org/367453 | 15:15 |
| *** spzala has joined #openstack-infra | 15:16 | |
| zigo | fungi: How does the track-upstream feature work? Is it a simple cron job? | 15:19 |
| *** akshai has quit IRC | 15:19 | |
| *** akshai has joined #openstack-infra | 15:19 | |
| *** sdake_ has joined #openstack-infra | 15:21 | |
| mordred | wznoinsk, fungi: there is a patch up for glean that changes how systemd detection works based on issues with newer ubuntu | 15:21 |
| *** sdake has quit IRC | 15:22 | |
| mordred | wznoinsk, fungi: perhaps it's related to the issue you're seeing? https://review.openstack.org/#/c/279818/ | 15:22 |
| wznoinsk | mordred: thanks, the issue I have is with dhcp-all-interfaces element tho | 15:23 |
| mordred | ah. well then nevermind :) | 15:25 |
| openstackgerrit | yolanda.robla proposed openstack-infra/puppet-infracloud: Enable create bridge service by default https://review.openstack.org/367461 | 15:25 |
| *** annegentle has joined #openstack-infra | 15:27 | |
| *** isaacb has quit IRC | 15:27 | |
| mordred | prometheanfire: you've got a -1 on https://review.openstack.org/#/c/259838/ ... and your point is totally valid. however, glean currently doesn't support systemd enablement on gentoo (http://git.openstack.org/cgit/openstack-infra/glean/tree/glean/install.py#n94) ... so I think the test is correct | 15:28 |
| AJaeger | armax: we're in the process of moving jobs to xenial. Do you (neutron liasons) want to review all of them that touch neutron - or can we just go ahead and merge? Two open reviews: https://review.openstack.org/#/c/367015 and https://review.openstack.org/#/c/367015. Clarkb is testing those manually and if there are any problems we can always revert quickly. | 15:28 |
| mordred | prometheanfire: that said, do you think that we should have glean do systemd enablement for gentoo? | 15:28 |
| armax | AJaeger: let me glance over them | 15:29 |
| *** amotoki has joined #openstack-infra | 15:29 | |
| clarkb | AJaeger: armax 014 nad 015 and yes I tested them manully which is where there is a split. The job that fails goes to experimental and the jobs that pass get switched in check/gate as is | 15:29 |
| *** dtantsur is now known as dtantsur|afk | 15:29 | |
| *** mriedem has quit IRC | 15:29 | |
| clarkb | also apparently that failure may be related to neutron compiling its own kernel modules nad userland for ovs in the tests? | 15:30 |
| clarkb | would explain why all of the normal devstack-gate + devstack + tempest jobs are happy | 15:30 |
| *** dprince has quit IRC | 15:30 | |
| AJaeger | armax: I'm interested in a general guideline - I'm happy to ping you or dougwig if you prefer. | 15:30 |
| *** dprince has joined #openstack-infra | 15:31 | |
| prometheanfire | mordred: I think we should support both systemd and openrc | 15:32 |
| AJaeger | armax: but since it's switching from trusty to xenial, it's basically a duplication of jobs and manual testing - and that's why I ask whether you want to review them all | 15:32 |
| *** akshai has quit IRC | 15:32 | |
| *** akshai has joined #openstack-infra | 15:33 | |
| armax | AJaeger: I personally want to stay on top of things so that I can navigate through the project-config repo without too many surprises | 15:33 |
| armax | AJaeger: I am sure the patches are fine per se | 15:33 |
| AJaeger | armax: ok, shall I ping you? Just add to the reviews? What'S your preference? And do you want to +1 these - or just be aware of them? | 15:34 |
| *** amotoki has quit IRC | 15:34 | |
| prometheanfire | mordred: the problem comes because gentoo optionally supports it, so systemctl enable won't work on openrc (Have a server without systemd installed at all for instance) | 15:34 |
| armax | AJaeger: ping me, if it’s not too much trouble | 15:34 |
| armax | AJaeger: I’ll try to be as prompt as I can get | 15:34 |
| AJaeger | armax: will do - clarkb, please ping him as well if there are more neutron changes | 15:35 |
| pleia2 | good morning | 15:35 |
| *** jlanoux has joined #openstack-infra | 15:35 | |
| *** mikelk has quit IRC | 15:35 | |
| AJaeger | good morning, pleia2 ! | 15:35 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Skip OSA scenario jobs for liberty/mitaka https://review.openstack.org/367408 | 15:35 |
| clarkb | AJaeger: yup yup. Hopefully if this patch to stop compiling things on xenial fixes us the last big patch is to switch the eperiemtnal jobs over to check/gate | 15:35 |
| AJaeger | clarkb: we'Re done already on neutron? Great! But still need to do the neutron owned repos I fear... | 15:36 |
| AJaeger | clarkb: sorry, lost track on what's done and what not... | 15:36 |
| * AJaeger just wants to get them merged asap. | 15:36 | |
| *** matrohon has quit IRC | 15:37 | |
| AJaeger | armax: there's a -1 by Jakub on one of the reviews, could you tell us your view, please in the review? | 15:37 |
| clarkb | AJaeger: well not done. There are these bugs causing failures int he api, functional, and fullstack tests but jlibosva thinks maybe its related to this incompatible set of software the jobs are compiling | 15:37 |
| AJaeger | clarkb: argh | 15:37 |
| *** dprince has quit IRC | 15:37 | |
| clarkb | yes that was sort of my initial reaction | 15:37 |
| armax | AJaeger: ack | 15:37 |
| *** esikachev has quit IRC | 15:38 | |
| clarkb | also fwiw I am very much against being super conservative on these changes | 15:38 |
| * AJaeger will be back online later... | 15:38 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Fix promote script and add logs https://review.openstack.org/367244 | 15:38 |
| clarkb | neutron has asked for these newer things and we give them and now its sorry hurry up and wait? | 15:38 |
| AJaeger | clarkb: I agree - I rather have it merged and reverted quickly | 15:38 |
| AJaeger | or fixed quickly | 15:38 |
| clarkb | but also the only reason we have had any failures at all in those tests is because neutron's test setup is broken | 15:38 |
| clarkb | and its good to discover these things and just fix them | 15:38 |
| *** zul has quit IRC | 15:39 | |
| *** zul has joined #openstack-infra | 15:40 | |
| *** zul has quit IRC | 15:40 | |
| *** zul has joined #openstack-infra | 15:41 | |
| *** thiagolib has joined #openstack-infra | 15:41 | |
| prometheanfire | mordred: basically, if I'm sorry...i love Google, the nexus/pixel line, and even use project Fi...but if people migrate to android from Apple they are going to get Galaxy phones. Samsung advertises very similarly to Apple as well as their phones being well known by name and accessibility. The average person didn't know what a nexus phone was and unless Google changes how they advertise they | 15:41 |
| prometheanfire | won't know what a pixel phone is either. | 15:41 |
| prometheanfire | fuck | 15:41 |
| *** andreas_s has quit IRC | 15:42 | |
| prometheanfire | mordred: basically if /usr/bin/systemctl is on the system (from a gentoo point of view) then you can enable via systemd | 15:42 |
| *** gouthamr_ is now known as gouthamr | 15:42 | |
| clarkb | AJaeger: https://review.openstack.org/#/c/364880/6 is maybe the fix for the failing things on xenial | 15:42 |
| *** vhosakot has joined #openstack-infra | 15:42 | |
| openstackgerrit | Nikhil Komawar proposed openstack-infra/project-config: Create a release notes job for glanceclient https://review.openstack.org/367473 | 15:44 |
| armax | AJaeger, clarkb: reviewed | 15:46 |
| anteaya | prometheanfire can you dial back your language? | 15:46 |
| armax | AJaeger: overall look good, but I have a couple of questions, mainly related to the side effects of the rename | 15:46 |
| armax | AJaeger: to Grafana and skip clauses | 15:46 |
| dtroyer | Gerrit admins: I need to be added to the new python-openstackclient-stable-maint group please… (https://review.openstack.org/#/c/366989/) | 15:47 |
| *** dahoo has joined #openstack-infra | 15:47 | |
| clarkb | oh right neutron has grafana graphs | 15:47 |
| armax | AJaeger, clarkb: the renames have typically set us back because jobs start being executed when they shouldn’t and their failure trends disappear from Grafana dashboards | 15:47 |
| clarkb | those will need updating | 15:47 |
| clarkb | armax: the way to deal with that is to have graphs that use both old and new names | 15:48 |
| armax | clarkb: do you want to take care of that as follow up? | 15:48 |
| armax | clarkb: I am easy either way | 15:48 |
| armax | so long as we merge the follow up fast | 15:48 |
| armax | which we usually do anyway | 15:48 |
| clarkb | I can try to figure out how to do that and push it in the same changes | 15:48 |
| armax | clarkb: there’s an upper limit on the number of graphs we can plot in a single dashboard | 15:49 |
| armax | I think it’s 9 | 15:49 |
| clarkb | armax: ya I think we can combine it in a single graph | 15:49 |
| armax | ihrachys might know better | 15:49 |
| clarkb | armax: so your graphs is show be success for old and new and show my faisl for old and new | 15:49 |
| clarkb | in one graph | 15:49 |
| armax | ihrachys: what’s the limit of # of plots in a single dashboard, do you remember? | 15:49 |
| anteaya | prometheanfire: can you do that? | 15:49 |
| clarkb | armax: I just have to sort out how to express that in grafyaml | 15:50 |
| *** gordc has quit IRC | 15:50 | |
| EmilienM | I'm sorry to ask again (I hate that) but could someone approve https://review.openstack.org/#/c/367453/ please? | 15:50 |
| ihrachys | armax: I think it was 9 or so when I hit it, yes; but then it somehow healed itself. so I am honestly not sure it's an actual limit, or some intermittent issue that I was lucky to catch | 15:51 |
| *** mriedem has joined #openstack-infra | 15:51 | |
| armax | clarkb: I’d be happy to track them separately if it makes our lives any easier | 15:51 |
| armax | ihrachys: ack | 15:51 |
| armax | thanks | 15:51 |
| fungi | dtroyer: is osc under official stable maintenance? i think those groups are supposed to be under control of the main stable-maint team and then they confirm members into the project-specific stable-maint teams | 15:51 |
| *** jgriffith_away is now known as jgriffith | 15:53 | |
| dtroyer | I'm not certain, dhellmann suggested I needed this group. | 15:53 |
| dtroyer | frankly I don't want stable branches, but I am being outnumbered here I think | 15:54 |
| *** tphummel has quit IRC | 15:55 | |
| mtreinish | dtroyer: why does osc need stable branches? | 15:58 |
| EmilienM | anteaya: thanks a lot | 15:58 |
| Krenair | fungi, I noticed wiki-dev shows a db query error now | 15:58 |
| *** akshai has quit IRC | 15:58 | |
| mtreinish | it's not tied to a particular release and we can just use caps/u-c for where we use it in devstack and gate jobs on stable | 15:58 |
| anteaya | EmilienM: welcome | 15:58 |
| fungi | tonyb: ^ can you weigh in on putting dtroyer in https://review.openstack.org/#/admin/groups/1561,members ? i've given stable-maint-core control over it for the moment like the other stable-maint teams | 15:58 |
| dtroyer | mtreinish: I don't really know outside of easing processes | 15:59 |
| *** akshai has joined #openstack-infra | 15:59 | |
| fungi | Krenair: yep, i haven't actually imported database content into teh trove instance it's using yet. was going to make sure the robots.txt change landed before search engines start hitting it | 15:59 |
| Krenair | ok | 15:59 |
| dtroyer | fungi: thanks | 16:00 |
| openstackgerrit | Merged openstack-infra/project-config: tripleo: make scenario001 non voting https://review.openstack.org/367453 | 16:00 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Update query for n-api deadlock bug 1480305 https://review.openstack.org/367479 | 16:00 |
| openstack | bug 1480305 in OpenStack Compute (nova) "DBDeadlock inserting into instance_extra" [Medium,Triaged] https://launchpad.net/bugs/1480305 | 16:00 |
| fungi | Krenair: last night i ended up sucking up a lot of time troubleshooting a strange ipv6 configuration issue in rackspace that seemed to go away when i blew away the wiki-dev01 instance which was having the issue and built a new one. i suspect something was wrong/missing in their network metadata | 16:00 |
| *** _nadya_ has quit IRC | 16:00 | |
| *** matthewbodkin has quit IRC | 16:00 | |
| zaro | morning | 16:01 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Add neutron api test on xenial to experimental https://review.openstack.org/367015 | 16:01 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Run neutron linuxbridge and dvr jobs on xenial https://review.openstack.org/367014 | 16:01 |
| anteaya | morning zaro | 16:01 |
| clarkb | AJaeger: armax ^ I think that should address the graphing concerns | 16:01 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Add a notice when worklists or boards are private or archived https://review.openstack.org/357354 | 16:04 |
| mordred | dtroyer, mtreinish: fwiw, I tend to agree. I think it makes sense for libs to have stable releases because they're used in server-server communication. but osc is not used for such things - but I also haven't followed any discussion around this | 16:04 |
| fungi | wznoinsk: so... looking in dhcp-all-interfaces.sh there at the conditional at the end, it's _trying_ to filter out the lo interface. can you see what `ls /sys/class/net | grep -v ^lo$` returns on a problem system? | 16:05 |
| mtreinish | mordred: I wasn't even aware there was a discussion on it. I just caught a glimpse of it in the backlog :) | 16:06 |
| wznoinsk | fungi: if you mean this part: | 16:07 |
| wznoinsk | if [ -n "$INTERFACE" ]; then | 16:07 |
| wznoinsk | inspect_interface $INTERFACE | 16:07 |
| wznoinsk | else | 16:07 |
| wznoinsk | for iface in $(ls /sys/class/net | grep -v ^lo$); do | 16:07 |
| wznoinsk | inspect_interface $iface | 16:07 |
| wznoinsk | done | 16:07 |
| *** fguillot has quit IRC | 16:07 | |
| wznoinsk | fi | 16:07 |
| *** Benj_ has joined #openstack-infra | 16:07 | |
| mordred | mtreinish: me either | 16:08 |
| fungi | wznoinsk: yep, it's being called from the systemd service definition with, i think, no $1 which means it should be hitting that else clause | 16:08 |
| wznoinsk | the for loop will not be hit normally, dhcp-all-interfaces.sh is invoked for each interface (name) | 16:08 |
| fungi | ohhh | 16:08 |
| dtroyer | mordred, mtreinish: the discussion is one stevemar wants to have again now. I thought it was going to happen in -sdks, maybe it'll happen in OSC meeting this afternoon. in any case, we have some stable branches and have not yet merged the basic reviews required to set them up... | 16:08 |
| *** fguillot has joined #openstack-infra | 16:08 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DO NOT MERGE: trying without proxy https://review.openstack.org/367484 | 16:08 |
| mordred | dtroyer: cool. I'll try to lurk around for it | 16:09 |
| wznoinsk | fungi: based on this condition in udev: SUBSYSTEM=="net", ACTION=="add", TAG+="systemd", ENV{SYSTEMD_WANTS}+="dhcp-interface@$name.service" | 16:09 |
| fungi | wznoinsk: the way it's written, it expects to be called once with no interface if the intent is to configure all interfaces, or else it expects to only be called for specific interfaces. i wonder where the breakdown is | 16:09 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Update query for n-api deadlock bug 1480305 https://review.openstack.org/367479 | 16:09 |
| openstack | bug 1480305 in OpenStack Compute (nova) "DBDeadlock inserting into instance_extra" [Medium,Triaged] https://launchpad.net/bugs/1480305 - Assigned to John Garbutt (johngarbutt) | 16:09 |
| *** yaume_ has quit IRC | 16:09 | |
| fungi | wznoinsk: ahh, yep. so the filtering logic in the script isn't kicking in because it's being driven asynchronously from udev events | 16:09 |
| fungi | i missed that bit on the first pass | 16:10 |
| wznoinsk | fungi: yes, once for each net device is added | 16:10 |
| *** jianghuaw-m has joined #openstack-infra | 16:10 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/glean: Add ipv6 support to gentoo https://review.openstack.org/367487 | 16:10 |
| prometheanfire | anteaya: sure | 16:11 |
| *** fguillot has quit IRC | 16:11 | |
| pabelanger | prometheanfire: ^ first pass at ipv6 | 16:11 |
| fungi | wznoinsk: in that case, the udev rule for this needs to only fire for relevant interfaces, and i guess when the lo interface is added it generates a udev event on xenial | 16:11 |
| anteaya | prometheanfire: thank you | 16:11 |
| prometheanfire | pabelanger: oh, nice timing, just got out of my third meeting for the day | 16:11 |
| pabelanger | prometheanfire: Ya, you'll need to confirm some of the syntax, that is best guess on my part | 16:12 |
| mordred | prometheanfire: cool - so it sounds like we want to update the logic in install.py to not avoid the systemd enablement code if gentoo is detected | 16:12 |
| wznoinsk | fungi: that's my guess | 16:12 |
| armax | clarkb: what about running both flavors on the jobs on the check queue? | 16:12 |
| prometheanfire | mordred: ya, the current code was there just for the 'common | 16:12 |
| armax | clarkb: mind sharing why it’s needed? | 16:12 |
| prometheanfire | ' use case of openrc | 16:13 |
| mordred | prometheanfire: ++ | 16:13 |
| *** Benj_ has quit IRC | 16:13 | |
| prometheanfire | pabelanger: the 'out' looks valid | 16:13 |
| mordred | prometheanfire: so mind if we land https://review.openstack.org/#/c/259838 for now (it's just testing current state of the world) - and then do a follow on patch that updates install logic and changes the test? | 16:13 |
| prometheanfire | mordred: sure, as long as it's not forgotten | 16:14 |
| pabelanger | prometheanfire: Ya, we only have 1 test cases right now, so I am not sure any other ipv6 networking will work. Honestly, which is fine because if it is broken else where, I want to add a testcase for it, then guess | 16:14 |
| prometheanfire | pabelanger: hardcoding /64 ok? | 16:14 |
| pabelanger | prometheanfire: Ya, not sure if that is correct | 16:15 |
| pabelanger | need help with that | 16:15 |
| prometheanfire | pabelanger: we probably need to have a function to covert the long form to the cidr form | 16:15 |
| pabelanger | ya | 16:15 |
| pabelanger | let me see if I can find something | 16:15 |
| prometheanfire | pabelanger: there are libs, but glean is self contained... | 16:15 |
| clarkb | armax: you mean why we are splitting this way? because we don't want to have to support trusty for an additional release cycle | 16:16 |
| *** esikachev has joined #openstack-infra | 16:16 | |
| clarkb | armax: we want to move forward with our lives and use new software | 16:16 |
| pabelanger | prometheanfire: Ya, not sure I want to write a cidr function | 16:16 |
| prometheanfire | pabelanger: ya :| | 16:16 |
| armax | clarkb: no I mean why we run trusty and xenial both | 16:16 |
| armax | when for full we only run xenial | 16:16 |
| *** drifterza has quit IRC | 16:16 | |
| prometheanfire | pabelanger: it's not pretty, I don't think it'd be TOO bad | 16:17 |
| fungi | wznoinsk: i'm having to refresh my memories of udev rules. can you try prepending KERNEL!="lo", to that line? | 16:17 |
| armax | clarkb: hang on | 16:18 |
| pabelanger | prometheanfire: if only python3, we could use ipaddress | 16:18 |
| armax | clarkb: I think I am on it | 16:18 |
| armax | clarkb: ignore me | 16:18 |
| prometheanfire | pabelanger: could we? I thought we wanted to avoid external deps | 16:18 |
| armax | for now | 16:18 |
| clarkb | armax: oh for the api tests its because the xenial one currently fails. So keeping that as status quo on trusty for now | 16:18 |
| mordred | pabelanger: reading your commit message on https://review.openstack.org/#/c/366862 ... centos7 doesn't support ipv6? or just glean doesn't have support for it yet? | 16:18 |
| armax | clarkb: I mean | 16:18 |
| clarkb | armax: the hope being the new xenial experimental job can be used to debug xenial further | 16:18 |
| armax | clarkb: we only run gate-tempest-dsvm-neutron-full-ubuntu-xenial | 16:18 |
| pabelanger | mordred: glean is lacking it | 16:19 |
| armax | clarkb: why for dvr and linuxbridge we run both on master? | 16:19 |
| mordred | pabelanger: gotcha. that makes more sense to me | 16:19 |
| clarkb | armax: we shouldn't run both on master. linuxbridge and dvr should have the same split | 16:19 |
| armax | clarkb: so am I reading this wrong? https://review.openstack.org/#/c/367014/2/zuul/layout.yaml@11123 | 16:19 |
| armax | it looks to me we’re running both flavors | 16:19 |
| pabelanger | prometheanfire: ya, maybe we should reconsider that. I mean, not today, but it would be nice is we could use voluptuous to deal with json validation, rather then what we have today | 16:20 |
| *** vsaienko1 has quit IRC | 16:20 | |
| pabelanger | prometheanfire: mind you, I've only started working on glean this week | 16:20 |
| prometheanfire | pabelanger: lol, welcome :P | 16:20 |
| *** esikachev has quit IRC | 16:20 | |
| clarkb | armax: yes they are both listed because that list there is for all branches. Then in the jobs section there are default ruels that say xenial runs on >=newton and trusty on < newton | 16:21 |
| *** tesseract- has quit IRC | 16:21 | |
| prometheanfire | pabelanger: if it generates the configs, other than the subnet conversion function being needed I think it's ok | 16:22 |
| armax | clarkb: oh right | 16:22 |
| armax | I keep forgetting that | 16:22 |
| *** tkelsey has joined #openstack-infra | 16:22 | |
| armax | clarkb: thanks | 16:23 |
| *** trown is now known as trown|outtypewww | 16:23 | |
| *** thorst_ has quit IRC | 16:23 | |
| mordred | pabelanger, prometheanfire: we do still want to keep glean with no depends - one of the problems it solves from cloud-init was that cloud-init installed stuff on the system which then conflicted with things we want to install in the test nodes themselves | 16:23 |
| *** thorst has joined #openstack-infra | 16:23 | |
| mordred | which, yeah - makes some of the bits harder, since it makes it hard to use libraries | 16:23 |
| openstackgerrit | Paul Belanger proposed openstack-infra/glean: Add ipv6 support to gentoo https://review.openstack.org/367487 | 16:24 |
| prometheanfire | right now it's just that function | 16:24 |
| *** kaisers has quit IRC | 16:24 | |
| *** hrybacki is now known as hrybacki|food | 16:24 | |
| mordred | I started on a rust rewrite a while ago which would alleviate any runtime dependency issues - but the python version works well enough it hasn't ever been worth doing additional work on that | 16:25 |
| pabelanger | mordred: Ya, I am not too sure of the history between cloud-init and glean to be honest. | 16:25 |
| pabelanger | so don't take my suggests to heart ;) | 16:25 |
| clarkb | FYI I am deleting leaked images in our clouds again now that a big cause of those leaks should be fixed | 16:26 |
| *** jianghuaw-m has quit IRC | 16:26 | |
| prometheanfire | does glean write out systemd network configs? | 16:26 |
| clarkb | this will let us check for leaks again in a week or so to see if things are better | 16:26 |
| prometheanfire | forget | 16:26 |
| *** Benj_ has joined #openstack-infra | 16:26 | |
| mordred | pabelanger: there are basically two reasons we wrote glean a) support for the config-drive static networking from rackspace b) cloud-init depends on a bunch of python packages and we're in the business of testing the instalation of large python projects | 16:26 |
| prometheanfire | anyway, meeting time, so I'm leaving | 16:26 |
| clarkb | prometheanfire: sort of, it has a unit file that is templated that is run for every interface that writes out eni etc | 16:26 |
| *** abregman_ is now known as abregman | 16:27 | |
| mordred | wow. TIL that systemd configures networks too | 16:27 |
| * mordred isn't sure why he's surprised about this | 16:27 | |
| mtreinish | mordred: I still can't get my bonded networks working with systemd | 16:28 |
| bkero | mordred: https://donnagore.files.wordpress.com/2016/05/491883192_1280x720.jpg | 16:29 |
| *** timello has quit IRC | 16:29 | |
| mtreinish | but I suspect that's more of an upgrade issue, like when I installed it a couple years ago it was broken and it's fixed today on new installs but even after upgrading mine still doesn't work | 16:29 |
| *** dimtruck is now known as zz_dimtruck | 16:30 | |
| mtreinish | at least jroll says it works today, so I just assume it's that | 16:30 |
| jroll | eh? | 16:30 |
| mordred | jroll: apparently you think systemd works | 16:30 |
| jroll | mtreinish: bonding + systemd or? | 16:30 |
| mordred | :) | 16:30 |
| jroll | oh, yes | 16:30 |
| jroll | I can give you an ssh key to an example if you like | 16:31 |
| *** dprince has joined #openstack-infra | 16:31 | |
| *** amotoki has joined #openstack-infra | 16:31 | |
| *** amotoki has quit IRC | 16:31 | |
| *** amotoki has joined #openstack-infra | 16:31 | |
| mtreinish | jroll: no I believe you, it doesn't change the fact that I fear having a power outage longer than my ups's battery when I'm out of town | 16:31 |
| *** thorst has quit IRC | 16:31 | |
| jroll | ah, heh | 16:32 |
| mtreinish | because none of my servers will boot up properly unattended because systemd fails to configure the bonded interfaces properly | 16:32 |
| *** samuelBartel has quit IRC | 16:32 | |
| mtreinish | but I can totally see it working on a new install today | 16:32 |
| jroll | right, well, if you want to try to fix your config, I can give you an example ¯\_(ツ)_/¯ | 16:32 |
| fungi | mordred: systemd only sort of configures network interfaces. systemd-networkd is _supposedly_ still separate software from systemd the init daemon | 16:32 |
| mordred | fungi: oh. silly me | 16:33 |
| mtreinish | fungi: heh, just like systemd-boot | 16:33 |
| fungi | systemd-dog-flosser | 16:33 |
| mordred | so I guess there's systemd the daemon and systemd the general collection of daemons ... this should not be confusing to me since I work on OpenStack - which means 12 different things simultaneously | 16:33 |
| fungi | et cetera | 16:33 |
| *** miniman has quit IRC | 16:33 | |
| *** zz_dimtruck is now known as dimtruck | 16:34 | |
| pabelanger | mordred: Ya, don't have a good solution for b). I assume we considered a virtualenv just for glean in the OS? | 16:34 |
| pabelanger | not that I need an external library atm | 16:34 |
| fungi | mordred: point being, you can use systemd the init daemon with other network management software than systemd-networkd, and i've also heard that you can (perhaps only mostly?) use systemd-networkd without systemd the init daemon | 16:34 |
| mordred | pabelanger: we haven't really explored solutions other than just not having dependencies ... if we do hit the point where we need one, I think we'd need to start exploring solutions | 16:35 |
| mordred | fungi: I'm about to say something I've never said before ... the config format for systemd-networkd does not look completely and totally insane | 16:36 |
| pabelanger | mordred: that's reasonable | 16:36 |
| *** tphummel has joined #openstack-infra | 16:36 | |
| *** fguillot has joined #openstack-infra | 16:37 | |
| fungi | mordred: yep, i've also seen some examples of command-line usage for driving systemd-networkd | 16:38 |
| fungi | it's on my to do list to see if i can switch my ifupdown use cases over to it | 16:38 |
| wznoinsk | fungi: that looks to be doing the trick, need to wait for the full ubuntu bootup but it didn't try to put lo on DHCP like it was doing when I had the problem | 16:38 |
| *** jlanoux has quit IRC | 16:38 | |
| fungi | wznoinsk: cool, you want to propose the fix into gerrit, or shall i? | 16:38 |
| wznoinsk | fungi: I can do it , need to do a few checks before doing so | 16:39 |
| *** spzala has quit IRC | 16:39 | |
| fungi | wznoinsk: awesome--let me know if you need any more help with it | 16:39 |
| *** _nadya_ has joined #openstack-infra | 16:39 | |
| wznoinsk | fungi: will do, thanks | 16:40 |
| *** fguillot has quit IRC | 16:40 | |
| *** spzala has joined #openstack-infra | 16:40 | |
| *** gyee_ has joined #openstack-infra | 16:40 | |
| *** jordanP has quit IRC | 16:40 | |
| *** tongli_ has joined #openstack-infra | 16:41 | |
| *** _nadya_ has quit IRC | 16:41 | |
| pabelanger | prometheanfire: http://stackoverflow.com/questions/33531561/python-ipaddr-library-netmask-ipv6 | 16:42 |
| *** timello has joined #openstack-infra | 16:42 | |
| pabelanger | prometheanfire: will give that a try | 16:42 |
| *** mhickey__ has quit IRC | 16:42 | |
| *** clenimar has joined #openstack-infra | 16:43 | |
| *** piet has joined #openstack-infra | 16:43 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Stop removing the puppet-ceph git repository https://review.openstack.org/367505 | 16:44 |
| *** spzala has quit IRC | 16:44 | |
| *** tongli has quit IRC | 16:44 | |
| *** moravec has quit IRC | 16:45 | |
| armax | clarkb: btw if I can steal a minute of your time: https://review.openstack.org/#/c/361432/ | 16:46 |
| *** amitgandhinz has quit IRC | 16:46 | |
| *** tongli_ has quit IRC | 16:46 | |
| *** spzala has joined #openstack-infra | 16:46 | |
| armax | clarkb: also, we trimmed logs about this much so far: http://logs.openstack.org/40/366440/9/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/c564504/logs/ | 16:46 |
| *** amitgandhinz has joined #openstack-infra | 16:47 | |
| armax | clarkb: I am sure we could do more, I’ll keep scavenging | 16:47 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Skip OSA scenario jobs for liberty/mitaka https://review.openstack.org/367408 | 16:47 |
| *** lucasagomes is now known as lucas-dinner | 16:48 | |
| *** fguillot has joined #openstack-infra | 16:49 | |
| *** derekh has quit IRC | 16:49 | |
| *** spzala has quit IRC | 16:50 | |
| openstackgerrit | Nikhil Komawar proposed openstack-infra/project-config: Create a release notes job for glanceclient https://review.openstack.org/367473 | 16:50 |
| openstackgerrit | Paul Belanger proposed openstack-infra/glean: Add ipv6 support to gentoo https://review.openstack.org/367487 | 16:51 |
| *** fguillot has quit IRC | 16:52 | |
| pabelanger | prometheanfire: updated^ | 16:52 |
| *** fguillot has joined #openstack-infra | 16:54 | |
| *** Apoorva has joined #openstack-infra | 16:55 | |
| mtreinish | jroll: you were right, just re-read the docs and got it working. Go figure :) | 16:56 |
| jroll | \o/ | 16:56 |
| *** devananda|travel is now known as devananda | 16:56 | |
| *** _nadya_ has joined #openstack-infra | 16:56 | |
| *** jheroux has quit IRC | 16:57 | |
| mtreinish | jroll: err, well sort of. It's using the wrong mac and dhcp is giving it the wrong ip now | 16:57 |
| mtreinish | but it's at least booting with a network now :) | 16:57 |
| jroll | heh | 16:57 |
| jroll | nice :) | 16:57 |
| *** spzala has joined #openstack-infra | 16:57 | |
| pabelanger | clarkb: fungi: might be interested in https://review.openstack.org/#/c/363630. Tripleo is wanting to add SSH key for tripleo-admins into the nodepool nodes launched in tripleo-test-cloud-rh1. I suspect we might have some issues with that? | 16:59 |
| *** Hal1 has joined #openstack-infra | 17:01 | |
| *** jaosorior has quit IRC | 17:01 | |
| pabelanger | clarkb: fungi: As side from the fact the node could disappear on them at any time. I'm guess it's possible they could affect the node is some manner when the job is running | 17:01 |
| *** spzala has quit IRC | 17:02 | |
| *** abregman has quit IRC | 17:02 | |
| clarkb | I think if thats the desire then maybe third party ci is a better fit? | 17:02 |
| pabelanger | clarkb: yes, I would agree. | 17:03 |
| *** migi has joined #openstack-infra | 17:03 | |
| *** vhosakot has quit IRC | 17:03 | |
| *** tongli has joined #openstack-infra | 17:04 | |
| pabelanger | clarkb: right now tripleo is struggling to keep their cloud online, so they are looking for more access to troubleshoot. I think that is the reason they are looking for access | 17:04 |
| *** vaidy has quit IRC | 17:04 | |
| *** isviridov_away has quit IRC | 17:05 | |
| pabelanger | but regardless, I something like SSH access highlights the need to stand up their own nodepool server | 17:05 |
| fungi | a third-party ci implementation on that same hardware would get them much more control to troubleshoot their current problems | 17:05 |
| openstackgerrit | Merged openstack/os-client-config: Add ability to configure Session constructor https://review.openstack.org/364589 | 17:05 |
| *** moravec has joined #openstack-infra | 17:05 | |
| pabelanger | fungi: in fact, review.rdoproject.org is setup now for 3rdparty CI. So, it wouldn't be much work to migrate tripleo to that | 17:06 |
| *** tphummel has quit IRC | 17:07 | |
| openstackgerrit | Alex Kavanagh proposed openstack-infra/project-config: Add charm-manila https://review.openstack.org/360762 | 17:07 |
| *** vhosakot has joined #openstack-infra | 17:08 | |
| pabelanger | fungi: do you mind commenting on the review | 17:08 |
| *** tongli has quit IRC | 17:08 | |
| *** spzala has joined #openstack-infra | 17:09 | |
| *** dizquierdo has quit IRC | 17:09 | |
| *** zul has quit IRC | 17:10 | |
| *** piet has quit IRC | 17:12 | |
| openstackgerrit | Waldemar Znoinski proposed openstack/diskimage-builder: don't configure 'lo' for dhcp https://review.openstack.org/367527 | 17:12 |
| *** adrian_otto has joined #openstack-infra | 17:12 | |
| *** spzala has quit IRC | 17:14 | |
| openstackgerrit | Waldemar Znoinski proposed openstack/diskimage-builder: don't configure 'lo' for dhcp https://review.openstack.org/367527 | 17:14 |
| *** fguillot_ has joined #openstack-infra | 17:14 | |
| *** zul has joined #openstack-infra | 17:14 | |
| openstackgerrit | Waldemar Znoinski proposed openstack/diskimage-builder: don't configure 'lo' for dhcp https://review.openstack.org/367527 | 17:15 |
| *** fguillot_ has quit IRC | 17:15 | |
| *** hrybacki|food is now known as hrybacki | 17:17 | |
| AJaeger | pabelanger: could you help land clarkb's changes for neutron xenial, please? https://review.openstack.org/#/c/367014 and https://review.openstack.org/#/c/367015 | 17:18 |
| clarkb | ok all leaked iamges are cleaned up now | 17:18 |
| *** rossella_s has quit IRC | 17:18 | |
| *** rossella_s has joined #openstack-infra | 17:19 | |
| *** drifterza has joined #openstack-infra | 17:20 | |
| *** SumitNaiksatam has joined #openstack-infra | 17:20 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Rework the task list layout https://review.openstack.org/357306 | 17:22 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Add a way to add tasks to worklists from the story view https://review.openstack.org/366899 | 17:22 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient: Complex priorities UI in stories https://review.openstack.org/312666 | 17:22 |
| AJaeger | clarkb: here's a change for gnocchi to switch to xenial, could you review, please? https://review.openstack.org/#/c/366573/ | 17:23 |
| clarkb | AJaeger: sure | 17:23 |
| *** tphummel has joined #openstack-infra | 17:25 | |
| *** spzala has joined #openstack-infra | 17:25 | |
| AJaeger | jd__: are you still around? | 17:26 |
| *** cardeois_ has joined #openstack-infra | 17:28 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Switch Telemetry jobs to Xenial https://review.openstack.org/366574 | 17:28 |
| AJaeger | clarkb: and this one as well - I just fixed jd__'s change ^ | 17:28 |
| *** cardeois has quit IRC | 17:28 | |
| *** spzala has quit IRC | 17:29 | |
| *** thorst has joined #openstack-infra | 17:29 | |
| *** tongli has joined #openstack-infra | 17:30 | |
| AJaeger | project-config cores, could you help land clarkb's changes for neutron xenial, please? https://review.openstack.org/#/c/367014 and https://review.openstack.org/#/c/367015 | 17:31 |
| *** spzala has joined #openstack-infra | 17:31 | |
| openstackgerrit | Merged openstack-infra/project-config: Switch Gnocchi functional jobs to Xenial https://review.openstack.org/366573 | 17:33 |
| *** sambetts is now known as sambetts|afk | 17:34 | |
| *** tongli has quit IRC | 17:34 | |
| *** spzala has quit IRC | 17:35 | |
| pabelanger | AJaeger: +3 | 17:36 |
| *** thorst has quit IRC | 17:37 | |
| AJaeger | pabelanger: thanks | 17:38 |
| AJaeger | is there any infra-root that can force push a repo, please? See https://review.openstack.org/365047 | 17:39 |
| AJaeger | infra-root, paste.openstack.org is taking ages to accept a new entry ;( | 17:40 |
| *** acoles is now known as acoles_ | 17:41 | |
| AJaeger | odyssey4me: check http://paste.opensuse.org/56662231 - there's one entry where I think your regex is not correct. I commented the layout output | 17:41 |
| anteaya | it was working fine for me a minute ago | 17:41 |
| fungi | AJaeger: i can take a minute to do it. also have you checked the cacti graphs for paste.o.o? i wonder if it's getting load spikes or something | 17:41 |
| *** piet has joined #openstack-infra | 17:41 | |
| *** mrjk has quit IRC | 17:41 | |
| anteaya | http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=153&rra_id=all | 17:41 |
| anteaya | it is indeed | 17:41 |
| anteaya | inbound | 17:42 |
| *** _nadya_ has quit IRC | 17:42 | |
| AJaeger | thanks, anteaya. | 17:42 |
| AJaeger | fungi, would be great if you can handle the repo. thanks | 17:42 |
| *** kvcobb has joined #openstack-infra | 17:42 | |
| *** spzala has joined #openstack-infra | 17:42 | |
| anteaya | tcp connections is also spiking: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=147&rra_id=all | 17:43 |
| fungi | AJaeger: yep, i'm pulling it up now | 17:43 |
| *** notnownikki has quit IRC | 17:43 | |
| odyssey4me | AJaeger ah ok, I guess I'll have to revert the branch changes there? | 17:44 |
| *** adrian_otto has quit IRC | 17:45 | |
| *** tqtran has joined #openstack-infra | 17:46 | |
| *** kvcobb has quit IRC | 17:46 | |
| *** spzala has quit IRC | 17:47 | |
| *** piet has quit IRC | 17:47 | |
| openstackgerrit | Merged openstack-infra/project-config: Run neutron linuxbridge and dvr jobs on xenial https://review.openstack.org/367014 | 17:47 |
| *** isviridov_away has joined #openstack-infra | 17:48 | |
| *** tongli has joined #openstack-infra | 17:48 | |
| *** vaidy has joined #openstack-infra | 17:48 | |
| openstackgerrit | Merged openstack-infra/project-config: Add neutron api test on xenial to experimental https://review.openstack.org/367015 | 17:48 |
| *** spzala has joined #openstack-infra | 17:48 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack-infra/project-config: Skip OSA scenario jobs for liberty/mitaka https://review.openstack.org/367408 | 17:48 |
| *** krtaylor has quit IRC | 17:49 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/puppet-elastic_recheck: Make Elastic recheck query location configurable https://review.openstack.org/367556 | 17:49 |
| prometheanfire | pabelanger: cool, will look at | 17:49 |
| prometheanfire | pabelanger: time for my 4th or 5th meeting today | 17:49 |
| AJaeger | odyssey4me: please check the layout change yourself once tests pass and confirm that it's fine. This is all tricky ;( | 17:49 |
| *** tphummel has quit IRC | 17:49 | |
| anteaya | tcp connections have decreased but haven't dropped to their former pre-spike level, inbound traffic is still high, load is still at max | 17:50 |
| *** jpich has quit IRC | 17:50 | |
| anteaya | for paste that is | 17:51 |
| odyssey4me | AJaeger I can try, but I find the output really hard to parse. | 17:51 |
| *** piet has joined #openstack-infra | 17:52 | |
| *** moravec has quit IRC | 17:52 | |
| prometheanfire | pabelanger: ya, that's about how I was thinking of doing it | 17:52 |
| *** tphummel has joined #openstack-infra | 17:52 | |
| *** tongli has quit IRC | 17:52 | |
| *** spzala has quit IRC | 17:52 | |
| prometheanfire | pabelanger: otherwise I would have converted the hex, then do the full math | 17:52 |
| *** akshai has quit IRC | 17:54 | |
| *** moravec has joined #openstack-infra | 17:56 | |
| *** piet has quit IRC | 17:56 | |
| anteaya | well I had paste 569285 and then created a foo one to see what number it would be, 306 then went backwards | 17:56 |
| anteaya | of the 20 pastes at least 10 looked like the exact same rally stacktrace to me | 17:57 |
| fungi | AJaeger: zigo: i've pushed the fixed deb-websockify repo into gerrit now and approved 365047 | 17:57 |
| anteaya | not sure why those 20 pastes would create such a load spike on paste, none of them looked large to me | 17:57 |
| *** IlyaG has joined #openstack-infra | 17:58 | |
| fungi | anteaya: i've noticed there's something rally-related that's been using paste.o.o as a (temporary?) publication method for months, maybe years | 17:58 |
| *** e0ne has quit IRC | 17:58 | |
| fungi | boris-42: ^ i keep meaning to ask, do you have any idea what causes that? | 17:58 |
| *** mrjk has joined #openstack-infra | 17:58 | |
| anteaya | huh | 17:58 |
| AJaeger | thanks, fungi. | 18:00 |
| *** rbrndt has quit IRC | 18:01 | |
| anteaya | tcp and traffic are back down to pre-spike levels and load average is decreasing | 18:01 |
| fungi | anteaya: yeah, after we got the spam problem on paste.o.o under control, those rally logs have been the primary volume of what gets stuffed into paste.o.o | 18:02 |
| *** kzaitsev_mb has quit IRC | 18:02 | |
| AJaeger | that's strange ;( | 18:02 |
| prometheanfire | pabelanger: the routes need work | 18:02 |
| *** akshai has joined #openstack-infra | 18:02 | |
| *** bethwhite_ has quit IRC | 18:03 | |
| pabelanger | prometheanfire: looking | 18:03 |
| openstackgerrit | Merged openstack-infra/project-config: Revert "Remove deb-websockify from projects.yaml" https://review.openstack.org/365047 | 18:03 |
| *** tphummel has quit IRC | 18:04 | |
| *** ifarkas is now known as ifarkas_afk | 18:04 | |
| anteaya | fungi: hmmmm | 18:04 |
| anteaya | is it part of rally's code to stick stacktraces on paste? | 18:05 |
| *** isviridov_away has quit IRC | 18:05 | |
| *** vaidy has quit IRC | 18:06 | |
| anteaya | as part of its logging mechinism? | 18:06 |
| *** gyee_ has quit IRC | 18:06 | |
| openstackgerrit | Merged openstack-infra/zuul: Handle non-valid HEAD https://review.openstack.org/362049 | 18:07 |
| AJaeger | anteaya, fungi: Just checked codesearch and couldn't find anything obvious | 18:07 |
| *** abregman has joined #openstack-infra | 18:07 | |
| prometheanfire | pabelanger: just commented | 18:08 |
| *** isviridov_away has joined #openstack-infra | 18:08 | |
| prometheanfire | pabelanger: our code is actually very similiar, but yours pass tests :P | 18:08 |
| fungi | anteaya: AJaeger: i'm guessing it's some dev machine that's poking stuff up to paste.o.o, but i'd need to collect a bunch of samples and map them back to apache logs to figure out if there's more than one source | 18:08 |
| *** vaidy has joined #openstack-infra | 18:09 | |
| anteaya | fungi: well you got about 10 samples between 285 and 306 | 18:09 |
| anteaya | and yeah the only mention of paste I got in rally was in the release notes | 18:09 |
| *** spzala has joined #openstack-infra | 18:09 | |
| fungi | yep, i just need to collect some from a broader timespan | 18:09 |
| anteaya | ah cool | 18:09 |
| *** kzaitsev_mb has joined #openstack-infra | 18:09 | |
| *** ociuhandu has joined #openstack-infra | 18:10 | |
| fungi | since a batch of them uploaded in quick succession may come from a single system, but overall there may be many such systems uploading things in short bursts like that example | 18:10 |
| anteaya | ah yes, that makes sense | 18:10 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for cells v1 delete host changed bug 1621574 https://review.openstack.org/367559 | 18:11 |
| openstack | bug 1621574 in OpenStack Compute (nova) "Instance fails to delete while building in cells v1 due to "ObjectActionError: Object action destroy failed because: host changed"" [Undecided,Confirmed] https://launchpad.net/bugs/1621574 | 18:11 |
| fungi | which is why i figured rally contributors might know what the cause of it was and save me some investigating before we could properly frame a discussion on the intent | 18:11 |
| anteaya | yes, seems reasonable to me | 18:12 |
| *** Na3iL has quit IRC | 18:12 | |
| *** kaisers has joined #openstack-infra | 18:12 | |
| *** mamitchl has joined #openstack-infra | 18:13 | |
| fungi | like, if it's intentional not accidental, and if it's just some random dev's machine, then maybe we don't care. on the other hand if it's a product running at various customer sites and reporting into paste.o.o so that some vendor can avoid having to run a server to collect these logs, it's not really okay | 18:14 |
| *** akshai has quit IRC | 18:14 | |
| *** spzala has quit IRC | 18:14 | |
| *** kzaitsev_mb has quit IRC | 18:14 | |
| *** ihrachys has quit IRC | 18:15 | |
| prometheanfire | pabelanger: the code snippet is almost directly usable I think | 18:15 |
| fungi | anteaya: and if it's not intentional at all and is just a forgotten process running in an indefinite loop somewhere, then maybe we can help people find it and finally shut it down | 18:15 |
| prometheanfire | pabelanger: should probably have another test case for a static route via v6 though | 18:15 |
| anteaya | agreed, it is worth having the conversation to find out what is going on here | 18:15 |
| fungi | debug logs and backtraces with no surrounding context are fairly hard to map to intent | 18:16 |
| pabelanger | prometheanfire: ya, that's my hesitation on adding it today. We are lacking a test case for it. If we can find a cloud that does that, can do it | 18:17 |
| *** kaisers has quit IRC | 18:17 | |
| prometheanfire | pabelanger: unit tests are not good enough? | 18:17 |
| anteaya | fungi: indeed, the first one I saw was a failed to validate token, then a bunch of 404s | 18:18 |
| pabelanger | prometheanfire: we don't have one today, do we? | 18:18 |
| openstackgerrit | Sergey Reshetnyak proposed openstack-infra/project-config: Add new projects: fuel-ccp-murano and fuel-ccp-sahara https://review.openstack.org/367561 | 18:18 |
| prometheanfire | pabelanger: a unit test? no | 18:19 |
| mordred | fungi: fwiw, codesearch.o.o does not show me anything that looks like it would post automatically to paste.o.o | 18:19 |
| mordred | oh - AJaeger already did that :) | 18:19 |
| fungi | mordred: agreed, that was the first thing that several of us independently thought to check | 18:19 |
| *** chem is now known as chem|off | 18:19 | |
| mordred | fungi: well, that's good | 18:20 |
| fungi | i checked it some months ago in fact, when i was revisiting this | 18:20 |
| AJaeger | mordred: you might have different a different string than I did ;) | 18:20 |
| fungi | it's been going on for a very long time | 18:20 |
| *** amitgandhinz has quit IRC | 18:20 | |
| prometheanfire | pabelanger: glean isn't just used in gate | 18:20 |
| *** mrjk has quit IRC | 18:20 | |
| anteaya | the test that is producing the stacktrace is rally/.rally/tempest/for-deployment | 18:20 |
| *** degorenko is now known as _degorenko|afk | 18:20 | |
| *** amitgandhinz has joined #openstack-infra | 18:20 | |
| anteaya | example: http://paste.openstack.org/show/569297/ | 18:21 |
| openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for cells v1 delete host changed bug 1621574 https://review.openstack.org/367559 | 18:21 |
| openstack | bug 1621574 in OpenStack Compute (nova) "Instance fails to delete while building in cells v1 due to "ObjectActionError: Object action destroy failed because: host changed"" [Medium,Confirmed] https://launchpad.net/bugs/1621574 - Assigned to Andrew Laski (alaski) | 18:21 |
| pabelanger | prometheanfire: right, so we need a example config-drive layout showing dedicated routes. I'm not sure where to find that today | 18:21 |
| prometheanfire | oh, that I can generate | 18:21 |
| pabelanger | basically, ipv6 in general is lacking from glean tests | 18:22 |
| pabelanger | so, we need to improve that | 18:22 |
| prometheanfire | ya | 18:22 |
| *** krtaylor has joined #openstack-infra | 18:24 | |
| pabelanger | that said, I think the priority is to review https://review.openstack.org/#/c/366862, land and cut a new release, since rax-iad to down as of today. | 18:24 |
| *** tongli has joined #openstack-infra | 18:25 | |
| pabelanger | then add ipv6 to centos / fedora / glean | 18:25 |
| pabelanger | gerr | 18:25 |
| *** fguillot_ has joined #openstack-infra | 18:25 | |
| pabelanger | gentoo | 18:25 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: Implement non-ovb overcloud update job - Newton -> Newton https://review.openstack.org/351330 | 18:26 |
| prometheanfire | lol | 18:26 |
| *** fguillot_ has quit IRC | 18:26 | |
| *** tphummel has joined #openstack-infra | 18:27 | |
| *** sdake_ is now known as sdake | 18:27 | |
| *** tongli has quit IRC | 18:28 | |
| *** tongli has joined #openstack-infra | 18:28 | |
| anteaya | I'm looking in the rally tree and am not finding rally/tempest/for-deployment so far | 18:29 |
| *** esikachev has joined #openstack-infra | 18:30 | |
| *** tongli has quit IRC | 18:30 | |
| AJaeger | anteaya: file doc/specs/in-progress/verification_refactoring.rst | 18:30 |
| AJaeger | in rally | 18:30 |
| clarkb | AJaeger: I approved the telemetry change for xenial (sorry popped out for breakfast but back now until I have to leave again to the dentist) | 18:31 |
| *** tongli has joined #openstack-infra | 18:31 | |
| AJaeger | anteaya: run "git grep for-deployment" and check the output | 18:31 |
| anteaya | happy dentist | 18:31 |
| AJaeger | clarkb: happy dentisting - and thanks | 18:31 |
| prometheanfire | pabelanger: this should be close, not sure if I have enough ffff in the netmask or not https://gist.github.com/092e99e65daed66d23a08833cb5eadb2 | 18:32 |
| *** tkelsey has quit IRC | 18:32 | |
| *** tongli has quit IRC | 18:32 | |
| *** drifterza has quit IRC | 18:32 | |
| *** mrjk has joined #openstack-infra | 18:32 | |
| *** tongli has joined #openstack-infra | 18:32 | |
| *** spzala has joined #openstack-infra | 18:33 | |
| clarkb | AJaeger: anteaya you all must have much different dentist experiences than I do :P | 18:33 |
| *** tongli has quit IRC | 18:33 | |
| anteaya | I have a wonderful dentist | 18:33 |
| prometheanfire | actually, let me just stash my code and I can test directly | 18:33 |
| anteaya | they turn off the tv for me, give my sunglasses for the lights | 18:33 |
| *** tongli has joined #openstack-infra | 18:34 | |
| anteaya | my dentist is terrific | 18:34 |
| AJaeger | clarkb: no - we all hope it will be soon over for you ;) | 18:34 |
| *** thorst has joined #openstack-infra | 18:34 | |
| *** akshai has joined #openstack-infra | 18:35 | |
| *** fguillot_ has joined #openstack-infra | 18:36 | |
| * AJaeger waves good bye | 18:37 | |
| anteaya | g'night AJaeger | 18:38 |
| *** fguillot_ has quit IRC | 18:39 | |
| *** Swami has joined #openstack-infra | 18:39 | |
| *** Jeffrey4l__ has quit IRC | 18:42 | |
| *** thorst has quit IRC | 18:42 | |
| openstackgerrit | Merged openstack-infra/project-config: Switch Telemetry jobs to Xenial https://review.openstack.org/366574 | 18:43 |
| *** Ravikiran_K has quit IRC | 18:44 | |
| *** sarob has joined #openstack-infra | 18:44 | |
| *** esikachev has quit IRC | 18:44 | |
| *** cardeois_ has quit IRC | 18:44 | |
| *** dmsimard is now known as dmsimard|afk | 18:45 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Add skeleton for DIB build cleanup https://review.openstack.org/367423 | 18:47 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Make builder recognize scheduled builds https://review.openstack.org/366934 | 18:47 |
| *** sarob has quit IRC | 18:49 | |
| *** cardeois has joined #openstack-infra | 18:50 | |
| *** _nadya_ has joined #openstack-infra | 18:50 | |
| *** Sukhdev has joined #openstack-infra | 18:51 | |
| *** david-lyle has quit IRC | 18:53 | |
| *** dkehn__ has quit IRC | 18:53 | |
| *** dkehn has quit IRC | 18:53 | |
| *** dkehn_ has quit IRC | 18:53 | |
| *** hasharAway is now known as hashar | 18:53 | |
| *** david-lyle has joined #openstack-infra | 18:53 | |
| *** Jeffrey4l__ has joined #openstack-infra | 18:54 | |
| *** Hal1 has quit IRC | 18:54 | |
| *** cardeois has quit IRC | 18:56 | |
| *** _nadya_ has quit IRC | 18:56 | |
| *** tphummel has quit IRC | 18:56 | |
| *** cardeois has joined #openstack-infra | 18:59 | |
| *** dkehn has joined #openstack-infra | 19:00 | |
| *** vhosakot_ has joined #openstack-infra | 19:00 | |
| *** rbrndt has joined #openstack-infra | 19:01 | |
| *** cardeois_ has joined #openstack-infra | 19:02 | |
| *** vhosakot has quit IRC | 19:03 | |
| *** IlyaG has quit IRC | 19:03 | |
| *** cardeois has quit IRC | 19:05 | |
| *** dkehn__ has joined #openstack-infra | 19:06 | |
| *** dkehn_ has joined #openstack-infra | 19:06 | |
| *** salv-orlando has quit IRC | 19:06 | |
| *** dizquierdo has joined #openstack-infra | 19:07 | |
| *** dtardivel has quit IRC | 19:07 | |
| *** vhosakot_ has quit IRC | 19:08 | |
| *** vhosakot has joined #openstack-infra | 19:12 | |
| *** dprince has quit IRC | 19:16 | |
| *** rlandy is now known as rlandy|brb | 19:16 | |
| openstackgerrit | Merged openstack-infra/puppet-infracloud: Enable create bridge service by default https://review.openstack.org/367461 | 19:17 |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: WIP -- clean full upgrade review https://review.openstack.org/364859 | 19:17 |
| prometheanfire | pabelanger: are you fine with me pushing an ammended commit up to the gentoov6 review? | 19:17 |
| prometheanfire | I could just give you the diff | 19:17 |
| openstackgerrit | Merged openstack-infra/puppet-mediawiki: Support disallowing robots https://review.openstack.org/366964 | 19:17 |
| prometheanfire | it adds ipv6 static route support everywhere v6 is supported it looks like | 19:18 |
| *** sarob has joined #openstack-infra | 19:19 | |
| openstackgerrit | Merged openstack-infra/system-config: Disallow robots for wiki-dev site https://review.openstack.org/366965 | 19:19 |
| *** cardeois_ has quit IRC | 19:19 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/glean: Add ipv6 support to gentoo https://review.openstack.org/367487 | 19:20 |
| *** e0ne has joined #openstack-infra | 19:21 | |
| clarkb | mtreinish: is ES happy for you again? | 19:21 |
| prometheanfire | pabelanger: nope :P | 19:21 |
| clarkb | also looks like we hit the 2k/hour jobs launched mark today | 19:21 |
| *** florianf has quit IRC | 19:22 | |
| *** coolsvap has quit IRC | 19:22 | |
| pleia2 | nice | 19:22 |
| *** hrybacki is now known as hrybacki|brb | 19:22 | |
| * fungi needs to pop out and run some errands... bbiaw | 19:22 | |
| anteaya | enjoy errands | 19:22 |
| prometheanfire | pabelanger: mind if I just push this up, it's almost the same, but my routes work | 19:22 |
| mtreinish | clarkb: yeah its working fine again last I looked | 19:23 |
| *** cardeois has joined #openstack-infra | 19:24 | |
| *** ilyashakhat_mobi has joined #openstack-infra | 19:24 | |
| *** samuelBartel has joined #openstack-infra | 19:24 | |
| openstackgerrit | Sumit Naiksatam proposed openstack-infra/project-config: Add non-voting job for GBP https://review.openstack.org/367591 | 19:26 |
| clarkb | and I am off to visit the dentist | 19:26 |
| openstackgerrit | Matthew Thode proposed openstack-infra/glean: Add ipv6 support to gentoo https://review.openstack.org/367487 | 19:27 |
| openstackgerrit | Sumit Naiksatam proposed openstack-infra/project-config: Add non-voting job for GBP https://review.openstack.org/367591 | 19:28 |
| anteaya | clarkb: ah okay, thought you might have been back by now | 19:30 |
| anteaya | was thinking that was a quick trip | 19:30 |
| *** adrian_otto has joined #openstack-infra | 19:34 | |
| *** cardeois has quit IRC | 19:35 | |
| *** AnarchyAo has joined #openstack-infra | 19:35 | |
| *** cardeois has joined #openstack-infra | 19:35 | |
| *** furlongm_ has joined #openstack-infra | 19:38 | |
| pabelanger | prometheanfire: Ah, reverted some optimizations :) | 19:38 |
| *** furlongm has quit IRC | 19:38 | |
| pabelanger | prometheanfire: I can fix it | 19:38 |
| openstackgerrit | Chris Krelle proposed openstack-infra/glean: Adjust the way we wait for interfaces to become available https://review.openstack.org/359471 | 19:38 |
| *** kzaitsev_mb has joined #openstack-infra | 19:39 | |
| *** thorst has joined #openstack-infra | 19:39 | |
| *** abregman has quit IRC | 19:39 | |
| NobodyCam | mordred: fungi: fyi ^^^^^^^ | 19:39 |
| *** hrybacki|brb is now known as hrybacki | 19:40 | |
| *** sshnaidm is now known as sshnaidm|afk | 19:41 | |
| *** Apoorva has quit IRC | 19:41 | |
| *** tongli_ has joined #openstack-infra | 19:43 | |
| *** _nadya_ has joined #openstack-infra | 19:43 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/glean: Add ipv6 support to gentoo https://review.openstack.org/367487 | 19:43 |
| *** burgerk has quit IRC | 19:43 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Implement undercloud upgrade job - Mitaka -> Newton https://review.openstack.org/346995 | 19:43 |
| *** _nadya_ has quit IRC | 19:45 | |
| *** tongli has quit IRC | 19:46 | |
| *** thorst has quit IRC | 19:47 | |
| mordred | NobodyCam: thanks! | 19:47 |
| NobodyCam | :) | 19:49 |
| *** yamahata has joined #openstack-infra | 19:50 | |
| *** sdake_ has joined #openstack-infra | 19:50 | |
| *** Jeffrey4l__ has quit IRC | 19:50 | |
| *** dizquierdo has quit IRC | 19:50 | |
| *** rlandy|brb is now known as rlandy | 19:52 | |
| *** sdake has quit IRC | 19:52 | |
| *** cdent has quit IRC | 19:54 | |
| *** dmsimard|afk is now known as dmsimard | 19:54 | |
| *** samuelBartel has quit IRC | 19:55 | |
| *** kaisers has joined #openstack-infra | 19:56 | |
| openstackgerrit | Merged openstack-infra/project-config: Skip OSA scenario jobs for liberty/mitaka https://review.openstack.org/367408 | 19:56 |
| *** tphummel has joined #openstack-infra | 19:56 | |
| *** kaisers has quit IRC | 20:00 | |
| openstackgerrit | Chris Krelle proposed openstack-infra/glean: Adjust the way we wait for interfaces to become available https://review.openstack.org/359471 | 20:01 |
| openstackgerrit | Paul Belanger proposed openstack-infra/glean: Add ipv6 support to gentoo https://review.openstack.org/367487 | 20:03 |
| *** amitgandhinz has quit IRC | 20:03 | |
| *** amitgandhinz has joined #openstack-infra | 20:03 | |
| pabelanger | mordred: prometheanfire: ^ should be good now for ipv6 on gentoo | 20:03 |
| pabelanger | clarkb: ianw: mind reviewing: https://review.openstack.org/#/c/366937 https://review.openstack.org/#/c/366862 fixes for glean to bring rax-iad back online | 20:06 |
| *** ilyashakhat_mobi has quit IRC | 20:12 | |
| openstackgerrit | Sumit Naiksatam proposed openstack-infra/project-config: Add non-voting job for GBP https://review.openstack.org/367591 | 20:17 |
| *** e0ne has quit IRC | 20:17 | |
| *** e0ne has joined #openstack-infra | 20:18 | |
| *** salv-orlando has joined #openstack-infra | 20:18 | |
| *** asettle has quit IRC | 20:19 | |
| *** yamahata has quit IRC | 20:20 | |
| *** asettle has joined #openstack-infra | 20:21 | |
| *** salv-orlando has quit IRC | 20:22 | |
| mordred | pabelanger: looks great! | 20:24 |
| mordred | pabelanger: you feel like looking at https://review.openstack.org/359471 ? | 20:24 |
| *** asettle has quit IRC | 20:25 | |
| pabelanger | mordred: sure, give me a few mins | 20:30 |
| *** esikachev has joined #openstack-infra | 20:30 | |
| prometheanfire | pabelanger: cool, will look | 20:30 |
| *** Benj_ has quit IRC | 20:30 | |
| *** Goneri has quit IRC | 20:31 | |
| openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: upstream: and options: track-upstream for deb-* https://review.openstack.org/367343 | 20:33 |
| *** salv-orlando has joined #openstack-infra | 20:33 | |
| *** thorst has joined #openstack-infra | 20:34 | |
| *** Guest46095 has quit IRC | 20:34 | |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Grafana Neutron: use string substitution to track jobs running on different nodes https://review.openstack.org/367620 | 20:37 |
| *** hamzy has quit IRC | 20:38 | |
| *** madhuvishy has quit IRC | 20:40 | |
| *** madhuvishy has joined #openstack-infra | 20:40 | |
| *** kgiusti has quit IRC | 20:40 | |
| *** Apoorva has joined #openstack-infra | 20:41 | |
| pabelanger | mrhillsman: raddaoui: wanted to see if you found anything with cloud8? | 20:42 |
| *** thorst has quit IRC | 20:42 | |
| *** ilyashakhat_mobi has joined #openstack-infra | 20:43 | |
| raddaoui | yeah should be good now. there was some problems with haproxy/keepalived | 20:44 |
| *** burgerk has joined #openstack-infra | 20:44 | |
| *** flepied has quit IRC | 20:45 | |
| openstackgerrit | Thomas Goirand proposed openstack-infra/project-config: Add missing deb repo 3/5 https://review.openstack.org/366352 | 20:45 |
| *** aeng has joined #openstack-infra | 20:45 | |
| *** Apoorva has quit IRC | 20:46 | |
| *** ilyashakhat_mobi has quit IRC | 20:48 | |
| *** shardy has quit IRC | 20:49 | |
| *** gordc has joined #openstack-infra | 20:51 | |
| *** tphummel has quit IRC | 20:51 | |
| *** sdague has quit IRC | 20:52 | |
| *** tongli_ has quit IRC | 20:52 | |
| *** tongli has joined #openstack-infra | 20:53 | |
| zigo | fungi: Thank you. | 20:53 |
| zigo | (for deb-websockify) | 20:53 |
| pabelanger | raddaoui: we seem to have a few nodes stuck in delete state. Can you check them out? | 20:54 |
| *** jkilpatr has quit IRC | 20:55 | |
| *** tongli_ has joined #openstack-infra | 20:56 | |
| *** askb has joined #openstack-infra | 20:56 | |
| *** fguillot_ has joined #openstack-infra | 20:56 | |
| *** tphummel has joined #openstack-infra | 20:57 | |
| *** tongli has quit IRC | 20:57 | |
| raddaoui | yes sure | 20:58 |
| *** flepied has joined #openstack-infra | 20:58 | |
| pabelanger | raddaoui: http://paste.openstack.org/show/569335/ includes the uuids | 20:58 |
| *** harlowja_ has joined #openstack-infra | 20:59 | |
| *** fguillot_ has quit IRC | 20:59 | |
| *** harlowja has quit IRC | 21:00 | |
| *** raildo has quit IRC | 21:01 | |
| openstackgerrit | mathieu bultel proposed openstack-infra/tripleo-ci: WIP -- clean full upgrade review https://review.openstack.org/364859 | 21:01 |
| zigo | mordred: Could you please approve that one https://review.openstack.org/366352 | 21:01 |
| zigo | mordred: I need tempest-lib, otherwise I can't build Newton b2 clients. | 21:01 |
| *** Mary has joined #openstack-infra | 21:02 | |
| *** Mary is now known as Guest23014 | 21:02 | |
| *** e0ne has quit IRC | 21:02 | |
| *** fguillot_ has joined #openstack-infra | 21:03 | |
| mtreinish | zigo: what still uses tempest-lib in newton? | 21:03 |
| zigo | mtreinish: In b2, some clients still required it. | 21:04 |
| zigo | mtreinish: I'm currently still trying to bootstrap b2 package build on infra, before I upgrade to b3. | 21:04 |
| zigo | mtreinish: For the moment, I have built all of Oslo. Once I have the clients, I'll soon build services. | 21:05 |
| zigo | mtreinish: So, if everything goes well, by next week, I'll start packaging b3 on infra. | 21:05 |
| *** psilvad has quit IRC | 21:05 | |
| zigo | I'm up to nearly 200 packages built so far... | 21:06 |
| zigo | :P | 21:06 |
| *** jcoufal has quit IRC | 21:06 | |
| *** Guest23014 has quit IRC | 21:06 | |
| prometheanfire | pabelanger: sorry, one more thing... | 21:07 |
| pabelanger | prometheanfire: np looking | 21:08 |
| *** mmedvede has quit IRC | 21:09 | |
| pabelanger | prometheanfire: Hmm, is our network valid? | 21:09 |
| *** devananda is now known as devananda|bbl | 21:09 | |
| pabelanger | in vendor_data.json? | 21:09 |
| openstackgerrit | Nikhil Komawar proposed openstack-infra/project-config: Create a release notes job for glanceclient https://review.openstack.org/367473 | 21:10 |
| pabelanger | eg: should it be "network": "fd30:0000:0000::", ? | 21:11 |
| prometheanfire | pabelanger: yes, I think it should | 21:13 |
| *** fguillot_ has quit IRC | 21:13 | |
| prometheanfire | fd30:0000:0000 is not a valid ipv6 address, I don't think | 21:13 |
| pabelanger | let me check osic-cloud1 | 21:15 |
| *** e0ne has joined #openstack-infra | 21:15 | |
| prometheanfire | pabelanger: k, sec | 21:15 |
| prometheanfire | Krenair: it could also just be fd30:: | 21:15 |
| prometheanfire | or even fd3:: I think | 21:15 |
| prometheanfire | Krenair: sorry, mistab | 21:15 |
| *** ldnunes has quit IRC | 21:16 | |
| *** fguillot_ has joined #openstack-infra | 21:16 | |
| *** nherciu has quit IRC | 21:17 | |
| ianw | pabelanger: can you ELI5 on that next() call in 366937? it's looking for the second result? (i.e. it returns an array of all, and then calls next on it, giving the second result?) | 21:17 |
| pabelanger | prometheanfire: updating | 21:17 |
| prometheanfire | pabelanger: sec | 21:17 |
| prometheanfire | pabelanger: looking up something | 21:17 |
| prometheanfire | if we can specify fd3:: or fd30:: | 21:17 |
| prometheanfire | I think those are equiv | 21:17 |
| prometheanfire | 0fd3:: and fd3:: are the same | 21:18 |
| *** rossella_s has quit IRC | 21:18 | |
| prometheanfire | so it does need to be fd30:: | 21:18 |
| prometheanfire | pabelanger: ^ | 21:18 |
| pabelanger | ianw: Ya, I'm not completely sure what is going on there. I was trying to address a line wrap issue, but think I messed up a little | 21:18 |
| prometheanfire | though fd30:0000:0000:: is the same | 21:18 |
| *** sarob has quit IRC | 21:19 | |
| pabelanger | Ya, the issue is the missing :: at the end | 21:19 |
| prometheanfire | right | 21:19 |
| *** rossella_s has joined #openstack-infra | 21:19 | |
| ianw | pabelanger: yeah, i'm not quite sure the new code gives the same semantics ... whatever they are :) | 21:19 |
| prometheanfire | both are correct, the shorter one is prefered methinks | 21:19 |
| prometheanfire | ianw: test cases are getting better, slowly | 21:19 |
| pabelanger | ianw: agreed, need to dig more into it | 21:20 |
| ianw | prometheanfire: sorry, what test cases? | 21:21 |
| prometheanfire | ianw: see what I mean | 21:21 |
| prometheanfire | ianw: mostly unit | 21:21 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/nodepool: Add skeleton for DIB build cleanup https://review.openstack.org/367423 | 21:21 |
| ianw | sorry, i'm genuinely confused as to what we're talking about | 21:22 |
| ianw | dib? | 21:22 |
| prometheanfire | glean | 21:23 |
| openstackgerrit | Paul Belanger proposed openstack-infra/glean: Add ipv6 support to gentoo https://review.openstack.org/367487 | 21:23 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: scenario002: deploy Swift https://review.openstack.org/367401 | 21:25 |
| *** e0ne has quit IRC | 21:25 | |
| *** e0ne has joined #openstack-infra | 21:26 | |
| *** e0ne has quit IRC | 21:26 | |
| *** tongli_ has quit IRC | 21:26 | |
| *** jkilpatr has joined #openstack-infra | 21:27 | |
| zigo | pabelanger: Could you review this one ? https://review.openstack.org/366352 (ie: Add missing deb repo 3/5) | 21:27 |
| zigo | It's currently a blocker. | 21:27 |
| *** tonytan4ever has quit IRC | 21:27 | |
| *** eggshell has quit IRC | 21:29 | |
| *** dizquierdo has joined #openstack-infra | 21:33 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: tripleo/upgrades: move jobs to check https://review.openstack.org/367641 | 21:35 |
| *** fguillot_ is now known as fguillot_afk | 21:36 | |
| *** esikachev has quit IRC | 21:37 | |
| *** fguillot_afk has quit IRC | 21:37 | |
| *** esikachev has joined #openstack-infra | 21:39 | |
| *** thorst has joined #openstack-infra | 21:39 | |
| *** adrian_otto has quit IRC | 21:40 | |
| *** tphummel has quit IRC | 21:43 | |
| *** kaisers has joined #openstack-infra | 21:45 | |
| *** thorst has quit IRC | 21:47 | |
| *** kaisers has quit IRC | 21:49 | |
| *** fguillot_ has joined #openstack-infra | 21:50 | |
| *** dizquierdo has quit IRC | 21:51 | |
| *** vhosakot has quit IRC | 21:53 | |
| *** mmedvede has joined #openstack-infra | 21:53 | |
| *** IlyaG has joined #openstack-infra | 21:54 | |
| *** matt-borland has quit IRC | 21:54 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Implement non-ovb overcloud update job - Newton -> Newton https://review.openstack.org/351330 | 21:55 |
| raddaoui | pabelanger: should be good to go | 21:55 |
| *** annegentle has quit IRC | 21:58 | |
| *** annegentle has joined #openstack-infra | 21:59 | |
| *** esikachev has quit IRC | 22:00 | |
| *** xarses has quit IRC | 22:04 | |
| *** rtheis has quit IRC | 22:04 | |
| *** fguillot_ has quit IRC | 22:06 | |
| *** jamesdenton has quit IRC | 22:06 | |
| *** esberglu has quit IRC | 22:07 | |
| zigo | mordred: I really hope you can review https://review.openstack.org/366351 tonight when I sleep (I'm going now), so I can work on building python-*client tomorrow... Night night! | 22:08 |
| *** dimtruck is now known as zz_dimtruck | 22:11 | |
| *** dtantsur|afk has quit IRC | 22:12 | |
| *** mdrabe has quit IRC | 22:12 | |
| *** tristanC has quit IRC | 22:12 | |
| *** baoli has quit IRC | 22:13 | |
| *** tristanC has joined #openstack-infra | 22:13 | |
| *** baoli has joined #openstack-infra | 22:13 | |
| fungi | wow, rackspace just spammed me offering to manage my aws environment | 22:14 |
| fungi | le sigh | 22:14 |
| *** dtantsur has joined #openstack-infra | 22:14 | |
| tonyb | fungi: Sure I'll look at the stable osc thing. Where would you like feedback? is there a ml threda I missed? | 22:16 |
| fungi | tonyb: no, dtroyer added stable branching to openstackclient at dhellmann's request, and usually infra sets the stable-maint-core team as the owner of project-specific stable-maint for official teams in gerrit | 22:17 |
| fungi | however, dtroyer (presumably) has some patches for it he wants to be able to approve | 22:18 |
| fungi | so just making sure this is coming to your attention | 22:18 |
| *** harlowja has joined #openstack-infra | 22:18 | |
| tonyb | fungi: fungi the new group structure looks good. osc deosn't have the stable:follows-policy and given dtroyer is the current PTL I think it's correct to include him | 22:21 |
| tonyb | fungi: Seem like a reasonable way to bootstrap a new stable-maint group to me | 22:22 |
| *** harlowja_ has quit IRC | 22:22 | |
| fungi | dtroyer: i've added you as a member of https://review.openstack.org/#/admin/groups/1561,members now | 22:22 |
| fungi | thanks tonyb! | 22:22 |
| tonyb | fungi: Also I'd be fine with stevemar aswell | 22:23 |
| * stevemar waves at fungi and tonyb | 22:23 | |
| ianw | fungi: rax sent me an email the other day with the subject "[EVENT] Uncompromised Security and Scalability". my heart skipped a beat as i thought i'd left a vm running that had been hacked and this was a system email (mostly the credit card implications). turns out it's some type of lunch "event" | 22:23 |
| fungi | stevemar: i've added you too now | 22:24 |
| tonyb | \o/ | 22:24 |
| stevemar | fungi: tonyb i was just gonna say to let dtroyer decide, but now he can decide to remove me or not :P | 22:24 |
| tonyb | stevemar: :) | 22:24 |
| fungi | tonyb: should i make that group self-owned rather than owned by stable-maint-core in that case? | 22:24 |
| fungi | ianw: there's no such thing as a free lunch. they're probably going to try to convince you to invest in a timeshare | 22:25 |
| stevemar | fungi: i'd treat it like all the others (my opinion, i know you didn't ask :P) | 22:25 |
| tonyb | fungi: if dtroyer is fine with it as is *and* inteneds to apply for stable:follows-policy then I think the current structure is fine | 22:25 |
| fungi | i'm a little fuzzy on how stable branches are handled for official team deliverables depending on whether they have stable:follows-policy or not. we should probably get something concrete written down | 22:26 |
| fungi | for now i'm fine doing whatever the ptls agree on | 22:26 |
| pabelanger | mgagne: we just had a large wave of failures in internap-mtl01, mind looking when you have time? http://grafana.openstack.org/dashboard/db/nodepool-internap | 22:27 |
| pabelanger | mgagne: I believe we just finished uploading a new DIB and the servers were trying to use the latest image | 22:27 |
| mgagne | pabelanger: are you talking about job failures or node failures? | 22:27 |
| tonyb | fungi: Yeah that's a good point. | 22:27 |
| pabelanger | mgagne: launch node failures | 22:27 |
| mgagne | pabelanger: sure. I think we find an issue earlier today where if a new image is uploaded, Glance can't keep up with download requests. | 22:28 |
| fungi | tonyb: though that's something we'll also need to clarify with the release management team since they have scripts that switch stable rbanch permissions around before/after releases | 22:28 |
| fungi | s/rbanch/branch/ | 22:28 |
| pabelanger | mgagne: Ya, that's what I am thinking too. | 22:28 |
| *** tonytan4ever has joined #openstack-infra | 22:28 | |
| tonyb | fungi: Yeah. That's a new tool so I think it merits a discussion | 22:29 |
| mgagne | pabelanger: I'm not sure we will be able to come up with a resolution today. This is however something we will be looking into this week or maybe next week as it might imply hardware if we can't come up with a software solution. | 22:29 |
| fungi | pabelanger: mgagne: our use case definitely creates a thundering herd when nova hosts need to refresh their caches | 22:29 |
| fungi | we had to plan for that when figuring out the lateral network connectivity for infra-cloud too | 22:30 |
| pabelanger | mgagne: No, that's understandable. Just wanted to raise the issue with you | 22:30 |
| pabelanger | fungi: indeed | 22:30 |
| mgagne | pabelanger: sure, thanks! | 22:30 |
| pabelanger | fungi: we would have nodepool be a little more graceful when launching the new images too. Maybe some sort of rolling window, rather then all nodes a once | 22:31 |
| fungi | doesn't it already effectively stagger uploads? | 22:31 |
| *** claudiub|2 has quit IRC | 22:32 | |
| pabelanger | right, but once the image is uploaded we switch all nodes to it right away | 22:32 |
| pabelanger | maybe a sliding window to give nova a chance to cache the new images | 22:32 |
| *** tonytan4ever has quit IRC | 22:33 | |
| *** sdake has joined #openstack-infra | 22:34 | |
| *** hashar has quit IRC | 22:36 | |
| *** sdake_ has quit IRC | 22:36 | |
| *** mriedem has quit IRC | 22:36 | |
| mgagne | the issue is with all compute nodes each downloading the new image. clearly our settings or architecture doesn't handle well that thundering herd. | 22:37 |
| *** xarses has joined #openstack-infra | 22:37 | |
| *** tphummel has joined #openstack-infra | 22:38 | |
| *** tkelsey has joined #openstack-infra | 22:40 | |
| *** akshai has quit IRC | 22:42 | |
| *** thorst has joined #openstack-infra | 22:44 | |
| *** ilyashakhat_mobi has joined #openstack-infra | 22:44 | |
| *** tkelsey has quit IRC | 22:45 | |
| *** wfoster has quit IRC | 22:46 | |
| *** spzala has quit IRC | 22:48 | |
| *** spzala has joined #openstack-infra | 22:49 | |
| *** ilyashakhat_mobi has quit IRC | 22:49 | |
| *** sai has quit IRC | 22:49 | |
| *** adriant has joined #openstack-infra | 22:50 | |
| *** tphummel has quit IRC | 22:51 | |
| *** krtaylor has quit IRC | 22:51 | |
| *** rhallisey has quit IRC | 22:51 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Enable SSL for undercloud-only job https://review.openstack.org/359131 | 22:52 |
| *** thorst has quit IRC | 22:53 | |
| *** spzala has quit IRC | 22:53 | |
| *** sai has joined #openstack-infra | 22:54 | |
| *** wfoster has joined #openstack-infra | 22:56 | |
| *** xyang1 has quit IRC | 22:56 | |
| *** sdake has quit IRC | 22:59 | |
| *** pahuang has joined #openstack-infra | 23:00 | |
| *** Sukhdev has quit IRC | 23:00 | |
| *** rlandy has quit IRC | 23:01 | |
| *** gordc has quit IRC | 23:02 | |
| jhesketh | Morning | 23:04 |
| *** hferenc has quit IRC | 23:05 | |
| *** baoli has quit IRC | 23:06 | |
| *** cardeois has quit IRC | 23:08 | |
| *** annegentle has quit IRC | 23:08 | |
| *** pradk has quit IRC | 23:08 | |
| *** sai has quit IRC | 23:11 | |
| *** rook has quit IRC | 23:11 | |
| *** lucas-dinner has quit IRC | 23:12 | |
| *** wfoster has quit IRC | 23:12 | |
| armax | clarkb: any idea why we might be seeing this on the linuxbridge job? | 23:13 |
| armax | http://logs.openstack.org/11/367011/4/check/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/92b0d84/logs/screen-q-agt.txt.gz#_2016-09-08_22_06_58_984 | 23:13 |
| armax | the host does no longer have eth0 | 23:13 |
| armax | kevinbenton: ^ | 23:13 |
| *** tphummel has joined #openstack-infra | 23:16 | |
| *** adrian_otto has joined #openstack-infra | 23:16 | |
| *** rbrndt has quit IRC | 23:16 | |
| fungi | pabelanger: oh, i get you. like keep asking that provider to boot the old image and slowly ramp up requests for the new image as we ramp down requests for the old image? | 23:16 |
| anteaya | morning jhesketh | 23:17 |
| *** Apoorva has joined #openstack-infra | 23:18 | |
| fungi | armax: ouch... apparently not? http://logs.openstack.org/11/367011/4/check/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/92b0d84/console.html#_2016-09-08_21_55_26_592018 | 23:18 |
| armax | fungi: yeah | 23:19 |
| armax | that’s a bit baffling | 23:19 |
| kevinbenton | fungi, armax: http://logs.openstack.org/31/367331/1/gate/gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial/bdba22e/logs/localrc.txt.gz | 23:19 |
| armax | we might have been lucky so far I guess | 23:19 |
| kevinbenton | LB_PHYSICAL_INTERFACE | 23:19 |
| kevinbenton | is being set to eth0 by something | 23:19 |
| armax | http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/devstack-gate.yaml | 23:20 |
| armax | http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/devstack-gate.yaml#n1127 | 23:20 |
| armax | but that’s multinode | 23:20 |
| fungi | i'm used to my nics on debian being like enp0s20u4, enp3s0 and wlp2s0 now but didn't realize xenial was also new enough to be getting path-based interface names | 23:20 |
| bkero | the curse of biosname is now on all of us | 23:21 |
| armax | kevinbenton: that’s the culprit I gues | 23:21 |
| armax | s | 23:21 |
| armax | http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/neutron.yaml#n430 | 23:21 |
| kevinbenton | armax: aye | 23:21 |
| StevenK | I still keep looking for wlan0 and failing | 23:21 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: scenarios: set Debug to True https://review.openstack.org/366896 | 23:21 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci: scenario001: deploy Ceph https://review.openstack.org/366810 | 23:21 |
| fungi | bkero: granted, it was inevitable. brings back memories of sun bios device paths | 23:21 |
| *** watanabe_isao has joined #openstack-infra | 23:22 | |
| kevinbenton | is it possible to throw a RetryRequest from devstack? ;) | 23:22 |
| *** moravec1 has joined #openstack-infra | 23:22 | |
| *** asettle has joined #openstack-infra | 23:22 | |
| *** moravec has quit IRC | 23:22 | |
| *** camunoz has quit IRC | 23:23 | |
| *** kzaitsev_mb has quit IRC | 23:24 | |
| armax | fungi, clarkb I think this is caused by the switch to xenial that happend this morning | 23:24 |
| armax | kevinbenton: ^ | 23:24 |
| armax | https://review.openstack.org/#/c/367014/ | 23:25 |
| fungi | armax: well, for some definition of "caused" anyway | 23:25 |
| *** markvoelker has quit IRC | 23:25 | |
| armax | yes sure | 23:25 |
| armax | bottom line eth0 is gone in xenial by the looks of it | 23:25 |
| fungi | i would say it's caused by assumptions about device names, but ultimately we should be fixing it in ways that reflect how we expect people to actually run this software under ubuntu 16.04 lts | 23:25 |
| *** mriedem has joined #openstack-infra | 23:25 | |
| *** rook has joined #openstack-infra | 23:26 | |
| fungi | eth0 isn't *gone* per se, but it's being renamed at boot and there are a number of possible solutions | 23:26 |
| *** wfoster has joined #openstack-infra | 23:26 | |
| *** sai has joined #openstack-infra | 23:26 | |
| armax | indeed | 23:26 |
| *** rook is now known as Guest90983 | 23:26 | |
| *** lucasagomes has joined #openstack-infra | 23:26 | |
| fungi | i could enumarate them, but presumably there are already people deploying this on xenial so we should find out which solution is preferred | 23:26 |
| armax | I meant the interface name, not the interface | 23:26 |
| fungi | well, the interface name itself isn't gone either, just changed (and can be changed back, but that's probably not an ideal solution) | 23:27 |
| bkero | yeah, you can disable biosname with a cmdline option | 23:27 |
| armax | ok, whichever way, linuxbridge job is busted because we hardcode eth0 in teh job confiuguration | 23:27 |
| *** AnarchyAo has quit IRC | 23:28 | |
| bkero | Time to go make the eth0 sausage | 23:28 |
| fungi | bkero: yep, that's one way to skin it. if our recommendation to people deploying linuxbridge for neutron is to disable biosdevname in the kernel, then it's question of whether that's a change we incur across all jobs using this test platform | 23:28 |
| fungi | since i think it wuold have to be done pre-boot and our job framework doesn't (currently) support reboots at job runtime | 23:29 |
| armax | fungi: the dumbest fix I could come up with right now is to use eth0 instead of ens3 by inspecting {node} | 23:29 |
| bkero | fungi: That's definitely not the solution I would use, diverges too much from ubuntu. | 23:29 |
| fungi | bkero: strongly agree with you there | 23:29 |
| bkero | or rather too much from distros | 23:29 |
| bkero | https://www.freedesktop.org/wiki/Software/systemd/PredictableNetworkInterfaceNames/ | 23:29 |
| *** asettle has quit IRC | 23:30 | |
| fungi | jamespage: any tips on how the ubuntu packages for neutron are addressing this? | 23:30 |
| StevenK | I still wonder just how my laptop comes up with enp0s31f6 | 23:30 |
| fungi | StevenK: my what a wide bus you have there | 23:31 |
| StevenK | Haha | 23:31 |
| prometheanfire | StevenK: do you want to go into the crazy of udev? | 23:31 |
| *** jamesdenton has joined #openstack-infra | 23:31 | |
| StevenK | prometheanfire: I already know some of the crazy of udev :-/ | 23:31 |
| kevinbenton | well this is a configuration value to be set by the operator. presumably the operator knows which interface they want to put traffic onto | 23:31 |
| * fungi already took a refreshing dip into udev crazy just earlier today, so no thanks | 23:31 | |
| StevenK | Haha | 23:31 |
| prometheanfire | StevenK: I'm sorry for your bad life choices | 23:32 |
| *** tphummel has quit IRC | 23:32 | |
| StevenK | fungi: Where "refreshing" is "oh god it burns" ? | 23:32 |
| prometheanfire | StevenK: I'm technically part of the eudev project :P | 23:32 |
| mwhahaha | just switch to predictable network interfaces and s/eth0/enp0s3. at least i think that was the replacement :D | 23:32 |
| * prometheanfire owns the eudev.org domain | 23:32 | |
| fungi | StevenK: in this case, "refreshingly short" since it was just figuring out a udev rule patch to fix a dib element | 23:32 |
| bkero | fungi: any clue how to get ip link show to tell me real honest-to-god ethernet interfaces? | 23:33 |
| bkero | man ip-link just shows me types for things like vxlans or bridges or other tunnels | 23:33 |
| fungi | bkero: i do not, no. i generalyl find them via dmesg | 23:33 |
| armax | fungi: can we rever the change until we come up with a clean solution? | 23:33 |
| armax | both nova and neutron are blocked by this | 23:33 |
| fungi | bkero: e.g., [Sat Sep 3 21:10:26 2016] iwlwifi 0000:02:00.0 wlp2s0: renamed from wlan0 | 23:33 |
| prometheanfire | bkero: no, I looked into this when I did my neutron patch | 23:34 |
| *** kaisers has joined #openstack-infra | 23:34 | |
| prometheanfire | bkero: network interfaces can be anything the filesystem supports | 23:34 |
| prometheanfire | can be named as such | 23:34 |
| fungi | bkero: i don't think a backreference to the original name is exposed anywhere persistent | 23:34 |
| prometheanfire | let me find the kernel filter | 23:34 |
| bkero | fungi, prometheanfire: I just iterated through all advertised types. It can't. :| | 23:34 |
| armax | fungi: one way to deal with this is to first of all elimate the hardcoding trom project-config and make devstack smarter at decting the interface needed | 23:34 |
| * bkero unimpressed. | 23:34 | |
| fungi | armax: we can switch the job back to trusty again briefly if it's a problem, but i seriously doubt you want linuxbridge for newton to be tested on trusty indefinitely while the rest of openstack newton is tested on xenial at release | 23:35 |
| prometheanfire | bkero: backported, but it was a simple patch https://patchwork.kernel.org/patch/6412971/ | 23:35 |
| *** gildub has joined #openstack-infra | 23:35 | |
| bkero | ugh | 23:35 |
| armax | I am not advocating to switch back indefinitely | 23:35 |
| fungi | armax: just concerned that if this isn't worked out during rc then it may be harder to backport after release | 23:36 |
| prometheanfire | bkero: basically, you can't have '/' || ':' || ' ' | 23:36 |
| bkero | prometheanfire: yeah, I get it. | 23:36 |
| bkero | Magic restrictions because somewhere in the stack decided to use it for their internal separator. | 23:36 |
| *** camunoz has joined #openstack-infra | 23:36 | |
| armax | this is an infra issue though, there’s nothing we can do Neutron side | 23:36 |
| armax | I don’t think | 23:36 |
| *** annegentle has joined #openstack-infra | 23:36 | |
| prometheanfire | bkero: what are you trying to do, get a list of physical ethernet interfaces? | 23:37 |
| armax | the job configuration hardcodes eth0 when it should not have | 23:37 |
| bkero | prometheanfire: yeah | 23:37 |
| fungi | armax: oh, it's not being set in devstack or a devstack plugin? i'm looking now to see where it's being set | 23:37 |
| armax | no | 23:38 |
| armax | it’s in neutron.yaml | 23:38 |
| armax | and in d-g.yaml | 23:38 |
| *** kaisers has quit IRC | 23:38 | |
| armax | http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/devstack-gate.yaml | 23:38 |
| armax | http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/jobs/neutron.yaml | 23:38 |
| armax | we should get those moved over to devstack itself | 23:38 |
| fungi | aha. yeah i guess if you have the xenial version of the job in experimental then it's easy enough to see if you've got it foxed before switchint it back to xenial in check/gate | 23:39 |
| *** annegentle has quit IRC | 23:39 | |
| fungi | s/foxed/fixed/ | 23:39 |
| anteaya | its a great typo | 23:39 |
| fungi | anteaya: yeah, it's reached that time of night where my typing accuracy is taking a rapid nosedive | 23:39 |
| prometheanfire | bkero: the only way I know of is to query the kernel directly, even then, I don't know if it's possible to get just physical interfaces | 23:39 |
| prometheanfire | bkero: I'd actually email the netdev mailing list (kernel) and ask, they are fairly helpful | 23:40 |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Revert "Run neutron linuxbridge and dvr jobs on xenial" https://review.openstack.org/367692 | 23:40 |
| *** gongysh has joined #openstack-infra | 23:40 | |
| prometheanfire | bkero: they also hate that things parse the output of ip, because that's something that changes | 23:40 |
| bkero | prometheanfire: yup | 23:41 |
| fungi | armax: so i guess you want gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial running in experimental and gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial running in check/gate for all branches rather than just mitaka and earlier? | 23:41 |
| StevenK | ip a l | grep | cut | oh god | questioning life choices | 23:41 |
| *** fguillot has quit IRC | 23:41 | |
| prometheanfire | lolol | 23:41 |
| StevenK | Is what I came up with | 23:41 |
| prometheanfire | yep | 23:41 |
| fungi | armax: er, -trusty for that second one | 23:41 |
| anteaya | fungi: must be an indcator of something | 23:41 |
| bkero | prometheanfire: I could go parse /proc/net/dev | 23:41 |
| armax | fungi: right now I want the gate back to sanity for all the projects affected :) | 23:41 |
| prometheanfire | bkero: they actually said that's a better way | 23:42 |
| bkero | Oh? What might that be? | 23:42 |
| fungi | armax: i'm trying to translate your general wishes into an actionable patch ;) | 23:42 |
| fungi | armax: is it just gate-tempest-dsvm-neutron-linuxbridge-ubuntu-xenial affected? | 23:42 |
| prometheanfire | bkero: that's what prompted the patch | 23:42 |
| armax | fungi: yes | 23:42 |
| prometheanfire | bkero: parsing the dir itself | 23:42 |
| armax | if we switched back to trusty for maste changes that would solve our immediate problem | 23:42 |
| armax | but I do want to get on with the switch to xenial asap | 23:43 |
| bkero | prometheanfire: /proc/net? | 23:43 |
| armax | I just don’t have a good solution I can think of right now | 23:43 |
| prometheanfire | bkero: https://review.openstack.org/gitweb?p=openstack/neutron.git;a=commitdiff;h=3844dda067df064e871e4ff739c5d67e67e7864c | 23:43 |
| armax | if not continuing to hardcode interface names in the job configurations | 23:43 |
| prometheanfire | bkero: /sys/class/net | 23:43 |
| bkero | oh boy | 23:43 |
| prometheanfire | that was 'fun' to do | 23:44 |
| fungi | prometheanfire: bkero: yeah, some of the network-oriented dib elements are inspecting the contents of /sys/class/net to figure out interfaces | 23:44 |
| StevenK | My wireless card also has a wireless/ directory under /sys/class/net | 23:45 |
| StevenK | ... which is empty, so WTF | 23:45 |
| prometheanfire | fungi: yarp | 23:45 |
| prometheanfire | lol | 23:45 |
| *** krtaylor has joined #openstack-infra | 23:45 | |
| prometheanfire | I don't have the wireless dir | 23:45 |
| StevenK | We want nice things | 23:45 |
| prometheanfire | oh, a subdir of the interface | 23:46 |
| StevenK | Yes, sorry | 23:46 |
| *** zhurong has joined #openstack-infra | 23:46 | |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Fix linuxbridge job breakage on xenial https://review.openstack.org/367693 | 23:46 |
| armax | fungi: that’s my actionable patch ^ | 23:46 |
| armax | but I am not sure if that means the job won’t run on master nodes | 23:47 |
| *** fguillot has joined #openstack-infra | 23:47 | |
| clarkb | jobs that require a specifc interface name should create the interfacethemselves | 23:47 |
| clarkb | just like multinode does... | 23:47 |
| fungi | armax: right now, yes it means you won't run linuxbridge jobs at all on master, and will run trusty-based linuxbridge on mitaka and earlier | 23:47 |
| prometheanfire | armax: I don't like the moving to experimental | 23:47 |
| fungi | armax: i | 23:47 |
| armax | fungi: right, I figured | 23:47 |
| clarkb | like its not hard to do | 23:47 |
| * prometheanfire uses linuxbridge and not ovs | 23:48 | |
| clarkb | and assuming eth0 had been a terrible idea for years | 23:48 |
| *** devananda|bbl is now known as devananda | 23:48 | |
| fungi | armax: i'm trying to navigate the current regular expressions to figure out where (if at all) we have an easy way to switch just that one jobs to experimental for xenial and run the trusty version on master | 23:48 |
| clarkb | also devstack is supposed to sort what interfaces to use iirc not sure why we would hardcode anywhere | 23:48 |
| armax | clarkb: what do you suggest? | 23:48 |
| clarkb | armax: stop assuming the interface and let devstack do its job | 23:49 |
| armax | clarkb: by doing what? | 23:49 |
| armax | creating a random interface that is dangling? | 23:49 |
| clarkb | armax: thr same thing wr had to do for the RAs ask drvstack ehat interface | 23:49 |
| clarkb | or create a dangling inyerface and co trol it directly | 23:49 |
| *** thorst has joined #openstack-infra | 23:50 | |
| clarkb | personally I am a fan of controlling it directly for testing | 23:50 |
| armax | clarkb: that’s fine by me, but it takes some time to get this coordinated and cleaned up between project-config and devstack, | 23:50 |
| clarkb | removes any assumpyions amd pteserves host interfaces | 23:50 |
| clarkb | sure I'mjust pointing out that you do have opyions | 23:51 |
| armax | if we want to keep the gate broken until we figure this out, I think this is a bit harsh on everybody who is trying to get RC out | 23:51 |
| clarkb | and that you shouldnt act likr the only thing is to stop.testing | 23:51 |
| clarkb | I didnt say that either | 23:51 |
| *** Swami has quit IRC | 23:51 | |
| armax | I am not acting like I want to stop anything | 23:52 |
| clarkb | earlier you said thats the only thing you cando | 23:52 |
| armax | I am trying to figure out the best way we can minimize disruption | 23:52 |
| kevinbenton | i'm not sure i understand the suggestion | 23:52 |
| kevinbenton | how would creating a dangling interface help? | 23:52 |
| kevinbenton | this needs actual connectivity | 23:52 |
| clarkb | kevinbenton: because you it would always be there if you create it | 23:52 |
| armax | whilst we can devise the right fix without the pressure of a broken gate | 23:52 |
| clarkb | kevinbenton: why no oyher test does | 23:52 |
| clarkb | kevinbenton: all of the network comms for VMs are contained to thr host(s) today | 23:53 |
| *** dcwangmit01 has quit IRC | 23:53 | |
| kevinbenton | clarkb: how is external network wired up in the gate? | 23:53 |
| clarkb | kevinbenton: it oftrn isnt | 23:53 |
| clarkb | since its not nrcessary | 23:53 |
| *** piet has joined #openstack-infra | 23:54 | |
| fungi | yeah, jobs should not assume there is working external connectivity at all | 23:54 |
| mtreinish | clarkb: well that's another issue seeing that traffic can actually leave the host would be something good to check. But that's a separate discussion | 23:54 |
| kevinbenton | clarkb: and then vxlan tunnels are used for multinode or something? | 23:54 |
| fungi | network use in jobs should be abstracted | 23:54 |
| clarkb | kevinbenton: yes | 23:54 |
| prometheanfire | armax: so /sys/class/net/eno1/type for me shows type '1', meaning ethernet | 23:55 |
| fungi | the previout vxlan tunnel is there to simulate direct layer 2 connectivity between nodes in a multi-node job | 23:55 |
| prometheanfire | http://lxr.linux.no/linux+v3.0/include/linux/if_arp.h#L30 | 23:55 |
| kevinbenton | clarkb: ack, then sure. creating a random stub interface that doens't do anything should work fine | 23:55 |
| fungi | previout? i have no idea what i was typing there. precreated? | 23:55 |
| clarkb | so ya lets stop making things painful now then plan to fix it | 23:55 |
| StevenK | prometheanfire: But it also tells me that for my wireless card | 23:56 |
| prometheanfire | StevenK: k | 23:56 |
| clarkb | but I dont like the attitufe of 'its broken and there is nothing we can do' | 23:56 |
| armax | clarkb: I never said that! | 23:56 |
| *** dingyichen has joined #openstack-infra | 23:56 | |
| prometheanfire | StevenK: I think that's fine | 23:56 |
| StevenK | prometheanfire: Just to deal with the case of "I'm running it on my laptop" | 23:56 |
| *** zhurong has quit IRC | 23:56 | |
| *** watanabe_isao has quit IRC | 23:56 | |
| clarkb | armax: ok I mustve misunderstood then | 23:56 |
| armax | clarkb: yes, you did | 23:56 |
| *** sflanigan has joined #openstack-infra | 23:56 | |
| *** sflanigan has joined #openstack-infra | 23:56 | |
| fungi | clarkb: i always get turned around with regex precedence in our zuul layout... to do a branch override should it be first-match or last-match? | 23:57 |
| prometheanfire | StevenK: ah, well, sit0 is type 776, so it should filter that out | 23:57 |
| *** thorst has quit IRC | 23:57 | |
| clarkb | fungi: last iirc | 23:57 |
| fungi | clarkb: or am i better off refactoring the regex to avoid having more than one match to begin with? | 23:57 |
| prometheanfire | StevenK: can probably just also filter out the ones with a wireless dir in there | 23:57 |
| StevenK | prometheanfire: Indeed, yes | 23:57 |
| prometheanfire | there, fixed | 23:57 |
| prometheanfire | kthnxbai | 23:58 |
| clarkb | for this I would just add temp last match wins | 23:58 |
| armax | clarkb: I am all in for the right fix, so long as it doesn’t keep the thing broken for as long as it take to get to the right fix | 23:58 |
| armax | if the right fix is achievable in minutes, then by all mean, let’s go for it! :) | 23:58 |
| clarkb | armax: sure but it seems we immediately jumo to just turn it off instead of determining first if we can do the right fix immediately | 23:58 |
| *** fguillot has quit IRC | 23:59 | |
| clarkb | and the problem with just turni git off is you lose yhe self testing that you get if its running | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
