| anteaya | jogo: no longer blocked by me devstack-gate is your next port of call | 00:00 |
|---|---|---|
| mtreinish | clarkb: yeah I think checking >= 1 is the only path forward | 00:00 |
| mtreinish | sc68cal: ^^^ | 00:00 |
| *** nelsnelson has quit IRC | 00:00 | |
| *** koolhead_ has joined #openstack-infra | 00:00 | |
| *** _nadya_ has joined #openstack-infra | 00:00 | |
| *** camunoz has quit IRC | 00:01 | |
| sc68cal | JayF: CPE equiment will get at least 2 IPv6 addrs when doing PD - a /128 and a /64 | 00:01 |
| JayF | CPE? | 00:01 |
| sc68cal | customer premises equip | 00:01 |
| sc68cal | actually better example, renumbering | 00:01 |
| openstackgerrit | Merged openstack-infra/system-config: Add new git haproxy frontends to cacti https://review.openstack.org/140526 | 00:02 |
| sc68cal | a router with two prefixes - devices attached to router will get two prefixes and migrate over as renumbering | 00:02 |
| jogo | anteaya: ? | 00:02 |
| fungi | okay, back now | 00:02 |
| sc68cal | mtreinish: yeah >=1 might be it | 00:02 |
| jogo | anteaya: you mean the next patch in the series is blocked on devstack-gate? if so correct | 00:02 |
| fungi | so much with the talking | 00:02 |
| *** shakamunyi has joined #openstack-infra | 00:02 | |
| clarkb | fungi: git.o.o round robin complete. jeblair has done more bisecting and narrowed it down to a couple packages | 00:03 |
| *** shakamunyi has quit IRC | 00:03 | |
| *** ryanpetrello has quit IRC | 00:04 | |
| *** koolhead17 has quit IRC | 00:04 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/project-config: Prepare project-config for puppet module split https://review.openstack.org/140523 | 00:04 |
| anteaya | jogo: yes sorry that was my meaning | 00:04 |
| *** sabeen1 has quit IRC | 00:05 | |
| *** ivar-lazzaro has joined #openstack-infra | 00:05 | |
| *** _nadya_ has quit IRC | 00:05 | |
| clarkb | fungi: also https://review.openstack.org/#/c/140497/ will fix the hostfile things | 00:05 |
| openstackgerrit | Ramy Asselin proposed openstack-infra/project-config: Prepare project-config for puppet module split https://review.openstack.org/140523 | 00:07 |
| *** asettle is now known as asettle-errands | 00:07 | |
| jeblair | clarkb, fungi: one line in fact: | 00:07 |
| jeblair | in paramiko/rsakey.py | 00:07 |
| jeblair | - rsa = RSA.generate(bits, rng.read, progress_func) | 00:07 |
| jeblair | + rsa = RSA.generate(bits, os.urandom, progress_func) | 00:07 |
| jeblair | this has a familiar ring to it somehow | 00:08 |
| clarkb | oh hey is that like what salt was doing? | 00:08 |
| *** melwitt has quit IRC | 00:09 | |
| jeblair | https://github.com/paramiko/paramiko/commit/6f211115f49edcea7d23b764d7cf3a84ff12f5f0 | 00:10 |
| clarkb | 4) it makes multithreaded python terrible | 00:11 |
| *** david-lyle is now known as david-lyle_afk | 00:11 | |
| clarkb | er 5) | 00:11 |
| *** ZZelle_ has quit IRC | 00:12 | |
| *** andreykurilin_ has quit IRC | 00:12 | |
| *** andreykurilin_ has joined #openstack-infra | 00:13 | |
| clarkb | now I am glad that I WIP'd yolanda's patch to update paramiko | 00:13 |
| openstackgerrit | Merged openstack-infra/system-config: Use puppet inventory when running ansible. https://review.openstack.org/140497 | 00:13 |
| *** gokrokve has quit IRC | 00:14 | |
| *** packet has quit IRC | 00:15 | |
| *** gokrokve has joined #openstack-infra | 00:15 | |
| *** kumartin has quit IRC | 00:16 | |
| *** dims has quit IRC | 00:17 | |
| *** camunoz has joined #openstack-infra | 00:17 | |
| *** camunoz is now known as camunoz_mtg | 00:17 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/project-config: Prepare project-config for puppet module split https://review.openstack.org/140523 | 00:18 |
| *** dims has joined #openstack-infra | 00:19 | |
| sc68cal | commit message needs rework | 00:19 |
| *** Masahiro has joined #openstack-infra | 00:19 | |
| *** sabeen has joined #openstack-infra | 00:20 | |
| *** gokrokve has quit IRC | 00:20 | |
| *** jerryz has joined #openstack-infra | 00:20 | |
| *** Sukhdev has joined #openstack-infra | 00:23 | |
| *** hdd has quit IRC | 00:23 | |
| *** pc_m has quit IRC | 00:23 | |
| openstackgerrit | Merged openstack-infra/reviewstats: Update neutron core https://review.openstack.org/140159 | 00:23 |
| fungi | jeblair: ha! | 00:23 |
| *** pc_m has joined #openstack-infra | 00:24 | |
| clarkb | I need to run shortly for an early dinner. It would be asomeness if someone could make sure that cacti gets the new git-feXX nodes in it before tomorrow | 00:24 |
| clarkb | that way we get the precious datas with tomorrows nodepool image updates | 00:24 |
| fungi | jeblair: so it really is contention over /dev/urandom during parallel key generation calls? | 00:24 |
| *** Masahiro has quit IRC | 00:24 | |
| * fungi is finally done catching up on scrollback | 00:24 | |
| openstackgerrit | Sean M. Collins proposed openstack-infra/devstack-gate: Set IP_VERSION in DevStack to run dual stack https://review.openstack.org/140128 | 00:25 |
| *** pc_m_ has joined #openstack-infra | 00:25 | |
| fungi | clarkb: now that 140497 is in, i'll keep an eye on puppetboard and make sure things continue puppeting | 00:25 |
| fungi | (and that things which weren't previously in the static hostfile start puppeting too) | 00:25 |
| *** spzala has quit IRC | 00:26 | |
| fungi | clarkb: since the cacti change merged a while ago, what else needs to be done for that? or just keep an eye on cacti and make sure they show up? | 00:27 |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Added cron plugin to clean old access tokens. https://review.openstack.org/140536 | 00:27 |
| *** pc_m has quit IRC | 00:28 | |
| openstackgerrit | Michael Krotscheck proposed openstack-infra/storyboard: Added cron plugin to clean old access tokens. https://review.openstack.org/140536 | 00:30 |
| *** doug-fish has left #openstack-infra | 00:30 | |
| *** dims has quit IRC | 00:30 | |
| *** Sincler has quit IRC | 00:30 | |
| *** Sincler has joined #openstack-infra | 00:30 | |
| *** Sincler has quit IRC | 00:30 | |
| *** rkukura has quit IRC | 00:30 | |
| *** Sincler has joined #openstack-infra | 00:31 | |
| *** Sincler has quit IRC | 00:33 | |
| *** Sincler has joined #openstack-infra | 00:33 | |
| krotscheck | Because OMG my access token change showed me that I have 100’s of old access tokens. | 00:34 |
| fungi | krotscheck: you're such a hoarder | 00:34 |
| krotscheck | fungi: I bet you have a lot too. | 00:35 |
| jeblair | clarkb, fungi: os.urandom is faster for small values, and increasingly slower for large values of data read | 00:35 |
| *** Sukhdev has quit IRC | 00:35 | |
| jeblair | so that change either made things faster or slower for us, depending on how much data paramiko reads | 00:35 |
| jeblair | it also introduces two GIL release/acquire events each time os.urandom is read | 00:36 |
| *** rkukura has joined #openstack-infra | 00:37 | |
| *** amitgandhinz has joined #openstack-infra | 00:37 | |
| fungi | ideally the thread would be accessing its own secure prng, and seed it once from /dev/urandom, rather than fighting over /dev/urandom as a substitute prng | 00:38 |
| jeblair | fungi: this isn't locked, so i don't think there's contention here | 00:38 |
| jeblair | unless the kernel does that | 00:38 |
| fungi | i think there are patches to make it possible to have independent streams reading urandom | 00:39 |
| jeblair | fungi: what happens if two processes open it? | 00:39 |
| fungi | researching whether that's common in current kernels | 00:39 |
| fungi | at one point there was a rotating buffer and the kernel would take turns serving each caller | 00:40 |
| jeblair | https://gist.github.com/drsnyder/10909495 | 00:40 |
| jeblair | huh look at that | 00:40 |
| *** rmcall has quit IRC | 00:41 | |
| fungi | http://drsnyder.us/2014/04/16/linux-dev-urandom-and-concurrency.html | 00:41 |
| fungi | so, yeah | 00:42 |
| fungi | not good | 00:42 |
| *** ryanpetrello has joined #openstack-infra | 00:42 | |
| *** dims has joined #openstack-infra | 00:43 | |
| jeblair | and indeed, the urandom manpage says to use it to seed a prng | 00:44 |
| jeblair | but the paramiko commit removed just that | 00:44 |
| fungi | win | 00:44 |
| *** Sukhdev has joined #openstack-infra | 00:45 | |
| *** Masahiro has joined #openstack-infra | 00:45 | |
| fungi | pretty sure i had seen literature about that being a terribly efficient pattern. disappointed to see that's still the case though | 00:46 |
| fungi | terribly INefficient i mean | 00:46 |
| fungi | https://news.ycombinator.com/item?id=7610273 | 00:46 |
| fungi | et cetera | 00:47 |
| *** otter768 has joined #openstack-infra | 00:48 | |
| fungi | seems like *bsd solved it with multi-stream prng generators in-kernel a while ago | 00:48 |
| *** jamielennox is now known as jamielennox|away | 00:48 | |
| openstackgerrit | Sukhdev Kapur proposed openstack-infra/project-config: Add networking-arisa project to StackForge https://review.openstack.org/140473 | 00:49 |
| * mordred comes back into channel and sees very sad things about paramiko | 00:50 | |
| *** gyee has quit IRC | 00:50 | |
| *** ivar-lazzaro has quit IRC | 00:51 | |
| *** SumitNaiksatam has quit IRC | 00:51 | |
| jeblair | it was either doing the wrong thing before and doing the right thing now, or the other way around | 00:51 |
| mordred | jeblair: this is all in the post-boot-onfig stuff in nodepool via ssh? or are we using paramkio for something else? | 00:51 |
| * mordred trying to tldr back in to context | 00:51 | |
| *** koolhead_ has quit IRC | 00:51 | |
| jeblair | depending on which cryptographer on the internet you are asking | 00:51 |
| jeblair | mordred: i believe this is in creating keys for the nodes (for use in multi-node setups) | 00:52 |
| mordred | cotcha | 00:52 |
| mordred | gotcha, that is | 00:52 |
| jeblair | i think at this point we can say that new paramiko is far less efficient at generating 1000 rsa keys | 00:52 |
| *** otter768 has quit IRC | 00:52 | |
| mordred | well, that's good to know | 00:52 |
| jeblair | we could probably defer the problem by not generating keys for single-host nodes | 00:53 |
| mordred | we coudl also shell to ssh-keygen and not use paramkio | 00:53 |
| mordred | which just moves the problem | 00:53 |
| fungi | or reuse keys | 00:53 |
| fungi | or short-circuit os.urandom by redefining it? | 00:54 |
| jeblair | fungi: i'd rather not worry about inter-node interference that way | 00:54 |
| fungi | jeblair: true | 00:54 |
| *** xyang1 has quit IRC | 00:54 | |
| mordred | or - offload to nova keypair extension | 00:55 |
| mordred | which can create a key for you | 00:55 |
| jeblair | mordred: i'm pretty sure that would take many many orders of magnitude longer | 00:55 |
| mordred | nod | 00:55 |
| *** avozza is now known as zz_avozza | 00:56 | |
| fungi | perhaps paramiko would take a patch upstream to make "cheap but insecure" randomness for key generation as a foot-cannon named parameter | 00:57 |
| *** MaxV has joined #openstack-infra | 00:58 | |
| *** Longgeek has joined #openstack-infra | 00:59 | |
| *** mikedillion has quit IRC | 01:00 | |
| jeblair | i'm doing some more tests | 01:01 |
| *** mikedillion has joined #openstack-infra | 01:01 | |
| *** MaxV has quit IRC | 01:03 | |
| *** salv-orlando has quit IRC | 01:03 | |
| *** StevenK has joined #openstack-infra | 01:04 | |
| *** mestery has quit IRC | 01:04 | |
| *** Longgeek has quit IRC | 01:04 | |
| *** armax has quit IRC | 01:05 | |
| *** armax has joined #openstack-infra | 01:07 | |
| *** signed8b_ is now known as signed8bit_ZZZzz | 01:07 | |
| openstackgerrit | Ramy Asselin proposed openstack-infra/project-config: Prepare project-config for puppet module split #2 https://review.openstack.org/140548 | 01:09 |
| *** dims has quit IRC | 01:11 | |
| *** CIBuilds has quit IRC | 01:11 | |
| *** mestery has joined #openstack-infra | 01:11 | |
| *** marun has quit IRC | 01:11 | |
| *** wenlock has quit IRC | 01:13 | |
| jeblair | fungi, mordred: it seems like overall, key generation is faster with the new paramiko | 01:13 |
| mordred | jeblair: so, generation is faste, but less concurrency friendly? | 01:13 |
| mordred | because GIL? | 01:14 |
| *** mikedillion has quit IRC | 01:14 | |
| jeblair | it may actually be more concurrent because it may hold the gil less | 01:14 |
| *** marun has joined #openstack-infra | 01:14 | |
| mordred | oh. neat | 01:15 |
| *** xianghui has joined #openstack-infra | 01:15 | |
| *** adalbas has quit IRC | 01:16 | |
| *** yamamoto_ has joined #openstack-infra | 01:16 | |
| jeblair | that might be giving us 500 threads all ready to run at much closer to the same time | 01:16 |
| reed | I'm still not sure what the recommended way is to take over someone else's changeset. Are there instructions somewhere? | 01:17 |
| reed | is it better to just pull from gerrit? or checkout is better? | 01:18 |
| jroll | reed: you can't transfer ownership, you just push patches to it and remember to check | 01:18 |
| *** gokrokve has joined #openstack-infra | 01:18 | |
| jroll | reed: I also tend to use "git review -d 12345", where 12345 is the change ID, that will check it out locally | 01:18 |
| *** zhiwei has joined #openstack-infra | 01:18 | |
| reed | jroll, that's what I meant | 01:18 |
| mmedvede | asselin: were does the script to refresh split out modules run? I do not think it does properly update the seed repositories right now | 01:18 |
| reed | jroll, ah, great, I'll try that | 01:18 |
| asselin | mmedvede, it runs on sweston's server | 01:19 |
| asselin | mmedvede, do you have an example? I'd like to take a look? | 01:19 |
| mmedvede | asselin: there were a few questions regarding the details today at the meeting. This is exactly the problem, we are relying on it to be running, without having any control. | 01:20 |
| mmedvede | asselin: example - subunit2sql module | 01:20 |
| openstackgerrit | Nikhil Manchanda proposed openstack-infra/project-config: Add link for Trove RSS feed https://review.openstack.org/140549 | 01:20 |
| asselin | asselin looking | 01:20 |
| * sweston is looking | 01:20 | |
| *** pc_m_ has quit IRC | 01:22 | |
| asselin | mmedvede, yes, something is missing | 01:23 |
| *** salv-orlando has joined #openstack-infra | 01:23 | |
| asselin | mmedvede, I think we can work out the issues. And we can delay the split until we know it's correct. | 01:24 |
| asselin | mmedvede, another option is to have -infra run the script | 01:24 |
| asselin | mmedvede, but it would be better not to in order to avoid tasking them with one more thing | 01:25 |
| sweston | what is missing? I do not see it | 01:25 |
| jeblair | clarkb, fungi, mordred: i'll think about this some more, but we may want to just see how the trusty server behaves with the updated pycrypto and deal with things from there. my test may be too artificial to tell us what we'll see in production. | 01:25 |
| fungi | i'll buy that | 01:25 |
| *** sabari is now known as zz_sabari | 01:25 | |
| *** ryanpetrello has quit IRC | 01:26 | |
| asselin | sweston, https://github.com/openstack-infra/system-config/tree/master/modules/subunit2sql has a commit that is 6 days old | 01:26 |
| jeblair | i'm going to eod now; night | 01:26 |
| *** rkukura has quit IRC | 01:26 | |
| asselin | sweston, your last commit is 21 days ago: https://github.com/Triniplex/puppet-subunit2sql | 01:26 |
| *** ddieterly has joined #openstack-infra | 01:27 | |
| *** obondarev has quit IRC | 01:28 | |
| openstackgerrit | Merged openstack-infra/project-config: Add new project packstack-vagrant to stackforge https://review.openstack.org/139660 | 01:28 |
| asselin | mmedvede, another option is to have multiple ppl running the script. e.g. I can run it too. | 01:28 |
| mmedvede | asselin: can you push to his github? | 01:29 |
| asselin | mmedvede, probably not unless he adds me | 01:30 |
| anteaya | asselin: good call | 01:31 |
| *** Masahiro has quit IRC | 01:31 | |
| *** amitgandhinz has quit IRC | 01:31 | |
| asselin | mmedvede, either way, i'd like to get the script working & validated. it's a huge time saver not to have to do this | 01:31 |
| anteaya | also we need the ability to trigger is manually as well | 01:31 |
| *** dannywilson has quit IRC | 01:31 | |
| anteaya | it | 01:31 |
| sweston | ok I will add those features in | 01:31 |
| *** Sukhdev has quit IRC | 01:32 | |
| *** xianghui has quit IRC | 01:32 | |
| *** yamamoto_ has quit IRC | 01:32 | |
| *** xianghui_ has joined #openstack-infra | 01:32 | |
| *** mestery has quit IRC | 01:32 | |
| *** armax has quit IRC | 01:32 | |
| anteaya | sweston: thanks steve | 01:32 |
| asselin | sweston, are you ok to add a few ppl with write permissions? I think this well help as a good backup. | 01:32 |
| * anteaya heads out to the restaurant | 01:32 | |
| asselin | sweston, but hopefully we'll never need to | 01:33 |
| anteaya | asselin: agreed | 01:33 |
| *** ddieterl_ has joined #openstack-infra | 01:33 | |
| *** xianghui_ is now known as xianghui | 01:33 | |
| *** ddieterly has quit IRC | 01:33 | |
| asselin | anteaya, bon appetite | 01:34 |
| sweston | asselin: yup | 01:34 |
| *** Masahiro has joined #openstack-infra | 01:34 | |
| *** markmcclain has quit IRC | 01:34 | |
| mmedvede | asselin, sweston: +1. I like the automation :) | 01:34 |
| sweston | anteaya: have a good dinner | 01:34 |
| anteaya | asselin sweston thanks | 01:35 |
| anteaya | the automation is a good idea, we just need to ensure we can respin on short notice | 01:35 |
| sweston | i'll look into the github api tomorrow | 01:36 |
| mmedvede | sweston: regarding on what is missing in the subunit2sql module, see commit 5941f83 in system-config | 01:36 |
| *** marun has quit IRC | 01:38 | |
| *** shayneburgess has quit IRC | 01:42 | |
| *** wuhg has joined #openstack-infra | 01:43 | |
| *** andreykurilin_ has quit IRC | 01:44 | |
| *** shakamunyi has joined #openstack-infra | 01:53 | |
| *** yaguang has joined #openstack-infra | 01:55 | |
| *** ivar-lazzaro has joined #openstack-infra | 01:57 | |
| *** oomichi_ has joined #openstack-infra | 01:57 | |
| sweston | mmedvede: yup, ok, found the error. will fix it in the morning | 01:59 |
| *** shashankhegde has quit IRC | 02:00 | |
| *** ivar-lazzaro has quit IRC | 02:00 | |
| mmedvede | sweston: thanks. Your script is great, what was the issue? | 02:00 |
| *** ivar-lazzaro has joined #openstack-infra | 02:01 | |
| sweston | mmedvede: thanks :-). when I built it, I didn't have the opportunity to test multiple module updates. the issue is with the parsing of the updated modules, it's a simple fix | 02:01 |
| *** weshay has quit IRC | 02:02 | |
| *** baoli has joined #openstack-infra | 02:02 | |
| *** signed8bit_ZZZzz is now known as signed8b_ | 02:03 | |
| *** fandi has quit IRC | 02:03 | |
| *** asettle-errands is now known as asettle-doctor | 02:06 | |
| sweston | mmedvede: thanks for finding the issue. since some of the modules are still being updated, I didn't catch it | 02:06 |
| mmedvede | sweston: glad to help :) | 02:08 |
| *** harlowja has joined #openstack-infra | 02:10 | |
| *** signed8b_ has quit IRC | 02:11 | |
| *** tnovacik has quit IRC | 02:13 | |
| *** yamamoto_ has joined #openstack-infra | 02:15 | |
| *** r-daneel has quit IRC | 02:15 | |
| *** tnovacik has joined #openstack-infra | 02:17 | |
| *** dkranz has quit IRC | 02:18 | |
| *** ChuckC has quit IRC | 02:18 | |
| *** Masahiro has quit IRC | 02:21 | |
| *** Masahiro has joined #openstack-infra | 02:27 | |
| *** SumitNaiksatam has joined #openstack-infra | 02:30 | |
| *** xyang1 has joined #openstack-infra | 02:30 | |
| *** amitgandhinz has joined #openstack-infra | 02:34 | |
| *** shayneburgess has joined #openstack-infra | 02:37 | |
| *** tnovacik has quit IRC | 02:40 | |
| *** camunoz_mtg has quit IRC | 02:41 | |
| *** oomichi_ has quit IRC | 02:44 | |
| *** salv-orlando has quit IRC | 02:47 | |
| *** ryanpetrello has joined #openstack-infra | 02:48 | |
| *** Longgeek has joined #openstack-infra | 02:48 | |
| *** otter768 has joined #openstack-infra | 02:49 | |
| *** Sincler has quit IRC | 02:51 | |
| *** amitgandhinz has quit IRC | 02:52 | |
| *** ChuckC has joined #openstack-infra | 02:53 | |
| *** Longgeek has quit IRC | 02:53 | |
| *** otter768 has quit IRC | 02:54 | |
| *** zz_sabari is now known as sabari | 02:54 | |
| *** camunoz_mtg has joined #openstack-infra | 02:54 | |
| *** ryanpetrello has quit IRC | 02:55 | |
| *** r-daneel has joined #openstack-infra | 02:56 | |
| *** signed8bit has joined #openstack-infra | 02:58 | |
| *** r-daneel has quit IRC | 03:00 | |
| *** signed8b_ has joined #openstack-infra | 03:03 | |
| clarkb | fungi still about? looks like we need to bounce snmpd on git-fe* | 03:07 |
| *** signed8bit has quit IRC | 03:07 | |
| clarkb | I can do that when I get home | 03:07 |
| *** ryanpetrello has joined #openstack-infra | 03:10 | |
| *** harlowja is now known as harlowja_away | 03:12 | |
| *** ryanpetrello has quit IRC | 03:14 | |
| *** r-daneel has joined #openstack-infra | 03:15 | |
| *** patrickeast has quit IRC | 03:19 | |
| *** armax has joined #openstack-infra | 03:20 | |
| *** mestery has joined #openstack-infra | 03:21 | |
| *** salv-orlando has joined #openstack-infra | 03:23 | |
| *** zz_dimtruck is now known as dimtruck | 03:23 | |
| *** salv-orlando has quit IRC | 03:23 | |
| *** salv-orl_ has joined #openstack-infra | 03:23 | |
| *** fandi has joined #openstack-infra | 03:24 | |
| *** marun has joined #openstack-infra | 03:26 | |
| *** jamielennox|away is now known as jamielennox | 03:26 | |
| *** changbl has joined #openstack-infra | 03:28 | |
| *** amotoki has joined #openstack-infra | 03:28 | |
| *** signed8b_ is now known as signed8bit | 03:31 | |
| *** camunoz_mtg has quit IRC | 03:34 | |
| *** oomichi_ has joined #openstack-infra | 03:35 | |
| *** dimtruck is now known as zz_dimtruck | 03:45 | |
| *** camunoz_mtg has joined #openstack-infra | 03:50 | |
| *** r-daneel has quit IRC | 03:50 | |
| *** ivar-laz_ has joined #openstack-infra | 03:55 | |
| *** Sukhdev has joined #openstack-infra | 03:55 | |
| *** ddieterl_ has quit IRC | 03:56 | |
| *** _nadya_ has joined #openstack-infra | 03:57 | |
| *** ivar-lazzaro has quit IRC | 03:58 | |
| *** talluri has joined #openstack-infra | 04:00 | |
| *** ivar-laz_ has quit IRC | 04:00 | |
| *** rkukura has joined #openstack-infra | 04:00 | |
| *** markmcclain has joined #openstack-infra | 04:02 | |
| *** asettle-doctor is now known as asettle | 04:02 | |
| *** pc_m has joined #openstack-infra | 04:03 | |
| *** pc_m has quit IRC | 04:04 | |
| *** pc_m has joined #openstack-infra | 04:05 | |
| *** _nadya_ has quit IRC | 04:09 | |
| *** talluri has quit IRC | 04:10 | |
| *** talluri has joined #openstack-infra | 04:11 | |
| *** signed8bit has quit IRC | 04:15 | |
| *** signed8bit has joined #openstack-infra | 04:16 | |
| *** mrmartin has joined #openstack-infra | 04:17 | |
| *** amotoki has quit IRC | 04:17 | |
| openstackgerrit | Merged openstack-infra/publications: Tell people to clone template branch using git:// https://review.openstack.org/111366 | 04:24 |
| *** signed8bit has quit IRC | 04:25 | |
| *** ddieterly has joined #openstack-infra | 04:29 | |
| *** dannywilson has joined #openstack-infra | 04:32 | |
| *** ddieterly has quit IRC | 04:33 | |
| *** amotoki has joined #openstack-infra | 04:34 | |
| *** achanda has joined #openstack-infra | 04:35 | |
| *** dannywilson has quit IRC | 04:36 | |
| *** Ryan_Lane has quit IRC | 04:37 | |
| *** Longgeek has joined #openstack-infra | 04:37 | |
| *** Longgeek has quit IRC | 04:42 | |
| *** otter768 has joined #openstack-infra | 04:50 | |
| *** fifieldt has joined #openstack-infra | 04:53 | |
| *** otter768 has quit IRC | 04:54 | |
| *** nikil22_ has joined #openstack-infra | 04:56 | |
| *** Sukhdev has quit IRC | 04:59 | |
| *** achanda has quit IRC | 04:59 | |
| *** achanda has joined #openstack-infra | 05:01 | |
| *** achanda has quit IRC | 05:05 | |
| *** markmcclain has quit IRC | 05:06 | |
| *** mestery has quit IRC | 05:06 | |
| *** harlowja_at_home has joined #openstack-infra | 05:06 | |
| *** armax has quit IRC | 05:06 | |
| *** markmcclain has joined #openstack-infra | 05:06 | |
| *** yfried|afk is now known as yfried_ | 05:07 | |
| *** hdd has joined #openstack-infra | 05:07 | |
| *** wenlock has joined #openstack-infra | 05:07 | |
| *** ddieterly has joined #openstack-infra | 05:08 | |
| *** mrmartin has quit IRC | 05:11 | |
| *** markmcclain has quit IRC | 05:11 | |
| *** koolhead17 has joined #openstack-infra | 05:11 | |
| *** marun has quit IRC | 05:12 | |
| *** ddieterly has quit IRC | 05:13 | |
| *** marun has joined #openstack-infra | 05:13 | |
| *** radez is now known as radez_g0n3 | 05:15 | |
| *** craigbr has joined #openstack-infra | 05:15 | |
| *** mmaglana has joined #openstack-infra | 05:16 | |
| *** craigbr has quit IRC | 05:18 | |
| *** achanda has joined #openstack-infra | 05:19 | |
| openstackgerrit | Joshua Harlow proposed openstack/requirements: Bump up oslo.utils to 1.1.0 https://review.openstack.org/140573 | 05:22 |
| *** camunoz_mtg has quit IRC | 05:25 | |
| *** achanda has quit IRC | 05:26 | |
| *** wenlock has quit IRC | 05:28 | |
| *** harlowja_away is now known as harlowja | 05:28 | |
| *** harlowja is now known as harlowja_away | 05:29 | |
| *** mrmartin has joined #openstack-infra | 05:33 | |
| *** sabeen has quit IRC | 05:35 | |
| *** Longgeek has joined #openstack-infra | 05:38 | |
| *** rushiagr_away is now known as rushiagr | 05:40 | |
| jyuso | sweston: Thank you for your config file.It solved my problem.:) | 05:41 |
| *** armax has joined #openstack-infra | 05:42 | |
| *** Longgeek has quit IRC | 05:43 | |
| *** Sukhdev has joined #openstack-infra | 05:46 | |
| *** KanagarajM has joined #openstack-infra | 05:46 | |
| *** yfried_ has quit IRC | 05:47 | |
| *** viglesias has quit IRC | 05:48 | |
| *** viglesias has joined #openstack-infra | 05:48 | |
| *** mrmartin has quit IRC | 05:49 | |
| *** talluri has quit IRC | 05:50 | |
| *** sarob has joined #openstack-infra | 05:50 | |
| *** talluri has joined #openstack-infra | 05:50 | |
| *** achanda has joined #openstack-infra | 05:52 | |
| *** wenlock has joined #openstack-infra | 05:52 | |
| *** gokrokve_ has joined #openstack-infra | 05:53 | |
| *** esker has joined #openstack-infra | 05:55 | |
| *** achanda has quit IRC | 05:55 | |
| *** achanda has joined #openstack-infra | 05:56 | |
| *** gokrokve has quit IRC | 05:57 | |
| *** ddieterly has joined #openstack-infra | 05:57 | |
| *** gokrokve_ has quit IRC | 05:58 | |
| *** achanda has quit IRC | 06:00 | |
| *** ddieterly has quit IRC | 06:02 | |
| *** hdd has quit IRC | 06:02 | |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Add test for validating certain gerrit ACL rules https://review.openstack.org/140470 | 06:05 |
| *** camunoz has joined #openstack-infra | 06:08 | |
| *** gyee has joined #openstack-infra | 06:08 | |
| *** koolhead17 has quit IRC | 06:16 | |
| *** gokrokve has joined #openstack-infra | 06:23 | |
| *** gokrokve has quit IRC | 06:25 | |
| *** sarob has quit IRC | 06:25 | |
| *** gokrokve has joined #openstack-infra | 06:25 | |
| *** ddieterly has joined #openstack-infra | 06:27 | |
| *** salv-orl_ has quit IRC | 06:29 | |
| *** gokrokve has quit IRC | 06:30 | |
| *** rlandy has joined #openstack-infra | 06:31 | |
| *** ddieterly has quit IRC | 06:31 | |
| *** gokrokve has joined #openstack-infra | 06:32 | |
| *** marun has quit IRC | 06:32 | |
| *** salv-orlando has joined #openstack-infra | 06:33 | |
| *** gokrokve_ has joined #openstack-infra | 06:34 | |
| *** krtaylor has quit IRC | 06:36 | |
| *** gokrokve has quit IRC | 06:36 | |
| *** harlowja_at_home has quit IRC | 06:37 | |
| *** krtaylor has joined #openstack-infra | 06:38 | |
| *** salv-orlando has quit IRC | 06:38 | |
| *** gokrokve_ has quit IRC | 06:39 | |
| *** yfried_ has joined #openstack-infra | 06:39 | |
| *** reed has quit IRC | 06:41 | |
| *** salv-orlando has joined #openstack-infra | 06:45 | |
| *** Longgeek has joined #openstack-infra | 06:45 | |
| *** teran has joined #openstack-infra | 06:46 | |
| *** oomichi_ has quit IRC | 06:46 | |
| *** armax has quit IRC | 06:46 | |
| *** teran_ has quit IRC | 06:49 | |
| *** otter768 has joined #openstack-infra | 06:51 | |
| *** mrunge has joined #openstack-infra | 06:51 | |
| *** belmoreira has joined #openstack-infra | 06:55 | |
| *** otter768 has quit IRC | 06:55 | |
| *** esker has quit IRC | 06:56 | |
| *** esker has joined #openstack-infra | 06:56 | |
| *** esker has quit IRC | 07:01 | |
| *** jgallard_ has joined #openstack-infra | 07:02 | |
| *** yfried_ is now known as yfried|afk | 07:05 | |
| *** yfried|afk is now known as yfried_ | 07:06 | |
| *** e0ne has joined #openstack-infra | 07:08 | |
| *** _nadya_ has joined #openstack-infra | 07:09 | |
| *** _nadya_ has quit IRC | 07:14 | |
| openstackgerrit | Merged openstack-infra/project-config: Add networking-arisa project to StackForge https://review.openstack.org/140473 | 07:15 |
| *** Sukhdev has quit IRC | 07:16 | |
| *** yfried_ is now known as yfried|afk | 07:19 | |
| *** zz_avozza is now known as avozza | 07:24 | |
| *** k4n0 has joined #openstack-infra | 07:25 | |
| *** ddieterly has joined #openstack-infra | 07:27 | |
| *** koolhead17 has joined #openstack-infra | 07:28 | |
| *** yfried|afk is now known as yfried_ | 07:29 | |
| *** salv-orlando has quit IRC | 07:31 | |
| *** ddieterly has quit IRC | 07:32 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/system-config: Fix indention in gerrit.config.erb https://review.openstack.org/90031 | 07:32 |
| *** koolhead17 has quit IRC | 07:33 | |
| *** masayukig has quit IRC | 07:43 | |
| *** masayukig has joined #openstack-infra | 07:43 | |
| *** teran_ has joined #openstack-infra | 07:45 | |
| *** teran has quit IRC | 07:48 | |
| tchaypo | Sorry for nagging about this, but https://review.openstack.org/#/c/136811/ seems like it’s ready to land. Is there anything I need to do so it can get an extra +2? | 07:51 |
| *** mmaglana has quit IRC | 07:52 | |
| *** dtantsur|afk is now known as dtantsur | 07:55 | |
| *** fifieldt has quit IRC | 07:56 | |
| *** ddieterly has joined #openstack-infra | 07:57 | |
| *** jerryz has quit IRC | 07:58 | |
| *** gyee has quit IRC | 07:58 | |
| *** tnovacik has joined #openstack-infra | 07:59 | |
| *** markus_z has joined #openstack-infra | 08:00 | |
| openstackgerrit | James Polley proposed openstack-infra/zuul: Remove "properly" from error message for clarity https://review.openstack.org/134122 | 08:00 |
| *** ddieterly has quit IRC | 08:01 | |
| *** luqas has joined #openstack-infra | 08:02 | |
| *** teran_ has quit IRC | 08:02 | |
| *** arxcruz has joined #openstack-infra | 08:05 | |
| *** jpich has joined #openstack-infra | 08:05 | |
| *** jerryz has joined #openstack-infra | 08:07 | |
| *** wenlock has quit IRC | 08:10 | |
| *** ala_ has joined #openstack-infra | 08:12 | |
| *** [HeOS] has quit IRC | 08:13 | |
| *** avozza is now known as zz_avozza | 08:16 | |
| *** jistr has joined #openstack-infra | 08:17 | |
| *** ociuhandu has joined #openstack-infra | 08:20 | |
| *** amuller has joined #openstack-infra | 08:23 | |
| *** jerryz_ has joined #openstack-infra | 08:24 | |
| *** stevemar has quit IRC | 08:25 | |
| *** oomichi has joined #openstack-infra | 08:26 | |
| *** salv-orlando has joined #openstack-infra | 08:31 | |
| *** gokrokve has joined #openstack-infra | 08:32 | |
| *** jcoufal has joined #openstack-infra | 08:32 | |
| *** e0ne has quit IRC | 08:36 | |
| *** salv-orlando has quit IRC | 08:37 | |
| *** koolhead17 has joined #openstack-infra | 08:37 | |
| *** gokrokve has quit IRC | 08:37 | |
| *** mpaolino has joined #openstack-infra | 08:38 | |
| *** jlibosva has joined #openstack-infra | 08:39 | |
| *** zz_avozza is now known as avozza | 08:39 | |
| *** nikil22_ has quit IRC | 08:40 | |
| *** pblaho has joined #openstack-infra | 08:40 | |
| *** oomichi has quit IRC | 08:40 | |
| *** MaxV has joined #openstack-infra | 08:41 | |
| *** ociuhandu has quit IRC | 08:44 | |
| *** unicell has joined #openstack-infra | 08:47 | |
| *** andreaf has quit IRC | 08:47 | |
| *** andreaf has joined #openstack-infra | 08:48 | |
| *** otter768 has joined #openstack-infra | 08:51 | |
| *** yfried_ is now known as yfried|afk | 08:56 | |
| ekarlso- | ahmmm, is oslo.context not yet in requirements? | 08:56 |
| *** otter768 has quit IRC | 08:56 | |
| AJaeger | ekarlso-, it's in as far as I can see | 08:57 |
| ekarlso- | kk, just gotta refresh then here :)= | 08:57 |
| *** ociuhandu has joined #openstack-infra | 08:59 | |
| omrim | Devstack was broken due to services split..Is someone know what is the status? | 09:02 |
| openstackgerrit | yolanda.robla proposed openstack-infra/infra-specs: Add nodepool disk image builder testing spec. https://review.openstack.org/139598 | 09:03 |
| *** nelsnelson has joined #openstack-infra | 09:03 | |
| *** yfried|afk is now known as yfried_ | 09:09 | |
| *** ociuhandu has joined #openstack-infra | 09:10 | |
| *** jedimike has joined #openstack-infra | 09:13 | |
| *** ociuhandu has quit IRC | 09:14 | |
| *** derekh has joined #openstack-infra | 09:17 | |
| *** yfried_ is now known as yfried|afk | 09:20 | |
| *** Hal_ has joined #openstack-infra | 09:23 | |
| *** mrunge has quit IRC | 09:24 | |
| *** [HeOS] has joined #openstack-infra | 09:25 | |
| *** sabari is now known as zz_sabari | 09:26 | |
| *** sarob has joined #openstack-infra | 09:26 | |
| *** mrunge has joined #openstack-infra | 09:28 | |
| *** sarob has quit IRC | 09:31 | |
| *** gokrokve has joined #openstack-infra | 09:32 | |
| *** berendt has joined #openstack-infra | 09:33 | |
| *** gokrokve has quit IRC | 09:37 | |
| *** mfink has quit IRC | 09:39 | |
| *** yfried|afk is now known as yfried_ | 09:40 | |
| *** e0ne has joined #openstack-infra | 09:41 | |
| *** salv-orlando has joined #openstack-infra | 09:45 | |
| *** koolhead17 has quit IRC | 09:47 | |
| *** teran has joined #openstack-infra | 09:47 | |
| *** salv-orlando has quit IRC | 09:50 | |
| *** mrunge has quit IRC | 09:50 | |
| openstackgerrit | Aaron Rosen proposed openstack-infra/nodepool: Update Readme config -> system-config repo https://review.openstack.org/134008 | 09:51 |
| *** ihrachyshka has joined #openstack-infra | 09:51 | |
| *** jerryz__ has joined #openstack-infra | 09:54 | |
| *** jerryz__ has quit IRC | 09:54 | |
| *** jerryz_ has quit IRC | 09:54 | |
| *** mrunge has joined #openstack-infra | 09:56 | |
| *** mrmartin has joined #openstack-infra | 10:04 | |
| *** pelix has joined #openstack-infra | 10:07 | |
| *** Masahiro has quit IRC | 10:10 | |
| *** berendt has quit IRC | 10:11 | |
| *** Masahiro has joined #openstack-infra | 10:11 | |
| openstackgerrit | Marton Kiss proposed openstack-infra/system-config: Fix puppet module dependency order https://review.openstack.org/140440 | 10:12 |
| *** hashar has joined #openstack-infra | 10:14 | |
| *** yfried_ is now known as yfried|afk | 10:14 | |
| *** nfedotov has joined #openstack-infra | 10:15 | |
| *** skolekonov has joined #openstack-infra | 10:16 | |
| *** dizquierdo has joined #openstack-infra | 10:17 | |
| *** jcoufal has quit IRC | 10:18 | |
| *** unicell1 has joined #openstack-infra | 10:20 | |
| *** unicell has quit IRC | 10:22 | |
| *** ociuhandu has joined #openstack-infra | 10:28 | |
| *** ihrachyshka_ has joined #openstack-infra | 10:28 | |
| *** ihrachyshka has quit IRC | 10:30 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/system-config: Add hp1 back running tripleo ci https://review.openstack.org/126513 | 10:31 |
| *** gokrokve has joined #openstack-infra | 10:32 | |
| *** Masahiro has quit IRC | 10:33 | |
| *** yfried|afk is now known as yfried_ | 10:34 | |
| *** gokrokve has quit IRC | 10:36 | |
| *** _shaps_ has joined #openstack-infra | 10:37 | |
| *** jp_at_hp has joined #openstack-infra | 10:40 | |
| *** dizquierdo has quit IRC | 10:41 | |
| *** ociuhandu has quit IRC | 10:44 | |
| *** yaguang has quit IRC | 10:44 | |
| *** yaguang has joined #openstack-infra | 10:44 | |
| *** ldnunes has joined #openstack-infra | 10:45 | |
| *** pblaho has quit IRC | 10:48 | |
| *** ociuhandu has joined #openstack-infra | 10:49 | |
| *** amotoki has quit IRC | 10:51 | |
| *** otter768 has joined #openstack-infra | 10:52 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/project-config: Add a tripleo juno overcloud jobs https://review.openstack.org/130540 | 10:53 |
| *** ociuhandu has quit IRC | 10:54 | |
| *** yfried_ is now known as yfried|afk | 10:55 | |
| *** dizquierdo has joined #openstack-infra | 10:55 | |
| *** jgallard_ has quit IRC | 10:56 | |
| *** otter768 has quit IRC | 10:57 | |
| *** ZZelle has quit IRC | 10:57 | |
| *** ZZelle has joined #openstack-infra | 10:57 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/project-config: Add a tripleo juno overcloud jobs https://review.openstack.org/130540 | 10:58 |
| *** talluri has quit IRC | 11:06 | |
| *** jkraj has joined #openstack-infra | 11:07 | |
| *** talluri has joined #openstack-infra | 11:08 | |
| *** teran has quit IRC | 11:09 | |
| openstackgerrit | Marton Kiss proposed openstack-infra/system-config: Enable SSL for groups.openstack.org https://review.openstack.org/138011 | 11:09 |
| *** jule has quit IRC | 11:10 | |
| *** teran has joined #openstack-infra | 11:11 | |
| *** jule has joined #openstack-infra | 11:11 | |
| *** hashar has quit IRC | 11:12 | |
| *** cnesa has joined #openstack-infra | 11:13 | |
| *** yfried|afk is now known as yfried_ | 11:15 | |
| *** yamamoto_ has quit IRC | 11:16 | |
| *** jkraj has quit IRC | 11:17 | |
| *** mika has quit IRC | 11:17 | |
| *** jp_at_hp has quit IRC | 11:17 | |
| *** jp_at_hp1 has joined #openstack-infra | 11:17 | |
| *** jkraj has joined #openstack-infra | 11:17 | |
| *** mika has joined #openstack-infra | 11:19 | |
| *** cnesa has quit IRC | 11:20 | |
| *** jp_at_hp1 has quit IRC | 11:21 | |
| *** cnesa has joined #openstack-infra | 11:25 | |
| *** yfried_ is now known as yfried|afk | 11:28 | |
| *** yaguang has quit IRC | 11:29 | |
| *** salv-orlando has joined #openstack-infra | 11:32 | |
| *** gokrokve has joined #openstack-infra | 11:32 | |
| *** aysyd has joined #openstack-infra | 11:33 | |
| *** alexpilotti has joined #openstack-infra | 11:33 | |
| *** andreykurilin_ has joined #openstack-infra | 11:34 | |
| *** Masahiro has joined #openstack-infra | 11:34 | |
| *** cnesa2 has joined #openstack-infra | 11:34 | |
| *** cnesa has quit IRC | 11:35 | |
| *** salv-orlando has quit IRC | 11:36 | |
| *** berendt has joined #openstack-infra | 11:36 | |
| *** gokrokve has quit IRC | 11:37 | |
| *** kmartin has quit IRC | 11:37 | |
| *** jamielennox is now known as jamielennox|away | 11:38 | |
| *** Masahiro has quit IRC | 11:38 | |
| *** yfried|afk is now known as yfried_ | 11:39 | |
| *** asselin has quit IRC | 11:43 | |
| *** _nadya_ has joined #openstack-infra | 11:45 | |
| *** vigneshvar has joined #openstack-infra | 11:46 | |
| *** jcoufal has joined #openstack-infra | 11:46 | |
| *** cdent has joined #openstack-infra | 11:47 | |
| *** adalbas has joined #openstack-infra | 11:49 | |
| *** isviridov_away is now known as isviridov | 11:50 | |
| *** fandi has quit IRC | 11:54 | |
| *** doug-fish has joined #openstack-infra | 11:54 | |
| *** talluri has quit IRC | 11:55 | |
| *** achanda has joined #openstack-infra | 11:59 | |
| *** mpaolino has quit IRC | 12:00 | |
| *** e0ne has quit IRC | 12:00 | |
| *** ddieterly has joined #openstack-infra | 12:02 | |
| *** bradjones has joined #openstack-infra | 12:03 | |
| *** zhiwei has quit IRC | 12:08 | |
| *** david-lyle_afk is now known as david-lyle | 12:09 | |
| *** david-lyle is now known as david-lyle_afk | 12:17 | |
| nikil22 | hi i have installed the jenkins master with zuul . Now i see that as a zuul user i am not able to get the gerrit triggers . my gerrit_key file is in "/var/lib/jenkins/.ssh/id_rsa" . Any idea how to solve this | 12:17 |
| *** david-lyle_afk is now known as david-lyle | 12:17 | |
| nikil22 | i have tried using the blog : http://www.joinfu.com/2014/01/understanding-the-openstack-ci-system/ | 12:19 |
| *** jistr has quit IRC | 12:20 | |
| *** david-lyle is now known as david-lyle_afk | 12:23 | |
| *** david-lyle_afk is now known as david-lyle | 12:23 | |
| *** yamamoto has joined #openstack-infra | 12:23 | |
| *** nfedotov has left #openstack-infra | 12:24 | |
| nikil22 | could some one should me the proper docs for setting up the Third party CI system. The standard docs is not having much information | 12:26 |
| *** jp_at_hp has joined #openstack-infra | 12:27 | |
| *** Murad has joined #openstack-infra | 12:29 | |
| *** amotoki has joined #openstack-infra | 12:29 | |
| *** mrunge is now known as mrunge_brb | 12:31 | |
| *** david-lyle is now known as david-lyle_afk | 12:31 | |
| *** david-lyle_afk is now known as david-lyle | 12:31 | |
| *** gokrokve has joined #openstack-infra | 12:32 | |
| *** ryanpetrello has joined #openstack-infra | 12:36 | |
| *** gokrokve has quit IRC | 12:37 | |
| *** ociuhandu has joined #openstack-infra | 12:37 | |
| *** teran has quit IRC | 12:37 | |
| *** ctlaugh has quit IRC | 12:38 | |
| *** ctlaugh has joined #openstack-infra | 12:38 | |
| *** jistr has joined #openstack-infra | 12:40 | |
| *** Masahiro has joined #openstack-infra | 12:46 | |
| *** ociuhandu_ has joined #openstack-infra | 12:48 | |
| *** ociuhandu has quit IRC | 12:48 | |
| *** ociuhandu_ is now known as ociuhandu | 12:48 | |
| *** Masahiro has quit IRC | 12:51 | |
| *** luqas has quit IRC | 12:51 | |
| *** e0ne has joined #openstack-infra | 12:52 | |
| *** ctlaugh has quit IRC | 12:52 | |
| *** Hal_ has quit IRC | 12:52 | |
| *** otter768 has joined #openstack-infra | 12:53 | |
| *** dprince has joined #openstack-infra | 12:54 | |
| *** ctlaugh has joined #openstack-infra | 12:56 | |
| *** talluri has joined #openstack-infra | 12:56 | |
| *** otter768 has quit IRC | 12:58 | |
| *** yfried_ is now known as yfried|afk | 12:58 | |
| *** ctlaugh has quit IRC | 12:58 | |
| *** david-lyle is now known as david-lyle_afk | 13:00 | |
| *** talluri has quit IRC | 13:01 | |
| *** talluri has joined #openstack-infra | 13:02 | |
| *** kgiusti has joined #openstack-infra | 13:03 | |
| *** wuhg has quit IRC | 13:03 | |
| *** yfried|afk is now known as yfried_ | 13:06 | |
| *** mwagner_lap has quit IRC | 13:10 | |
| *** ddieterly has quit IRC | 13:11 | |
| *** pblaho has joined #openstack-infra | 13:11 | |
| *** jpich has quit IRC | 13:12 | |
| *** dkranz has joined #openstack-infra | 13:13 | |
| *** garyk has joined #openstack-infra | 13:16 | |
| *** jpich has joined #openstack-infra | 13:16 | |
| garyk | AJaeger: hi, you have a sec for a quick question about https://review.openstack.org/#/c/140409/. | 13:16 |
| *** achanda has quit IRC | 13:17 | |
| AJaeger | garyk, yes | 13:17 |
| garyk | AJaeger: Do you know where I can read up on what to add to ensure that we get the file history (sorry I am really bad at this stuff) | 13:17 |
| AJaeger | It's your call what you do - I just want you to be aware of the pros and cons of importing or not | 13:17 |
| garyk | AJaeger: what you suggest i great. I would like to go down that path, just not exactly sure what to do to ensure that | 13:18 |
| AJaeger | garyk, http://docs.openstack.org/infra/manual/creators.html explain all about setting up a repo. | 13:18 |
| *** ctlaugh has joined #openstack-infra | 13:18 | |
| AJaeger | The importing is not yet good enough explained, see: | 13:18 |
| garyk | AJaeger: brilliant! thank you | 13:18 |
| AJaeger | https://review.openstack.org/#/c/138831/4/doc/source/creators.rst | 13:19 |
| garyk | AJaeger: thanks! | 13:20 |
| AJaeger | garyk, for "exporting", use git filter-branch on a copy of the neutron repo to filter out the history for only those files that are interesting for your new project | 13:20 |
| *** bswartz has quit IRC | 13:20 | |
| AJaeger | And then create from that a new repo, make it available and use the upstream directive to import it. | 13:20 |
| garyk | ok, thanks. i will check it out | 13:21 |
| AJaeger | If you have questions, come back and ask the team. I'm AFK for an hour now... | 13:21 |
| garyk | ok, thanks | 13:23 |
| *** mpaolino has joined #openstack-infra | 13:24 | |
| *** dkliban_afk is now known as dkliban | 13:26 | |
| *** andreykurilin_ has quit IRC | 13:27 | |
| *** vigneshvar has quit IRC | 13:28 | |
| *** amotoki_ has joined #openstack-infra | 13:28 | |
| *** _nadya_ has quit IRC | 13:30 | |
| *** zul has quit IRC | 13:30 | |
| fungi | omrim: i believe there are changes landed in the past 24 hours which disable those in devstack-gate/tempest while the neutron advanced services developers get separate testing going for them | 13:30 |
| *** teran has joined #openstack-infra | 13:32 | |
| *** mpaolino has quit IRC | 13:32 | |
| *** gokrokve has joined #openstack-infra | 13:32 | |
| fungi | nikil22: if you look in your zuul.conf it's probably trying to use /var/lib/zuul/ssh/id_rsa to authenticate to gerrit? | 13:33 |
| *** amuller_ has joined #openstack-infra | 13:34 | |
| *** amuller has quit IRC | 13:34 | |
| *** zul has joined #openstack-infra | 13:34 | |
| *** _nadya_ has joined #openstack-infra | 13:36 | |
| *** gokrokve has quit IRC | 13:37 | |
| *** teran_ has joined #openstack-infra | 13:37 | |
| *** weshay has joined #openstack-infra | 13:37 | |
| *** yfried_ has quit IRC | 13:39 | |
| *** teran has quit IRC | 13:40 | |
| *** Sukhdev has joined #openstack-infra | 13:41 | |
| nikil22 | fungi: yes it tries to use /var/lib/zuul/ssh/id_rsa | 13:41 |
| nikil22 | fungi: the script already copied in that location during instllation time. But the issue is zuul doesn't have permission i think | 13:42 |
| fungi | nikil22: did you copy your /var/lib/jenkins/.ssh/id_rsa to there? | 13:42 |
| nikil22 | zuul user | 13:42 |
| fungi | nikil22: which permissions? are you talking about your local filesystem permissions? | 13:42 |
| openstackgerrit | Merged openstack-dev/specs-cookiecutter: Add RSS feed https://review.openstack.org/120560 | 13:42 |
| *** garyk has quit IRC | 13:43 | |
| *** mrunge_brb has quit IRC | 13:43 | |
| nikil22 | yes local filesystem permission ; Because if i log in as different user and and use the same key with sudo then it works | 13:43 |
| *** eharney has joined #openstack-infra | 13:43 | |
| nikil22 | fungi: works means like i am able to to ssh -i key_file user-ci@review.openstack.org to get gerrit stream | 13:43 |
| fungi | nikil22: all the contents of /var/lib/zuul need to be owned by your local zuul user | 13:44 |
| *** mpaolino has joined #openstack-infra | 13:44 | |
| fungi | including the /var/lib/zuul/ssh/id_rsa file | 13:45 |
| nikil22 | fungi : ok i will take snapshoot and try now. | 13:45 |
| *** jerryz has quit IRC | 13:45 | |
| *** garyk has joined #openstack-infra | 13:48 | |
| nikil22 | fungi: will chown -R zuul:zuul /var/lib/zull works? because still i get same permission error . | 13:49 |
| *** _nadya_ has quit IRC | 13:50 | |
| *** amotoki has quit IRC | 13:51 | |
| *** amotoki_ is now known as amotoki | 13:51 | |
| *** mbacchi has joined #openstack-infra | 13:51 | |
| *** ddieterly has joined #openstack-infra | 13:51 | |
| *** MaxV has quit IRC | 13:52 | |
| *** xyang1 has quit IRC | 13:52 | |
| *** MaxV has joined #openstack-infra | 13:52 | |
| *** stevemar has joined #openstack-infra | 13:54 | |
| *** Longgeek has quit IRC | 13:54 | |
| fungi | nikil22: to help you troubleshoot this, i'll need to know the actual errors you're getting, not your interpretation of what they might mean | 13:54 |
| *** pblaho has quit IRC | 13:56 | |
| *** mwagner_lap has joined #openstack-infra | 13:56 | |
| mordred | jroll: while I'm bugging you about certs ... boot.rackspace.com has a bogus cert | 13:56 |
| mordred | jroll: http://paste.openstack.org/show/148672/ | 13:57 |
| *** jp_at_hp has quit IRC | 13:57 | |
| mordred | jroll: also, I know your job is not ACTUALLY to be our personal support contact - so feel free to tell us to go away | 13:57 |
| *** mestery has joined #openstack-infra | 13:58 | |
| *** jcoufal_ has joined #openstack-infra | 13:59 | |
| *** nfedotov has joined #openstack-infra | 13:59 | |
| *** oomichi has joined #openstack-infra | 14:00 | |
| *** sressot has quit IRC | 14:00 | |
| *** jp_at_hp has joined #openstack-infra | 14:01 | |
| *** Longgeek has joined #openstack-infra | 14:01 | |
| *** jcoufal has quit IRC | 14:01 | |
| *** sressot has joined #openstack-infra | 14:03 | |
| *** talluri has quit IRC | 14:05 | |
| *** doug-fish1 has joined #openstack-infra | 14:06 | |
| *** doug-fish has quit IRC | 14:06 | |
| *** bswartz has joined #openstack-infra | 14:07 | |
| *** luqas has joined #openstack-infra | 14:08 | |
| ttx | fungi: let me know when we can work on stable maint apocalypse | 14:08 |
| *** berendt has quit IRC | 14:08 | |
| sdague | ttx: what apocalypsed? | 14:08 |
| *** viktors has joined #openstack-infra | 14:09 | |
| *** eharney has quit IRC | 14:09 | |
| *** berendt has joined #openstack-infra | 14:09 | |
| *** berendt has quit IRC | 14:09 | |
| ttx | sdague: refactoring of openstack-stable-maint into $PROJECT-stable-maint and stable-maint-core. | 14:09 |
| sdague | oh, process appocalypse pony | 14:09 |
| ttx | http://lists.openstack.org/pipermail/openstack-dev/2014-November/050390.html | 14:09 |
| *** kaeso has joined #openstack-infra | 14:10 | |
| sdague | https://www.youtube.com/watch?v=FIY41LrvMFQ | 14:11 |
| *** rushiagr is now known as rushiagr_away | 14:11 | |
| kaeso | sorry to disturb, who should I (privately) contact for a couple of inquiries regarding openstack.org infrastructure admin/security? | 14:12 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Add debootstrap to the needed packages for dib https://review.openstack.org/124077 | 14:12 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Make apt skip grabbing translations https://review.openstack.org/136837 | 14:12 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Add rinse to nodepool https://review.openstack.org/136598 | 14:12 |
| *** koolhead17 has joined #openstack-infra | 14:14 | |
| *** julim has joined #openstack-infra | 14:14 | |
| *** esker has joined #openstack-infra | 14:15 | |
| *** obondarev has joined #openstack-infra | 14:15 | |
| *** KanagarajM has quit IRC | 14:17 | |
| *** pc_m has quit IRC | 14:19 | |
| *** annegent_ has joined #openstack-infra | 14:20 | |
| *** hashar has joined #openstack-infra | 14:21 | |
| *** berendt has joined #openstack-infra | 14:21 | |
| ttx | kaeso: fungi seems like the right guy with the right intersection of skills. Contact details at http://www.openstack.org/projects/openstack-security/ | 14:22 |
| ttx | (fungi being Jeremy Stanley in that list) | 14:22 |
| ttx | but then, any of those addresses will do. | 14:23 |
| *** amuller_ has quit IRC | 14:23 | |
| *** amuller_ has joined #openstack-infra | 14:23 | |
| *** bknudson has joined #openstack-infra | 14:23 | |
| *** mriedem has joined #openstack-infra | 14:23 | |
| *** mjturek has joined #openstack-infra | 14:23 | |
| kaeso | ttx: thanks, mail in progress :) | 14:24 |
| *** cpowell has joined #openstack-infra | 14:28 | |
| *** cpowell has quit IRC | 14:29 | |
| *** jaypipes has joined #openstack-infra | 14:29 | |
| *** cpowell has joined #openstack-infra | 14:29 | |
| nikil22 | fungi: http://paste.openstack.org/show/148693/ | 14:30 |
| nikil22 | fungi: i get this error in zuul log | 14:31 |
| *** ryanpetrello_ has joined #openstack-infra | 14:31 | |
| *** mika has quit IRC | 14:31 | |
| *** armax has joined #openstack-infra | 14:31 | |
| *** ryanpetrello has quit IRC | 14:31 | |
| *** mjturek has quit IRC | 14:31 | |
| *** ryanpetrello_ is now known as ryanpetrello | 14:31 | |
| *** mjturek has joined #openstack-infra | 14:31 | |
| *** signed8bit has joined #openstack-infra | 14:32 | |
| *** mika has joined #openstack-infra | 14:32 | |
| *** gokrokve has joined #openstack-infra | 14:32 | |
| *** signed8bit has quit IRC | 14:33 | |
| *** amitgandhinz has joined #openstack-infra | 14:33 | |
| *** signed8bit has joined #openstack-infra | 14:34 | |
| *** Masahiro has joined #openstack-infra | 14:35 | |
| fungi | kaeso: yep, e-mail me at that address, encrypted to my openpgp key if you like | 14:36 |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Add test for validating certain gerrit ACL rules https://review.openstack.org/140470 | 14:36 |
| *** gokrokve has quit IRC | 14:37 | |
| *** mestery has quit IRC | 14:38 | |
| ttx | clarkb: since you reviewed the previous patchset and had reservations on it, would appreciate a new review of https://review.openstack.org/#/c/126719/ before I approve it | 14:39 |
| *** Masahiro has quit IRC | 14:39 | |
| *** dims has joined #openstack-infra | 14:39 | |
| jroll | mordred: blah | 14:40 |
| *** amuller_ has quit IRC | 14:41 | |
| *** amuller__ has joined #openstack-infra | 14:41 | |
| mordred | jroll: :) | 14:42 |
| mordred | jroll: also, good morning | 14:42 |
| *** zz_johnthetubagu is now known as johnthetubaguy | 14:42 | |
| openstackgerrit | Merged openstack-infra/release-tools: spec2bp v2 -- support in-review specs https://review.openstack.org/108041 | 14:42 |
| *** koolhead17 has quit IRC | 14:43 | |
| fungi | nikil22: the "connection refused" you see there is at the network layer. looks like zuul is receiving a tcp/rst or icmp rejection packet of some kind attempting to reach tcp port 29418 on review.openstack.org | 14:43 |
| *** koolhead17 has joined #openstack-infra | 14:43 | |
| jroll | morning mordred :) | 14:43 |
| * jroll needs more coffee for this | 14:44 | |
| *** berendt has quit IRC | 14:44 | |
| *** radez_g0n3 is now known as radez | 14:44 | |
| *** resker has joined #openstack-infra | 14:44 | |
| fungi | nikil22: or else the paramiko library is being very opaque/misleading with its error messages | 14:45 |
| *** tonytan4ever has joined #openstack-infra | 14:45 | |
| nikil22 | fungi: may be this is due to i have used ubuntu 14.04? | 14:46 |
| nikil22 | do i need to use ubuntu 12.04 | 14:46 |
| fungi | nikil22: can you su to the zuul user on that machine and run 'ssh -i /var/lib/zuul/ssh/id_rsa -p 29418 yourusername@review.openstack.org gerrit stream-events' | 14:46 |
| nikil22 | fungi: let me check | 14:46 |
| fungi | nikil22: replacing yourusername with the gerrit username listed in your zuul.conf obviously | 14:46 |
| *** esker has quit IRC | 14:47 | |
| *** koolhead17 has quit IRC | 14:48 | |
| *** rushiagr_away is now known as rushiagr | 14:48 | |
| nikil22 | fungi: yes the events is successfull | 14:48 |
| nikil22 | as zuul user | 14:49 |
| fungi | nikil22: did it prompt you first to accept an unrecognized ssh host key? | 14:49 |
| nikil22 | let me restart the zuul service once | 14:49 |
| nikil22 | fungi: yes previously it asked | 14:49 |
| nikil22 | fungi: this time it did not ask | 14:50 |
| *** hdd has joined #openstack-infra | 14:50 | |
| fungi | oh, okay, so that wasn't it either (though usually when that's the problem it fails with a different error/exception) | 14:50 |
| *** ociuhandu has quit IRC | 14:50 | |
| *** dmsimard_away is now known as dmsimard | 14:51 | |
| nikil22 | fungi: i have restarted the service still it gives me same error. But now as a zuul user i can confirm that it can communicate to stream-events as zuul user | 14:51 |
| nikil22 | fungi: the command you gave works . | 14:52 |
| fungi | nikil22: and the [gerrit] section of your zuul.conf has server=review.openstack.org and doesn't specify a port= | 14:52 |
| *** talluri has joined #openstack-infra | 14:52 | |
| jroll | mordred: turns out boot.rackspace.com is a CNAME to a cloud files container, the ssl hostname for it is https://f97f271e9fde8f434e2a-fa73b8821af96cee574a861a54d04230.ssl.cf3.rackcdn.com | 14:52 |
| jroll | mordred: though I'm told that ipxe doesn't play nice with https | 14:52 |
| fungi | jroll: oh! that container. i'd know it on sight ;) | 14:52 |
| jroll | lol | 14:53 |
| fungi | it has a very attractive uuid | 14:53 |
| *** ociuhandu has joined #openstack-infra | 14:53 | |
| clarkb | ttx that script echos the command to run but switches source branch before you can run it. Then deletes the source branch. Is that ok for your workflow | 14:53 |
| nikil22 | fungi: yes the server=review.openstack.org and doesn't specify any port. http://paste.openstack.org/show/148715/ | 14:54 |
| fungi | jroll: anyway, that container's ssl cert ideally needs a serverAltName for any of its cnames (or a wildcard match or something) | 14:54 |
| *** pblaho has joined #openstack-infra | 14:54 | |
| mordred | jroll: well, I care little about ipxe - I was more trying to build images that contain nova-agent securely | 14:54 |
| mordred | jroll: is there another place to download nova-agent from that doesn't have an invalid cert? | 14:54 |
| ttx | clarkb: hmm, let me think about that a bit | 14:54 |
| *** otter768 has joined #openstack-infra | 14:54 | |
| *** arxcruz has quit IRC | 14:54 | |
| *** doug-fish1 has quit IRC | 14:54 | |
| * mordred grosk why boot.rackspace.com might be fine in this situation | 14:54 | |
| *** Murad has quit IRC | 14:54 | |
| *** oomichi has quit IRC | 14:55 | |
| *** doug-fish has joined #openstack-infra | 14:55 | |
| ttx | clarkb: I don't really use that script myself, so I have to try to understand how to use it. It should probably patch README anyway | 14:55 |
| jroll | mordred: ah, you can just use whatever you were doing, just s/boot.rackspace.com/f97f271e9fde8f434e2a-fa73b8821af96cee574a861a54d04230.ssl.cf3.rackcdn.com | 14:55 |
| mordred | jroll: https://review.openstack.org/#/c/137860/2/elements/nova-agent/source-repository-nova-agent and https://review.openstack.org/#/c/137860/2/elements/nova-agent/source-repository-xen-tools | 14:55 |
| mordred | jroll: can I assume that that swift container will never change? | 14:56 |
| clarkb | ttx I think it should either run git review or not delete merge-branch but not sure yet | 14:56 |
| ttx | clarkb: that echo line might be a debug leftover | 14:56 |
| jroll | mordred: never is a fun word, I would think yes in general | 14:56 |
| ttx | especially with the commented line just above | 14:56 |
| mordred | jroll: :) | 14:56 |
| mordred | jroll: thanks! | 14:56 |
| *** arxcruz has joined #openstack-infra | 14:57 | |
| ttx | clarkb: I'll -1 | 14:57 |
| clarkb | ttx ok | 14:57 |
| *** yfried_ has joined #openstack-infra | 14:57 | |
| jroll | mordred: np, enjoy | 14:57 |
| ttx | clarkb: thx! | 14:58 |
| *** otter768 has quit IRC | 14:58 | |
| *** dkranz has quit IRC | 14:59 | |
| *** obondarev has quit IRC | 15:00 | |
| annegent_ | how do I determine merge rights on any given repo? jeblair or mordred or ttx will know | 15:01 |
| jroll | mordred: btw, this would solve the problem: https://feedback.rackspace.com/forums/250746-cloud-hosting/suggestions/5977865-add-ssl-to-cloudfiles | 15:01 |
| ttx | annegent_: you can look up the Gerrit ACL | 15:01 |
| fungi | annegent_: you have to look at the acl for that project in gerrit and see what group has workflow +1 permirrion | 15:01 |
| annegent_ | ttx: is that in a repo or in Settings? | 15:01 |
| ttx | example: https://review.openstack.org/#/admin/projects/openstack/governance,access | 15:02 |
| annegent_ | fungi: "in gerrit" means in a web browser | 15:02 |
| *** resker has quit IRC | 15:02 | |
| fungi | annegent_: there are ways to determine it programmatically. i have a script | 15:02 |
| fungi | annegent_: but yes, web browser will also work | 15:02 |
| annegent_ | fungi: oh ttx's URL works | 15:02 |
| *** amuller__ has quit IRC | 15:02 | |
| annegent_ | fungi: ok and yeah I'll also need to know how to propose changes to it? | 15:02 |
| ttx | annegent_: gerrit/acls files in openstack-infra/project-config | 15:03 |
| fungi | annegent_: you need to change the group in the acl, or the members of the group? | 15:03 |
| mordred | jroll: nice | 15:03 |
| fungi | annegent_: group membership can be edited in that webui, but to change the acl itself (for example to switch it to a different group) you need a change like ttx describes | 15:04 |
| annegent_ | fungi: looks like I need to change members of the group, possibly | 15:04 |
| ttx | fungi: got my ping from earlier re: stable-maint refactoring ? | 15:04 |
| annegent_ | okay, thanks ttx and fungi! | 15:04 |
| fungi | annegent_: just click on the hyperlinked group name you see and if you're a member of the group (as it's likely self-owned) you can add/remove members | 15:05 |
| *** dims has quit IRC | 15:05 | |
| ttx | fungi: we can do it now before meeting, otherwise will have to wait until tomorrow | 15:05 |
| fungi | nikil22: i'm not seeing any obvious errors, and i see successful ssh connections from your account in the gerrit logs | 15:05 |
| *** dims has joined #openstack-infra | 15:05 | |
| *** zz_dimtruck is now known as dimtruck | 15:05 | |
| fungi | ttx: we can do it now. let me see where i missed the ping | 15:05 |
| *** amuller has joined #openstack-infra | 15:06 | |
| fungi | oh, there it is | 15:06 |
| ttx | heh | 15:06 |
| *** oomichi has joined #openstack-infra | 15:06 | |
| fungi | ttx: okay, so do you have a list of the affected projects? | 15:06 |
| *** xyang0 has joined #openstack-infra | 15:06 | |
| ttx | fungi: I think I should be able to propose the change if you give me an example (say for nova) | 15:06 |
| fungi | ttx: ahh, right-o. just a sec | 15:07 |
| *** achanda has joined #openstack-infra | 15:07 | |
| ttx | fungi: but no idea what triggers the creation of the groups themselves | 15:07 |
| ttx | and how to specify who owns them | 15:07 |
| fungi | ttx: it's automatic, but then i or someone has to seed the initial member(s) | 15:07 |
| fungi | ttx: and ownership will be a manual change i'll have to make in gerrit for them | 15:07 |
| ttx | ok, so let's do it this wey, you can give me an example, I can prepare the change to cover all projects we cover..., and then when approved you can add base members and I'll add the other ones. | 15:08 |
| fungi | ttx: if you look at the openstack/manila acl, the [access "refs/heads/stable/*"] section is what you need | 15:08 |
| fungi | ttx: but instead of manila-core it would be nova-stable or something | 15:08 |
| *** bswartz has quit IRC | 15:09 | |
| nikil22 | fungi: could you tell me that the successfull connection is keep on coming. Because the successfull connection might be the one which i tried manually | 15:09 |
| fungi | nikil22: yes, is zuul retrying to connect over and over? i'll check the log and see what the most recent connection was | 15:09 |
| ttx | fungi: openstack-stable-maint generic control over stable branches must appear somewhere too, need to switch it to stable-maint-core and inherit it | 15:09 |
| *** salv-orlando has joined #openstack-infra | 15:09 | |
| fungi | ttx: yep, i can add it as an inlcuded group in each of the project-specific groups | 15:10 |
| ttx | Ah, that would work | 15:10 |
| kaeso | fungi: oh sorry, had to go afk, can I privmsg you a sec before writing a longer mail? | 15:10 |
| *** Longgeek has quit IRC | 15:10 | |
| fungi | kaeso: sure | 15:10 |
| *** dims has quit IRC | 15:10 | |
| ttx | fungi: ok, let me try this | 15:10 |
| fungi | nikil22: last connection from ib-ipam-ci at 12.164.170.130 was 14:48:32 utc, about 23 minutes ago | 15:11 |
| ttx | fungi: any idea where openstack-stable-maint is defined for, say, nova ? It's not in the nova acl | 15:12 |
| *** Hal_ has joined #openstack-infra | 15:12 | |
| *** Hal_ has quit IRC | 15:12 | |
| ttx | fungi: or should I just overwrite it same style as in manila acl | 15:12 |
| *** dkranz has joined #openstack-infra | 15:12 | |
| ttx | I think we inherit some default from somewhere here | 15:12 |
| ttx | but can't find it | 15:12 |
| nikil22 | fungi: then i guess that was the manuall one. Because i see that zuul is keep on trying to pull and i see these errors | 15:13 |
| ttx | only designate seems to explicitely mention openstack-stable-maint. Default config somewhere ? | 15:13 |
| *** yamamoto has quit IRC | 15:13 | |
| *** esker has joined #openstack-infra | 15:13 | |
| *** oomichi has quit IRC | 15:14 | |
| *** mestery has joined #openstack-infra | 15:14 | |
| *** Longgeek has joined #openstack-infra | 15:14 | |
| clarkb | ttx in all-projects which isnot managed by puppet | 15:14 |
| *** fandi has joined #openstack-infra | 15:14 | |
| *** armax has quit IRC | 15:15 | |
| clarkb | you can see those acls in gerrit directly | 15:15 |
| ttx | clarkb: hmm. maybe simpler to make stable-maint-core part of the explicitly-declared group then, rather than rely on inheritance | 15:15 |
| ttx | will ensure transition | 15:15 |
| *** eharney has joined #openstack-infra | 15:16 | |
| ttx | ok, let me see what I can come up with. | 15:16 |
| *** lttrl has joined #openstack-infra | 15:19 | |
| *** sabeen has joined #openstack-infra | 15:20 | |
| *** salv-orlando has quit IRC | 15:20 | |
| *** rkukura_ has joined #openstack-infra | 15:21 | |
| *** fandi has quit IRC | 15:22 | |
| *** fandi has joined #openstack-infra | 15:23 | |
| fungi | ttx: sorry, too many conversations at once. openstack-stable-maint is handled in the all-projects global act inherited by every project right now. we would lift that once we get the per-project groups added with that group included in each of them | 15:23 |
| fungi | s/act/acl/ | 15:23 |
| fungi | oh, clarkb answered anyway | 15:23 |
| *** r-daneel has joined #openstack-infra | 15:24 | |
| *** dustins has joined #openstack-infra | 15:24 | |
| *** rkukura has quit IRC | 15:24 | |
| *** rkukura_ is now known as rkukura | 15:24 | |
| *** vdo has joined #openstack-infra | 15:25 | |
| derekh | If anybody has a chance could I get some eyes on adding hp1 back running tripleo ci - https://review.openstack.org/#/c/126513/ | 15:25 |
| *** _nadya_ has joined #openstack-infra | 15:25 | |
| *** _nadya_ has quit IRC | 15:26 | |
| *** talluri has quit IRC | 15:26 | |
| *** emagana has joined #openstack-infra | 15:26 | |
| *** mrmartin has quit IRC | 15:27 | |
| *** _nadya_ has joined #openstack-infra | 15:27 | |
| *** patrickeast has joined #openstack-infra | 15:28 | |
| fungi | nikil22: yeah, so something is blocking those egress connections presumably (or is your zuul maybe using a different zuul.conf than the one you think it is?) | 15:28 |
| fungi | derekh: i don't think we explicitly removed it, but i'll check | 15:28 |
| *** zz_jgrimm is now known as jgrimm | 15:29 | |
| derekh | fungi: thanks, we set the max-servers: at 0 so it wasn't being used, this increases to 90 | 15:30 |
| *** obondarev has joined #openstack-infra | 15:30 | |
| *** gokrokve has joined #openstack-infra | 15:30 | |
| *** esker has quit IRC | 15:30 | |
| *** pc_m has joined #openstack-infra | 15:30 | |
| derekh | fungi: note this is a new cloud | 15:30 |
| fungi | derekh: max-servers isn't 0 it's 60 at the moment, but yes we seem to have removed it from the labels | 15:31 |
| SergeyLukjanov | good morning folks | 15:31 |
| *** esker has joined #openstack-infra | 15:31 | |
| fungi | derekh: aha, in hp1 | 15:31 |
| SergeyLukjanov | fungi, I just saw that switch to the self-controlled groups for 3rd party ci has not been applied to all projects, for example it's not applied for sahara :) | 15:32 |
| *** teran_ has quit IRC | 15:32 | |
| fungi | derekh: sorry, i misread and thought you said rh1 | 15:32 |
| fungi | moar coffee | 15:32 |
| SergeyLukjanov | fungi, should I try to re-run jjb on gerrit? | 15:32 |
| derekh | fungi: no prob | 15:32 |
| *** arxcruz has quit IRC | 15:33 | |
| garyk | dhellmann: hi, any chance you can please look at https://review.openstack.org/136614? | 15:33 |
| fungi | SergeyLukjanov: i think clarkb queried gerrit to find which ci accounts were leaving verify votes and only added groups for those which had accounts voting on them | 15:33 |
| clarkb | SergeyLukjanov: it should be applied to sahara | 15:33 |
| SergeyLukjanov | fungi, clarkb, oh, I think I've used bad wording | 15:33 |
| dhellmann | garyk: +2a | 15:33 |
| SergeyLukjanov | fungi, clarkb, in https://github.com/openstack-infra/project-config/blob/master/gerrit/acls/openstack/sahara.config there is a rule "label-Verified = -1..+1 group sahara-ci" | 15:33 |
| nikil22 | fungi: i am sure my iptables is not blocking any ports. Let me debug more and confirm that zuul uses proper conf file | 15:34 |
| clarkb | oh right sahara didn't have anything vote on it | 15:34 |
| garyk | dhellmann: thanks! | 15:34 |
| clarkb | SergeyLukjanov: oh I see now | 15:34 |
| SergeyLukjanov | fungi, clarkb, but there is no corresponding permission in gerrit - https://review.openstack.org/#/admin/projects/openstack/sahara,access | 15:34 |
| *** julim has quit IRC | 15:34 | |
| *** marcusvrn1 has joined #openstack-infra | 15:34 | |
| *** marcusvrn has quit IRC | 15:34 | |
| fungi | acl didn't get applied? or is that a stale acl file and sahara uses a different one overridden in projects.yaml? | 15:34 |
| SergeyLukjanov | clarkb, looks like ACL file is just not applied | 15:34 |
| SergeyLukjanov | fungi, yeah | 15:35 |
| clarkb | ya so I think you want to run `manage-projects -d openstack/sahara` | 15:35 |
| *** rkukura has quit IRC | 15:35 | |
| *** hdd has quit IRC | 15:35 | |
| SergeyLukjanov | clarkb, on gerrit node? | 15:35 |
| openstackgerrit | Thierry Carrez proposed openstack-infra/project-config: Introduce project-specific stable-maint teams https://review.openstack.org/140738 | 15:35 |
| ttx | fungi: ^ | 15:35 |
| sdague | clarkb: how much have you played with the fixtures.MonkeyPatch? | 15:35 |
| *** Sukhdev has quit IRC | 15:35 | |
| SergeyLukjanov | ttx, yay! | 15:35 |
| clarkb | SergeyLukjanov: yup, if you look in roots histor you should see similar commands | 15:35 |
| clarkb | sdague: I think so | 15:36 |
| *** julim has joined #openstack-infra | 15:36 | |
| SergeyLukjanov | clarkb, thank you, will try | 15:36 |
| sdague | because I found a case where it didn't seem to work at all like it was expected | 15:36 |
| fungi | clarkb: SergeyLukjanov: yep, that does appear to be the correct acl file, so something must still be racy on m-p group creation sometimes? | 15:36 |
| *** arxcruz has joined #openstack-infra | 15:36 | |
| ttx | SergeyLukjanov: Note that I aligned sahara, even if technically you own stable/icehouse. | 15:36 |
| clarkb | sdague: oh? | 15:36 |
| ttx | SergeyLukjanov: we'll make sure sahara-stable-maint contains the right people for you to be able to continue doing that | 15:36 |
| fungi | ttx: you're going to need the exlcusive line in those | 15:37 |
| clarkb | sdague: it basically monkey patches a name until the cleanup runs so you get sane monkey patching per test case | 15:37 |
| *** wenlock has joined #openstack-infra | 15:37 | |
| SergeyLukjanov | ttx, I think it'll be the same list as for juno, so, it's ok, thank you | 15:37 |
| sdague | yeh except, it does it through some magical imports, which might fail | 15:37 |
| ttx | fungi: why ? It's not on the proposed/* ACL | 15:37 |
| sdague | that it masks the failures | 15:37 |
| clarkb | sdague: is it importing to make sure that both things (dest and patch) are available? | 15:37 |
| *** obondarev has quit IRC | 15:37 | |
| sdague | maybe if I show you my example, you can help me figure out why it doesn't work | 15:38 |
| clarkb | sdague: sure | 15:38 |
| fungi | ttx: without that, it's still overridden from all-projects | 15:38 |
| fungi | ttx: also, when we remove the entry from all-projects, it will be necessary to prevent inheritence from higher-level ref matches | 15:39 |
| *** obondarev has joined #openstack-infra | 15:39 | |
| ttx | fungi: hmm, if the net effect is just that openstack-stable-maint still ahs rights during the transition, that sounds like a feature to me. Or is there more ? | 15:39 |
| *** marcusvrn1 has quit IRC | 15:39 | |
| ttx | oh, hm | 15:39 |
| *** marcusvrn has joined #openstack-infra | 15:39 | |
| fungi | ttx: the way gerrit's acls work by default is that permissions on refs/heads/* are cumulative with those on refs/heads/stable/* | 15:40 |
| SergeyLukjanov | clarkb, "invalid project configuration" | 15:40 |
| fungi | ttx: exclusiveGroupPermissions is the way around inheriting | 15:40 |
| *** marcusvrn1 has joined #openstack-infra | 15:41 | |
| ttx | ok, that means we'll have to populate groups soon afetr we push the change | 15:41 |
| clarkb | SergeyLukjanov: is there more log involved? would be good to see where that happens | 15:41 |
| * ttx adds exclusivity lines | 15:41 | |
| SergeyLukjanov | clarkb, it's on the push to config stage | 15:41 |
| fungi | ttx: yep, i plan to do it immediately after that's merged and applied via manage-projects | 15:41 |
| SergeyLukjanov | clarkb, " ! [remote rejected] HEAD -> refs/meta/config (invalid project configuration) | 15:42 |
| clarkb | sdague: http://bazaar.launchpad.net/~testing-cabal/python-fixtures/master/view/head:/fixtures/_fixtures/monkeypatch.py#L45 looking at the source that is what it appeas to be trying to do. It is making sure the thing to be monkey patched is already imported | 15:42 |
| *** marcusvrn has quit IRC | 15:42 | |
| clarkb | SergeyLukjanov: huh, there must be something wrong with the file then which is odd because saharaclient was fine | 15:43 |
| SergeyLukjanov | clarkb, saharaclient uses another ACL file | 15:43 |
| SergeyLukjanov | clarkb, I need to go to the PTL Webinar, will digg into it after the webinar | 15:43 |
| *** achanda has quit IRC | 15:44 | |
| clarkb | SergeyLukjanov: oh that may explain it then | 15:44 |
| *** marcusvrn has joined #openstack-infra | 15:44 | |
| clarkb | ya I will look quickly to see if I see anything | 15:44 |
| *** xyang0 has quit IRC | 15:44 | |
| SergeyLukjanov | clarkb, thx | 15:44 |
| *** teran has joined #openstack-infra | 15:45 | |
| *** teran has quit IRC | 15:45 | |
| *** dmsimard is now known as dmsimard_away | 15:45 | |
| *** teran has joined #openstack-infra | 15:45 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/project-config: Introduce project-specific stable-maint teams https://review.openstack.org/140738 | 15:45 |
| *** marcusvrn1 has quit IRC | 15:45 | |
| clarkb | looks like it would've broken way back in august | 15:45 |
| clarkb | or at least that was the last time we successfully updated it | 15:45 |
| ttx | fungi: ^should be better | 15:45 |
| *** marun has joined #openstack-infra | 15:46 | |
| fungi | ttx: thanks--looking now | 15:46 |
| fungi | derekh: i'll check your nodepool change after this | 15:46 |
| derekh | fungi: cool, thanks | 15:47 |
| *** dmsimard_away is now known as dmsimard | 15:48 | |
| *** _buzz_ has joined #openstack-infra | 15:48 | |
| *** obondarev has quit IRC | 15:48 | |
| *** marcusvrn has quit IRC | 15:49 | |
| sdague | clarkb: so - https://review.openstack.org/#/c/140741/ | 15:49 |
| sdague | that doesn't do what you think it's going to do | 15:50 |
| *** craigbr has joined #openstack-infra | 15:50 | |
| *** _buzz has quit IRC | 15:51 | |
| clarkb | sdague: it should attempt to import that thing, fail, then import oslo.messaging if I read this correctly | 15:52 |
| clarkb | sdague: I think you just need to import the thing you want first? | 15:52 |
| fungi | ttx: change lgtm, but what's the group configuration plan look like? we make openstack-stable-maint (optionally renamed) an included group in each of those and set the group owner to openstack-stable-maint as well? and let someone in openstack-stable-maint add per-project members as appropriate? | 15:52 |
| sdague | clarkb: so... I have tried many invocations of this with various imports | 15:52 |
| clarkb | sdague: ya I think that if you just import oslo.messaging._drivers.impl_fake | 15:52 |
| fungi | ttx: or will the groups be self-owned so that per-project stable teams can add/remove members themselves? | 15:53 |
| clarkb | then that will be imported so it can get monke patched | 15:53 |
| fungi | ttx: oh, you outlined it in the commit message | 15:53 |
| fungi | ttx: nevermind. works for me | 15:53 |
| clarkb | sdague: the problem here is monkeypatch says "I will try to import this thing for you but not scream if I can't because maybe you gave me a class method" which you did | 15:53 |
| clarkb | trying to think if monkey patch could scream about issues a bit better though | 15:54 |
| fungi | ttx: if clarkb or another project-config core wants to give it a once-over, then i can make the group edits as soon as it's applied | 15:54 |
| ttx | fungi: yes, we create a new group | 15:54 |
| sdague | clarkb: so ... no one using this fixture understands that subtlety | 15:54 |
| sdague | well maybe not no one | 15:54 |
| clarkb | sdague: its how monkey patching works | 15:54 |
| sdague | but in my look on how it's used in the tree, I'm pretty sure lots of people are getting this wrong | 15:54 |
| clarkb | sdague: if the name isn't available then you monkey patch nothing | 15:54 |
| *** salv-orlando has joined #openstack-infra | 15:55 | |
| sdague | under the assumption that the fixture did the right thing | 15:55 |
| clarkb | this is true regardless of fixture or other tool | 15:55 |
| fungi | ttx: is the new stable-maint-core group a renamed openstack-stable-maint with the original members, or a separate/smaller group entirely? | 15:55 |
| clarkb | python lets you say x = y | 15:55 |
| *** achanda has joined #openstack-infra | 15:55 | |
| ttx | fungi: you can add me as initial member/owner of stable-maint-core, then stable-maint-core as initial member/owner of $PROJECT-stable-maint groups | 15:55 |
| clarkb | that is how python works | 15:55 |
| sdague | clarkb: yep | 15:55 |
| fungi | ttx: okay, can do | 15:55 |
| ttx | fungi: smaller group / new group. Not the same role, much smaller group | 15:55 |
| ttx | the idea is to have that "core" group the guardians of the policy | 15:56 |
| fungi | ttx: but also include the old openstack-stable-maint in all of the per-project stable groups? | 15:56 |
| *** garyk has quit IRC | 15:56 | |
| ttx | fungi: no, we'll delete that one. | 15:56 |
| ttx | ah.. for transition, I guess | 15:56 |
| *** bswartz has joined #openstack-infra | 15:56 | |
| ttx | you can initially add it, I can remove it when i'm done editing the group | 15:56 |
| fungi | ttx: okay, stable-maint-core can of course remove it as an included group at your discretion | 15:56 |
| clarkb | sdague: this is similar to how oslo.config breaks unittests because no one understands you have to import the thing that defines a config value before it is available to you | 15:56 |
| ttx | that way it shouldn't break waiting for me to edit group | 15:57 |
| fungi | ttx: also i can set stable-maint-core as the owner of openstack-stable-maint if desired | 15:57 |
| clarkb | sdague: if you try to use that thing before you have imported it sadness happens | 15:57 |
| sdague | clarkb: sure | 15:57 |
| ttx | fungi: works for me | 15:57 |
| *** btran has quit IRC | 15:57 | |
| sdague | except the fixture half heartidly works some times | 15:57 |
| fungi | ttx: right now it seems to be owned by the release managers group | 15:57 |
| sdague | because if the thing is a top level function in a namespace, it manages the import | 15:58 |
| *** armax has joined #openstack-infra | 15:58 | |
| fungi | ttx: do you then want release managers as the owner of stable-maint-core or make stable-maint-core self-owned? | 15:58 |
| clarkb | right just like oslo.config half heartidly works some times... | 15:58 |
| ttx | fungi: self-owned with me as initial member | 15:58 |
| clarkb | both could do a better job at making it known when stuff is not imported | 15:58 |
| *** belmoreira has quit IRC | 15:58 | |
| fungi | ttx: got it | 15:58 |
| *** wznoinsk has quit IRC | 15:58 | |
| sdague | clarkb: yeh | 16:00 |
| *** wznoinsk has joined #openstack-infra | 16:00 | |
| *** hashar has quit IRC | 16:01 | |
| *** Sukhdev has joined #openstack-infra | 16:01 | |
| *** hashar has joined #openstack-infra | 16:01 | |
| fungi | ttx: okay, the stable-maint-core group is set up self-owned with you as initial member and switched to be the owner of the openstack-stable-maint group. i'll make the per-project stable-maint groups owned by stable-maint-core with openstack-stable-maint as an included group as soon as 140738 lands | 16:01 |
| clarkb | fungi: ttx: the change looks good though the centos6 apply job failed due to haproxy not applying cleanly for some reason. I don't think that is related to this change | 16:02 |
| *** achanda has quit IRC | 16:02 | |
| ttx | ack | 16:02 |
| clarkb | looks like puppet concat had a sad | 16:02 |
| *** mfink has joined #openstack-infra | 16:02 | |
| *** hashar has quit IRC | 16:02 | |
| clarkb | I am going to recheck to see if this is consistent | 16:02 |
| fungi | ttx: after that, i'll remove the old refs/heads/stable/* sections from the all-projects acl and look for other acls which can be cleaned up now that they'll no longer need to override it | 16:02 |
| ttx | fungi: sounds like a plan | 16:03 |
| *** hashar has joined #openstack-infra | 16:03 | |
| * dhellmann wishes sdague and clarkb would file bugs instead of trash-talking other contributors in this channel | 16:03 | |
| *** emagana_ has joined #openstack-infra | 16:04 | |
| * dhellmann walks away for a while | 16:04 | |
| clarkb | dhellmann: I tried | 16:05 |
| clarkb | dhellmann: was explicitly told by markmc ~1.5 years ago that this was a design feature/expected/wontfix | 16:05 |
| *** asselin has joined #openstack-infra | 16:06 | |
| *** wenlock has quit IRC | 16:06 | |
| clarkb | dhellmann: and to a degree it is. This is how python works. Unfortunately it is a thing that also trips people up constantly | 16:06 |
| *** hashar has quit IRC | 16:06 | |
| mordred | sdague, clarkb: is fixtures not moved to git yet? | 16:07 |
| clarkb | mordred: not that I could see | 16:07 |
| mordred | https://github.com/testing-cabal/fixtures | 16:07 |
| *** emagana has quit IRC | 16:08 | |
| sdague | mordred: yes it is | 16:09 |
| mordred | seems like it it should be possible to fix the import logic there to make sure it always manages the import | 16:09 |
| sdague | I'm trying to develop a test case right now | 16:09 |
| clarkb | pypi still says launchpad which is where I got link to above code | 16:09 |
| sdague | clarkb: yeh, they moved it to github | 16:09 |
| *** jpich has quit IRC | 16:09 | |
| sdague | I put over a PR as soon as it landed to fix a log fixture | 16:09 |
| *** dtantsur is now known as dtantsur|brb | 16:10 | |
| sdague | mordred: yeh, mostly I needed to understand what it was or was not doing correctly, hence poking clarkb | 16:10 |
| *** jistr has quit IRC | 16:10 | |
| *** kmartin has joined #openstack-infra | 16:11 | |
| clarkb | I think I would prefer it to throw an exception if the thing being monkey patched is not imported | 16:11 |
| clarkb | then you don't have to rely on it to always import properly, it pushes that off on you to do what you need | 16:11 |
| sdague | clarkb: yeh, possibly | 16:12 |
| sdague | I think this gets into the crazy logic that hacking has over finding symbols | 16:12 |
| *** dangers_away is now known as dangers | 16:12 | |
| openstackgerrit | Ivan Udovichenko proposed openstack-infra/system-config: Remove hardcoded variables from openstack_project module (template) https://review.openstack.org/140758 | 16:12 |
| sdague | I actually just deleted a nova specific setup function that did exactly this... poorly | 16:13 |
| *** achanda_ has joined #openstack-infra | 16:13 | |
| *** jkraj has quit IRC | 16:13 | |
| sdague | and turned out to not be working when it was used | 16:13 |
| clarkb | but it should be relatively simple to say "does this name exist" | 16:13 |
| clarkb | and throw an error if not | 16:13 |
| *** shashankhegde has joined #openstack-infra | 16:13 | |
| mordred | ++ to throwing error | 16:14 |
| *** yamamoto has joined #openstack-infra | 16:14 | |
| *** skolekonov has quit IRC | 16:17 | |
| *** e0ne_ has joined #openstack-infra | 16:18 | |
| *** rlandy has quit IRC | 16:18 | |
| *** yamamoto has quit IRC | 16:19 | |
| *** spzala has joined #openstack-infra | 16:19 | |
| *** e0ne has quit IRC | 16:19 | |
| sdague | yeh well the test case will be mostly the same either way | 16:19 |
| sdague | hmmm... running tests in fixtures repo.... | 16:19 |
| sdague | oh, it's got a makefile. I can get behind that | 16:21 |
| *** dannywilson has joined #openstack-infra | 16:23 | |
| *** gokrokve has quit IRC | 16:23 | |
| *** _buzz_ has quit IRC | 16:23 | |
| *** dannywilson has quit IRC | 16:23 | |
| *** dannywilson has joined #openstack-infra | 16:23 | |
| *** Masahiro has joined #openstack-infra | 16:24 | |
| sdague | hmph | 16:24 |
| sdague | so the test class that should fail, isn't | 16:24 |
| *** shashankhegde has quit IRC | 16:25 | |
| *** resker has joined #openstack-infra | 16:25 | |
| *** resker has quit IRC | 16:26 | |
| sdague | clarkb: so - https://github.com/sdague/fixtures/commit/eeac75e6c414be75dc2bd875e62af8ec2937c971 should fail in the same way, right? | 16:26 |
| *** resker has joined #openstack-infra | 16:27 | |
| *** ryanpetrello has quit IRC | 16:27 | |
| *** erikmwilson has quit IRC | 16:28 | |
| *** ryanpetrello has joined #openstack-infra | 16:28 | |
| *** Masahiro has quit IRC | 16:28 | |
| *** erikmwilson has joined #openstack-infra | 16:28 | |
| *** mpaolino has quit IRC | 16:28 | |
| *** obondarev has joined #openstack-infra | 16:29 | |
| *** esker has quit IRC | 16:29 | |
| *** annegent_ has quit IRC | 16:29 | |
| *** mikedillion has joined #openstack-infra | 16:29 | |
| *** e0ne_ is now known as e0ne | 16:30 | |
| *** gokrokve has joined #openstack-infra | 16:30 | |
| *** dims has joined #openstack-infra | 16:32 | |
| *** erikmwilson is now known as Guest30554 | 16:34 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config: Check requirements for taskflow https://review.openstack.org/140764 | 16:34 |
| clarkb | sdague: maybe the test suite imports all that stuff implicitly? but yes at first glance I would expect that to fail too | 16:35 |
| *** yaguang has joined #openstack-infra | 16:35 | |
| *** erikmwilson has joined #openstack-infra | 16:36 | |
| *** dims has quit IRC | 16:36 | |
| *** dims has joined #openstack-infra | 16:36 | |
| sdague | testtools.run is all it's doing | 16:37 |
| *** adalbas has quit IRC | 16:38 | |
| dims | sdague: this one helps with running project-requirements-change.py locally esp with project that have not signed upto be in global req sync. can you please take a look when you get a chance? https://review.openstack.org/#/c/138710/ | 16:38 |
| sdague | dims: I'm not sure I understand the --local really there? | 16:39 |
| sdague | clarkb: yep, you are right | 16:41 |
| sdague | the way load tests work it invalidates things | 16:41 |
| *** vigneshvar has joined #openstack-infra | 16:41 | |
| *** erikmwilson is now known as Guest25434 | 16:42 | |
| *** [BNC]erikmwilson has joined #openstack-infra | 16:42 | |
| *** ihrachyshka_ has quit IRC | 16:44 | |
| *** mikedillion has quit IRC | 16:44 | |
| *** julim has quit IRC | 16:45 | |
| *** shakamunyi has quit IRC | 16:45 | |
| *** simonmcc has quit IRC | 16:45 | |
| *** jlibosva has quit IRC | 16:46 | |
| *** ctracey has quit IRC | 16:46 | |
| *** markus_z has quit IRC | 16:46 | |
| *** zhiyan has quit IRC | 16:46 | |
| dims | sdague: the current code looks at the last changeset, i want it to run against the full requirements.txt file | 16:46 |
| *** serverascode___ has quit IRC | 16:47 | |
| *** ameade_ has quit IRC | 16:47 | |
| *** jraim has quit IRC | 16:48 | |
| sdague | dims: oh, gotcha | 16:49 |
| sdague | clarkb: https://github.com/testing-cabal/fixtures/pull/3 - so that's a test case which does fail | 16:49 |
| *** julim has joined #openstack-infra | 16:50 | |
| *** nikil22 has quit IRC | 16:51 | |
| *** armax has quit IRC | 16:52 | |
| *** zz_sabari is now known as sabari | 16:53 | |
| openstackgerrit | Merged openstack/requirements: Upgrade oslo.vmware>=0.7.0 https://review.openstack.org/136614 | 16:53 |
| *** otter768 has joined #openstack-infra | 16:55 | |
| *** yaguang has quit IRC | 16:56 | |
| *** emagana_ has quit IRC | 16:56 | |
| *** mpaolino has joined #openstack-infra | 16:57 | |
| *** arxcruz has quit IRC | 16:58 | |
| *** achanda_ has quit IRC | 16:58 | |
| *** amuller has quit IRC | 17:00 | |
| *** otter768 has quit IRC | 17:00 | |
| *** viktors is now known as viktors|afk | 17:00 | |
| *** amotoki has quit IRC | 17:02 | |
| *** achanda has joined #openstack-infra | 17:02 | |
| *** garyk has joined #openstack-infra | 17:02 | |
| *** julim has quit IRC | 17:03 | |
| *** doug-fish has quit IRC | 17:03 | |
| *** armax has joined #openstack-infra | 17:03 | |
| *** armax has quit IRC | 17:03 | |
| *** david-lyle_afk is now known as david-lyle | 17:06 | |
| *** julim has joined #openstack-infra | 17:06 | |
| *** asselin has quit IRC | 17:07 | |
| *** mpaolino has quit IRC | 17:08 | |
| *** emagana has joined #openstack-infra | 17:08 | |
| *** dmsimard is now known as dmsimard_away | 17:09 | |
| openstackgerrit | Dmitry Teselkin proposed openstack-infra/zuul: Whitelist for gerrit events https://review.openstack.org/137634 | 17:10 |
| clarkb | sc68cal: mtreinish: wanted to catch up on ipv6. Is that tempest test counting IPs the only issue so far? (want to make sure I haven't just asked you guys to fix half a million bugs to get that d-g change in) | 17:10 |
| *** shayneburgess has quit IRC | 17:11 | |
| sc68cal | clarkb: it's the first issue to crop up | 17:11 |
| sc68cal | clarkb: no guarantee it won't be the last | 17:11 |
| mtreinish | sc68cal: I think some of the scenario tests exploded too | 17:11 |
| clarkb | sc68cal: there is a way to run d-g with a specific tempest patch. Let me dig that up so that we can rerun the tests with your fix prior to it merging | 17:11 |
| *** e0ne has quit IRC | 17:12 | |
| *** k4n0 has quit IRC | 17:12 | |
| *** berendt has joined #openstack-infra | 17:12 | |
| jeblair | clarkb, fungi: i think we should try trusty nodepool again | 17:13 |
| jeblair | shall we do that now? | 17:13 |
| *** mmaglana has joined #openstack-infra | 17:13 | |
| clarkb | jeblair: you will find no disagreement from me | 17:13 |
| clarkb | jeblair: can you give me a few minutes to get caffeine and breakfast? | 17:14 |
| jeblair | yep | 17:14 |
| fungi | jeblair: i'm in favor | 17:14 |
| fungi | derekh: i think we should hold off adding that other tripleo region until we have worked out whether our nodepool migration is going to stick this time | 17:15 |
| *** koolhead17 has joined #openstack-infra | 17:15 | |
| jeblair | we may find that the world has changed around nodepool and we need to adapt. if so, i think clarb's change to gear may help (just because we have fewer cycles available to us), though it's not a long-term solution to the fundamental problem | 17:15 |
| jeblair | i do have some ideas about how we could be a bit more robust without drastic changes; i'll write up a spec while we're working on this in case we need it | 17:16 |
| derekh | fungi: ok, any idea who long that will be? don't want to pop in asking about it prematurely. | 17:17 |
| fungi | derekh: probably a couple hours | 17:17 |
| clarkb | gah I am out of yogurt. But I have caffeine so lets do this | 17:18 |
| derekh | ok cool, I'll probably be gone by then but will check later to see if its merged and watch to make sure its going ok | 17:18 |
| clarkb | the images from last time should be new enough so we don't need to rebuild images on nodepool-dev again | 17:19 |
| *** nfedotov has quit IRC | 17:21 | |
| sweston | jyuso: you're welcome :-). You should thank anteaya as well, she organized the meeting this week. We never would have converged on a solution without her. | 17:21 |
| clarkb | jeblair: any other prep type items we might have to do based on your debugging? | 17:22 |
| *** mmaglana has quit IRC | 17:22 | |
| clarkb | jeblair: you already rebuilt pycrypto? | 17:22 |
| jeblair | clarkb: yep, should be gtg | 17:22 |
| *** mmaglana has joined #openstack-infra | 17:22 | |
| *** ZZelle is now known as zzelle_ | 17:23 | |
| *** zzelle_ is now known as ZZelle_ | 17:23 | |
| fungi | want me to stop nodepoold on precise and start deleting ready/building nodes? | 17:23 |
| clarkb | so stop old nodepool, delete ready/building, start new nodepool | 17:23 |
| clarkb | then delete remainder on old nodepool | 17:23 |
| *** salv-orlando has quit IRC | 17:23 | |
| *** emagana_ has joined #openstack-infra | 17:23 | |
| *** johnthetubaguy is now known as zz_johnthetubagu | 17:23 | |
| clarkb | fungi: I am ready when you are | 17:23 |
| fungi | doing | 17:24 |
| *** salv-orlando has joined #openstack-infra | 17:24 | |
| fungi | ~300 building+ready nodes deleting now | 17:26 |
| *** salv-orlando has quit IRC | 17:26 | |
| *** jaypipes has quit IRC | 17:26 | |
| *** emagana has quit IRC | 17:27 | |
| openstackgerrit | Merged openstack/requirements: Bump the minimum required version of retrying https://review.openstack.org/140074 | 17:27 |
| openstackgerrit | Merged openstack/requirements: Update xstatic-font-awesome to 4.2.0 https://review.openstack.org/139207 | 17:27 |
| openstackgerrit | Merged openstack/requirements: Add nova-docker to tracked project list https://review.openstack.org/122221 | 17:27 |
| *** dtantsur|brb is now known as dtantsur | 17:27 | |
| *** koolhead17 has quit IRC | 17:28 | |
| clarkb | sc68cal: https://review.openstack.org/#/c/131604/9/functions.sh the new block of code on line 317 there shows how you can test a specific tempest change within d-g | 17:29 |
| *** armax has joined #openstack-infra | 17:29 | |
| * tchaypo continues song+dance routine extolling the virtues of the most wonderful and marvellously exciting https://review.openstack.org/#/c/136811/ | 17:29 | |
| clarkb | sc68cal: changes to d-g like that should never be merged but the can help you ensure that the number of bugs is falling | 17:29 |
| *** sabari is now known as zz_sabari | 17:30 | |
| clarkb | tchaypo: ok :P | 17:31 |
| sc68cal | clarkb: thanks | 17:32 |
| * tchaypo cheers | 17:32 | |
| tchaypo | thank you :) | 17:32 |
| tchaypo | now of course it’ll turn out to break everything, I’ll be sad, but you’ll be the person who approved it... | 17:32 |
| clarkb | sc68cal: and if I am way off base on how much of this should just work we can go back to thinking about the experimental job | 17:33 |
| clarkb | sc68cal: which is why I dind't want to abandon thechange to add the new job just yet | 17:33 |
| clarkb | tchaypo: yes that is how things go around here | 17:33 |
| *** asselin has joined #openstack-infra | 17:33 | |
| clarkb | tchaypo: we can fix it together when that happens :P | 17:34 |
| fungi | every morning when i wake up, i put on my flame-retardant pants | 17:34 |
| fungi | we're down to ~150 ready/building nodes on precise nodepool now | 17:35 |
| *** salv-orlando has joined #openstack-infra | 17:35 | |
| *** vdo has quit IRC | 17:36 | |
| *** garyk has quit IRC | 17:36 | |
| *** avozza is now known as zz_avozza | 17:36 | |
| *** ihrachyshka has joined #openstack-infra | 17:38 | |
| zaro | morning | 17:39 |
| *** gokrokve has quit IRC | 17:40 | |
| *** jraim has joined #openstack-infra | 17:41 | |
| *** ihrachyshka has quit IRC | 17:42 | |
| *** armax has quit IRC | 17:42 | |
| clarkb | good morning | 17:44 |
| clarkb | fungi: we must be getting close to ready to start nodepool? | 17:45 |
| openstackgerrit | Khai Do proposed openstack-infra/system-config: make gerrit commentlink case insensitive for bug and story https://review.openstack.org/140439 | 17:45 |
| *** tonytan4ever has quit IRC | 17:46 | |
| fungi | down to 30 remaining | 17:46 |
| *** gyee has joined #openstack-infra | 17:46 | |
| fungi | so nearly there | 17:46 |
| *** annegent_ has joined #openstack-infra | 17:47 | |
| fungi | 20 | 17:47 |
| *** KurtMartin has joined #openstack-infra | 17:47 | |
| *** _nadya_ has quit IRC | 17:47 | |
| anteaya | do you make crinkle noises when you walk? | 17:48 |
| fungi | it's now down to 0. i'll start deleting all other nodes if you want to start nodepoold on nodepool-dev | 17:48 |
| * anteaya reviews ttx's patch | 17:48 | |
| clarkb | ok I am starting new nodepool now | 17:48 |
| *** amotoki has joined #openstack-infra | 17:49 | |
| clarkb | it is doing things | 17:49 |
| fungi | remaining 550 nodes on precise nodepool are deleting now | 17:49 |
| clarkb | I really like doing this when we don't have to restart zuul | 17:50 |
| clarkb | so much easier :) | 17:50 |
| *** amotoki_ has joined #openstack-infra | 17:50 | |
| fungi | indeed | 17:50 |
| clarkb | fungi: hold on | 17:50 |
| *** stevemar has quit IRC | 17:50 | |
| clarkb | fungi: don't delete used quite yet | 17:50 |
| clarkb | since those jobs may still be running | 17:50 |
| fungi | yeah, realized that and didn't do it | 17:50 |
| fungi | waiting one hour first ;) | 17:50 |
| *** kmartin has quit IRC | 17:51 | |
| clarkb | though 550 seems a bit high | 17:51 |
| fungi | we were maxxed out on capacity when we started | 17:51 |
| clarkb | I guess we are currently running quite a bit of jobs | 17:51 |
| clarkb | ya | 17:51 |
| jeblair | if we wannted to be really clever, we could copy the database between the servers | 17:51 |
| *** gokrokve has joined #openstack-infra | 17:51 | |
| fungi | nodepool-ha! | 17:51 |
| *** doude has quit IRC | 17:51 | |
| *** armax has joined #openstack-infra | 17:52 | |
| clarkb | jeblair: ya I thought about that. Ithink we haveto do it after deleting building nodes though | 17:52 |
| clarkb | otherwise we have to copy the ssh keys and other non DB state | 17:52 |
| clarkb | still doable though | 17:52 |
| *** shakamunyi has joined #openstack-infra | 17:52 | |
| fungi | stick the db in trove and connect nodepoold to it, but only run one at a time? | 17:52 |
| ryanpetrello | anybody have any idea why the `gate-pecan-tox-ceilometer-tip` is stuck in queued and doesn't show up in https://jenkins06.openstack.org/job/gate-pecan-python33/52/ ? | 17:53 |
| jeblair | ya | 17:53 |
| *** dizquierdo has quit IRC | 17:53 | |
| ryanpetrello | looks like pecan reviews are wedged due to this, wondering if something changed related to nodes running ceilometer | 17:53 |
| *** andreykurilin_ has joined #openstack-infra | 17:53 | |
| *** simonmcc has joined #openstack-infra | 17:53 | |
| *** amotoki_ has quit IRC | 17:54 | |
| *** amotoki has quit IRC | 17:54 | |
| anteaya | ttx so ironic, tripleo, zaqar, manila, designate, barbican are not part of the <project>-stable-maint grouping? | 17:54 |
| fungi | ryanpetrello: why would gate-pecan-tox-ceilometer-tip show up in https://jenkins06.openstack.org/job/gate-pecan-python33/52/ | 17:54 |
| clarkb | ryanpetrello: we are changing the nodepool node that boots the test slaves | 17:54 |
| clarkb | fungi: gearman updates the jenkins job summary with other jobs that ran | 17:54 |
| fungi | clarkb: oh... | 17:54 |
| ryanpetrello | fungi, sorry, I meant the "All builds for this change set:" | 17:54 |
| ryanpetrello | right | 17:54 |
| *** [HeOS] has quit IRC | 17:55 | |
| fungi | right, that | 17:55 |
| ryanpetrello | and if you look at Zuul, the ceilometer-tip job is there but just stuck | 17:55 |
| clarkb | ryanpetrello: I think this is lilely just due to us changing the host that is building nodes | 17:55 |
| *** doug-fish has joined #openstack-infra | 17:55 | |
| ryanpetrello | okay | 17:55 |
| clarkb | so there will be a slight delay as we transition | 17:55 |
| ryanpetrello | is there something I need to do other than just waiting? | 17:55 |
| ryanpetrello | okay, that's fine :) | 17:55 |
| *** ctracey has joined #openstack-infra | 17:55 | |
| ryanpetrello | just wanted to make sure it was a delay and not something I needed to change/retry | 17:55 |
| *** shakamunyi has quit IRC | 17:55 | |
| fungi | ryanpetrello: which ceilometer change specifically? | 17:56 |
| ryanpetrello | it's a pecan change that gates against ceilometer | 17:56 |
| fungi | oh, right | 17:56 |
| *** timcline_ has joined #openstack-infra | 17:56 | |
| fungi | i bet the jenkins slave that job originally ran on met with an unfortunate end and zuul requeued the job but hasn't gotten a new node to assign to it yet | 17:57 |
| fungi | and we're currently node-starved while in the middle of swapping nodepool servers | 17:57 |
| anteaya | AJaeger: I would like some sort of indication that a job called project-config-gerrit is only evaluating stackforge acls: https://review.openstack.org/#/c/140470/7 | 17:57 |
| *** ivar-lazzaro has joined #openstack-infra | 17:57 | |
| clarkb | fungi: I am going to check used nodes on old nodepool against each master and delete the ones that are safe to delete | 17:57 |
| anteaya | AJaeger: since the name does imply to me that it would apply to all incoming acl config files but the script is not doing that right now | 17:58 |
| clarkb | fungi: I do this by nodepool list | grep jenkinsXX > file. then just removing the handful of ndoes tha shouldn't be deleted | 17:58 |
| clarkb | fungi: it works well enough. though if I was smart I would figure out python-jenkins and completely script it | 17:58 |
| *** sarob has joined #openstack-infra | 17:59 | |
| ryanpetrello | fungi: makes sense, if it doesn't complete I'll just give it another try sometime later this week when things calmd own | 17:59 |
| ryanpetrello | *calm down | 17:59 |
| fungi | clarkb: yeah. or maybe nodepool could grow a quiescent mode we can trigger similar to zuul's | 18:00 |
| openstackgerrit | gordon chung proposed openstack/requirements: Up pymongo version to avoid memory leak https://review.openstack.org/123995 | 18:00 |
| fungi | clarkb: where it immediately starts deleting ready/building nodes and doesn't provision any new nodes, but continues to handle the used->delete transition and retry deletes as usual | 18:01 |
| *** Sukhdev has quit IRC | 18:01 | |
| *** emagana_ has quit IRC | 18:01 | |
| *** dannywilson has quit IRC | 18:01 | |
| fungi | and disconnect from gearman too | 18:02 |
| *** derekh has quit IRC | 18:02 | |
| *** MaxV has quit IRC | 18:02 | |
| *** serverascode___ has joined #openstack-infra | 18:02 | |
| *** cpowell has quit IRC | 18:03 | |
| *** annegent_ has quit IRC | 18:03 | |
| *** mmaglana has quit IRC | 18:04 | |
| *** patrickeast has quit IRC | 18:04 | |
| *** koolhead17 has joined #openstack-infra | 18:04 | |
| *** patrickeast has joined #openstack-infra | 18:04 | |
| *** ameade_ has joined #openstack-infra | 18:04 | |
| *** dannywilson has joined #openstack-infra | 18:05 | |
| *** SumitNaiksatam has quit IRC | 18:05 | |
| *** shakamunyi has joined #openstack-infra | 18:06 | |
| jeblair | i have suspected a problem with the "All builds for this change set" data, but have not had a chance to actually diagnose | 18:06 |
| jeblair | just to say -- best not to rely on its accuracy | 18:06 |
| *** marun has quit IRC | 18:07 | |
| *** wznoinsk has quit IRC | 18:07 | |
| ryanpetrello | fungi: clarkb: yep, it was just a delay, the job seems to be running now | 18:07 |
| *** emagana has joined #openstack-infra | 18:08 | |
| *** jgallard_ has joined #openstack-infra | 18:08 | |
| clarkb | ok I have deletions running for 04-07 | 18:09 |
| *** zhiyan has joined #openstack-infra | 18:09 | |
| fungi | yep, i show numbers dropping rapidly | 18:10 |
| *** charz has quit IRC | 18:10 | |
| jeblair | i don't see any red flags in the logs; either timeouterrors or exceptionally long times in the main loop | 18:11 |
| *** emagana_ has joined #openstack-infra | 18:11 | |
| *** emagana has quit IRC | 18:12 | |
| *** resker has quit IRC | 18:12 | |
| *** jgallard_ has quit IRC | 18:12 | |
| *** Masahiro has joined #openstack-infra | 18:13 | |
| *** gokrokve has quit IRC | 18:13 | |
| *** amitgandhinz has quit IRC | 18:15 | |
| *** _nadya_ has joined #openstack-infra | 18:16 | |
| openstackgerrit | Merged openstack-infra/python-storyboardclient: Initial Cookiecutter Commit. https://review.openstack.org/138090 | 18:17 |
| *** Masahiro has quit IRC | 18:17 | |
| *** cnesa2 has quit IRC | 18:18 | |
| *** zz_sabari is now known as sabari | 18:18 | |
| *** charz has joined #openstack-infra | 18:20 | |
| openstackgerrit | Merged openstack-infra/storyboard-webclient: Eabled custom dev configuration. https://review.openstack.org/138087 | 18:23 |
| *** _nadya_ has quit IRC | 18:25 | |
| *** e0ne has joined #openstack-infra | 18:25 | |
| *** sabari is now known as zz_sabari | 18:25 | |
| *** armax has quit IRC | 18:26 | |
| *** sarob has quit IRC | 18:27 | |
| *** markmcclain has joined #openstack-infra | 18:27 | |
| clarkb | jeblair: still no timeouts | 18:28 |
| clarkb | I have us down to ~150 nodes on the old host | 18:28 |
| clarkb | and that is still falling | 18:28 |
| jeblair | cool. the graph is really spiky, but i think that's because it still has incorrect data about usage | 18:28 |
| anteaya | dhellmann: thanks for the project creator's guide, I was just able to guide sukhdev to use it so hopefully he will guide others as well | 18:28 |
| jeblair | spiky's good though -- it means the loop is fast | 18:28 |
| *** cdent has quit IRC | 18:29 | |
| *** armax has joined #openstack-infra | 18:30 | |
| *** SumitNaiksatam has joined #openstack-infra | 18:30 | |
| *** luqas has quit IRC | 18:30 | |
| *** cpowell_ has joined #openstack-infra | 18:30 | |
| *** luqas has joined #openstack-infra | 18:31 | |
| *** harlowja_away is now known as harlowja | 18:31 | |
| *** signed8bit is now known as signed8bit_ZZZzz | 18:31 | |
| *** cpowell_ has quit IRC | 18:33 | |
| *** cpowell has joined #openstack-infra | 18:33 | |
| *** annegent_ has joined #openstack-infra | 18:34 | |
| *** emagana has joined #openstack-infra | 18:34 | |
| jesusaurus | what does it mean when fetching from a zuul merger says "error: Unable to get pack index"? | 18:35 |
| *** marun has joined #openstack-infra | 18:35 | |
| jesusaurus | is that a race condition of some sort? | 18:35 |
| clarkb | jesusaurus: hrm it shouldn't be. I think that git asked for an index of the pack files and that index operation failed. Could be a number of things. I would expect a race happening after you get the index and ask for a pack that is no longer there | 18:36 |
| *** pradk has joined #openstack-infra | 18:36 | |
| clarkb | jesusaurus: check apache on the zuul merger side for any errors in the error log? | 18:37 |
| *** emagana_ has quit IRC | 18:37 | |
| jeblair | krotscheck: https://storyboard.openstack.org/#!/story/2000075 | 18:38 |
| *** annegent_ has quit IRC | 18:39 | |
| openstackgerrit | Khai Do proposed stackforge/python-jenkins: Handle job and node names that contain spaces https://review.openstack.org/138886 | 18:40 |
| *** pelix has quit IRC | 18:40 | |
| fungi | speaking of "Unable to get pack index" i just discovered that cgit has the ability to turn off its default dumb http protocol endpoint support (enable-http-clone=off) | 18:40 |
| fungi | patch on the way | 18:40 |
| *** Sukhdev has joined #openstack-infra | 18:41 | |
| Sukhdev | fungi, clarkb: Hi | 18:42 |
| clarkb | hello | 18:42 |
| jesusaurus | clarkb: thanks | 18:42 |
| *** jedimike has quit IRC | 18:43 | |
| Sukhdev | clarkb: I got my new project approved - see https://review.openstack.org/#/c/140473/ | 18:43 |
| Sukhdev | clarkb: need to add couple of members so that we can work on this project | 18:43 |
| *** cnesa has joined #openstack-infra | 18:44 | |
| clarkb | Sukhdev: who should be the initial member of the -core and -release groups | 18:44 |
| clarkb | Sukhdev: I can just add one and that person canfill out the remaining members | 18:44 |
| *** teran has quit IRC | 18:44 | |
| Sukhdev | clarkb: that will be myself - do you need my email ID ? | 18:45 |
| *** teran has joined #openstack-infra | 18:45 | |
| clarkb | no I can get it from the change | 18:45 |
| *** pblaho has quit IRC | 18:45 | |
| Sukhdev | Ah..cool | 18:45 |
| *** Hefeweizen has joined #openstack-infra | 18:46 | |
| clarkb | Sukhdev: done | 18:46 |
| Sukhdev | clarkb: cool - thanks | 18:46 |
| Sukhdev | clarkb: what is the easiest way to check/verify for me? | 18:47 |
| clarkb | jeblair: there was a timeout error ~2 minutes ago, but that was the first and only one | 18:47 |
| clarkb | Sukhdev: I am not sure I understand the question. You want to see that i added you to the groups? | 18:47 |
| clarkb | Sukhdev: to do that go to https://review.openstack.org/#/admin/groups/ which is under People -> List Groups | 18:48 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Disable cgit's dumb HTTP protocol endpoint support https://review.openstack.org/140805 | 18:49 |
| clarkb | Sukhdev: then type into the filter box to searc hfor the group you are interested in. When it shows up click on it | 18:49 |
| clarkb | Sukhdev: and that takes you to the membership page | 18:49 |
| *** melwitt has joined #openstack-infra | 18:49 | |
| *** tonytan4ever has joined #openstack-infra | 18:49 | |
| *** kmartin has joined #openstack-infra | 18:50 | |
| *** Ryan_Lane has joined #openstack-infra | 18:50 | |
| *** teran has quit IRC | 18:50 | |
| *** shashankhegde has joined #openstack-infra | 18:50 | |
| sdague | clarkb: hmmm... I'm about to just put this fixtures bit down. Because, here's the odd thing, I'm tracing inside the fixture code and it looks like it's rebinding the symbol fine | 18:50 |
| sdague | except then it doesn't after the import | 18:50 |
| *** berendt has quit IRC | 18:51 | |
| clarkb | sdague: doesn't the import happen first though? | 18:52 |
| clarkb | before it rebinds | 18:52 |
| *** AJaeger_ has joined #openstack-infra | 18:52 | |
| *** esker has joined #openstack-infra | 18:53 | |
| *** KurtMartin has quit IRC | 18:53 | |
| fungi | looks like all old nodepool nodes are vamoose now | 18:53 |
| sdague | so, in MonkeyPatch setUp it actually seemed to find the symbols correctly, and looks like it set the attrs correctly | 18:53 |
| AJaeger_ | anteaya: regarding https://review.openstack.org/#/c/140470/7 - I understand your concern but adding this as comment to the voting=false is not the right thing IMHO | 18:53 |
| sdague | but then when I try to use the object, nope | 18:53 |
| clarkb | fungi: for the most part. and new nodepool marked all the things ready and now gear is catching up | 18:54 |
| anteaya | AJaeger_: fair enough | 18:54 |
| anteaya | AJaeger_: any way we can address my concern? | 18:54 |
| *** MaxV has joined #openstack-infra | 18:54 | |
| sdague | I have the hackiest of print debug code if you are up for poking at this | 18:54 |
| clarkb | sdague: so by the time the test runs its no longer correct | 18:54 |
| zaro | clarkb: do you know if we are having this problem at all? https://storyboard.openstack.org/#!/story/2000030 | 18:55 |
| clarkb | sdague: I think that may be explained if you do properly import the patched module later | 18:55 |
| clarkb | sdague: as that import action should write over the existing name? | 18:55 |
| sdague | https://github.com/sdague/fixtures/commit/d892eb060c4ed30f94bc9c709788d718b5c97a9e#diff-f987a3c91da9c5018dec6879afd4ba60R90 if i print debug inside of MonkeyPatch the attrs on C are changed | 18:55 |
| anteaya | AJaeger_: armax is sitting 10 feet away and is very amenable, we just have to agree on what to suggest to him | 18:55 |
| AJaeger_ | anteaya: we could add a comment above the job in layout.yaml if that helps. | 18:55 |
| anteaya | I can live with that | 18:56 |
| *** shayneburgess has joined #openstack-infra | 18:56 | |
| anteaya | care to add the comment? | 18:56 |
| clarkb | zaro: I don't think we have seen that. It may be related to us having single use only nodes though | 18:56 |
| zaro | clarkb: someone else reported what looks like the same thing: https://issues.jenkins-ci.org/browse/JENKINS-25867 | 18:56 |
| AJaeger_ | anteaya: physically 10 feet? | 18:56 |
| *** otter768 has joined #openstack-infra | 18:56 | |
| anteaya | AJaeger_: in the review, a review comment | 18:56 |
| clarkb | zaro: I wonder if wikimedia is using long lived nodes which increases the changes of deadlock | 18:56 |
| anteaya | AJaeger_: yes, neutron mid-cycle | 18:56 |
| AJaeger_ | anteaya: understood, on my way... | 18:56 |
| AJaeger_ | anteaya: Ah! Say hi to him! | 18:56 |
| anteaya | AJaeger_: will do | 18:56 |
| zaro | clarkb: yeah they do. | 18:56 |
| clarkb | sdague: so in that case you setup before your import | 18:57 |
| clarkb | sdague: I think the followup import is what breaks you there | 18:57 |
| zaro | clarkb: i was thinking it might also be the other plugins that they have installed. | 18:57 |
| sdague | clarkb: right, clearly, but why | 18:57 |
| clarkb | sdague: when you construct the patch then run setup You are essentially saying x.that.does.not.exist.yet = thing. Then at import time you say x.that.does.not.exist.yet = the thing it really is | 18:58 |
| AJaeger_ | anteaya: I haven't seen these kind of comments in layout.yaml and those also become quickly outdated. | 18:58 |
| anteaya | AJaeger_: right whereas I have seen them in the location where non-voting status is set | 18:58 |
| anteaya | which is why I picked there | 18:59 |
| clarkb | sdague: and python lets you get away with that whereas other lnaguages would complain about unknown scopes or symbols | 18:59 |
| anteaya | I just want to remember that right now this non-voting job only evaluates stackforge acls | 18:59 |
| anteaya | AJaeger_: I'm afraid I will forget | 18:59 |
| sdague | brb... one handed with infant | 19:00 |
| AJaeger_ | sdague, clarkb, fungi: Any suggestions on how to address anteaya's comment suggestion best? See https://review.openstack.org/#/c/140470/4/zuul/layout.yaml | 19:00 |
| fungi | clarkb: what's the possibility that the repeat gate-infra-puppet-apply-centos6 failures are an issue in module dependency ordering introduced when i approved adding puppet-httpd to the modules array yesterday? | 19:00 |
| *** sabeen3 has joined #openstack-infra | 19:00 | |
| clarkb | fungi: I think that must be what it is. I noticed that mrmartin's fix for the module ordering didn't seem affected | 19:00 |
| AJaeger_ | anteaya: The current comments in the voting section explain why something is not voting or set this way | 19:00 |
| *** nfedotov has joined #openstack-infra | 19:00 | |
| *** wenlock has joined #openstack-infra | 19:00 | |
| anteaya | AJaeger_: fair enough, but there are comments there | 19:01 |
| AJaeger_ | anteaya: yes, there are comments. | 19:01 |
| *** timcline_ has quit IRC | 19:01 | |
| *** otter768 has quit IRC | 19:01 | |
| anteaya | I'm willing to branch out on content | 19:01 |
| *** sabeen has quit IRC | 19:01 | |
| clarkb | anteaya: AJaeger_ I think you can run that non voting, then add openstack in at some point still non voting and when you are happy with it make it voting? | 19:01 |
| anteaya | that is the plan yes | 19:02 |
| *** annegent_ has joined #openstack-infra | 19:02 | |
| *** amitgandhinz has joined #openstack-infra | 19:02 | |
| anteaya | just trying to capture that somehow so I don't forget when we make it non-voting | 19:02 |
| anteaya | or whoever approves the patch once it is offered | 19:02 |
| *** nfedotov has quit IRC | 19:02 | |
| AJaeger_ | clarkb: patchset 6 introduced a comment saying "# Right now this is only evaluating acl files on stackforge projects. " | 19:02 |
| *** nfedotov has joined #openstack-infra | 19:02 | |
| *** MaxV has quit IRC | 19:02 | |
| AJaeger_ | And that one didn't work for me at all ;( | 19:02 |
| fungi | anteaya: AJaeger_: yeah, having it run tools/normalize_acl.py against the proposed acl and complain if the output differs from the input might be a good addition | 19:03 |
| AJaeger_ | anteaya: please tell armax ;) | 19:03 |
| clarkb | still just the one timeout so this is much happier nodepool than before | 19:03 |
| *** reed has joined #openstack-infra | 19:03 | |
| *** timcline has joined #openstack-infra | 19:04 | |
| AJaeger_ | anteaya, armax: let me make a proposal for the patch with specific wording. I hope that addresses both our concerns... | 19:04 |
| anteaya | I'm sorry if I am thick but I think I missed fungi's suggestion | 19:04 |
| armax | AJaeger_: standing by | 19:04 |
| armax | AJaeger_: thanks for bearing with me! | 19:04 |
| AJaeger_ | armax: Thanks for bearing with my bikeshedding ;) | 19:05 |
| *** arosen has joined #openstack-infra | 19:05 | |
| armax | anteaya, clarkb, AJaeger_: btw do we have an ETA for https://review.openstack.org/#/c/140426/ ? | 19:05 |
| *** reed has quit IRC | 19:05 | |
| armax | AJaeger_: no worries | 19:05 |
| *** jistr has joined #openstack-infra | 19:05 | |
| *** bitblt has joined #openstack-infra | 19:05 | |
| anteaya | AJaeger_: you are the best person to bikeshed with | 19:05 |
| dims | AJaeger_: thanks for the heads up on reverify vs recheck! | 19:06 |
| anteaya | fungi: sorry I see what you are saying now | 19:06 |
| *** mrmartin has joined #openstack-infra | 19:06 | |
| *** jaypipes has joined #openstack-infra | 19:07 | |
| fungi | anteaya: basically ensure acl normalization prior to allowing it to merge, similar to our alpha-order checks | 19:07 |
| *** zz_sabari is now known as sabari | 19:07 | |
| *** ayoung is now known as shhh_im_busy | 19:07 | |
| anteaya | makes way more sense that piecemeal tests | 19:07 |
| AJaeger_ | dims: you're welcome | 19:08 |
| anteaya | thanks | 19:08 |
| fungi | anteaya: armax: also, i think the future of this job, once it's proven as being non-annoying/problematic, is to absorb it into one of our existing syntax/format checking jobs for that project so that we don't waste spin-up/tear-down overhead and waste additional job worksers running it | 19:08 |
| armax | fungi: agreed | 19:08 |
| clarkb | also so that it is easier to remember to run it locally | 19:08 |
| fungi | s/worksers/workers/ | 19:08 |
| AJaeger_ | fungi: agreed | 19:09 |
| *** sabari is now known as zz_sabari | 19:09 | |
| *** andreykurilin_ has quit IRC | 19:09 | |
| *** tsg has joined #openstack-infra | 19:09 | |
| AJaeger_ | armax, anteaya: Does my comment work for you? | 19:10 |
| *** shhh_im_busy is now known as ayoung | 19:10 | |
| *** MaxV has joined #openstack-infra | 19:11 | |
| fungi | SergeyLukjanov: did you get a chance to retry applying that acl update to sahara? it doesn't seem to have changed in gerrit | 19:11 |
| clarkb | fungi: ya there is an error in that acl file | 19:12 |
| *** emagana has quit IRC | 19:12 | |
| clarkb | fungi: not sure what it is though but it appears to have nt updated since late august | 19:12 |
| dhellmann | anteaya: I'll be happy to try to help keep that up to date, since I've rewritten our Oslo guide to point to it at the appropriate spot(s), so let me know if I can help answer questions or add detail | 19:12 |
| *** wenlock has quit IRC | 19:12 | |
| *** zz_sabari is now known as sabari | 19:12 | |
| *** emagana has joined #openstack-infra | 19:12 | |
| *** _shaps_ has quit IRC | 19:13 | |
| *** ala_ has quit IRC | 19:14 | |
| AJaeger_ | dhellmann: could you review https://review.openstack.org/#/c/138831/ , please? Fungi mentioned that it's not linear with my change anymore. | 19:14 |
| AJaeger_ | and I haven't found a good way to keep it in order, suggestions are welcome | 19:15 |
| fungi | clarkb: i'll have a look then | 19:16 |
| *** yamamoto has joined #openstack-infra | 19:16 | |
| *** emagana has quit IRC | 19:16 | |
| *** erikmwilson has joined #openstack-infra | 19:17 | |
| *** KurtMartin has joined #openstack-infra | 19:17 | |
| *** signed8bit_ZZZzz is now known as signed8bit | 19:19 | |
| AJaeger_ | speaking about extra checks, I added a check for the existance of descriptions in gerrit/projects.yaml with https://review.openstack.org/#/c/138749/ . Like anteaya prefers a comment that the gerrit acls checks is only partial, I like to see descriptions for projects. is this something we should do moving forward - or should i abandon it? | 19:20 |
| *** kmartin has quit IRC | 19:20 | |
| *** baoli has quit IRC | 19:20 | |
| *** baoli has joined #openstack-infra | 19:21 | |
| *** yamamoto has quit IRC | 19:21 | |
| fungi | it seems reasonable that every project should have a description | 19:22 |
| fungi | i am not opposed to making that a required field | 19:22 |
| *** jp_at_hp has quit IRC | 19:23 | |
| *** reed has joined #openstack-infra | 19:23 | |
| openstackgerrit | Marton Kiss proposed openstack-infra/system-config: Initial commit of Ask website https://review.openstack.org/140043 | 19:23 |
| *** wenlock has joined #openstack-infra | 19:23 | |
| AJaeger_ | anteaya: Are you opposed completely to 138749 or do you have a suggestion on what to change? | 19:24 |
| AJaeger_ | fungi, thanks | 19:24 |
| openstackgerrit | James E. Blair proposed openstack-infra/infra-specs: Add nodepool-launcher spec https://review.openstack.org/140812 | 19:25 |
| *** [HeOS] has joined #openstack-infra | 19:26 | |
| jeblair | clarkb, fungi, mordred: ^ addresses recent nodepool issues | 19:26 |
| *** annegent_ has quit IRC | 19:26 | |
| *** emagana has joined #openstack-infra | 19:26 | |
| *** annegent_ has joined #openstack-infra | 19:27 | |
| fungi | jeblair: thank you! | 19:28 |
| *** baoli has quit IRC | 19:28 | |
| jeblair | 2014-12-10 10:12:29,509 ERROR gear.Client.unknown: Connection <gear.Connection 0x267c0d0 host: 127.0.0.1 port: 4730> timed out waiting for a response to a submit job request: <gear.Job 0 | 19:28 |
| jeblair | x7feaf0043e50 handle: None name: set_description:jenkins06.openstack.org unique: 92cb9ce3549f44d283d4a3cb9230d8de> | 19:28 |
| jeblair | 2014-12-10 10:12:29,510 INFO zuul.Gearman: Gearman job <gear.Job 0x7feb6d80d190 handle: H:127.0.0.1:207180 name: build:gate-tempest-dsvm-neutron-large-ops-juno:devstack-trusty unique: 3cabdc4d17284762bc79144fe316a743> lost due to disconnect | 19:28 |
| jeblair | clarkb: ^ | 19:28 |
| clarkb | jeblair: thanks | 19:28 |
| clarkb | I greped for 'gear' and 'gearman' before quickly ^Cing :) | 19:28 |
| jeblair | clarkb: "isconnect" :) | 19:28 |
| AJaeger_ | armax: you can enable openstack-dev as well https://review.openstack.org/#/c/140470/ | 19:28 |
| jeblair | clarkb: looks like 3 times today | 19:29 |
| AJaeger_ | armax: could you remove the -x? That is too much debug for me right now | 19:29 |
| *** jistr has quit IRC | 19:30 | |
| *** ZZelle has joined #openstack-infra | 19:31 | |
| armax | AJaeger_: will do | 19:31 |
| armax | AJaeger_: with openstack-dev there are some projects that do not comply, as far as I recall | 19:31 |
| armax | I doublecheck | 19:31 |
| *** KurtMartin is now known as kmartin | 19:32 | |
| fungi | clarkb: following merging https://review.openstack.org/140497 last night, did puppet need to get manually reapplied on puppetmaster.o.o for that to work? | 19:32 |
| clarkb | fungi: ya I did it | 19:32 |
| *** wenlock has quit IRC | 19:33 | |
| fungi | huh | 19:33 |
| dhellmann | AJaeger_: looking | 19:33 |
| harlowja | have u guys ever seen errors like '/opt/stack/new/devstack/functions-common:603 Cloning not allowed in this configuration' ? | 19:33 |
| harlowja | seen in http://logs.openstack.org/63/140263/3/check/gate-tempest-dsvm-neutron-src-tooz/3977db4/logs/devstacklog.txt.gz | 19:33 |
| *** shakamunyi has quit IRC | 19:33 | |
| *** esker has quit IRC | 19:33 | |
| fungi | clarkb: doesn't seem to have taken effect then. we still have stuff listed in puppetboard which isn't updating | 19:33 |
| mordred | jeblair: cool | 19:34 |
| clarkb | fungi: hrm let me double check I thought puppetmaster was puppeting it self at the very least | 19:34 |
| *** shakamunyi has joined #openstack-infra | 19:34 | |
| dhellmann | AJaeger_: that looks like good info to add; I'll have to consider the order a bit. You seem to have found a reasonable place for it, though. | 19:34 |
| *** esker has joined #openstack-infra | 19:34 | |
| *** signed8bit has quit IRC | 19:34 | |
| fungi | clarkb: there might be another reason. i'll check the hosts where this is failing. maybe agent is disabled (or for the new git-fe servers maybe puppetmaster needs to update ~root/.ssh/known_hosts) | 19:34 |
| *** timcline has quit IRC | 19:35 | |
| *** bdpayne has joined #openstack-infra | 19:35 | |
| clarkb | fungi: /etc/ansible/ansible.cfg looks right and running that script as root spits out json with a list of nodes | 19:35 |
| AJaeger_ | armax: Only add it if it passes for openstack-dev ;) | 19:35 |
| *** pc_m_ has joined #openstack-infra | 19:35 | |
| fungi | clarkb: okay, i'm going with puppet agent is still set --disable on the afs/kdc hosts, and git-fe hosts need ssh host keys accepted | 19:36 |
| AJaeger_ | dhellmann: thanks, looking forward whether you have some great ordering idea ;) | 19:36 |
| clarkb | fungi: likely | 19:36 |
| clarkb | fungi: I can do git-feXX now | 19:36 |
| dhellmann | AJaeger_: well, how about as a sub-section of the very next block? | 19:36 |
| clarkb | ok thats done | 19:36 |
| dhellmann | AJaeger_: because step 1 in that section is to test "git review" | 19:37 |
| *** sarob has joined #openstack-infra | 19:37 | |
| clarkb | jeblair: should I be worried about it restarting 3 times today? | 19:37 |
| *** esker has quit IRC | 19:37 | |
| *** sarob has quit IRC | 19:38 | |
| dhellmann | AJaeger_: we could replace each of those vague numbered steps with a little description of what to do (your git-review stuff; instructions to run tox; where to look in gerrit for acls; a link to instructions for tagging a release) | 19:38 |
| fungi | clarkb: i guess if those go to reported in puppetboard then it's working for sure | 19:38 |
| *** emagana has quit IRC | 19:38 | |
| jeblair | clarkb: yep. i want to catch it in a tcpdump, and then i think we should probably increase the zuul timeout back to 3 minutes | 19:38 |
| jeblair | er 5 minutes | 19:38 |
| *** salv-orlando has quit IRC | 19:38 | |
| *** sarob has joined #openstack-infra | 19:38 | |
| jeblair | clarkb: tcpdump is running | 19:38 |
| clarkb | jeblair: in that spec we would handle rate limiting by not submitting jobs to launch/delete above the rate limits? or would we need some bus between workers to negotiate that? | 19:38 |
| clarkb | jeblair: rgr | 19:38 |
| jeblair | clarkb: what kind of rate limiting? openstack? | 19:38 |
| clarkb | jeblair: ya openstack api limits | 19:39 |
| *** pc_m has quit IRC | 19:39 | |
| jeblair | clarkb: the workers use the provider managers we have now, whose only purpose is to serialize and rate limit api calls from multiple threads | 19:39 |
| *** sabari is now known as zz_sabari | 19:39 | |
| AJaeger_ | dhellmann: do you want to take over my patch? | 19:40 |
| clarkb | jeblair: but wouldn't they run in different processes without shared memory? | 19:40 |
| *** dtantsur is now known as dtantsur|afk | 19:40 | |
| jeblair | clarkb: one worker per provider, that worker still spawns lots of threads for each launch | 19:40 |
| clarkb | oh I see | 19:40 |
| *** marun has quit IRC | 19:40 | |
| dhellmann | AJaeger_: "want" is a strong word :-) How about just moving what you have down below the list for now, and I'll work on the other details in a follow-up? | 19:40 |
| AJaeger_ | dhellmann: so, just one section further down? I can do that. | 19:41 |
| jeblair | clarkb: so this moves the thread contention out of the main loop, makes it smaller because we could run 10 workers in our configuration (for our 10 providers), and finally if that's not enough, we can limit the contention by saying "no more than X threads at a time for this worker" | 19:41 |
| dhellmann | AJaeger_: yeah, under "Verify That Gerrit and the Test Jobs are Working" | 19:41 |
| *** emagana_ has joined #openstack-infra | 19:42 | |
| *** marun has joined #openstack-infra | 19:42 | |
| *** mbacchi has quit IRC | 19:42 | |
| clarkb | jeblair: yup | 19:42 |
| *** sarob has quit IRC | 19:43 | |
| *** timcline has joined #openstack-infra | 19:43 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Check that Gerrit ACL files are normalized https://review.openstack.org/140821 | 19:44 |
| *** timcline has quit IRC | 19:44 | |
| AJaeger_ | fungi: is the above what you had in mind? ^ | 19:44 |
| *** zz_sabari is now known as sabari | 19:44 | |
| *** emagana has joined #openstack-infra | 19:44 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Add .gitreview content to Creator's Guide https://review.openstack.org/138831 | 19:45 |
| AJaeger_ | dhellmann: done, thanks! | 19:45 |
| *** emagana_ has quit IRC | 19:46 | |
| *** cnesa2 has joined #openstack-infra | 19:46 | |
| openstackgerrit | Merged openstack-infra/project-config: Support running script against local changes https://review.openstack.org/138710 | 19:46 |
| dhellmann | AJaeger_, sorry, I meant to make your new section a *subsection* of that one, not just list it after | 19:46 |
| *** cnesa has quit IRC | 19:47 | |
| *** nfedotov has quit IRC | 19:47 | |
| dhellmann | AJaeger_: "make sure git review works, if not, these are the steps to make it work" | 19:47 |
| *** _nadya_ has joined #openstack-infra | 19:47 | |
| *** nfedotov has joined #openstack-infra | 19:48 | |
| AJaeger_ | dhellmann: so, then we should rename it. | 19:48 |
| dhellmann | Hmm, probably. How about "Configuring ``git review``"? | 19:49 |
| *** tsg has left #openstack-infra | 19:49 | |
| *** tsg has quit IRC | 19:49 | |
| AJaeger_ | dhellmann: and the first paragraph needs to be changed as well, let me review it again... | 19:49 |
| *** jcoufal_ has quit IRC | 19:49 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Normalize Gerrit ACLs https://review.openstack.org/140822 | 19:50 |
| dhellmann | AJaeger_, oh, yeah, I missed the tests bit. I think you can leave that out because it is step 2 in the list right above | 19:50 |
| *** bitblt has quit IRC | 19:51 | |
| *** mmaglana has joined #openstack-infra | 19:53 | |
| *** MaxV has quit IRC | 19:53 | |
| *** sabeen has joined #openstack-infra | 19:53 | |
| *** sabeen3 has quit IRC | 19:54 | |
| *** nfedotov1 has joined #openstack-infra | 19:55 | |
| *** nfedotov has quit IRC | 19:55 | |
| *** timcline has joined #openstack-infra | 19:56 | |
| AJaeger_ | dhellmann: what about adding them as subsection as well? Here comes a patch and I fear it needs some more fleshing out when I'm a bit less distracted | 19:56 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/infra-manual: Add .gitreview content to Creator's Guide https://review.openstack.org/138831 | 19:57 |
| *** sabari is now known as zz_sabari | 19:57 | |
| dhellmann | AJaeger_: yes, that's exactly what I'm talking about -- I'll do the other sections as a follow-up to your patch | 19:57 |
| *** zz_sabari is now known as sabari | 19:57 | |
| *** pblaho has joined #openstack-infra | 19:57 | |
| AJaeger_ | dhellmann: thanks! | 19:58 |
| clarkb | we are now down to a very small list of problem nodes on old nodepool | 19:59 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config: Check that Gerrit ACL files are normalized https://review.openstack.org/140821 | 19:59 |
| *** nfedotov has joined #openstack-infra | 20:00 | |
| clarkb | I will dig into those after lunch | 20:00 |
| clarkb | still just the one timeout on new nodepool so things look much better there | 20:00 |
| *** nfedotov has quit IRC | 20:00 | |
| *** nfedotov1 has quit IRC | 20:01 | |
| *** nfedotov has joined #openstack-infra | 20:01 | |
| *** erikmwilson has quit IRC | 20:01 | |
| AJaeger_ | fungi, addressed your comment and also normalized all current files, see https://review.openstack.org/140822 . | 20:01 |
| *** Masahiro has joined #openstack-infra | 20:01 | |
| *** dims has quit IRC | 20:02 | |
| *** dannywilson has quit IRC | 20:03 | |
| ryanpetrello | since the OpenStack CI doesn't test py26 and 32 anymore, is there a way for me to set up other external CI for pecan myself? | 20:04 |
| ryanpetrello | (that affects the vote on reviews?) | 20:04 |
| dhellmann | ryanpetrello: we're still testing 26 for oslo libs, so you should be able to as well | 20:04 |
| ryanpetrello | yea, though I assume it's eventually going away | 20:04 |
| clarkb | dhellmann: ya I offered but ryanpetrello said meh :) | 20:04 |
| clarkb | it will go away when we eol juno | 20:04 |
| ryanpetrello | sure :) | 20:04 |
| *** kgiusti has quit IRC | 20:04 | |
| dhellmann | ah, ok | 20:04 |
| ryanpetrello | and I don't want you all to have to carry this | 20:04 |
| ryanpetrello | it's not a major issue for me | 20:05 |
| fungi | ryanpetrello: third-party testing | 20:05 |
| clarkb | ryanpetrello: there is a way for you to run those tests though let me get u a link | 20:05 |
| *** aysyd has quit IRC | 20:05 | |
| ryanpetrello | I'm just wondering if there's some way for me to affect this myself | 20:05 |
| ryanpetrello | okay, awesome | 20:05 |
| ryanpetrello | I'd be glad to manage some separate CI myself | 20:05 |
| fungi | yep, we do indeed have instructions | 20:05 |
| *** dannywilson has joined #openstack-infra | 20:05 | |
| ryanpetrello | awesome, thanks! | 20:05 |
| clarkb | ryanpetrello: http://ci.openstack.org/third_party.html some of that won't strictly apply because you will just be voting against a stackforge project right? | 20:05 |
| ryanpetrello | clarkb: yep | 20:05 |
| clarkb | ryanpetrello: but it has info on creating an account and reading the event stream and so on | 20:05 |
| ryanpetrello | I'll have a read-through | 20:05 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/infra-manual: Expand more of the repo verification steps https://review.openstack.org/140828 | 20:06 |
| dhellmann | AJaeger_: ^^ | 20:06 |
| *** Masahiro has quit IRC | 20:06 | |
| AJaeger_ | dhellmann: wow! Let me review ... | 20:06 |
| *** kgiusti has joined #openstack-infra | 20:06 | |
| *** teran has joined #openstack-infra | 20:07 | |
| *** wenlock has joined #openstack-infra | 20:08 | |
| *** MaxV has joined #openstack-infra | 20:08 | |
| *** spzala has quit IRC | 20:08 | |
| *** annegent_ has quit IRC | 20:09 | |
| *** armax has quit IRC | 20:10 | |
| * AJaeger_ waves good bye for today! | 20:10 | |
| *** AJaeger_ has quit IRC | 20:10 | |
| fungi | clarkb: SergeyLukjanov: i checked the gerrit error_log and it does indeed dislike that acl file | 20:10 |
| fungi | clarkb: SergeyLukjanov: though i'm not immediately spotting the cause | 20:10 |
| *** timcline has quit IRC | 20:10 | |
| SergeyLukjanov | fungi, clarkb, sorry, folks, just returned home (11pm, heh) | 20:10 |
| *** armax has joined #openstack-infra | 20:10 | |
| SergeyLukjanov | fungi, I'll try to understand the issue in ACL file, don't see any atm :( | 20:11 |
| *** ryanpetrello has quit IRC | 20:11 | |
| *** _nadya_ has quit IRC | 20:11 | |
| *** timcline has joined #openstack-infra | 20:11 | |
| *** ryanpetrello_ has joined #openstack-infra | 20:11 | |
| *** ryanpetrello_ is now known as ryanpetrello | 20:12 | |
| *** marun has quit IRC | 20:12 | |
| *** marun has joined #openstack-infra | 20:12 | |
| *** pc_m_ has quit IRC | 20:12 | |
| *** _nadya_ has joined #openstack-infra | 20:13 | |
| *** pc_m has joined #openstack-infra | 20:13 | |
| *** ldnunes has quit IRC | 20:14 | |
| *** _nadya_ has quit IRC | 20:16 | |
| *** sabari is now known as zz_sabari | 20:16 | |
| *** markmcclain has quit IRC | 20:17 | |
| fungi | SergeyLukjanov: aha, found it | 20:19 |
| SergeyLukjanov | fungi, ? | 20:19 |
| SergeyLukjanov | fungi, /me still don't see :( | 20:19 |
| *** salv-orlando has joined #openstack-infra | 20:20 | |
| fungi | SergeyLukjanov: just a sec | 20:20 |
| *** jcoufal has joined #openstack-infra | 20:23 | |
| *** koolhead17 has quit IRC | 20:23 | |
| *** unicell1 has quit IRC | 20:23 | |
| *** koolhead17 has joined #openstack-infra | 20:24 | |
| openstackgerrit | Merged openstack-infra/devstack-gate: Add os-net-config to the list of packages we clone https://review.openstack.org/136811 | 20:24 |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config: Revert "Use more strict regex for sahara tags acl" https://review.openstack.org/140831 | 20:25 |
| fungi | SergeyLukjanov: ^ | 20:25 |
| *** erikmwilson has joined #openstack-infra | 20:25 | |
| SergeyLukjanov | fungi, omg, I've been testing it manually on my gerrit installation | 20:25 |
| *** signed8bit has joined #openstack-infra | 20:25 | |
| fungi | SergeyLukjanov: when i reverted that manually on review.o.o i was able to apply it with manage-projects just fine | 20:26 |
| fungi | SergeyLukjanov: it's probably an escaping problem? | 20:26 |
| *** luqas has quit IRC | 20:26 | |
| SergeyLukjanov | fungi, hm, yeah, I think it could be | 20:26 |
| *** nfedotov1 has joined #openstack-infra | 20:26 | |
| SergeyLukjanov | fungi, thank you very much! | 20:27 |
| *** luqas has joined #openstack-infra | 20:27 | |
| *** nfedotov has quit IRC | 20:28 | |
| *** koolhead17 has quit IRC | 20:29 | |
| *** [HeOS] is now known as HeOS | 20:31 | |
| fungi | SergeyLukjanov: yw | 20:31 |
| *** tonytan4ever has quit IRC | 20:32 | |
| dougwig | hi infra. what's the right way to redo a gate job? failed for a transient error, passed in the check queue. https://review.openstack.org/#/c/140515/ | 20:33 |
| *** spzala has joined #openstack-infra | 20:34 | |
| openstackgerrit | Joshua Harlow proposed openstack/requirements: Bump up oslo.utils to 1.1.0 https://review.openstack.org/140573 | 20:36 |
| *** MaxV has quit IRC | 20:37 | |
| *** erikmwilson has quit IRC | 20:38 | |
| fungi | dougwig: recheck, assuming you know why it failed and that it's not related to the change | 20:38 |
| *** lttrl has quit IRC | 20:38 | |
| dougwig | was a network failure, unrelated to the change. thanks. | 20:38 |
| *** timcline has quit IRC | 20:39 | |
| *** annegent_ has joined #openstack-infra | 20:39 | |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Add test for validating certain gerrit ACL rules https://review.openstack.org/140470 | 20:40 |
| *** Sukhdev has quit IRC | 20:41 | |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Add test for validating certain gerrit ACL rules https://review.openstack.org/140470 | 20:41 |
| armax | AJaeger: I tweaked the check logic first, let me know if you’d like me to revise your patch that depends on it | 20:42 |
| SergeyLukjanov | fungi, we're using sahara-ci to run jobs to verify it's own config located in stackforge/sahara-ci-config, is it ok if I'll add permissions for sahara-ci to vote on it? | 20:43 |
| *** rushiagr is now known as rushiagr_away | 20:43 | |
| clarkb | yup as the ptl that is entirely up to you | 20:44 |
| fungi | SergeyLukjanov: yes, that's the intent of the new design model | 20:44 |
| SergeyLukjanov | fungi, clarkb, ok, thx | 20:44 |
| fungi | project ptls get to decide what accounts are allowed to vote on their projects now | 20:44 |
| *** annegent_ has quit IRC | 20:44 | |
| gilliard | Hello - what code backs this page? http://www.openstack.org/community/members/ - I want to feature request search-by-irc-nick there. | 20:45 |
| gilliard | (actually it is fungi's idea, I think) | 20:46 |
| *** bdpayne_ has joined #openstack-infra | 20:46 | |
| clarkb | openstack-org is the bugtracker used on launchpad. The source is on github somewhere though .I wonder if the are using github bug tracker now? | 20:47 |
| clarkb | fungi: ^ | 20:47 |
| mordred | clarkb: I thought the source was in gerrit now | 20:47 |
| *** nfedotov1 has quit IRC | 20:47 | |
| clarkb | jeblair: jhesketh SergeyLukjanov fungi mordred http://www.cs.pdx.edu/~warren/Capstone/PAGES/CapstoneDescription.pdf fyi. I am going to try and send warren email today before the long break | 20:47 |
| jeblair | http://git.openstack.org/cgit/openstack-infra/openstackweb/ ? | 20:47 |
| openstackgerrit | Armando Migliaccio proposed openstack-infra/project-config: Add test for validating certain gerrit ACL rules https://review.openstack.org/140470 | 20:47 |
| clarkb | mordred: no, it has been imported into gerrit but that isn't the source | 20:47 |
| fungi | clarkb: gilliard: right, the openstack-org project on launchpad for now. and while we have imported the source into gerrit as openstack-infra/openstackweb they've apparently gotten out of sync | 20:48 |
| mordred | oh good | 20:48 |
| *** nfedotov has joined #openstack-infra | 20:48 | |
| * mordred steps away from this conversation | 20:48 | |
| gilliard | Alright I'll hit launchpad and raise something - I'm happy to code it if I know where it lives. | 20:49 |
| * clarkb realized that the university basically shuts down for 3 weeks so I better hurry up and send mail if I want a response reasonbly soon | 20:49 | |
| openstackgerrit | Merged openstack-infra/project-config: Revert "Use more strict regex for sahara tags acl" https://review.openstack.org/140831 | 20:49 |
| fungi | we approved the project-config change to import that repo even though they apparently weren't done updating it in github yet, and before i'd had a chance to corner the tipit folks to discuss new workflow options | 20:49 |
| *** bdpayne has quit IRC | 20:49 | |
| *** MaxV has joined #openstack-infra | 20:49 | |
| jeblair | fungi: none of that makes any sense :( | 20:50 |
| *** kmartin has quit IRC | 20:50 | |
| *** lttrl has joined #openstack-infra | 20:51 | |
| fungi | jeblair: well, they published that as a "preview" export of code they were developing for the next iteration of the site (which is now in production since late last week) | 20:51 |
| jeblair | fungi: that's not what their readme said :) | 20:52 |
| fungi | i think they may have a little trouble navigating the space-time continuum | 20:52 |
| jeblair | indeed, it's been a long 2 years since we agreed the import was the next step. | 20:53 |
| *** shakamunyi has quit IRC | 20:53 | |
| *** erikmwilson has joined #openstack-infra | 20:53 | |
| *** whoops has joined #openstack-infra | 20:53 | |
| *** lttrl has quit IRC | 20:54 | |
| jeblair | anyway, nothing is stopping them from proposing a commit with "Code dump to bring repo up to date since our last code dump" | 20:54 |
| fungi | agreed. i will pick that conversation back up again | 20:54 |
| gilliard | So I raised the ticket, but the short answer for where the code lives is "ask again later", right ;) | 20:55 |
| fungi | i think they were waiting until that code was actually in production, so now it's a good time to get them using gerrit | 20:55 |
| fungi | gilliard: yeah, disappointing to most of us, but that's the present situation | 20:56 |
| gilliard | No worries, thanks all! | 20:56 |
| *** bdpayne_ has quit IRC | 20:56 | |
| *** shakamunyi has joined #openstack-infra | 20:56 | |
| *** teran_ has joined #openstack-infra | 20:57 | |
| *** otter768 has joined #openstack-infra | 20:57 | |
| *** Longgeek has quit IRC | 20:58 | |
| pleia2 | I hoped after a few years I'd stop saying "arrrgghhh puppet" | 20:58 |
| *** teran has quit IRC | 20:59 | |
| *** nfedotov has quit IRC | 20:59 | |
| pleia2 | I think it's time for lunch :) | 21:00 |
| *** mwagner_lap has quit IRC | 21:00 | |
| *** MaxV has quit IRC | 21:00 | |
| *** nfedotov has joined #openstack-infra | 21:01 | |
| *** erikwilson has joined #openstack-infra | 21:01 | |
| *** wenlock has quit IRC | 21:01 | |
| *** erikwilson has quit IRC | 21:01 | |
| *** otter768 has quit IRC | 21:02 | |
| *** tonytan4ever has joined #openstack-infra | 21:02 | |
| *** dims has joined #openstack-infra | 21:03 | |
| *** btran has joined #openstack-infra | 21:03 | |
| *** tonytan4ever has quit IRC | 21:03 | |
| *** tonytan4ever has joined #openstack-infra | 21:04 | |
| *** belmoreira has joined #openstack-infra | 21:04 | |
| *** annegent_ has joined #openstack-infra | 21:05 | |
| *** dims has quit IRC | 21:08 | |
| *** dkranz has quit IRC | 21:08 | |
| *** hashar has joined #openstack-infra | 21:09 | |
| *** erikmwilson has quit IRC | 21:09 | |
| *** [BNC]erikmwilson is now known as erikmwilson | 21:10 | |
| *** jp_at_hp has joined #openstack-infra | 21:10 | |
| *** mestery has quit IRC | 21:10 | |
| *** MaxV has joined #openstack-infra | 21:10 | |
| *** bdpayne has joined #openstack-infra | 21:10 | |
| *** ociuhandu has quit IRC | 21:11 | |
| mattoliverau | morning | 21:12 |
| *** armax has quit IRC | 21:12 | |
| anteaya | morning mattoliverau | 21:13 |
| *** esker has joined #openstack-infra | 21:13 | |
| *** weshay has quit IRC | 21:13 | |
| *** teran has joined #openstack-infra | 21:13 | |
| *** hdd has joined #openstack-infra | 21:13 | |
| *** zz_sabari is now known as sabari | 21:13 | |
| *** teran_ has quit IRC | 21:14 | |
| *** emagana has quit IRC | 21:14 | |
| *** achanda has quit IRC | 21:15 | |
| *** emagana has joined #openstack-infra | 21:15 | |
| *** dannywilson has quit IRC | 21:16 | |
| *** jp_at_hp has quit IRC | 21:16 | |
| *** dims has joined #openstack-infra | 21:17 | |
| *** esker has quit IRC | 21:17 | |
| *** dannywilson has joined #openstack-infra | 21:17 | |
| *** emagana has quit IRC | 21:19 | |
| *** mfink has quit IRC | 21:21 | |
| *** kgiusti has quit IRC | 21:23 | |
| anteaya | AJaeger: 138749 I'm kind of concerned over how much oversite we are adding to a space that by definition is not overseen | 21:23 |
| anteaya | AJaeger: I am really not wanting to set ourselves up to have to make decisions or arbitrate on stackforge issues | 21:23 |
| JayF | I just had a pep8 job fail in an interesting way; a traceback in pep8 itself. https://gist.github.com/jayofdoom/dc8df0c64a8f594fd5ae -- wanted to see if anyone here has seen it and/or if there's a known brokenness before rechecking | 21:23 |
| *** esker has joined #openstack-infra | 21:24 | |
| anteaya | AJaeger: feel free to move ahead without me, I am comfortable with the patch merging with my concern reflected in my vote and the comments | 21:24 |
| *** teran_ has joined #openstack-infra | 21:25 | |
| anteaya | dhellmann: awesome, thank you | 21:26 |
| *** mfink has joined #openstack-infra | 21:26 | |
| anteaya | AJaeger fungi sorry been talking in person, will get a moment with armax soon | 21:26 |
| *** timcline has joined #openstack-infra | 21:27 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Add elements for Infra servers https://review.openstack.org/140840 | 21:27 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config: Move to using package-installs.yaml https://review.openstack.org/140841 | 21:27 |
| mordred | jeblair, clarkb, fungi: ^^ latest state of the art - those build ubuntu and centos hosts - I have one more thing I need to do for nova-agent on centos | 21:27 |
| *** timcline has quit IRC | 21:27 | |
| mordred | also, all of the upstream dib modifications I've done have landed already | 21:28 |
| mordred | so a large part of taht patch will go away very soon | 21:28 |
| *** teran has quit IRC | 21:28 | |
| *** tonytan4ever has quit IRC | 21:28 | |
| *** julim has quit IRC | 21:29 | |
| *** denis_makogon has quit IRC | 21:31 | |
| *** dmakogon_ has joined #openstack-infra | 21:32 | |
| *** markmcclain has joined #openstack-infra | 21:32 | |
| *** timcline has joined #openstack-infra | 21:32 | |
| *** teran has joined #openstack-infra | 21:32 | |
| *** timcline has quit IRC | 21:32 | |
| *** asettle is now known as asettle-bfast | 21:34 | |
| *** teran_ has quit IRC | 21:36 | |
| *** MaxV has quit IRC | 21:38 | |
| *** timcline has joined #openstack-infra | 21:38 | |
| *** baoli has joined #openstack-infra | 21:39 | |
| *** timcline has quit IRC | 21:39 | |
| openstackgerrit | Merged openstack-infra/infra-specs: Zuul could use different yaml files https://review.openstack.org/133249 | 21:40 |
| *** dizquierdo has joined #openstack-infra | 21:41 | |
| *** tonytan4ever has joined #openstack-infra | 21:42 | |
| *** shashankhegde has quit IRC | 21:42 | |
| *** jcoufal has quit IRC | 21:43 | |
| *** dannywilson has quit IRC | 21:43 | |
| jeblair | wow, did i really approve that? oops. | 21:45 |
| jeblair | clarkb: you previously reviewed that; would you mind giving it a quick review and either +2ing it or reverting it? | 21:45 |
| jeblair | clarkb: i'm really sorry :( | 21:45 |
| anteaya | did you just mean to +2 it? | 21:45 |
| jeblair | yes | 21:45 |
| jeblair | must have slipped | 21:45 |
| *** armax has joined #openstack-infra | 21:46 | |
| clarkb | jeblair: sure | 21:47 |
| jeblair | yep, hit wrong button. | 21:47 |
| *** weshay has joined #openstack-infra | 21:47 | |
| *** hashar has quit IRC | 21:48 | |
| *** armax has quit IRC | 21:49 | |
| *** nfedotov has quit IRC | 21:49 | |
| *** MaxV has joined #openstack-infra | 21:49 | |
| clarkb | jeblair: ya Ithink yolanda addressed my concerns with newer patchsets | 21:49 |
| clarkb | so not necessary to revert | 21:49 |
| *** Ryan_Lane has quit IRC | 21:49 | |
| jeblair | cool, thanks (i thought so too -- i went back and checked) | 21:50 |
| *** Masahiro has joined #openstack-infra | 21:50 | |
| anteaya | in case anyone wonders if it is useful to have an infra person at mid-cycles the answer is yes | 21:51 |
| *** dangers is now known as dangers_away | 21:51 | |
| jeblair | anteaya: cool. we're going to need 500 infra people. ;) | 21:51 |
| anteaya | I get a lot of questions introduced wtih "I've been wanting to ask this for a while, but I didnt' want to bug anyone in -infra channel" | 21:51 |
| anteaya | ha ha ha | 21:51 |
| fungi | jeblair: mordred: any opposition to me enabling puppet agent on the afs/afsdb/kdc servers? i've checked with --noop and the only things of significance being changed are not related to afs or kerberos | 21:52 |
| *** shashankhegde has joined #openstack-infra | 21:52 | |
| anteaya | oh heads up jeblair in case you ever see a spec about testing things as a group in the gate, where either all the patches merge or none of them | 21:53 |
| jeblair | fungi: wfm | 21:53 |
| *** patrickeast has quit IRC | 21:53 | |
| fungi | jeblair: mordred: i can leave afstest untouched for now... though it looks like the only significant changes it would get are possible reversion of a few iptables rules you may have added | 21:53 |
| *** Ryan_Lane has joined #openstack-infra | 21:54 | |
| mordred | fungi: nope. I think we should | 21:54 |
| fungi | jeblair: mordred: great--doing now | 21:54 |
| *** sabari is now known as zz_sabari | 21:54 | |
| jeblair | fungi: yeah, i'd leave afstest out for now; it will be useful for a little longer, but not for long. | 21:54 |
| *** markmcclain has quit IRC | 21:55 | |
| mordred | fungi: if you're poking at those sorts fo things, https://review.openstack.org/#/c/129722/ | 21:55 |
| *** Masahiro has quit IRC | 21:55 | |
| *** zz_sabari is now known as sabari | 21:55 | |
| mordred | fungi: actually - let me go take another pass through that | 21:55 |
| mordred | so nevermind | 21:55 |
| jeblair | anteaya: thanks. that's close, and related to "one-way cross-repo dependencies", but not the same thing. we'll have to get into the nitty gritty on that (some things in this area are desirable, some are actively not desired) | 21:55 |
| anteaya | right | 21:56 |
| fungi | mordred: sure. i mostly wanted to get started playing with afs as a consistent backend for our git server farm, so that we can think about turning off ip persistence in haproxy for better load distribution | 21:56 |
| mordred | fungi: ooh. I like that idea | 21:56 |
| anteaya | so since the short term fix is to make carl baldwin merge all the affected patches (it is easier than editing zuul for now) it might be a bit before he writes the spec but he said the would | 21:57 |
| jhesketh | Morning | 21:57 |
| anteaya | so details can come out of that | 21:57 |
| mordred | anteaya: I like carl baldwin being teh short term fix to things | 21:57 |
| mordred | morning jhesketh | 21:57 |
| * anteaya looks at one-way cross-repo dependencies spec | 21:57 | |
| anteaya | mordred: he doesn't, fortunately his price is "be nice to me" | 21:57 |
| *** baoli_ has joined #openstack-infra | 21:57 | |
| mordred | anteaya: :) | 21:58 |
| anteaya | so we are going to be extra nice to carl for a bit | 21:58 |
| anteaya | :D | 21:58 |
| anteaya | morning jhesketh | 21:58 |
| anteaya | the good news is being nice to carl is easy | 21:58 |
| *** armax has joined #openstack-infra | 21:58 | |
| *** pblaho has quit IRC | 21:58 | |
| *** Longgeek has joined #openstack-infra | 21:58 | |
| asselin | mordred, you wanted to discuss something with me yesterday? | 21:59 |
| anteaya | so how are we marking specs implimented? because I do believe this one is completed: http://specs.openstack.org/openstack-infra/infra-specs/specs/config-repo-split.html | 21:59 |
| mordred | asselin: I did? | 21:59 |
| *** baoli has quit IRC | 21:59 | |
| anteaya | mordred: you did | 21:59 |
| mordred | asselin: that was a long time ago, I'm certain I've forgotten by now ... | 21:59 |
| anteaya | mordred: in the meeting yesterday | 21:59 |
| *** patrickeast has joined #openstack-infra | 21:59 | |
| mordred | asselin: oh! right | 21:59 |
| anteaya | I remember | 22:00 |
| *** wenlock has joined #openstack-infra | 22:00 | |
| mordred | I wanted to connect with you on my crazy plans to rework our launch-node script | 22:00 |
| asselin | ok....I see. I was wondering what you were talking about. | 22:00 |
| *** bswartz has quit IRC | 22:00 | |
| asselin | so this is the nodepool image-creating script? | 22:01 |
| mordred | not quite, but it all winds up being related | 22:01 |
| mordred | I'm currently working on using diskimage-builder to build our images in nodepool | 22:01 |
| jeblair | anteaya: we talked about it pre-specs. sdague was working on it at some point; i think there may be some wip changes in zuul's review queue | 22:01 |
| *** marun has quit IRC | 22:01 | |
| anteaya | ah, I will look there, thanks | 22:02 |
| *** imcsk8 has quit IRC | 22:02 | |
| mordred | asselin: once that's all happy, I want to consolidate the code we use to create nodes, because we use different code to create long-lived servers than we do to create nodepool nodes - but most of the cloud logic needs to be very similar | 22:02 |
| *** imcsk8 has joined #openstack-infra | 22:02 | |
| jeblair | anteaya: also, i don't think we have marked any as implemented. i think there should be a new section/directory for it | 22:02 |
| anteaya | the only spec I was seeing that was close was the nodepool one | 22:02 |
| anteaya | jeblair: would you like me to offer a patch for a new dir? | 22:03 |
| asselin | mordred, interesting | 22:03 |
| *** doug-fish has quit IRC | 22:03 | |
| anteaya | jeblair: I'm thinking implemented/ | 22:03 |
| sdague | trying to gather context? | 22:03 |
| asselin | I haven't looked into dib yet, but I guess I should start sooner than later | 22:04 |
| *** emagana has joined #openstack-infra | 22:04 | |
| *** ryanpetrello has quit IRC | 22:04 | |
| anteaya | sdague: being able merge one-way cross-repo dependencies | 22:04 |
| sdague | oh | 22:04 |
| *** Longgeek has quit IRC | 22:04 | |
| jeblair | anteaya: sounds great | 22:04 |
| *** dprince has quit IRC | 22:04 | |
| anteaya | jeblair: thanks | 22:04 |
| asselin | mordred, quick example of what's different to setup log-lived server and short one for nodepool? | 22:05 |
| *** annegent_ has quit IRC | 22:05 | |
| sdague | yeh, I got a partial patch, but I ended up abandoning it. I can dig it up | 22:05 |
| *** dustins has quit IRC | 22:05 | |
| mordred | asselin: it's just two differetn code bases | 22:05 |
| sdague | https://review.openstack.org/#/c/94365/ | 22:06 |
| *** bdpayne has quit IRC | 22:06 | |
| mordred | asselin: like, we have a script called "launch-node" that we run by hand to add new servers | 22:06 |
| jeblair | sdague: oh, can you explain your last comment there? | 22:06 |
| mordred | asselin: and nodepool has similar but different logic inside of itself to spin up and tear down short-lived ones | 22:06 |
| jeblair | sdague: i think this is actually a really important feature | 22:06 |
| jeblair | i thought we all felt that | 22:06 |
| asselin | mordred, I see. yeah, we're more primite then. we manually launch servers | 22:07 |
| *** sabari is now known as zz_sabari | 22:07 | |
| mordred | asselin: for dib - https://review.openstack.org/#/c/140840/ - if you install latest dib and then grab that patch, the tools/build-base-image.sh will build a very small ubuntu image | 22:07 |
| sdague | jeblair: maybe. It turns out you have to solve a lot of the things that git solves with parents | 22:07 |
| sdague | multiply so, and worse, cycles | 22:07 |
| mordred | asselin: yah. well, our long-lived servers are essentially manual - which is one of the things I want to fix | 22:08 |
| jeblair | yeah, we can't have cycles (just kick them out with an error if one is detected) | 22:08 |
| sdague | so if someone else wants to run with it, that's a starting point | 22:08 |
| *** jamielennox|away has quit IRC | 22:08 | |
| asselin | mordred, I start looking into dib and that patch. thanks! | 22:08 |
| *** shakamunyi has quit IRC | 22:08 | |
| jeblair | sdague: okay, well, "i have decided not to work on this anymore" and "i'm not convinced this is a good idea" are different. | 22:08 |
| sdague | it's not really on my priority list any more though, because I think that in most cases the right option is to not have that tight commit wise coupling between projects | 22:09 |
| mordred | asselin: cool. I've got to run - but I'll point you at the other work around node spin up when I get back onine | 22:09 |
| mordred | online | 22:09 |
| jeblair | sdague: i do not think the former requires anything further, but i think the latter requires a conversation. | 22:09 |
| *** charz has quit IRC | 22:09 | |
| mordred | woot. latest elements official do build both ubuntu and centos base images | 22:09 |
| *** mattoliverau has quit IRC | 22:09 | |
| *** serverascode___ has quit IRC | 22:09 | |
| *** zz_sabari is now known as sabari | 22:10 | |
| jeblair | sdague: this helps with "i'm adding a test of another project" or "i'm intending to use a new in-development feature in another project" | 22:10 |
| mordred | I have a meeting to run to - when I get back, I will test taht those images work on both clouds | 22:10 |
| clarkb | mordred: and we are still running trusty nodepool so we can likely start pushing on dib nodepool images again | 22:10 |
| sdague | jeblair: right | 22:10 |
| *** jamielennox|away has joined #openstack-infra | 22:10 | |
| clarkb | mordred: tl;dr much excite | 22:10 |
| pleia2 | dhellmann: you handled rss for specs, any thoughts on this change when you have a moment? https://review.openstack.org/#/c/140041/ | 22:10 |
| jeblair | sdague: that's still a think we want to do, right? | 22:10 |
| fungi | i do feel like the extra barrier we've added with testing against released dep versions has significantly diminished the majority of the need for cross-project review dependencies, but there are still cases where projects are tighthly-coupled and don't release or release in tandem | 22:10 |
| *** jamielennox|away is now known as jamielennox | 22:10 | |
| *** cloudnull has quit IRC | 22:10 | |
| *** shakamunyi has joined #openstack-infra | 22:10 | |
| mordred | clarkb: well, don't get too excited yet | 22:10 |
| sdague | well... I'm not convinced thing 2 is a thing we want to encourage | 22:10 |
| mordred | clarkb: I will still need to write the patch to nodepool to properly upload these to both clouds | 22:10 |
| sdague | because it actually makes upgrades quite hard | 22:10 |
| *** mattoliverau has joined #openstack-infra | 22:10 | |
| jeblair | fungi: yeah, i think no amount of wishing in the world is going to cause some of these things not to be tightly coupled | 22:10 |
| *** zigo has quit IRC | 22:11 | |
| clarkb | mordred: ya I have a half dozen nodepool patches that need to get in too | 22:11 |
| mordred | clarkb: which I'm expecting to take a few days to get right | 22:11 |
| fungi | sdague: for example, project-config and system-config repos | 22:11 |
| *** cloudnull has joined #openstack-infra | 22:11 | |
| clarkb | mordred: but at least they are not stalled based on where the server is | 22:11 |
| fungi | we don't release those, and they're tightly coupled | 22:11 |
| sdague | and thing one I'm actually working to get more of the the tests back owned by the project in question | 22:11 |
| mordred | clarkb: yes | 22:11 |
| fungi | at least sometimes | 22:11 |
| mordred | clarkb: totally | 22:11 |
| jeblair | fungi: or any of our 50 puppet repos | 22:11 |
| mordred | clarkb: do any of your patches affect the openstack api interactions? | 22:11 |
| sdague | fungi: yeh, I'm not saying there aren't places where this would be useful | 22:11 |
| *** serverascode___ has joined #openstack-infra | 22:11 | |
| sdague | but I also see some draw backs | 22:12 |
| *** mrmartin has quit IRC | 22:12 | |
| *** zigo has joined #openstack-infra | 22:12 | |
| clarkb | mordred: no, but one of them does interact with dib to do multi image output. you may want to coopt that one | 22:12 |
| mordred | kk | 22:12 |
| *** armax has quit IRC | 22:12 | |
| *** bdpayne has joined #openstack-infra | 22:12 | |
| sdague | which leaves me at, I'm fine if someone else wants to do it (like I won't argue against it) | 22:12 |
| fungi | jeblair: i could get on board with saying we're going to make releases of puppet modules and do so before we consume new features from them, which is why i didn't go there with the example ;) | 22:12 |
| mordred | I just wanted to make sure I don't step on you as I start looking at api operation changes | 22:12 |
| jeblair | sdague: okay, thank you for the work you have done so far | 22:12 |
| *** axelddd has joined #openstack-infra | 22:12 | |
| *** charz has joined #openstack-infra | 22:12 | |
| sdague | what's there was about 95% of the base case IIRC | 22:13 |
| sdague | with just 1 test that wouldn't pass | 22:13 |
| sdague | so hopefully a starting point for someone | 22:13 |
| dougwig | hi infra, can I get another core to look at this devstack change to re-enable neutron with services? it has one +2 and has passed jenkins. https://review.openstack.org/#/c/140572/ thank you. | 22:15 |
| *** r-daneel has quit IRC | 22:16 | |
| *** axelddd has quit IRC | 22:16 | |
| fungi | chmouel: dtroyer: ianw: ^ | 22:16 |
| sdague | mtreinish also has +2 now | 22:16 |
| *** andreaf has quit IRC | 22:17 | |
| jeblair | fungi: our testing of that would have to be fanstastic; and that's a long ways off | 22:17 |
| *** andreaf has joined #openstack-infra | 22:17 | |
| jeblair | (puppet) | 22:17 |
| fungi | jeblair: true | 22:17 |
| jeblair | but yeah, in principle :) | 22:18 |
| *** yamamoto has joined #openstack-infra | 22:19 | |
| jeblair | clarkb, fungi: whichever one of you feels more affinity with subunit2sql, can you review 106584? | 22:19 |
| fungi | lookin | 22:20 |
| anteaya | clarkb: you able to address https://review.openstack.org/#/c/140426/ ? | 22:20 |
| clarkb | anteaya: ya now that nodepool is mostly done I should do that | 22:20 |
| clarkb | I am going to disable puppet on review.o.o now, rename that group, then merge the change and reenable puppet | 22:21 |
| clarkb | fungi: jeblair ^ fyi | 22:21 |
| anteaya | clarkb: thanks | 22:21 |
| *** emagana has quit IRC | 22:21 | |
| fungi | clarkb: k | 22:22 |
| *** emagana has joined #openstack-infra | 22:22 | |
| SergeyLukjanov | jeblair, clarkb, fungi, mordred, are you folks ok with setting up storyboard-dev instance to run drafts on top of it? | 22:22 |
| SergeyLukjanov | https://review.openstack.org/#/c/140469/1 ^^ | 22:22 |
| SergeyLukjanov | if yes, I'd like to mode forward and setup it tomorrow | 22:23 |
| fungi | mordred: yeah, i've been working with krotscheck on that front | 22:23 |
| fungi | er, SergeyLukjanov ^ | 22:23 |
| fungi | sorry mordred | 22:23 |
| jeblair | SergeyLukjanov: you mean to have docs-draft use storyboard-dev... | 22:23 |
| SergeyLukjanov | jeblair, yeah | 22:23 |
| dtroyer | dougwig, fungi, et.al: +A on 140572 | 22:23 |
| SergeyLukjanov | bad wording again, heh | 22:23 |
| jeblair | yeah, makes sense | 22:23 |
| mtreinish | sdague: I need to blindly +A something? | 22:23 |
| *** yamamoto has quit IRC | 22:24 | |
| krotscheck | SergeyLukjanov: We’re waiting on recheck for https://review.openstack.org/#/c/140466/ | 22:24 |
| dtroyer | mtreinish: not today, I beat you to it… | 22:24 |
| mtreinish | fungi: what's the fungi-proxy IRC syntax? I've got a query for jogo: http://paste.openstack.org/show/148986/ | 22:24 |
| fungi | SergeyLukjanov: it helps mitigate a potential security leak where, with some social engineering, you could convince a storyboard admin to test out a malicious front-end which made api calls using their credentials | 22:24 |
| clarkb | anteaya: its renamed and I have approved the change. will reenable puppet once that merges | 22:24 |
| SergeyLukjanov | krotscheck, fungi, so, no need in assistance? | 22:24 |
| SergeyLukjanov | fungi, exactly, that's why I'd like to move it forward | 22:25 |
| fungi | mtreinish: i accept a very loosely-defined human language grammar | 22:25 |
| anteaya | clarkb: thanks armax is happy | 22:25 |
| fungi | SergeyLukjanov: assistance is always welcome | 22:25 |
| *** armax has joined #openstack-infra | 22:25 | |
| *** andreykurilin_ has joined #openstack-infra | 22:25 | |
| SergeyLukjanov | fungi, okay, so, I'd like to try setting up the node for it tomorrow if it'll have +2 from someone else :) | 22:26 |
| dougwig | dtroyer: thank you! | 22:26 |
| *** teran_ has joined #openstack-infra | 22:26 | |
| *** emagana has quit IRC | 22:26 | |
| *** mestery has joined #openstack-infra | 22:26 | |
| fungi | SergeyLukjanov: sure. i'm good with that if krotscheck is | 22:26 |
| SergeyLukjanov | fungi, I've been already doing it on our internal infra with launch_node, so, I think that I know how to do it :) | 22:26 |
| krotscheck | Works for me. | 22:27 |
| fungi | SergeyLukjanov: i'll look over that review here in a few minutes then | 22:27 |
| mtreinish | fungi: oops actuall I made a mistake in that link, one sec | 22:27 |
| *** wenlock has quit IRC | 22:27 | |
| *** teran has quit IRC | 22:27 | |
| *** ddieterly has quit IRC | 22:28 | |
| fungi | mtreinish: okay, i'm connected to the db now so can run whatever query you need once you finalize it | 22:28 |
| SergeyLukjanov | fungi, thx | 22:28 |
| SergeyLukjanov | fungi, oh, the only question I don't know answer for - is how to issue the ssl cert for it? | 22:29 |
| *** dkliban is now known as dkliban_afk | 22:29 | |
| jogo | https://review.openstack.org/#/c/138685/ | 22:29 |
| jogo | is a patch to stable | 22:29 |
| *** emagana has joined #openstack-infra | 22:29 | |
| jogo | but the test names being run don't have juno in the names | 22:29 |
| fungi | SergeyLukjanov: we'd want to use a self-signed cert. easiest to just point it at the snakeoil cert already on the server like we do with review-dev, et al | 22:29 |
| clarkb | jogo: correct | 22:30 |
| SergeyLukjanov | fungi, ack | 22:30 |
| mtreinish | fungi: ok, give this a try: http://paste.openstack.org/show/148987/ | 22:31 |
| *** mfisch has quit IRC | 22:31 | |
| *** obondarev has quit IRC | 22:31 | |
| fungi | mtreinish: it's running now | 22:31 |
| clarkb | jogo: d-g by default sets up devstack to deploy whatever ZUUL_BRANCH version is of things | 22:31 |
| jogo | ahhh | 22:31 |
| clarkb | jogo: when we put juno/icehouse in a job name that implies we are overriding d-g defaults and saying install ZUUL_BRANCH of everything but the current change | 22:32 |
| jogo | that makes it a little harder to detect when stable branches are broken though | 22:32 |
| jogo | but makes sense | 22:32 |
| *** yjiang5_away is now known as yjiang5 | 22:32 | |
| openstackgerrit | Merged openstack-infra/project-config: Fix ACL groups for networking L2GW https://review.openstack.org/140426 | 22:32 |
| clarkb | jogo: so you see that with branchless tempest beacuse tempest only has master but needs to test against juno | 22:32 |
| mtreinish | fungi: fwiw, if the test is working it should have 0 hits and jogo will close the bug :) | 22:32 |
| clarkb | jogo: how so? | 22:32 |
| jogo | clarkb: in graphite | 22:32 |
| clarkb | jogo: the branch info should still be available. gerrit knows it. zuul provides it to jenkins whihc provides it to logstash | 22:32 |
| *** Guest76485 has joined #openstack-infra | 22:32 | |
| clarkb | jogo: hrm ya graphite job name based | 22:33 |
| jeblair | jogo: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-stable-maint | 22:33 |
| jeblair | jogo: http://lists.openstack.org/pipermail/openstack-stable-maint/2014-December/thread.html | 22:33 |
| jogo | clarkb: right, its not that big of a deal though | 22:33 |
| *** Guest76485 is now known as mfisch | 22:33 | |
| clarkb | jogo: though zuul knows it and reports the graphite data. it may actually split by branch | 22:33 |
| fungi | mtreinish: jogo: Empty set (2 min 20.11 sec) | 22:33 |
| fungi | congrats! | 22:33 |
| *** tnovacik has quit IRC | 22:34 | |
| jogo | jeblair: good point, the periodic-stable queue | 22:34 |
| clarkb | did mordred ever review the mysql proxy change? we should feed him pizza and beer until he does that | 22:34 |
| mtreinish | fungi: awesome thanks | 22:34 |
| mtreinish | clarkb: no, mordred hasn't done that yet | 22:35 |
| *** nelsnelson has quit IRC | 22:35 | |
| jogo | fungi: woot, thanks | 22:35 |
| mtreinish | clarkb: I also want to start working on my LCA talk on it, but I'm kinda blocked because I can't get to the data... | 22:35 |
| mtreinish | fungi: 2min seems kinda slow, while you still have things open, how big are things now? | 22:36 |
| clarkb | jeblair: fungi jhesketh SergeyLukjanov any opposition to making mordred do post merge review? | 22:36 |
| *** baoli_ has quit IRC | 22:37 | |
| *** baoli has joined #openstack-infra | 22:38 | |
| *** dannywilson has joined #openstack-infra | 22:38 | |
| jeblair | clarkb: fyi i negated some of your early comments on 129255 :( | 22:38 |
| *** dannywilson has quit IRC | 22:38 | |
| *** jedimike has joined #openstack-infra | 22:39 | |
| *** cnesa2 has quit IRC | 22:39 | |
| *** dannywilson has joined #openstack-infra | 22:39 | |
| *** tonytan4ever has quit IRC | 22:39 | |
| *** marun has joined #openstack-infra | 22:40 | |
| jeblair | clarkb: i feel like mordred is mostly back from his being very afk recently though is at a meeting right now.... could we give him a couple more hours? | 22:40 |
| fungi | mtreinish: specific count queries you want me to run? | 22:40 |
| clarkb | jeblair: sure | 22:40 |
| jedimike | jeblair, hi, thanks for your review of the fail-fast spec, with your feedback I'm not sure if it's something I should pursue, although clarkb and sdague were keen on it and it would help us in gozer with our limited resources. What do you think? | 22:40 |
| clarkb | jeblair: and re 129255 thats fine. I don't know that I was super happy with what I had come with either, but wanted to drive the discussion to keeping the yaml as a datastructure that made sense structurally | 22:40 |
| mtreinish | fungi: yeah if you don't mind running a count on the runs, test_runs, and run_metadata tables | 22:41 |
| clarkb | jeblair: oh good point on making it a job attribute | 22:41 |
| clarkb | and yes in geneal I agree. Fail fast is a thing we attempted and it never really panned out so not entirely convinced it will help | 22:42 |
| openstackgerrit | Anita Kuno proposed openstack-infra/infra-specs: Adds an implemented directory https://review.openstack.org/140853 | 22:42 |
| jeblair | jedimike: i had meant to say that i think it is something that you should pursue; i may not have communicated it that well.... let me try again :) | 22:42 |
| *** groknix has joined #openstack-infra | 22:42 | |
| *** emagana has quit IRC | 22:42 | |
| clarkb | but I also don't think zuul should refuse to add the feature | 22:43 |
| clarkb | maybe that is what jeblair meant | 22:43 |
| *** emagana has joined #openstack-infra | 22:43 | |
| jeblair | jedimike: i think it is a fine feature to have in zuul. people keep asking for it, and it shouldn't be too hard to do, relatively speaking. i think many of the times people think that it would be totally awsome they haven't thought through all the issues, so it's not a silver bullet for some of the problems people want to apply it to. | 22:43 |
| *** hdd has quit IRC | 22:43 | |
| *** armax has quit IRC | 22:44 | |
| jeblair | jedimike: for that reason, it's probably not going to be our highest priority review item -- so you should expect slower than normal review turnaround times | 22:44 |
| jeblair | jedimike: but i'd be very happy to have the feature, and if you want to proceed, addressing the specific comments i marked with (-1) is the way to go, i think | 22:44 |
| *** mriedem has quit IRC | 22:44 | |
| openstackgerrit | Anita Kuno proposed openstack-infra/infra-specs: Adds an implemented directory https://review.openstack.org/140853 | 22:44 |
| *** craigbr has quit IRC | 22:44 | |
| fungi | mtreinish: 27421 runs, 24074155 test_runs, 329052 run_metadata | 22:44 |
| fungi | mtreinish: count on test_runs took the longest, at 1 min 39.44 sec | 22:45 |
| jedimike | jeblair, ah ok :) I was mainly thinking about our situation in gozer where resources are quite limited, it would certainly help there, and I'd be happy to start the development myself, seems like a good project to cut my zuul teeth on | 22:45 |
| jedimike | i'll work on a new patch with your suggestions | 22:45 |
| jeblair | jedimike: absolutely! and thanks. :) | 22:45 |
| mtreinish | fungi: well at 24 million tests it is kinda big :) | 22:45 |
| openstackgerrit | Khai Do proposed stackforge/python-jenkins: Add a default http timeout for connections to jenkins https://review.openstack.org/138982 | 22:45 |
| mtreinish | I would have expected it to be a bit bigger though | 22:46 |
| jeblair | once it exists, mordred, sdague, clarkb, and i can then all argue about where we should and should not use it in openstack. which will be lots of fun for us. ;) | 22:46 |
| clarkb | ya 27k runs seems low | 22:46 |
| *** bdpayne has quit IRC | 22:46 | |
| fungi | 27m | 22:46 |
| clarkb | fungi: no the first number | 22:46 |
| fungi | oh, that | 22:46 |
| clarkb | which is 27k tempest jobs aiui | 22:46 |
| fungi | yes | 22:46 |
| fungi | might want to check that against something in graphite i guess | 22:47 |
| mtreinish | clarkb: yeah 27k tempest jobs in the gate since we started this, back around summit seems kinda low | 22:47 |
| clarkb | oh its just gate? that may actually be accurate then | 22:47 |
| clarkb | but ya we can check against graphite | 22:47 |
| *** jedimike has quit IRC | 22:47 | |
| *** emagana has quit IRC | 22:47 | |
| mtreinish | clarkb: well it was gate with poor filtering until: https://review.openstack.org/135493 landed | 22:48 |
| *** cnesa has joined #openstack-infra | 22:48 | |
| jeblair | mtreinish: also, it's not even january and you want to work on your lca talk already? ;) | 22:49 |
| mtreinish | fungi: one more thing can checkthe most recent run in the runs table | 22:49 |
| sdague | jeblair: I believe we should have that conversation in a closed room with a few bottles of whiskey | 22:49 |
| *** wenlock has joined #openstack-infra | 22:49 | |
| jeblair | sdague: i was thinking the same thing :) | 22:49 |
| sdague | and whoever comes out standing declares victory | 22:49 |
| *** esker has quit IRC | 22:50 | |
| jeblair | i will start practicing now | 22:50 |
| jeblair | To Whiskey! | 22:50 |
| sdague | well I'm about to go to a brewery | 22:50 |
| jeblair | To Beer! | 22:51 |
| *** Sukhdev has joined #openstack-infra | 22:52 | |
| mtreinish | jeblair: yeah, it's unusual for me. I'm sure I'll put most of it off until the plane :) | 22:52 |
| *** mattoliverau has quit IRC | 22:53 | |
| *** mattoliverau has joined #openstack-infra | 22:53 | |
| clarkb | mtreinish: that is what 29 hours in a plane is good for | 22:53 |
| mtreinish | I just want to make sure I have enough time to do something with the data | 22:53 |
| mtreinish | clarkb: heh, I'm normally sufficiently uncomfortable squeezed into my seat on a plane using a laptop can be difficult sometimes. | 22:55 |
| fungi | mtreinish: 2014-12-10 22:53:03 | 22:55 |
| *** mmaglana has quit IRC | 22:55 | |
| fungi | utc | 22:55 |
| *** markmcclain has joined #openstack-infra | 22:56 | |
| mtreinish | fungi: thanks, it looks like it's keeping up | 22:56 |
| fungi | yup | 22:56 |
| fungi | running the query a few times, seems to be ~3min behind present | 22:57 |
| *** cpowell has quit IRC | 22:57 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config: Bring up Fedora 21 nodes on rackspace https://review.openstack.org/140857 | 22:58 |
| *** otter768 has joined #openstack-infra | 22:58 | |
| fungi | oh, heads up i'm going to be absent the first half of tomorrow for some appointments | 22:58 |
| *** pc_m has quit IRC | 22:58 | |
| openstackgerrit | Joe Gordon proposed openstack-infra/elastic-recheck: Remove queries for closed bugs https://review.openstack.org/140858 | 22:58 |
| mtreinish | fungi: yeah, I'm still surprised it's keeping up. The test_run inserts got slow in my local testing after a while | 22:58 |
| clarkb | I will be around. Though I am likely out for much of friday and monday | 22:59 |
| *** pc_m has joined #openstack-infra | 22:59 | |
| *** vigneshvar has quit IRC | 22:59 | |
| *** dimtruck is now known as zz_dimtruck | 23:00 | |
| openstackgerrit | Merged openstack-infra/infra-specs: Remove Modulefile from puppet-module spec https://review.openstack.org/134812 | 23:00 |
| anteaya | yes the view of poor mtreinish squished into economy is a sight | 23:01 |
| anteaya | fungi: happy appointments | 23:01 |
| openstackgerrit | Khai Do proposed stackforge/python-jenkins: Add a default http timeout for connections to jenkins https://review.openstack.org/138982 | 23:01 |
| *** tnovacik has joined #openstack-infra | 23:01 | |
| clarkb | anteaya: starting puppet on review.o.o now | 23:01 |
| *** SumitNaiksatam has quit IRC | 23:01 | |
| clarkb | or enabling it | 23:01 |
| anteaya | I'll be offline all tomorrow with travel expecting to be online Friday | 23:01 |
| anteaya | clarkb: kk | 23:01 |
| clarkb | so next puppet run will add the release group | 23:01 |
| anteaya | cll | 23:02 |
| anteaya | cool too | 23:02 |
| anteaya | so 20 minutes ish | 23:02 |
| clarkb | ya | 23:02 |
| *** otter768 has quit IRC | 23:02 | |
| anteaya | k great thank you | 23:02 |
| anteaya | btw anyone who hasn't yet had the pleasure of working with armax, I recommend it | 23:02 |
| *** craigbr has joined #openstack-infra | 23:04 | |
| openstackgerrit | Merged openstack-infra/infra-specs: Workflow documentation is now in infra-manual https://review.openstack.org/139423 | 23:04 |
| openstackgerrit | Khai Do proposed stackforge/python-jenkins: Add a default http timeout for connections to jenkins https://review.openstack.org/138982 | 23:04 |
| *** wenlock has quit IRC | 23:05 | |
| *** dkliban_afk is now known as dkliban | 23:06 | |
| *** ianw has quit IRC | 23:06 | |
| *** ianw has joined #openstack-infra | 23:06 | |
| *** Rockyg has joined #openstack-infra | 23:07 | |
| *** tnovacik has quit IRC | 23:07 | |
| *** zz_avozza is now known as avozza | 23:08 | |
| jeblair | clarkb, fungi: also, heads up, we are forecast to get a severe rainstorm tomorrow, so i might have power outages, flooding, etc to deal with | 23:10 |
| fungi | jeblair: noted--thanks | 23:10 |
| jeblair | we lose power here in storms that would be considered "a gentle spring rain" in NC. | 23:10 |
| *** bdpayne has joined #openstack-infra | 23:10 | |
| jeblair | but 3-4 inches in not insignificant anywhere | 23:11 |
| fungi | well, you are just a little ways north of a partially-reclaimed desert | 23:11 |
| *** wenlock has joined #openstack-infra | 23:11 | |
| *** annegent_ has joined #openstack-infra | 23:11 | |
| *** esker has joined #openstack-infra | 23:11 | |
| *** emagana has joined #openstack-infra | 23:11 | |
| anteaya | jeblair: stay dry | 23:12 |
| jeblair | fungi: oddly enough, desert communities are usually better equipped to deal with torrential rain than we are... | 23:12 |
| anteaya | jeblair: any risk to property? | 23:12 |
| fungi | heh | 23:12 |
| jeblair | something about having hundreds of square miles of catch basin funneling it all toward you... | 23:12 |
| fungi | good point, when they get rain they get _hard_ rain | 23:12 |
| *** resker has joined #openstack-infra | 23:12 | |
| fungi | and major flash flooding | 23:12 |
| *** asettle-bfast is now known as asettle | 23:12 | |
| jeblair | anteaya: yeah, but probably less than the riots and looting that's been going on the last few days | 23:13 |
| anteaya | :( | 23:13 |
| anteaya | stay safe from the riots | 23:13 |
| anteaya | are you in a high risk area? | 23:13 |
| pleia2 | I avoided an event on monday in berkeley because of it :\ probably for the best, bart was expressing through some downtown stations anyway, not sure I would have made it anyway | 23:14 |
| jeblair | they've generally been focusing on downtown business districts and highways | 23:14 |
| *** thedodd has joined #openstack-infra | 23:14 | |
| *** groknix has quit IRC | 23:14 | |
| *** belmoreira has quit IRC | 23:14 | |
| anteaya | glad that means you are lower risk, but still :( | 23:14 |
| jeblair | pleia2: yeah, would have been tricky. i think you have to have up to the minute info to plan trips like that now | 23:15 |
| pleia2 | yeah | 23:15 |
| anteaya | and yay neutron is now unfrozen http://lists.openstack.org/pipermail/openstack-dev/2014-December/052713.html | 23:15 |
| anteaya | mestery and dougwig are very grateful for the help | 23:16 |
| jeblair | "avoid areas with helicopters overhead" is a good rule of thumb once you're over here; doesn't help planning a bart trip tho | 23:16 |
| anteaya | thanks so much | 23:16 |
| *** esker has quit IRC | 23:16 | |
| mestery | Indeed, thank you to all in infra for their awesome help this week! | 23:16 |
| pleia2 | heh, no, there were helicopters here too and our protests stopped mostly | 23:16 |
| mestery | I feel like we had great team work this week, it was really awesome! | 23:16 |
| anteaya | mestery: yay | 23:16 |
| jeblair | yay people who worked on this! :) | 23:17 |
| anteaya | :) | 23:17 |
| mestery | It was truly epic to be a part of jeblair. :) | 23:17 |
| anteaya | I find it epic to be a part of jeblair | 23:17 |
| mestery | lol | 23:18 |
| jeblair | spoken like my right hand | 23:18 |
| mestery | OK, I've got to run and catch my flight soon. I'll be back online tomorrow, thanks again folks! | 23:18 |
| anteaya | ha ha ha | 23:18 |
| anteaya | mestery: happy trails | 23:18 |
| *** amitgandhinz has quit IRC | 23:18 | |
| mestery | You too anteaya! | 23:18 |
| *** mestery has quit IRC | 23:18 | |
| *** wenlock has quit IRC | 23:20 | |
| *** thedodd has quit IRC | 23:20 | |
| bknudson | does the CI use MyISAM MySQL engine? | 23:21 |
| bknudson | wondering about this commit message: https://review.openstack.org/#/c/138712/6//COMMIT_MSG | 23:21 |
| jeblair | bknudson: we explicitly set the default to myisam because it's the wrong choice for openstack... | 23:22 |
| jeblair | bknudson: that way, programs that assume that the default is innodb but do explicitly set it break | 23:22 |
| *** marun has quit IRC | 23:23 | |
| *** groknix has joined #openstack-infra | 23:23 | |
| bknudson | jeblair: ohhh... guess we need better testing. | 23:23 |
| bknudson | I think better testing is coming. | 23:23 |
| *** groknix has quit IRC | 23:23 | |
| *** craigbr has quit IRC | 23:23 | |
| jeblair | bknudson: yeah, i guess if you haven't noticed it till now, you're probably not exercising it... | 23:23 |
| jeblair | it was a big problem in nova early on | 23:23 |
| jeblair | thus the counter-intuitive default setting | 23:24 |
| *** kumartin has joined #openstack-infra | 23:24 | |
| bknudson | it hit us in keystone too... but then new tables get added and we forgot, and didn't test well on real system. | 23:24 |
| jeblair | at any rate, it should definitely not be taken as an endorsement of myisam -- it's just there so that our test systems imitate a "lazy sysadmin" | 23:24 |
| bknudson | it's the default in older RHEL... I was just surprised to see that CI was forcing it. | 23:25 |
| *** ayoung is now known as ayoung_dad_mode | 23:26 | |
| jeblair | i'll leave a comment in that change letting people know why | 23:26 |
| openstackgerrit | Matthew Treinish proposed openstack-infra/devstack-gate: Revert "Temporarily disable testing lbaas, fwaas, and vpnaas" https://review.openstack.org/140864 | 23:26 |
| *** signed8bit is now known as signed8bit_ZZZzz | 23:27 | |
| *** kmartin has joined #openstack-infra | 23:27 | |
| *** ChuckC has quit IRC | 23:28 | |
| *** dizquierdo has quit IRC | 23:28 | |
| *** ryanpetrello has joined #openstack-infra | 23:29 | |
| *** whoops has quit IRC | 23:29 | |
| *** pradk has quit IRC | 23:29 | |
| *** r-daneel has joined #openstack-infra | 23:33 | |
| bknudson | jeblair: thanks. | 23:37 |
| *** r-daneel has quit IRC | 23:38 | |
| clarkb | anteaya: arg we missed one... oh well | 23:38 |
| clarkb | thats on me. cleaning it up now | 23:39 |
| *** Masahiro has joined #openstack-infra | 23:39 | |
| mtreinish | dougwig: I'm assuming we should be able to do: https://review.openstack.org/#/c/140864/ now | 23:40 |
| openstackgerrit | Clark Boylan proposed openstack-infra/project-config: Stop using networking-l2gw group https://review.openstack.org/140867 | 23:40 |
| clarkb | anteaya: ^ | 23:40 |
| anteaya | what did I msiss? | 23:40 |
| anteaya | +2 | 23:41 |
| anteaya | sorry about that | 23:41 |
| *** doug-fish has joined #openstack-infra | 23:43 | |
| *** Masahiro has quit IRC | 23:43 | |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: DO NOT MERGE: testing aiopcpu with tempest full https://review.openstack.org/136504 | 23:44 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Set up ssh_known_host based on hostname https://review.openstack.org/136596 | 23:44 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Setup /etc/hosts for aiopcpu https://review.openstack.org/136158 | 23:44 |
| *** doug-fish has left #openstack-infra | 23:44 | |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Allow root user to ssh in as stack https://review.openstack.org/137176 | 23:44 |
| openstackgerrit | Joe Gordon proposed openstack-infra/devstack-gate: Enable live block migration https://review.openstack.org/135768 | 23:44 |
| clarkb | anteaya: no problem. I "deactivated" that group and that change should make everything go | 23:45 |
| clarkb | also seeded release group membership | 23:45 |
| *** ildikov_afk has quit IRC | 23:45 | |
| *** craigbr has joined #openstack-infra | 23:46 | |
| *** ildikov_afk has joined #openstack-infra | 23:46 | |
| *** resker has quit IRC | 23:47 | |
| clarkb | jeblair: my lights just flickered. we are getting bad weather too | 23:49 |
| openstackgerrit | Khai Do proposed openstack-infra/jenkins-job-builder: deprecate postbuildscript onsuccess and onfailure parameter names https://review.openstack.org/139257 | 23:49 |
| *** r-daneel has joined #openstack-infra | 23:50 | |
| *** ryanpetrello has quit IRC | 23:50 | |
| *** dannywilson has quit IRC | 23:51 | |
| *** sabari is now known as zz_sabari | 23:51 | |
| *** zz_sabari is now known as sabari | 23:51 | |
| *** sabeen has quit IRC | 23:51 | |
| *** annegent_ has quit IRC | 23:51 | |
| *** esker has joined #openstack-infra | 23:52 | |
| *** dannywil_ has joined #openstack-infra | 23:54 | |
| dougwig | mtreinish: driving back to Boise right now. let me sanity test before we revert. | 23:55 |
| *** dannywil_ has quit IRC | 23:55 | |
| *** esker has quit IRC | 23:56 | |
| mtreinish | dougwig: ok sure, but won't it self test. (ie the gate will kick it out if we missed something) | 23:56 |
| mtreinish | anyway we can pick it up tomorrow | 23:56 |
| *** SumitNaiksatam has joined #openstack-infra | 23:56 | |
| *** esker has joined #openstack-infra | 23:57 | |
| *** cnesa has quit IRC | 23:57 | |
| anteaya | clarkb: kk, thanks | 23:58 |
| *** SumitNaiksatam has quit IRC | 23:58 | |
| openstackgerrit | Steve Baker proposed openstack-infra/project-config: Make check-heat-dsvm-functional-mysql voting https://review.openstack.org/138940 | 23:58 |
| *** straycat has left #openstack-infra | 23:58 | |
| *** esker has quit IRC | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!