| clarkb | ianw: yup | 00:00 |
|---|---|---|
| clarkb | should probably scan the lot once we think they are done and double check the kernel version but otehrwise that should be it | 00:00 |
| ianw | we can also watch the graph and make sure they're all lower. or is it higher :) anyway, together | 00:01 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Grafana: switch zuul executor ram metric https://review.openstack.org/544746 | 00:04 |
| clarkb | ianw: ^ I think its about to change too :) | 00:04 |
| *** dingyichen has joined #openstack-infra | 00:07 | |
| mnaser | is gerrit being extra slow or is it just me | 00:07 |
| clarkb | there have been a few gc blips over the last day but nothing crazy | 00:08 |
| clarkb | looking at melody over the last week I'm not sure I'm seeing anything systemic there | 00:08 |
| mnaser | its the first time i work with a bigger repo, maybe operations against nova take a bit slower and im not used to it | 00:08 |
| clarkb | oh ya nova is huge and will probably be slower | 00:08 |
| clarkb | ze08 is rebooted and zuul and afs are happy | 00:12 |
| *** jcoufal_ has joined #openstack-infra | 00:12 | |
| *** jcoufal has quit IRC | 00:12 | |
| ianw | ze09 shutting down now | 00:14 |
| *** jcoufal has joined #openstack-infra | 00:15 | |
| *** signed8bit is now known as signed8bit_Zzz | 00:18 | |
| *** jcoufal_ has quit IRC | 00:18 | |
| *** caphrim007_ has joined #openstack-infra | 00:21 | |
| *** jcoufal_ has joined #openstack-infra | 00:22 | |
| *** caphrim007_ has quit IRC | 00:22 | |
| *** caphrim007_ has joined #openstack-infra | 00:23 | |
| *** jcoufal has quit IRC | 00:23 | |
| *** caphrim007 has quit IRC | 00:24 | |
| *** jcoufal has joined #openstack-infra | 00:27 | |
| *** caphrim007_ has quit IRC | 00:27 | |
| *** jcoufal_ has quit IRC | 00:28 | |
| ianw | ze09 back, and looks like everything updated http://paste.openstack.org/show/672912/ | 00:28 |
| *** bobh has joined #openstack-infra | 00:28 | |
| *** jcoufal_ has joined #openstack-infra | 00:30 | |
| clarkb | and now we wait and watch | 00:31 |
| ianw | is it just me, or are all the recents stats for ze02 on http://grafana01.openstack.org/dashboard/db/zuul-status @ 0 | 00:32 |
| *** jcoufal has quit IRC | 00:32 | |
| ianw | is it not getting to statsd or something? | 00:32 |
| clarkb | ianw: when you redid the network interface maybe it borked the statds module? | 00:33 |
| *** jcoufal has joined #openstack-infra | 00:33 | |
| *** suhdood has joined #openstack-infra | 00:33 | |
| clarkb | assuming the process was running through that time period | 00:33 |
| clarkb | unrelated but apparently dtrace is getting relicensed and going into linux | 00:33 |
| ianw | clarkb: no, zuul-executor was shutdown during that period | 00:34 |
| ianw | oooohhhh ... but the ip changed. i'm now thinking firewalls | 00:34 |
| clarkb | oh ya if the ip changed then ya need firweall to be "restarted" probably | 00:35 |
| clarkb | on graphite.openstack.org | 00:35 |
| corvus | i'd start with the one on zuul.openstack.org | 00:35 |
| *** jcoufal_ has quit IRC | 00:36 | |
| corvus | hrm, that seems to be okay, ianw did you do that one already? | 00:36 |
| clarkb | corvus: that one uses your new firewall stuff iirc | 00:36 |
| ianw | corvus: no, i didn't reload any firewalls. graphite also has an entry for the ip | 00:36 |
| clarkb | which would detect the update and apply it | 00:37 |
| corvus | clarkb: ah, good point | 00:37 |
| clarkb | oh if graphite already ahs the ip then maybe something else. check iptables on ze02 and on graphite.o.o? | 00:37 |
| clarkb | er | 00:37 |
| corvus | ianw: reverse dns is missng | 00:37 |
| clarkb | s/iptables/tcpdump/ | 00:37 |
| *** jcoufal_ has joined #openstack-infra | 00:38 | |
| ianw | hmm, ok, let me see about rdns | 00:38 |
| clarkb | you can add rdns records through the web ui if you open up the server in the web ui | 00:39 |
| corvus | or you can use the dns.py script | 00:39 |
| corvus | that's what the launch script uses | 00:39 |
| *** jcoufal has quit IRC | 00:40 | |
| corvus | ianw, clarkb: it's hostnames | 00:41 |
| corvus | it's transmitting zuul.executor.ze02.load_average | 00:41 |
| ianw | ok, rdns is in now | 00:41 |
| *** jcoufal has joined #openstack-infra | 00:42 | |
| corvus | >>> socket.getfqdn() | 00:42 |
| corvus | 'ze02' | 00:42 |
| corvus | there were some extra lines in /etc/hosts | 00:43 |
| corvus | i commented them | 00:43 |
| corvus | er commented them out | 00:43 |
| corvus | and now getfqdn returns the right thing. | 00:43 |
| corvus | anyone have ideas how they got there? | 00:43 |
| clarkb | that may have been an initial reaction to when the hostname stuff "changed" | 00:44 |
| clarkb | but no I don't actually know how that happened | 00:44 |
| ianw | odd ... not me ... there were hostname updates a while ago? | 00:44 |
| corvus | yeah, i'm wondering what piece of software wrote that | 00:44 |
| corvus | ianw: it's the new ip addresses | 00:44 |
| *** jcoufal_ has quit IRC | 00:44 | |
| *** olaph1 has joined #openstack-infra | 00:44 | |
| corvus | so i suspect it's in response to the ip change | 00:44 |
| ianw | cloud-init? | 00:44 |
| corvus | i just want to know what mechanism did it | 00:44 |
| corvus | we remove cloud-init | 00:44 |
| corvus | i thought? | 00:45 |
| clarkb | ya I thought we did too | 00:45 |
| clarkb | and those nodes shouldn't have glean | 00:45 |
| corvus | though... dpkg says it's installed | 00:45 |
| clarkb | hrm | 00:45 |
| *** olaph has quit IRC | 00:45 | |
| ianw | no logs for 2018 though | 00:46 |
| *** jcoufal_ has joined #openstack-infra | 00:47 | |
| clarkb | not to interrupt but the numbers we get back about available memory seem to ignore swap now | 00:47 |
| *** Goneri has quit IRC | 00:47 | |
| clarkb | not sure if we changed anything other than the kernel to get that | 00:47 |
| *** camunoz has quit IRC | 00:47 | |
| corvus | clarkb: which numbers? | 00:47 |
| clarkb | corvus: the available ram numbers in grafana | 00:47 |
| corvus | clarkb: that's always been the case | 00:47 |
| clarkb | oh I must've misunderstand the number confusion about that at one time | 00:48 |
| corvus | clarkb: that was a theory, but i ended up discounting it | 00:48 |
| clarkb | gotcha | 00:48 |
| *** jcoufal has quit IRC | 00:48 | |
| corvus | clarkb: the discrepancy between grafana and cacti is mostly due to differing accounting. grafana's numbers are more accurate; cacti includes slab in 'used'. | 00:49 |
| *** tosky has quit IRC | 00:50 | |
| corvus | (by coincidence, the fact that the old kernel wasn't apparently able to reclaim slab, and we had lots of slab, made it look like cacti was more accurace, since it turns out if slab isn't reclaimable, it may as well be counted as 'used') | 00:50 |
| *** mriedem has quit IRC | 00:50 | |
| corvus | i'll restart the executor on ze02 | 00:50 |
| *** jcoufal has joined #openstack-infra | 00:51 | |
| corvus | i wonder if rackspace wrote out the new /etc/hosts behind the scenes | 00:51 |
| clarkb | via nova agent? that could be | 00:52 |
| *** jcoufal_ has quit IRC | 00:52 | |
| *** jcoufal_ has joined #openstack-infra | 00:54 | |
| *** bstinson has quit IRC | 00:54 | |
| *** bstinson has joined #openstack-infra | 00:54 | |
| *** dave-mccowan has joined #openstack-infra | 00:54 | |
| fungi | i wonder if nova-agent mangles /etc/hosts on address changes? | 00:55 |
| *** jcoufal has quit IRC | 00:56 | |
| *** r-daneel has quit IRC | 00:56 | |
| corvus | zuul.executor.ze02.openstack.org.starting_builds | 00:57 |
| corvus | that's more like it | 00:57 |
| ianw | https://github.com/Rackspace-DOT/nova-agent/blob/master/novaagent/libs/debian.py ... seems to call hostnamectl maybe? | 00:57 |
| ianw | hostnamectl doesn't seem to touch /etc/hosts | 00:59 |
| corvus | well, it's systemdbus, anything could happen | 00:59 |
| ianw | "I don't know exact reason why nova-agent put records for all assigned interfaces into this file however it shouldn't affect any well written software. " | 01:04 |
| ianw | https://www.drupal.org/project/barracuda/issues/2009374#comment-7632457 | 01:04 |
| corvus | well, it affects python. not sure what that says. | 01:17 |
| mnaser | are you running cloud-init? | 01:20 |
| fungi | if only we'd chosen php like drupal? | 01:20 |
| mnaser | https://github.com/cloud-init/cloud-init/blob/22a14a6a6d45ae55d2c2307d7b097eef9863bb0c/cloudinit/config/cc_update_etc_hosts.py | 01:20 |
| *** jcoufal_ has quit IRC | 01:20 | |
| *** jcoufal_ has joined #openstack-infra | 01:21 | |
| *** jcoufal has joined #openstack-infra | 01:26 | |
| ianw | mnaser: no, cloud-init doesn't run | 01:26 |
| *** rossella_s has quit IRC | 01:26 | |
| *** rossella_s has joined #openstack-infra | 01:27 | |
| *** jcoufal_ has quit IRC | 01:27 | |
| *** caphrim007 has joined #openstack-infra | 01:28 | |
| * mnaser shurgs | 01:29 | |
| * mnaser shrugs | 01:29 | |
| *** jcoufal_ has joined #openstack-infra | 01:30 | |
| *** jcoufal has quit IRC | 01:32 | |
| *** caphrim007 has quit IRC | 01:33 | |
| *** numans has quit IRC | 01:34 | |
| *** jcoufal has joined #openstack-infra | 01:34 | |
| *** olaph has joined #openstack-infra | 01:36 | |
| *** jcoufal_ has quit IRC | 01:36 | |
| *** jcoufal_ has joined #openstack-infra | 01:38 | |
| *** olaph1 has quit IRC | 01:38 | |
| *** jcoufal has quit IRC | 01:40 | |
| *** jcoufal has joined #openstack-infra | 01:41 | |
| *** jcoufal_ has quit IRC | 01:45 | |
| *** lbragstad has quit IRC | 01:45 | |
| *** jcoufal_ has joined #openstack-infra | 01:46 | |
| *** jcoufal has quit IRC | 01:48 | |
| *** jcoufal has joined #openstack-infra | 01:50 | |
| *** jcoufal_ has quit IRC | 01:52 | |
| *** jcoufal_ has joined #openstack-infra | 01:54 | |
| *** jcoufal has quit IRC | 01:56 | |
| *** jcoufal has joined #openstack-infra | 01:59 | |
| *** jcoufal_ has quit IRC | 02:00 | |
| *** iyamahat has quit IRC | 02:01 | |
| *** jamesmcarthur has joined #openstack-infra | 02:01 | |
| *** yamahata has quit IRC | 02:01 | |
| *** jcoufal_ has joined #openstack-infra | 02:02 | |
| *** jcoufal has quit IRC | 02:04 | |
| *** jcoufal has joined #openstack-infra | 02:06 | |
| *** jcoufal_ has quit IRC | 02:08 | |
| *** jcoufal_ has joined #openstack-infra | 02:09 | |
| *** jcoufal has quit IRC | 02:12 | |
| *** slaweq has joined #openstack-infra | 02:13 | |
| *** slaweq has quit IRC | 02:18 | |
| dmsimard | Gerrit 2.13.10 is out | 02:18 |
| dmsimard | https://gerrit.googlesource.com/gerrit/+log/v2.13.9..v2.13.10?no-merges | 02:19 |
| *** ihrachys has quit IRC | 02:20 | |
| *** caphrim007 has joined #openstack-infra | 02:22 | |
| openstackgerrit | megan guiney proposed openstack-infra/subunit2sql master: Add delete by uuid functions https://review.openstack.org/537775 | 02:31 |
| *** olaph1 has joined #openstack-infra | 02:32 | |
| *** olaph has quit IRC | 02:33 | |
| *** slaweq has joined #openstack-infra | 02:36 | |
| *** slaweq has quit IRC | 02:39 | |
| *** caphrim007_ has joined #openstack-infra | 02:42 | |
| *** ramishra has joined #openstack-infra | 02:43 | |
| *** salv-orlando has joined #openstack-infra | 02:44 | |
| *** caphrim007 has quit IRC | 02:46 | |
| *** salv-orl_ has quit IRC | 02:47 | |
| *** jamesmcarthur has quit IRC | 02:50 | |
| *** iyamahat has joined #openstack-infra | 02:58 | |
| *** bobh has quit IRC | 02:59 | |
| *** jcoufal has joined #openstack-infra | 02:59 | |
| *** jcoufal_ has quit IRC | 03:00 | |
| *** bobh has joined #openstack-infra | 03:02 | |
| *** jamesmcarthur has joined #openstack-infra | 03:06 | |
| *** jcoufal_ has joined #openstack-infra | 03:06 | |
| *** jcoufal has quit IRC | 03:08 | |
| *** harlowja has quit IRC | 03:08 | |
| *** jamesmcarthur has quit IRC | 03:10 | |
| *** jcoufal has joined #openstack-infra | 03:11 | |
| *** jcoufal_ has quit IRC | 03:12 | |
| *** ijw has quit IRC | 03:13 | |
| *** jcoufal_ has joined #openstack-infra | 03:14 | |
| *** jcoufal has quit IRC | 03:16 | |
| *** yamahata has joined #openstack-infra | 03:17 | |
| *** dougwig has quit IRC | 03:21 | |
| *** olaph1 is now known as olaph | 03:21 | |
| *** rossella_s has quit IRC | 03:22 | |
| *** rossella_s has joined #openstack-infra | 03:23 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-openafs master: Add Xenial arm64 support https://review.openstack.org/544764 | 03:24 |
| *** jcoufal has joined #openstack-infra | 03:27 | |
| *** jcoufal_ has quit IRC | 03:28 | |
| *** rlandy|bbl is now known as rlandy | 03:30 | |
| *** jcoufal_ has joined #openstack-infra | 03:30 | |
| *** ijw has joined #openstack-infra | 03:31 | |
| *** jcoufal has quit IRC | 03:32 | |
| *** hongbin has joined #openstack-infra | 03:34 | |
| *** ykarel|away has joined #openstack-infra | 03:34 | |
| *** jcoufal has joined #openstack-infra | 03:34 | |
| *** ijw has quit IRC | 03:35 | |
| *** jcoufal_ has quit IRC | 03:36 | |
| *** suhdood has quit IRC | 03:38 | |
| *** jamesmcarthur has joined #openstack-infra | 03:42 | |
| *** ijw has joined #openstack-infra | 03:43 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-openafs master: Add Xenial arm64 support https://review.openstack.org/544764 | 03:44 |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Add aarch64 configuration https://review.openstack.org/539083 | 03:45 |
| *** jcoufal_ has joined #openstack-infra | 03:46 | |
| *** yamamoto has joined #openstack-infra | 03:47 | |
| *** yamamoto has quit IRC | 03:47 | |
| *** jcoufal has quit IRC | 03:48 | |
| *** ijw has quit IRC | 03:48 | |
| *** jcoufal has joined #openstack-infra | 03:49 | |
| *** yamamoto has joined #openstack-infra | 03:51 | |
| *** jcoufal_ has quit IRC | 03:52 | |
| *** jcoufal_ has joined #openstack-infra | 03:55 | |
| *** jcoufal has quit IRC | 03:58 | |
| *** rosmaita has quit IRC | 04:00 | |
| *** bobh has quit IRC | 04:00 | |
| *** jcoufal has joined #openstack-infra | 04:01 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/puppet-openafs master: Add Xenial arm64 support https://review.openstack.org/544764 | 04:03 |
| *** jcoufal_ has quit IRC | 04:04 | |
| *** jcoufal_ has joined #openstack-infra | 04:06 | |
| *** jcoufal has quit IRC | 04:08 | |
| *** jamesmcarthur has quit IRC | 04:08 | |
| *** jcoufal has joined #openstack-infra | 04:10 | |
| *** jcoufal_ has quit IRC | 04:12 | |
| *** jogo has quit IRC | 04:13 | |
| *** gyee has quit IRC | 04:14 | |
| *** jcoufal_ has joined #openstack-infra | 04:14 | |
| *** jcoufal has quit IRC | 04:16 | |
| ianw | gema: http://mirror.cn1.linaro.openstack.org/ ... remotely i end up with "connection reset by peer". however a wget from another linaro cloud host works. it *could* be the host as it's with new kernel & new openafs packages, but there's no errors and it looks like apache sent things ok | 04:17 |
| ianw | ergo i suspect something in the external net might be getting in the way? | 04:18 |
| *** jcoufal has joined #openstack-infra | 04:18 | |
| *** jcoufal_ has quit IRC | 04:20 | |
| *** ijw has joined #openstack-infra | 04:21 | |
| *** cshastri has joined #openstack-infra | 04:22 | |
| *** jcoufal_ has joined #openstack-infra | 04:22 | |
| *** jcoufal has quit IRC | 04:24 | |
| *** dave-mccowan has quit IRC | 04:25 | |
| *** ijw has quit IRC | 04:26 | |
| *** jcoufal has joined #openstack-infra | 04:26 | |
| *** VW has joined #openstack-infra | 04:27 | |
| *** psachin has joined #openstack-infra | 04:28 | |
| *** jcoufal_ has quit IRC | 04:28 | |
| *** jcoufal_ has joined #openstack-infra | 04:30 | |
| *** jcoufal has quit IRC | 04:32 | |
| *** masber has joined #openstack-infra | 04:33 | |
| *** jcoufal has joined #openstack-infra | 04:34 | |
| *** links has joined #openstack-infra | 04:34 | |
| *** rlandy has quit IRC | 04:35 | |
| *** jcoufal_ has quit IRC | 04:36 | |
| *** jcoufal_ has joined #openstack-infra | 04:38 | |
| *** lpetrut has joined #openstack-infra | 04:39 | |
| *** jcoufal has quit IRC | 04:40 | |
| *** links has quit IRC | 04:42 | |
| *** hongbin has quit IRC | 04:43 | |
| *** jcoufal_ has quit IRC | 04:44 | |
| *** links has joined #openstack-infra | 04:45 | |
| *** jcoufal_ has joined #openstack-infra | 04:46 | |
| *** rkukura_ has joined #openstack-infra | 04:47 | |
| *** rkukura has quit IRC | 04:47 | |
| *** rkukura_ is now known as rkukura | 04:47 | |
| *** jcoufal has joined #openstack-infra | 04:47 | |
| *** VW has quit IRC | 04:49 | |
| *** VW has joined #openstack-infra | 04:49 | |
| *** jcoufal_ has quit IRC | 04:50 | |
| *** jcoufal_ has joined #openstack-infra | 04:52 | |
| *** VW has quit IRC | 04:53 | |
| *** jcoufal has quit IRC | 04:54 | |
| *** olaph has quit IRC | 04:55 | |
| *** jcoufal has joined #openstack-infra | 04:56 | |
| *** r-daneel has joined #openstack-infra | 04:57 | |
| *** olaph has joined #openstack-infra | 04:57 | |
| *** janki has joined #openstack-infra | 04:57 | |
| *** jamesmcarthur has joined #openstack-infra | 04:57 | |
| *** jcoufal_ has quit IRC | 04:58 | |
| *** jcoufal_ has joined #openstack-infra | 05:00 | |
| *** jamesmcarthur has quit IRC | 05:02 | |
| *** janki has quit IRC | 05:03 | |
| *** dhajare has joined #openstack-infra | 05:03 | |
| *** jcoufal has quit IRC | 05:03 | |
| *** dhajare is now known as dhajare|mtg | 05:03 | |
| *** janki has joined #openstack-infra | 05:03 | |
| *** janki has quit IRC | 05:06 | |
| *** janki has joined #openstack-infra | 05:06 | |
| *** lpetrut has quit IRC | 05:08 | |
| *** janki has quit IRC | 05:08 | |
| *** jcoufal has joined #openstack-infra | 05:08 | |
| *** janki has joined #openstack-infra | 05:09 | |
| *** threestrands_ has joined #openstack-infra | 05:09 | |
| *** janki has quit IRC | 05:09 | |
| *** threestrands_ has quit IRC | 05:09 | |
| *** threestrands_ has joined #openstack-infra | 05:09 | |
| *** threestrands has quit IRC | 05:09 | |
| *** jogo has joined #openstack-infra | 05:10 | |
| *** jogo has joined #openstack-infra | 05:10 | |
| *** pgadiya has joined #openstack-infra | 05:10 | |
| *** jcoufal_ has quit IRC | 05:10 | |
| *** janki has joined #openstack-infra | 05:10 | |
| *** threestrands_ has quit IRC | 05:10 | |
| *** threestrands_ has joined #openstack-infra | 05:11 | |
| *** jcoufal_ has joined #openstack-infra | 05:12 | |
| *** jcoufal has quit IRC | 05:13 | |
| *** harlowja has joined #openstack-infra | 05:15 | |
| *** threestrands has joined #openstack-infra | 05:15 | |
| *** sree has joined #openstack-infra | 05:15 | |
| *** suhdood has joined #openstack-infra | 05:17 | |
| *** coolsvap has joined #openstack-infra | 05:17 | |
| *** threestrands_ has quit IRC | 05:18 | |
| *** lpetrut has joined #openstack-infra | 05:19 | |
| *** saop has joined #openstack-infra | 05:21 | |
| saop | hello all | 05:21 |
| saop | whats the version of bubblewrap package we should use for Zuulv3? | 05:22 |
| saop | We have Ubuntu Xenial, as vm image. | 05:22 |
| *** jcoufal has joined #openstack-infra | 05:24 | |
| *** jcoufal_ has quit IRC | 05:24 | |
| *** ankkumar has joined #openstack-infra | 05:25 | |
| ianw | saop: i'd say use https://launchpad.net/~openstack-ci-core/+archive/ubuntu/bubblewrap | 05:25 |
| saop | ianw, thanks | 05:26 |
| *** jcoufal_ has joined #openstack-infra | 05:26 | |
| *** armaan has quit IRC | 05:26 | |
| *** armaan has joined #openstack-infra | 05:27 | |
| *** threestrands has quit IRC | 05:28 | |
| *** jcoufal has quit IRC | 05:29 | |
| saop | ianw, We tried that one, but its not working | 05:29 |
| *** armaan has quit IRC | 05:32 | |
| *** armaan has joined #openstack-infra | 05:32 | |
| saop | We are getting this error http://paste.openstack.org/show/673007/ | 05:33 |
| *** lpetrut has quit IRC | 05:34 | |
| *** jcoufal has joined #openstack-infra | 05:36 | |
| *** jaosorior has quit IRC | 05:37 | |
| ianw | "FileNotFoundError: [Errno 2] No such file or directory: 'bwrap'" | 05:38 |
| ianw | are you *sure* it's installed? | 05:38 |
| *** jcoufal_ has quit IRC | 05:39 | |
| *** jcoufal_ has joined #openstack-infra | 05:39 | |
| *** janki has quit IRC | 05:40 | |
| *** janki has joined #openstack-infra | 05:40 | |
| *** wolverineav has joined #openstack-infra | 05:41 | |
| *** kjackal has joined #openstack-infra | 05:41 | |
| *** jcoufal has quit IRC | 05:42 | |
| saop | yeah we can see in dpkg list | 05:42 |
| *** jaosorior has joined #openstack-infra | 05:44 | |
| *** jcoufal has joined #openstack-infra | 05:45 | |
| *** wolverineav has quit IRC | 05:46 | |
| *** jcoufal_ has quit IRC | 05:46 | |
| *** iyamahat has quit IRC | 05:47 | |
| *** jcoufal_ has joined #openstack-infra | 05:48 | |
| *** jcoufal has quit IRC | 05:50 | |
| *** armaan has quit IRC | 05:50 | |
| AJaeger | do you need to configure PATH somehow to find bwrap? | 05:50 |
| AJaeger | is the package installed properly? Check the file list, does it include bwrap? Do you find it on disk? | 05:51 |
| *** jcoufal has joined #openstack-infra | 05:51 | |
| AJaeger | ianw, frickler, could you put https://review.openstack.org/543127 on your review list to get rid of jenkins/scripts, please? | 05:52 |
| *** xcrot has joined #openstack-infra | 05:52 | |
| *** ankkumar_ has joined #openstack-infra | 05:52 | |
| *** jcoufal_ has quit IRC | 05:54 | |
| *** ankkumar has quit IRC | 05:54 | |
| *** jcoufal_ has joined #openstack-infra | 05:57 | |
| *** aeng has quit IRC | 05:58 | |
| *** jcoufal has quit IRC | 05:59 | |
| ianw | saop: also, that's on the executor ... so make sure it's there | 05:59 |
| saop | ianw, AJaeger I am checking | 06:00 |
| *** jcoufal has joined #openstack-infra | 06:01 | |
| *** jcoufal_ has quit IRC | 06:02 | |
| *** lpetrut has joined #openstack-infra | 06:06 | |
| *** xcrot has left #openstack-infra | 06:07 | |
| *** jchhatbar has joined #openstack-infra | 06:09 | |
| *** s-shiono has joined #openstack-infra | 06:09 | |
| *** janki has quit IRC | 06:09 | |
| *** abelur_ has quit IRC | 06:11 | |
| *** jcoufal_ has joined #openstack-infra | 06:11 | |
| saop | ianw, AJaeger Thanks we had mismatch version on executor vm, its working now | 06:12 |
| *** jcoufal has quit IRC | 06:13 | |
| openstackgerrit | Hiroaki Kobayashi proposed openstack-infra/project-config master: Remove the non-voting option of openstack-python35-jobs for blazar repos https://review.openstack.org/544786 | 06:14 |
| *** harlowja has quit IRC | 06:14 | |
| *** slaweq has joined #openstack-infra | 06:15 | |
| *** abelur_ has joined #openstack-infra | 06:15 | |
| *** jcoufal has joined #openstack-infra | 06:16 | |
| *** jcoufal_ has quit IRC | 06:18 | |
| *** lpetrut has quit IRC | 06:19 | |
| *** slaweq has quit IRC | 06:19 | |
| *** saop has quit IRC | 06:20 | |
| *** suhdood has quit IRC | 06:20 | |
| *** jcoufal_ has joined #openstack-infra | 06:20 | |
| *** e0ne has joined #openstack-infra | 06:20 | |
| *** jcoufal has quit IRC | 06:22 | |
| openstackgerrit | Hiroaki Kobayashi proposed openstack-infra/project-config master: Remove the non-voting option of openstack-python35-jobs for blazar repos https://review.openstack.org/544786 | 06:23 |
| *** jcoufal has joined #openstack-infra | 06:25 | |
| *** jcoufal_ has quit IRC | 06:26 | |
| *** jcoufal_ has joined #openstack-infra | 06:27 | |
| *** jcoufal has quit IRC | 06:29 | |
| *** e0ne has quit IRC | 06:30 | |
| *** jcoufal has joined #openstack-infra | 06:31 | |
| *** jcoufal_ has quit IRC | 06:33 | |
| *** numans has joined #openstack-infra | 06:34 | |
| *** jcoufal_ has joined #openstack-infra | 06:35 | |
| *** jcoufal has quit IRC | 06:36 | |
| *** ankkumar__ has joined #openstack-infra | 06:40 | |
| *** ankkumar_ has quit IRC | 06:44 | |
| *** rcernin has quit IRC | 06:44 | |
| *** e0ne has joined #openstack-infra | 06:44 | |
| *** jcoufal has joined #openstack-infra | 06:45 | |
| *** jcoufal_ has quit IRC | 06:47 | |
| *** jbadiapa has joined #openstack-infra | 06:48 | |
| *** jcoufal_ has joined #openstack-infra | 06:48 | |
| *** jcoufal has quit IRC | 06:50 | |
| *** e0ne_ has joined #openstack-infra | 06:51 | |
| *** stakeda has joined #openstack-infra | 06:51 | |
| dirk | ianw: so how is testing related to a xenial update? | 06:54 |
| dirk | Debian testing I mean | 06:54 |
| *** mrodden has quit IRC | 06:54 | |
| *** e0ne_ has quit IRC | 06:55 | |
| *** e0ne has quit IRC | 06:55 | |
| dirk | And how is a bug of libzypp related to zypper ? Two different packages? | 06:55 |
| *** jchhatbar has quit IRC | 06:56 | |
| *** e0ne has joined #openstack-infra | 06:56 | |
| *** janki has joined #openstack-infra | 06:56 | |
| *** eroux has joined #openstack-infra | 06:56 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Consolidate common.sh script copying https://review.openstack.org/543127 | 06:57 |
| AJaeger | ianw: updated, is that naming better? ^ | 06:57 |
| openstackgerrit | Merged openstack-infra/zuul master: Invert executor ram statsd metric https://review.openstack.org/544742 | 06:57 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Install proposal scripts only when needed https://review.openstack.org/541795 | 07:01 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Move release-tools out of jenkins/scripts https://review.openstack.org/542639 | 07:01 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove role legacy-copy-project-config-scripts https://review.openstack.org/543128 | 07:01 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Good bye jenkins/scripts https://review.openstack.org/543130 | 07:01 |
| *** sree has quit IRC | 07:01 | |
| *** jcoufal has joined #openstack-infra | 07:01 | |
| *** sree has joined #openstack-infra | 07:01 | |
| *** jcoufal_ has quit IRC | 07:02 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Consolidate common.sh script copying https://review.openstack.org/543127 | 07:03 |
| * AJaeger is rebasing to avoid conflicts ^ | 07:04 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Install proposal scripts only when needed https://review.openstack.org/541795 | 07:06 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Move release-tools out of jenkins/scripts https://review.openstack.org/542639 | 07:06 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove role legacy-copy-project-config-scripts https://review.openstack.org/543128 | 07:06 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Good bye jenkins/scripts https://review.openstack.org/543130 | 07:06 |
| *** sree has quit IRC | 07:06 | |
| *** dsariel has joined #openstack-infra | 07:07 | |
| *** dsariel_ has joined #openstack-infra | 07:07 | |
| *** threestrands has joined #openstack-infra | 07:09 | |
| *** janki has quit IRC | 07:09 | |
| *** janki has joined #openstack-infra | 07:10 | |
| *** jamesdenton has quit IRC | 07:10 | |
| *** florianf has joined #openstack-infra | 07:12 | |
| *** nikeshm has joined #openstack-infra | 07:15 | |
| nikeshm | my CI is failing from past few hours | 07:15 |
| nikeshm | http://54.209.116.144/66/543066/2/check/kaminario-dsvm-tempest-full-FC/83908d4/logs/devstack-early.txt.gz | 07:15 |
| nikeshm | 2018-02-15 01:11:05.499 | Collecting tinyrpc===0.7 (from -c /opt/stack/new/requirements/upper-constraints.txt (line 499)) 2018-02-15 01:11:05.596 | Could not find a version that satisfies the requirement tinyrpc===0.7 (from -c /opt/stack/new/requirements/upper-constraints.txt (line 499)) (from versions: 0.3.dev0, 0.4, 0.4.1, 0.5, 0.6) | 07:15 |
| *** jcoufal_ has joined #openstack-infra | 07:16 | |
| *** jcoufal has quit IRC | 07:19 | |
| AJaeger | nikeshm: did they release a version 0.8 and remove 0.7 from https://pypi.python.org/pypi/tinyrpc ? Argh ;( | 07:19 |
| AJaeger | nikeshm: best discuss with requirements team on #openstack-requirements channel | 07:19 |
| nikeshm | looks like | 07:19 |
| *** sree has joined #openstack-infra | 07:20 | |
| *** psachin has quit IRC | 07:24 | |
| nikeshm | AJaeger : ok i will ask there | 07:26 |
| *** dsariel has quit IRC | 07:28 | |
| *** rcernin has joined #openstack-infra | 07:28 | |
| *** dsariel_ has quit IRC | 07:28 | |
| *** lpetrut has joined #openstack-infra | 07:29 | |
| tobberydberg | Hi folks! Did a commit 4 weeks ago, hoping to add meetbot to the publiccloud channel. We are looking for a new time for our meetings and just wanted to check with you before that if I'm missing something in the commit or if it isn't possible for other reasons? | 07:30 |
| tobberydberg | https://review.openstack.org/#/c/535318/ | 07:30 |
| *** Diabelko has quit IRC | 07:37 | |
| *** pcaruana has joined #openstack-infra | 07:40 | |
| *** andreas_s has joined #openstack-infra | 07:40 | |
| *** edmondsw has joined #openstack-infra | 07:41 | |
| *** e0ne has quit IRC | 07:43 | |
| *** e0ne has joined #openstack-infra | 07:43 | |
| *** slaweq has joined #openstack-infra | 07:45 | |
| *** edmondsw has quit IRC | 07:45 | |
| *** snapiri has joined #openstack-infra | 07:47 | |
| *** e0ne has quit IRC | 07:49 | |
| *** abelur has quit IRC | 07:53 | |
| *** gfidente has joined #openstack-infra | 07:55 | |
| *** gfidente has joined #openstack-infra | 07:55 | |
| *** dingyichen has quit IRC | 07:55 | |
| *** jcoufal has joined #openstack-infra | 07:58 | |
| *** jcoufal_ has quit IRC | 07:59 | |
| *** psachin has joined #openstack-infra | 07:59 | |
| *** jcoufal_ has joined #openstack-infra | 08:02 | |
| *** eumel8 has joined #openstack-infra | 08:03 | |
| *** jcoufal has quit IRC | 08:04 | |
| *** ykarel|away is now known as ykarel|lunch | 08:04 | |
| *** gibi has joined #openstack-infra | 08:13 | |
| *** slaweq_ has joined #openstack-infra | 08:15 | |
| *** ijw has joined #openstack-infra | 08:17 | |
| *** tesseract has joined #openstack-infra | 08:17 | |
| *** aviau has quit IRC | 08:19 | |
| *** aviau has joined #openstack-infra | 08:19 | |
| *** slaweq_ has quit IRC | 08:20 | |
| *** ijw has quit IRC | 08:21 | |
| *** alexchadin has joined #openstack-infra | 08:22 | |
| *** ari[m] has joined #openstack-infra | 08:23 | |
| *** mdbooth has joined #openstack-infra | 08:24 | |
| *** danpawlik has quit IRC | 08:24 | |
| *** danpawlik has joined #openstack-infra | 08:25 | |
| *** jpena|off is now known as jpena | 08:26 | |
| *** iyamahat has joined #openstack-infra | 08:31 | |
| *** links has quit IRC | 08:35 | |
| *** cshastri has quit IRC | 08:38 | |
| *** ykarel|lunch is now known as ykarel | 08:40 | |
| openstackgerrit | Thierry Carrez proposed openstack/ptgbot master: Refresh every 3 minutes instead of 1 https://review.openstack.org/544810 | 08:41 |
| ianw | dirk: just that if the package isn't making it into testing, I don't think it's going to make it into the next version of ubuntu | 08:46 |
| openstackgerrit | Thierry Carrez proposed openstack-infra/puppet-ptgbot master: Mismatch in room names in Dublin config https://review.openstack.org/544811 | 08:46 |
| ianw | and if libzypp can't be updated, then neither can zypper? | 08:46 |
| ianw | it seems the libzypp depends on gnupg2, but for all those various bugs needs quite a few updates before it can migrate | 08:48 |
| *** nikeshm has quit IRC | 08:50 | |
| ianw | tobberydberg: i think it's ok, feel free to ping infra-root on this in us hours for a double check | 08:51 |
| *** links has joined #openstack-infra | 08:53 | |
| *** cshastri has joined #openstack-infra | 08:53 | |
| *** sshnaidm|off is now known as sshnaidm|ruck | 08:55 | |
| openstackgerrit | Merged openstack/ptgbot master: Remove leftover console.log https://review.openstack.org/544346 | 08:56 |
| *** alexchadin has quit IRC | 08:56 | |
| *** alexchadin has joined #openstack-infra | 08:57 | |
| tobberydberg | Thanks ianw | 08:58 |
| *** jpich has joined #openstack-infra | 08:59 | |
| openstackgerrit | Merged openstack/ptgbot master: Refresh every 3 minutes instead of 1 https://review.openstack.org/544810 | 09:00 |
| *** hashar has joined #openstack-infra | 09:01 | |
| tobberydberg | Maybe a dumb question ianw - but I assume I ping root team here in this channel as well? | 09:01 |
| ianw | tobberydberg: yep | 09:03 |
| tobberydberg | Thx! | 09:03 |
| *** sambetts|afk has quit IRC | 09:03 | |
| ianw | dirk: https://bugs.launchpad.net/debian/+source/zypper/+bug/1731764 <-- that's the issue there i think. afaict it won't make it to bionic, the next ubuntu lts release | 09:03 |
| openstack | Launchpad bug 1731764 in zypper (Debian) "demote libzypp and zypper from proposed, incompatible with new rpm" [Unknown,New] | 09:03 |
| *** shardy has joined #openstack-infra | 09:04 | |
| gema | ianw: very likely the connectivity to the lab from whenever you are doing the wget is getting poor bandwidth, we have seen this from the UK as well | 09:05 |
| gema | ianw: we are working with the provider in improving this, but for now, assume that anyone using it from China will be good, anyone from outside China won't | 09:05 |
| gema | ianw: will keep you posted with progress on that front | 09:06 |
| *** ykarel_ has joined #openstack-infra | 09:06 | |
| *** sambetts_ has joined #openstack-infra | 09:07 | |
| *** ykarel has quit IRC | 09:08 | |
| *** coolsvap has quit IRC | 09:08 | |
| *** amoralej|off is now known as amoralej | 09:09 | |
| *** olaph has quit IRC | 09:09 | |
| *** olaph has joined #openstack-infra | 09:10 | |
| *** oidgar has joined #openstack-infra | 09:11 | |
| *** derekh has joined #openstack-infra | 09:12 | |
| *** ankkumar__ has quit IRC | 09:14 | |
| *** ykarel_ has quit IRC | 09:15 | |
| *** jcoufal has joined #openstack-infra | 09:17 | |
| *** dsariel_ has joined #openstack-infra | 09:18 | |
| *** jcoufal_ has quit IRC | 09:18 | |
| *** dsariel has joined #openstack-infra | 09:18 | |
| *** dtantsur|afk is now known as dtantsur | 09:21 | |
| *** jcoufal_ has joined #openstack-infra | 09:21 | |
| *** threestrands_ has joined #openstack-infra | 09:21 | |
| *** threestrands has quit IRC | 09:21 | |
| *** ykarel has joined #openstack-infra | 09:22 | |
| *** Diabelko has joined #openstack-infra | 09:23 | |
| *** jcoufal has quit IRC | 09:23 | |
| *** ralonsoh has joined #openstack-infra | 09:23 | |
| *** jamesmcarthur has joined #openstack-infra | 09:25 | |
| *** edmondsw has joined #openstack-infra | 09:29 | |
| *** jamesmcarthur has quit IRC | 09:30 | |
| *** jcoufal has joined #openstack-infra | 09:32 | |
| *** oidgar has quit IRC | 09:34 | |
| *** edmondsw has quit IRC | 09:34 | |
| *** ijw has joined #openstack-infra | 09:34 | |
| *** jcoufal_ has quit IRC | 09:35 | |
| *** jcoufal_ has joined #openstack-infra | 09:36 | |
| *** iyamahat has quit IRC | 09:37 | |
| *** alexchadin has quit IRC | 09:37 | |
| *** e0ne has joined #openstack-infra | 09:37 | |
| *** alexchadin has joined #openstack-infra | 09:38 | |
| *** jcoufal has quit IRC | 09:38 | |
| *** ijw has quit IRC | 09:39 | |
| openstackgerrit | Balazs Gibizer proposed openstack-infra/project-config master: consolidate nova job definitions https://review.openstack.org/538908 | 09:42 |
| *** krenczewski has joined #openstack-infra | 09:54 | |
| *** ykarel is now known as ykarel|away | 09:58 | |
| *** kopecmartin has joined #openstack-infra | 09:59 | |
| *** jcoufal has joined #openstack-infra | 09:59 | |
| *** panda|off is now known as panda | 10:01 | |
| *** jcoufal_ has quit IRC | 10:01 | |
| *** jcoufal_ has joined #openstack-infra | 10:03 | |
| *** yamahata has quit IRC | 10:05 | |
| *** jcoufal has quit IRC | 10:05 | |
| *** sree has quit IRC | 10:06 | |
| *** jcoufal has joined #openstack-infra | 10:06 | |
| *** sree has joined #openstack-infra | 10:07 | |
| *** coolsvap has joined #openstack-infra | 10:07 | |
| *** ykarel|away has quit IRC | 10:08 | |
| *** jcoufal_ has quit IRC | 10:08 | |
| *** jcoufal_ has joined #openstack-infra | 10:10 | |
| *** sree has quit IRC | 10:11 | |
| *** jcoufal has quit IRC | 10:13 | |
| *** oidgar has joined #openstack-infra | 10:14 | |
| *** slaweq_ has joined #openstack-infra | 10:16 | |
| *** nikeshm has joined #openstack-infra | 10:19 | |
| *** sambetts_ is now known as sambetts | 10:21 | |
| *** slaweq_ has quit IRC | 10:21 | |
| *** jcoufal has joined #openstack-infra | 10:24 | |
| nikeshm | i reported this | 10:24 |
| nikeshm | https://bugs.launchpad.net/openstack-requirements/+bug/1749651 | 10:24 |
| openstack | Launchpad bug 1749651 in OpenStack Global Requirements "tinyrpc version issue" [Undecided,New] | 10:25 |
| *** jcoufal_ has quit IRC | 10:27 | |
| *** d0ugal has quit IRC | 10:30 | |
| *** ldnunes has joined #openstack-infra | 10:31 | |
| *** d0ugal has joined #openstack-infra | 10:33 | |
| AJaeger | nikeshm: report it to tinyrpc upstream as well, please! They should not just remove old versions... | 10:33 |
| nikeshm | https://github.com/mbr/tinyrpc/issues/45 | 10:34 |
| nikeshm | some one already reported | 10:34 |
| nikeshm | is any where else | 10:34 |
| nikeshm | we should report | 10:34 |
| AJaeger | nikeshm: thanks, that should be all. I see prometheanfire is on it already, he's part of requirements team. | 10:38 |
| *** jcoufal_ has joined #openstack-infra | 10:38 | |
| AJaeger | nikeshm: in OPenStack CI we might be lucky since we mirror old versions, you could copy it from us and make it available to your installs | 10:38 |
| AJaeger | argh, it's gone as well ;( | 10:40 |
| *** panda is now known as panda|reloc | 10:40 | |
| *** jcoufal has quit IRC | 10:40 | |
| *** stakeda has quit IRC | 10:41 | |
| *** jcoufal has joined #openstack-infra | 10:42 | |
| *** jcoufal_ has quit IRC | 10:45 | |
| *** hashar is now known as hasharLunch | 10:45 | |
| *** jcoufal_ has joined #openstack-infra | 10:46 | |
| *** tosky has joined #openstack-infra | 10:48 | |
| *** zoli is now known as zoli|lunch | 10:49 | |
| *** zoli|lunch is now known as zoli | 10:49 | |
| *** jcoufal has quit IRC | 10:49 | |
| *** jcoufal has joined #openstack-infra | 10:50 | |
| *** e0ne has quit IRC | 10:51 | |
| *** jcoufal_ has quit IRC | 10:52 | |
| *** jcoufal_ has joined #openstack-infra | 10:55 | |
| *** jcoufal has quit IRC | 10:57 | |
| *** s-shiono has quit IRC | 10:59 | |
| *** priteau has joined #openstack-infra | 10:59 | |
| *** e0ne has joined #openstack-infra | 10:59 | |
| *** jcoufal has joined #openstack-infra | 10:59 | |
| *** jistr is now known as jistr|mtg | 11:00 | |
| *** jcoufal_ has quit IRC | 11:00 | |
| *** yamamoto has quit IRC | 11:01 | |
| *** jcoufal_ has joined #openstack-infra | 11:03 | |
| *** ykarel has joined #openstack-infra | 11:04 | |
| *** lucas-afk is now known as lucasagomes | 11:04 | |
| *** jcoufal has quit IRC | 11:05 | |
| *** yamamoto has joined #openstack-infra | 11:06 | |
| *** jcoufal has joined #openstack-infra | 11:13 | |
| *** jcoufal_ has quit IRC | 11:15 | |
| *** jcoufal_ has joined #openstack-infra | 11:16 | |
| *** adarazs is now known as adarazs_lunch | 11:17 | |
| *** jcoufal has quit IRC | 11:19 | |
| *** d0ugal has quit IRC | 11:20 | |
| *** ykarel has quit IRC | 11:22 | |
| *** e0ne has quit IRC | 11:24 | |
| *** rfolco|off is now known as rfolco|rover | 11:27 | |
| *** pbourke has quit IRC | 11:30 | |
| *** e0ne has joined #openstack-infra | 11:31 | |
| *** pbourke has joined #openstack-infra | 11:32 | |
| *** d0ugal has joined #openstack-infra | 11:39 | |
| *** pgadiya has quit IRC | 11:40 | |
| *** sree has joined #openstack-infra | 11:45 | |
| *** jcoufal has joined #openstack-infra | 11:47 | |
| *** jcoufal_ has quit IRC | 11:48 | |
| *** jcoufal_ has joined #openstack-infra | 11:50 | |
| *** sree has quit IRC | 11:50 | |
| *** jpena is now known as jpena|lunch | 11:52 | |
| *** jcoufal has quit IRC | 11:53 | |
| *** sree has joined #openstack-infra | 11:55 | |
| *** sree has quit IRC | 11:55 | |
| *** agopi_out has quit IRC | 11:56 | |
| *** sree has joined #openstack-infra | 11:56 | |
| *** sree_ has joined #openstack-infra | 11:57 | |
| *** sree_ is now known as Guest43911 | 11:57 | |
| *** rossella_s has quit IRC | 11:59 | |
| *** armaan has joined #openstack-infra | 12:00 | |
| *** rossella_s has joined #openstack-infra | 12:01 | |
| *** sree has quit IRC | 12:01 | |
| *** jcoufal has joined #openstack-infra | 12:03 | |
| *** jcoufal_ has quit IRC | 12:05 | |
| *** jcoufal_ has joined #openstack-infra | 12:06 | |
| *** olaph1 has joined #openstack-infra | 12:08 | |
| *** jcoufal has quit IRC | 12:09 | |
| *** kjackal_ has joined #openstack-infra | 12:09 | |
| *** yamamoto has quit IRC | 12:09 | |
| *** olaph has quit IRC | 12:09 | |
| *** dave-mccowan has joined #openstack-infra | 12:10 | |
| *** larsks has joined #openstack-infra | 12:11 | |
| *** janki is now known as janki|aafk | 12:12 | |
| *** janki|aafk is now known as janki|afk | 12:12 | |
| *** rossella_s has quit IRC | 12:13 | |
| *** jcoufal_ has quit IRC | 12:14 | |
| *** panda|reloc is now known as panda | 12:15 | |
| *** rossella_s has joined #openstack-infra | 12:17 | |
| *** slaweq_ has joined #openstack-infra | 12:17 | |
| *** slaweq_ has quit IRC | 12:22 | |
| *** yamamoto has joined #openstack-infra | 12:22 | |
| *** jistr|mtg is now known as jistr | 12:23 | |
| *** e0ne has quit IRC | 12:29 | |
| *** abelur has joined #openstack-infra | 12:31 | |
| *** olaph has joined #openstack-infra | 12:35 | |
| *** shardy has quit IRC | 12:35 | |
| *** coolsvap has quit IRC | 12:36 | |
| *** olaph1 has quit IRC | 12:37 | |
| *** yamamoto has quit IRC | 12:39 | |
| *** jcoufal has joined #openstack-infra | 12:40 | |
| *** HeOS has joined #openstack-infra | 12:40 | |
| *** adarazs_lunch is now known as adarazs | 12:41 | |
| *** ansmith has quit IRC | 12:43 | |
| *** jamesmcarthur has joined #openstack-infra | 12:45 | |
| openstackgerrit | Thomas Morin proposed openstack-infra/project-config master: n8g-bagpipe: add n8g-sfc and n8g-bgpvpn deps for fullstack job https://review.openstack.org/544898 | 12:47 |
| *** bobh has joined #openstack-infra | 12:50 | |
| *** jamesmcarthur has quit IRC | 12:52 | |
| *** yamamoto has joined #openstack-infra | 12:54 | |
| *** dprince has joined #openstack-infra | 13:00 | |
| *** bobh has quit IRC | 13:04 | |
| *** yamamoto has quit IRC | 13:05 | |
| *** edmondsw has joined #openstack-infra | 13:06 | |
| *** wolverineav has joined #openstack-infra | 13:06 | |
| *** wolverineav has quit IRC | 13:07 | |
| *** wolverineav has joined #openstack-infra | 13:07 | |
| *** snapiri has quit IRC | 13:08 | |
| *** edmondsw has quit IRC | 13:10 | |
| *** wolverineav has quit IRC | 13:12 | |
| *** jcoufal_ has joined #openstack-infra | 13:13 | |
| *** Guest43911 has quit IRC | 13:14 | |
| *** sree has joined #openstack-infra | 13:14 | |
| *** jcoufal has quit IRC | 13:15 | |
| *** sree has quit IRC | 13:21 | |
| *** hasharLunch is now known as hashar | 13:22 | |
| *** trown|outtypewww is now known as trown | 13:23 | |
| *** jcoufal has joined #openstack-infra | 13:23 | |
| *** edmondsw has joined #openstack-infra | 13:24 | |
| *** zoli is now known as zoli|afk | 13:25 | |
| *** zoli|afk is now known as zoli | 13:25 | |
| *** jcoufal_ has quit IRC | 13:25 | |
| *** Diabelko has quit IRC | 13:26 | |
| *** Diabelko has joined #openstack-infra | 13:27 | |
| openstackgerrit | Sean McGinnis proposed openstack-infra/devstack-gate master: Update grenade settings for stable/queens https://review.openstack.org/543615 | 13:27 |
| *** kaisers has quit IRC | 13:31 | |
| *** rlandy has joined #openstack-infra | 13:32 | |
| *** kaisers has joined #openstack-infra | 13:32 | |
| tosky | AJaeger: sooo... I'm backporting the zuulv3 jobs for python-saharaclient and sahara, and the backport on pike failed: https://review.openstack.org/#/c/544874/ | 13:33 |
| tosky | while running devstack | 13:33 |
| *** jpena|lunch is now known as jpena | 13:37 | |
| AJaeger | tosky: two options: Figure out the problem ;) or import the legacy job definition for that branch, it obviously works... | 13:37 |
| *** jcoufal_ has joined #openstack-infra | 13:38 | |
| tosky | AJaeger: could it be that it's failing to get the right branch for saharaclient when LIBS_FROM_GIT is enabled? | 13:38 |
| AJaeger | looking at failure at http://logs.openstack.org/74/544874/1/check/python-saharaclient-scenario/de1fe51/job-output.txt.gz#_2018-02-15_12_09_30_617124 , I wonder whether that'S a general problem and the devstack job needs fixing | 13:38 |
| AJaeger | tosky: let's check... | 13:39 |
| tosky | uhm, no | 13:39 |
| tosky | it's using 1.3.0, it should be the right version | 13:39 |
| tosky | uhm uhm | 13:39 |
| AJaeger | http://logs.openstack.org/74/544874/1/check/python-saharaclient-scenario/de1fe51/zuul-info/inventory.yaml | 13:39 |
| AJaeger | That one specifies stable/pike | 13:39 |
| tosky | I guess that I should compare with some other native devstack jobs for pike | 13:39 |
| *** armaan has quit IRC | 13:39 | |
| AJaeger | http://logs.openstack.org/74/544874/1/check/python-saharaclient-scenario/de1fe51/job-output.txt.gz#_2018-02-15_11_58_56_800782 her as well | 13:40 |
| *** jcoufal has quit IRC | 13:40 | |
| AJaeger | but what is this: http://logs.openstack.org/74/544874/1/check/python-saharaclient-scenario/de1fe51/job-output.txt.gz#_2018-02-15_12_04_08_553171 | 13:40 |
| AJaeger | "master" ??? | 13:40 |
| *** signed8bit_Zzz is now known as signed8bit | 13:40 | |
| tosky | but then, 1.3.0 is checked out | 13:40 |
| *** jcoufal has joined #openstack-infra | 13:41 | |
| AJaeger | tosky: better work with andreaf on this, I'm not a devstack expert | 13:41 |
| openstackgerrit | Thomas Morin proposed openstack-infra/openstack-zuul-jobs master: n8g-bagpipe fullstack job: add n8g-sfc as a required-project https://review.openstack.org/544962 | 13:41 |
| tosky | ack | 13:41 |
| AJaeger | tosky: quick fix would indeed be importing the legacy job | 13:41 |
| *** signed8bit has quit IRC | 13:41 | |
| tosky | (but always thanks for listening my blurbs) | 13:41 |
| AJaeger | tosky: and then you can decide how much you want to investigate | 13:41 |
| AJaeger | tosky: ;) | 13:41 |
| *** Goneri has joined #openstack-infra | 13:42 | |
| tosky | I'd prefer to have the native job working, at least for pike | 13:43 |
| tosky | ocata is going to disappear soon anyway | 13:43 |
| *** jcoufal_ has quit IRC | 13:44 | |
| *** rosmaita has joined #openstack-infra | 13:47 | |
| openstackgerrit | Simon Westphahl proposed openstack-infra/zuul master: Allow using remote refs to find commits for change https://review.openstack.org/544964 | 13:48 |
| *** cshastri has quit IRC | 13:48 | |
| *** jamesmcarthur has joined #openstack-infra | 13:49 | |
| *** ansmith has joined #openstack-infra | 13:51 | |
| *** kgiusti has joined #openstack-infra | 13:52 | |
| *** e0ne has joined #openstack-infra | 13:54 | |
| *** rossella_s has quit IRC | 13:54 | |
| *** rossella_s has joined #openstack-infra | 13:55 | |
| *** esberglu has joined #openstack-infra | 13:58 | |
| *** yamamoto has joined #openstack-infra | 14:00 | |
| *** mriedem has joined #openstack-infra | 14:01 | |
| *** dtantsur is now known as dtantsur|brb | 14:02 | |
| *** jamesmcarthur has quit IRC | 14:03 | |
| *** kjackal_ has quit IRC | 14:04 | |
| *** kjackal has quit IRC | 14:04 | |
| *** kjackal has joined #openstack-infra | 14:04 | |
| *** kjackal_ has joined #openstack-infra | 14:05 | |
| *** jcoufal_ has joined #openstack-infra | 14:05 | |
| *** kjackal__ has joined #openstack-infra | 14:06 | |
| *** jcoufal has quit IRC | 14:07 | |
| *** dsariel has quit IRC | 14:07 | |
| *** dsariel_ has quit IRC | 14:08 | |
| *** kjackal_ has quit IRC | 14:08 | |
| *** kjackal has quit IRC | 14:08 | |
| *** kjackal__ has quit IRC | 14:08 | |
| *** rossella_s has quit IRC | 14:08 | |
| *** jcoufal has joined #openstack-infra | 14:08 | |
| *** lucasagomes is now known as lucas-hungry | 14:09 | |
| *** kjackal has joined #openstack-infra | 14:10 | |
| *** sree has joined #openstack-infra | 14:11 | |
| *** rossella_s has joined #openstack-infra | 14:11 | |
| *** jcoufal_ has quit IRC | 14:11 | |
| dhellmann | hey, folks. The release team is going to need some help adapting our branching process for zuul v3. Specifically, it is not clear to me how to perform steps 8-10 starting at http://git.openstack.org/cgit/openstack/releases/tree/PROCESS.rst#n270 | 14:11 |
| dhellmann | the example patches no longer apply, as far as I can tell, and I can't find anything similar to those old jobs that need to be updated | 14:12 |
| dhellmann | mtreinish, maybe you can help, too? ^^ | 14:12 |
| *** jcoufal_ has joined #openstack-infra | 14:13 | |
| *** VW has joined #openstack-infra | 14:13 | |
| *** kjackal_ has joined #openstack-infra | 14:14 | |
| *** kjackal__ has joined #openstack-infra | 14:15 | |
| *** jcoufal has quit IRC | 14:15 | |
| *** kjackal__ has quit IRC | 14:15 | |
| *** kjackal has quit IRC | 14:15 | |
| *** kjackal_ has quit IRC | 14:15 | |
| *** VW has quit IRC | 14:16 | |
| *** janki|afk has quit IRC | 14:16 | |
| *** VW has joined #openstack-infra | 14:16 | |
| *** kjackal has joined #openstack-infra | 14:17 | |
| dhellmann | "devstack-stable-jobs" seems to have gone away or been renamed and I don't see the word "bitrot" anywhere in any YAML files so I'm having trouble even figuring out where to start. | 14:18 |
| *** electrofelix has joined #openstack-infra | 14:19 | |
| *** VW has quit IRC | 14:21 | |
| *** yamahata has joined #openstack-infra | 14:21 | |
| *** larsks has quit IRC | 14:21 | |
| *** kjackal has joined #openstack-infra | 14:22 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add platform build jobs to nodepool experimental https://review.openstack.org/544717 | 14:22 |
| *** dave-mccowan has quit IRC | 14:23 | |
| *** jaosorior has quit IRC | 14:23 | |
| *** kjackal has quit IRC | 14:24 | |
| dhellmann | clarkb, AJaeger : ^^ | 14:25 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: n8g-bagpipe fullstack job: add n8g-sfc as a required-project https://review.openstack.org/544962 | 14:25 |
| *** dhill__ has joined #openstack-infra | 14:26 | |
| *** kjackal has joined #openstack-infra | 14:26 | |
| *** lbragstad has joined #openstack-infra | 14:29 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove legacy-tempest-dsvm-neutron-nova-next-full job https://review.openstack.org/541479 | 14:29 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove legacy-devstack-dsvm-py35-updown https://review.openstack.org/540708 | 14:29 |
| *** alexchadin has quit IRC | 14:29 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove the non-voting option of openstack-python35-jobs for blazar repos https://review.openstack.org/544786 | 14:32 |
| *** esberglu has quit IRC | 14:34 | |
| *** dizquierdo has joined #openstack-infra | 14:38 | |
| *** threestrands_ has quit IRC | 14:39 | |
| *** dtruong has quit IRC | 14:40 | |
| *** HeOS has quit IRC | 14:41 | |
| andreaf | tosky: we didn't backport zuulv3 native roles and play to devstack <= pike | 14:41 |
| *** dtruong has joined #openstack-infra | 14:41 | |
| *** yamamoto has quit IRC | 14:41 | |
| *** krenczewski has quit IRC | 14:41 | |
| andreaf | tosky: which is the reason we're still running the legacy jobs on all stable branches but queens | 14:41 |
| tosky | andreaf: yes, but I was trying to kill the legacy jobs for sahara | 14:42 |
| andreaf | tosky: I don't think it's worth the effort even if it would be a one off... if you're really keen on that feel free to propose a backport... I guess it could be done in a single commit as opposed to backporting all commits one by one | 14:43 |
| tosky | andreaf: a backport for devstack, or a copy of the legacy jobs to the sahara repository just for ocata for 15 days? | 14:44 |
| *** jamesmcarthur has joined #openstack-infra | 14:44 | |
| andreaf | either way | 14:45 |
| *** ldnunes has quit IRC | 14:46 | |
| *** ldnunes has joined #openstack-infra | 14:46 | |
| tosky | let's see then - for now the PTL is going to ask the stable team what to do | 14:47 |
| tosky | andreaf: but first, I need to investigate why a backport of native zuul jobs to stable/pike is failing (see above: https://review.openstack.org/#/c/544874/ ) | 14:48 |
| openstackgerrit | Merged openstack-infra/puppet-ptgbot master: Mismatch in room names in Dublin config https://review.openstack.org/544811 | 14:48 |
| *** yamamoto has joined #openstack-infra | 14:48 | |
| tosky | and if you see anything apparently weird... | 14:48 |
| andreaf | tosky: well as I was saying we didn't backport native jobs to devstack on stable/pike - some bits are there but not up to date | 14:49 |
| *** dtantsur|brb is now known as dtantsur | 14:49 | |
| *** jamesmcarthur has quit IRC | 14:49 | |
| tosky | andreaf: oh, I missed the = in the <= - but there is zuul v3 definition in stable/pike | 14:49 |
| andreaf | tosky: yeah there was a backport done in the beginning but things changed a lot in the meanwhile | 14:50 |
| andreaf | tosky: so they will fail for sure | 14:50 |
| *** ykarel has joined #openstack-infra | 14:50 | |
| tosky | andreaf: uhm, maybe for pike it would be worth to update the backport; we are going to have it around still for some time | 14:51 |
| *** psachin has quit IRC | 14:51 | |
| andreaf | tosky: it's probably not too much work to backport things but it was kind of low in my list of priorities - there's enough to do for master jobs :) | 14:51 |
| tosky | I know | 14:52 |
| tosky | andreaf: do you think that it would be enough to check the diff with the jobs in master and create a review with the diff, or is it something specific for pike that should not be backported? | 14:52 |
| tosky | I assume that a single commit instead of a stream of backports would be acceptable in this case, as you mentioned before | 14:53 |
| *** yamamoto has quit IRC | 14:53 | |
| andreaf | tosky: yeah I guess that might be enough - tempest, d-g, zuul-jobs are all branchless | 14:55 |
| tosky | ok, let's see... | 14:55 |
| andreaf | tosky: the thing is, if we start gating on pike native v3, then we must continue to backport ansible changes | 14:55 |
| tosky | andreaf: I think that with a working devstack as it is, most jobs will be fine | 14:56 |
| fungi | dhellmann: i've caught up... so i believe we have an equivalent of the jobs described there running for those projects with earlier (e.g. stable/pike) branches so if i can find where they're defined we'll be able to just copy and modify. starting to dig for them now but it'll take a few minutes | 14:56 |
| andreaf | tosky: which is kind of meh... but ok, we'll have to backport to stable/queens as well so probably not much overhead | 14:57 |
| tosky | andreaf: I suspect that by the time that more native jobs could need to work on pike (if any, I'm probably an exception with sahara in this), pike will be close to EOL | 14:57 |
| tosky | and it's mostly in this stabilization time anyway | 14:57 |
| dhellmann | fungi : ok, it's good to know at least those jobs do exist in some form. I wasn't able to find them. I did finally find the definition of the integrated-gate job set and I think we'll need to update that, too, but I couldn't find anything related to those jobs for devstack-gate or tempest :-( | 14:57 |
| *** tpsilva_ has joined #openstack-infra | 14:58 | |
| AJaeger | dhellmann: periodic-stable jobs instead of bitrot jobs | 14:58 |
| dhellmann | AJaeger : ok, thanks. How about those branch jobs for tempest & devstack-gate? | 14:59 |
| *** tpsilva_ is now known as tpsilva | 14:59 | |
| dhellmann | AJaeger : and do you have any idea which repo defines the periodic jobs? | 14:59 |
| AJaeger | dhellmann: I think we removed devstack-stable jobs but don't have time to check right now | 14:59 |
| fungi | i'm starting to work backwards from jobs i see reporting on tempest changes | 14:59 |
| *** HeOS has joined #openstack-infra | 15:00 | |
| AJaeger | dhellmann: openstack-zuul-jobs includes the periodic-stable-jobs, file zuul.d/project-templates.yaml - just add stable/queens to the list | 15:00 |
| fungi | looks like we ran a job named legacy-tempest-dsvm-neutron-full-pike on tempest change https://review.openstack.org/544521 | 15:00 |
| dhellmann | AJaeger : thanks | 15:00 |
| fungi | defined at http://git.openstack.org/cgit/openstack-infra/openstack-zuul-jobs/tree/playbooks/legacy/tempest-dsvm-neutron-full-pike/ | 15:01 |
| *** rcernin has quit IRC | 15:01 | |
| fungi | and http://git.openstack.org/cgit/openstack-infra/openstack-zuul-jobs/tree/zuul.d/zuul-legacy-jobs.yaml#n4298 | 15:02 |
| * mordred waves to the nice people ... did I miss anything fun? | 15:02 | |
| dhellmann | fungi : ok, so I need to what? duplicate that block, change pike to queens, and add the new job to a list somewhere? | 15:03 |
| fungi | and then added to tempest at http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul.d/projects.yaml#n15940 | 15:03 |
| *** ispp has joined #openstack-infra | 15:03 | |
| dhellmann | why do we have openstack-zuul-jobs separate from project-config again? | 15:04 |
| fungi | patches to openstack-zuul-jobs can be speculatively tested | 15:04 |
| fungi | we try to keep as much as we can outside project-config | 15:04 |
| dhellmann | ok | 15:04 |
| dhellmann | it's going to make this process a bit more complex, but I guess not by much | 15:04 |
| fungi | basically we avoid adding things to project-config unless they're unsafe to run speculatively | 15:05 |
| *** pblaho has quit IRC | 15:05 | |
| fungi | e.g. would expose secrets or compromise the integrity of the system | 15:06 |
| ispp | Hi, I had this error during a devstack creation, apparently the tinyrc version 0.7 disappeared of pypi, I have solved installing the latest version 0.8, any idea about it? here is the error https://pastebin.com/T03w6H3n | 15:06 |
| dhellmann | fungi : should I be making new "legacy" jobs for these things? or is there a new way to do it? | 15:07 |
| fungi | dhellmann: that's a question to which i don't know the answer. i'm aware andreaf has been working on new-style devstack integration testing jobs defined in the openstack-dev/devstack repo but what i don't know is whether they're yet in suitable shape to be able to tell tempest to run against the stable/queens branch of everything else. my guess is that if they're working for master then it's probably | 15:09 |
| fungi | no more than a one-or-two line change to add a branch-specific version for those | 15:09 |
| *** r-daneel has quit IRC | 15:09 | |
| fungi | like creating a job parented to that one but specifying a default override branch? | 15:09 |
| *** hamzy_ has quit IRC | 15:10 | |
| andreaf | fungi, dhellmann: the single-node tempest jobs are in good shape for stable/queens - they were running in the integrated gate before stable/queens was cut | 15:10 |
| andreaf | fungi, dhellmann: multinode and grenade jobs are still WIP | 15:11 |
| fungi | andreaf: so should we add a backward-compat job to the tempest repo and parent it to the new-style job from the devstack repo? | 15:11 |
| andreaf | fungi: https://review.openstack.org/#/c/521888/ | 15:12 |
| dhellmann | andreaf : would you please look at the openstack/releases/PROCESS.rst document steps 8-10 for the RC1 period and let me know how to update them for the new zuul v3 world? | 15:12 |
| fungi | copying the legacy stable branch jobs pattern from pike is likely to be a lot more work than utilizing the new style jobs, but that's treading new ground so i'm not as sure of the pattern to follow there | 15:13 |
| *** bobh has joined #openstack-infra | 15:13 | |
| andreaf | dhellmann: well the process is pretty much the same only the sample patches will be different since the repo the jobs are defined in is different | 15:14 |
| *** dave-mccowan has joined #openstack-infra | 15:14 | |
| *** VW has joined #openstack-infra | 15:15 | |
| dhellmann | andreaf : ok. I am completely out of the loop on this, so I (and I'm sure smcginnis ) would appreciate any help you can give. | 15:15 |
| smcginnis | ++ | 15:16 |
| dhellmann | frankly the fact that all of this has changed without any real discussion on the ML makes me frustrated enough to lower my motivation to deal with it | 15:16 |
| dhellmann | maybe it's not as bad as it seems, but I can't tell | 15:17 |
| *** lucas-hungry is now known as lucasagomes | 15:18 | |
| tobberydberg | Hi folks! I was asked earlier to ping infra-root here in this channel during US daytime about https://review.openstack.org/#/c/535318/ | 15:21 |
| *** pblaho has joined #openstack-infra | 15:21 | |
| *** agopi_out has joined #openstack-infra | 15:21 | |
| andreaf | dhellmann: yeah I feel your frustration - on my side I'm trying to make people migration to new style jobs less painful by building the base jobs on QA side | 15:22 |
| pabelanger | tobberydberg: we'll need to merge that when no other meetings are going on. | 15:22 |
| *** Nil_ has joined #openstack-infra | 15:22 | |
| andreaf | dhellmann: I wonder if a kind-of-periodic status update on the status of those in the ML would help | 15:22 |
| fungi | looks like the neutron_l3 and manila meetings are currently underway in a couple of official meeting channels, and no idea how many more are running in team-specific channels right now | 15:22 |
| dhellmann | andreaf : I appreciate that. Maybe things are better. But they're definitely different in surprising ways, and that's the part we're going to need some help understanding. | 15:22 |
| dhellmann | andreaf : yes, I think we should always have regular updates for big initiatives like that | 15:23 |
| tobberydberg | Thanks pabelanger! No panic! | 15:23 |
| openstackgerrit | Fabien Boucher proposed openstack-infra/grafyaml master: Unlock yaxes min limit and allow free value https://review.openstack.org/545006 | 15:25 |
| fungi | dhellmann: i also think part of the frustration stems from processes which get followed once every 6 months butting up against systems which are constantly evolving... i experience similar challenges almost every election cycle because of changes in schemas, data file locations, apis... it seems like every time i try to follow a repeatable process or use automation which is only exercised twice a | 15:26 |
| fungi | year, there's always bitrot requiring them to get updated | 15:26 |
| andreaf | dhellmann: regarding https://github.com/openstack/releases/blob/master/PROCESS.rst, the links in there are newton old anyways, what I can do is propose new patches that will work in the zuul v3 world | 15:26 |
| dhellmann | fungi : that's a very good point | 15:26 |
| andreaf | dhellmann: and update the links in the docs | 15:26 |
| andreaf | for steps 8 to 10 | 15:26 |
| dhellmann | we should change our release cycle to be monthly ;-) | 15:26 |
| dhellmann | andreaf : that would be awesome, thank you (and those patches worked as examples for at least 2 releases, which is why they haven't been updated before now) | 15:27 |
| andreaf | :D | 15:27 |
| *** jaosorior has joined #openstack-infra | 15:27 | |
| *** pblaho1 has joined #openstack-infra | 15:27 | |
| *** pblaho has quit IRC | 15:27 | |
| *** ralonsoh_ has joined #openstack-infra | 15:32 | |
| *** yamamoto has joined #openstack-infra | 15:33 | |
| *** eumel8 has quit IRC | 15:33 | |
| *** dsariel has joined #openstack-infra | 15:36 | |
| *** ralonsoh has quit IRC | 15:36 | |
| *** dsariel_ has joined #openstack-infra | 15:36 | |
| *** hamzy_ has joined #openstack-infra | 15:37 | |
| *** yamamoto has quit IRC | 15:38 | |
| *** olaph1 has joined #openstack-infra | 15:38 | |
| *** caphrim007_ has quit IRC | 15:39 | |
| *** olaph has quit IRC | 15:40 | |
| *** agopi_out is now known as agopi | 15:41 | |
| *** hamzy_ has quit IRC | 15:41 | |
| *** lpetrut has quit IRC | 15:42 | |
| *** dsariel has quit IRC | 15:42 | |
| *** dsariel_ has quit IRC | 15:42 | |
| *** dave-mccowan has quit IRC | 15:43 | |
| witek | hello, how can I `manually` trigger the gate jobs? | 15:46 |
| witek | e.g. here https://review.openstack.org/513204 | 15:47 |
| fungi | witek: remove and reapply the workflow +1 vote once the depends-on has merged | 15:49 |
| fungi | witek: until https://review.openstack.org/543399 is approved and merges though, you can't get 513204 to enqueue into the gate pipeline without removing its depends-on header in the commit message | 15:50 |
| fungi | dependencies must merge before the changes which declare a dependency on them | 15:50 |
| *** felipemonteiro has joined #openstack-infra | 15:50 | |
| *** hamzy has joined #openstack-infra | 15:50 | |
| *** felipemonteiro_ has joined #openstack-infra | 15:51 | |
| openstackgerrit | Fabien Boucher proposed openstack-infra/grafyaml master: Cap voluptuous version https://review.openstack.org/545016 | 15:54 |
| witek | fungi: oops, sorry, I missed that | 15:54 |
| witek | thanks | 15:54 |
| fungi | no problem | 15:54 |
| openstackgerrit | Fabien Boucher proposed openstack-infra/grafyaml master: Cap voluptuous version https://review.openstack.org/545016 | 15:55 |
| *** felipemonteiro has quit IRC | 15:55 | |
| *** dizquierdo has quit IRC | 15:55 | |
| *** oidgar has quit IRC | 15:56 | |
| *** r-daneel has joined #openstack-infra | 15:58 | |
| mhayden | the pypi mirrors seem to be missing tinyrpc, but they have 'tinytinyrpc' -- requirements has a UC for tinyrpc===0.7 | 16:01 |
| mhayden | it seems to get pulled in via neutron's requirements | 16:01 |
| mhayden | i saw it on mirror.bhs1.ovh.openstack.org and i'm trying to find out if it's happening elsewhere | 16:02 |
| mhayden | tinyrpc is missing on mirror.mtl01.inap.openstack.org, too | 16:03 |
| *** ralonsoh_ has quit IRC | 16:05 | |
| clarkb | mhayden: all of our mirrors are served from the same filesystem so content on one should be identical to content on another | 16:06 |
| *** ralonsoh_ has joined #openstack-infra | 16:06 | |
| * mhayden forgot about that | 16:07 | |
| clarkb | mhayden: http://mirror.dfw.rax.openstack.org/pypi/simple/tinyrpc/ is our tinyrpc content. I believe I saw mention that 0.7 was deleted by upstream which our mirror then reflected | 16:07 |
| mhayden | oh, that's always fun | 16:07 |
| mhayden | :) | 16:07 |
| clarkb | I would check to see if the constraint/requirement has been or is being updated | 16:07 |
| mhayden | thanks, clarkb -- i'm on the hunt | 16:08 |
| mhayden | ah, it's coming through as part of https://review.openstack.org/#/c/538556/ | 16:09 |
| *** pcaruana has quit IRC | 16:09 | |
| frickler | mhayden: clarkb: see backlog, https://bugs.launchpad.net/openstack-requirements/+bug/1749651 | 16:10 |
| openstack | Launchpad bug 1749651 in OpenStack Global Requirements "tinyrpc version issue" [Undecided,New] | 16:10 |
| *** rbergeron has quit IRC | 16:10 | |
| *** rbergeron has joined #openstack-infra | 16:10 | |
| mhayden | frickler: thanks -- i couldn't find that when searching launchpad :/ | 16:10 |
| frickler | also https://github.com/mbr/tinyrpc/issues/45 | 16:10 |
| mhayden | oh my | 16:10 |
| *** andreas_s has quit IRC | 16:11 | |
| *** rlandy is now known as rlandy|rover | 16:11 | |
| *** rfolco|rover has quit IRC | 16:11 | |
| mhayden | as always, prometheanfire is direct and on point ;) | 16:11 |
| *** andreas_s has joined #openstack-infra | 16:11 | |
| *** arxcruz is now known as arxcruz|ruck | 16:11 | |
| *** sshnaidm|ruck is now known as sshnaidm|notruck | 16:12 | |
| fungi | yeah, this has been going on for much of the day | 16:12 |
| *** panda is now known as panda|afk | 16:12 | |
| *** rfolco has joined #openstack-infra | 16:13 | |
| *** sshnaidm|notruck is now known as sshnaidm|mitsubi | 16:13 | |
| mhayden | it's like the gift that keeps on giving | 16:13 |
| *** sshnaidm|mitsubi is now known as sshnaidm | 16:13 | |
| fungi | i think we're saved from it by the fact that we have autobuilt wheel mirrors (separate from our pypi mirrors) and those are purely additive | 16:13 |
| *** eroux has quit IRC | 16:14 | |
| fungi | so a deletion from pypi does propagate to our pypi mirrors but not to our wheel mirrors | 16:14 |
| fungi | anyway, looks like the author not only deleted the most recent version but then unsuccessfully attempted to upload a newer version and went to sleep or something without checking whether it worked | 16:15 |
| AJaeger | config-core, I need a second pair of eyes to review my removal of jenkins/scripts - see https://review.openstack.org/#/c/543127/ , please | 16:15 |
| pabelanger | fungi: awesome | 16:15 |
| *** yamamoto has joined #openstack-infra | 16:18 | |
| *** ijw has joined #openstack-infra | 16:18 | |
| *** slaweq_ has joined #openstack-infra | 16:19 | |
| clarkb | mordred beat me to it AJaeger | 16:20 |
| *** andreas_s has quit IRC | 16:21 | |
| *** slaweq has quit IRC | 16:21 | |
| mordred | AJaeger: +A on 543127 and 541795 - I left +A off the rest of the stack just in case you were wanting to land them slowly | 16:22 |
| *** links has quit IRC | 16:22 | |
| *** slaweq has joined #openstack-infra | 16:22 | |
| mordred | AJaeger: (but also feel free to click the +a button any time) | 16:22 |
| *** larsks has joined #openstack-infra | 16:22 | |
| *** yamamoto has quit IRC | 16:23 | |
| *** bobh has quit IRC | 16:24 | |
| *** bobh has joined #openstack-infra | 16:24 | |
| *** slaweq_ has quit IRC | 16:24 | |
| openstackgerrit | Merged openstack-infra/project-config master: Consolidate common.sh script copying https://review.openstack.org/543127 | 16:24 |
| AJaeger | mordred, clarkb thanks! | 16:25 |
| *** andreas_s has joined #openstack-infra | 16:26 | |
| AJaeger | mordred: let's move them slowly - so will +A the rest later today | 16:26 |
| *** slaweq has quit IRC | 16:26 | |
| AJaeger | mordred, clarkb , if you want to help removing jenkins/data as well, here's another stack: https://review.openstack.org/#/c/543139/ ;) | 16:26 |
| TheJulia | smcginnis: Hey, any idea when https://review.openstack.org/#/c/543615 will be landed? | 16:27 |
| *** lpetrut has joined #openstack-infra | 16:27 | |
| *** rosmaita has quit IRC | 16:28 | |
| openstackgerrit | Merged openstack-infra/project-config master: Install proposal scripts only when needed https://review.openstack.org/541795 | 16:28 |
| smcginnis | TheJulia: Hopefully soon, but maybe we should point it out in -qa. | 16:28 |
| smcginnis | TheJulia: Is that hold you up from anything? | 16:28 |
| *** jaosorior has quit IRC | 16:29 | |
| smcginnis | *holding | 16:29 |
| fungi | it's technically an infra change not a qa change, but we do need strong buy-in from qa on that | 16:29 |
| TheJulia | smcginnis: we accidentally landed something in ironic on master that was expecting that change to be in place since we're non-voting on our grenade pullup job at the moment since it is horribly broken... and the other change broke it further :( | 16:29 |
| TheJulia | smcginnis: we're prepared to revert, but... trying to set our expectations | 16:30 |
| clarkb | typically we don't make that change until everything is branched. I think at this point everything not trailing is branched so that should be ok ? | 16:30 |
| *** hongbin has joined #openstack-infra | 16:30 | |
| smcginnis | clarkb: Yep, I believe everything but cycle-trailing is done now. | 16:31 |
| smcginnis | mtreinish: Would you mind giving a QA hat look at https://review.openstack.org/#/c/543615 | 16:31 |
| clarkb | (the probably with making that change early is we fall back to the master branch if a branch does not exist which will do the completely wrong thing with grenade if we haven't fnished branching new stable yet :( ) | 16:31 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Updated Presentation Delete Method https://review.openstack.org/545027 | 16:31 |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Updated Presentation Delete Method https://review.openstack.org/545027 | 16:32 |
| TheJulia | clarkb: indeed, ironic hit that last cycle where it was changed before we were branched :( | 16:33 |
| *** kiennt26 has joined #openstack-infra | 16:33 | |
| TheJulia | It is a pain to recover from :( | 16:33 |
| clarkb | so from infras side as long as branches are made I think we are good. Just get qa to confirm and I think we can approve the change | 16:33 |
| *** jcoufal has joined #openstack-infra | 16:34 | |
| smcginnis | This time around we forced releases on all repos that were not responding before we did this change, so hopefully we've avoided most issues. | 16:34 |
| smcginnis | Even though none of us were happy about needing to force those branches on projects. | 16:34 |
| mtreinish | smcginnis: +1 | 16:34 |
| smcginnis | mtreinish: Thanks | 16:35 |
| smcginnis | fungi, clarkb: I guess we are good to go then. ^ | 16:35 |
| *** ramishra has quit IRC | 16:35 | |
| *** jcoufal_ has quit IRC | 16:35 | |
| *** pcichy has quit IRC | 16:36 | |
| clarkb | fungi: ^ I've +2'd it do you want to be second reviewer? | 16:36 |
| *** pcichy has joined #openstack-infra | 16:36 | |
| fungi | just did | 16:36 |
| *** jcoufal_ has joined #openstack-infra | 16:36 | |
| fungi | fire in the hole! | 16:37 |
| *** e0ne has quit IRC | 16:37 | |
| *** imacdonn has quit IRC | 16:37 | |
| TheJulia | *crosses fingers* | 16:37 |
| *** imacdonn has joined #openstack-infra | 16:37 | |
| *** jcoufal has quit IRC | 16:38 | |
| openstackgerrit | Merged openstack-infra/zuul master: Add zuul from scratch doc https://review.openstack.org/542518 | 16:39 |
| openstackgerrit | Merged openstack-infra/zuul master: Reclassify some debug log lines as info https://review.openstack.org/543044 | 16:39 |
| *** jamesmcarthur has joined #openstack-infra | 16:39 | |
| andreaf | AJaeger about https://review.openstack.org/#/c/521888/, do you think I should define two separate jobs, one for check and one for periodic-stable? what should be the name of the periodic one? | 16:40 |
| openstackgerrit | Sean McGinnis proposed openstack-infra/devstack-gate master: Fix newton/ocata upgrade branching https://review.openstack.org/545029 | 16:40 |
| corvus | andreaf: this is to make a periodic stable job? | 16:41 |
| fungi | the hope with zuulv3 is that periodic jobs don't need to be defined independently of check/gate/experimental jobs and should just reuse the same names if possible, right? | 16:41 |
| corvus | fungi: exactly | 16:41 |
| openstackgerrit | Sean McGinnis proposed openstack-infra/devstack-gate master: Remove branch handling for deleted branches https://review.openstack.org/545030 | 16:42 |
| AJaeger | andreaf: I don' | 16:42 |
| corvus | the zuulv3 way would be not to create a new job, but instead, just add tempest-dsvm-neutron-full to the periodic pipeline. it will by default run on all branches. if you only want it to run on some, add branch matchers. | 16:42 |
| andreaf | corvus, fungi: yeah that's what I did - AJaeger commented on my patch that I don't need to use override-branch, only branch, but for check jobs I do need override-branch | 16:42 |
| AJaeger | andreaf: I don't get why you use override-checkout in that one for check change on *master*. | 16:42 |
| *** jamesmcarthur has quit IRC | 16:42 | |
| *** tosky has quit IRC | 16:42 | |
| *** jamesmcarthur has joined #openstack-infra | 16:43 | |
| AJaeger | andreaf: let corvus review the change, please. I'll be back later today... | 16:43 |
| andreaf | AJaeger: we always need to run job that use stable branches against branchless repos | 16:43 |
| andreaf | AJaeger: since master tempest is used for master and for all stable branches as well | 16:43 |
| corvus | oh, this is for check? then yeah, it will need to look more like this. | 16:43 |
| andreaf | AJaeger: same goes for all branchless repos | 16:43 |
| fungi | backwards-compat testing use case | 16:44 |
| AJaeger | andreaf: oh, I see - I'll stay out of it and let you play with it ;) | 16:44 |
| *** andreas_s has quit IRC | 16:44 | |
| corvus | andreaf: that looks right to me | 16:45 |
| evrardjp | hey, where do I change my irc bot to also list the stable/queens changes into our channel? | 16:45 |
| evrardjp | does anyone know? | 16:45 |
| fungi | this is in service of dhellmann's earlier request for help with updating the release process steps for creating stable branch jobs for tempest and devstack-gate | 16:45 |
| evrardjp | ofc someone know :) | 16:45 |
| corvus | er, wait, i was looking at an old version | 16:45 |
| evrardjp | I am silly | 16:45 |
| *** panda|afk is now known as panda | 16:45 | |
| clarkb | evrardjp: openstack-infra/project-config/gerritbot/channels.yaml | 16:45 |
| evrardjp | thanks. | 16:46 |
| *** ykarel has quit IRC | 16:46 | |
| evrardjp | sorry for the interruption, and talk to you laterz! | 16:46 |
| andreaf | fungi corvus one thing that I'm not sure about is whether to run the py3 job on stable as well - I added in my patch and gmann_ asked if we really need it | 16:46 |
| smcginnis | clarkb: Those branch settings can't take a regex, can they? I see several projects that have not updated that do have some stable/* branches listed. | 16:47 |
| andreaf | hopefully py3 is the future and in future py3 will be the *main* integration job - however atm it does not run swift so it is not suitable as the only job for stable | 16:47 |
| *** dhajare|mtg has quit IRC | 16:47 | |
| fungi | andreaf: we haven't in the past because we didn't have enough projects supporting python 3 on older branches, but it's worth asking whether this is the cycle when we should start to do so | 16:47 |
| clarkb | smcginnis: I don't recall. let me check | 16:48 |
| andreaf | fungi: I guess this is a good question for the ML | 16:48 |
| corvus | andreaf: 521888 lgtm -- but what's interesting is that only tempest needs those jobs. nova, for example, should not add them to any pipeline, and instead should just have 'tempest-full' in periodic-stable in its stable/queens branch | 16:48 |
| smcginnis | evrardjp: Might be worth doing a global find replace for stable/newton to stable/queens in channels.yaml. | 16:48 |
| andreaf | corvus yeah that's right | 16:49 |
| evrardjp | smcginnis: stable/newton still exist for some people :( | 16:49 |
| evrardjp | but yeah, I should probably do it. | 16:49 |
| smcginnis | Oh, true. | 16:49 |
| smcginnis | Hopefully nothing to notify on them anymore though. ;) | 16:49 |
| smcginnis | But if we can do ^stable/.*$, that might be better. | 16:50 |
| clarkb | smcginnis: no it doesn't support regexes on branch | 16:50 |
| smcginnis | clarkb: OK, thanks for checking. | 16:50 |
| openstackgerrit | Sean McGinnis proposed openstack-infra/devstack-gate master: Remove branch handling for deleted branches https://review.openstack.org/545030 | 16:51 |
| pabelanger | clarkb: mind a review on https://review.openstack.org/544582/ and https://review.openstack.org/544583/ updates for nodepool dsvm testing images | 16:52 |
| *** slaweq has joined #openstack-infra | 16:52 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack-infra/project-config master: Add Queens gerritbot tracking for OSA chan https://review.openstack.org/545032 | 16:53 |
| *** hashar is now known as hasharAway | 16:53 | |
| clarkb | pabelanger: done | 16:54 |
| *** electrofelix has quit IRC | 16:55 | |
| fungi | andreaf: starting to maintain widespread python 3 testing for stable/queens seems like a good idea to me in light of the fact that we had a community-wide goal to start doing python 3 as of the pike cycle | 16:55 |
| *** wolverineav has joined #openstack-infra | 16:55 | |
| clarkb | also with multiple distros now talking about making python3 default maybe we should consider that a signal that as an upstream we should flip our default? | 16:56 |
| *** trown is now known as trown|lunch | 16:56 | |
| pabelanger | clarkb: danke | 16:56 |
| *** caphrim007 has joined #openstack-infra | 16:57 | |
| fungi | smcginnis: clarkb: though there's https://review.openstack.org/499367 "Support regexes in channel config yaml" efried has proposed | 16:57 |
| *** slaweq has quit IRC | 16:57 | |
| smcginnis | Oh, perfect. | 16:57 |
| fungi | evrardjp: ^ | 16:57 |
| * efried blinks | 16:57 | |
| efried | Do I need to resurrect that guy now? | 16:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Add host/group vars https://review.openstack.org/544562 | 16:57 |
| clarkb | efried: sounds like smcginnis would be happy to review it for you :) | 16:57 |
| fungi | efried: only if you want to, or someone with an interest in it can take it over | 16:58 |
| evrardjp | fungi: oh that's interesting. | 16:58 |
| fungi | it's a frequently-requested feature | 16:58 |
| clarkb | has anyone checked for oom'ing on ze's yet? | 16:58 |
| clarkb | pabelanger: ^ what is process for that? grep syslog? | 16:58 |
| *** oidgar has joined #openstack-infra | 16:58 | |
| pabelanger | clarkb: I usually just look at dmesg first | 16:59 |
| pabelanger | but ya, grep | 16:59 |
| *** sree has quit IRC | 17:00 | |
| clarkb | `dmesg | grep -i oomkiller` shows no results | 17:01 |
| *** sree has joined #openstack-infra | 17:01 | |
| openstackgerrit | Eric Fried proposed openstack-infra/gerritbot master: Support regexes in channel config yaml https://review.openstack.org/499367 | 17:01 |
| fungi | success! (so far?) | 17:01 |
| clarkb | fungi: looks like it | 17:01 |
| clarkb | the other thing I notice is that hte memory use is far more uniform across the executors according to grafana | 17:02 |
| *** auristor has quit IRC | 17:02 | |
| *** yamamoto has joined #openstack-infra | 17:03 | |
| openstackgerrit | Eric Fried proposed openstack-infra/gerritbot master: Support regexes in channel config yaml https://review.openstack.org/499367 | 17:04 |
| efried | fungi, smcginnis, clarkb: ^ Rebased and fixed those couple of nits. | 17:04 |
| efried | evrardjp: ^ | 17:04 |
| clarkb | efried: thanks, I'll try to take a look after breakfast | 17:04 |
| smcginnis | efried: Thanks! | 17:06 |
| *** sree has quit IRC | 17:06 | |
| *** yamamoto has quit IRC | 17:08 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack-infra/project-config master: Add Queens gerritbot tracking https://review.openstack.org/545039 | 17:09 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Added endpoint get events CSV https://review.openstack.org/545040 | 17:09 |
| *** kopecmartin has quit IRC | 17:12 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack-infra/project-config master: Add Queens gerritbot tracking for #openstack-dns https://review.openstack.org/545039 | 17:13 |
| evrardjp | good catch efried | 17:14 |
| efried | evrardjp: Sure would be nice if you could regex that guy... | 17:14 |
| evrardjp | the world is better with RE indeed. | 17:18 |
| *** wolverineav has quit IRC | 17:18 | |
| *** lpetrut has quit IRC | 17:18 | |
| *** sambetts is now known as sambetts|afk | 17:19 | |
| *** harlowja has joined #openstack-infra | 17:19 | |
| *** wolverineav has joined #openstack-infra | 17:19 | |
| *** ijw has quit IRC | 17:20 | |
| *** pcaruana has joined #openstack-infra | 17:20 | |
| *** yamahata has quit IRC | 17:20 | |
| *** wolverin_ has joined #openstack-infra | 17:24 | |
| mtreinish | clarkb: I added some stuff to the ptg etherpad, just my random topics that I'd like to work on with people while there | 17:27 |
| clarkb | mtreinish: I like that you've called it potpurri | 17:27 |
| *** wolverineav has quit IRC | 17:28 | |
| *** jpich has quit IRC | 17:32 | |
| *** yamamoto has joined #openstack-infra | 17:32 | |
| *** yamamoto has quit IRC | 17:33 | |
| *** lpetrut has joined #openstack-infra | 17:34 | |
| *** wolverin_ has quit IRC | 17:34 | |
| *** wolverineav has joined #openstack-infra | 17:35 | |
| *** auristor has joined #openstack-infra | 17:36 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools master: import the old onboarding presentation https://review.openstack.org/545058 | 17:37 |
| fungi | as opposed to potpourri with a u? | 17:37 |
| openstackgerrit | Alex Krzos proposed openstack-infra/grafyaml master: Allow repeating panels and to set minspan https://review.openstack.org/545062 | 17:39 |
| fungi | or was it just a typo? | 17:39 |
| clarkb | mine was typo | 17:39 |
| clarkb | mtreinish can actually spell | 17:39 |
| *** wolverineav has quit IRC | 17:39 | |
| fungi | ahh, i see it's spelled with a u in the pad ;) | 17:39 |
| openstackgerrit | Alex Krzos proposed openstack-infra/grafyaml master: Allow repeating panels and to set minspan https://review.openstack.org/545062 | 17:40 |
| fungi | i didn't know if it was some sort of wordplay going on | 17:41 |
| fungi | like having to do with cats | 17:41 |
| *** yamamoto has joined #openstack-infra | 17:41 | |
| * fungi clearly reads too much into simple typos | 17:41 | |
| *** jcoufal__ has joined #openstack-infra | 17:43 | |
| *** jcoufal_ has quit IRC | 17:43 | |
| corvus | config-core: this may be of interest: https://review.openstack.org/545065 Add resolution about CI for external projects | 17:44 |
| *** panda is now known as panda|off | 17:44 | |
| corvus | fultonj: ^ | 17:45 |
| fultonj | corvus: thanks | 17:45 |
| *** yamamoto has quit IRC | 17:46 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools master: stub in presentation for rocky ptg https://review.openstack.org/545066 | 17:47 |
| fungi | corvus: thanks! reviewing with another hat on now | 17:49 |
| *** sshnaidm is now known as sshnaidm|off | 17:49 | |
| *** jamesmcarthur has quit IRC | 17:50 | |
| fungi | lgtm | 17:50 |
| *** zoli is now known as zoli|gone | 17:51 | |
| *** zoli|gone is now known as zoli | 17:52 | |
| *** tesseract has quit IRC | 17:52 | |
| *** sshnaidm|off has quit IRC | 17:56 | |
| *** rosmaita has joined #openstack-infra | 17:57 | |
| *** yamahata has joined #openstack-infra | 17:58 | |
| *** dhajare|mtg has joined #openstack-infra | 17:58 | |
| *** derekh has quit IRC | 17:59 | |
| *** dtantsur is now known as dtantsur|afk | 18:04 | |
| openstackgerrit | Lee Yarwood proposed openstack-infra/devstack-gate master: Update grenade for stable/queens https://review.openstack.org/545071 | 18:05 |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Update grenade settings for stable/queens https://review.openstack.org/543615 | 18:07 |
| lyarwood | ^_^ I should really search first | 18:07 |
| EmilienM | not sure if it's just me again but I can't send patches to gerrit | 18:10 |
| EmilienM | ssh: connect to host review.openstack.org port 29418: Network is unreachable | 18:10 |
| EmilienM | (UI works) | 18:10 |
| *** SumitNaiksatam has joined #openstack-infra | 18:11 | |
| *** wolverineav has joined #openstack-infra | 18:11 | |
| fungi | EmilienM: i can check to see if your connections are being blocked | 18:11 |
| fungi | we currently only allow 100 concurrent ssh connections to that port from a single ip address | 18:11 |
| EmilienM | fungi: I'll send my IP on PM | 18:11 |
| fungi | thanks | 18:11 |
| *** yamamoto has joined #openstack-infra | 18:11 | |
| clarkb | and 64 connections per account | 18:11 |
| fungi | EmilienM: i don't see any established gerrit ssh connections from the same ip address you're using... i'll fire up tcpdump next | 18:12 |
| EmilienM | gertty + git review doesn't work / UI works - just fyi | 18:13 |
| EmilienM | you don't want me to work, right? :-) | 18:13 |
| fungi | EmilienM: i'm sniffing packets on review.openstack.org eth0 looking for connections from your ip address to 29418/tcp now | 18:14 |
| *** kiennt26 has quit IRC | 18:14 | |
| fungi | give it a try and i'll see what i catch | 18:14 |
| *** jpena is now known as jpena|off | 18:14 | |
| EmilienM | fungi: thanks for looking | 18:14 |
| pabelanger | EmilienM: I'm guessing you are on RHT vpn, because I can too reproduce it | 18:14 |
| pabelanger | if I drop from VPN is works | 18:15 |
| *** kukacz has quit IRC | 18:15 | |
| EmilienM | o_O | 18:15 |
| fungi | yeah, if you're bouncing through a vpn then your ip address may not be what you think it is | 18:15 |
| pabelanger | it looks to be ipv6 issue | 18:16 |
| clarkb | would be good to get the VPN address because it is possible that if you are all NAT'd to it our connection limit is too low | 18:16 |
| EmilienM | sounds like I couldn't resolve review.openstack.org | 18:16 |
| pabelanger | EmilienM: ssh -4 review.openstack.org -p29418 | 18:16 |
| EmilienM | I fixed it by adding 104.130.246.91 to my /etc/hosts | 18:16 |
| pabelanger | does that work? | 18:16 |
| EmilienM | now yes | 18:16 |
| EmilienM | (with my workaround) | 18:16 |
| pabelanger | well, drop /etc/hosts | 18:16 |
| *** yamamoto has quit IRC | 18:16 | |
| clarkb | using ipv4 would be a workaround for NAT issues though it would be weird to NAT ipv6 | 18:16 |
| *** ralonsoh_ has quit IRC | 18:17 | |
| EmilienM | pabelanger: works now but probably because of cache | 18:17 |
| fungi | also i don't see any individual ip address at/over 100 concurrent connections in gerrit, nor any individual account at/over 64 so i don't think gerrit is actually rejecting anything | 18:17 |
| EmilienM | probably networking issue in our side | 18:18 |
| pabelanger | EmilienM: you could try -6, and confirm failure. But looks VPN related | 18:18 |
| fungi | this seems likely, but if you can come up with additional locations it's failing from i'm happy to dig deeper | 18:18 |
| pabelanger | however, unsure why ipv6 is routing over VPN for me | 18:18 |
| pabelanger | now to see why | 18:18 |
| fungi | what vpn client do they use, out of curiosity? | 18:19 |
| EmilienM | thanks for looking folks! glad everything works fine on your side | 18:19 |
| EmilienM | openvpn | 18:19 |
| fungi | full tunnel or split tunnel? | 18:19 |
| EmilienM | not sure I can tell that here :) | 18:19 |
| * fungi has a ton of past experience maintaining openvpn gateways used by vast numbers of client connections) | 18:19 | |
| pabelanger | I'm guessing ipv6 dns servers are down for VPN | 18:19 |
| pabelanger | as dig fails | 18:20 |
| *** kukacz_ has joined #openstack-infra | 18:20 | |
| *** slaweq has joined #openstack-infra | 18:20 | |
| fungi | ahh, so the config is set to push additional dns servers to clients | 18:20 |
| clarkb | probably so that they can shadow dns | 18:20 |
| EmilienM | yes | 18:20 |
| fungi | or is that hard-coded in the client-side config? | 18:20 |
| EmilienM | not hardcoded | 18:20 |
| EmilienM | you want my vpn config? lol | 18:20 |
| *** oidgar has quit IRC | 18:20 | |
| fungi | nah | 18:20 |
| pabelanger | you can opt out, with local dns resolver | 18:20 |
| EmilienM | (was a joke) | 18:21 |
| fungi | i'm guessing whoever set this up made sane choices | 18:21 |
| *** amoralej is now known as amoralej|off | 18:21 | |
| fungi | so yeah, broken resolver inside the vpn network sounds a likely culprit | 18:21 |
| *** gibi has quit IRC | 18:22 | |
| pabelanger | yah, my guess too | 18:23 |
| openstackgerrit | James E. Blair proposed openstack-infra/infra-manual master: Add instructions for third-party-check https://review.openstack.org/545077 | 18:24 |
| *** slaweq has quit IRC | 18:25 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Added endpoint get events CSV https://review.openstack.org/545040 | 18:29 |
| *** trown|lunch is now known as trown | 18:30 | |
| *** bobh has quit IRC | 18:31 | |
| *** quite has quit IRC | 18:33 | |
| *** yamamoto has joined #openstack-infra | 18:35 | |
| *** yamamoto has quit IRC | 18:35 | |
| *** jcoufal has joined #openstack-infra | 18:37 | |
| AJaeger | andreaf: regarding queens jobs: Is there anything you need help with? I wasn't able to help earlier but can now dig a bit into it... | 18:38 |
| *** Thaelim has joined #openstack-infra | 18:38 | |
| *** lpetrut has quit IRC | 18:38 | |
| *** lpetrut has joined #openstack-infra | 18:39 | |
| *** persia has quit IRC | 18:39 | |
| *** jcoufal__ has quit IRC | 18:40 | |
| *** jcoufal_ has joined #openstack-infra | 18:40 | |
| *** bobh has joined #openstack-infra | 18:41 | |
| *** jcoufal has quit IRC | 18:41 | |
| *** jamesdenton has joined #openstack-infra | 18:43 | |
| *** jcoufal has joined #openstack-infra | 18:45 | |
| *** suhdood_ has joined #openstack-infra | 18:45 | |
| *** dhajare|mtg has quit IRC | 18:45 | |
| openstackgerrit | James E. Blair proposed openstack-infra/infra-manual master: Add instructions for third-party-check https://review.openstack.org/545077 | 18:45 |
| *** suhdood_ has quit IRC | 18:46 | |
| *** Thaelimm has joined #openstack-infra | 18:47 | |
| *** jcoufal_ has quit IRC | 18:47 | |
| *** Thaelim has quit IRC | 18:47 | |
| clarkb | andreaf: corvus when is a good time to start thinking about the tuesday lunch slot at PTG? | 18:51 |
| *** claudiub has joined #openstack-infra | 18:52 | |
| clarkb | andreaf: corvus: I'm thinking I will probably just take a couple minutes to talk general infra things then we can devote the rest of the time to zuul updates | 18:53 |
| *** gfidente has quit IRC | 18:53 | |
| corvus | clarkb: monday? ;) maybe we should start an etherpad outline so we can all jot down what we want to cover, and then see how long we think it will take to verbalize | 18:54 |
| clarkb | that wfm. I'll get one started | 18:54 |
| corvus | (because, let's be honest, the last time we sat down with developers for a 30m chat about zuulv3, we used 2 hours) | 18:55 |
| corvus | (so it's not like we're going to lack for things to talk about) | 18:55 |
| fungi | however, we can also recommend adjourning to the helproom for continuing q&a at the end? | 18:58 |
| *** Thaelimmm has joined #openstack-infra | 18:59 | |
| *** camunoz has joined #openstack-infra | 18:59 | |
| corvus | fungi: yes -- and -- this is the great part, we can tell people to bring extra cookies from lunch to the helproom! | 18:59 |
| clarkb | not a bad idea | 18:59 |
| fungi | genius! | 19:00 |
| *** lucasagomes is now known as lucas-afk | 19:00 | |
| *** harlowja has quit IRC | 19:00 | |
| fungi | zuul always goes better with cookies | 19:00 |
| *** pcichy has quit IRC | 19:02 | |
| *** Thaelimm has quit IRC | 19:02 | |
| *** wolverineav has quit IRC | 19:03 | |
| *** gyee has joined #openstack-infra | 19:03 | |
| *** wolverineav has joined #openstack-infra | 19:04 | |
| clarkb | corvus: andreaf https://etherpad.openstack.org/p/dublin-ptg-infra-lunch | 19:05 |
| *** wolverineav has quit IRC | 19:08 | |
| clarkb | as I'm sitting here thinking of "general" infra topics basically everything this cycle has revolved around zuul | 19:10 |
| clarkb | I guess there was meltdown and spectre and we could do a cloud provider update | 19:11 |
| prometheanfire | fungi: do you know how many projects are affected by the tinyrpc fail | 19:11 |
| * prometheanfire just woke up | 19:11 | |
| clarkb | and then we also started xenial control plane upgrades | 19:11 |
| *** jcoufal_ has joined #openstack-infra | 19:14 | |
| fungi | prometheanfire: no clue. i expect only ones running jobs that force building deps from sdist and ignoring wheels or else they'd get our prebuilt wheels | 19:15 |
| *** dprince has quit IRC | 19:15 | |
| fungi | i haven't heard from anyone suggesting our ci jobs are impacted | 19:15 |
| fungi | however, third-party ci systems and local devs without cached sdists/wheels are probably hard hit | 19:16 |
| clarkb | I think osa was impacted | 19:16 |
| openstackgerrit | Merged openstack-infra/nodepool master: Clean up old images for testing https://review.openstack.org/544582 | 19:16 |
| openstackgerrit | Merged openstack-infra/nodepool master: Switch to fedora-27 for nodepool dsvm https://review.openstack.org/544583 | 19:16 |
| clarkb | and third parties | 19:16 |
| *** jcoufal has quit IRC | 19:16 | |
| prometheanfire | clarkb: ya, osa can build it's own wheels | 19:16 |
| *** felipemonteiro_ has quit IRC | 19:16 | |
| *** felipemonteiro_ has joined #openstack-infra | 19:17 | |
| prometheanfire | well, the interdiff seems safe, I'll rush it for rocky/queens | 19:17 |
| prometheanfire | https://github.com/mbr/tinyrpc/compare/0.7...0.8 | 19:17 |
| fungi | oh, did they finally get 0.8 to upload? | 19:19 |
| prometheanfire | it's not listed in simple, but here | 19:20 |
| prometheanfire | https://pypi.python.org/packages/18/f7/3e29caf829046bff81933f7c1b77120bc7da1be0cd679cf0bb0c9b0b80c1/tinyrpc-0.8.tar.gz#md5=222553d259ebf64c2516cfbefa09ed4c | 19:20 |
| prometheanfire | not sure what's up with that | 19:20 |
| clarkb | if its not in simple I don't think pip will find it | 19:20 |
| *** Thaelimmm has quit IRC | 19:21 | |
| prometheanfire | Downloading tinyrpc-0.6.tar.gz | 19:21 |
| *** Thaelimmm has joined #openstack-infra | 19:21 | |
| prometheanfire | you are right... | 19:21 |
| clarkb | http://mirror.dfw.rax.openstack.org/pypi/simple/tinyrpc/ it is however in our mirror's simple listing | 19:22 |
| clarkb | which is extra confusing | 19:22 |
| clarkb | cheeseshop bug maybe? | 19:22 |
| *** r-daneel has quit IRC | 19:27 | |
| *** Thaelimmm has quit IRC | 19:27 | |
| *** jcoufal_ has quit IRC | 19:32 | |
| *** jcoufal has joined #openstack-infra | 19:33 | |
| *** slaweq has joined #openstack-infra | 19:33 | |
| *** harlowja has joined #openstack-infra | 19:35 | |
| *** yamamoto has joined #openstack-infra | 19:35 | |
| *** harlowja_ has joined #openstack-infra | 19:37 | |
| *** harlowja has quit IRC | 19:39 | |
| *** dprince has joined #openstack-infra | 19:40 | |
| *** dprince_ has joined #openstack-infra | 19:40 | |
| *** lpetrut has quit IRC | 19:40 | |
| *** dprince_ has quit IRC | 19:40 | |
| fungi | prometheanfire: gentoo has swift builds working under python 3.5/3.6? | 19:45 |
| *** yamamoto has quit IRC | 19:45 | |
| prometheanfire | fungi: yes | 19:46 |
| notmyname | prometheanfire: ?! what does that mean? how is that possible? | 19:46 |
| prometheanfire | well, let me check | 19:46 |
| prometheanfire | maybe not swift | 19:46 |
| notmyname | swift in now way shape or form supports py3 today | 19:46 |
| prometheanfire | ya, not swift | 19:46 |
| prometheanfire | PYTHON_COMPAT=( python2_7 ) | 19:47 |
| prometheanfire | everything else though... | 19:47 |
| fungi | that makes more sense. i was somewhat surprised by the implied assertion in your ml post | 19:52 |
| pabelanger | I'm not up-to-date on swift python3 migration, is there a place I can look to see the progress? | 19:55 |
| notmyname | pabelanger: there's some open patches in gerrit. eg https://review.openstack.org/#/q/topic:py3+(status:open+OR+status:merged) | 19:55 |
| notmyname | pabelanger: the most up to date issue list I know of is https://gist.github.com/tipabu/833b03a865dba96e9fa2230b82f5d075 | 19:56 |
| *** pcrews has quit IRC | 19:56 | |
| notmyname | there are some very scary migration and compatiblity issues there. which is one reason swift hasn't been ported | 19:56 |
| *** xarses_ has joined #openstack-infra | 19:57 | |
| notmyname | string types changes, bugs in python (mostly resolved now IIRC), use of some internal variables that have changed (unfortunate use, but necessary) | 19:57 |
| *** bobh has quit IRC | 19:58 | |
| *** hasharAway is now known as hashar | 19:59 | |
| notmyname | the two main issues I'm most worried about are (1) existing rings--ie the thing that is the heart and soul of a swift cluster--won't be readable in new python and (2) existing object metadata--ie all the info on the EB of deployed swift in the work--may not be readable in new python | 20:00 |
| notmyname | the other stuff (like reading data from config files that may break because of new string types or finding the new way to get at underlying socket objects in an http library) are going to be tricky, but mostly just for the dev team | 20:01 |
| *** pcrews has joined #openstack-infra | 20:02 | |
| clarkb | notmyname: what prevents python3 from reading ring data written by python2? is it pickled? | 20:03 |
| notmyname | yeah. https://bugs.launchpad.net/swift/+bug/1644387 | 20:03 |
| openstack | Launchpad bug 1644387 in OpenStack Object Storage (swift) "Ring builder files need a consistent format" [Undecided,New] | 20:03 |
| *** pcaruana has quit IRC | 20:03 | |
| notmyname | rings are pickled. as is object metadata stored on disk | 20:03 |
| pabelanger | notmyname: thanks! I'll read shortly | 20:04 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools master: draft of presentation for rocky ptg https://review.openstack.org/545105 | 20:06 |
| ianw | infra-root: could i get some eyes on two arm64 changes : https://review.openstack.org/539083 & https://review.openstack.org/544764 . basically installs ports sources.list and our ppa packages for AFS. i want to re-create the mirror & create a nodepool-builder; but want to make sure it doesn't need manual intervention | 20:07 |
| *** sshnaidm|off has joined #openstack-infra | 20:08 | |
| pabelanger | okay, anybody good at using ethercalc? I'm trying to explan A1 to G1, but not sure how: https://ethercalc.openstack.org/pqhemnrgnz7t | 20:08 |
| clarkb | pabelanger: select the cells you want then click the bottom near top right that has a yellow horizontal bar and tooltip is merge cells | 20:10 |
| *** olaph has joined #openstack-infra | 20:10 | |
| *** sree has joined #openstack-infra | 20:11 | |
| mriedem | anyone realize this is still broken since jan 27? http://status.openstack.org/elastic-recheck/ | 20:11 |
| *** olaph1 has quit IRC | 20:11 | |
| mriedem | i ran elastic-recheck-graph locally and didn't have any problems, so it doesn't seem to be an issue with e-r itself | 20:11 |
| pabelanger | clarkb: great, thank you! | 20:12 |
| clarkb | mriedem: no I haven't noticed but also hadn't looked :) | 20:14 |
| clarkb | mriedem: the reason appears to be processes holding the locks since that long ago | 20:15 |
| *** sree has quit IRC | 20:15 | |
| clarkb | mriedem: I will kill them to let newer processes have a change | 20:15 |
| mriedem | ok | 20:16 |
| *** kukacz_ has quit IRC | 20:17 | |
| *** ldnunes has quit IRC | 20:17 | |
| *** kjackal has quit IRC | 20:17 | |
| clarkb | ianw: sources list change approved we should also double check the amd64 hosts don't have anything funny happen | 20:17 |
| *** kjackal has joined #openstack-infra | 20:18 | |
| pabelanger | infra-root: config-core: others, check infra ML for info about team dinner or go directly to ethercalc: https://ethercalc.openstack.org/pqhemnrgnz7t | 20:18 |
| *** aviau has quit IRC | 20:20 | |
| *** aviau has joined #openstack-infra | 20:20 | |
| *** e0ne has joined #openstack-infra | 20:22 | |
| *** pcichy has joined #openstack-infra | 20:27 | |
| *** bobh has joined #openstack-infra | 20:28 | |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools master: stub in presentation for rocky ptg https://review.openstack.org/545066 | 20:28 |
| openstackgerrit | Doug Hellmann proposed openstack-infra/release-tools master: draft of presentation for rocky ptg https://review.openstack.org/545105 | 20:28 |
| ianw | pabelanger: want to remove the precise-backports line? it was just copying | 20:30 |
| *** hongbin has quit IRC | 20:31 | |
| *** r-daneel has joined #openstack-infra | 20:31 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add aarch64 configuration https://review.openstack.org/539083 | 20:31 |
| *** hongbin has joined #openstack-infra | 20:32 | |
| pabelanger | ianw: maybe, we should make discuss in a follow up. Just a little surprised we have it enabled | 20:32 |
| *** wolverineav has joined #openstack-infra | 20:32 | |
| *** florianf has quit IRC | 20:33 | |
| *** bobh has quit IRC | 20:33 | |
| *** jtomasek has quit IRC | 20:34 | |
| clarkb | oh hey the zuul executor upgrades yesterday which resulted in them restarting should mean that we are running with the timeout value applying to all three phases of the jobs | 20:35 |
| clarkb | so no more waithing 6 hours for a 2 hour timeout to happen \o/ | 20:35 |
| clarkb | something to be aware of if you start seeing jobs hit their timeouts | 20:35 |
| AJaeger | clarkb: yeah! | 20:36 |
| dmsimard | clarkb: we have metrics on timeouts now | 20:36 |
| dmsimard | not in grafana yet however | 20:36 |
| AJaeger | could I get a second +2 on https://review.openstack.org/543139 , please? that is one step in getting rid of jenkins/data | 20:37 |
| dmsimard | clarkb: stats.zuul.executor.ze*.openstack.org.phase.*.RESULT_TIMED_OUT | 20:37 |
| dmsimard | looks like there's quite a bit of timeouts actually | 20:37 |
| *** e0ne has quit IRC | 20:38 | |
| *** e0ne has joined #openstack-infra | 20:38 | |
| clarkb | timeouts are normalish | 20:42 |
| *** andreas_s has joined #openstack-infra | 20:43 | |
| openstackgerrit | Alex Krzos proposed openstack-infra/grafyaml master: Allow decimals to be specificed to limit decimals graphs https://review.openstack.org/545112 | 20:43 |
| clarkb | I think we are also generally running into them due to problems like converted jobs not carrying over timeouts. Possibly cloud performance degredation post meltdown etc | 20:43 |
| *** wolverineav has quit IRC | 20:45 | |
| *** wolverineav has joined #openstack-infra | 20:45 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: Take 2: Add functional test for key-name and glean https://review.openstack.org/545113 | 20:46 |
| pabelanger | clarkb: oh, good to know. | 20:46 |
| *** andreas_s has quit IRC | 20:47 | |
| xarses_ | Heads up, looks like in the last few min most of all the docs.openstack.org/python-openstacksdk urls are returning 404 | 20:50 |
| *** wolverineav has quit IRC | 20:50 | |
| openstackgerrit | Alex Krzos proposed openstack-infra/grafyaml master: Allow hidden templated vars https://review.openstack.org/542979 | 20:50 |
| xarses_ | https://docs.openstack.org/python-openstacksdk/latest/users/proxies/compute.html | 20:50 |
| clarkb | xarses_: https://docs.openstack.org/python-openstacksdk/latest/ is there for me | 20:51 |
| mordred | xarses_: https://docs.openstack.org/python-openstacksdk/latest/ works for me | 20:51 |
| xarses_ | I was literaly moving around these pages 10 min ago | 20:51 |
| mordred | xarses_: the docs got updated to use the standard layout during this last cycle - so users is now user in that url | 20:51 |
| mordred | xarses_: it's possible we have a stale link somewhere | 20:52 |
| clarkb | or just stale browser cache | 20:52 |
| mordred | yah. I do see two places where something is dealing with 'users' instead of 'user' - but nothign that should have caused the above issue | 20:53 |
| ianw | pabelanger: also, are we meeting free at the moment? want to approve https://review.openstack.org/#/c/535318/ ? | 20:54 |
| xarses_ | looks like `user` instead of `users` | 20:54 |
| xarses_ | I literaly opened these pages this morning and was moving around ... | 20:54 |
| AJaeger | ianw, pabelanger there're more open reviews for statusbot/meetbot - also https://review.openstack.org/531595 https://review.openstack.org/535390 https://review.openstack.org/531136 | 20:56 |
| pabelanger | ianw: yah | 20:56 |
| mordred | xarses_: well, if you can find anything that linked you to users/proxies/compute.html i'd love to get that fixed | 20:56 |
| pabelanger | AJaeger: looking | 20:56 |
| xarses_ | mordred: I have an old link that I keep using, the page is hard to find | 20:57 |
| xarses_ | and was working up to today, hence my panic | 20:57 |
| openstackgerrit | Alex Krzos proposed openstack-infra/grafyaml master: Allow repeating panels and to set minspan https://review.openstack.org/545062 | 20:57 |
| mordred | xarses_: ah - gotcha | 20:59 |
| mordred | AJaeger: .htaccess files in sphinx docs work yeah? | 21:00 |
| AJaeger | mordred: yes - let me check quickly how exactly... | 21:00 |
| mordred | AJaeger: no rush - was just thinking that I could add some redirects in to the sdk docs tree for a few of the big-ticket reorganizations to help with scenarios like what xarses_ hit | 21:01 |
| AJaeger | mordred: https://docs.openstack.org/doc-contrib-guide/redirects.html#adding-a-htaccess-file-to-your-repo | 21:01 |
| AJaeger | mordred: and following section as well | 21:03 |
| *** aeng has joined #openstack-infra | 21:03 | |
| mordred | AJaeger: awesome! thanks! | 21:04 |
| *** bobh has joined #openstack-infra | 21:05 | |
| *** ijw has joined #openstack-infra | 21:05 | |
| openstackgerrit | Merged openstack-infra/puppet-openafs master: Add Xenial arm64 support https://review.openstack.org/544764 | 21:06 |
| openstackgerrit | Merged openstack-infra/zuul master: Set remote url on every getRepo in merger https://review.openstack.org/535716 | 21:08 |
| corvus | clarkb, fungi: can you review https://review.openstack.org/544716 while it's still fresh in our minds? | 21:08 |
| *** bobh has quit IRC | 21:10 | |
| openstackgerrit | Merged openstack-infra/system-config master: Adding meetbot for #openstack-publiccloud channel https://review.openstack.org/535318 | 21:11 |
| ianw | AJaeger / pabelanger : i think meetings have started now. i'll do all those in my afternoon? | 21:12 |
| ianw | usually quiet then | 21:12 |
| corvus | well, we just merged a meetbot change, so it's going to restart soon. | 21:13 |
| *** dprince has quit IRC | 21:13 | |
| *** quite has joined #openstack-infra | 21:13 | |
| ianw | oh, well let's not make it do it twice then | 21:15 |
| corvus | pabelanger: you can put http://eavesdrop.openstack.org/irc-meetings.ical in any old calendaring app to see all the meetings | 21:15 |
| corvus | nova team meeting is 2100-2200, then we're clear for a few hours. | 21:15 |
| *** pcichy has quit IRC | 21:16 | |
| AJaeger | pabelanger, could you review https://review.openstack.org/543139 , please? that is one step in getting rid of jenkins/data | 21:16 |
| *** bobh has joined #openstack-infra | 21:18 | |
| *** sree has joined #openstack-infra | 21:20 | |
| mordred | corvus: did something change (or not change) with the github webhook? | 21:21 |
| mordred | corvus: we're throwing 404's currently | 21:21 |
| corvus | mordred: i'm unaware of any known problems | 21:23 |
| *** bobh has quit IRC | 21:24 | |
| openstackgerrit | John L. Villalovos proposed openstack-infra/gerritbot master: Add some initial unit tests and improve readability https://review.openstack.org/545128 | 21:24 |
| mordred | corvus: https://review.openstack.org/#/c/540996/ landed - so i'd expect us to be in good shape - I've checked the apache config on zuul and that has been applied | 21:24 |
| *** sree has quit IRC | 21:24 | |
| mordred | we sure do emit a lot of concurrent.futures._base.CancelledError errors into the zuul-web log | 21:26 |
| corvus | mordred: /openstack/connection/github/github/payload -- do we need to drop '/openstack' from that? | 21:26 |
| mordred | corvus: yah. probably so | 21:26 |
| mordred | corvus: and by 'probably so' I of course mean 'yes' | 21:27 |
| corvus | mordred: hrm... https://zuul.openstack.org/connection/github/payload is the payload url configured in github | 21:27 |
| *** bobh has joined #openstack-infra | 21:27 | |
| mordred | corvus: yah - but that's getting rewritten to /openstack/connection in the rewrite rules | 21:27 |
| corvus | mordred: ah, yep. that's the thing that's wrong. | 21:27 |
| mordred | patch coming | 21:27 |
| *** kgiusti has left #openstack-infra | 21:28 | |
| *** e0ne has quit IRC | 21:31 | |
| *** pcaruana has joined #openstack-infra | 21:31 | |
| *** jcoufal has quit IRC | 21:31 | |
| *** bobh has quit IRC | 21:32 | |
| *** bobh has joined #openstack-infra | 21:34 | |
| *** trown is now known as trown|outtypewww | 21:35 | |
| *** caphrim007 has quit IRC | 21:38 | |
| *** openstack has joined #openstack-infra | 21:44 | |
| *** ChanServ sets mode: +o openstack | 21:44 | |
| *** felipemonteiro__ has joined #openstack-infra | 21:45 | |
| corvus | we lucked out, they finished early :) | 21:45 |
| *** hamzy has quit IRC | 21:46 | |
| *** pcaruana has quit IRC | 21:48 | |
| *** felipemonteiro_ has quit IRC | 21:48 | |
| *** oidgar has joined #openstack-infra | 21:49 | |
| *** rcernin has joined #openstack-infra | 21:50 | |
| AJaeger | Uff | 21:50 |
| *** olaph1 has joined #openstack-infra | 21:51 | |
| *** olaph has quit IRC | 21:51 | |
| AJaeger | corvus: we merged abstract in zuul now - should we start using that? | 21:52 |
| clarkb | corvus: ya I'll review as soon as I figure out lunch | 21:52 |
| AJaeger | (after next restart) | 21:52 |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/zuul-jobs master: Improve file renaming in stage-output https://review.openstack.org/544606 | 21:53 |
| corvus | AJaeger: yes, i think there were some jobs in project-config we wanted to use that with | 21:53 |
| AJaeger | corvus: do you remember which ones? The base ones? | 21:53 |
| openstackgerrit | Paul Belanger proposed openstack-infra/nodepool master: Take 2: Add functional test for key-name and glean https://review.openstack.org/545113 | 21:53 |
| *** dougwig has joined #openstack-infra | 21:56 | |
| *** oidgar has quit IRC | 21:57 | |
| AJaeger | config-core, could you review https://review.openstack.org/543139 , please? that is one step in getting rid of jenkins/data | 21:58 |
| corvus | AJaeger: base jobs are a good start...also base-publish-static (which, desipite its name, is not actually a base job) | 22:01 |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-zuul master: Add support for specifying a tenant explicitly https://review.openstack.org/545137 | 22:01 |
| *** olaph1 has quit IRC | 22:02 | |
| *** olaph has joined #openstack-infra | 22:02 | |
| corvus | AJaeger: i also think we might be able to rework some of the static publication jobs to use 'protected'. if we made base-publish-static a protected job, we could put the fileserver secret on that, centralize the playbook, and make all the child jobs simpler | 22:03 |
| corvus | (i think that was the thinking behind creating 'protected') | 22:03 |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Add abstract attribute to base jobs https://review.openstack.org/545138 | 22:04 |
| AJaeger | corvus: ^ | 22:04 |
| pabelanger | AJaeger: it is too late in the day for my brain to mental map the removal of jenkins folder. I think it might break jobs, since it takes 24+ hours to upload DIBs. But I'll dive more into it in the morning | 22:05 |
| corvus | mordred: easy -1 on the puppet-zuul change | 22:05 |
| AJaeger | corvus: ah, didn't remember protected - will look another time. | 22:05 |
| AJaeger | pabelanger: that very first change should be fine since it only *adds* a new location | 22:05 |
| corvus | AJaeger: we have the full complement now: abstract, protected, and final. :) | 22:06 |
| AJaeger | pabelanger: and then we wait 24 hours for the rest | 22:06 |
| AJaeger | corvus: nice | 22:06 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Set zuul openstack tenant name explicitly https://review.openstack.org/545139 | 22:06 |
| AJaeger | pabelanger: ok, will ask tomorrow again - thanks | 22:07 |
| AJaeger | have a nice evening/night/whatever... | 22:08 |
| * AJaeger signs off | 22:08 | |
| pabelanger | AJaeger: yah, tomorrow works. Left a few comments we can discuss | 22:09 |
| *** felipemonteiro__ has quit IRC | 22:09 | |
| *** felipemonteiro__ has joined #openstack-infra | 22:10 | |
| *** olaph is now known as olahp | 22:14 | |
| *** olahp is now known as olaph | 22:14 | |
| *** VW has quit IRC | 22:15 | |
| *** VW has joined #openstack-infra | 22:15 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-zuul master: Add support for specifying a tenant explicitly https://review.openstack.org/545137 | 22:15 |
| *** VW has quit IRC | 22:15 | |
| *** VW has joined #openstack-infra | 22:16 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Stop setting zuul_status_url https://review.openstack.org/545140 | 22:16 |
| mordred | corvus: fixed. also - added a followup cleanup patch ^^ | 22:16 |
| *** VW has quit IRC | 22:16 | |
| *** VW has joined #openstack-infra | 22:16 | |
| openstackgerrit | Merged openstack-infra/subunit2sql master: Add --dpi flag to subunit2sql-graph https://review.openstack.org/543335 | 22:17 |
| *** VW has quit IRC | 22:17 | |
| *** VW has joined #openstack-infra | 22:17 | |
| *** VW has quit IRC | 22:18 | |
| *** VW has joined #openstack-infra | 22:18 | |
| *** olaph has quit IRC | 22:21 | |
| *** VW has quit IRC | 22:23 | |
| *** olaph has joined #openstack-infra | 22:23 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/devstack-gate master: Add stable/queens integration checks https://review.openstack.org/545144 | 22:26 |
| *** apetrich has quit IRC | 22:27 | |
| openstackgerrit | Merged openstack-infra/zuul master: Fix branch deletion after failed reconfig https://review.openstack.org/544716 | 22:27 |
| *** priteau has quit IRC | 22:29 | |
| *** apetrich has joined #openstack-infra | 22:29 | |
| *** priteau has joined #openstack-infra | 22:29 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/devstack-gate master: Add stable/queens integration checks https://review.openstack.org/545144 | 22:32 |
| *** priteau has quit IRC | 22:34 | |
| *** felipemonteiro_ has joined #openstack-infra | 22:35 | |
| *** tpsilva has quit IRC | 22:37 | |
| *** armaan has joined #openstack-infra | 22:39 | |
| *** felipemonteiro__ has quit IRC | 22:40 | |
| pabelanger | ianw: cool, https://review.openstack.org/545113/ works again. Lets wait for experimental jobs | 22:40 |
| *** slaweq has joined #openstack-infra | 22:42 | |
| ianw | ++ that's a really good test especially for dib | 22:42 |
| *** threestrands has joined #openstack-infra | 22:43 | |
| *** threestrands has quit IRC | 22:43 | |
| *** threestrands has joined #openstack-infra | 22:43 | |
| *** slaweq has quit IRC | 22:44 | |
| *** armaan has quit IRC | 22:46 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Make NodeSetParser a regular class https://review.openstack.org/545148 | 22:51 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Make SecretParser a regular class https://review.openstack.org/545149 | 22:51 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Make JobParser a regular class https://review.openstack.org/545150 | 22:51 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Make PipelineParser a regular class https://review.openstack.org/545151 | 22:51 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Make SemaphoreParser a regular class https://review.openstack.org/545152 | 22:51 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul master: Make TenantParser a regular class https://review.openstack.org/545153 | 22:51 |
| *** hashar has quit IRC | 22:52 | |
| ianw | clarkb: hmm ... here's your "how does this even work" for today -> https://git.openstack.org/cgit/openstack-infra/system-config/tree/modules/openstack_project/manifests/review.pp#n85 | 22:53 |
| mordred | ianw: it works because review.openstack.org runs on trusty | 22:55 |
| *** VW has joined #openstack-infra | 22:57 | |
| pabelanger | yah, next migration will first upgrade to xenial | 22:58 |
| ianw | ahh, i must have missed we skipped that | 22:58 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient master: Allow branches to be browsed by project_id https://review.openstack.org/530656 | 22:58 |
| openstackgerrit | Merged openstack-infra/storyboard-webclient master: Add a "New Story" view https://review.openstack.org/526219 | 22:59 |
| pabelanger | ianw: I signed up for the migration, plan on testing with review-dev.o.o first | 22:59 |
| *** VW has quit IRC | 23:02 | |
| *** agopi is now known as agopi_out | 23:03 | |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard-webclient master: Disable closing modals when backdrop is clicked https://review.openstack.org/545156 | 23:06 |
| *** agopi_out has quit IRC | 23:07 | |
| *** Goneri has quit IRC | 23:08 | |
| *** ijw has quit IRC | 23:09 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/system-config master: Remove precise references https://review.openstack.org/545157 | 23:12 |
| ianw | pabelanger: ^ well that should save you 1/2 hour or so :) | 23:12 |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-zuul master: Add support for specifying a tenant explicitly https://review.openstack.org/545137 | 23:14 |
| *** ijw has joined #openstack-infra | 23:14 | |
| mordred | corvus: ^^ fixed a puppet-lint | 23:14 |
| mordred | ianw, pabelanger: if you have a spare moment ^^ | 23:14 |
| pabelanger | will trade :) https://review.openstack.org/545113/ adds ssh checks back to nodepool dsvm jobs | 23:16 |
| *** dingyichen has joined #openstack-infra | 23:17 | |
| *** bobh has quit IRC | 23:19 | |
| *** bobh has joined #openstack-infra | 23:20 | |
| *** r-daneel has quit IRC | 23:24 | |
| *** felipemonteiro_ has quit IRC | 23:24 | |
| *** felipemonteiro_ has joined #openstack-infra | 23:24 | |
| *** bobh has quit IRC | 23:25 | |
| clarkb | pabelanger: ianw http://logs.openstack.org/13/545113/2/experimental/nodepool-zuul-functional/9c7be55/ara/result/0662348e-e16b-4877-a0f5-06855e61703c/ looks like some of AJaeger's cleanups caught the nodepool/zuul functional job | 23:25 |
| ianw | pabelanger: yeah, just looking now | 23:26 |
| *** bobh has joined #openstack-infra | 23:26 | |
| clarkb | mriedem: e-r looks to be generating graphs now | 23:28 |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add legacy-copy-jenkins-scripts https://review.openstack.org/545158 | 23:28 |
| ianw | pabelanger: ^ i think that's the minimal change, but probably this can be done better | 23:28 |
| *** VW has joined #openstack-infra | 23:31 | |
| clarkb | might just want to invoke bindep and installation directly? that seems like a quick and simple enough fix for now though | 23:31 |
| mriedem | clarkb: yeah sweet http://status.openstack.org/elastic-recheck/gate.html | 23:33 |
| *** VW has quit IRC | 23:35 | |
| clarkb | pabelanger: see comment on the ssh check change but I've approved it | 23:35 |
| *** camunoz has quit IRC | 23:39 | |
| *** bobh has quit IRC | 23:39 | |
| openstackgerrit | Merged openstack-infra/nodepool master: Take 2: Add functional test for key-name and glean https://review.openstack.org/545113 | 23:39 |
| ianw | corvus: bindep role would require migrating https://git.openstack.org/cgit/openstack-infra/zuul/tree/tools/nodepool-integration-setup.sh? which probably should be done, just not sure if it will be done right now | 23:46 |
| ianw | oh, it still doesn't work anyway | 23:48 |
| corvus | ianw: wow, that whole job needs to be v3-ified | 23:48 |
| *** xarses_ has quit IRC | 23:48 | |
| ianw | yeah, it's using python2 | 23:48 |
| openstackgerrit | Merged openstack-infra/puppet-zuul master: Add support for specifying a tenant explicitly https://review.openstack.org/545137 | 23:49 |
| openstackgerrit | Ian Wienand proposed openstack-infra/zuul master: Use pip3 in nodepool-integration-setup.sh https://review.openstack.org/545163 | 23:51 |
| openstackgerrit | Ian Wienand proposed openstack-infra/nodepool master: Add legacy-copy-jenkins-scripts https://review.openstack.org/545158 | 23:51 |
| ianw | if those two fail, well i give up for now | 23:52 |
| *** stakeda has joined #openstack-infra | 23:52 | |
| *** rlandy|rover is now known as rlandy|rover|bia | 23:53 | |
| *** HeOS has quit IRC | 23:53 | |
| *** rlandy|rover|bia is now known as rlandy|rover|bbl | 23:53 | |
| *** abelur has quit IRC | 23:54 | |
| *** abelur has joined #openstack-infra | 23:54 | |
| *** hongbin has quit IRC | 23:56 | |
| *** abelur has quit IRC | 23:57 | |
| *** dhill__ has quit IRC | 23:58 | |
| mordred | ianw: I was just about to say sometihng about using the bindep role, but I see that's already been discussed | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!