| *** tosky has quit IRC | 00:00 | |
| *** harlowja has quit IRC | 00:01 | |
| *** mattw4 has quit IRC | 00:02 | |
| *** hwoarang has quit IRC | 00:04 | |
| *** hwoarang has joined #openstack-infra | 00:04 | |
| *** tkajinam has quit IRC | 00:07 | |
| *** ijw has joined #openstack-infra | 00:07 | |
| *** tkajinam has joined #openstack-infra | 00:07 | |
| *** ijw has joined #openstack-infra | 00:08 | |
| *** ijw has joined #openstack-infra | 00:10 | |
| *** bnemec has quit IRC | 00:14 | |
| *** dave-mccowan has joined #openstack-infra | 00:20 | |
| *** armax has joined #openstack-infra | 00:27 | |
| *** factor has joined #openstack-infra | 00:27 | |
| *** rlandy has quit IRC | 00:29 | |
| *** yamamoto has joined #openstack-infra | 00:32 | |
| *** noonedeadpunk has quit IRC | 00:39 | |
| *** rodrigods has quit IRC | 00:39 | |
| clarkb | infra-root I can mysql on review.o.o now using the backup my.cnf | 00:41 |
|---|---|---|
| clarkb | fungi: ^ maybe you want to confirm | 00:41 |
| *** noonedeadpunk has joined #openstack-infra | 00:42 | |
| *** gyee has quit IRC | 00:47 | |
| *** dave-mccowan has quit IRC | 01:16 | |
| fungi | confirmed, `sudo mysql --defaults-file=/root/.gerrit_db.cnf reviewdb` wfm with no password | 01:24 |
| *** yamamoto has quit IRC | 01:34 | |
| *** ijw has quit IRC | 01:40 | |
| *** ijw has joined #openstack-infra | 01:40 | |
| *** ijw has quit IRC | 01:45 | |
| *** dave-mccowan has joined #openstack-infra | 01:50 | |
| *** diablo_rojo has quit IRC | 01:55 | |
| *** dklyle has quit IRC | 02:03 | |
| *** david-lyle has joined #openstack-infra | 02:03 | |
| *** yamamoto has joined #openstack-infra | 02:04 | |
| *** mriedem has quit IRC | 02:09 | |
| *** armax has quit IRC | 02:12 | |
| *** dchen has quit IRC | 02:33 | |
| *** factor has quit IRC | 02:36 | |
| *** dchen has joined #openstack-infra | 02:36 | |
| *** auristor has quit IRC | 02:42 | |
| *** yamamoto has quit IRC | 02:44 | |
| *** smarcet has joined #openstack-infra | 02:49 | |
| *** auristor has joined #openstack-infra | 02:59 | |
| *** apetrich has quit IRC | 03:09 | |
| *** yamamoto has joined #openstack-infra | 03:11 | |
| *** gouthamr has quit IRC | 03:14 | |
| *** gouthamr has joined #openstack-infra | 03:24 | |
| *** jamesmcarthur has joined #openstack-infra | 03:29 | |
| *** psachin has joined #openstack-infra | 03:39 | |
| *** jamesmcarthur has quit IRC | 03:44 | |
| *** StevenK_ is now known as StevenK | 03:44 | |
| *** ykarel|away has joined #openstack-infra | 03:46 | |
| *** yamamoto has quit IRC | 03:58 | |
| *** goldyfruit has quit IRC | 04:16 | |
| *** ykarel|away has quit IRC | 04:18 | |
| *** ykarel|away has joined #openstack-infra | 04:35 | |
| *** hwoarang has quit IRC | 04:35 | |
| *** hwoarang has joined #openstack-infra | 04:37 | |
| *** yamamoto has joined #openstack-infra | 04:39 | |
| *** dave-mccowan has quit IRC | 04:46 | |
| *** yamamoto has quit IRC | 04:49 | |
| *** Lucas_Gray has joined #openstack-infra | 04:50 | |
| *** Lucas_Gray has quit IRC | 04:58 | |
| *** ykarel|away is now known as ykarel | 05:00 | |
| *** Lucas_Gray has joined #openstack-infra | 05:00 | |
| *** rosmaita has quit IRC | 05:16 | |
| *** ramishra has joined #openstack-infra | 05:23 | |
| *** pcaruana has joined #openstack-infra | 05:24 | |
| *** Lucas_Gray has quit IRC | 05:27 | |
| *** yonglihe has joined #openstack-infra | 05:29 | |
| *** rosmaita has joined #openstack-infra | 05:29 | |
| *** ricolin has joined #openstack-infra | 05:29 | |
| *** auristor has quit IRC | 05:52 | |
| *** auristor has joined #openstack-infra | 05:56 | |
| *** raukadah is now known as chkumar|rover | 05:58 | |
| *** surpatil has joined #openstack-infra | 05:59 | |
| *** ociuhandu has joined #openstack-infra | 06:07 | |
| *** SurajPatil has joined #openstack-infra | 06:09 | |
| *** factor has joined #openstack-infra | 06:10 | |
| *** ociuhandu has quit IRC | 06:11 | |
| *** surpatil has quit IRC | 06:12 | |
| *** factor has quit IRC | 06:16 | |
| *** mudpuppy has quit IRC | 06:19 | |
| *** mudpuppy has joined #openstack-infra | 06:19 | |
| *** SurajPatil has quit IRC | 06:25 | |
| *** surpatil has joined #openstack-infra | 06:26 | |
| *** factor has joined #openstack-infra | 06:32 | |
| openstackgerrit | Andreas Jaeger proposed openstack/logstash-filters master: DNM - testing jobs https://review.opendev.org/699561 | 06:32 |
| openstackgerrit | wangfaxin proposed openstack/reviewstats master: Update ssh community page https://review.opendev.org/699562 | 06:37 |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Remove logstash trusty job https://review.opendev.org/699563 | 06:37 |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Remove trusty group-based-policy jobs https://review.opendev.org/699564 | 06:41 |
| AJaeger | config-core, further trusty removals - I use topic:bye-trusty now ^ | 06:41 |
| AJaeger | reviews welcome! | 06:41 |
| *** jamesmcarthur has joined #openstack-infra | 06:46 | |
| *** janki has joined #openstack-infra | 06:48 | |
| *** jamesmcarthur has quit IRC | 06:51 | |
| *** hwoarang has quit IRC | 06:55 | |
| *** rcernin has quit IRC | 06:56 | |
| *** hwoarang has joined #openstack-infra | 06:59 | |
| *** pkopec has joined #openstack-infra | 07:18 | |
| *** lpetrut has joined #openstack-infra | 07:26 | |
| *** pgaxatte has joined #openstack-infra | 07:28 | |
| *** ccamacho has joined #openstack-infra | 07:38 | |
| *** ykarel is now known as ykarel|lunch | 07:47 | |
| *** fnordahl has joined #openstack-infra | 07:49 | |
| *** kozhukalov has joined #openstack-infra | 07:52 | |
| *** kopecmartin|off is now known as kopecmartin | 07:53 | |
| *** slaweq has joined #openstack-infra | 08:03 | |
| *** vesper11 has quit IRC | 08:09 | |
| *** ricolin has quit IRC | 08:11 | |
| *** vesper11 has joined #openstack-infra | 08:14 | |
| *** tosky has joined #openstack-infra | 08:18 | |
| *** ricolin has joined #openstack-infra | 08:18 | |
| *** jpena|off is now known as jpena | 08:22 | |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Retire fuel and fuel-ccp repositories (step 2) https://review.opendev.org/699362 | 08:27 |
| *** SurajPatil has joined #openstack-infra | 08:29 | |
| *** surpatil has quit IRC | 08:30 | |
| AJaeger | config-core, we can retire fuel, please review ^ | 08:31 |
| *** surpatil has joined #openstack-infra | 08:31 | |
| *** tosky has quit IRC | 08:32 | |
| *** tkajinam has quit IRC | 08:34 | |
| *** SurajPatil has quit IRC | 08:34 | |
| *** slaweq has quit IRC | 08:36 | |
| *** ralonsoh has joined #openstack-infra | 08:40 | |
| *** dchen has quit IRC | 08:41 | |
| *** yamamoto has joined #openstack-infra | 08:48 | |
| *** slaweq has joined #openstack-infra | 08:50 | |
| *** yamamoto has quit IRC | 08:52 | |
| openstackgerrit | Andreas Jaeger proposed openstack/openstack-zuul-jobs master: Remove fuel jobs https://review.opendev.org/699635 | 08:58 |
| *** kozhukalov has quit IRC | 08:58 | |
| *** rpittau|afk is now known as rpittau | 08:59 | |
| *** lucasagomes has joined #openstack-infra | 09:05 | |
| *** tosky has joined #openstack-infra | 09:16 | |
| *** gfidente has joined #openstack-infra | 09:16 | |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Retire fuel and fuel-ccp repositories (step 2) https://review.opendev.org/699362 | 09:21 |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Retire fuel and fuel-ccp (step 4) https://review.opendev.org/699639 | 09:21 |
| *** apetrich has joined #openstack-infra | 09:27 | |
| *** factor has quit IRC | 09:33 | |
| *** derekh has joined #openstack-infra | 09:37 | |
| *** ykarel|lunch is now known as ykarel | 09:44 | |
| *** dpawlik has joined #openstack-infra | 09:51 | |
| *** factor has joined #openstack-infra | 09:57 | |
| *** apetrich has quit IRC | 09:58 | |
| *** ociuhandu has joined #openstack-infra | 09:59 | |
| *** tosky has quit IRC | 10:02 | |
| *** tosky has joined #openstack-infra | 10:03 | |
| tosky | still fortnebula ipv6 issues? | 10:10 |
| frickler | tosky: there seem to have been some issues yesterday, do you still see failures occuring right now? if yes, we could consider disabling FN for now | 10:22 |
| tosky | frickler: from https://review.opendev.org/#/c/699515/ , see https://c411f5fb268503bf096c-d1bf0a9e503701d3eb5d5588a992c0f2.ssl.cf2.rackcdn.com/699515/1/check/grenade-heat/4e8de96/logs/devstack-gate-setup-host.txt | 10:23 |
| tosky | it's from a 2 hours ago | 10:23 |
| tosky | unless it's a red herring | 10:24 |
| openstackgerrit | Jens Harbott (frickler) proposed openstack/project-config master: Revert "Revert "Disable fortnebula"" https://review.opendev.org/699652 | 10:27 |
| tosky | I take it as "it's a real issue" :) | 10:28 |
| frickler | tosky: yes, at least it looks like one to me. infra-root: ^^ I fast-approved this, maybe donnyd can have another look later and fix this | 10:29 |
| tosky | thanks | 10:29 |
| *** ociuhandu has quit IRC | 10:34 | |
| *** janki has quit IRC | 10:35 | |
| *** ociuhandu has joined #openstack-infra | 10:36 | |
| *** ociuhandu has quit IRC | 10:40 | |
| *** ociuhandu has joined #openstack-infra | 10:42 | |
| openstackgerrit | Merged openstack/project-config master: Revert "Revert "Disable fortnebula"" https://review.opendev.org/699652 | 10:46 |
| *** ociuhandu has quit IRC | 10:48 | |
| *** tbarron_ has joined #openstack-infra | 10:59 | |
| *** smarcet has quit IRC | 11:09 | |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Retire x/fuel-plugin-calico https://review.opendev.org/699664 | 11:15 |
| *** ociuhandu has joined #openstack-infra | 11:16 | |
| *** witek_ has joined #openstack-infra | 11:20 | |
| *** ykarel is now known as ykarel|afk | 11:20 | |
| *** ociuhandu has quit IRC | 11:22 | |
| *** ociuhandu has joined #openstack-infra | 11:23 | |
| *** ociuhandu has quit IRC | 11:24 | |
| *** ociuhandu has joined #openstack-infra | 11:25 | |
| donnyd | So what makes no sense here is it succeeded in talking g | 11:27 |
| donnyd | To the mirror via http | 11:27 |
| donnyd | It just looks like an icmp issue | 11:27 |
| *** ociuhandu has quit IRC | 11:29 | |
| *** ykarel|afk has quit IRC | 11:30 | |
| *** Lucas_Gray has joined #openstack-infra | 11:34 | |
| *** Lucas_Gray has quit IRC | 11:38 | |
| *** ociuhandu has joined #openstack-infra | 11:40 | |
| fungi | icmp delivery isn't guaranteed anyway, so having a "connectivity test" consisting of ping -c1 is a questionable choice | 11:41 |
| fungi | all you need is to have one icmp packet go missing (either the echo request or reply) | 11:42 |
| *** apetrich has joined #openstack-infra | 11:42 | |
| *** Lucas_Gray has joined #openstack-infra | 11:42 | |
| *** ralonsoh has quit IRC | 11:48 | |
| *** ociuhandu has quit IRC | 11:50 | |
| *** ralonsoh has joined #openstack-infra | 11:51 | |
| *** ociuhandu has joined #openstack-infra | 11:51 | |
| *** smarcet has joined #openstack-infra | 11:52 | |
| *** lucasagomes has quit IRC | 11:57 | |
| *** lucasagomes has joined #openstack-infra | 11:57 | |
| *** smarcet has joined #openstack-infra | 11:58 | |
| *** ociuhandu has quit IRC | 12:03 | |
| *** sshnaidm has quit IRC | 12:04 | |
| donnyd | Well what is interesting is I can ping the mirror from anywhere else and get 100% success | 12:08 |
| *** gfidente has quit IRC | 12:14 | |
| *** adriant has quit IRC | 12:18 | |
| *** adriant has joined #openstack-infra | 12:18 | |
| *** ykarel|afk has joined #openstack-infra | 12:21 | |
| *** smarcet has quit IRC | 12:21 | |
| *** ociuhandu has joined #openstack-infra | 12:25 | |
| *** ociuhandu has quit IRC | 12:28 | |
| *** ociuhandu has joined #openstack-infra | 12:29 | |
| *** gfidente has joined #openstack-infra | 12:29 | |
| *** ociuhandu has quit IRC | 12:30 | |
| *** ociuhandu has joined #openstack-infra | 12:30 | |
| *** witek_ has quit IRC | 12:32 | |
| *** ociuhandu has quit IRC | 12:34 | |
| *** ociuhandu has joined #openstack-infra | 12:34 | |
| *** Lucas_Gray has quit IRC | 12:36 | |
| *** jpena is now known as jpena|lunch | 12:41 | |
| donnyd | fungi: https://opendev.org/openstack/devstack-gate/src/branch/master/playbooks/roles/network_sanity_check/tasks/ping_check.yaml | 12:41 |
| donnyd | ping doesn't work for ipv6 | 12:42 |
| donnyd | its ping6 | 12:42 |
| donnyd | so this check will always fail on FN | 12:42 |
| donnyd | ok or that isn't it at all | 12:43 |
| donnyd | LOL | 12:43 |
| donnyd | why does that work on ubuntu but not fedora | 12:43 |
| *** KeithMnemonic1 has joined #openstack-infra | 12:44 | |
| *** KeithMnemonic has quit IRC | 12:45 | |
| donnyd | ok, i found the issue. | 12:48 |
| donnyd | https://usercontent.irccloud-cdn.com/file/bXvnuaf8/image.png | 12:48 |
| donnyd | its this static route that was left in from the first time this thing was built | 12:49 |
| fungi | neat | 12:50 |
| fungi | also, ping does work with ipv6 addresses if your ping is new enough (mine defaults to pinging the v6 address of things if there is onw) | 12:51 |
| fungi | s/onw/one/ | 12:51 |
| donnyd | I see that. it used to not work, but I stand easily corrected | 12:52 |
| donnyd | LOL | 12:52 |
| fungi | but yes, this was not always the case | 12:52 |
| donnyd | https://www.irccloud.com/pastebin/XqmO6FNT/ | 12:54 |
| donnyd | So the packet loss is from me not having the correct static routes in. (this is just how FN works for the mirror) | 12:54 |
| donnyd | The issue is valid and the fix is in | 12:54 |
| fungi | thanks for finding it! | 12:56 |
| *** rlandy has joined #openstack-infra | 12:57 | |
| fungi | as a reminder, i'm going to be on the road and in planes a lot for the next several days, but will try to check in from time to time. after that i'll be completely out of communication for a week and a half | 12:57 |
| donnyd | I will update the bug with my findings. This all stems from the last set of updates I pulled down for the controller. I needed a newer pyroute2 than what shipped in the repos for stein | 12:57 |
| *** sshnaidm has joined #openstack-infra | 12:58 | |
| donnyd | I had to delete and recreate the external gateways - and hence the static routes changed | 12:58 |
| *** Goneri has quit IRC | 12:58 | |
| donnyd | they are there so systems never leave the sdn for mirror communications - which vastly improves performance | 12:58 |
| *** sshnaidm has quit IRC | 13:02 | |
| *** sshnaidm has joined #openstack-infra | 13:03 | |
| openstackgerrit | Merged opendev/storyboard master: Add a dedicated "lpimport" tox testenv https://review.opendev.org/649065 | 13:05 |
| *** electrofelix has joined #openstack-infra | 13:05 | |
| *** jamesmcarthur has joined #openstack-infra | 13:05 | |
| *** rh-jelabarre has joined #openstack-infra | 13:06 | |
| *** ociuhandu has quit IRC | 13:06 | |
| *** ociuhandu has joined #openstack-infra | 13:07 | |
| openstackgerrit | Donny Davis proposed openstack/project-config master: Revert "Revert Revert "Disable fortnebula" https://review.opendev.org/699677 | 13:09 |
| *** udesale has joined #openstack-infra | 13:11 | |
| *** ociuhandu has quit IRC | 13:11 | |
| *** jamesmcarthur has quit IRC | 13:12 | |
| *** ociuhandu has joined #openstack-infra | 13:12 | |
| *** jamesmcarthur has joined #openstack-infra | 13:13 | |
| *** smarcet has joined #openstack-infra | 13:18 | |
| *** ociuhandu has quit IRC | 13:18 | |
| *** ssbarnea has quit IRC | 13:22 | |
| *** jamesmcarthur has quit IRC | 13:29 | |
| *** ociuhandu has joined #openstack-infra | 13:32 | |
| *** ykarel|afk is now known as ykarel | 13:36 | |
| *** ociuhandu has quit IRC | 13:39 | |
| *** mriedem has joined #openstack-infra | 13:43 | |
| *** jpena|lunch is now known as jpena | 13:45 | |
| *** Goneri has joined #openstack-infra | 13:46 | |
| *** ociuhandu has joined #openstack-infra | 13:47 | |
| *** jamesmcarthur has joined #openstack-infra | 13:55 | |
| *** dave-mccowan has joined #openstack-infra | 13:56 | |
| *** smarcet has quit IRC | 13:56 | |
| *** jamesmcarthur has quit IRC | 13:59 | |
| *** ociuhandu has quit IRC | 14:00 | |
| *** goldyfruit has joined #openstack-infra | 14:01 | |
| *** sshnaidm has quit IRC | 14:02 | |
| *** udesale has quit IRC | 14:02 | |
| *** lbragstad_ is now known as lbragstad | 14:03 | |
| openstackgerrit | Sean McGinnis proposed openstack/openstack-zuul-jobs master: Add no-constraints job for py37 https://review.opendev.org/699679 | 14:03 |
| *** jamesmcarthur has joined #openstack-infra | 14:03 | |
| *** rh-jelabarre has quit IRC | 14:04 | |
| openstackgerrit | Sean McGinnis proposed openstack/reviewstats master: Update URL links to opendev.org locations https://review.opendev.org/699562 | 14:04 |
| openstackgerrit | Sean McGinnis proposed openstack/reviewstats master: Drop py2 testing and metadata https://review.opendev.org/699680 | 14:04 |
| *** ociuhandu has joined #openstack-infra | 14:04 | |
| openstackgerrit | Riccardo Pittau proposed openstack/diskimage-builder master: Add python-yaml in bindep for ubuntu https://review.opendev.org/699681 | 14:05 |
| openstackgerrit | Sean McGinnis proposed openstack/reviewstats master: Switch to py37 jobs https://review.opendev.org/699683 | 14:06 |
| *** chkumar|rover is now known as chandankumar | 14:07 | |
| *** bnemec has joined #openstack-infra | 14:10 | |
| *** ramishra has quit IRC | 14:13 | |
| openstackgerrit | Sean McGinnis proposed openstack/openstack-zuul-jobs master: Add no-constraints job for py37 https://review.opendev.org/699679 | 14:16 |
| *** priteau has joined #openstack-infra | 14:17 | |
| *** smarcet has joined #openstack-infra | 14:18 | |
| *** smarcet has quit IRC | 14:22 | |
| *** rh-jelabarre has joined #openstack-infra | 14:22 | |
| *** smarcet has joined #openstack-infra | 14:26 | |
| *** ociuhandu has quit IRC | 14:26 | |
| *** ociuhandu has joined #openstack-infra | 14:27 | |
| *** surpatil has quit IRC | 14:29 | |
| *** ociuhandu has quit IRC | 14:31 | |
| *** smarcet has quit IRC | 14:31 | |
| *** smarcet has joined #openstack-infra | 14:35 | |
| AJaeger | mordred, frickler, could you review https://review.opendev.org/#/c/699362/ , please? That starts retiring fuel finally... | 14:36 |
| *** ociuhandu has joined #openstack-infra | 14:47 | |
| AJaeger | thanks, mordred! | 14:48 |
| mordred | AJaeger: makes me wonder - do we skip retired projects when we make codesearch config? | 14:48 |
| mordred | (we should if we don't) | 14:48 |
| AJaeger | mordred: AFAIK, we skip them - but since they only contain a single README, we might not notice. Where's codesearch config written? Jeepyb? | 14:48 |
| mordred | yeah - I'm going to look at it now | 14:49 |
| *** mriedem has quit IRC | 14:51 | |
| *** david-lyle is now known as dklyle | 14:51 | |
| *** mriedem has joined #openstack-infra | 14:51 | |
| AJaeger | mordred: seems we don't ignore them ;( | 14:52 |
| *** sshnaidm has joined #openstack-infra | 14:53 | |
| AJaeger | config-core, please review https://review.opendev.org/699360 and https://review.opendev.org/699563 - the later removes logstash trusty jobs, AFAIK we don't need them anymore. | 14:53 |
| *** ociuhandu has quit IRC | 14:56 | |
| mordred | AJaeger: I agree - and I think your earlier statement about them just having README contents means it's not a big deal | 14:56 |
| openstackgerrit | Stephen Finucane proposed openstack/pbr master: Use importlib-metadata for runtime package version lookups https://review.opendev.org/662035 | 14:58 |
| AJaeger | mordred: yeah, it's a nice optimization - deleting 60 repos at once might be nice for codesearch. But it means reworking the loop completely... | 14:59 |
| mordred | yah | 14:59 |
| mordred | I have an idea ... | 15:00 |
| *** ssbarnea has joined #openstack-infra | 15:00 | |
| *** ociuhandu has joined #openstack-infra | 15:02 | |
| AJaeger | nice | 15:02 |
| openstackgerrit | Monty Taylor proposed opendev/jeepyb master: Don't index retired projects https://review.opendev.org/699697 | 15:03 |
| mordred | AJaeger: ^^ | 15:03 |
| AJaeger | checking | 15:03 |
| mordred | the loop rework wasn't too bad | 15:03 |
| AJaeger | mordred: no, wasn't - and should work once you fixed the typo... | 15:04 |
| AJaeger | mordred: thanks | 15:04 |
| *** smarcet has quit IRC | 15:05 | |
| * AJaeger needs to step out for a bit... | 15:06 | |
| openstackgerrit | Monty Taylor proposed opendev/jeepyb master: Don't index retired projects https://review.opendev.org/699697 | 15:07 |
| *** ykarel is now known as ykarel|away | 15:11 | |
| *** ramishra has joined #openstack-infra | 15:12 | |
| *** smarcet has joined #openstack-infra | 15:12 | |
| *** xorxor42 has joined #openstack-infra | 15:13 | |
| mnaser | would anyone off the top of their head know why `DIB_APT_LOCAL_CACHE` is set to 0 (aka "DIB_APT_LOCAL_CACHE=0 will disable internal caching." according to docs) inside infra? | 15:15 |
| xorxor42 | Hello! I'd like to report a (probably small) security issue concerning either the opendev.org infra or one of its hosted project (can't tell), where can I contact some admins privately? Thx | 15:15 |
| mnaser | any infra-root around for ^ ? | 15:15 |
| * mnaser see mordred pushing patches | 15:16 | |
| clarkb | mnaser: we put the caches in our mirror nodes instead of on every image | 15:16 |
| mordred | clarkb is a better contact - I'm in and out | 15:16 |
| mordred | although I'm currently aroud and happy to help | 15:16 |
| clarkb | xorxor42: hi | 15:16 |
| mnaser | clarkb: hmm okay cool | 15:17 |
| xorxor42 | Hi! Are you an admin? If yes, any way for me to check that? | 15:17 |
| *** udesale has joined #openstack-infra | 15:17 | |
| xorxor42 | It's probably no big deal, but I'd like to report something | 15:18 |
| mnaser | xorxor42: clarkb is the project team lead for the infrastructure team - https://governance.openstack.org/tc/reference/projects/infrastructure.html | 15:18 |
| xorxor42 | Ok thanks, I will mp you, if that's ok | 15:18 |
| *** ociuhandu has quit IRC | 15:19 | |
| clarkb | xorxor42: privmsg or email should be fine | 15:19 |
| *** ociuhandu has joined #openstack-infra | 15:20 | |
| *** ociuhandu has quit IRC | 15:21 | |
| *** ociuhandu has joined #openstack-infra | 15:21 | |
| *** lpetrut has quit IRC | 15:23 | |
| mordred | it's a good question re: verificaiton - perhaps we should make a published doc that lists the admins, their IRC nicks, emails and gpg key ids so that someone has a verifiable initial path to knowing who they can contact? | 15:24 |
| clarkb | mordred: seems like a good idea | 15:24 |
| *** yamamoto has joined #openstack-infra | 15:24 | |
| *** udesale has quit IRC | 15:25 | |
| *** udesale has joined #openstack-infra | 15:25 | |
| mordred | clarkb: I made a jeepyb patch above - I know you love reviewing those | 15:27 |
| *** eharney has quit IRC | 15:29 | |
| *** yamamoto has quit IRC | 15:29 | |
| *** auristor has quit IRC | 15:31 | |
| *** panda has quit IRC | 15:31 | |
| stephenfin | Is there an open bug regarding the 'testr_results.html.gz' file being missing on zuul results pages? | 15:33 |
| stephenfin | e.g. https://zuul.opendev.org/t/openstack/build/9b90fb5022524bbdbc737cddc6b259aa/logs | 15:33 |
| *** panda has joined #openstack-infra | 15:33 | |
| *** auristor has joined #openstack-infra | 15:38 | |
| mordred | stephenfin: click the raw link | 15:38 |
| mordred | stephenfin: but clarkb can explain what's going on there better | 15:39 |
| *** smarcet has quit IRC | 15:39 | |
| stephenfin | Oh, weird. Did that change or am I just being dumb? | 15:39 |
| * stephenfin could have sworn there was a normal link to the html page previously | 15:39 | |
| clarkb | I think the console doesn't want to try and render html for you | 15:39 |
| clarkb | and instead wants you to have your browser do it | 15:40 |
| clarkb | its possible that got fixed and was previously attempting to show you html | 15:40 |
| openstackgerrit | Monty Taylor proposed zuul/nodepool master: Add debootstrap to builder package list https://review.opendev.org/699707 | 15:40 |
| clarkb | mordred: I'm not seeing a new db backup on review.o.o after the my.cnf fix | 15:42 |
| clarkb | mordred: the backup command is in roots crontab. Anything obviously wrong with that to you? | 15:43 |
| clarkb | I guess we can run the command and see what happens? | 15:43 |
| mordred | clarkb: yeah | 15:43 |
| mordred | clarkb: --defaults-file=/root/.gerrit_db.cnf | 15:45 |
| mordred | it'll be that | 15:45 |
| mordred | oh - no it won't | 15:45 |
| mordred | hrm | 15:45 |
| clarkb | its running now | 15:45 |
| clarkb | in a root screen | 15:45 |
| clarkb | seems to be working | 15:45 |
| clarkb | let me double check timestamps | 15:45 |
| *** ssbarnea has quit IRC | 15:46 | |
| clarkb | aha I mention the file was updated around 00:41UTC but crontab fires at 00:00 | 15:46 |
| mordred | ah | 15:46 |
| clarkb | I think the cron job simply missed the fix by less than an hour | 15:46 |
| mordred | kk. so we should be fine next time | 15:46 |
| clarkb | ya | 15:46 |
| mordred | WARNING: --ssl is deprecated and will be removed in a future version. Use --ssl-mode instead. | 15:47 |
| clarkb | ya I'm guessing you need to do ssl-mode=foo instead of ssl=false | 15:47 |
| mordred | --ssl-mode=DISABLED | 15:48 |
| openstackgerrit | Monty Taylor proposed opendev/puppet-mysql_backup master: Switch to ssl-mode=DISABLED https://review.opendev.org/699711 | 15:49 |
| mordred | clarkb: ^^ | 15:49 |
| openstackgerrit | Monty Taylor proposed opendev/puppet-mysql_backup master: Switch to ssl-mode=DISABLED https://review.opendev.org/699711 | 15:49 |
| clarkb | when this mysql dump finishes I'll run the bup backup in the same root screen to ensure we get it off host too | 15:50 |
| AJaeger | clarkb, good morning! could you review https://review.opendev.org/#/c/699362/ , please? That starts retiring fuel finally... | 15:51 |
| clarkb | mordred: jeepyb change lgtm but it fails pep8 for some reason | 15:52 |
| AJaeger | mordred: that's unrelated - did pep8 change - or is it running under python3 now? | 15:53 |
| clarkb | AJaeger: Approved the fuel one | 15:53 |
| clarkb | AJaeger: oh that could be it. I had to fix a similar bashate thing with d-g yesterday. It was running under python3 and failing | 15:53 |
| *** yamamoto has joined #openstack-infra | 15:54 | |
| AJaeger | clarkb: thanks for approving. Could you give me permissions to abandon all open fuel changes - and self-approve my changes for retirement, please? Or is there anybody else that likes to abandon and approve? There's nobody from fuel anymore around to do that step ;( | 15:55 |
| openstackgerrit | Monty Taylor proposed opendev/jeepyb master: Don't index retired projects https://review.opendev.org/699697 | 15:55 |
| openstackgerrit | Monty Taylor proposed opendev/jeepyb master: Fix create_hound_config for python3 https://review.opendev.org/699715 | 15:55 |
| mordred | AJaeger, clarkb: ^^ | 15:55 |
| mordred | we arent' running jeepyb under python3 (although we should be, clearly) | 15:55 |
| openstackgerrit | Merged openstack/reviewstats master: Switch reviewers command to use argparse https://review.opendev.org/692847 | 15:55 |
| openstackgerrit | Merged openstack/reviewstats master: reviewers: make --project and --stable mutually exclusive https://review.opendev.org/692848 | 15:55 |
| mordred | but the pep8 is running in python3 | 15:55 |
| mordred | so that should fix it for both | 15:56 |
| *** udesale has quit IRC | 15:56 | |
| AJaeger | thanks, mordred | 15:56 |
| *** smarcet has joined #openstack-infra | 15:56 | |
| openstackgerrit | Sean McGinnis proposed openstack/reviewstats master: Clean up requirements https://review.opendev.org/699717 | 15:57 |
| clarkb | mysqldump has completed. I'm running bup in root screen on review.o.o | 16:01 |
| clarkb | we could stand to do some cleanup of gerrits homedir (its collected a number of backup indexes and ancient db backups | 16:03 |
| *** gyee has joined #openstack-infra | 16:03 | |
| clarkb | I'll start that process by proposing a list of files to cleanup | 16:04 |
| openstackgerrit | Merged openstack/project-config master: Retire fuel and fuel-ccp repositories (step 2) https://review.opendev.org/699362 | 16:07 |
| *** ssbarnea has joined #openstack-infra | 16:08 | |
| *** armax has joined #openstack-infra | 16:09 | |
| *** chandankumar is now known as raukadah | 16:10 | |
| *** smarcet has quit IRC | 16:13 | |
| clarkb | AJaeger: for the gerrit perms I think I need to put you in project bootstrappers | 16:18 |
| clarkb | AJaeger: if you just needed to abandon then gerrit admin would be enough but the self approving needs bootstrappers iirc | 16:18 |
| clarkb | mordred: ^ that sound right to you? | 16:18 |
| AJaeger | clarkb: ah, ok. I checked the fuel groups - there are too many to add me to ;( | 16:19 |
| clarkb | AJaeger: oh ya I could do that. How many are there? | 16:19 |
| * clarkb looks | 16:19 | |
| AJaeger | clarkb: over 30 ;( | 16:19 |
| AJaeger | fuel-ccp has one group per repo | 16:19 |
| *** iurygregory has joined #openstack-infra | 16:20 | |
| AJaeger | that's why I suggested to not go down that road. Your call ;) | 16:20 |
| AJaeger | wait, https://review.opendev.org/#/admin/groups/1457,members is included by most - we can try that. | 16:20 |
| clarkb | AJaeger: some add fuel-core and fuel-release as group members but not all :( | 16:20 |
| clarkb | sure can start with those additions | 16:21 |
| clarkb | and I guess if you have problems let me know and we'll just target those? | 16:21 |
| AJaeger | as well as https://review.opendev.org/#/admin/groups/209,members | 16:21 |
| AJaeger | yes, fuel-ccp-core and fuel-core should get us started, so let's do that. | 16:21 |
| clarkb | done. I also did -release for fuel and fuel-ccp | 16:22 |
| clarkb | since that seems to pop up in a couple places | 16:22 |
| AJaeger | Ok, will start abandoning etc. now. | 16:22 |
| AJaeger | thanks | 16:22 |
| *** yamamoto has quit IRC | 16:22 | |
| *** eharney has joined #openstack-infra | 16:24 | |
| *** smarcet has joined #openstack-infra | 16:24 | |
| AJaeger | config-core, please review https://review.opendev.org/699635 and https://review.opendev.org/699664 as next steps for fuel retirement. | 16:26 |
| openstackgerrit | Merged zuul/nodepool master: Add debootstrap to builder package list https://review.opendev.org/699707 | 16:27 |
| openstackgerrit | Mohammed Naser proposed openstack/diskimage-builder master: modprobe.d: use $TMP_MOUNT_PATH https://review.opendev.org/699722 | 16:27 |
| *** ociuhandu has quit IRC | 16:30 | |
| openstackgerrit | Mohammed Naser proposed zuul/nodepool master: Add procps to packages in Dockerfile https://review.opendev.org/699725 | 16:32 |
| clarkb | infra-root http://paste.openstack.org/show/BoP6WhVAe5XbXtf8gDUC/ I think we can clean up those gerrit dirs | 16:33 |
| *** eharney_ has joined #openstack-infra | 16:33 | |
| clarkb | I'm also not in a rush to do that, but noticed we've collected some boxes in the attic over the years | 16:33 |
| corvus | clarkb: all lgtm | 16:35 |
| *** eharney has quit IRC | 16:37 | |
| *** alti_17 has joined #openstack-infra | 16:42 | |
| openstackgerrit | Mohammed Naser proposed openstack/diskimage-builder master: modprobe.d: use $TMP_MOUNT_PATH https://review.opendev.org/699722 | 16:42 |
| openstackgerrit | Clark Boylan proposed openstack/devstack-gate master: Bump ANSIBLE_VERSION default to 2.7.14 https://review.opendev.org/699463 | 16:46 |
| openstackgerrit | Clark Boylan proposed openstack/devstack-gate master: Set tox basepython to python2 https://review.opendev.org/699730 | 16:46 |
| clarkb | mriedem: ^ split out and actually fixed properly | 16:46 |
| *** pgaxatte has quit IRC | 16:48 | |
| AJaeger | clarkb: I don't have permissions for fuel-octane, tuning-box, fuel-ccp-tests (but not finished yet, more might come) | 16:48 |
| clarkb | AJaeger: you shoudl have perms on those three now | 16:49 |
| AJaeger | thanks | 16:51 |
| AJaeger | clarkb: fuel-devops is also needed | 16:51 |
| *** auristor has quit IRC | 16:51 | |
| *** lucasagomes has quit IRC | 16:52 | |
| AJaeger | and fuel-plugin-murano | 16:52 |
| AJaeger | infra-root, can you confirm that we don't need trusty logstash jobs? See https://review.opendev.org/699563 | 16:54 |
| mriedem | clarkb: ack thanks | 16:55 |
| mriedem | i'm hacking on a workaround for http://status.openstack.org/elastic-recheck/#1844929 since there is no end in sight for that bug | 16:55 |
| *** auristor has joined #openstack-infra | 16:56 | |
| clarkb | AJaeger: can we make sure that legacy-logstash-filters runs and passes? | 16:56 |
| clarkb | AJaeger: we do run on xenial now so those tests should work but not sure | 16:56 |
| *** alti_17 has quit IRC | 16:58 | |
| *** yamamoto has joined #openstack-infra | 16:58 | |
| *** kopecmartin is now known as kopecmartin|off | 16:58 | |
| AJaeger | clarkb: that's what my change does | 16:58 |
| AJaeger | clarkb: see the references in commit message: the xenial tests pass | 16:59 |
| clarkb | sshnaidm: is https://bugs.launchpad.net/tripleo/+bug/1856864 possibly related to your network failures getting the constraints file? | 16:59 |
| openstack | Launchpad bug 1856864 in tripleo "Not all firewall rules are applied, leading to timeouts" [Critical,In progress] - Assigned to Emilien Macchi (emilienm) | 16:59 |
| clarkb | AJaeger: oh sorry I was looking at the job runs on that particular repo | 16:59 |
| clarkb | but now see it is ozj | 16:59 |
| openstackgerrit | Merged openstack/openstack-zuul-jobs master: Remove fuel jobs https://review.opendev.org/699635 | 16:59 |
| clarkb | AJaeger: approved. Thank you | 17:00 |
| mordred | fatal: [localhost]: FAILED! => {"changed": false, "msg": "Failure downloading https://release-archives.puppet.com/apt/pool/xenial/PC1/p/puppet-agent/puppet-agent_1.10.14-1xenial_amd64.deb, Request failed: <urlopen error [Errno -2] Name or service not known>"} | 17:00 |
| mordred | sigh | 17:00 |
| mordred | clarkb: ^^ | 17:01 |
| sshnaidm | clarkb, difficult to say, it can affect any network related stuff | 17:01 |
| clarkb | mordred: so they deleted the archive that they said they wouldn't delete? | 17:01 |
| sshnaidm | clarkb, but I don't think iptables have something with outgoing connections here | 17:01 |
| AJaeger | clarkb: thanks. Want to review https://review.opendev.org/699360 and https://review.opendev.org/699564 as well? That removes further trusty jobs | 17:01 |
| mordred | clarkb: no - that link works - I think it was a temporary hiccup | 17:01 |
| clarkb | mordred: dns is broken for it | 17:02 |
| clarkb | mordred: its a cname to a cloudfront location with no A/AAAA records | 17:02 |
| mordred | clarkb: it resolved from my laptop here in mexico | 17:03 |
| clarkb | ok so probably a cdn issue then | 17:03 |
| mordred | "yay" | 17:03 |
| clarkb | with globally aware dns | 17:03 |
| clarkb | I'll ping some puppet people | 17:03 |
| openstackgerrit | Merged openstack/project-config master: Retire x/fuel-plugin-calico https://review.opendev.org/699664 | 17:05 |
| *** yamamoto has quit IRC | 17:11 | |
| openstackgerrit | Merged openstack/openstack-zuul-jobs master: Remove logstash trusty job https://review.opendev.org/699563 | 17:11 |
| AJaeger | clarkb, I need some more permissions, please: https://review.opendev.org/#/admin/groups/656,members https://review.opendev.org/#/admin/groups/646,members https://review.opendev.org/#/admin/groups/663,members https://review.opendev.org/#/admin/groups/1575,members https://review.opendev.org/#/admin/groups/1560,members https://review.opendev.org/#/admin/groups/1310,members - hope that's it.. | 17:16 |
| clarkb | on it | 17:16 |
| AJaeger | thanks | 17:17 |
| *** rlandy is now known as rlandy|brb | 17:17 | |
| clarkb | done | 17:18 |
| *** diablo_rojo has joined #openstack-infra | 17:18 | |
| *** auristor has quit IRC | 17:19 | |
| AJaeger | great | 17:20 |
| * AJaeger loves mass-abandon with gertty ;) | 17:20 | |
| *** auristor has joined #openstack-infra | 17:21 | |
| *** hashar has joined #openstack-infra | 17:21 | |
| *** rpittau is now known as rpittau|afk | 17:21 | |
| *** gfidente is now known as gfidente|afk | 17:24 | |
| *** dklyle has quit IRC | 17:26 | |
| *** david-lyle has joined #openstack-infra | 17:26 | |
| *** david-lyle has quit IRC | 17:26 | |
| *** david-lyle has joined #openstack-infra | 17:26 | |
| *** ykarel|away has quit IRC | 17:26 | |
| AJaeger | team, I left a question on openstack-discuss mailing list: Should we retire all the fuel-plugins in the x namespace? Those don't make sense without fuel - and have no actions since 2 years, see http://lists.openstack.org/pipermail/openstack-discuss/2019-December/011661.html | 17:32 |
| *** smarcet has quit IRC | 17:33 | |
| mordred | AJaeger: I think so | 17:35 |
| *** mattw4 has joined #openstack-infra | 17:35 | |
| *** jpena is now known as jpena|off | 17:36 | |
| *** panda has quit IRC | 17:36 | |
| *** smarcet has joined #openstack-infra | 17:37 | |
| *** panda has joined #openstack-infra | 17:39 | |
| *** psachin has quit IRC | 17:39 | |
| *** rlandy|brb is now known as rlandy | 17:46 | |
| AJaeger | https://review.opendev.org/#/q/(projects:openstack/fuel+OR+projects:x/fuel-ccp+OR+project:openstack/tuning-box+OR+project:openstack/python-fuelclient)+is:open is empty! | 17:50 |
| *** ociuhandu has joined #openstack-infra | 17:51 | |
| AJaeger | clarkb: want to merge https://review.opendev.org/699639 to finish fuel retirement, please? | 17:51 |
| clarkb | done | 17:54 |
| AJaeger | bnemec: could you review https://review.opendev.org/699691, please? If you're fine with that change I can +2A... | 17:54 |
| AJaeger | thanks, clarkb ! | 17:54 |
| *** ociuhandu has quit IRC | 17:55 | |
| *** rascasoft has quit IRC | 17:56 | |
| AJaeger | config-core, could you review these trusty changes, please? https://review.opendev.org/699564 https://review.opendev.org/699348 https://review.opendev.org/699360 | 17:58 |
| openstackgerrit | Tristan Cacqueray proposed zuul/zuul master: spec: add a zuul-runner cli https://review.opendev.org/681277 | 17:59 |
| openstackgerrit | Kendall Nelson proposed openstack/cookiecutter master: Update CONTRIBUTING.rst template https://review.opendev.org/696001 | 18:00 |
| openstackgerrit | Merged openstack/project-config master: Retire fuel and fuel-ccp (step 4) https://review.opendev.org/699639 | 18:03 |
| *** derekh has quit IRC | 18:04 | |
| AJaeger | \o/ | 18:05 |
| *** rfolco has quit IRC | 18:07 | |
| clarkb | AJaeger: I have to step away for a little bit but will try to get to those last changes after | 18:07 |
| AJaeger | no urgency - just want to get them from my plate ;) Thanks, clarkb | 18:09 |
| *** electrofelix has quit IRC | 18:09 | |
| openstackgerrit | Merged openstack/project-config master: Remove legacy-group-based-policy trusty jobs https://review.opendev.org/699360 | 18:10 |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Remove retired fuel repos from zuul.d/projects.yaml https://review.opendev.org/699748 | 18:14 |
| AJaeger | config-core, Sorry, I forgot one change and we now have an invalid Zuul config probably, please review ^ | 18:15 |
| *** sgw has joined #openstack-infra | 18:15 | |
| clarkb | puppet release archives dns name is resolving now | 18:16 |
| clarkb | I can grab the deb now | 18:16 |
| clarkb | and really poppping out now | 18:16 |
| sgw | Morning Folks, gerrit question about workflow+1 and Depends-On merging. I seem to have some stuck or delayed reviews getting through the merge gate. A number of reviews got +W before the dependent review was merged. Now those just seem to be waiting, I ran recheck on a couple and that caused them to merge, but not sure I want to do that for 20 reviews. Thoughts? | 18:18 |
| *** yolanda__ is now known as yolanda | 18:18 | |
| *** priteau has quit IRC | 18:19 | |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Retire remaining fuel repos (step 2) https://review.opendev.org/699752 | 18:20 |
| AJaeger | sgw: remove +W and re-add it again. | 18:20 |
| AJaeger | or have somebody else add a +W | 18:20 |
| AJaeger | that's the only alternative | 18:21 |
| sgw | so there is not "job" that goes around and notices these "stuck" reviews? | 18:22 |
| *** tosky has quit IRC | 18:23 | |
| *** smarcet has quit IRC | 18:24 | |
| AJaeger | sgw: correct, there's one. Those will only merge together if they share the same queue | 18:25 |
| AJaeger | you can - for the future- configure repos into the same queue | 18:25 |
| *** ralonsoh has quit IRC | 18:25 | |
| AJaeger | which only makes sense for related repos | 18:25 |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Retire remaining fuel repos (step 2) https://review.opendev.org/699752 | 18:26 |
| *** Goneri has quit IRC | 18:28 | |
| AJaeger | mordred: thanks, I'll start the x/fuel retirement now... | 18:28 |
| clarkb | sgw: AJaeger you don't even need to remove the vote anymore to reapply it. That got fixed in gerrit. Should be able to apply +W again | 18:34 |
| clarkb | also the way you get zuul to auto notice these things is to put them in the same gate queue | 18:34 |
| clarkb | when the projects share a gate queue Zuul checks if there are any projects that can be gated once dependencies merge | 18:35 |
| AJaeger | sgw: which repos are you talking about? | 18:35 |
| sgw | AJaeger: starlingx/integ on the f/centos8 branch | 18:36 |
| sgw | https://review.opendev.org/#/q/status:open+project:starlingx/integ+branch:f/centos8 | 18:37 |
| AJaeger | sgw: and the dependency? | 18:37 |
| clarkb | looks like starlingx/tools at least | 18:38 |
| sgw | Those merged this morning | 18:38 |
| clarkb | yes I think AJaeger is trying to understand which repos are involved so that he can suggest a change to make them share a queue | 18:38 |
| AJaeger | sgw, so you could have a shared queue "starlingx" for these repos | 18:38 |
| AJaeger | sgw, so if you want this, add "queue: starlingx" to the .zuul.yaml file of both repositories. This also means that these get serialized: If you approve two changes, then they will merge after each other and not in parallel. | 18:39 |
| *** eharney_ has quit IRC | 18:40 | |
| clarkb | they will be tested in parallel though | 18:40 |
| AJaeger | yes, correct | 18:41 |
| sgw | I will have to run this by the starlingx team, seems like it might be the right approach for the cross repo dependencies. | 18:42 |
| sgw | but for now, I need to touch each of the affected reviews with a -W/+W action? | 18:42 |
| sgw | Or just re-apply +W | 18:42 |
| *** openstackgerrit has quit IRC | 18:43 | |
| clarkb | sgw: just reapply +W should be sufficient. An old gerrit bug that was fixed required us to do the -W then +W but I believe that is no longer a problem | 18:43 |
| *** openstackgerrit has joined #openstack-infra | 18:50 | |
| openstackgerrit | Merged zuul/nodepool master: Add procps to packages in Dockerfile https://review.opendev.org/699725 | 18:50 |
| openstackgerrit | Merged zuul/nodepool master: Functional tests - use common verification script https://review.opendev.org/698834 | 18:50 |
| *** rfolco has joined #openstack-infra | 18:52 | |
| *** sshnaidm is now known as sshnaidm|afk | 18:58 | |
| openstackgerrit | Andreas Jaeger proposed openstack/project-config master: Retire x/fuel repos (step 4) https://review.opendev.org/699849 | 18:59 |
| AJaeger | another 96 repos to retire ;( ^ | 18:59 |
| AJaeger | a couple of those repos had never a single change merged ;( | 19:03 |
| *** jamesmcarthur has quit IRC | 19:03 | |
| clarkb | AJaeger: thats efficiency :) | 19:04 |
| clarkb | bup did eventually complete on review.o.o | 19:05 |
| clarkb | I've closed my root screen there | 19:05 |
| AJaeger | we should ask for 100 USD per new repo - and return them if they get properly retired ;) | 19:07 |
| AJaeger | If not, we get some money for our next bar visit ;) | 19:08 |
| AJaeger | mnaser: could you review https://review.opendev.org/699748 , please? I missed that earlier ;( | 19:20 |
| openstackgerrit | Clark Boylan proposed openstack/project-config master: Run zuul tenant jobs under ansible 2.9 https://review.opendev.org/699857 | 19:24 |
| clarkb | pabelanger: corvus ^ fyi I think that is the next step in the ansible 2.9 rollout | 19:24 |
| *** jamesmcarthur has joined #openstack-infra | 19:26 | |
| openstackgerrit | Merged openstack/openstack-zuul-jobs master: Remove openstack-python-jobs-trusty template https://review.opendev.org/699348 | 19:27 |
| openstackgerrit | Merged openstack/openstack-zuul-jobs master: Remove trusty group-based-policy jobs https://review.opendev.org/699564 | 19:28 |
| *** smarcet has joined #openstack-infra | 19:37 | |
| *** Goneri has joined #openstack-infra | 19:37 | |
| *** jamesmcarthur has quit IRC | 19:38 | |
| AJaeger | clarkb: thanks for reviews. If you have time later this week, https://review.opendev.org/699752 might be nice as well but has no urgency - the rest of the changes we can do in January... | 19:44 |
| openstackgerrit | Merged opendev/system-config master: Update pip3 role to install from get-pip.py https://review.opendev.org/690766 | 19:46 |
| openstackgerrit | Merged opendev/system-config master: Add service playbook and test run for prod gerrit https://review.opendev.org/691171 | 19:46 |
| mriedem | clarkb: just noticed the e-r last updated is about a week old http://status.openstack.org/elastic-recheck/ | 19:51 |
| mriedem | Data Last Updated: Wed Dec 11 2019 08:30:02 GMT-0600 (Central Standard Time) | 19:51 |
| *** smarcet has quit IRC | 19:51 | |
| mriedem | will run the graph locally to see if some query is busted | 19:54 |
| openstackgerrit | Merged opendev/system-config master: Add launchpadlib credentials to gerrit ansible https://review.opendev.org/691172 | 19:55 |
| openstackgerrit | Merged opendev/system-config master: Add replication config to gerrit ansible https://review.opendev.org/691173 | 19:55 |
| clarkb | it might be stuck on its lockfiles again | 19:56 |
| *** pkopec has quit IRC | 19:58 | |
| mriedem | ooo i got this locally: | 19:59 |
| mriedem | pyelasticsearch.exceptions.ElasticHttpError: (500, 'ArrayIndexOutOfBoundsException[null]') | 19:59 |
| mriedem | pyelasticsearch==0.7.1 | 19:59 |
| mriedem | oh that's old as hell b/c we pin to <1.0 | 20:00 |
| clarkb | ya because we have anacient ES :/ | 20:00 |
| *** david-lyle is now known as dklyle | 20:00 | |
| mriedem | and no love on your https://github.com/pyelasticsearch/pyelasticsearch/pull/182 | 20:00 |
| clarkb | huh I haveno memory of writing that :) | 20:05 |
| mriedem | lemme see if it's a specific query | 20:05 |
| mriedem | is that pre-kids? | 20:05 |
| mriedem | 2015 | 20:05 |
| clarkb | just after | 20:06 |
| mriedem | ha that's why you don't remember anything | 20:06 |
| clarkb | that probably explains the memory loss though :) | 20:06 |
| *** jamesmcarthur has joined #openstack-infra | 20:09 | |
| *** rf0lc0 has joined #openstack-infra | 20:15 | |
| *** hashar has quit IRC | 20:16 | |
| *** rfolco has quit IRC | 20:17 | |
| *** hashar has joined #openstack-infra | 20:24 | |
| openstackgerrit | Merged openstack/diskimage-builder master: modprobe.d: use $TMP_MOUNT_PATH https://review.opendev.org/699722 | 20:29 |
| *** ramishra has quit IRC | 20:31 | |
| mriedem | looks like this query is causing the problem https://opendev.org/opendev/elastic-recheck/src/branch/master/queries/1708704.yaml | 20:33 |
| *** auristor has quit IRC | 20:35 | |
| clarkb | does it work if run manually against kibana? | 20:35 |
| *** slaweq has quit IRC | 20:36 | |
| mriedem | it's not blowin gup | 20:37 |
| mriedem | i wonder if something is screwed up in the parsing of allow-nonvoting: true | 20:37 |
| *** hashar has quit IRC | 20:38 | |
| *** auristor has joined #openstack-infra | 20:38 | |
| mriedem | the results in kibana don't really make sense though | 20:39 |
| mriedem | oh here we go - it's hitting in the giant ass tripleo console logs | 20:40 |
| mriedem | so i wonder if it's blowing the heap or something | 20:40 |
| *** rf0lc0 has quit IRC | 20:41 | |
| *** auristor has quit IRC | 20:43 | |
| *** auristor has joined #openstack-infra | 20:43 | |
| mriedem | huh, so that bug does show up in the gate queue http://status.openstack.org/elastic-recheck/gate.html#1708704 | 20:44 |
| mriedem | but blows up the check queue index page | 20:44 |
| *** slaweq has joined #openstack-infra | 20:45 | |
| openstackgerrit | Matt Riedemann proposed opendev/elastic-recheck master: Handle ElasticHttpError in graph generation https://review.opendev.org/699869 | 20:49 |
| mriedem | ^ is a workaround | 20:49 |
| *** auristor has quit IRC | 20:53 | |
| *** iurygregory has quit IRC | 20:53 | |
| *** auristor has joined #openstack-infra | 20:55 | |
| *** yamamoto has joined #openstack-infra | 21:11 | |
| *** szaher has quit IRC | 21:15 | |
| *** yamamoto has quit IRC | 21:17 | |
| *** rf0lc0 has joined #openstack-infra | 21:26 | |
| clarkb | mriedem: approved | 21:42 |
| corvus | i'm going to restart zuul | 21:47 |
| *** dkehn has quit IRC | 21:50 | |
| mriedem | clarkb: with that you likely need to restart the e-r worker yeah? | 21:52 |
| mriedem | err after it merges | 21:52 |
| clarkb | mriedem: I think it will automatically update since we fork new processes for the graph generation | 21:52 |
| *** pcaruana has quit IRC | 21:54 | |
| corvus | #status log restarted all of zuul at commit 84f6ea667c3453a75a7a0210ee08228c9eec167a | 22:00 |
| openstackstatus | corvus: finished logging | 22:00 |
| *** jamesmcarthur has quit IRC | 22:04 | |
| *** mattw4 has quit IRC | 22:07 | |
| *** xorxor42 has quit IRC | 22:08 | |
| *** dpawlik has quit IRC | 22:08 | |
| openstackgerrit | Matt Riedemann proposed opendev/elastic-recheck master: Add query for test_create_servers_with_vpmem bug 1856902 https://review.opendev.org/699878 | 22:09 |
| openstack | bug 1856902 in OpenStack Compute (nova) "nova.tests.functional.libvirt.test_vpmem.VPMEMTests.test_create_servers_with_vpmem fails intermittently" [Medium,Confirmed] https://launchpad.net/bugs/1856902 | 22:09 |
| *** mattw4 has joined #openstack-infra | 22:10 | |
| *** haleyb has quit IRC | 22:22 | |
| openstackgerrit | Merged opendev/elastic-recheck master: Handle ElasticHttpError in graph generation https://review.opendev.org/699869 | 22:37 |
| *** KeithMnemonic1 has quit IRC | 22:38 | |
| *** mriedem has quit IRC | 22:51 | |
| *** mattw4 has quit IRC | 22:51 | |
| openstackgerrit | Merged opendev/elastic-recheck master: Add query for test_create_servers_with_vpmem bug 1856902 https://review.opendev.org/699878 | 22:56 |
| openstack | bug 1856902 in OpenStack Compute (nova) "nova.tests.functional.libvirt.test_vpmem.VPMEMTests.test_create_servers_with_vpmem fails intermittently" [Medium,Confirmed] https://launchpad.net/bugs/1856902 | 22:56 |
| *** mattw4 has joined #openstack-infra | 22:59 | |
| *** tkajinam has joined #openstack-infra | 23:05 | |
| *** rcernin has joined #openstack-infra | 23:10 | |
| *** rlandy is now known as rlandy|bbl | 23:11 | |
| *** ccamacho has quit IRC | 23:23 | |
| *** goldyfruit_ has joined #openstack-infra | 23:23 | |
| *** goldyfruit has quit IRC | 23:24 | |
| *** dchen has joined #openstack-infra | 23:29 | |
| *** mattw4 has quit IRC | 23:40 | |
| *** mattw4 has joined #openstack-infra | 23:40 | |
| *** mattw4 has quit IRC | 23:45 | |
| *** yamamoto has joined #openstack-infra | 23:46 | |
| *** mattw4 has joined #openstack-infra | 23:46 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
