| opendevreview | Merged openstack/kayobe master: Bump MichaelRigart.interfaces to v1.15.4 https://review.opendev.org/c/openstack/kayobe/+/943350 | 00:10 |
|---|---|---|
| opendevreview | Merged openstack/kolla-ansible stable/2024.2: Fix Redis Sentinel authentication for octavia's jobboard HA https://review.opendev.org/c/openstack/kolla-ansible/+/945137 | 00:24 |
| opendevreview | Merged openstack/kolla-ansible master: CI: Wait until containers exit health starting state https://review.opendev.org/c/openstack/kolla-ansible/+/944104 | 00:50 |
| opendevreview | Verification of a change to openstack/kolla-ansible stable/2024.1 failed: Fix Redis Sentinel authentication for octavia's jobboard HA https://review.opendev.org/c/openstack/kolla-ansible/+/945141 | 01:27 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: base: Remove /etc/apt/sources.list.d/ubuntu.sources as well https://review.opendev.org/c/openstack/kolla/+/945182 | 06:23 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: Run ML2/OVS agents processes in separate containers https://review.opendev.org/c/openstack/kolla-ansible/+/864780 | 06:48 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: Run ML2/OVS agents processes in separate containers https://review.opendev.org/c/openstack/kolla-ansible/+/864780 | 07:00 |
| opendevreview | Verification of a change to openstack/kolla-ansible stable/2024.1 failed: Fix Redis Sentinel authentication for octavia's jobboard HA https://review.opendev.org/c/openstack/kolla-ansible/+/945141 | 07:27 |
| opendevreview | Roman Krcek proposed openstack/ansible-collection-kolla master: Add uninstall tasks https://review.opendev.org/c/openstack/ansible-collection-kolla/+/925083 | 07:55 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: Run ML2/OVS agents processes in separate containers https://review.opendev.org/c/openstack/kolla-ansible/+/864780 | 08:21 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: Run ML2/OVS agents processes in separate containers https://review.opendev.org/c/openstack/kolla-ansible/+/864780 | 08:29 |
| opendevreview | Michal Nasiadka proposed openstack/kolla master: Bump non-OpenStack projects versions https://review.opendev.org/c/openstack/kolla/+/945144 | 08:34 |
| priteau | Apologies if this has been discussed before, do we know if the source of the many job timeouts we are seeing is just the rax instances (and why now? has there been any significant change on their side?) or are we dealing with some other issue? | 08:44 |
| priteau | We are seeing the timeouts in kayobe CI too | 08:44 |
| frickler | priteau: I've been looking at those and what I've seen so far is that they always seem to happen on rax nodes, mostly rax-dfw. but then there seem to be two different kinds of situations: | 08:50 |
| frickler | one is just slower than usual, but generally progressing fine, though not fast enough to finish within the timeout. this is why I bumped the base job timeout from 2h to 2.5h | 08:51 |
| frickler | others are so slow that they don't even finish pulling the images within the timeout | 08:51 |
| priteau | I am looking at https://zuul.opendev.org/t/openstack/build/25d87d0334384040bdcb396279ea0c6b now and in this one the pull is taking a long time | 08:52 |
| priteau | Playbook run took 0 days, 1 hours, 40 minutes, 53 seconds | 08:52 |
| priteau | Issue with mirror-int.dfw.rax.opendev.org maybe? | 08:52 |
| frickler | priteau: if it was an issue on the mirror, I think it would happen more often and also affect other projects. I'm currently thinking that for a small subset of hypervisors either disk- or network-io is impacted, but not sure yer how to test that | 08:54 |
| frickler | I guess I should set up an autohold for a couple of jobs and look into performance locally | 08:54 |
| priteau | right, it could be client side too | 08:55 |
| opendevreview | Grzegorz Koper proposed openstack/kolla-ansible master: Bump ansible-core versions to 2.17 and 2.18 https://review.opendev.org/c/openstack/kolla-ansible/+/941787 | 08:56 |
| opendevreview | Franciszek Przewoźny proposed openstack/kolla-ansible master: Allow for keepalived configuration with given subnet prefix. https://review.opendev.org/c/openstack/kolla-ansible/+/945194 | 09:02 |
| opendevreview | Franciszek Przewoźny proposed openstack/kolla-ansible master: Keepalived configuration with subnet prefix https://review.opendev.org/c/openstack/kolla-ansible/+/945195 | 09:06 |
| opendevreview | Franciszek Przewoźny proposed openstack/kolla-ansible master: Keepalived configuration with subnet prefix https://review.opendev.org/c/openstack/kolla-ansible/+/945196 | 09:08 |
| opendevreview | Franciszek Przewoźny proposed openstack/kolla-ansible master: Keepalived configuration with subnet prefix https://review.opendev.org/c/openstack/kolla-ansible/+/945194 | 09:09 |
| opendevreview | Franciszek Przewoźny proposed openstack/kolla-ansible master: Remove tailing space https://review.opendev.org/c/openstack/kolla-ansible/+/945198 | 09:27 |
| opendevreview | Franciszek Przewoźny proposed openstack/kolla-ansible master: Keepalived configuration with subnet prefix https://review.opendev.org/c/openstack/kolla-ansible/+/945196 | 09:29 |
| frickler | another thing to look at would be whether we'd always want to build our images locally instead of pulling them from quay, if that turns out to be more reliable | 09:35 |
| opendevreview | Dr. Jens Harbott proposed openstack/kolla master: Remove swift container images https://review.opendev.org/c/openstack/kolla/+/945114 | 09:37 |
| frickler | at least on a quick glance, kolla patches do not seem to be affected as much by the timeouts, and the ones that I did see are on other providers, so looks like a different issue there | 09:40 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: Run ML2/OVS agents processes in separate containers https://review.opendev.org/c/openstack/kolla-ansible/+/864780 | 09:50 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: Run ML2/OVS agents processes in separate containers https://review.opendev.org/c/openstack/kolla-ansible/+/864780 | 09:57 |
| mnasiadka | frickler: building pulls in a lot of things from github and other places - so I'm not certain it's going to be better - easier for us would be to publish also to some local opendev container registry (but I understand maintaining it might be problematic) | 09:59 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: mariadb: Use mysql_query instead of command https://review.opendev.org/c/openstack/kolla-ansible/+/944411 | 10:01 |
| opendevreview | Merged openstack/kolla-ansible stable/2024.1: Fix Redis Sentinel authentication for octavia's jobboard HA https://review.opendev.org/c/openstack/kolla-ansible/+/945141 | 10:34 |
| opendevreview | Verification of a change to openstack/kolla master failed: Add mtools package to ironic-conductor image https://review.opendev.org/c/openstack/kolla/+/942785 | 12:02 |
| opendevreview | Grzegorz Koper proposed openstack/kolla-ansible master: Bump ansible-core versions to 2.17 and 2.18 https://review.opendev.org/c/openstack/kolla-ansible/+/941787 | 12:04 |
| opendevreview | Seunghun Lee proposed openstack/kayobe master: Fix netplan packages do not getting fully removed https://review.opendev.org/c/openstack/kayobe/+/945207 | 12:31 |
| opendevreview | Merged openstack/kayobe master: Bump version of stackhpc.linux collection https://review.opendev.org/c/openstack/kayobe/+/944142 | 12:53 |
| opendevreview | Pierre Riteau proposed openstack/kayobe stable/2024.2: Bump version of stackhpc.linux collection https://review.opendev.org/c/openstack/kayobe/+/945209 | 13:24 |
| opendevreview | Pierre Riteau proposed openstack/kayobe stable/2024.1: Bump version of stackhpc.linux collection https://review.opendev.org/c/openstack/kayobe/+/945210 | 13:30 |
| opendevreview | Bartosz Bezak proposed openstack/kolla master: fix sources.py based cross-arch builds https://review.opendev.org/c/openstack/kolla/+/938791 | 14:29 |
| opendevreview | Bartosz Bezak proposed openstack/kolla master: fix sources.py based cross-arch builds https://review.opendev.org/c/openstack/kolla/+/938791 | 14:32 |
| opendevreview | Bartosz Bezak proposed openstack/kolla master: fix sources.py based cross-arch builds https://review.opendev.org/c/openstack/kolla/+/938791 | 14:34 |
| opendevreview | Merged openstack/kolla-ansible master: mariadb: Use mysql_query instead of command https://review.opendev.org/c/openstack/kolla-ansible/+/944411 | 14:52 |
| opendevreview | Bartosz Bezak proposed openstack/kolla master: tests: Add cross-arch test for etcd https://review.opendev.org/c/openstack/kolla/+/940442 | 15:09 |
| opendevreview | Bartosz Bezak proposed openstack/kolla master: fix sources.py based cross-arch builds https://review.opendev.org/c/openstack/kolla/+/938791 | 15:10 |
| opendevreview | Bartosz Bezak proposed openstack/kolla master: fix sources.py based cross-arch builds https://review.opendev.org/c/openstack/kolla/+/938791 | 15:11 |
| opendevreview | Merged openstack/kolla master: Add mtools package to ironic-conductor image https://review.opendev.org/c/openstack/kolla/+/942785 | 15:34 |
| opendevreview | Michal Nasiadka proposed openstack/kolla-ansible master: Remove Swift role https://review.opendev.org/c/openstack/kolla-ansible/+/945113 | 16:31 |
| opendevreview | Grzegorz Koper proposed openstack/kolla-ansible master: Bump ansible-core versions to 2.17 and 2.18 https://review.opendev.org/c/openstack/kolla-ansible/+/941787 | 16:34 |
| opendevreview | Grzegorz Koper proposed openstack/kolla-ansible master: Bump ansible-core versions to 2.17 and 2.18 https://review.opendev.org/c/openstack/kolla-ansible/+/941787 | 17:02 |
| opendevreview | Bartosz Bezak proposed openstack/kolla master: fix sources.py based cross-arch builds https://review.opendev.org/c/openstack/kolla/+/938791 | 17:06 |
| opendevreview | Bartosz Bezak proposed openstack/kolla master: tests: Add cross-arch test for etcd https://review.opendev.org/c/openstack/kolla/+/940442 | 17:06 |
| opendevreview | Grzegorz Koper proposed openstack/kolla-ansible master: Bump ansible-core versions to 2.17 and 2.18 https://review.opendev.org/c/openstack/kolla-ansible/+/941787 | 17:29 |
| opendevreview | Grzegorz Koper proposed openstack/kolla-ansible master: Bump ansible-core versions to 2.17 and 2.18 https://review.opendev.org/c/openstack/kolla-ansible/+/941787 | 17:37 |
| opendevreview | Merged openstack/kayobe master: Fix netplan packages do not getting fully removed https://review.opendev.org/c/openstack/kayobe/+/945207 | 19:06 |
| opendevreview | Merged openstack/kayobe stable/2024.2: infra-vm: efficiently handle `hostvars` during deploy and destroy https://review.opendev.org/c/openstack/kayobe/+/939533 | 19:06 |
| opendevreview | Pierre Riteau proposed openstack/kayobe master: Improve release note of netplan fix https://review.opendev.org/c/openstack/kayobe/+/945258 | 20:46 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!