| mikal | Oh that's disappointing -- the relevant file (libvirtd.txt) isn't collected for elasticsearch. | 05:55 |
|---|---|---|
| mikal | I ended up scripting a scrape of the logs and drawing this super scientific graph of failures for this problem on master in the last 30 days: https://madebymikal.com/shee0aedieFeico7Fiey/libvirt_chart.png | 05:55 |
| mikal | I think what is happening is that the timing is slightly different on Rocky which stops libvirtd from getting "flooded" with more than five requests at the same time, I cannot see a different in the defaults for these config options between Debian / Ubuntu / Rocky. | 05:56 |
| mikal | Either way, tuning this seems like it would definitely improve the reliability of CI for Debian / Ubuntu? | 05:56 |
| blanson[m] | interesting how rocky barely ever fails | 07:19 |
| blanson[m] | on the same defaults | 07:19 |
| frickler | mikal: can you also show failure percentages? like if 40 from 100 jobs are affected, that's much different than if 40 out of 50 are | 08:18 |
| frickler | anyway I'm ready to approve your fix if you just add in the bug reference. docs updates can be done in a followup | 08:19 |
| mikal | blanson[m]: like I said, I think its a timing thing. I can't find any difference in the defaults for libvirt between the two. | 09:03 |
| opendevreview | Michael Still proposed openstack/kolla-ansible master: Tune libvirtd connection limits for OpenStack. https://review.opendev.org/c/openstack/kolla-ansible/+/995171 | 09:04 |
| *** jhorstmann is now known as Guest12207 | 09:13 | |
| opendevreview | Michael Still proposed openstack/kolla-ansible master: Tune libvirtd connection limits for OpenStack https://review.opendev.org/c/openstack/kolla-ansible/+/995171 | 09:15 |
| mikal | ^--- bug reference added frickler. I also had a quick go a the docs entry. | 09:15 |
| mikal | frickler: I have to put my daughter to bed now so I can't redo the graphs for percentages immediately, but it was about 5% of the Debian and Ubuntu jobs IIRC. | 09:18 |
| opendevreview | Michael Still proposed openstack/kolla-ansible master: Tune libvirtd connection limits for OpenStack https://review.opendev.org/c/openstack/kolla-ansible/+/995171 | 10:08 |
| opendevreview | Dr. Jens Harbott proposed openstack/kolla-ansible master: DNM: Test ovn without vpnaas https://review.opendev.org/c/openstack/kolla-ansible/+/995198 | 15:35 |
| opendevreview | Verification of a change to openstack/kolla-ansible stable/2025.1 failed: proxysql: fix keepalived healthcheck to use MySQL protocol https://review.opendev.org/c/openstack/kolla-ansible/+/992405 | 16:30 |
| opendevreview | Merged openstack/kolla-ansible master: Tune libvirtd connection limits for OpenStack https://review.opendev.org/c/openstack/kolla-ansible/+/995171 | 19:00 |
| opendevreview | Merged openstack/kolla-ansible master: Introduce `schema_version` in the federated attribute mapping API https://review.opendev.org/c/openstack/kolla-ansible/+/750996 | 23:39 |
Generated by irclog2html.py 4.1.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!
