| *** dviroel|afk is now known as dviroel | 00:08 | |
| *** dviroel is now known as dviroel|out | 01:33 | |
| opendevreview | James Denton proposed openstack/openstack-ansible-os_neutron master: Install openvswitch packages in Neutron server container https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/866249 | 04:24 |
|---|---|---|
| opendevreview | James Denton proposed openstack/openstack-ansible master: Implement OVN inventory changes and deploy by default https://review.opendev.org/c/openstack/openstack-ansible/+/862924 | 04:25 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-tests master: Switch CentOS 8 Stream to 9 Stream https://review.opendev.org/c/openstack/openstack-ansible-tests/+/866197 | 09:20 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-plugins master: Allow to define condition for DB creation https://review.opendev.org/c/openstack/openstack-ansible-plugins/+/866059 | 10:36 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia master: Add coordination to octavia https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/866058 | 10:39 |
| *** dviroel|out is now known as dviroel | 10:43 | |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Run zookeeper installation for validate job https://review.opendev.org/c/openstack/openstack-ansible/+/866047 | 10:46 |
| opendevreview | Merged openstack/openstack-ansible-os_neutron master: add ovn ssl config https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/862403 | 11:23 |
| opendevreview | James Denton proposed openstack/openstack-ansible-os_neutron master: Install openvswitch packages in Neutron server container https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/866249 | 11:30 |
| noonedeadpunk | jamesdenton: ^ sounds like not doing what it should | 12:17 |
| noonedeadpunk | or doing more then it should | 12:18 |
| noonedeadpunk | I was jsut trying to build up aio to check | 12:18 |
| noonedeadpunk | as jobs reliably failing with it | 12:18 |
| jrosser | it probably started a bunch of services we may not want? | 12:25 |
| noonedeadpunk | I'm quite sure it did actually | 13:07 |
| noonedeadpunk | I'm trying without that patch to see what it needs and then see what we should actually do | 13:07 |
| noonedeadpunk | I was actually a bit distracted by https://review.opendev.org/c/openstack/openstack-ansible/+/752311 to see if we gain any performance from building wheels. And then again distracted by ara failing on our ssh plugin... | 13:09 |
| noonedeadpunk | And that we run https://opendev.org/openstack/openstack-ansible/src/branch/master/scripts/scripts-library.sh#L249-L257 after each step in gate-check-commit | 13:09 |
| noonedeadpunk | interestingly, that tempest fails on teardown only | 13:13 |
| *** frenzy_friday|rover is now known as frenzy_friday|rover|lunch | 13:33 | |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_neutron master: Install openvswitch packages in Neutron server container https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/866249 | 13:36 |
| noonedeadpunk | I guess that should do it ^ | 13:37 |
| noonedeadpunk | jrosser: do you think I should revert this https://review.opendev.org/c/openstack/openstack-ansible/+/866047/3/playbooks/zookeeper-install.yml ? did mainly to trigger validate job, kind of don't want to waste CI resources but know that changing copyright is wrong... | 13:40 |
| noonedeadpunk | So not sure | 13:40 |
| jrosser | it is a bit odd to change the copyright | 13:44 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Define apmhora provider for tempest config https://review.opendev.org/c/openstack/openstack-ansible/+/866335 | 13:49 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Define apmhora provider for tempest config https://review.opendev.org/c/openstack/openstack-ansible/+/866335 | 13:49 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_octavia master: Add coordination to octavia https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/866058 | 13:49 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Run zookeeper installation for validate job https://review.opendev.org/c/openstack/openstack-ansible/+/866047 | 13:53 |
| *** frenzy_friday|rover|lunch is now known as frenzy_friday|rover | 14:01 | |
| noonedeadpunk | damiandabrowski: can you kindly also vote on https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/865566 | 14:04 |
| jamesdenton | noonedeadpunk yes, i kicked off a local job, too. | 14:08 |
| jamesdenton | ahh, perhaps | 14:09 |
| jamesdenton | thanks | 14:09 |
| noonedeadpunk | we really need to land 865566 to unblock master jobs | 14:13 |
| jamesdenton | done | 14:18 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_ironic master: Update variables for switchport introspection during inspection https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/864437 | 14:18 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_ironic master: Add variable for user defined list of deploy images https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/865310 | 14:19 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_ironic master: Add variable for user defined list of deploy images https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/865310 | 14:20 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_ironic master: Ensure nginx config is present for ironic inspector https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/864406 | 14:22 |
| opendevreview | Merged openstack/openstack-ansible-os_octavia master: Remove redundant vars line https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/857654 | 14:54 |
| opendevreview | Merged openstack/openstack-ansible-os_designate master: Fix race condition during designate setup https://review.opendev.org/c/openstack/openstack-ansible-os_designate/+/865701 | 14:56 |
| jrosser | i found another bug with the parallel-git-clone module | 15:01 |
| jrosser | 128 core machine is toooooo many threads and it breaks | 15:01 |
| opendevreview | Merged openstack/openstack-ansible-os_octavia master: Enable /healthcheck for Octavia API https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/864419 | 15:06 |
| opendevreview | Merged openstack/openstack-ansible-os_horizon master: Install ironic-ui from git source rather than a pip package https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/863921 | 15:29 |
| noonedeadpunk | jrosser: lol | 15:34 |
| noonedeadpunk | can we pass threads to the module? | 15:34 |
| jrosser | it takes cores * some multiplier | 15:35 |
| noonedeadpunk | or well, we can max out to 16 or smth reasonable | 15:35 |
| jrosser | but it needs a max | 15:35 |
| noonedeadpunk | 128core machine I assume that's arm? | 15:35 |
| jrosser | it is | 15:35 |
| jrosser | i have an AIO in an arm vm but i can't boot cirros on it | 15:36 |
| jrosser | so i try the same on bare metal too | 15:36 |
| jrosser | i am not too sure how to debug it tbh | 15:36 |
| jrosser | also what is happening with interface names these days | 15:40 |
| jrosser | enP1p1s0f1np1 | 15:40 |
| jrosser | really?! | 15:40 |
| jamesdenton | dude | 15:40 |
| jamesdenton | it's out of hand | 15:40 |
| jrosser | oh yes, i'll just rememeber that and type it in somewhere - i don't think so :( | 15:41 |
| opendevreview | James Denton proposed openstack/openstack-ansible-os_neutron master: Install openvswitch packages in Neutron server container https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/866249 | 15:43 |
| jamesdenton | a name only a machine can love | 15:43 |
| opendevreview | Merged openstack/openstack-ansible master: Explicitly define neutron_plugin_base for OVS https://review.opendev.org/c/openstack/openstack-ansible/+/866012 | 15:53 |
| opendevreview | Merged openstack/openstack-ansible-os_ironic stable/yoga: Pass CA pass to Swift CLI https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/865566 | 15:57 |
| noonedeadpunk | jamesdenton: why you said that ovs logic is broken? | 16:01 |
| noonedeadpunk | ah | 16:01 |
| noonedeadpunk | I was checking old zuul logs | 16:01 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Disable sahara real tempest tests https://review.opendev.org/c/openstack/openstack-ansible/+/866124 | 16:34 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-os_ironic master: Enable /healtcheck for Ironic APIs https://review.opendev.org/c/openstack/openstack-ansible-os_ironic/+/864423 | 16:34 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Define apmhora provider for tempest config https://review.opendev.org/c/openstack/openstack-ansible/+/866335 | 16:38 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible-haproxy_server master: Fix warnings in haproxy config https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/864786 | 16:41 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Switch distro jobs to Jammy https://review.opendev.org/c/openstack/openstack-ansible/+/866126 | 16:52 |
| noonedeadpunk | so.... | 16:53 |
| noonedeadpunk | bumping apache limits didn't help keystone | 16:53 |
| noonedeadpunk | we still get plenty of failures on tempesting keystone | 16:53 |
| noonedeadpunk | I kind of woner if we _really_ want to run full identity api tests... | 16:55 |
| opendevreview | Jonathan Rosser proposed openstack/openstack-ansible-os_tempest master: Update cirros image to 0.6.1 https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/866370 | 16:56 |
| noonedeadpunk | we'd better find reason why it fails ofc, but stilll | 16:57 |
| jrosser | it has been a long time now like that | 16:59 |
| noonedeadpunk | well, true, but we create users/projects/catalog during role runtime anyway | 17:03 |
| noonedeadpunk | so if it's not working - we will fail early anyway | 17:03 |
| noonedeadpunk | well, except infra jobs | 17:03 |
| jrosser | oh well i mean we don't just ignore it for all this time - there is nothing obvious wrong when keystone breaks like this | 17:06 |
| jrosser | other than haproxy thinks it is down? | 17:06 |
| noonedeadpunk | yup | 17:07 |
| noonedeadpunk | I haven't seen ooms either | 17:07 |
| noonedeadpunk | So it's some connection limit I guess | 17:08 |
| noonedeadpunk | but increasing mpm settings didn't help much | 17:11 |
| noonedeadpunk | So I'm obviously missing smth | 17:11 |
| jamesdenton | noonedeadpunk yeah, i was checking logs of failed jobs before the rest were done | 17:22 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Do not try to install packages on each log_instance_info run https://review.opendev.org/c/openstack/openstack-ansible/+/866372 | 17:23 |
| * noonedeadpunk trying to find out what during log_instance_info run causes https://paste.openstack.org/show/bkdnIOr1vL4cEJ9vDM0i/ in output | 17:24 | |
| opendevreview | James Denton proposed openstack/openstack-ansible master: Remove deprecated OVN and Panko services https://review.opendev.org/c/openstack/openstack-ansible/+/866205 | 17:35 |
| noonedeadpunk | Ok, it's `ansible -i localhost, localhost -m setup` that causes that | 17:35 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Use local connection while colelcting instance info https://review.opendev.org/c/openstack/openstack-ansible/+/866374 | 17:40 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Use local connection while colelcting instance info https://review.opendev.org/c/openstack/openstack-ansible/+/866374 | 17:40 |
| noonedeadpunk | ^ this would save another couple of mins for each job | 17:41 |
| noonedeadpunk | jamesdenton: btw, do you know if there's any way to set ovn to log into journal instead of files? | 17:45 |
| noonedeadpunk | so keystone was "down" for 12 seconds: https://zuul.opendev.org/t/openstack/build/58473167135147028d25b73b56670861/log/logs/host/haproxy.service.journal-15-06-19.log.txt#1846-1869 | 17:47 |
| noonedeadpunk | and /var/log/messages stopps 2 mins before that time o_O | 17:49 |
| noonedeadpunk | btw we obviosuly misuse dstat | 17:50 |
| noonedeadpunk | https://zuul.opendev.org/t/openstack/build/58473167135147028d25b73b56670861/log/logs/openstack/instance-info/dstat.log.txt | 17:50 |
| noonedeadpunk | it's even better on jammy :D https://zuul.opendev.org/t/openstack/build/b6e0acd2a4df41ad911a2b5642b28a48/log/logs/openstack/instance-info/dstat.log.txt | 17:53 |
| noonedeadpunk | well, dstat has been deprecated and renamed I guess https://github.com/dstat-real/dstat/issues/170 | 18:01 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Do not try to install packages on each log_instance_info run https://review.opendev.org/c/openstack/openstack-ansible/+/866372 | 18:07 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Do not try to install packages on each log_instance_info run https://review.opendev.org/c/openstack/openstack-ansible/+/866372 | 18:07 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Replace dstat with dool https://review.opendev.org/c/openstack/openstack-ansible/+/866377 | 18:13 |
| jamesdenton | noonedeadpunk i imagine there is, i can look into it | 18:13 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/openstack-ansible master: Replace dstat with dool https://review.opendev.org/c/openstack/openstack-ansible/+/866377 | 18:14 |
| noonedeadpunk | 866249 looks sweet btw :) | 18:18 |
| noonedeadpunk | and yeah, logging to journal would be very sweet! | 18:19 |
| noonedeadpunk | Btw regarding reviews - there're couple of patches that seems ready https://review.opendev.org/q/parentproject:openstack/openstack-ansible++NOT+label:Workflow%253C%253D-1+NOT+label:Workflow%253E%253D1+label:Verified%253E%253D1+NOT+label:Code-Review%253C%253D-1+label:Code-Review%253E%253D2+branch:master+status:open+ | 18:20 |
| noonedeadpunk | well, it seems that check queue in zuul is quite outstanding now :( | 18:23 |
| noonedeadpunk | like some checks are in for 5h :( | 18:24 |
| jamesdenton | yes, if we can get 866249 then i think 862924 will be good to go | 18:26 |
| opendevreview | Merged openstack/openstack-ansible-os_octavia stable/yoga: Adding octavia_provider_network_mtu-parameter parameter https://review.opendev.org/c/openstack/openstack-ansible-os_octavia/+/865643 | 20:10 |
| opendevreview | Merged openstack/openstack-ansible-os_heat stable/xena: Install git into heat containers https://review.opendev.org/c/openstack/openstack-ansible-os_heat/+/865565 | 20:42 |
| *** dviroel is now known as dviroel|out | 21:02 | |
| opendevreview | Merged openstack/openstack-ansible master: Allow to define user.rc file for OSA https://review.opendev.org/c/openstack/openstack-ansible/+/865867 | 21:34 |
| opendevreview | Merged openstack/openstack-ansible master: Define a group for ironic_console https://review.opendev.org/c/openstack/openstack-ansible/+/860947 | 21:34 |
| opendevreview | Merged openstack/openstack-ansible master: Add zookeeper deployment https://review.opendev.org/c/openstack/openstack-ansible/+/864750 | 21:34 |
| opendevreview | Merged openstack/openstack-ansible-lxc_hosts master: Use correct apt repo when ubuntu architecture is not x86_64 https://review.opendev.org/c/openstack/openstack-ansible-lxc_hosts/+/866167 | 22:07 |
| opendevreview | Merged openstack/openstack-ansible-os_nova master: fix: os_vif_ovs should not be in the middle of libvirt section https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/866159 | 23:01 |
| * prometheanfire wonders why https://review.opendev.org/c/openstack/openstack-ansible-os_nova/+/865067 wasn't good enough | 23:35 | |
| opendevreview | Merged openstack/openstack-ansible-os_neutron master: Set default plugin type to OVN https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/865961 | 23:44 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!