| opendevreview | Merged openstack/openstack-ansible-haproxy_server master: Do not resolve all host_vars when haproxy_backend_node is a mapping https://review.opendev.org/c/openstack/openstack-ansible-haproxy_server/+/913927 | 13:05 |
|---|---|---|
| f0o | Noticed a weird gotcha... in OVN sometimes my br-int becomes corrupted. It looks fine via ovs-vsctl show and geneve partner's show state-up bfd responses but onv-controller keeps reporting 00020|rconn(ovn_statctrl2)|WARN|unix:/var/run/openvswitch/br-int.mgmt: connection dropped (Broken pipe) | 13:40 |
| f0o | solution was to ovs-vsctl del-br br-int and ovn recreated it and all was fine and dandy | 13:40 |
| f0o | idk if this was some dirty state from a prior deployment but everything was basically fine until I rebooted the host | 13:41 |
| f0o | ok just rebooted the router again and it seems that every boot br-int is corrupted | 14:15 |
| noonedeadpunk | huh | 15:16 |
| noonedeadpunk | that's weird for sure. | 15:16 |
| noonedeadpunk | don't you happen to have it defined somewhere in netplan or smth? | 15:16 |
| f0o | not br-int | 16:39 |
| f0o | I do have br-ext defined there tho | 16:39 |
| f0o | probbaly shouldnt I guess? | 16:39 |
| f0o | netplan does create something called netplan-ovs-cleanup.service | 17:44 |
| f0o | which seems to be removing bridges defined in netplan | 17:44 |
| f0o | checked the logs and no mention of br-int | 17:44 |
| f0o | but maybe that could be a solution | 17:44 |
| f0o | it happened again | 18:52 |
| f0o | out of nowhere | 18:52 |
| f0o | but I think I'm onto something | 18:52 |
| f0o | I have neutron-openvswitch-agent.service and neutron-ovn-metadata-agent.service | 18:53 |
| f0o | they seem to conflict and I entirely blame ubuntu for installing and auto-enabling them | 18:54 |
| f0o | from what I saw in the ansible role, neutron-ovn-metadata-agent.service is the correct one for OVN setups | 18:54 |
| f0o | so I'm going to mask neutron-openvswitch-agent.service and hopefully this resolves the issue | 18:55 |
| f0o | I understand that distro isnt the preferred installation method but honestly I was tired of patching the upper_constraint file every time I had to resetup to get the unbugged ovs package as well as the requirement of having a patched openvswitch-host package - so this is not on OSA but as a Quality of Life enhacement you could make sure that the conflicting systemd-services | 18:58 |
| f0o | get masked because they're automatically installed by apt-get | 18:58 |
| jrosser | f0o: putting your openstack_deploy directory into git would mean you don’t have to constantly patch that | 19:19 |
| jrosser | you can override the default constraints file completely to point to your modified version | 19:19 |
| jrosser | experience from my deployments is that the number of patches I need to locally apply to openstack services is *always* > 0, and often you find corner cases or newly broken things just after upgrades | 19:24 |
| jrosser | so for me it’s source install every time | 19:25 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!