Friday, 2023-01-13

opendevreviewVasyl Saienko proposed openstack/neutron stable/zed: Set ip_nonlocal_bind to 1 for HA routers and DVR snat  https://review.opendev.org/c/openstack/neutron/+/86764008:46
*** elodilles is now known as elodilles_pto09:58
tobias-urdinralonsoh: slaweq mlavalle now that parent (and dependency is merged) please check https://review.opendev.org/c/openstack/neutron/+/869013/5 and let me know what you think, thanks!10:04
tobias-urdini think it makes sense to revert that based on dependency being reverted10:04
ralonsohI'll check it today10:05
opendevreviewFernando Royo proposed openstack/neutron master: Allow multiple IPv6 ports on router from same network ml2/ovs+dvr  https://review.opendev.org/c/openstack/neutron/+/87007911:29
opendevreviewBence Romsics proposed openstack/neutron-lib master: WIP port-hints: api definition  https://review.opendev.org/c/openstack/neutron-lib/+/87008011:52
opendevreviewBence Romsics proposed openstack/neutron master: WIP port hints: api extension  https://review.opendev.org/c/openstack/neutron/+/87008111:53
opendevreviewBence Romsics proposed openstack/neutron master: WIP port hints: db model, db migration, ovo, extension driver  https://review.opendev.org/c/openstack/neutron/+/87008211:53
ralonsohslaweq, hi, I've seen recently some fullstack jobs failing due to timeouts12:11
ralonsohhttps://zuul.opendev.org/t/openstack/builds?job_name=neutron-fullstack-with-uwsgi&result=TIMED_OUT&skip=012:11
ralonsoharound 10 during this week12:11
slaweqralonsoh ok, thx for the info, I will look at it12:11
ralonsohI'm sugesting to increase the time12:12
ralonsohthe completion time is close to 2 hours12:12
ralonsoh(some times)12:12
slaweqwe can try that and see if that will help12:26
slaweqbut I will take closer look at few of such job runs after lunch to see if there is any pattern there maybe12:27
ralonsohthanks a lot12:34
mflynnAnyone know what conditions cause the neutron_l3_agent to transition vRouters to other nodes? We're running Train on centos 7 and seeing several dozen to hundreds of transitions per day. Turned on debug and didn't see any reason of why it's doing the transitions. No errors on the physical network at all.13:01
slaweqmflynn aren't Your L3 agents flapping from down to up?13:54
slaweqI think that neutron will reschedule routers if agent is down13:54
mflynnNope, not flapping at all. Before we rebooted the physical nodes, the agents had been up for 17 months.13:57
slaweqok, but are You asking about HA routers which are active instance is moved to other node or routers which are rescheduled by Neutron to new L3 agent?13:59
slaweqralonsoh regarding fullstack tests, I think it may be that sometimes we are on some more busy nodes, comparing some recent test runs, it can take about 4200 seconds in "good" run and more than 5500 seconds in timeouted14:07
slaweqso it's not that something is stucked but it's just running slower14:07
ralonsohslaweq, agree14:08
ralonsohso just increasing the timeout can help us14:08
slaweqI will propose patch to increase that timeout14:08
ralonsohthanks!14:08
mflynnI'm not sure, The instances aren't being moved but the routers are being transitioned from master to backup on one network node and from backup to master on another node, which causes the network traffic to move from one network node to another.14:08
slaweqahh, ok14:08
slaweqmflynn so it's not that neutron is rescheduling them but keepalived is moving master node to another host14:09
slaweqfor each router there is keepalived process running on each node, You need to check in keepalived logs why it's doing failover so often14:09
mflynnahh, ok, so it's a keepalived thing, thanks14:10
ralonsohcheck if the node is busy (OVS sometimes can't handle the VRRP traffic)14:10
ralonsohand try increasing the keepalived timeouts and delays14:10
mflynnok thanks,14:11
mflynngreat, I don't have logging set up on keepalived...14:13
opendevreviewSlawek Kaplonski proposed openstack/neutron master: Increase fullstack job's timeout  https://review.opendev.org/c/openstack/neutron/+/87009614:14
slaweqmflynn there can be some logs in journal log14:15
slaweqralonsoh I just proposed patch ^^14:15
ralonsohcool14:15
*** dasm|off is now known as dasm14:34
opendevreviewBrian Haley proposed openstack/neutron-lib master: Update envlist for tox4  https://review.opendev.org/c/openstack/neutron-lib/+/86948114:58
opendevreviewBrian Haley proposed openstack/neutron master: Set proxy_delay to zero when using proxy_arp  https://review.opendev.org/c/openstack/neutron/+/78257015:05
opendevreviewRodolfo Alonso proposed openstack/neutron master: [OVN] Implementation of OVN Neutron Agent  https://review.opendev.org/c/openstack/neutron/+/87002415:31
opendevreviewLajos Katona proposed openstack/python-neutronclient master: Tox4  https://review.opendev.org/c/openstack/python-neutronclient/+/87010415:31
opendevreviewLajos Katona proposed openstack/python-neutronclient master: Move network trunk commands from python-neutronclient  https://review.opendev.org/c/openstack/python-neutronclient/+/86947315:32
opendevreviewLajos Katona proposed openstack/python-neutronclient master: Tox4: add allowlist_externals where necessary  https://review.opendev.org/c/openstack/python-neutronclient/+/87010415:33
opendevreviewLajos Katona proposed openstack/python-neutronclient master: Move network trunk commands from python-neutronclient  https://review.opendev.org/c/openstack/python-neutronclient/+/86947315:33
opendevreviewRodolfo Alonso proposed openstack/neutron master: [OVN] Implementation of OVN Neutron Agent  https://review.opendev.org/c/openstack/neutron/+/87002416:38
opendevreviewRodolfo Alonso proposed openstack/neutron-specs master: OVN Neutron Agent and hardware offloaded QoS extension.  https://review.opendev.org/c/openstack/neutron-specs/+/86807617:00
opendevreviewRodolfo Alonso proposed openstack/neutron master: WIP DNM [OVN] New OVN Neutron Agent extension: QoS for HWOL  https://review.opendev.org/c/openstack/neutron/+/87011518:18
opendevreviewMerged openstack/neutron master: Increase fullstack job's timeout  https://review.opendev.org/c/openstack/neutron/+/87009618:27
opendevreviewRodolfo Alonso proposed openstack/neutron master: Fix get_link_devices() with index argument  https://review.opendev.org/c/openstack/neutron/+/82048419:52
opendevreviewBrian Haley proposed openstack/neutron master: Set proxy_delay to one when using proxy_arp  https://review.opendev.org/c/openstack/neutron/+/78257022:25
opendevreviewBrian Haley proposed openstack/neutron master: Add auto-allocated-topology delete example to docs  https://review.opendev.org/c/openstack/neutron/+/87042722:46
*** dasm is now known as dasm|off23:37
*** dkehn_ is now known as dkehn23:57

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!