opendevreview | Vasyl Saienko proposed openstack/neutron stable/zed: Set ip_nonlocal_bind to 1 for HA routers and DVR snat https://review.opendev.org/c/openstack/neutron/+/867640 | 08:46 |
---|---|---|
*** elodilles is now known as elodilles_pto | 09:58 | |
tobias-urdin | ralonsoh: slaweq mlavalle now that parent (and dependency is merged) please check https://review.opendev.org/c/openstack/neutron/+/869013/5 and let me know what you think, thanks! | 10:04 |
tobias-urdin | i think it makes sense to revert that based on dependency being reverted | 10:04 |
ralonsoh | I'll check it today | 10:05 |
opendevreview | Fernando Royo proposed openstack/neutron master: Allow multiple IPv6 ports on router from same network ml2/ovs+dvr https://review.opendev.org/c/openstack/neutron/+/870079 | 11:29 |
opendevreview | Bence Romsics proposed openstack/neutron-lib master: WIP port-hints: api definition https://review.opendev.org/c/openstack/neutron-lib/+/870080 | 11:52 |
opendevreview | Bence Romsics proposed openstack/neutron master: WIP port hints: api extension https://review.opendev.org/c/openstack/neutron/+/870081 | 11:53 |
opendevreview | Bence Romsics proposed openstack/neutron master: WIP port hints: db model, db migration, ovo, extension driver https://review.opendev.org/c/openstack/neutron/+/870082 | 11:53 |
ralonsoh | slaweq, hi, I've seen recently some fullstack jobs failing due to timeouts | 12:11 |
ralonsoh | https://zuul.opendev.org/t/openstack/builds?job_name=neutron-fullstack-with-uwsgi&result=TIMED_OUT&skip=0 | 12:11 |
ralonsoh | around 10 during this week | 12:11 |
slaweq | ralonsoh ok, thx for the info, I will look at it | 12:11 |
ralonsoh | I'm sugesting to increase the time | 12:12 |
ralonsoh | the completion time is close to 2 hours | 12:12 |
ralonsoh | (some times) | 12:12 |
slaweq | we can try that and see if that will help | 12:26 |
slaweq | but I will take closer look at few of such job runs after lunch to see if there is any pattern there maybe | 12:27 |
ralonsoh | thanks a lot | 12:34 |
mflynn | Anyone know what conditions cause the neutron_l3_agent to transition vRouters to other nodes? We're running Train on centos 7 and seeing several dozen to hundreds of transitions per day. Turned on debug and didn't see any reason of why it's doing the transitions. No errors on the physical network at all. | 13:01 |
slaweq | mflynn aren't Your L3 agents flapping from down to up? | 13:54 |
slaweq | I think that neutron will reschedule routers if agent is down | 13:54 |
mflynn | Nope, not flapping at all. Before we rebooted the physical nodes, the agents had been up for 17 months. | 13:57 |
slaweq | ok, but are You asking about HA routers which are active instance is moved to other node or routers which are rescheduled by Neutron to new L3 agent? | 13:59 |
slaweq | ralonsoh regarding fullstack tests, I think it may be that sometimes we are on some more busy nodes, comparing some recent test runs, it can take about 4200 seconds in "good" run and more than 5500 seconds in timeouted | 14:07 |
slaweq | so it's not that something is stucked but it's just running slower | 14:07 |
ralonsoh | slaweq, agree | 14:08 |
ralonsoh | so just increasing the timeout can help us | 14:08 |
slaweq | I will propose patch to increase that timeout | 14:08 |
ralonsoh | thanks! | 14:08 |
mflynn | I'm not sure, The instances aren't being moved but the routers are being transitioned from master to backup on one network node and from backup to master on another node, which causes the network traffic to move from one network node to another. | 14:08 |
slaweq | ahh, ok | 14:08 |
slaweq | mflynn so it's not that neutron is rescheduling them but keepalived is moving master node to another host | 14:09 |
slaweq | for each router there is keepalived process running on each node, You need to check in keepalived logs why it's doing failover so often | 14:09 |
mflynn | ahh, ok, so it's a keepalived thing, thanks | 14:10 |
ralonsoh | check if the node is busy (OVS sometimes can't handle the VRRP traffic) | 14:10 |
ralonsoh | and try increasing the keepalived timeouts and delays | 14:10 |
mflynn | ok thanks, | 14:11 |
mflynn | great, I don't have logging set up on keepalived... | 14:13 |
opendevreview | Slawek Kaplonski proposed openstack/neutron master: Increase fullstack job's timeout https://review.opendev.org/c/openstack/neutron/+/870096 | 14:14 |
slaweq | mflynn there can be some logs in journal log | 14:15 |
slaweq | ralonsoh I just proposed patch ^^ | 14:15 |
ralonsoh | cool | 14:15 |
*** dasm|off is now known as dasm | 14:34 | |
opendevreview | Brian Haley proposed openstack/neutron-lib master: Update envlist for tox4 https://review.opendev.org/c/openstack/neutron-lib/+/869481 | 14:58 |
opendevreview | Brian Haley proposed openstack/neutron master: Set proxy_delay to zero when using proxy_arp https://review.opendev.org/c/openstack/neutron/+/782570 | 15:05 |
opendevreview | Rodolfo Alonso proposed openstack/neutron master: [OVN] Implementation of OVN Neutron Agent https://review.opendev.org/c/openstack/neutron/+/870024 | 15:31 |
opendevreview | Lajos Katona proposed openstack/python-neutronclient master: Tox4 https://review.opendev.org/c/openstack/python-neutronclient/+/870104 | 15:31 |
opendevreview | Lajos Katona proposed openstack/python-neutronclient master: Move network trunk commands from python-neutronclient https://review.opendev.org/c/openstack/python-neutronclient/+/869473 | 15:32 |
opendevreview | Lajos Katona proposed openstack/python-neutronclient master: Tox4: add allowlist_externals where necessary https://review.opendev.org/c/openstack/python-neutronclient/+/870104 | 15:33 |
opendevreview | Lajos Katona proposed openstack/python-neutronclient master: Move network trunk commands from python-neutronclient https://review.opendev.org/c/openstack/python-neutronclient/+/869473 | 15:33 |
opendevreview | Rodolfo Alonso proposed openstack/neutron master: [OVN] Implementation of OVN Neutron Agent https://review.opendev.org/c/openstack/neutron/+/870024 | 16:38 |
opendevreview | Rodolfo Alonso proposed openstack/neutron-specs master: OVN Neutron Agent and hardware offloaded QoS extension. https://review.opendev.org/c/openstack/neutron-specs/+/868076 | 17:00 |
opendevreview | Rodolfo Alonso proposed openstack/neutron master: WIP DNM [OVN] New OVN Neutron Agent extension: QoS for HWOL https://review.opendev.org/c/openstack/neutron/+/870115 | 18:18 |
opendevreview | Merged openstack/neutron master: Increase fullstack job's timeout https://review.opendev.org/c/openstack/neutron/+/870096 | 18:27 |
opendevreview | Rodolfo Alonso proposed openstack/neutron master: Fix get_link_devices() with index argument https://review.opendev.org/c/openstack/neutron/+/820484 | 19:52 |
opendevreview | Brian Haley proposed openstack/neutron master: Set proxy_delay to one when using proxy_arp https://review.opendev.org/c/openstack/neutron/+/782570 | 22:25 |
opendevreview | Brian Haley proposed openstack/neutron master: Add auto-allocated-topology delete example to docs https://review.opendev.org/c/openstack/neutron/+/870427 | 22:46 |
*** dasm is now known as dasm|off | 23:37 | |
*** dkehn_ is now known as dkehn | 23:57 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!