Wednesday, 2019-03-06

*** tosky has quit IRC00:00
*** abaindur has joined #openstack-neutron00:01
*** armax has quit IRC00:01
*** armax has joined #openstack-neutron00:02
*** dmellado has quit IRC00:03
*** wolverineav has quit IRC00:04
*** dmellado has joined #openstack-neutron00:04
*** armax has quit IRC00:08
openstackgerritBrian Haley proposed openstack/neutron master: Remove quota_db backward compat file  https://review.openstack.org/63984800:11
*** hongbin has quit IRC00:13
*** br7k has joined #openstack-neutron00:14
*** sapd1 has quit IRC00:16
*** rkukura has quit IRC00:17
openstackgerritLIU Yulong proposed openstack/neutron master: More accurate agent restart state transfer  https://review.openstack.org/64079700:19
*** br7k has quit IRC00:19
*** wolverineav has joined #openstack-neutron00:22
*** sm806 has quit IRC00:22
*** sm806 has joined #openstack-neutron00:23
*** hoonetorg has quit IRC00:24
*** hoonetorg has joined #openstack-neutron00:26
*** sm806 has quit IRC00:27
*** sm806 has joined #openstack-neutron00:28
*** macza_ has quit IRC00:30
openstackgerritMerged openstack/os-ken master: Fix pep8 errors in os-ken  https://review.openstack.org/64112200:31
*** rkukura has joined #openstack-neutron00:32
*** mlavalle has quit IRC00:33
*** luksky has quit IRC00:35
*** wolverineav has quit IRC00:48
*** markvoelker has joined #openstack-neutron00:49
*** wolverineav has joined #openstack-neutron00:51
*** ileixe has joined #openstack-neutron00:56
*** itlinux has joined #openstack-neutron00:58
*** mriedem has quit IRC01:00
*** zhanglong has joined #openstack-neutron01:01
*** wolverineav has quit IRC01:03
*** cheng1 has joined #openstack-neutron01:03
*** cheng1 has quit IRC01:04
*** wolverineav has joined #openstack-neutron01:04
*** wolverineav has quit IRC01:09
*** armax has joined #openstack-neutron01:13
*** oanson has quit IRC01:13
*** mmethot has joined #openstack-neutron01:15
*** br7k has joined #openstack-neutron01:19
*** markvoelker has quit IRC01:22
*** br7k has quit IRC01:23
*** wolverineav has joined #openstack-neutron01:36
*** itlinux_ has joined #openstack-neutron01:38
*** cshen has joined #openstack-neutron01:40
*** itlinux_ has quit IRC01:40
*** itlinux has quit IRC01:41
*** cshen has quit IRC01:44
*** wolverineav has quit IRC02:00
*** wolverineav has joined #openstack-neutron02:00
*** abaindur_ has joined #openstack-neutron02:04
*** ileixe has quit IRC02:05
*** abaindur has quit IRC02:06
*** ileixe has joined #openstack-neutron02:08
*** abaindur has joined #openstack-neutron02:11
*** abaindur_ has quit IRC02:12
*** abaindur_ has joined #openstack-neutron02:13
*** abaindur has quit IRC02:15
*** abaindur has joined #openstack-neutron02:17
*** markvoelker has joined #openstack-neutron02:19
*** abaindur_ has quit IRC02:20
*** dsneddon has quit IRC02:21
*** cheng1 has joined #openstack-neutron02:21
*** wolverineav has quit IRC02:22
*** abaindur_ has joined #openstack-neutron02:24
*** hongbin has joined #openstack-neutron02:26
*** abaindu__ has joined #openstack-neutron02:26
*** abaindu__ is now known as abaindur__02:26
*** abaindur has quit IRC02:27
*** wolverineav has joined #openstack-neutron02:27
*** abaindur_ has quit IRC02:29
*** zhanglong has quit IRC02:29
*** abaindur has joined #openstack-neutron02:29
*** abaindur__ has quit IRC02:31
*** br7k has joined #openstack-neutron02:33
*** tbachman has quit IRC02:33
*** rkukura has quit IRC02:35
openstackgerritbaisen proposed openstack/neutron master: the PeriodicWorker function misssing the desc  https://review.openstack.org/64118602:36
*** abaindur_ has joined #openstack-neutron02:36
*** br7k has quit IRC02:37
*** abaindur has quit IRC02:38
*** wolverineav has quit IRC02:40
*** abaindur has joined #openstack-neutron02:41
*** abaindu__ has joined #openstack-neutron02:44
*** abaindur_ has quit IRC02:44
*** abaindu__ is now known as abaindur__02:44
*** abaindur has quit IRC02:45
*** dsneddon has joined #openstack-neutron02:46
*** abaindur has joined #openstack-neutron02:48
*** abaindur__ has quit IRC02:50
*** abaindur_ has joined #openstack-neutron02:50
openstackgerritBrian Haley proposed openstack/neutron master: Remove quota_db backward compat file  https://review.openstack.org/63984802:51
*** markvoelker has quit IRC02:52
*** abaindur has quit IRC02:53
*** abaindur_ has quit IRC02:57
*** dsneddon has quit IRC02:57
*** abaindur has joined #openstack-neutron02:58
*** yamamoto has joined #openstack-neutron03:00
*** zhanglong has joined #openstack-neutron03:04
*** dsneddon has joined #openstack-neutron03:07
openstackgerritBrian Haley proposed openstack/neutron master: DVR-HA: Unbinding a HA router from agent does not clear HA interface  https://review.openstack.org/63856603:09
*** dsneddon has quit IRC03:13
*** dsneddon has joined #openstack-neutron03:25
*** dsneddon has quit IRC03:32
*** br7k has joined #openstack-neutron03:37
*** cshen has joined #openstack-neutron03:40
*** br7k has quit IRC03:42
*** wolverineav has joined #openstack-neutron03:43
*** dsneddon has joined #openstack-neutron03:44
*** wolverineav has quit IRC03:44
*** cshen has quit IRC03:45
*** janki has joined #openstack-neutron03:49
*** markvoelker has joined #openstack-neutron03:49
*** janki has quit IRC03:50
*** janki has joined #openstack-neutron03:50
*** dsneddon has quit IRC03:53
*** wolverineav has joined #openstack-neutron03:58
*** cheng1 has quit IRC03:59
*** dsneddon has joined #openstack-neutron04:00
*** dsneddon has quit IRC04:05
*** ramishra has joined #openstack-neutron04:14
*** markvoelker has quit IRC04:22
*** nehaalhat has joined #openstack-neutron04:25
*** ratailor has joined #openstack-neutron04:27
*** armax has quit IRC04:32
*** dsneddon has joined #openstack-neutron04:35
*** cheng1 has joined #openstack-neutron04:38
*** dsneddon has quit IRC04:40
*** hongbin has quit IRC04:42
*** nehaalhat has quit IRC04:43
*** br7k has joined #openstack-neutron04:52
*** dsneddon has joined #openstack-neutron04:54
*** br7k has quit IRC04:56
*** dsneddon has quit IRC04:59
*** bzhao__ has quit IRC04:59
*** dave-mccowan has quit IRC05:03
openstackgerritDoug Wiegley proposed openstack/neutron-tempest-plugin master: Add tempest api tests for security groups RBAC  https://review.openstack.org/63531205:12
*** sridharg has joined #openstack-neutron05:13
*** igordc has joined #openstack-neutron05:14
*** igordc has quit IRC05:27
*** dsneddon has joined #openstack-neutron05:27
*** gcheresh_ has joined #openstack-neutron05:32
*** dsneddon has quit IRC05:32
*** hoonetorg has quit IRC05:33
*** gcheresh_ has quit IRC05:37
openstackgerritLIU Yulong proposed openstack/neutron master: More accurate agent restart state transfer  https://review.openstack.org/64079705:40
*** wolverineav has quit IRC05:40
*** abaindur has quit IRC05:49
*** abaindur has joined #openstack-neutron05:50
*** hoonetorg has joined #openstack-neutron05:50
*** zhanglong has quit IRC05:51
*** rubasov has quit IRC05:53
*** br7k has joined #openstack-neutron06:02
*** dsneddon has joined #openstack-neutron06:04
*** br7k has quit IRC06:06
*** igordc has joined #openstack-neutron06:07
*** igordc has quit IRC06:07
*** gcheresh_ has joined #openstack-neutron06:07
*** dsneddon has quit IRC06:09
*** gkadam has quit IRC06:13
*** wolverineav has joined #openstack-neutron06:14
*** wolverineav has quit IRC06:18
*** wolverineav has joined #openstack-neutron06:18
*** abaindur has quit IRC06:19
*** abaindur has joined #openstack-neutron06:20
*** rkukura has joined #openstack-neutron06:21
*** cheng1 has quit IRC06:23
*** cheng1 has joined #openstack-neutron06:23
openstackgerritbaisen proposed openstack/neutron master: the PeriodicWorker class init misssing desc argument  https://review.openstack.org/64118606:32
*** wolverineav has quit IRC06:32
*** markvoelker has joined #openstack-neutron06:49
*** hjensas has quit IRC06:50
*** Luzi has joined #openstack-neutron06:53
*** lajoskatona has joined #openstack-neutron06:57
*** mosulica has joined #openstack-neutron06:57
*** ccamposr has joined #openstack-neutron06:59
*** ivve has joined #openstack-neutron07:00
*** dsneddon has joined #openstack-neutron07:04
*** dsneddon has quit IRC07:08
*** br7k has joined #openstack-neutron07:09
*** br7k has quit IRC07:14
*** hamdyk has joined #openstack-neutron07:19
*** dsneddon has joined #openstack-neutron07:20
*** markvoelker has quit IRC07:21
*** dsneddon has quit IRC07:25
*** cshen has joined #openstack-neutron07:25
*** ksambor has joined #openstack-neutron07:31
*** luksky has joined #openstack-neutron07:35
*** luksky has quit IRC07:39
*** hjensas has joined #openstack-neutron07:40
*** sm806 has quit IRC07:42
*** sm806 has joined #openstack-neutron07:43
*** dsneddon has joined #openstack-neutron07:44
*** dsneddon has quit IRC07:48
*** dsneddon has joined #openstack-neutron07:50
*** jlibosva has joined #openstack-neutron07:55
*** rubasov has joined #openstack-neutron07:56
*** rpittau|afk is now known as rpittau08:02
*** wolverineav has joined #openstack-neutron08:03
*** tesseract has joined #openstack-neutron08:07
openstackgerritRoman Safronov proposed openstack/neutron-tempest-plugin master: Add logging of the test steps in NetworkWritableMtuTest  https://review.openstack.org/64082108:07
*** wolverineav has quit IRC08:08
*** tkajinam has quit IRC08:09
*** wolverineav has joined #openstack-neutron08:10
*** dsneddon has quit IRC08:14
*** gkadam has joined #openstack-neutron08:14
*** awalende has joined #openstack-neutron08:15
*** wolverineav has quit IRC08:17
*** wolverineav has joined #openstack-neutron08:18
*** br7k has joined #openstack-neutron08:18
*** markvoelker has joined #openstack-neutron08:19
*** dsneddon has joined #openstack-neutron08:22
*** br7k has quit IRC08:23
*** alisanhaji has joined #openstack-neutron08:23
*** alisanhaji has left #openstack-neutron08:23
*** alisanhaji has joined #openstack-neutron08:24
openstackgerritbaisen proposed openstack/neutron master: the PeriodicWorker class init misssing desc argument  https://review.openstack.org/64118608:24
*** dsneddon has quit IRC08:26
*** tosky has joined #openstack-neutron08:29
*** mosulica has quit IRC08:29
*** pcaruana has joined #openstack-neutron08:29
*** mosulica has joined #openstack-neutron08:32
*** cheng1 has quit IRC08:33
*** tssurya has joined #openstack-neutron08:33
*** ralonsoh has joined #openstack-neutron08:38
*** ksambor has quit IRC08:38
*** ksambor has joined #openstack-neutron08:40
*** kleini has joined #openstack-neutron08:46
*** sm806 has quit IRC08:48
*** aojea has joined #openstack-neutron08:49
*** sm806 has joined #openstack-neutron08:49
*** markvoelker has quit IRC08:52
*** mosulica has quit IRC08:54
*** jpena|off is now known as jpena08:55
*** mosulica has joined #openstack-neutron08:56
*** dsneddon has joined #openstack-neutron08:59
ralonsohslaweq, hi. Can you please take a look at https://review.openstack.org/#/c/641064/?09:01
slaweqralonsoh: sure09:01
ralonsohslaweq, thanks!09:02
slaweqralonsoh: done09:02
slaweq+W09:02
*** nehaalhat has joined #openstack-neutron09:04
bcafarel\o/09:04
*** ArchiFleKs has quit IRC09:10
openstackgerritRodolfo Alonso Hernandez proposed openstack/neutron master: Add a more robust method to check OVSDB values in BaseOVSTestCase  https://review.openstack.org/64111709:10
*** numans has joined #openstack-neutron09:13
*** ArchiFleKs has joined #openstack-neutron09:14
*** wolverineav has quit IRC09:19
*** abaindur has quit IRC09:22
*** lemko has joined #openstack-neutron09:27
*** cheng1 has joined #openstack-neutron09:29
*** mosulica has quit IRC09:34
*** cshen has quit IRC09:35
*** sm806 has quit IRC09:37
*** sm806 has joined #openstack-neutron09:38
*** br7k has joined #openstack-neutron09:39
*** aojeagarcia has joined #openstack-neutron09:42
*** br7k has quit IRC09:43
*** mosulica has joined #openstack-neutron09:43
*** aojea has quit IRC09:46
*** cheng1 has quit IRC09:49
*** markvoelker has joined #openstack-neutron09:49
f0omorning09:50
*** moshele has joined #openstack-neutron09:50
*** salmankhan has joined #openstack-neutron09:52
*** mosulica has quit IRC09:58
*** cshen has joined #openstack-neutron10:00
*** cshen has quit IRC10:05
*** cshen has joined #openstack-neutron10:06
*** davidsha has joined #openstack-neutron10:08
openstackgerritbaisen proposed openstack/neutron master: the PeriodicWorker class init misssing desc argument  https://review.openstack.org/64118610:08
*** nehaalhat has quit IRC10:14
openstackgerritBence Romsics proposed openstack/neutron master: Fail placement sync if _get_rp_by_name() fails  https://review.openstack.org/64103410:17
*** markvoelker has quit IRC10:22
*** hamdyk has quit IRC10:22
openstackgerritBence Romsics proposed openstack/neutron master: Delete floating IPs on network turned internal  https://review.openstack.org/62475110:29
*** mosulica has joined #openstack-neutron10:31
*** yamamoto has quit IRC10:34
openstackgerritReedip proposed openstack/networking-ovn master: Revert "Migrate from Octavia to Octavia-Lib"  https://review.openstack.org/64131110:37
*** ramishra has quit IRC10:40
*** moshele has quit IRC10:40
*** sm806 has quit IRC10:49
*** sm806 has joined #openstack-neutron10:50
*** rubasov has quit IRC10:51
*** wolverineav has joined #openstack-neutron10:53
openstackgerritRodolfo Alonso Hernandez proposed openstack/neutron master: Add a more robust method to check OVSDB values in BaseOVSTestCase  https://review.openstack.org/64111710:56
*** cshen has quit IRC10:57
*** wolverineav has quit IRC10:57
*** ramishra has joined #openstack-neutron10:59
*** FlorianFa has quit IRC11:01
*** FlorianFa has joined #openstack-neutron11:02
*** pcaruana has quit IRC11:04
*** moshele has joined #openstack-neutron11:07
*** sm806 has quit IRC11:08
*** sm806 has joined #openstack-neutron11:09
openstackgerritLucas Alvares Gomes proposed openstack/networking-ovn master: Trivial: Fix typo in the zuul template name  https://review.openstack.org/64132211:09
*** panda|ruck|off is now known as panda|ruck|flu11:10
*** yamamoto has joined #openstack-neutron11:10
*** yamamoto has quit IRC11:18
*** markvoelker has joined #openstack-neutron11:19
*** hamdyk has joined #openstack-neutron11:25
*** yamamoto has joined #openstack-neutron11:27
lajoskatonaralonsoh: hi, ping regarding https://review.openstack.org/63871411:27
*** cshen has joined #openstack-neutron11:27
ralonsohlajoskatona, sure, yes11:27
ralonsohlajoskatona, I tested the patch just modifying the line https://review.openstack.org/#/c/638714/2/neutron/services/qos/qos_plugin.py@43611:28
ralonsohlajoskatona, rule = policy.get_rule_by_id(rule_id)11:28
ralonsohlajoskatona, and it's working fine with min and max, in both directions, updating any of those rules11:29
lajoskatonaralonsoh: I did the same, so no problem with it. After thinking of it I think let's fix both and see later what to do with bandwidth_limit rule default11:30
ralonsohlajoskatona, I agree with this!11:31
*** pcaruana has joined #openstack-neutron11:32
lajoskatonaralonsoh: I upload a patch, and what do you think is it worth to open a bug for bandwidth_limit default direction?11:34
*** dsneddon has quit IRC11:35
openstackgerritMerged openstack/neutron master: Make "phys_brs" argument in OVSAgentExtensionAPI optional  https://review.openstack.org/64106411:35
ralonsohlajoskatona, sure, we need to track it. This bug will affect OSclient and Neutron (because we need to force the client to ask for direction when creating a max rule now)11:36
ralonsohlajoskatona, first patch should be the OSclient11:36
openstackgerritRodolfo Alonso Hernandez proposed openstack/networking-sfc master: Fix unit tests on latest neutron  https://review.openstack.org/64099911:37
lajoskatonaralonsoh: ok I check it, and open a bug for it11:37
ralonsohlajoskatona, thanks!11:37
ralonsohlajoskatona: BTW, I can implement the patch in OSclient if you want11:38
lajoskatonaralonsoh: thanks. I personally like to work with osclient, it gives the feeling of really doing something with output :P11:43
ralonsohlajoskatona, hahahaha11:43
*** markvoelker has quit IRC11:52
openstackgerritElod Illes proposed openstack/networking-odl master: WIP: Use latest networking-sfc release  https://review.openstack.org/64082411:53
openstackgerritRodolfo Alonso Hernandez proposed openstack/neutron master: Add a more robust method to check OVSDB values in BaseOVSTestCase  https://review.openstack.org/64111711:54
*** ratailor has quit IRC11:54
*** br7k has joined #openstack-neutron11:56
openstackgerritMerged openstack/neutron master: remove neutron.db.api references  https://review.openstack.org/63328311:56
*** br7k has quit IRC12:00
*** dsneddon has joined #openstack-neutron12:06
*** dsneddon has quit IRC12:11
*** mvkr has joined #openstack-neutron12:13
*** jpena is now known as jpena|lunch12:31
*** rubasov has joined #openstack-neutron12:32
*** dsneddon has joined #openstack-neutron12:40
*** dsneddon has quit IRC12:44
*** markvoelker has joined #openstack-neutron12:49
*** njohnston_ has joined #openstack-neutron13:01
*** mchlumsky has joined #openstack-neutron13:02
openstackgerritLajos Katona proposed openstack/neutron master: Fix QoS rule update  https://review.openstack.org/63871413:02
*** boden has joined #openstack-neutron13:04
*** TheJulia_sick is now known as TheJulia13:05
*** dsneddon has joined #openstack-neutron13:05
*** br7k has joined #openstack-neutron13:10
*** dsneddon has quit IRC13:11
*** br7k has quit IRC13:14
*** lemko has quit IRC13:15
lajoskatonaralonsoh: functional jobs are failing sometimes with ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Port with name=..... see: http://logs.openstack.org/51/624751/7/check/neutron-functional-python27/81cd4fd/job-output.txt.gz13:15
*** liuyulong_zzz is now known as liuyulong13:19
lajoskatonaralonsoh: logstash: http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22ovsdbapp.backend.ovs_idl.idlutils.RowNotFound%3A%20Cannot%20find%20Port%20with%20name%3D%5C%22%20AND%20build_status%3A%5C%22FAILURE%5C%2213:20
*** markvoelker has quit IRC13:22
*** goldyfruit has joined #openstack-neutron13:29
*** goldyfruit has left #openstack-neutron13:29
ralonsohlajoskatona, yes, there is a bug for this and I'm working on it now13:30
ralonsohlajoskatona, please, update the bug with this info13:30
ralonsohlajoskatona, I'll submit a patch to try to solve this problem today13:30
ralonsohlajoskatona, I have another one under review13:30
ralonsohhttps://review.openstack.org/#/c/641117/13:30
*** sm806 has quit IRC13:33
*** sm806 has joined #openstack-neutron13:33
*** jpena|lunch is now known as jpena13:34
*** mriedem has joined #openstack-neutron13:34
liuyulonglajoskatona, https://bugs.launchpad.net/neutron/+bug/1818613, FYI13:35
openstackLaunchpad bug 1818613 in neutron "Functional qos related tests fails often" [Critical,In progress] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez)13:35
*** dsneddon has joined #openstack-neutron13:36
*** hjensas is now known as hjensas|afk13:40
*** dsneddon has quit IRC13:42
lajoskatonaralonsoh: ok, I see13:42
kklimonda_Hi, could someone help me understand the fix from https://bugs.launchpad.net/neutron/+bug/1789846 ? This is some sort of race, but I'm trying to understand why are we guaranteed that at this point the active number of ports will be either 1 or 213:44
openstackLaunchpad bug 1789846 in neutron "l2_pop flows missing when spawning VMs at a high rate" [High,Fix released] - Assigned to Oleg Bondarev (obondarev)13:44
*** hjensas|afk has quit IRC13:44
*** salmankhan has quit IRC13:44
kklimonda_in our case the first two active ports on compute nodes are "compute:nova" and "network:router_interface_distributed" but wouldn't it be possible for there to be 3 ports (two "compute:nova" + "network:router_interface_distributed") if we spawn enough VMs in the same network concurrently ?13:45
*** dsneddon has joined #openstack-neutron13:46
*** yamamoto has quit IRC13:47
*** yamamoto has joined #openstack-neutron13:48
*** cheng1 has joined #openstack-neutron13:50
*** pcaruana has quit IRC13:51
*** dsneddon has quit IRC13:54
openstackgerritjacky06 proposed openstack/os-ken master: Update hacking version  https://review.openstack.org/64136013:54
openstackgerritboden proposed openstack/neutron master: use api def ALIAS in supported_extension_aliases  https://review.openstack.org/63730413:56
*** ataraday_ has joined #openstack-neutron13:58
*** pcaruana has joined #openstack-neutron14:01
*** mlavalle has joined #openstack-neutron14:02
*** wolverineav has joined #openstack-neutron14:08
*** FlorianFa has quit IRC14:09
*** wolverineav has quit IRC14:12
openstackgerritjacky06 proposed openstack/os-ken master: Update hacking version  https://review.openstack.org/64137514:14
*** sm806 has quit IRC14:16
*** gkadam_ has joined #openstack-neutron14:16
*** sm806 has joined #openstack-neutron14:17
*** gkadam has quit IRC14:19
*** markvoelker has joined #openstack-neutron14:19
*** dsneddon has joined #openstack-neutron14:24
*** alisanhaji has quit IRC14:26
*** br7k has joined #openstack-neutron14:27
*** dsneddon has quit IRC14:29
*** alisanhaji has joined #openstack-neutron14:35
*** moshele has quit IRC14:37
openstackgerritElod Illes proposed openstack/networking-odl master: Use latest Oxygen release instead of snapshot  https://review.openstack.org/64108814:42
openstackgerritElod Illes proposed openstack/networking-odl master: WIP: Use latest networking-sfc release  https://review.openstack.org/64082414:42
*** dsneddon has joined #openstack-neutron14:42
liuyulonghttp://logs.openstack.org/74/640874/2/check/neutron-fullstack/c564eb9/logs/dsvm-fullstack-logs/TestBwLimitQoSOvs.test_bw_limit_qos_port_removed_egress,openflow-native_/neutron-server--2019-03-06--05-31-46-895667.txt.gz#_2019-03-06_05_32_06_69214:43
liuyulongvif_type ovs of port cf1ad685-71ff-4548-859c-10cde55222eb is not compatible with QoS driver linuxbridge _validate_vif_type /opt/stack/new/neutron/neutron/services/qos/drivers/manager.py:8414:43
*** sm806 has quit IRC14:43
*** sm806 has joined #openstack-neutron14:44
liuyulongI found this log in failed fullstack test 'test_bw_limit_qos_port_removed_egress,openflow-native_'14:44
*** kleini has quit IRC14:45
*** tbachman has joined #openstack-neutron14:46
liuyulongAddressing to this bug: https://bugs.launchpad.net/neutron/+bug/181869714:46
openstackLaunchpad bug 1818697 in neutron "neutron fullstack frequently times out waiting on qos ports" [Undecided,New]14:46
*** dsneddon has quit IRC14:47
*** markvoelker has quit IRC14:52
openstackgerritSlawek Kaplonski proposed openstack/neutron master: Store journal log in functional tests results  https://review.openstack.org/64112714:53
*** br7k has quit IRC14:54
*** sm806 has quit IRC14:55
*** sm806 has joined #openstack-neutron14:56
*** ivve has quit IRC14:57
*** gkadam__ has joined #openstack-neutron15:00
*** cheng1 has quit IRC15:00
mlavallerubasov: I just pushed https://review.openstack.org/#/c/574783/15:00
mlavallelajoskatona: ^^^^15:00
*** cheng1 has joined #openstack-neutron15:01
*** gkadam_ has quit IRC15:03
*** hamdyk has quit IRC15:03
openstackgerritRodolfo Alonso Hernandez proposed openstack/neutron master: [WIP] Skip QoS removal when OVS agent is initialized during funtional tests  https://review.openstack.org/64141115:06
*** moshele has joined #openstack-neutron15:07
*** cheng1 has quit IRC15:08
*** Luzi has quit IRC15:09
openstackgerritzhulingjie proposed openstack/neutron-vpnaas master: Update hacking version to latest  https://review.openstack.org/62864815:10
lajoskatonaliuyulong: thanks, ralonsoh sent me the link previously15:12
ralonsohlajoskatona, which link?15:13
*** dsneddon has joined #openstack-neutron15:13
ralonsohahhh ok, sorry15:13
lajoskatonamlavalle: the nova side on the way as well: https://review.openstack.org/63636015:13
lajoskatonaralonsoh: https://bugs.launchpad.net/neutron/+bug/181861315:13
openstackLaunchpad bug 1818613 in neutron "Functional qos related tests fails often" [Critical,In progress] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez)15:13
*** awalende has quit IRC15:15
*** awalende has joined #openstack-neutron15:16
rubasovmlavalle: thank you15:18
*** dsneddon has quit IRC15:18
*** awalende has quit IRC15:20
mlavallelajoskatona, rubasov: thanks or your hard work! any thing missing on this side?15:21
mlavalleI mean, things we need to review15:21
*** sridharg has quit IRC15:21
rubasovmlavalle: there is stuff until rc1, but nothing for ff15:25
openstackgerritboden proposed openstack/neutron master: use callback payloads for AGENT OVS_RESTARTED events  https://review.openstack.org/63642115:27
*** tbachman has quit IRC15:28
*** moshele has quit IRC15:29
*** moshele has joined #openstack-neutron15:30
*** salmankhan has joined #openstack-neutron15:30
*** hjensas has joined #openstack-neutron15:33
*** moshele has quit IRC15:39
openstackgerritboden proposed openstack/networking-midonet master: stop using common db mixin methods  https://review.openstack.org/63553115:42
liuyulonghttp://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%20%5C%22Error%20executing%20command%3A%20ovsdbapp.backend.ovs_idl.idlutils.RowNotFound%3A%20Cannot%20find%20Interface%20with%20name%3D%5C%2215:43
liuyulonghttps://bugs.launchpad.net/neutron/+bug/1818859, Boden just filed this bug.15:44
openstackLaunchpad bug 1818859 in neutron "neutron functional job intermittent failures with ovsdbapp.backend.ovs_idl.idlutils.RowNotFound" [Undecided,New]15:44
liuyulongfullstack meets this trace too.15:45
*** sm806 has quit IRC15:46
*** sm806 has joined #openstack-neutron15:46
*** dsneddon has joined #openstack-neutron15:47
liuyulong2019-03-05T11:26:07.060Z|00217|bridge|INFO|bridge br-intc84947f87: added interface portc4fee6 on port 215:49
liuyulong2019-03-05T11:26:07.133Z|00218|connmgr|INFO|br-tun97fbf27af<->tcp:127.0.0.1:6697: 13 flow_mods 10 s ago (13 adds)15:49
liuyulong2019-03-05T11:26:07.190Z|00219|netdev_linux|INFO|ioctl(SIOCGIFHWADDR) on portc4fee6 device failed: No such device15:49
liuyulong2019-03-05T11:26:07.195Z|00220|netdev_linux|INFO|ioctl(SIOCGIFINDEX) on portc4fee6 device failed: No such device15:49
*** lpetrut has joined #openstack-neutron15:50
*** markvoelker has joined #openstack-neutron15:50
ralonsohliuyulong, I think https://review.openstack.org/#/c/641411/ solves this problem15:51
*** pcaruana has quit IRC15:53
liuyulongralonsoh, cool, good news.15:54
*** janki has quit IRC15:55
*** armax has joined #openstack-neutron15:56
*** mosulica has quit IRC15:58
openstackgerritboden proposed openstack/networking-bgpvpn master: use payloads for ROUTER_INTERFACE events  https://review.openstack.org/63983415:59
*** sm806 has quit IRC16:00
*** sm806 has joined #openstack-neutron16:00
*** rubasov has quit IRC16:04
openstackgerritBernard Cafarelli proposed openstack/neutron master: [Fullstack] Drop OVS kernel module recompilation  https://review.openstack.org/64143016:05
*** pcaruana has joined #openstack-neutron16:06
*** hongbin has joined #openstack-neutron16:07
openstackgerritBernard Cafarelli proposed openstack/neutron master: DNM Testing neutron legacy jobs on bionic  https://review.openstack.org/63936116:08
*** wwriverrat_ has quit IRC16:09
openstackgerritSlawek Kaplonski proposed openstack/neutron master: DNM Add some extra logs to debug issues in functional tests  https://review.openstack.org/64143416:15
openstackgerritMerged openstack/networking-ovn master: Trivial: Fix typo in the zuul template name  https://review.openstack.org/64132216:16
*** tssurya has quit IRC16:18
*** markvoelker has quit IRC16:22
*** amuller has joined #openstack-neutron16:23
*** sm806 has quit IRC16:27
*** sm806 has joined #openstack-neutron16:28
*** ksambor has quit IRC16:31
*** ileixe has quit IRC16:33
*** cshen has quit IRC16:33
*** imacdonn has quit IRC16:36
*** imacdonn has joined #openstack-neutron16:36
*** wwriverrat has joined #openstack-neutron16:37
*** macza has joined #openstack-neutron16:39
*** gkadam__ has quit IRC16:42
*** br7k has joined #openstack-neutron16:43
*** pcaruana has quit IRC16:55
*** panda|ruck|flu is now known as panda|ruck|off16:57
*** ivve has joined #openstack-neutron17:00
*** ramishra has quit IRC17:14
*** lpetrut has quit IRC17:14
*** yamamoto has quit IRC17:15
*** br7k has quit IRC17:15
*** awalende has joined #openstack-neutron17:17
*** lpetrut has joined #openstack-neutron17:17
*** rubasov has joined #openstack-neutron17:17
*** davidsha has quit IRC17:17
*** hjensas has quit IRC17:18
*** markvoelker has joined #openstack-neutron17:19
openstackgerritboden proposed openstack/neutron master: use payloads for PORT AFTER_CREATE events  https://review.openstack.org/63446117:22
*** awalende has quit IRC17:22
*** cbrumm_ has quit IRC17:26
*** yamamoto has joined #openstack-neutron17:28
*** gcheresh_ has quit IRC17:32
*** lpetrut has quit IRC17:32
*** dsneddon has quit IRC17:33
*** cbrumm_ has joined #openstack-neutron17:33
*** yamamoto has quit IRC17:34
*** rkukura has quit IRC17:38
*** mmethot has quit IRC17:44
*** wolverineav has joined #openstack-neutron17:44
*** mmethot has joined #openstack-neutron17:45
*** wolverineav has quit IRC17:49
*** markvoelker has quit IRC17:52
*** wolverineav has joined #openstack-neutron17:54
*** mattw4 has joined #openstack-neutron17:57
*** wolverineav has quit IRC18:01
*** dsneddon has joined #openstack-neutron18:03
*** rkukura has joined #openstack-neutron18:04
*** wolverineav has joined #openstack-neutron18:06
*** wolverineav has quit IRC18:06
*** wolverineav has joined #openstack-neutron18:06
*** yamamoto has joined #openstack-neutron18:09
*** amuller has quit IRC18:13
*** yamamoto has quit IRC18:14
*** jpena is now known as jpena|off18:19
openstackgerritRodolfo Alonso Hernandez proposed openstack/neutron master: Skip QoS removal when OVS agent is initialized during funtional tests  https://review.openstack.org/64141118:23
*** br7k has joined #openstack-neutron18:24
*** br7k has quit IRC18:26
*** ralonsoh has quit IRC18:28
openstackgerritboden proposed openstack/neutron master: consume sqlalchemytypes from neutron-lib  https://review.openstack.org/64146118:32
*** ccamposr has quit IRC18:35
*** hjensas has joined #openstack-neutron18:41
eanderssonStill trying to figure out why we are seeing18:46
eandersson> Timeout in RPC method dhcp_ready_on_ports.18:46
eanderssonTwice every 10 minutes for some reason.18:46
eanderssonAnyone got any advise on how to track that down?18:46
*** aojeagarcia has quit IRC18:47
*** markvoelker has joined #openstack-neutron18:50
openstackgerritBrian Haley proposed openstack/neutron master: Fix pyline E1128 (assignment-from-no-return) in l3-agent  https://review.openstack.org/63833118:54
*** cshen has joined #openstack-neutron18:57
*** ivve has quit IRC18:57
*** hongbin has quit IRC19:00
*** cshen has quit IRC19:01
*** hongbin has joined #openstack-neutron19:02
*** aedc has joined #openstack-neutron19:03
dougwigeandersson: the error is coming from ../../neutron-lib/neutron_lib/rpc.py.  you could put a LOG.error right next to that one that prints out traceback.format_stack(), to see where it's coming from.19:04
*** munimeha1 has joined #openstack-neutron19:08
*** salmankhan has quit IRC19:11
*** salmankhan1 has joined #openstack-neutron19:11
*** br7k has joined #openstack-neutron19:11
*** wolverineav has quit IRC19:14
*** salmankhan1 has quit IRC19:15
*** markvoelker has quit IRC19:22
*** br7k has quit IRC19:23
*** br7k has joined #openstack-neutron19:24
*** wolverineav has joined #openstack-neutron19:25
*** wolverineav has quit IRC19:26
*** wolverineav has joined #openstack-neutron19:26
*** wolverineav has quit IRC19:29
*** wolverineav has joined #openstack-neutron19:30
eanderssondougwig, it looks like it's just provisioning_complete being slow19:34
eanderssonbut it makes no sense to me19:34
openstackgerritIgor D.C. proposed openstack/neutron master: [WIP] L3 agent refactor: RouterInfo and Backend  https://review.openstack.org/63960519:35
eanderssonthe load on most of our neutron boxes are down to 3-819:35
eanderssonand provisioning_complete looks like it's just updating the db19:35
*** wolverineav has quit IRC19:35
eanderssonProbably unrelated but what is the external pids (/var/lib/neutron/external/) for?19:38
*** wolverineav has joined #openstack-neutron19:41
*** cshen has joined #openstack-neutron19:42
eanderssonor rather what is the difference from the regular dhcp pid files (e.g. /var/lib/neutron/dhcp/<network>/pid)19:43
*** cshen has quit IRC19:46
*** wolverineav has quit IRC19:47
*** wolverineav has joined #openstack-neutron19:56
*** tosky has quit IRC20:00
*** tosky has joined #openstack-neutron20:01
openstackgerritboden proposed openstack/neutron master: consume get_random_cidr from neutron-lib  https://review.openstack.org/64147820:07
*** igordc has joined #openstack-neutron20:10
*** yamamoto has joined #openstack-neutron20:11
*** yamamoto has quit IRC20:16
openstackgerritSlawek Kaplonski proposed openstack/neutron master: DNM Add some extra logs to debug issues in functional tests  https://review.openstack.org/64143420:16
openstackgerritSlawek Kaplonski proposed openstack/neutron master: DNM Add some extra logs to debug issues in functional tests  https://review.openstack.org/64143420:16
eanderssonneutron-dhcp-agent stuck in a deadlock again :'(20:18
openstackgerritIgor D.C. proposed openstack/neutron master: Add router_factory to l3-agent and L3 extension API  https://review.openstack.org/62034920:19
*** markvoelker has joined #openstack-neutron20:19
*** wolverineav has quit IRC20:21
eanderssonHitting neutron-dhcp-agent with a SIGUSR2 it looks like the whole agent is stuck in a deadlock performing port_delete_end20:26
*** lemko has joined #openstack-neutron20:29
*** betherly has joined #openstack-neutron20:31
*** igordc has quit IRC20:35
ceryxAlso helping investigate with what eandersson is seeing. We're seeing in neutron debug logs "Provisioning complete for port <uuid> triggered by entity DHCP. provisioning_complete" for every single port we have under a single request ID happening frequently. The whole request takes 20+ minutes to run though all ports. Any idea where that may be coming from? Thinking it might be a DHCP agent resync but it takes a really long time. Usually happens in20:36
ceryxconjunction with the dhcp_ready_on_ports timeout error.20:36
*** wolverineav has joined #openstack-neutron20:37
*** alisanhaji has quit IRC20:37
*** jlibosva has quit IRC20:39
*** betherly has quit IRC20:41
*** abaindur has joined #openstack-neutron20:42
*** br7k has quit IRC20:50
*** betherly has joined #openstack-neutron20:51
*** markvoelker has quit IRC20:53
*** tesseract has quit IRC20:54
*** br7k has joined #openstack-neutron20:55
*** betherly has quit IRC20:55
*** br7k has quit IRC20:57
*** br7k has joined #openstack-neutron20:58
prometheanfiresomeone said my name here and highlighting isn't showing :(21:00
slaweqmlavalle: njohnston_ haleyb, hongbin: if You will have a minute, please check https://review.openstack.org/#/c/641127/21:01
prometheanfirewas someone talking about sqlalchemy-1.3.0?21:02
mlavalleslaweq: ack21:03
slaweqthx mlavalle21:03
mlavalleslaweq: done21:03
haleybslaweq: only zuul stands in the way now21:04
slaweqthx haleyb and mlavalle :)21:05
haleybnjohnston_ beat me to it21:05
mlavallehaleyb: LOL21:05
slaweqthx njohnston_ too :)21:06
slaweqYou are all really fast21:06
njohnston_When the Hulk calls, the Avengers assemble!21:06
*** zbr|ssbarnea has joined #openstack-neutron21:08
*** zbr has quit IRC21:10
*** betherly has joined #openstack-neutron21:11
*** betherly has quit IRC21:15
*** betherly has joined #openstack-neutron21:31
mlavallenjohnston_: danm right!21:35
*** betherly has quit IRC21:35
*** cshen has joined #openstack-neutron21:42
openstackgerritMerged openstack/neutron-tempest-plugin master: Fix L3 agent scheduler tests in multinode environments  https://review.openstack.org/64076321:44
openstackgerritMerged openstack/neutron-tempest-plugin master: Fix neutron-tempest-plugin tox pep8 setup  https://review.openstack.org/64045321:44
*** betherly has joined #openstack-neutron21:46
*** cshen has quit IRC21:46
*** markvoelker has joined #openstack-neutron21:50
*** betherly has quit IRC21:51
openstackgerritBrian Haley proposed openstack/neutron master: Dynamically increase DHCP process queue green pool size  https://review.openstack.org/64149021:51
*** igordc has joined #openstack-neutron21:53
*** mchlumsky has quit IRC21:53
openstackgerritboden proposed openstack/neutron master: consume is_bsd from neutron-lib  https://review.openstack.org/64149121:53
*** boden has quit IRC22:03
*** sm806 has quit IRC22:07
*** sm806 has joined #openstack-neutron22:07
*** betherly has joined #openstack-neutron22:17
*** hongbin has quit IRC22:18
*** ceryx has quit IRC22:18
*** betherly has quit IRC22:22
*** markvoelker has quit IRC22:22
*** ceryx has joined #openstack-neutron22:30
*** hongbin has joined #openstack-neutron22:33
*** macza has quit IRC22:36
*** lemko has quit IRC22:38
*** rcernin has joined #openstack-neutron22:52
*** wolverineav has quit IRC22:52
openstackgerritIgor D.C. proposed openstack/neutron master: [WIP] L3 agent refactor: RouterInfo and Backend  https://review.openstack.org/63960522:55
*** wolverineav has joined #openstack-neutron22:58
*** munimeha1 has quit IRC22:58
*** mattw4 has quit IRC23:00
*** mattw4 has joined #openstack-neutron23:01
*** tkajinam has joined #openstack-neutron23:01
*** abaindur has quit IRC23:02
*** abaindur has joined #openstack-neutron23:03
*** wolverineav has quit IRC23:13
*** mlavalle has quit IRC23:15
*** wolverineav has joined #openstack-neutron23:17
*** markvoelker has joined #openstack-neutron23:19
*** aedc has quit IRC23:21
*** aedc has joined #openstack-neutron23:23
*** hongbin has quit IRC23:32
*** hongbin has joined #openstack-neutron23:34
*** cshen has joined #openstack-neutron23:42
*** abaindur has quit IRC23:42
*** abaindur has joined #openstack-neutron23:44
*** br7k has quit IRC23:46
*** cshen has quit IRC23:46
*** abaindur has quit IRC23:50
*** markvoelker has quit IRC23:53
*** goldyfruit has joined #openstack-neutron23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!