Friday, 2019-06-07

*** tbachman has quit IRC00:00
*** tbachman has joined #openstack-neutron00:01
*** panda has quit IRC00:01
*** mattw4 has quit IRC00:03
*** panda has joined #openstack-neutron00:04
*** slaweq has joined #openstack-neutron00:11
*** mriedem has joined #openstack-neutron00:17
*** enyinna1234 has quit IRC00:18
*** slaweq has quit IRC00:24
*** markvoelker has joined #openstack-neutron00:29
*** mriedem has quit IRC00:30
*** rkukura has quit IRC00:36
*** igordc has joined #openstack-neutron00:38
*** hongbin has quit IRC00:44
*** frankwang has joined #openstack-neutron00:54
*** markvoelker has quit IRC01:02
*** slaweq has joined #openstack-neutron01:06
*** slaweq has quit IRC01:19
eandersson> mysql> UPDATE standardattributes SET revision_number=ZZZ, updated_at='<date>' WHERE standardattributes.id = YYYY AND standardattributes.revision_number = XXX;01:57
eandersson> Query OK, 0 rows affected (24.18 sec)01:57
eanderssonWould it be possible to add a index to revision_number?01:58
*** ccstone has joined #openstack-neutron01:58
eanderssonOr is there another way to fix these super slow calls. They are hitting us hard during upgrade.01:58
*** markvoelker has joined #openstack-neutron01:59
*** frankwang has quit IRC02:01
*** rkukura has joined #openstack-neutron02:05
*** slaweq has joined #openstack-neutron02:11
eanderssonBasically we see hundreds of these being executed at the same time taking 20s+ after brining the computes back up after an upgrade02:11
eanderssonAnd that then causes the queue for agents (q-reports-plugin) to grow exponentially02:11
*** kosa777777 has joined #openstack-neutron02:18
kosa777777more info for issue eandersson we work together: the same UPDATE with same parameters statement was send 15 times in 15 sec02:21
*** slaweq has quit IRC02:24
kosa777777after a while same update returns in 0 sec02:24
*** sean-k-mooney has quit IRC02:28
*** markvoelker has quit IRC02:32
*** JamesBenson has joined #openstack-neutron02:50
*** iyamahat_ has joined #openstack-neutron02:54
*** threestrands has joined #openstack-neutron02:54
*** enyinna1234 has joined #openstack-neutron02:55
*** yamahata has quit IRC02:56
*** iyamahat has quit IRC02:56
*** iyamahat_ has quit IRC02:59
*** sean-k-mooney has joined #openstack-neutron03:00
*** whoami-rajat has joined #openstack-neutron03:10
*** slaweq has joined #openstack-neutron03:11
*** enyinna1234 has quit IRC03:13
*** sean-k-mooney has quit IRC03:14
*** sean-k-mooney has joined #openstack-neutron03:16
*** JamesBenson has quit IRC03:23
*** JamesBenson has joined #openstack-neutron03:24
*** slaweq has quit IRC03:25
*** igordc has quit IRC03:25
*** JamesBenson has quit IRC03:28
*** BjoernT has joined #openstack-neutron03:31
*** BjoernT_ has joined #openstack-neutron03:35
*** BjoernT has quit IRC03:36
*** ratailor has joined #openstack-neutron03:54
*** yamamoto has quit IRC04:09
*** threestrands has quit IRC04:12
*** slaweq has joined #openstack-neutron04:16
*** sean-k-mooney has quit IRC04:19
*** sean-k-mooney has joined #openstack-neutron04:21
*** slaweq has quit IRC04:24
*** jaewook_oh_ has joined #openstack-neutron04:25
*** markvoelker has joined #openstack-neutron04:30
*** yamamoto has joined #openstack-neutron04:43
*** BjoernT_ has quit IRC04:53
*** yamamoto has quit IRC04:54
*** frankwang has joined #openstack-neutron04:58
*** frankwang has quit IRC05:02
*** markvoelker has quit IRC05:03
*** jaewook_oh_ has quit IRC05:09
*** yamamoto has joined #openstack-neutron05:13
*** slaweq has joined #openstack-neutron05:13
*** slaweq has quit IRC05:24
*** slaweq has joined #openstack-neutron05:31
*** ratailor_ has joined #openstack-neutron05:43
*** ratailor has quit IRC05:43
*** luksky has joined #openstack-neutron05:44
*** slaweq has quit IRC05:44
*** jrich has quit IRC05:48
*** lajoskatona has joined #openstack-neutron05:52
*** markvoelker has joined #openstack-neutron06:00
*** ccamposr has joined #openstack-neutron06:03
*** ccamposr has quit IRC06:05
*** ccamposr has joined #openstack-neutron06:05
*** aojea has joined #openstack-neutron06:07
*** slaweq has joined #openstack-neutron06:11
*** slaweq has quit IRC06:15
*** lpetrut has joined #openstack-neutron06:19
*** sapd1_x has joined #openstack-neutron06:21
*** hoonetorg has quit IRC06:21
*** cshen has joined #openstack-neutron06:24
*** aojea has quit IRC06:31
*** maciejjozefczyk has joined #openstack-neutron06:32
*** markvoelker has quit IRC06:32
*** itlinux_ has joined #openstack-neutron06:34
*** itlinux has quit IRC06:34
*** jaewook_oh has joined #openstack-neutron06:35
*** pcaruana has joined #openstack-neutron06:35
*** hoonetorg has joined #openstack-neutron06:38
*** lajoskatona has quit IRC06:45
*** itlinux_ has quit IRC06:54
*** slaweq has joined #openstack-neutron06:59
*** itlinux has joined #openstack-neutron06:59
*** lajoskatona has joined #openstack-neutron07:00
*** itlinux has quit IRC07:05
*** doreilly has joined #openstack-neutron07:06
*** tssurya has joined #openstack-neutron07:07
*** mvkr has joined #openstack-neutron07:09
*** tesseract has joined #openstack-neutron07:09
*** itlinux has joined #openstack-neutron07:10
*** imacdonn has quit IRC07:16
*** lajoskatona has quit IRC07:26
*** lajoskatona has joined #openstack-neutron07:28
*** markvoelker has joined #openstack-neutron07:30
*** aedc has quit IRC07:40
*** jpena|off is now known as jpena07:53
*** rcernin has quit IRC07:55
*** ralonsoh has joined #openstack-neutron07:59
*** markvoelker has quit IRC08:03
openstackgerritsean mooney proposed openstack/neutron master: do not skip ports with unset or invalid ofport  https://review.opendev.org/64025808:06
*** JamesBenson has joined #openstack-neutron08:08
*** JamesBenson has quit IRC08:12
*** bcafarel has quit IRC08:13
*** sapd1_x has quit IRC08:15
*** lucasagomes has joined #openstack-neutron08:17
ralonsohslaweq, http://logs.openstack.org/11/660611/19/check/neutron-fullstack/7d4f6c4/testr_results.html.gz08:20
ralonsohslaweq, I've seen this several times08:20
ralonsohhttp://logs.openstack.org/11/660611/19/gate/neutron-fullstack/bdea52a/testr_results.html.gz08:20
slaweqralonsoh: is Your patch with additional logging merged already? I think it is but I may be wrong here :)08:22
*** aedc has joined #openstack-neutron08:22
slaweqif so we should check if that would help us with debugging this issue08:22
ralonsohslaweq, yes, I'll check it08:22
slaweqralonsoh: thx08:24
*** bcafarel has joined #openstack-neutron08:26
*** jaewook_oh has quit IRC08:33
*** trident has quit IRC08:35
ralonsohslaweq, let me ask you08:36
ralonsohhttps://github.com/openstack/neutron/blob/master/neutron/tests/fullstack/test_dhcp_agent.py#L132-L13508:36
ralonsohslaweq, it doesn't matter if the agent is dead, this agent will be listed here08:36
ralonsohslaweq, in this case, the agent will be marked as dead08:37
*** trident has joined #openstack-neutron08:37
*** imacdonn has joined #openstack-neutron08:37
slaweqralonsoh: yes08:38
slaweqor no, I'm not sure now08:38
slaweqralonsoh: give me 5 minutes, I will check it08:39
*** iyamahat has joined #openstack-neutron08:44
slaweqralonsoh: so I think that it should be only this new, alive agent on the list because when allow_automatic_dhcp_failover is set to true (https://github.com/openstack/neutron/blob/d5865ad7a75e9fee71eb4312476476f9e9098135/neutron/conf/agent/database/agentschedulers_db.py#L26) neutron should remove network from dead agents:08:57
slaweqhttps://github.com/openstack/neutron/blob/c21d922abd1208a72fe64d404a8eab93e0c56870/neutron/db/agentschedulers_db.py#L18608:57
slaweqbut there is race probably08:57
slaweqas this is periodic task so sometimes it may happend than it's not removed yet08:58
slaweqand there are 2 agents on the list08:58
slaweqthat is at least my idea what can be wrong there08:58
slaweqwhat do You think about it?08:58
ralonsohslaweq, I don't see in the code where/when the DHCP agent is started (the second one)08:59
*** markvoelker has joined #openstack-neutron09:00
*** yamahata has joined #openstack-neutron09:00
ralonsohslaweq, well rescheduled09:01
ralonsohslaweq, in this test, there is only one DHCP agent09:02
ralonsohif you take a look at _wait_until_network_rescheduled, if network_agents is None (this is the case), the function will always return False09:02
ralonsohslaweq, but this is how it should be: only one dhcp agent (dead) so "list_dhcp_agent_hosting_networks" should return None09:03
ralonsohor []09:03
openstackgerritRodolfo Alonso Hernandez proposed openstack/neutron master: [WIP] Replace "ip monitor" command with Pyroute2 implementation  https://review.opendev.org/66072209:10
*** davidsha has joined #openstack-neutron09:12
jamespagemorning all09:16
slaweqralonsoh: there are 2 dhcp agents started in this test, look at logs http://logs.openstack.org/11/660611/19/check/neutron-fullstack/7d4f6c4/controller/logs/dsvm-fullstack-logs/TestDhcpAgentHA.test_reschedule_network_on_new_agent_Linux-bridge-agent_/09:18
slaweqralonsoh: look here: https://github.com/openstack/neutron/blob/master/neutron/tests/fullstack/test_dhcp_agent.py#L127 there are 2 "hosts" with dhcp agent in this test class09:19
openstackgerritYAMAMOTO Takashi proposed openstack/networking-ovn master: Relax coverage threshold  https://review.opendev.org/66354609:21
*** sapd1_x has joined #openstack-neutron09:23
*** priteau has joined #openstack-neutron09:25
*** zbr has joined #openstack-neutron09:30
*** markvoelker has quit IRC09:32
*** tkajinam has quit IRC09:37
*** lpetrut has quit IRC09:38
openstackgerritMerged openstack/neutron master: Run nova's VM boot rally scenario in the neutron gate  https://review.opendev.org/66280409:41
openstackgerritMerged openstack/neutron-tempest-plugin master: Scenario test for port forwarding  https://review.opendev.org/66262809:41
openstackgerritMerged openstack/neutron master: Updating bgp driver to match what neutron-dynamic-routing supports  https://review.opendev.org/66371109:41
*** gcheresh has joined #openstack-neutron09:57
*** yamamoto has quit IRC10:02
*** lpetrut has joined #openstack-neutron10:04
*** lpetrut has quit IRC10:04
*** lpetrut has joined #openstack-neutron10:05
*** luksky has quit IRC10:11
*** sapd1_x has quit IRC10:18
*** gcheresh has quit IRC10:24
*** ociuhandu has joined #openstack-neutron10:25
*** yamamoto has joined #openstack-neutron10:29
*** ociuhandu has quit IRC10:30
*** ociuhandu has joined #openstack-neutron10:31
*** yamamoto has quit IRC10:35
*** zbr is now known as zbr|rover10:44
*** luksky has joined #openstack-neutron10:49
openstackgerritMaciej Jozefczyk proposed openstack/networking-ovn master: Add gateway chassis rebalance script  https://review.opendev.org/66304610:53
openstackgerritMaciej Jozefczyk proposed openstack/networking-ovn master: Add gateway chassis rebalance script  https://review.opendev.org/66304610:54
*** janki has joined #openstack-neutron10:57
openstackgerritRodolfo Alonso Hernandez proposed openstack/neutron master: Add log information in agent schedulers  https://review.opendev.org/66390311:24
*** markvoelker has joined #openstack-neutron11:30
*** jpena is now known as jpena|lunch11:38
*** yamamoto has joined #openstack-neutron11:46
*** njohnston has joined #openstack-neutron11:48
*** yamamoto has quit IRC11:54
*** yamamoto has joined #openstack-neutron11:56
*** ratailor_ has quit IRC12:01
*** markvoelker has quit IRC12:03
*** njohnston has quit IRC12:07
*** njohnston has joined #openstack-neutron12:08
*** yamamoto has quit IRC12:18
*** yamamoto has joined #openstack-neutron12:19
*** slaweq_ has joined #openstack-neutron12:23
*** binh___ has joined #openstack-neutron12:24
*** binh_ has quit IRC12:27
*** slaweq has quit IRC12:27
*** lpetrut has quit IRC12:27
*** dansmith has quit IRC12:29
*** dansmith has joined #openstack-neutron12:32
*** gcheresh has joined #openstack-neutron12:42
*** jpena|lunch is now known as jpena12:47
*** markvoelker has joined #openstack-neutron12:49
openstackgerritsahid proposed openstack/neutron-fwaas master: db: add missing primary key in firewall_group_associations_v2  https://review.opendev.org/66393112:58
*** boden has joined #openstack-neutron12:59
*** janki has quit IRC13:04
*** janki has joined #openstack-neutron13:04
*** mvkr has quit IRC13:09
*** mriedem has joined #openstack-neutron13:10
*** sm806 has quit IRC13:12
*** sm806 has joined #openstack-neutron13:13
*** yamamoto has quit IRC13:15
*** gcheresh has quit IRC13:15
*** rkukura has quit IRC13:18
*** BjoernT has joined #openstack-neutron13:20
openstackgerritMerged openstack/neutron master: fix NetworkSegmentRange OVO entry point  https://review.opendev.org/66341813:22
*** priteau has quit IRC13:23
*** shubham_potale has quit IRC13:27
*** sm806 has quit IRC13:28
*** BjoernT_ has joined #openstack-neutron13:28
*** sm806 has joined #openstack-neutron13:29
*** BjoernT has quit IRC13:31
*** tbachman has quit IRC13:31
*** tbachman has joined #openstack-neutron13:33
openstackgerritSlawek Kaplonski proposed openstack/networking-ovn master: WIP Make networking-ovn-tempest-slow to be multinode job  https://review.opendev.org/65832613:34
openstackgerritMerged openstack/neutron master: Add ip_monitor command implemented using Pyroute2  https://review.opendev.org/66061113:36
*** priteau has joined #openstack-neutron13:38
*** cshen has quit IRC13:47
*** yamamoto has joined #openstack-neutron13:48
*** yamamoto has quit IRC13:49
*** yamamoto has joined #openstack-neutron13:50
*** JamesBenson has joined #openstack-neutron13:52
*** JamesBenson has quit IRC13:53
*** JamesBenson has joined #openstack-neutron13:53
*** mlavalle has joined #openstack-neutron13:55
*** ccamposr has quit IRC13:58
*** slaweq_ is now known as slaweq14:00
*** hongbin has joined #openstack-neutron14:06
*** janki has quit IRC14:08
*** liuyulong has joined #openstack-neutron14:11
*** igordc has joined #openstack-neutron14:23
*** tbachman has quit IRC14:23
openstackgerritSlawek Kaplonski proposed openstack/networking-ovn master: WIP Make networking-ovn-tempest-slow to be multinode job  https://review.opendev.org/65832614:33
*** tbachman has joined #openstack-neutron14:44
*** pbandark has joined #openstack-neutron14:44
*** baojg has joined #openstack-neutron14:46
*** itlinux has quit IRC14:46
*** itlinux has joined #openstack-neutron14:47
*** itlinux has quit IRC14:52
*** baojg has quit IRC14:56
*** manjeets has joined #openstack-neutron14:59
*** itlinux has joined #openstack-neutron14:59
*** sapd1_x has joined #openstack-neutron15:07
*** tbachman has quit IRC15:08
*** tbachman has joined #openstack-neutron15:11
*** aedc has quit IRC15:12
openstackgerritLajos Katona proposed openstack/neutron-lib master: placement client: fix routed prov networks working  https://review.opendev.org/66397815:21
openstackgerritLajos Katona proposed openstack/neutron master: Force segments to use placement 1.1  https://review.opendev.org/66397915:25
openstackgerritLajos Katona proposed openstack/neutron master: segments: Fix resource provider inventories update  https://review.opendev.org/66398015:25
*** bnemec is now known as beekneemech15:29
*** lajoskatona has quit IRC15:30
*** davidsha has quit IRC15:32
*** BjoernT has joined #openstack-neutron15:37
openstackgerritJakub Libosvar proposed openstack/networking-ovn master: functional: Import event module from ovsdbapp  https://review.opendev.org/66216015:38
*** BjoernT_ has quit IRC15:40
*** gibi is now known as gibi_ogg15:41
*** gibi_ogg is now known as gibi_off15:41
*** lucasagomes has quit IRC15:47
*** markvoelker has quit IRC15:49
*** wwriverrat has quit IRC15:54
*** ramishra has quit IRC15:56
*** aedc has joined #openstack-neutron15:58
*** aedc has quit IRC16:05
*** mattw4 has joined #openstack-neutron16:07
openstackgerritSlawek Kaplonski proposed openstack/networking-ovn master: WIP Make networking-ovn-tempest-slow to be multinode job  https://review.opendev.org/65832616:07
*** luksky has quit IRC16:11
openstackgerritBrian Haley proposed openstack/neutron-specs master: [WIP] Toward Convergence of ML2+OVS+DVR and OVN  https://review.opendev.org/65841416:11
*** panda is now known as panda|off16:13
*** yamamoto has quit IRC16:23
*** tbachman has quit IRC16:24
*** priteau has quit IRC16:25
*** mriedem has quit IRC16:28
*** mriedem has joined #openstack-neutron16:29
openstackgerritMerged openstack/networking-midonet master: Remove CINDER_PERIODIC_INTERVAL setting  https://review.opendev.org/65544816:37
openstackgerritMerged openstack/ovsdbapp master: Replace openstack repository by opendev  https://review.opendev.org/66259116:38
*** tbachman has joined #openstack-neutron16:39
*** tesseract has quit IRC16:40
*** iyamahat has quit IRC16:41
*** boden has quit IRC16:46
*** iyamahat has joined #openstack-neutron16:48
*** markvoelker has joined #openstack-neutron16:50
*** weifan has joined #openstack-neutron16:51
*** gibi_off has quit IRC16:52
*** yamamoto has joined #openstack-neutron16:54
*** jpena is now known as jpena|off16:56
*** yamamoto has quit IRC16:59
openstackgerritRodolfo Alonso Hernandez proposed openstack/neutron master: [WIP] Implement "ip route" commands using Pyroute2  https://review.opendev.org/66198116:59
*** boden has joined #openstack-neutron17:04
*** weifan has quit IRC17:04
*** weifan has joined #openstack-neutron17:05
*** weifan has quit IRC17:05
*** weifan has joined #openstack-neutron17:05
*** weifan has quit IRC17:06
*** liuyulong has quit IRC17:06
*** weifan has joined #openstack-neutron17:06
*** weifan has quit IRC17:07
*** weifan has joined #openstack-neutron17:07
*** weifan has quit IRC17:08
*** weifan has joined #openstack-neutron17:08
*** weifan has quit IRC17:08
openstackgerritRodolfo Alonso Hernandez proposed openstack/neutron master: Add log information in agent schedulers  https://review.opendev.org/66390317:08
*** tbachman has quit IRC17:09
*** ralonsoh has quit IRC17:09
*** tbachman has joined #openstack-neutron17:13
*** ociuhandu_ has joined #openstack-neutron17:15
*** ociuhandu has quit IRC17:18
*** sapd1_x has quit IRC17:19
*** ociuhandu_ has quit IRC17:20
*** iyamahat has quit IRC17:20
*** yamahata has quit IRC17:21
*** markvoelker has quit IRC17:25
*** weifan has joined #openstack-neutron17:31
*** iyamahat has joined #openstack-neutron17:33
*** weifan has quit IRC17:35
*** aedc has joined #openstack-neutron17:36
*** tssurya has quit IRC17:36
*** iyamahat_ has joined #openstack-neutron17:38
*** aedc has quit IRC17:41
*** iyamahat has quit IRC17:41
*** yamahata has joined #openstack-neutron17:51
*** weifan has joined #openstack-neutron17:51
*** maciejjozefczyk has quit IRC17:55
*** luksky has joined #openstack-neutron17:56
*** aram1s has joined #openstack-neutron18:05
openstackgerritMerged openstack/neutron master: Switch to new engine facade for L3_HA_NAT_db_mixin  https://review.opendev.org/66330618:15
openstackgerritMerged openstack/neutron master: Add guidelines for removal of OVO version downgrades  https://review.opendev.org/66199518:15
*** aedc has joined #openstack-neutron18:18
*** markvoelker has joined #openstack-neutron18:22
*** aedc has quit IRC18:23
*** enyinna1234 has joined #openstack-neutron18:30
openstackgerritMerged openstack/networking-ovn master: Pass haproxy service name to ProcessMonitor  https://review.opendev.org/66367618:53
*** markvoelker has quit IRC18:55
openstackgerritMerged openstack/ovsdbapp master: Move WaitForPortBindingEvent out from testing code  https://review.opendev.org/66163219:01
*** JamesBenson has quit IRC19:02
*** boden has quit IRC19:22
*** pbandark has quit IRC19:30
*** BjoernT has quit IRC19:31
*** weifan has quit IRC19:32
*** manjeets has quit IRC19:33
*** boden has joined #openstack-neutron19:33
*** boden has quit IRC19:33
*** doreilly has quit IRC19:51
*** markvoelker has joined #openstack-neutron19:52
*** guimaluf has joined #openstack-neutron19:52
*** maciejjozefczyk has joined #openstack-neutron20:02
*** mriedem has quit IRC20:08
*** maciejjozefczyk has quit IRC20:10
*** ksambor has quit IRC20:10
*** mriedem has joined #openstack-neutron20:11
*** weifan has joined #openstack-neutron20:12
*** weifan has quit IRC20:16
openstackgerritBrian Haley proposed openstack/neutron-specs master: [WIP] Toward Convergence of ML2+OVS+DVR and OVN  https://review.opendev.org/65841420:18
*** markvoelker has quit IRC20:20
*** igordc has quit IRC20:28
*** weifan has joined #openstack-neutron20:45
*** mriedem has quit IRC21:06
*** njohnston has quit IRC21:07
*** njohnston has joined #openstack-neutron21:09
*** markvoelker has joined #openstack-neutron21:16
*** markvoelker has quit IRC21:21
*** iyamahat__ has joined #openstack-neutron21:30
*** iyamahat_ has quit IRC21:33
*** whoami-rajat has quit IRC21:34
*** iyamahat_ has joined #openstack-neutron21:48
*** pcaruana has quit IRC21:51
*** iyamahat__ has quit IRC21:52
*** luksky has quit IRC21:55
openstackgerritSwaminathan Vasudevan proposed openstack/neutron master: (WIP)DVR: Enable IPv6 for FIP and Fast path exit  https://review.opendev.org/66211121:57
*** slaweq has quit IRC22:01
*** slaweq has joined #openstack-neutron22:07
*** tbachman has quit IRC22:11
*** slaweq has quit IRC22:15
openstackgerritSwaminathan Vasudevan proposed openstack/neutron master: (WIP)DVR: Enable IPv6 for FIP and Fast path exit  https://review.opendev.org/66211122:22
*** weifan has quit IRC22:28
*** weifan has joined #openstack-neutron22:29
*** hamzy_ has joined #openstack-neutron22:30
*** hamzy has quit IRC22:32
*** weifan has quit IRC22:33
*** weifan has joined #openstack-neutron22:36
*** weifan has quit IRC22:45
*** weifan has joined #openstack-neutron22:46
*** weifan has quit IRC22:50
*** weifan has joined #openstack-neutron22:52
*** slaweq has joined #openstack-neutron23:11
*** slaweq has quit IRC23:15
*** markvoelker has joined #openstack-neutron23:17
*** hongbin has quit IRC23:20
*** hoonetorg has quit IRC23:35
*** markvoelker has quit IRC23:38
*** hoonetorg has joined #openstack-neutron23:49
*** weifan has quit IRC23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!