| *** iyamahat has joined #openstack-meeting-3 | 00:03 | |
| *** hongbin has quit IRC | 00:11 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 00:11 | |
| *** witek_ has joined #openstack-meeting-3 | 00:13 | |
| *** witek has quit IRC | 00:13 | |
| *** macza has quit IRC | 00:14 | |
| *** jamesmcarthur has quit IRC | 00:15 | |
| *** bobh has joined #openstack-meeting-3 | 00:19 | |
| *** Swami has quit IRC | 00:48 | |
| *** dklyle has joined #openstack-meeting-3 | 00:53 | |
| *** diablo_rojo has quit IRC | 01:25 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 01:30 | |
| *** jamesmcarthur has quit IRC | 01:57 | |
| *** yamamoto has quit IRC | 02:21 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 02:29 | |
| *** bobh has quit IRC | 02:37 | |
| *** bobh has joined #openstack-meeting-3 | 02:38 | |
| *** bobh has quit IRC | 02:42 | |
| *** jamesmcarthur has quit IRC | 02:44 | |
| *** hongbin has joined #openstack-meeting-3 | 02:45 | |
| *** iyamahat has quit IRC | 02:51 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 02:51 | |
| *** yamahata has quit IRC | 02:51 | |
| *** jamesmcarthur has quit IRC | 02:57 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 02:57 | |
| *** yamamoto has joined #openstack-meeting-3 | 02:59 | |
| *** jamesmcarthur has quit IRC | 03:03 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 03:08 | |
| *** apetrich has quit IRC | 03:15 | |
| *** dklyle has quit IRC | 03:22 | |
| *** jamesmcarthur has quit IRC | 03:24 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 03:27 | |
| *** pgodek has quit IRC | 03:28 | |
| *** xubozhang has quit IRC | 03:28 | |
| *** bobh has joined #openstack-meeting-3 | 03:38 | |
| *** bobh has quit IRC | 03:39 | |
| *** bobh has joined #openstack-meeting-3 | 03:40 | |
| *** bobh has quit IRC | 03:40 | |
| *** bobh has joined #openstack-meeting-3 | 03:41 | |
| *** PagliaccisCloud has joined #openstack-meeting-3 | 03:43 | |
| *** jamesmcarthur has quit IRC | 03:56 | |
| *** bobh has quit IRC | 03:57 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 04:03 | |
| *** PagliaccisCloud has quit IRC | 04:03 | |
| *** jamesmcarthur has quit IRC | 04:05 | |
| *** hongbin has quit IRC | 04:20 | |
| *** yamamoto has quit IRC | 04:35 | |
| *** yamahata has joined #openstack-meeting-3 | 04:52 | |
| *** dconde has quit IRC | 05:05 | |
| *** dconde has joined #openstack-meeting-3 | 05:23 | |
| *** yamamoto has joined #openstack-meeting-3 | 05:32 | |
| *** haleyb has quit IRC | 05:34 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 06:06 | |
| *** jamesmcarthur has quit IRC | 06:11 | |
| *** slaweq has joined #openstack-meeting-3 | 06:57 | |
| *** pcaruana has joined #openstack-meeting-3 | 07:12 | |
| *** yamamoto has quit IRC | 07:14 | |
| *** ralonsoh has joined #openstack-meeting-3 | 07:19 | |
| *** apetrich has joined #openstack-meeting-3 | 07:27 | |
| *** Luzi has joined #openstack-meeting-3 | 07:33 | |
| *** rossella_s has joined #openstack-meeting-3 | 08:00 | |
| *** dklyle has joined #openstack-meeting-3 | 08:07 | |
| *** moguimar has joined #openstack-meeting-3 | 08:08 | |
| *** dconde has quit IRC | 08:18 | |
| *** dklyle has quit IRC | 08:27 | |
| *** yamamoto has joined #openstack-meeting-3 | 08:30 | |
| *** yamamoto has quit IRC | 08:47 | |
| *** tssurya has joined #openstack-meeting-3 | 09:09 | |
| *** trident has quit IRC | 09:16 | |
| *** trident has joined #openstack-meeting-3 | 09:19 | |
| *** yamahata has quit IRC | 09:24 | |
| *** yamamoto has joined #openstack-meeting-3 | 09:26 | |
| *** e0ne has joined #openstack-meeting-3 | 09:41 | |
| *** markvoelker has joined #openstack-meeting-3 | 09:46 | |
| *** PagliaccisCloud has joined #openstack-meeting-3 | 09:56 | |
| *** trident has quit IRC | 10:15 | |
| *** trident has joined #openstack-meeting-3 | 10:15 | |
| *** pbourke has quit IRC | 10:28 | |
| *** pbourke has joined #openstack-meeting-3 | 10:30 | |
| *** yamamoto has quit IRC | 11:13 | |
| *** yamamoto has joined #openstack-meeting-3 | 11:51 | |
| *** yamamoto has quit IRC | 11:51 | |
| *** yamamoto has joined #openstack-meeting-3 | 11:52 | |
| *** yamamoto has quit IRC | 11:56 | |
| *** yamamoto has joined #openstack-meeting-3 | 12:04 | |
| *** raildo has joined #openstack-meeting-3 | 12:08 | |
| *** PagliaccisCloud has quit IRC | 12:19 | |
| *** markvoelker has quit IRC | 12:24 | |
| *** yamamoto has quit IRC | 12:49 | |
| *** e0ne has quit IRC | 12:51 | |
| *** yamamoto has joined #openstack-meeting-3 | 12:51 | |
| *** bobh has joined #openstack-meeting-3 | 13:04 | |
| *** markvoelker has joined #openstack-meeting-3 | 13:10 | |
| *** bobh has quit IRC | 13:18 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 13:28 | |
| *** jamesmcarthur has quit IRC | 13:30 | |
| *** irclogbot_1 has quit IRC | 13:30 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 13:32 | |
| *** e0ne has joined #openstack-meeting-3 | 13:35 | |
| *** jamesmcarthur has quit IRC | 13:40 | |
| *** tellesnobrega has joined #openstack-meeting-3 | 13:40 | |
| *** irclogbot_1 has joined #openstack-meeting-3 | 13:47 | |
| *** e0ne has quit IRC | 13:49 | |
| *** apetrich has quit IRC | 13:49 | |
| *** apetrich has joined #openstack-meeting-3 | 13:50 | |
| *** irclogbot_1 has quit IRC | 13:52 | |
| *** e0ne has joined #openstack-meeting-3 | 13:57 | |
| *** bobh has joined #openstack-meeting-3 | 13:58 | |
| *** njohnston has joined #openstack-meeting-3 | 13:58 | |
| *** yamamoto has quit IRC | 13:59 | |
| *** yamamoto has joined #openstack-meeting-3 | 14:00 | |
| tellesnobrega | #startmeeting sahara | 14:01 |
|---|---|---|
| openstack | Meeting started Thu Dec 13 14:01:29 2018 UTC and is due to finish in 60 minutes. The chair is tellesnobrega. Information about MeetBot at http://wiki.debian.org/MeetBot. | 14:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 14:01 |
| *** openstack changes topic to " (Meeting topic: sahara)" | 14:01 | |
| openstack | The meeting name has been set to 'sahara' | 14:01 |
| *** tosky has joined #openstack-meeting-3 | 14:01 | |
| tosky | hi | 14:01 |
| *** markvoelker has quit IRC | 14:03 | |
| tellesnobrega | hi | 14:03 |
| tellesnobrega | is jeremy around? | 14:03 |
| tellesnobrega | maybe not | 14:03 |
| tellesnobrega | lets start | 14:03 |
| tellesnobrega | #topic News/Updates | 14:04 |
| *** openstack changes topic to "News/Updates (Meeting topic: sahara)" | 14:04 | |
| *** jeremyfreudberg has joined #openstack-meeting-3 | 14:04 | |
| jeremyfreudberg | o/ | 14:04 |
| tellesnobrega | hey jeremyfreudberg | 14:04 |
| tellesnobrega | I'm mainly working on APIv2 stuff, documentation and 500 issue | 14:05 |
| tellesnobrega | we can talk more about them later | 14:05 |
| *** yamamoto has quit IRC | 14:05 | |
| tellesnobrega | tosky, jeremyfreudberg news from you? | 14:06 |
| tosky | I reviewed the patch which fixes ambari image generation on ubuntu (still some issues) | 14:07 |
| tosky | sent the email about the split of the repositories to openstack-discuss@ (sorry for messing up the subject) | 14:07 |
| tosky | worked for a (unrelated) presentation on RBAC in openstack, but that's the reason for that WIP review which adds some RBAC tests to Sahara | 14:08 |
| tosky | and in general I should work on the code for https://review.openstack.org/#/c/622492/ , if accepted | 14:09 |
| tosky | and that's it | 14:09 |
| *** tidwellr has joined #openstack-meeting-3 | 14:09 | |
| *** irclogbot_1 has joined #openstack-meeting-3 | 14:10 | |
| tellesnobrega | jeremyfreudberg? | 14:10 |
| *** jamesmcarthur has joined #openstack-meeting-3 | 14:11 | |
| jeremyfreudberg | nothing new really, but the semester is over after mid-next-week | 14:12 |
| tellesnobrega | nice | 14:12 |
| tellesnobrega | will you be able to take some time to work on some apiv2 them? | 14:12 |
| jeremyfreudberg | yes, that's the idea | 14:13 |
| jeremyfreudberg | that's my priority for sure | 14:13 |
| tellesnobrega | awesome | 14:13 |
| tellesnobrega | moving on | 14:14 |
| tellesnobrega | #topic APIv2 | 14:14 |
| *** openstack changes topic to "APIv2 (Meeting topic: sahara)" | 14:14 | |
| tellesnobrega | I'm currently working on 2 issues | 14:15 |
| tellesnobrega | the 500 case and the documentation | 14:15 |
| tellesnobrega | lets start with the 500 case | 14:15 |
| tellesnobrega | I talked with tosky and we decided to make the change happen only on APIv2 | 14:16 |
| *** jamesmcarthur has quit IRC | 14:16 | |
| jeremyfreudberg | apiv2 only makes sense to me too | 14:17 |
| tellesnobrega | what I'm trying to make it work right now is a decorator that will get the command and check in a dictionary if the params passed are on the whitelist | 14:17 |
| tellesnobrega | does that seems ok to you? | 14:18 |
| jeremyfreudberg | well, i think this was something that i at least partially suggested on the review, so, yes, it sounds good :) | 14:19 |
| jeremyfreudberg | tosky? | 14:20 |
| tellesnobrega | jeremyfreudberg, yes it is :) | 14:20 |
| tosky | ehm, that's one the reviews that I really didn't check | 14:20 |
| tellesnobrega | it would be good if both could take a look, I'm hitting some weird errors on tempest (the change is only on APIv2 and tempest runs against api v1 and it is failing) | 14:22 |
| tellesnobrega | also scenarios I couldn't find the errors, if anyone can give me a hand with that | 14:22 |
| tosky | the first question is: are you sure that the change is v2 only? :) | 14:23 |
| jeremyfreudberg | in any case, the solution is, in theory, elegant: it's the most straightforward way to encapsulate that different API view functions have different allowed query string values | 14:23 |
| tosky | iirc some of the v2 code used v1, or the other way, or some common code | 14:23 |
| jeremyfreudberg | tosky, good question | 14:23 |
| tellesnobrega | tosky, it should be at this point, but I will check | 14:24 |
| tosky | tellesnobrega: check the logs of sahara-api | 14:25 |
| jeremyfreudberg | tellesnobrega: did you find out where these things are coming from: https://review.openstack.org/#/c/623300/9/sahara/utils/api.py | 14:25 |
| tosky | it's definitely going through apiv2 code | 14:25 |
| jeremyfreudberg | (my question is unrelated to tosky's question) | 14:25 |
| tosky | http://logs.openstack.org/00/623300/9/check/sahara-tests-tempest/94d7ad0/controller/logs/apache/sahara-api_log.txt.gz#_2018-12-12_21_41_49_395831 | 14:26 |
| tellesnobrega | jeremyfreudberg, I cleaned up it a lot now, I'll test and see if it is better | 14:26 |
| tellesnobrega | jeremyfreudberg, it looks more like this now https://review.openstack.org/#/c/623300/9/sahara/service/validation.py | 14:27 |
| *** irclogbot_1 has quit IRC | 14:27 | |
| *** bobh has quit IRC | 14:27 | |
| tellesnobrega | a lot less params | 14:27 |
| jeremyfreudberg | tellesnobrega: great, cool | 14:27 |
| tellesnobrega | the ones I kept are search_opts passed on the client that it uses to create the query | 14:27 |
| tellesnobrega | tosky, thanks, I will fix that | 14:27 |
| tellesnobrega | that is all I have on apiv2 | 14:30 |
| tellesnobrega | hopefully jeremyfreudberg will have time to work on microversioning | 14:30 |
| *** haleyb has joined #openstack-meeting-3 | 14:31 | |
| tellesnobrega | any topics you want to cover? | 14:31 |
| *** jamesmcarthur has joined #openstack-meeting-3 | 14:31 | |
| tosky | an update on plugin split | 14:32 |
| tellesnobrega | sure | 14:32 |
| tellesnobrega | #topic Split Plugin | 14:32 |
| *** openstack changes topic to "Split Plugin (Meeting topic: sahara)" | 14:32 | |
| tosky | I sent the email to openstack-discuss@; we had one reaction so far with some feedback which should be implemented (description for plugins) | 14:33 |
| tosky | apart from that, the codebase seems to be fine, according my previous tests, so I'd be leaning towards merging the pending patches, rebasing, and try to push the split as soon as possible | 14:33 |
| tosky | and fix the breakages when they shows | 14:34 |
| tosky | at least a puppet core wrote that he can help when I nagged him earlier today | 14:34 |
| tosky | the openstack-ansible part is something that I can help fixing too | 14:34 |
| tosky | if anyone else has any comment on the way the split is done, this is the right time :) | 14:35 |
| tellesnobrega | it looks like the right path | 14:35 |
| *** irclogbot_1 has joined #openstack-meeting-3 | 14:36 | |
| *** markvoelker has joined #openstack-meeting-3 | 14:36 | |
| tosky | nothing else from my side about the splitting | 14:37 |
| tellesnobrega | jeremyfreudberg? | 14:37 |
| *** redrobot has joined #openstack-meeting-3 | 14:38 | |
| jeremyfreudberg | not right now | 14:39 |
| tellesnobrega | anything else? | 14:40 |
| tosky | not on this topic, just a plea to recheck few pending reviews with +2 (I think that tellesnobrega already ninja-approved everything that he could, so it's on jeremyfreudberg now :) | 14:40 |
| jeremyfreudberg | yes, i'll give some things a look | 14:41 |
| tellesnobrega | I did but didn't want to force approve important stuff | 14:41 |
| tellesnobrega | jeremyfreudberg, if you have time today or tomorrow to review would be great so we can merge most of the stuff and we can move on with the split sequece | 14:42 |
| tellesnobrega | sequence | 14:42 |
| *** hongbin has joined #openstack-meeting-3 | 14:42 | |
| jeremyfreudberg | yup | 14:43 |
| tellesnobrega | thanks | 14:43 |
| *** liuyulong has joined #openstack-meeting-3 | 14:43 | |
| tellesnobrega | I guess we can close it early today | 14:43 |
| *** yamamoto has joined #openstack-meeting-3 | 14:44 | |
| tellesnobrega | thanks jeremyfreudberg and tosky | 14:45 |
| tellesnobrega | lets keep up the good work | 14:46 |
| tellesnobrega | see you all next week | 14:46 |
| tosky | see you! | 14:46 |
| tellesnobrega | #endmeeting | 14:46 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 14:46 | |
| openstack | Meeting ended Thu Dec 13 14:46:36 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 14:46 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/sahara/2018/sahara.2018-12-13-14.01.html | 14:46 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/sahara/2018/sahara.2018-12-13-14.01.txt | 14:46 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/sahara/2018/sahara.2018-12-13-14.01.log.html | 14:46 |
| *** jeremyfreudberg has quit IRC | 14:47 | |
| *** tellesnobrega has left #openstack-meeting-3 | 14:54 | |
| haleyb | #startmeeting neutron_l3 | 15:00 |
| openstack | Meeting started Thu Dec 13 15:00:54 2018 UTC and is due to finish in 60 minutes. The chair is haleyb. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| *** openstack changes topic to " (Meeting topic: neutron_l3)" | 15:00 | |
| openstack | The meeting name has been set to 'neutron_l3' | 15:00 |
| njohnston | o/ | 15:01 |
| slaweq | hi | 15:01 |
| *** davidsha has joined #openstack-meeting-3 | 15:01 | |
| haleyb | hi everyone | 15:02 |
| davidsha | Hi | 15:02 |
| *** jamesmcarthur has quit IRC | 15:02 | |
| haleyb | #topic Announcements | 15:02 |
| *** openstack changes topic to "Announcements (Meeting topic: neutron_l3)" | 15:02 | |
| haleyb | Just a reminder Stein-2 is Jan 7th | 15:03 |
| *** jamesmcarthur has joined #openstack-meeting-3 | 15:03 | |
| haleyb | And we will have a meeting next week, but not the week after | 15:04 |
| *** jamesmcarthur has quit IRC | 15:04 | |
| haleyb | any other announcements? | 15:04 |
| haleyb | #topic Bugs | 15:05 |
| *** openstack changes topic to "Bugs (Meeting topic: neutron_l3)" | 15:05 | |
| tidwellr | hi | 15:05 |
| haleyb | tidwellr: hi | 15:05 |
| haleyb | i don't see Swami so will go through bugs | 15:06 |
| *** jamesmcarthur has joined #openstack-meeting-3 | 15:06 | |
| haleyb | https://bugs.launchpad.net/neutron/+bug/1774459 | 15:06 |
| openstack | Launchpad bug 1774459 in neutron "Update permanent ARP entries for allowed_address_pair IPs in DVR Routers" [High,Confirmed] - Assigned to Swaminathan Vasudevan (swaminathan-vasudevan) | 15:06 |
| haleyb | https://review.openstack.org/#/c/601336/ | 15:06 |
| haleyb | I have not finished my review of this, still working on it | 15:07 |
| haleyb | seems zuul didn't finish it's review either | 15:08 |
| haleyb | next is https://bugs.launchpad.net/neutron/+bug/1802006 | 15:08 |
| openstack | Launchpad bug 1802006 in neutron "Floating IP attach/detach fails for non-admin user and unbound port with router in different tenant" [Medium,In progress] - Assigned to Arjun Baindur (abaindur) | 15:08 |
| haleyb | https://review.openstack.org/#/c/622623/ | 15:09 |
| haleyb | i just rebased that, looked good, simple change | 15:09 |
| haleyb | https://bugs.launchpad.net/neutron/+bug/1804327 | 15:10 |
| openstack | Launchpad bug 1804327 in neutron "occasional connection reset on SNATed after tcp retries" [Medium,In progress] - Assigned to Dirk Mueller (dmllr) | 15:10 |
| haleyb | tidwellr: you were taking this one over | 15:10 |
| haleyb | https://review.openstack.org/#/c/618208/ | 15:10 |
| tidwellr | no updates on that one today | 15:11 |
| haleyb | ack | 15:11 |
| haleyb | next is https://bugs.launchpad.net/neutron/+bug/1805456 | 15:11 |
| openstack | Launchpad bug 1805456 in neutron "[DVR] Neutron doesn't configure multiple external subnets for one network properly" [Medium,In progress] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez) | 15:11 |
| haleyb | https://review.openstack.org/#/c/622449/ | 15:11 |
| haleyb | that's just stuck in recheck | 15:12 |
| haleyb | thanks for fixing that ralonsoh | 15:12 |
| ralonsoh | np | 15:12 |
| *** davidsha has left #openstack-meeting-3 | 15:13 | |
| haleyb | https://bugs.launchpad.net/neutron/+bug/1794991 | 15:13 |
| openstack | Launchpad bug 1794991 in neutron "Inconsistent flows with DVR l2pop VxLAN on br-tun" [Undecided,New] | 15:13 |
| haleyb | Swami did some further debugging here, so made some progress | 15:14 |
| haleyb | at least the missing flow has been identified | 15:15 |
| haleyb | next is https://bugs.launchpad.net/neutron/+bug/1806770 | 15:15 |
| openstack | Launchpad bug 1806770 in neutron "DHCP Agent should not release DHCP lease when client ID is not set on port" [Medium,In progress] - Assigned to Arjun Baindur (abaindur) | 15:15 |
| haleyb | https://review.openstack.org/#/c/623066/ proposed | 15:16 |
| haleyb | i don't see Arjun here, big timezone difference | 15:16 |
| haleyb | this is probably the 4th time we've had to tweak the dhcp release code, so any additional eyes would be helpful. in this case it was due to differences in Windows clients | 15:18 |
| haleyb | crickets :) | 15:19 |
| *** jamesmcarthur has quit IRC | 15:19 | |
| haleyb | there were also 2 metering agent bugs filed last week, i will triage them but fix is posted | 15:20 |
| haleyb | https://bugs.launchpad.net/neutron/+bug/1807153 | 15:20 |
| openstack | Launchpad bug 1807153 in neutron "Race condition in metering agent when creating iptable managers for router namespaces" [Undecided,New] | 15:20 |
| haleyb | https://bugs.launchpad.net/neutron/+bug/1807157 | 15:20 |
| openstack | Launchpad bug 1807157 in neutron "Metering doesn't work for DVR routers on compute nodes" [Undecided,New] | 15:20 |
| haleyb | https://review.openstack.org/#/c/621165/ | 15:21 |
| haleyb | ^^ fixes both, needs reviews | 15:21 |
| haleyb | any other bugs someone wants to talk about? | 15:22 |
| slaweq | I want to raise one | 15:23 |
| slaweq | https://bugs.launchpad.net/neutron/+bug/1798475 | 15:23 |
| openstack | Launchpad bug 1798475 in neutron "Fullstack test test_ha_router_restart_agents_no_packet_lost failing" [High,Confirmed] | 15:23 |
| slaweq | it's fullstack tests issue but related to L3 HA | 15:23 |
| liuyulong | yes, I got your email. | 15:23 |
| liuyulong | Looking at it now | 15:23 |
| slaweq | in last comment I described exactly sequence of events there, and I need someone else to take a look on it :) | 15:23 |
| slaweq | yes, thx liuyulong :) | 15:23 |
| haleyb | thanks liuyulong, let me know if you need some help | 15:24 |
| liuyulong | I have a clue, maybe the create router 'router_update' notifaction was re-consumed again. | 15:25 |
| liuyulong | Because the l3 agent is restart too fast. | 15:25 |
| slaweq | it's more than 1 minute after create router | 15:26 |
| liuyulong | I can not see a packet loss in my local env during l3 agent restart, if router was created long time ago. | 15:26 |
| slaweq | because when router is created, backup agent is restarted and ping is checked for 1 minute | 15:26 |
| haleyb | slaweq: so it's the restart of the master - when it comes back up it becomes master again instead of staying backup? | 15:28 |
| liuyulong | http://logs.openstack.org/09/608909/20/check/neutron-fullstack/c7b6401/logs/dsvm-fullstack-logs/TestHAL3Agent.test_ha_router_restart_agents_no_packet_lost/neutron-l3-agent--2018-11-30--03-38-50-946978.txt.gz#_2018-11-30_03_39_03_184 | 15:28 |
| slaweq | finally it becomes master again but it may be because other agent was already removed | 15:28 |
| liuyulong | this line is the related LOG. | 15:28 |
| liuyulong | l3 agent restart, but it got a notification | 15:29 |
| liuyulong | The request id was first seen here: http://logs.openstack.org/09/608909/20/check/neutron-fullstack/c7b6401/logs/dsvm-fullstack-logs/TestHAL3Agent.test_ha_router_restart_agents_no_packet_lost/neutron-l3-agent--2018-11-30--03-37-05-693500.txt.gz | 15:31 |
| liuyulong | during the create | 15:31 |
| liuyulong | req-9ce3d0cb-3fbf-421d-a59c-8ca6efda1c58 | 15:31 |
| *** jamesmcarthur has joined #openstack-meeting-3 | 15:32 | |
| liuyulong | This is a known issue, I'm not quite sure if it is related to the test failing. | 15:33 |
| liuyulong | IMO, such behavior does not influence the data plane. | 15:33 |
| slaweq | but test clearly shows that dataplane is impacted in this case | 15:34 |
| slaweq | as it fails because of some packet loss during agent restart | 15:34 |
| haleyb | liuyulong: is there another bug for this issue? | 15:34 |
| liuyulong | haleyb, no bug for it | 15:35 |
| liuyulong | slaweq, yes, we needs more investigation | 15:36 |
| slaweq | liuyulong: haleyb: but can processing of such rpc message by agent cause switch of VIP address in keepalived? | 15:36 |
| slaweq | I though that agent is not the one who decides if it's master or backup node | 15:36 |
| liuyulong | slaweq, IMO, it should not | 15:36 |
| *** davidsha has joined #openstack-meeting-3 | 15:36 | |
| slaweq | but keepalived do that | 15:36 |
| haleyb | yes, keepalived should do it | 15:36 |
| slaweq | so IMO here there is some issue that cause missing some vrrp packets from one "host" to another | 15:37 |
| slaweq | but I don't know what could do that :/ | 15:37 |
| haleyb | slaweq: and this is intermittent gate failure? | 15:37 |
| liuyulong | besides this re-consume issue, a race condition between routers_updated and fullsync may also need attention. | 15:37 |
| slaweq | haleyb: yes, it happens from time to time | 15:38 |
| slaweq | some time ago this test was restarting all agents at once and it happend more often then IIRC | 15:38 |
| *** markvoelker has quit IRC | 15:38 | |
| slaweq | but then I changed it to restart only backup agents and You added restart of active agents to it | 15:38 |
| liuyulong | L2 agent is not restarted, so l2 data plane may not be an issue. But if ha router re-consume notification was causing a re-install ha device, this may cause a packet loss. | 15:39 |
| liuyulong | I'm not quite sure about this, needs some code digging | 15:40 |
| haleyb | liuyulong: do you have the time to look? | 15:40 |
| liuyulong | haleyb, yes, I'll check it. | 15:40 |
| slaweq | liuyulong: thx a lot | 15:41 |
| haleyb | liuyulong: thanks, i'll assign it to you (although launchpad is not cooperating right now) | 15:42 |
| liuyulong | OK | 15:42 |
| haleyb | liuyulong: dragon889 is your launchpad id ? | 15:43 |
| liuyulong | yes | 15:43 |
| haleyb | thanks | 15:43 |
| haleyb | any other bugs to discuss? | 15:44 |
| haleyb | #topic Check/gate failures | 15:45 |
| *** openstack changes topic to "Check/gate failures (Meeting topic: neutron_l3)" | 15:45 | |
| haleyb | http://grafana.openstack.org/d/Hj5IHcSmz/neutron-failure-rate?orgId=1 | 15:45 |
| haleyb | obviously the iptable-hybrid job is causing grief... | 15:45 |
| ralonsoh | my bad.... sorry | 15:46 |
| ralonsoh | patch is merged in os-vif, waiting for next os-vif version release | 15:46 |
| haleyb | ralonsoh: np, it wasn't your fault | 15:47 |
| haleyb | i had an action item from last week to check the neutron-tempest-plugin-dvr-multinode-scenario job failure rate | 15:47 |
| haleyb | i have failed that task, so re-added to my queue | 15:48 |
| *** xubozhang has joined #openstack-meeting-3 | 15:48 | |
| haleyb | i do wonder if some of this will clear up with fressi's changes that are in-flight | 15:49 |
| haleyb | but most are because unable to ssh to the floating IP | 15:50 |
| haleyb | eg http://logs.openstack.org/23/622623/3/check/neutron-tempest-plugin-dvr-multinode-scenario/604b3c0/testr_results.html.gz | 15:50 |
| haleyb | i will take a further look | 15:52 |
| haleyb | and file a bug | 15:52 |
| *** Luzi has quit IRC | 15:52 | |
| haleyb | ooh, and i found another error now in the qos extension | 15:53 |
| *** bobh has joined #openstack-meeting-3 | 15:53 | |
| haleyb | http://logs.openstack.org/23/622623/3/check/neutron-tempest-plugin-dvr-multinode-scenario/604b3c0/controller/logs/screen-q-l3.txt.gz?level=WARNING | 15:53 |
| haleyb | Error while deleting router a9ac83ee-c93e-4aaf-b1c5-bcdf22ff8b13: TypeError: string indices must be integers | 15:53 |
| haleyb | anyone seen that before? | 15:54 |
| slaweq | no, but that should be IMO easy to reproduce and fix :) | 15:54 |
| njohnston | has this job been switched to python 3 yet? | 15:54 |
| haleyb | i don't know, and it's non-voting so goes unnoticed | 15:55 |
| slaweq | njohnston: yes, all neutron-tempest-plugin jobs are on py3 now | 15:55 |
| slaweq | since some time already | 15:56 |
| njohnston | ok, so that looks like an issue I have seen with some py3 conversions | 15:56 |
| haleyb | USE_PYTHON3: true | 15:57 |
| haleyb | running out of time... | 15:57 |
| haleyb | #topic Open discussion | 15:57 |
| *** openstack changes topic to "Open discussion (Meeting topic: neutron_l3)" | 15:57 | |
| haleyb | any quick topics to discuss? | 15:58 |
| haleyb | ok, thanks for attending, i've got some bugs to file | 15:59 |
| davidsha | Thanks! | 15:59 |
| haleyb | #endmeeting | 15:59 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:59 | |
| openstack | Meeting ended Thu Dec 13 15:59:25 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:59 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_l3/2018/neutron_l3.2018-12-13-15.00.html | 15:59 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_l3/2018/neutron_l3.2018-12-13-15.00.txt | 15:59 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_l3/2018/neutron_l3.2018-12-13-15.00.log.html | 15:59 |
| *** moguimar has quit IRC | 16:04 | |
| *** alexchadin has joined #openstack-meeting-3 | 16:07 | |
| *** alexchadin has quit IRC | 16:10 | |
| *** PagliaccisCloud has joined #openstack-meeting-3 | 16:13 | |
| *** e0ne has quit IRC | 16:30 | |
| *** e0ne has joined #openstack-meeting-3 | 16:30 | |
| *** tosky has quit IRC | 16:43 | |
| *** tosky has joined #openstack-meeting-3 | 16:44 | |
| *** davidsha has quit IRC | 16:46 | |
| *** dconde has joined #openstack-meeting-3 | 16:47 | |
| *** jamesmcarthur has quit IRC | 16:59 | |
| *** bobh has quit IRC | 17:01 | |
| *** bobh has joined #openstack-meeting-3 | 17:05 | |
| *** yamahata has joined #openstack-meeting-3 | 17:06 | |
| *** bobh has quit IRC | 17:10 | |
| *** bobh has joined #openstack-meeting-3 | 17:12 | |
| *** bobh has quit IRC | 17:16 | |
| *** tosky has left #openstack-meeting-3 | 17:29 | |
| *** ianychoi has quit IRC | 17:42 | |
| *** bobh has joined #openstack-meeting-3 | 17:51 | |
| *** joadavis has left #openstack-meeting-3 | 17:53 | |
| *** rkukura has joined #openstack-meeting-3 | 18:00 | |
| *** tbachman has joined #openstack-meeting-3 | 18:03 | |
| tbachman | rkukura: hi! | 18:04 |
| * tbachman looks for annakk | 18:04 | |
| tbachman | rkukura: I’ll give annakk a few minutes | 18:05 |
| rkukura | hi | 18:06 |
| *** yamahata has quit IRC | 18:06 | |
| *** Swami has joined #openstack-meeting-3 | 18:06 | |
| tbachman | rkukura: do you have anything you wanted to cover today? | 18:07 |
| rkukura | nothing critical | 18:08 |
| tbachman | k | 18:08 |
| tbachman | rkukura: we’ll skip it if we don’t see annakk in the next few minutes | 18:08 |
| rkukura | ok | 18:09 |
| tbachman | k | 18:11 |
| tbachman | I think it’s time to call it | 18:11 |
| tbachman | rkukura: see you next time! | 18:11 |
| rkukura | ok | 18:11 |
| *** tbachman has left #openstack-meeting-3 | 18:11 | |
| *** e0ne has quit IRC | 18:11 | |
| rkukura | maybe we could put together an agenda for next time, and notify others | 18:11 |
| *** rkukura has left #openstack-meeting-3 | 18:12 | |
| *** e0ne has joined #openstack-meeting-3 | 18:15 | |
| *** e0ne has quit IRC | 18:16 | |
| *** tssurya has quit IRC | 18:16 | |
| *** yamahata has joined #openstack-meeting-3 | 18:22 | |
| *** ralonsoh has quit IRC | 18:24 | |
| *** njohnston is now known as njohnston_lunch | 18:44 | |
| *** SridarK has joined #openstack-meeting-3 | 18:49 | |
| *** diablo_rojo has joined #openstack-meeting-3 | 19:42 | |
| *** pcaruana has quit IRC | 19:47 | |
| *** PagliaccisCloud has quit IRC | 19:52 | |
| *** e0ne has joined #openstack-meeting-3 | 19:53 | |
| *** e0ne has quit IRC | 19:58 | |
| *** munimeha1 has joined #openstack-meeting-3 | 20:28 | |
| *** bobh has quit IRC | 20:28 | |
| *** diablo_rojo has quit IRC | 20:34 | |
| *** diablo_rojo has joined #openstack-meeting-3 | 20:36 | |
| *** diablo_rojo has quit IRC | 20:41 | |
| *** bauzas has quit IRC | 20:42 | |
| *** bauzas has joined #openstack-meeting-3 | 20:45 | |
| *** bobh has joined #openstack-meeting-3 | 20:48 | |
| *** bobh has quit IRC | 20:52 | |
| *** psachin has joined #openstack-meeting-3 | 20:52 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 20:52 | |
| *** lpetrut has joined #openstack-meeting-3 | 20:53 | |
| *** ianychoi has joined #openstack-meeting-3 | 20:59 | |
| *** macza has joined #openstack-meeting-3 | 21:09 | |
| *** markvoelker has joined #openstack-meeting-3 | 21:11 | |
| *** raildo has quit IRC | 21:21 | |
| *** psachin has quit IRC | 21:27 | |
| *** bobh has joined #openstack-meeting-3 | 21:54 | |
| *** lpetrut has quit IRC | 22:00 | |
| *** bobh has quit IRC | 22:00 | |
| *** dklyle has joined #openstack-meeting-3 | 22:05 | |
| *** markvoelker has quit IRC | 22:06 | |
| *** david-lyle has joined #openstack-meeting-3 | 22:09 | |
| *** dklyle has quit IRC | 22:12 | |
| *** bobh has joined #openstack-meeting-3 | 22:15 | |
| *** david-lyle has quit IRC | 22:23 | |
| *** PagliaccisCloud has joined #openstack-meeting-3 | 22:31 | |
| *** jamesmcarthur has quit IRC | 22:47 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 23:04 | |
| *** jamesmcarthur has quit IRC | 23:04 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 23:05 | |
| *** jamesmcarthur has quit IRC | 23:05 | |
| *** jamesmcarthur has joined #openstack-meeting-3 | 23:39 | |
| *** slaweq has quit IRC | 23:40 | |
| *** jamesmcarthur has quit IRC | 23:44 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!