Wednesday, 2020-10-14

*** jamesmcarthur has quit IRC00:09
*** jamesmcarthur has joined #openstack-meeting-300:40
*** jamesmcarthur has quit IRC00:48
*** jamesmcarthur has joined #openstack-meeting-300:56
*** jamesmcarthur has quit IRC01:23
*** jamesmcarthur has joined #openstack-meeting-301:24
*** psachin has joined #openstack-meeting-303:37
*** jamesmcarthur has quit IRC03:41
*** jamesmcarthur has joined #openstack-meeting-303:48
*** jamesmcarthur has quit IRC03:53
*** jamesmcarthur has joined #openstack-meeting-303:58
*** jamesmcarthur has quit IRC04:40
*** jamesmcarthur has joined #openstack-meeting-304:41
*** jamesmcarthur has quit IRC04:46
*** psachin has quit IRC04:48
*** hongbin has quit IRC04:59
*** hongbin has joined #openstack-meeting-305:09
*** jamesmcarthur has joined #openstack-meeting-305:17
*** hongbin has quit IRC05:19
*** ralonsoh has joined #openstack-meeting-305:33
*** jamesmcarthur has quit IRC05:40
*** slaweq has joined #openstack-meeting-306:08
*** Luzi has joined #openstack-meeting-306:58
*** tosky has joined #openstack-meeting-307:43
*** lpetrut has joined #openstack-meeting-307:50
*** e0ne has joined #openstack-meeting-308:02
*** e0ne has quit IRC08:04
*** jamesmcarthur has joined #openstack-meeting-308:16
*** jamesmcarthur has quit IRC08:21
*** zigo has joined #openstack-meeting-310:12
*** psachin has joined #openstack-meeting-310:57
*** priteau has joined #openstack-meeting-311:39
*** raildo has joined #openstack-meeting-311:42
*** jamesmcarthur has joined #openstack-meeting-312:18
*** jamesmcarthur has quit IRC12:22
*** jamesmcarthur has joined #openstack-meeting-312:26
*** jamesmcarthur has quit IRC12:34
*** jamesmcarthur has joined #openstack-meeting-312:35
*** jamesmcarthur has quit IRC13:05
*** jamesmcarthur has joined #openstack-meeting-313:07
*** Luzi has quit IRC13:23
*** jamesmcarthur has quit IRC13:28
*** artom has joined #openstack-meeting-313:37
*** jamesmcarthur has joined #openstack-meeting-313:50
*** e0ne has joined #openstack-meeting-314:04
*** priteau has quit IRC14:09
*** priteau has joined #openstack-meeting-314:19
*** macz_ has joined #openstack-meeting-314:23
*** macz_ has quit IRC14:28
*** ianychoi_ has quit IRC14:33
*** psachin has quit IRC14:33
*** lpetrut has quit IRC14:40
*** ianychoi has joined #openstack-meeting-314:51
*** lajoskatona has joined #openstack-meeting-314:59
slaweq#startmeeting neutron_ci15:00
openstackMeeting started Wed Oct 14 15:00:52 2020 UTC and is due to finish in 60 minutes.  The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
*** openstack changes topic to " (Meeting topic: neutron_ci)"15:00
slaweqhi15:00
openstackThe meeting name has been set to 'neutron_ci'15:00
lajoskatonao/15:01
*** belmoreira has joined #openstack-meeting-315:01
ralonsohhi15:01
radezo/15:01
bcafarelo/15:02
slaweqGrafana dashboard: http://grafana.openstack.org/dashboard/db/neutron-failure-rate15:02
slaweqplease open now, before we will start15:02
slaweq#topic Actions from previous meetings15:02
*** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)"15:02
*** macz_ has joined #openstack-meeting-315:02
slaweqfirst one15:03
slaweqbcafarel to update our grafana dashboards for stable branches15:03
bcafarelI sent review (looking for link I think it is merged)15:04
bcafarelhttps://review.opendev.org/#/c/757102/ merged indeed!15:04
slaweqthx bcafarel15:05
slaweqok, next one15:05
slaweqslaweq to make neutron-tempest-plugin victoria template15:05
slaweq    Patch: https://review.opendev.org/#/c/756585/15:05
slaweqit is missing +W :)15:05
slaweqso if someone wants, feel free to approve it ;)15:06
ralonsohsone15:06
ralonsohdone15:06
slaweqafter it will be merged I will propose patch to neutron to use those new template15:06
slaweqthx ralonsoh15:06
bcafarelkind of related one https://review.opendev.org/#/c/756695/ drops *-master jobs in victoria (similar to other sable branches)15:06
slaweqbcafarel: done15:07
bcafarelthanks!15:08
slaweqok, next one15:08
slaweqslaweq to propose patch to check console log before ssh to instance15:08
slaweqand tbh I totally forgot about that one15:08
slaweqsorry15:08
slaweqbut I added it to my tasks list for that week, so I will not forget about it again15:08
slaweq#action slaweq to propose patch to check console log before ssh to instance15:08
slaweqok, lets move on15:09
slaweq#topic Switch to Ubuntu Focal15:09
*** openstack changes topic to "Switch to Ubuntu Focal (Meeting topic: neutron_ci)"15:09
slaweqI checked https://etherpad.opendev.org/p/neutron-victoria-switch_to_focal today15:09
slaweqand the only missing jobs are 2 jobs from networking-midonet15:09
slaweqbut those jobs are just proposed to be run on Bionic https://review.opendev.org/#/c/754922/ and it is explained there that there is some issue on Focal15:10
slaweqso I think that we can close this topic for now and consider it as done15:10
slaweqwdyt?15:10
bcafarelyes I think we knew it would be problematic to move them to Focal (and there is good progress compared to preious state)15:10
bcafareland for the rest it seems done to me indeed \o/15:10
ralonsohI agree15:10
slaweqahh, and one more cleanup related to that https://review.opendev.org/75810315:11
slaweqplease take a look :)15:11
slaweqI didn't found definition of those jobs anywhere15:11
slaweq:)15:11
bcafarelnice catch :)15:12
slaweqthx bcafarel15:12
lajoskatonaI have another one related to bgpvpn: https://review.opendev.org/75571915:12
lajoskatonato make some tests unstable for now, and after that we can make voting that job again15:13
slaweqI already +2 it :)15:13
slaweqthx lajoskatona15:13
lajoskatonaslaweq: thanks15:14
slaweqok, next topic15:14
slaweq#topic standardize on zuul v315:14
*** openstack changes topic to "standardize on zuul v3 (Meeting topic: neutron_ci)"15:14
slaweqI think that we can also consider it as done and remove from the agenda15:14
slaweqdo You agree?15:14
ralonsohI think so15:14
lajoskatona+115:15
bcafarelyay for topics completion15:15
slaweqok, great :)15:15
* slaweq I need 2 minutes break15:15
*** macz_ has quit IRC15:15
ralonsoh(he is preparing next week PTG! hehehe)15:16
bcafarellajoskatona: just commented on https://review.opendev.org/758103 please check (before it is merged)15:16
lajoskatonabcafarel: I check it, thanks15:16
ralonsohlet's remove the +W then15:17
toskyjust as reminder about the zuul v3 migration: if you want, you can propose backports too15:18
toskyI'm not sure I will have time for that in the next weeks, but at least ussuri and train could benefit from being fully zuulv315:18
toskyEOF :)15:18
bcafarel:)15:18
slaweqtosky: thx for reminder15:18
toskyand thanks again for the push! Those jobs were not too easy to tackle15:18
slaweqI will try to do them15:18
bcafareltosky: and hopefully CI is still OK in most stadium projects up to train (older branches I am not so sure)15:18
slaweqok, lets move on15:20
slaweq#topic Stadium projects15:21
*** openstack changes topic to "Stadium projects (Meeting topic: neutron_ci)"15:21
slaweqdo You have anything else regarding our stadoum projects for today?15:21
bcafarelnothing from me15:21
slaweqok, so lets move on15:22
slaweq#topic Stable branches15:22
*** openstack changes topic to "Stable branches (Meeting topic: neutron_ci)"15:22
slaweqanything related to the stadium branches for today?15:23
bcafarel*stable nothing either15:23
bcafarelI have a few reviews in my backlog to check but I think others went fine15:23
slaweqafaict it works pretty ok for stable branches recently15:23
slaweqok, so lets move on15:24
slaweq#topic Grafana15:24
*** openstack changes topic to "Grafana (Meeting topic: neutron_ci)"15:24
slaweqhttp://grafana.openstack.org/dashboard/db/neutron-failure-rate15:25
slaweqin overall I don't see anything "special" there - it works "as usual" :)15:26
ralonsoha bit buggy during last weeks15:26
bcafarellooks like we need an update for functional/fullstack? graphs are empty15:26
ralonsohbut nothing special to point out15:26
slaweqbcafarel: yes, I though about it15:26
slaweqwe should remove those 2 jobs from the graph as it was removed from our queues some time ago15:27
bcafarelah yes with the -uwsgi move15:27
slaweqexactly15:27
slaweqand we need to add neutron-ovn-grenade job to the graph15:27
slaweqdo You want to do that?15:27
bcafarelsure! should be smaller than the stable branches one :)15:28
slaweqyes15:28
slaweq:)15:28
slaweqthx a lot15:28
slaweq#action bcafarel to update grafana dashboard for master branch15:28
slaweqanything else regarding grafana?15:29
bcafarelapparently no15:31
slaweqok, so lets move on15:31
slaweq#topic fullstack/functional15:31
*** openstack changes topic to "fullstack/functional (Meeting topic: neutron_ci)"15:31
slaweqI have one issue in fullstack test for today15:31
slaweqhttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_095/756678/5/check/neutron-fullstack-with-uwsgi/095d3c9/testr_results.html15:31
slaweqit happened only once but it seems similar to the other issue which lajoskatona was trying to address recently15:32
slaweqthis time it couldn't associate FIP to port because port was already associated to FIP from same network15:32
slaweqI think that this was simply slow processing of the first request and then it was retried and failed15:33
ralonsohI think that happened before, a race condition between tests, the second one using the first one FIP15:33
slaweqralonsoh: that is not possible in fullstack tests15:33
slaweqbecause each server has got own neutron server15:33
ralonsohyou are right, this is fullstack15:33
lajoskatonayeah I recently learned that from slaweq :-)15:33
slaweq(at least it shouldn't be possible)15:33
ralonsohnot tempest15:34
ralonsohI can review this tomorrow morning15:34
slaweqI just wanted to point to this issue here for lajoskatona :)15:35
slaweqso he can take a look and maybe understand what happened exactly there15:35
slaweqbut tbh I don't think we will be able to do anything with that if that was just slow node15:35
slaweqand that's all regarding fullstack/functional jobs15:37
lajoskatonaslaweq: sure I can check15:37
slaweqin functional most often we have issue with test_agent and it is addressed already by some patches IIRC15:37
slaweqso that should be good15:37
slaweqthx lajoskatona :)15:37
slaweqnext topic then15:37
slaweq#topic Tempest/Scenario15:37
*** openstack changes topic to "Tempest/Scenario (Meeting topic: neutron_ci)"15:37
slaweqhere I have 2 things15:38
slaweq1. I proposed patch https://review.opendev.org/758116 to disable dstat service in ovn multinode jobs15:38
slaweqas it seems that it is causing many failures of those jobs15:38
slaweqthx ralonsoh for +2 :)15:38
ralonsohyw15:39
slaweqlajoskatona: if You can take a look also, would be great :)15:39
bcafarelhmm where did I see recently issue with dstat causing failure?15:39
bcafarelit may have been same ovn issue nvm15:39
slaweqand the second issue is in qos test15:40
slaweqhttps://1bf1346bda7ee67d9a02-58d93d7929b8e264fef7aa823e8ca608.ssl.cf5.rackcdn.com/734889/5/check/neutron-tempest-plugin-scenario-openvswitch-iptables_hybrid/d140a79/testr_results.html15:40
slaweqit is basically ssh failure15:40
slaweqbut this time it seems that even metadata wasn't working15:40
slaweqso maybe there is someone who wants to investigate it more15:40
ralonsohI can take a look15:41
slaweqthere is data about network configuration from the node there15:41
slaweqmaybe it will be useful somehow15:41
slaweqand that reminds me my patch https://review.opendev.org/#/c/725526/15:42
slaweqwhich may help in debugging such issues in the future :)15:42
slaweqfrom other things, neutron-grenade-ovn is failing 100% of times but I will check that as I just moved this job to zuulv3 syntax recently :)15:43
slaweq#action slaweq to check failing neutron-grenade-ovn job15:43
slaweqand that's basically all from me for today15:43
bcafarelmay be some recent change, I saw it was green in victoria backport15:43
slaweqbcafarel: yes, I saw it green in victoria too15:44
slaweqdo You have anyting else regarding CI for today?15:44
slaweqif not, I will give You few minutes back today15:45
bcafarelall good for me15:46
ralonsohsame here15:46
slaweqok15:46
slaweqahh, one more announcement15:46
slaweqnext week I have workshop on OpenInfra during the time of this meeting15:46
slaweqso I will cancel this meeting15:47
slaweqand then the week after next one is PTG so I will cancel CI meeting too15:47
slaweqif there will be anything urgent we can sync on neutron channel15:47
slaweqok for You?15:47
bcafarelsounds good!15:47
ralonsohperfect15:48
lajoskatonaperfect15:48
slaweqthx for attending the meeting15:48
slaweqsee You online :)15:48
slaweqo/15:48
slaweq#endmeeting'15:48
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"15:48
openstackMeeting ended Wed Oct 14 15:48:55 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:48
slaweq#endmeeting15:48
openstackMinutes:        http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-10-14-15.00.html15:48
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-10-14-15.00.txt15:48
lajoskatonao/15:49
openstackLog:            http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-10-14-15.00.log.html15:49
ralonsohbye15:49
*** lajoskatona has left #openstack-meeting-315:49
bcafarelo/15:49
*** e0ne has quit IRC15:49
radezo/15:50
*** slaweq has quit IRC15:55
*** slaweq has joined #openstack-meeting-315:58
*** tosky has quit IRC16:21
*** artom has quit IRC16:37
*** e0ne has joined #openstack-meeting-317:00
*** jamesmcarthur has quit IRC17:02
*** jamesmcarthur has joined #openstack-meeting-317:14
*** jamesmcarthur has quit IRC17:15
*** jamesmcarthur has joined #openstack-meeting-317:15
*** jamesmcarthur has quit IRC17:19
*** artom has joined #openstack-meeting-317:20
*** mlavalle has joined #openstack-meeting-317:26
*** artom has quit IRC17:39
*** ralonsoh has quit IRC17:42
*** e0ne has quit IRC17:50
*** e0ne has joined #openstack-meeting-317:52
*** jamesmcarthur has joined #openstack-meeting-317:59
*** e0ne has quit IRC18:01
*** jamesmcarthur has quit IRC18:05
*** jamesmcarthur has joined #openstack-meeting-318:05
*** artom has joined #openstack-meeting-318:22
*** e0ne has joined #openstack-meeting-318:39
*** belmoreira has quit IRC18:51
*** belmoreira has joined #openstack-meeting-319:02
*** e0ne has quit IRC19:09
*** priteau has quit IRC19:20
*** tosky has joined #openstack-meeting-319:53
*** jamesmcarthur has quit IRC20:32
*** belmoreira has quit IRC20:36
*** jamesmcarthur has joined #openstack-meeting-320:40
*** slaweq has quit IRC21:59
*** raildo has quit IRC22:01
*** slaweq has joined #openstack-meeting-322:05
*** slaweq has quit IRC22:36
*** jamesmcarthur has quit IRC23:11
*** jamesmcarthur has joined #openstack-meeting-323:17
*** tosky has quit IRC23:27
*** mlavalle has quit IRC23:29

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!