Wednesday, 2020-09-30

*** artom has quit IRC00:05
*** yamamoto has quit IRC01:18
*** grami[m] has quit IRC01:22
*** grami[m] has joined #openstack-meeting-301:26
*** yamamoto has joined #openstack-meeting-301:28
*** srwilkers has quit IRC02:14
*** ttx has quit IRC02:14
*** lyarwood has quit IRC02:14
*** srwilkers has joined #openstack-meeting-302:15
*** lyarwood has joined #openstack-meeting-302:20
*** psachin has joined #openstack-meeting-303:31
*** psachin has quit IRC03:32
*** psachin has joined #openstack-meeting-303:33
*** hongbin has quit IRC05:07
*** yamamoto has quit IRC05:22
*** yamamoto has joined #openstack-meeting-305:26
*** lpetrut has joined #openstack-meeting-306:24
*** ralonsoh has joined #openstack-meeting-306:38
*** slaweq has joined #openstack-meeting-307:09
*** ttx has joined #openstack-meeting-307:17
*** tosky has joined #openstack-meeting-307:30
*** yamamoto has quit IRC08:52
*** yamamoto has joined #openstack-meeting-308:52
*** yamamoto has quit IRC08:53
*** yamamoto has joined #openstack-meeting-309:33
*** lkoranda has joined #openstack-meeting-310:40
*** artom has joined #openstack-meeting-310:41
*** haleyb has quit IRC10:47
*** yamamoto has quit IRC10:47
*** yamamoto has joined #openstack-meeting-310:52
*** slaweq_ has joined #openstack-meeting-310:52
*** dansmith has quit IRC10:53
*** slaweq has quit IRC10:55
*** dansmith has joined #openstack-meeting-310:55
*** yamamoto has quit IRC10:59
*** yamamoto has joined #openstack-meeting-311:02
*** e0ne has joined #openstack-meeting-311:09
*** yamamoto has quit IRC11:11
*** haleyb has joined #openstack-meeting-311:34
*** yamamoto has joined #openstack-meeting-311:44
*** yamamoto has quit IRC11:55
*** raildo has joined #openstack-meeting-311:55
*** yamamoto has joined #openstack-meeting-312:27
*** yamamoto has quit IRC12:32
*** ricolin_ has joined #openstack-meeting-312:48
*** ricolin_ has quit IRC13:11
*** lkoranda has quit IRC13:14
*** priteau has joined #openstack-meeting-313:24
*** ricolin_ has joined #openstack-meeting-313:31
*** slaweq_ has quit IRC13:33
*** slaweq has joined #openstack-meeting-313:46
*** haleyb has quit IRC14:01
*** e0ne_ has joined #openstack-meeting-314:02
*** e0ne has quit IRC14:02
*** haleyb has joined #openstack-meeting-314:05
*** lajoskatona has joined #openstack-meeting-314:09
*** ricolin_ has quit IRC14:14
*** yamamoto has joined #openstack-meeting-314:29
*** yamamoto has quit IRC14:34
*** mlavalle has joined #openstack-meeting-314:48
slaweq#startmeeting neutron_ci15:00
openstackMeeting started Wed Sep 30 15:00:04 2020 UTC and is due to finish in 60 minutes.  The chair is slaweq. Information about MeetBot at
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
*** openstack changes topic to " (Meeting topic: neutron_ci)"15:00
openstackThe meeting name has been set to 'neutron_ci'15:00
slaweqok, lets start15:03
slaweqGrafana dashboard:
slaweq#topic Actions from previous meetings15:03
*** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)"15:03
slaweq    ralonsoh to check timing out neutron-ovn-tempest-full-multinode-ovs-master jobs - bug
openstackLaunchpad bug 1886807 in neutron "neutron-ovn-tempest-full-multinode-ovs-master job is failing 100% times" [High,Confirmed] - Assigned to Maciej Jozefczyk (maciejjozefczyk)15:04
ralonsohplease read comment in
*** lpetrut has quit IRC15:04
ralonsohlong story short: I think the error is related to
openstackLaunchpad bug 1863021 in OpenStack Object Storage (swift) "[SRU] eventlet monkey patch results in assert len(_active) == 1 AssertionError" [Undecided,In progress] - Assigned to Chris MacNaughton (chris.macnaughton)15:04
ralonsohand I psuhed, I think this should fix this error15:05
ralonsohbut I don't think this is related to OVN or neutron15:05
slaweqthat's great news, thx ralonsoh :)15:05
slaweqnext one is15:06
slaweqslaweq to report bug with neutron-dhcp-agent and Fedora 3215:06
slaweqI didn't but bug is reported
openstackLaunchpad bug 1896945 in neutron "dnsmasq >= 2.81 not responding to DHCP requests with current q-dhcp configs" [High,In progress] - Assigned to Dan Radez (dradez)15:06
slaweqand radez already works on that15:06
slaweqI think he found that it is "fedora only" issue15:06
lajoskatonayeah this was the one I checke with ubuntu20.10, and on that it worked15:06
slaweqand that is also good news for us, at least from u/s PoV :)15:07
radezo/ sry stepped away and missed the start15:07
slaweqradez: hi15:07
slaweqdon't worry, I was just saying that You are working on this issue with dnsmasq and F3215:07
radezsaw that thx :)15:08
slaweqthank You for taking care of this issue :)15:08
slaweqand with that I think we can move on to the next topic15:08
slaweqwhich is15:08
slaweq#topic Switch to Ubuntu Focal15:08
*** openstack changes topic to "Switch to Ubuntu Focal (Meeting topic: neutron_ci)"15:08
slaweqI updated it today15:09
slaweqwe are basically mostly done for most of the jobs15:09
ralonsohgood work everyone!15:09
slaweqbut we should just check once again e.g. stadium projects if we didn't miss anything15:09
slaweqI hope that next week we will be able to remove that topic from this meeting :)15:11
slaweqok, lets move on15:11
slaweq#topic Stadium projects15:11
*** openstack changes topic to "Stadium projects (Meeting topic: neutron_ci)"15:11
bcafarel for sfc is still in queue :)15:11
slaweqbcafarel: sorry, I missed that somehow15:11
slaweqI will look at it just after this meeting15:12
slaweqbcafarel: (and others) if You have any other patch related to migration to Focal which we missed, please add it to that etherpad15:12
slaweqso it will be easier to find and review it (at least for me) :)15:13
slaweqok, I think we can move on to the next topic15:13
slaweqso stadium projects15:13
slaweqand migration to zuulv315:14
slaweqwe still have just those last 2 jobs to convert:15:14
slaweq    networking-odl:
slaweq    neutron:
*** lpetrut has joined #openstack-meeting-315:14
slaweqfor neutron-ovn-grenade job it seems that it passed now :)15:15
slaweqso please review this patch15:15
lajoskatonaI just check odl logs, but now it seems better15:16
slaweqand lajoskatona, regarding odl patch I see that grenade job is still failing15:16
slaweqis it ready to review or not yet?15:16
lajoskatonahmmm, it failed originally as well, the same true for tempest jobs sadly15:17
lajoskatonaI check the logs in details, and "report" on irc the status and on etherpad15:17
slaweqso, if that is failing same way like old job, and failure isn't related to the job's configuration than I think we should be good to go with it now15:18
slaweqand fix job later15:18
slaweqok, so I will review it also15:18
slaweqok, anything else regarding stadium projects' CI?15:19
slaweqif not, than lets move on15:20
slaweq#topic Stable branches15:20
*** openstack changes topic to "Stable branches (Meeting topic: neutron_ci)"15:20
slaweqfirst of all I think that we need to update our dashboards for "previous" and "older" stable release15:21
bcafarelthat makes me think we should switch the stable dashboards to victoria soon15:21
slaweqevery time I'm first :P15:21
bcafarelI should train on fast typing :)15:22
slaweqactually You are typing faster than me usually :)15:22
slaweqbcafarel: can You take care of that?15:22
slaweqthx a lot15:23
slaweq#action bcafarel to update our grafana dashboards for stable branches15:24
slaweqexcept that, do we have anything else regarding stable branches for today?15:24
slaweqI think that ci for stable branches is pretty ok, isn't it?15:24
bcafarelyes patches got in without too many rechecks15:26
bcafareland as list of opened backports is short, I sent for stable releases15:26
*** lpetrut has quit IRC15:27
slaweqok, so I think we are good with stable branches now15:28
slaweqlets move on to the next topic15:28
slaweq#topic Grafana15:28
*** openstack changes topic to "Grafana (Meeting topic: neutron_ci)"15:28
slaweqgrafana is starting to look better now15:29
slaweqovn jobs and neutron-tempest-plugin jobs are going down finally15:29
slaweqfunctional job is failing pretty often15:29
slaweqbut I didn't really found any specific issues there so far15:30
slaweqanything else You want to add here?15:30
ralonsohno thanks15:31
slaweqok, so lets move on15:32
slaweq#topic Tempest/Scenario15:32
*** openstack changes topic to "Tempest/Scenario (Meeting topic: neutron_ci)"15:32
slaweqrecently, after I opened 3 new bugs:15:32
openstackLaunchpad bug 1897898 in neutron "Scenario test test_multiple_ports_portrange_remote is unstable" [Critical,Confirmed]15:32
openstackLaunchpad bug 1897326 in neutron "scenario test test_floating_ip_update is failing often on Ubuntu 20.04" [Critical,In progress] - Assigned to Slawek Kaplonski (slaweq)15:32
openstackLaunchpad bug 1896735 in neutron "Scenario tests from neutron_tempest_plugin.scenario.test_port_forwardings.PortForwardingTestJSON failing due to ssh failure" [Critical,In progress] - Assigned to Slawek Kaplonski (slaweq)15:32
slaweqfirst 2 are happening after migration to Focal15:33
slaweqat least I didn't saw them before15:33
slaweqand for  I just sent patch which should hopefully fix it15:33
*** belmoreira has joined #openstack-meeting-315:33
slaweqand is happening pretty often also15:33
openstackLaunchpad bug 1896735 in neutron "Scenario tests from neutron_tempest_plugin.scenario.test_port_forwardings.PortForwardingTestJSON failing due to ssh failure" [Critical,In progress] - Assigned to Slawek Kaplonski (slaweq)15:33
slaweqso I will probably mark this test as unstable for now too15:33
bcafarelsounds in line with the other 2 yes15:34
ralonsohlast one you say?15:34
ralonsohwhy is related to
openstackLaunchpad bug 1896735 in neutron "Scenario tests from neutron_tempest_plugin.scenario.test_port_forwardings.PortForwardingTestJSON failing due to ssh failure" [Critical,In progress] - Assigned to Slawek Kaplonski (slaweq)15:35
slaweqsorry, I mixed some links probably15:35
slaweqahh, it is related because is marking this test as unstable due to that bug15:36
ralonsohright, thanks!15:37
slaweqalso, after our recent issues with merging patches to neutron-tempest-plugin repo, I was checking some of the failures and I proposed some small patches15:38
slaweq  should help with some of the Authentication failures on stable branches15:39
slaweqand other 2 should at least add some extra logging of the console log and network config on host in case of failures15:39
slaweqif You will have few minutes, please check those patches15:39
slaweqand that's all from my side regarding tempest/scenario jobs for today15:40
slaweqdo You have anything else?15:40
ralonsohno thanks15:40
bcafarelso cirros 0.5.1 can help? will take a look at patch later15:41
slaweqbecause maciejjozefczyk did patch to cirros to retry failed calls to metadata15:41
slaweqand it is in 0.5.115:41
slaweqso in case if call for public-keys will fail once, it will be retried15:41
slaweqand key should be configured in the guest vm15:42
bcafareloh nice!15:42
slaweqok, so I have one more topic for today15:42
slaweq#topic Periodic15:42
*** openstack changes topic to "Periodic (Meeting topic: neutron_ci)"15:42
slaweqfirst of all thx bcafarel for fixing fedora job :)15:43
slaweqbut now it seems that openstack-tox-py36-with-ovsdbapp-master is failing contantly since about a week15:43
slaweqevery time same 2 tests are failing15:44
slaweqanyone wants to report a bug and check it?15:44
ralonsohI can15:45
slaweqthx ralonsoh15:45
slaweq#action ralonsoh to report a bug and check failing openstack-tox-py36-with-ovsdbapp-master periodic job15:45
slaweqralonsoh: You can find logs in
slaweqthank You15:46
slaweqok, and that was last thing from me for today15:46
slaweqdo You have anything else You want to discuss?15:46
bcafarelnot from me15:46
slaweqso I think we can finish now :)15:47
slaweqthx for attending15:48
*** openstack changes topic to "OpenStack Meetings ||"15:48
openstackMeeting ended Wed Sep 30 15:48:05 2020 UTC.  Information about MeetBot at . (v 0.1.4)15:48
openstackMinutes (text):
*** lajoskatona has left #openstack-meeting-315:48
*** tosky has quit IRC16:19
*** yamamoto has joined #openstack-meeting-316:30
*** psachin has quit IRC16:34
*** yamamoto has quit IRC16:34
*** e0ne_ has quit IRC17:50
*** ralonsoh has quit IRC18:11
*** e0ne has joined #openstack-meeting-318:48
*** e0ne_ has joined #openstack-meeting-318:52
*** e0ne has quit IRC18:53
*** priteau has quit IRC18:56
*** e0ne_ has quit IRC18:58
*** e0ne has joined #openstack-meeting-319:04
*** belmoreira has quit IRC19:05
*** e0ne has quit IRC19:16
*** tosky has joined #openstack-meeting-319:32
*** raildo has quit IRC20:56
*** _erlon_ has joined #openstack-meeting-321:12
*** slaweq has quit IRC21:39
*** slaweq has joined #openstack-meeting-321:42
*** mlavalle has quit IRC21:44
*** yamamoto has joined #openstack-meeting-322:08
*** mlavalle has joined #openstack-meeting-322:08
*** slaweq has quit IRC22:17
*** slaweq has joined #openstack-meeting-322:18
*** slaweq has quit IRC22:24
*** tosky has quit IRC22:54
*** mlavalle has quit IRC23:14

Generated by 2.17.2 by Marius Gedminas - find it at!