| *** artom has quit IRC | 00:05 | |
| *** yamamoto has quit IRC | 01:18 | |
| *** grami[m] has quit IRC | 01:22 | |
| *** grami[m] has joined #openstack-meeting-3 | 01:26 | |
| *** yamamoto has joined #openstack-meeting-3 | 01:28 | |
| *** srwilkers has quit IRC | 02:14 | |
| *** ttx has quit IRC | 02:14 | |
| *** lyarwood has quit IRC | 02:14 | |
| *** srwilkers has joined #openstack-meeting-3 | 02:15 | |
| *** lyarwood has joined #openstack-meeting-3 | 02:20 | |
| *** psachin has joined #openstack-meeting-3 | 03:31 | |
| *** psachin has quit IRC | 03:32 | |
| *** psachin has joined #openstack-meeting-3 | 03:33 | |
| *** hongbin has quit IRC | 05:07 | |
| *** yamamoto has quit IRC | 05:22 | |
| *** yamamoto has joined #openstack-meeting-3 | 05:26 | |
| *** lpetrut has joined #openstack-meeting-3 | 06:24 | |
| *** ralonsoh has joined #openstack-meeting-3 | 06:38 | |
| *** slaweq has joined #openstack-meeting-3 | 07:09 | |
| *** ttx has joined #openstack-meeting-3 | 07:17 | |
| *** tosky has joined #openstack-meeting-3 | 07:30 | |
| *** yamamoto has quit IRC | 08:52 | |
| *** yamamoto has joined #openstack-meeting-3 | 08:52 | |
| *** yamamoto has quit IRC | 08:53 | |
| *** yamamoto has joined #openstack-meeting-3 | 09:33 | |
| *** lkoranda has joined #openstack-meeting-3 | 10:40 | |
| *** artom has joined #openstack-meeting-3 | 10:41 | |
| *** haleyb has quit IRC | 10:47 | |
| *** yamamoto has quit IRC | 10:47 | |
| *** yamamoto has joined #openstack-meeting-3 | 10:52 | |
| *** slaweq_ has joined #openstack-meeting-3 | 10:52 | |
| *** dansmith has quit IRC | 10:53 | |
| *** slaweq has quit IRC | 10:55 | |
| *** dansmith has joined #openstack-meeting-3 | 10:55 | |
| *** yamamoto has quit IRC | 10:59 | |
| *** yamamoto has joined #openstack-meeting-3 | 11:02 | |
| *** e0ne has joined #openstack-meeting-3 | 11:09 | |
| *** yamamoto has quit IRC | 11:11 | |
| *** haleyb has joined #openstack-meeting-3 | 11:34 | |
| *** yamamoto has joined #openstack-meeting-3 | 11:44 | |
| *** yamamoto has quit IRC | 11:55 | |
| *** raildo has joined #openstack-meeting-3 | 11:55 | |
| *** yamamoto has joined #openstack-meeting-3 | 12:27 | |
| *** yamamoto has quit IRC | 12:32 | |
| *** ricolin_ has joined #openstack-meeting-3 | 12:48 | |
| *** ricolin_ has quit IRC | 13:11 | |
| *** lkoranda has quit IRC | 13:14 | |
| *** priteau has joined #openstack-meeting-3 | 13:24 | |
| *** ricolin_ has joined #openstack-meeting-3 | 13:31 | |
| *** slaweq_ has quit IRC | 13:33 | |
| *** slaweq has joined #openstack-meeting-3 | 13:46 | |
| *** haleyb has quit IRC | 14:01 | |
| *** e0ne_ has joined #openstack-meeting-3 | 14:02 | |
| *** e0ne has quit IRC | 14:02 | |
| *** haleyb has joined #openstack-meeting-3 | 14:05 | |
| *** lajoskatona has joined #openstack-meeting-3 | 14:09 | |
| *** ricolin_ has quit IRC | 14:14 | |
| *** yamamoto has joined #openstack-meeting-3 | 14:29 | |
| *** yamamoto has quit IRC | 14:34 | |
| *** mlavalle has joined #openstack-meeting-3 | 14:48 | |
| slaweq | #startmeeting neutron_ci | 15:00 |
|---|---|---|
| openstack | Meeting started Wed Sep 30 15:00:04 2020 UTC and is due to finish in 60 minutes. The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot. | 15:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 15:00 |
| *** openstack changes topic to " (Meeting topic: neutron_ci)" | 15:00 | |
| openstack | The meeting name has been set to 'neutron_ci' | 15:00 |
| ralonsoh | hi | 15:00 |
| lajoskatona | Hi | 15:01 |
| bcafarel | o/ | 15:01 |
| slaweq | ok, lets start | 15:03 |
| slaweq | Grafana dashboard: http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 15:03 |
| slaweq | #topic Actions from previous meetings | 15:03 |
| *** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)" | 15:03 | |
| slaweq | ralonsoh to check timing out neutron-ovn-tempest-full-multinode-ovs-master jobs - bug https://bugs.launchpad.net/neutron/+bug/1886807 | 15:04 |
| openstack | Launchpad bug 1886807 in neutron "neutron-ovn-tempest-full-multinode-ovs-master job is failing 100% times" [High,Confirmed] - Assigned to Maciej Jozefczyk (maciejjozefczyk) | 15:04 |
| ralonsoh | please read comment in https://bugs.launchpad.net/neutron/+bug/1886807/comments/3 | 15:04 |
| *** lpetrut has quit IRC | 15:04 | |
| ralonsoh | long story short: I think the error is related to https://bugs.launchpad.net/nova/+bug/1863021 | 15:04 |
| openstack | Launchpad bug 1863021 in OpenStack Object Storage (swift) "[SRU] eventlet monkey patch results in assert len(_active) == 1 AssertionError" [Undecided,In progress] - Assigned to Chris MacNaughton (chris.macnaughton) | 15:04 |
| ralonsoh | and I psuhed https://review.opendev.org/#/c/755256/, I think this should fix this error | 15:05 |
| ralonsoh | but I don't think this is related to OVN or neutron | 15:05 |
| slaweq | that's great news, thx ralonsoh :) | 15:05 |
| ralonsoh | yw | 15:05 |
| slaweq | ok | 15:05 |
| slaweq | next one is | 15:06 |
| slaweq | slaweq to report bug with neutron-dhcp-agent and Fedora 32 | 15:06 |
| slaweq | I didn't but bug is reported https://bugs.launchpad.net/neutron/+bug/1896945 | 15:06 |
| openstack | Launchpad bug 1896945 in neutron "dnsmasq >= 2.81 not responding to DHCP requests with current q-dhcp configs" [High,In progress] - Assigned to Dan Radez (dradez) | 15:06 |
| slaweq | and radez already works on that | 15:06 |
| slaweq | I think he found that it is "fedora only" issue | 15:06 |
| lajoskatona | yeah this was the one I checke with ubuntu20.10, and on that it worked | 15:06 |
| slaweq | and that is also good news for us, at least from u/s PoV :) | 15:07 |
| radez | o/ sry stepped away and missed the start | 15:07 |
| slaweq | radez: hi | 15:07 |
| slaweq | don't worry, I was just saying that You are working on this issue with dnsmasq and F32 | 15:07 |
| radez | saw that thx :) | 15:08 |
| slaweq | thank You for taking care of this issue :) | 15:08 |
| slaweq | and with that I think we can move on to the next topic | 15:08 |
| slaweq | which is | 15:08 |
| slaweq | #topic Switch to Ubuntu Focal | 15:08 |
| *** openstack changes topic to "Switch to Ubuntu Focal (Meeting topic: neutron_ci)" | 15:08 | |
| slaweq | Etherpad: https://etherpad.opendev.org/p/neutron-victoria-switch_to_focal | 15:09 |
| slaweq | I updated it today | 15:09 |
| slaweq | we are basically mostly done for most of the jobs | 15:09 |
| slaweq | (finally) | 15:09 |
| ralonsoh | good work everyone! | 15:09 |
| slaweq | but we should just check once again e.g. stadium projects if we didn't miss anything | 15:09 |
| slaweq | I hope that next week we will be able to remove that topic from this meeting :) | 15:11 |
| slaweq | ok, lets move on | 15:11 |
| slaweq | #topic Stadium projects | 15:11 |
| *** openstack changes topic to "Stadium projects (Meeting topic: neutron_ci)" | 15:11 | |
| bcafarel | https://review.opendev.org/#/c/754068/ for sfc is still in queue :) | 15:11 |
| slaweq | bcafarel: sorry, I missed that somehow | 15:11 |
| slaweq | I will look at it just after this meeting | 15:12 |
| slaweq | bcafarel: (and others) if You have any other patch related to migration to Focal which we missed, please add it to that etherpad | 15:12 |
| slaweq | so it will be easier to find and review it (at least for me) :) | 15:13 |
| slaweq | ok, I think we can move on to the next topic | 15:13 |
| slaweq | so stadium projects | 15:13 |
| slaweq | and migration to zuulv3 | 15:14 |
| slaweq | Etherpad: https://etherpad.openstack.org/p/neutron-train-zuulv3-py27drop | 15:14 |
| slaweq | we still have just those last 2 jobs to convert: | 15:14 |
| slaweq | networking-odl: https://review.opendev.org/#/c/725647/ | 15:14 |
| slaweq | neutron: https://review.opendev.org/#/c/729591/ | 15:14 |
| *** lpetrut has joined #openstack-meeting-3 | 15:14 | |
| slaweq | for neutron-ovn-grenade job it seems that it passed now :) | 15:15 |
| ralonsoh | yes! | 15:15 |
| slaweq | so please review this patch | 15:15 |
| bcafarel | nice! | 15:15 |
| lajoskatona | I just check odl logs, but now it seems better | 15:16 |
| slaweq | and lajoskatona, regarding odl patch I see that grenade job is still failing | 15:16 |
| slaweq | is it ready to review or not yet? | 15:16 |
| lajoskatona | hmmm, it failed originally as well, the same true for tempest jobs sadly | 15:17 |
| lajoskatona | I check the logs in details, and "report" on irc the status and on etherpad | 15:17 |
| slaweq | so, if that is failing same way like old job, and failure isn't related to the job's configuration than I think we should be good to go with it now | 15:18 |
| slaweq | and fix job later | 15:18 |
| lajoskatona | yeah | 15:18 |
| slaweq | ok, so I will review it also | 15:18 |
| slaweq | ok, anything else regarding stadium projects' CI? | 15:19 |
| slaweq | if not, than lets move on | 15:20 |
| slaweq | #topic Stable branches | 15:20 |
| *** openstack changes topic to "Stable branches (Meeting topic: neutron_ci)" | 15:20 | |
| slaweq | first of all I think that we need to update our dashboards for "previous" and "older" stable release | 15:21 |
| bcafarel | that makes me think we should switch the stable dashboards to victoria soon | 15:21 |
| slaweq | :) | 15:21 |
| bcafarel | :) | 15:21 |
| slaweq | :D | 15:21 |
| slaweq | every time I'm first :P | 15:21 |
| bcafarel | I should train on fast typing :) | 15:22 |
| slaweq | actually You are typing faster than me usually :) | 15:22 |
| slaweq | bcafarel: can You take care of that? | 15:22 |
| bcafarel | sure | 15:23 |
| slaweq | thx a lot | 15:23 |
| slaweq | #action bcafarel to update our grafana dashboards for stable branches | 15:24 |
| slaweq | except that, do we have anything else regarding stable branches for today? | 15:24 |
| slaweq | I think that ci for stable branches is pretty ok, isn't it? | 15:24 |
| bcafarel | yes patches got in without too many rechecks | 15:26 |
| bcafarel | and as list of opened backports is short, I sent https://review.opendev.org/#/c/755203/ for stable releases | 15:26 |
| slaweq | thx | 15:26 |
| *** lpetrut has quit IRC | 15:27 | |
| slaweq | ok, so I think we are good with stable branches now | 15:28 |
| slaweq | lets move on to the next topic | 15:28 |
| slaweq | #topic Grafana | 15:28 |
| *** openstack changes topic to "Grafana (Meeting topic: neutron_ci)" | 15:28 | |
| slaweq | #link http://grafana.openstack.org/dashboard/db/neutron-failure-rate | 15:28 |
| slaweq | grafana is starting to look better now | 15:29 |
| slaweq | ovn jobs and neutron-tempest-plugin jobs are going down finally | 15:29 |
| slaweq | functional job is failing pretty often | 15:29 |
| slaweq | but I didn't really found any specific issues there so far | 15:30 |
| slaweq | anything else You want to add here? | 15:30 |
| ralonsoh | no thanks | 15:31 |
| slaweq | ok, so lets move on | 15:32 |
| slaweq | #topic Tempest/Scenario | 15:32 |
| *** openstack changes topic to "Tempest/Scenario (Meeting topic: neutron_ci)" | 15:32 | |
| slaweq | recently, after I opened 3 new bugs: | 15:32 |
| slaweq | https://bugs.launchpad.net/neutron/+bug/1897898 | 15:32 |
| openstack | Launchpad bug 1897898 in neutron "Scenario test test_multiple_ports_portrange_remote is unstable" [Critical,Confirmed] | 15:32 |
| slaweq | https://bugs.launchpad.net/neutron/+bug/1897326 | 15:32 |
| openstack | Launchpad bug 1897326 in neutron "scenario test test_floating_ip_update is failing often on Ubuntu 20.04" [Critical,In progress] - Assigned to Slawek Kaplonski (slaweq) | 15:32 |
| slaweq | https://bugs.launchpad.net/neutron/+bug/1896735 | 15:32 |
| openstack | Launchpad bug 1896735 in neutron "Scenario tests from neutron_tempest_plugin.scenario.test_port_forwardings.PortForwardingTestJSON failing due to ssh failure" [Critical,In progress] - Assigned to Slawek Kaplonski (slaweq) | 15:32 |
| slaweq | first 2 are happening after migration to Focal | 15:33 |
| slaweq | at least I didn't saw them before | 15:33 |
| slaweq | and for https://bugs.launchpad.net/neutron/+bug/1897326 I just sent patch https://review.opendev.org/755314 which should hopefully fix it | 15:33 |
| *** belmoreira has joined #openstack-meeting-3 | 15:33 | |
| slaweq | and https://bugs.launchpad.net/neutron/+bug/1896735 is happening pretty often also | 15:33 |
| openstack | Launchpad bug 1896735 in neutron "Scenario tests from neutron_tempest_plugin.scenario.test_port_forwardings.PortForwardingTestJSON failing due to ssh failure" [Critical,In progress] - Assigned to Slawek Kaplonski (slaweq) | 15:33 |
| slaweq | so I will probably mark this test as unstable for now too | 15:33 |
| slaweq | wdyt? | 15:34 |
| bcafarel | sounds in line with the other 2 yes | 15:34 |
| ralonsoh | last one you say? | 15:34 |
| ralonsoh | why https://bugs.launchpad.net/neutron/+bug/1896735 is related to https://review.opendev.org/#/c/748367/? | 15:35 |
| openstack | Launchpad bug 1896735 in neutron "Scenario tests from neutron_tempest_plugin.scenario.test_port_forwardings.PortForwardingTestJSON failing due to ssh failure" [Critical,In progress] - Assigned to Slawek Kaplonski (slaweq) | 15:35 |
| slaweq | sorry, I mixed some links probably | 15:35 |
| ralonsoh | np | 15:36 |
| slaweq | ahh, it is related because is marking this test as unstable due to that bug | 15:36 |
| ralonsoh | right, thanks! | 15:37 |
| slaweq | also, after our recent issues with merging patches to neutron-tempest-plugin repo, I was checking some of the failures and I proposed some small patches | 15:38 |
| slaweq | https://review.opendev.org/#/c/725526/ | 15:38 |
| slaweq | https://review.opendev.org/#/c/755112/ | 15:38 |
| slaweq | https://review.opendev.org/#/c/755122/ | 15:38 |
| slaweq | https://review.opendev.org/#/c/755112/ should help with some of the Authentication failures on stable branches | 15:39 |
| slaweq | and other 2 should at least add some extra logging of the console log and network config on host in case of failures | 15:39 |
| slaweq | if You will have few minutes, please check those patches | 15:39 |
| slaweq | and that's all from my side regarding tempest/scenario jobs for today | 15:40 |
| slaweq | do You have anything else? | 15:40 |
| ralonsoh | no thanks | 15:40 |
| bcafarel | so cirros 0.5.1 can help? will take a look at patch later | 15:41 |
| slaweq | yes | 15:41 |
| slaweq | because maciejjozefczyk did patch to cirros to retry failed calls to metadata | 15:41 |
| slaweq | and it is in 0.5.1 | 15:41 |
| slaweq | so in case if call for public-keys will fail once, it will be retried | 15:41 |
| slaweq | and key should be configured in the guest vm | 15:42 |
| bcafarel | oh nice! | 15:42 |
| slaweq | ok, so I have one more topic for today | 15:42 |
| slaweq | #topic Periodic | 15:42 |
| *** openstack changes topic to "Periodic (Meeting topic: neutron_ci)" | 15:42 | |
| slaweq | first of all thx bcafarel for fixing fedora job :) | 15:43 |
| slaweq | but now it seems that openstack-tox-py36-with-ovsdbapp-master is failing contantly since about a week | 15:43 |
| slaweq | every time same 2 tests are failing | 15:44 |
| slaweq | anyone wants to report a bug and check it? | 15:44 |
| ralonsoh | I can | 15:45 |
| slaweq | thx ralonsoh | 15:45 |
| slaweq | #action ralonsoh to report a bug and check failing openstack-tox-py36-with-ovsdbapp-master periodic job | 15:45 |
| slaweq | ralonsoh: You can find logs in https://zuul.openstack.org/buildsets?project=openstack%2Fneutron&pipeline=periodic&branch=master | 15:45 |
| ralonsoh | thanks | 15:45 |
| slaweq | thank You | 15:46 |
| slaweq | ok, and that was last thing from me for today | 15:46 |
| slaweq | do You have anything else You want to discuss? | 15:46 |
| bcafarel | not from me | 15:46 |
| slaweq | so I think we can finish now :) | 15:47 |
| slaweq | thx for attending | 15:48 |
| slaweq | o/ | 15:48 |
| slaweq | #endmeeting | 15:48 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 15:48 | |
| lajoskatona | o/ | 15:48 |
| openstack | Meeting ended Wed Sep 30 15:48:05 2020 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 15:48 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-09-30-15.00.html | 15:48 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-09-30-15.00.txt | 15:48 |
| *** lajoskatona has left #openstack-meeting-3 | 15:48 | |
| radez | o/ | 15:48 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-09-30-15.00.log.html | 15:48 |
| ralonsoh | bye | 15:48 |
| bcafarel | o/ | 15:48 |
| *** tosky has quit IRC | 16:19 | |
| *** yamamoto has joined #openstack-meeting-3 | 16:30 | |
| *** psachin has quit IRC | 16:34 | |
| *** yamamoto has quit IRC | 16:34 | |
| *** e0ne_ has quit IRC | 17:50 | |
| *** ralonsoh has quit IRC | 18:11 | |
| *** e0ne has joined #openstack-meeting-3 | 18:48 | |
| *** e0ne_ has joined #openstack-meeting-3 | 18:52 | |
| *** e0ne has quit IRC | 18:53 | |
| *** priteau has quit IRC | 18:56 | |
| *** e0ne_ has quit IRC | 18:58 | |
| *** e0ne has joined #openstack-meeting-3 | 19:04 | |
| *** belmoreira has quit IRC | 19:05 | |
| *** e0ne has quit IRC | 19:16 | |
| *** tosky has joined #openstack-meeting-3 | 19:32 | |
| *** raildo has quit IRC | 20:56 | |
| *** _erlon_ has joined #openstack-meeting-3 | 21:12 | |
| *** slaweq has quit IRC | 21:39 | |
| *** slaweq has joined #openstack-meeting-3 | 21:42 | |
| *** mlavalle has quit IRC | 21:44 | |
| *** yamamoto has joined #openstack-meeting-3 | 22:08 | |
| *** mlavalle has joined #openstack-meeting-3 | 22:08 | |
| *** slaweq has quit IRC | 22:17 | |
| *** slaweq has joined #openstack-meeting-3 | 22:18 | |
| *** slaweq has quit IRC | 22:24 | |
| *** tosky has quit IRC | 22:54 | |
| *** mlavalle has quit IRC | 23:14 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!