Tuesday, 2020-01-14

*** mattw4 has quit IRC00:05
*** vishalmanchanda has joined #openstack-meeting00:06
*** ianychoi_ has joined #openstack-meeting00:09
*** ianychoi has quit IRC00:11
*** macz has quit IRC00:17
*** brault has quit IRC00:33
*** brault has joined #openstack-meeting00:33
*** igordc has joined #openstack-meeting00:51
*** jamesmcarthur has joined #openstack-meeting00:54
*** jamesmcarthur has quit IRC00:57
*** jamesmcarthur has joined #openstack-meeting00:59
*** jamesmcarthur has quit IRC01:04
*** jamesmcarthur has joined #openstack-meeting01:06
*** Liang__ has joined #openstack-meeting01:10
*** brinzhang has joined #openstack-meeting01:13
*** jamesmcarthur has quit IRC01:14
*** brinzhang_ has quit IRC01:17
*** nicolasbock has quit IRC01:18
*** gyee has quit IRC01:34
*** igordc has quit IRC01:45
*** jamesmcarthur has joined #openstack-meeting01:45
*** masahito has joined #openstack-meeting01:51
*** jamesmcarthur has quit IRC01:56
*** dviroel has quit IRC01:57
*** ykatabam has quit IRC02:14
*** jamesmcarthur has joined #openstack-meeting02:18
*** mhen has quit IRC02:19
*** Liang__ is now known as LiangFang02:26
*** jamesmcarthur has quit IRC02:27
*** jamesmcarthur has joined #openstack-meeting02:30
*** LiangFang has quit IRC02:32
*** Liang__ has joined #openstack-meeting02:32
*** tetsuro has joined #openstack-meeting02:33
*** Liang__ has quit IRC02:34
*** Liang__ has joined #openstack-meeting02:34
*** davee_ has quit IRC02:38
*** davee__ has quit IRC02:38
*** epoojad1 has quit IRC02:39
*** maohongbo1 has joined #openstack-meeting02:43
*** maohongbo has quit IRC02:44
*** maohongbo1 is now known as maohongbo02:44
*** davee_ has joined #openstack-meeting02:55
*** davee__ has joined #openstack-meeting02:55
*** t5s has joined #openstack-meeting03:00
*** ykatabam has joined #openstack-meeting03:02
*** ykatabam has quit IRC03:03
*** ykatabam has joined #openstack-meeting03:04
*** maohongbo1 has joined #openstack-meeting03:24
*** maohongbo has quit IRC03:25
*** maohongbo1 is now known as maohongbo03:25
*** psachin has joined #openstack-meeting03:35
*** masahito has quit IRC03:47
*** hongbin has joined #openstack-meeting03:50
*** macz has joined #openstack-meeting03:56
*** tpatil has joined #openstack-meeting03:56
*** brault has quit IRC03:58
tpatil#startmeeting masakari04:00
openstackMeeting started Tue Jan 14 04:00:29 2020 UTC and is due to finish in 60 minutes.  The chair is tpatil. Information about MeetBot at http://wiki.debian.org/MeetBot.04:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.04:00
*** openstack changes topic to " (Meeting topic: masakari)"04:00
openstackThe meeting name has been set to 'masakari'04:00
*** shilpasd has joined #openstack-meeting04:00
tpatilHi All04:00
shilpasdHi Tushar San04:01
tpatilThis is our first meeting in 2020, Happy New Year to you all.04:01
tpatilshilpasd: Hi04:01
shilpasdThank you, wish you happy new year04:02
tpatil#topic Critical Bugs04:02
*** openstack changes topic to "Critical Bugs (Meeting topic: masakari)"04:02
tpatilThere are no critical bugs reported, so you can discuss on any reported bug here.04:04
tpatilRecently there are many new bugs reported recently, need to confirm these bugs and set the priority04:05
tpatil#action: Confirm newly reported bugs and set the priority : tpatil04:05
*** tashiromt has joined #openstack-meeting04:06
*** shilpasd has quit IRC04:07
*** kiyofujin has joined #openstack-meeting04:07
*** shilpasd has joined #openstack-meeting04:09
shilpasdtpatil: Sorry got disconnected04:09
*** psachin has quit IRC04:09
tpatilshilpasd: NP, do you want to discuss on any bug here or else we can move to the next topic04:10
shilpasdyes, we can move to next topic04:10
tpatil#topic: Ussuri work items04:11
*** openstack changes topic to ": Ussuri work items (Meeting topic: masakari)"04:11
tpatil#link : https://etherpad.openstack.org/p/masakari-u-workitems04:12
tpatilI have created a new etherpad with a single work item for now.04:12
tpatilPlease add your work items in this etherpad04:12
shilpasdtpatil: sure, will update the same04:12
*** maohongbo has quit IRC04:13
tpatilshilpasd: Do you have any updates on the Ussuri work items?04:14
*** maohongbo has joined #openstack-meeting04:14
shilpasdtpatil: we are working on spec and implementation of mentioned work items04:15
shilpasdi.e. https://blueprints.launchpad.net/masakari/+spec/evacuate-non-recovery-instances-in-shutoff-status-at-host-failure-except-specified-tenants04:15
tpatilshilpasd: OK. If specs are ready you can upload it for review04:17
shilpasdtpatil: sure04:18
shilpasdwill upload the same04:18
tpatilshilpasd: Can you please check some of the newly reported bugs? If it's reproducible, set the important to "Confirmed".04:20
tpatil* importance04:20
shilpasdtpatil: ok, observed that there are 5 newly reported bugs https://bugs.launchpad.net/masakari/+bugs?orderby=-id&start=004:22
shilpasdwill go through them and update you separately today04:22
*** jhesketh has quit IRC04:23
tpatilshilpasd: Thanks04:23
*** jhesketh has joined #openstack-meeting04:24
*** ykatabam has quit IRC04:25
tpatil#topic: AOB04:25
*** openstack changes topic to ": AOB (Meeting topic: masakari)"04:25
*** ykatabam has joined #openstack-meeting04:25
*** jamesmcarthur has quit IRC04:25
*** jamesmcarthur has joined #openstack-meeting04:27
tpatilI don't have anything specific for discussion04:28
tpatilshilpasd: Do you have any topic for discussion? if not, let's end this meeting here04:29
shilpasdtpatil: we can end this meeting04:29
tpatilOK, Thank you all04:29
tpatil#endmeeting04:30
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"04:30
openstackMeeting ended Tue Jan 14 04:30:02 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)04:30
openstackMinutes:        http://eavesdrop.openstack.org/meetings/masakari/2020/masakari.2020-01-14-04.00.html04:30
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/masakari/2020/masakari.2020-01-14-04.00.txt04:30
openstackLog:            http://eavesdrop.openstack.org/meetings/masakari/2020/masakari.2020-01-14-04.00.log.html04:30
*** jamesmcarthur has quit IRC04:32
*** tpatil has quit IRC04:33
*** ykatabam has quit IRC04:53
*** ykatabam has joined #openstack-meeting04:53
*** jamesmcarthur has joined #openstack-meeting04:56
*** dmacpher has quit IRC04:57
*** dmacpher has joined #openstack-meeting04:57
*** jamesmcarthur has quit IRC05:03
*** hongbin has quit IRC05:05
*** macz has quit IRC05:06
*** macz has joined #openstack-meeting05:07
*** hongbin has joined #openstack-meeting05:14
*** hongbin has quit IRC05:19
*** kiyofujin has quit IRC05:46
*** ociuhandu has joined #openstack-meeting05:56
*** jamesmcarthur has joined #openstack-meeting05:59
*** ociuhandu has quit IRC06:00
*** jamesmcarthur has quit IRC06:04
*** masahito has joined #openstack-meeting06:05
*** macz has quit IRC06:06
*** masahito has quit IRC06:06
*** masahito has joined #openstack-meeting06:06
*** ykatabam has quit IRC06:11
*** ykatabam has joined #openstack-meeting06:15
*** pcaruana has quit IRC06:17
*** jamesmcarthur has joined #openstack-meeting06:38
*** anastzhyr has joined #openstack-meeting06:38
*** hochanlee has joined #openstack-meeting06:41
*** jamesmcarthur has quit IRC06:43
*** e0ne has joined #openstack-meeting06:43
*** maohongbo1 has joined #openstack-meeting06:52
*** tetsuro has quit IRC06:53
*** maohongbo has quit IRC06:54
*** maohongbo1 is now known as maohongbo06:54
*** tetsuro has joined #openstack-meeting06:54
*** tashiromt has quit IRC07:00
*** ralonsoh has joined #openstack-meeting07:12
*** jamesmcarthur has joined #openstack-meeting07:15
*** jamesmcarthur has quit IRC07:20
*** mhen has joined #openstack-meeting07:38
*** tesseract has joined #openstack-meeting07:41
*** maohongbo1 has joined #openstack-meeting07:50
*** jamesmcarthur has joined #openstack-meeting07:50
*** joxyuki has joined #openstack-meeting07:51
*** maohongbo has quit IRC07:51
*** maohongbo1 is now known as maohongbo07:51
*** ykatabam has quit IRC07:51
*** ociuhandu has joined #openstack-meeting07:52
*** rcernin has quit IRC07:52
*** jamesmcarthur has quit IRC07:55
*** ociuhandu has joined #openstack-meeting07:55
*** ricolin has quit IRC07:55
*** masahito has quit IRC08:00
*** joxyuki has left #openstack-meeting08:01
*** slaweq has joined #openstack-meeting08:02
*** takahashi-tsc has joined #openstack-meeting08:06
*** ircuser-1 has joined #openstack-meeting08:07
*** zbr|rover has quit IRC08:14
*** zbr has joined #openstack-meeting08:15
*** yunyoung has joined #openstack-meeting08:15
*** nitinuikey has joined #openstack-meeting08:15
*** jamesmcarthur has joined #openstack-meeting08:15
*** yunyoung has left #openstack-meeting08:17
*** maohongbo1 has joined #openstack-meeting08:18
*** maohongbo has quit IRC08:19
*** maohongbo1 is now known as maohongbo08:19
*** jiaopengju has quit IRC08:20
*** jiaopengju has joined #openstack-meeting08:20
*** jamesmcarthur has quit IRC08:20
*** yunyoung has joined #openstack-meeting08:20
*** yunyoung has left #openstack-meeting08:21
*** yunyoung_cho has joined #openstack-meeting08:26
*** Liang__ is now known as LiangFang08:42
*** nitinuikey has quit IRC08:45
*** maohongbo1 has joined #openstack-meeting08:45
*** maohongbo has quit IRC08:47
*** maohongbo1 is now known as maohongbo08:47
*** dmellado has quit IRC08:55
*** dmellado has joined #openstack-meeting08:56
*** pcaruana has joined #openstack-meeting08:56
*** maohongbo1 has joined #openstack-meeting08:59
*** maohongbo has quit IRC09:01
*** maohongbo1 is now known as maohongbo09:01
*** rpittau|afk is now known as rpittau09:16
*** maohongbo1 has joined #openstack-meeting09:19
*** maohongbo has quit IRC09:19
*** maohongbo1 is now known as maohongbo09:19
*** anastzhyr has quit IRC09:34
*** hochanlee has quit IRC09:35
*** ykatabam has joined #openstack-meeting09:45
*** yunyoung_cho has quit IRC09:48
*** LiangFang has quit IRC09:51
*** ociuhandu has quit IRC09:57
*** ociuhandu has joined #openstack-meeting10:02
*** e0ne has quit IRC10:02
*** takahashi-tsc has quit IRC10:02
*** e0ne has joined #openstack-meeting10:02
*** jamesmcarthur has joined #openstack-meeting10:17
*** ykatabam has quit IRC10:17
*** jamesmcarthur has quit IRC10:22
*** ociuhandu has quit IRC10:22
*** pcaruana has quit IRC10:23
*** ociuhandu has joined #openstack-meeting10:35
*** pcaruana has joined #openstack-meeting11:02
*** shilpasd has quit IRC11:05
*** ykatabam has joined #openstack-meeting11:08
*** ykatabam has quit IRC11:08
*** ykatabam has joined #openstack-meeting11:09
*** rpittau is now known as rpittau|bbl11:11
*** Lucas_Gray has joined #openstack-meeting11:12
*** ociuhandu has quit IRC11:13
*** dviroel has joined #openstack-meeting11:16
*** masahito has joined #openstack-meeting11:16
*** ociuhandu has joined #openstack-meeting11:21
*** bbowen has quit IRC11:39
*** maohongbo has quit IRC11:48
*** ociuhandu has quit IRC12:03
*** diablo_rojo has joined #openstack-meeting12:07
*** Lucas_Gray has quit IRC12:23
*** Lucas_Gray has joined #openstack-meeting12:25
*** Luzi has joined #openstack-meeting12:26
*** rfolco has joined #openstack-meeting12:28
*** t5s has quit IRC12:38
*** ociuhandu has joined #openstack-meeting12:39
*** ociuhandu has quit IRC12:43
*** e0ne has quit IRC12:45
*** bbowen has joined #openstack-meeting12:54
*** ociuhandu has joined #openstack-meeting13:03
*** Lucas_Gray has quit IRC13:11
*** jamesmcarthur has joined #openstack-meeting13:16
*** rpittau|bbl is now known as rpittau13:26
*** masahito has quit IRC13:29
*** masahito has joined #openstack-meeting13:31
*** jamesmcarthur has quit IRC13:33
*** masahito has quit IRC13:35
*** masahito has joined #openstack-meeting13:36
*** masahito has quit IRC13:37
*** davidsha has joined #openstack-meeting13:42
*** masahito has joined #openstack-meeting13:44
*** masahito has quit IRC13:45
*** liuyulong has joined #openstack-meeting13:53
*** enriquetaso has joined #openstack-meeting13:54
slaweq#startmeeting networking14:00
openstackMeeting started Tue Jan 14 14:00:18 2020 UTC and is due to finish in 60 minutes.  The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot.14:00
slaweqhi14:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:00
*** openstack changes topic to " (Meeting topic: networking)"14:00
openstackThe meeting name has been set to 'networking'14:00
njohnstono/14:00
bcafarel\o14:00
davidshao/14:00
amotokihi14:01
*** mlavalle has joined #openstack-meeting14:01
mlavalleo/14:01
rubasovo/14:01
*** e0ne has joined #openstack-meeting14:02
*** lajoskatona has joined #openstack-meeting14:02
slaweq#topic Announcements14:03
*** openstack changes topic to "Announcements (Meeting topic: networking)"14:03
lajoskatonao/14:03
slaweqFirst announcement is good news actually14:03
*** ociuhandu has quit IRC14:03
slaweqWe found new maintainer for neutron-vpnaas yedongcan stepped up to help maintaining it14:03
mlavalleyayy14:03
*** ociuhandu has joined #openstack-meeting14:05
slaweqso we are still looking only for maintainers for neutron-fwaas: http://lists.openstack.org/pipermail/openstack-discuss/2019-November/010929.html14:05
slaweqwhich is somehow connected to my last announcement:14:05
slaweqWe are getting close to Ussuri-2, it will be in the week of February 10: https://releases.openstack.org/ussuri/schedule.html14:05
slaweqso if we will not have anyone interested in maintaining fwaas before Ussuri-2, we will mark this project as deprecated14:06
slaweqthat's what we discussed in Shangahi14:06
mlavalleyeah, maybe time to send a warning to the ML again14:06
bcafarelwe'll see if the "last call" mail will trigger a reaction14:07
slaweqI actually already sent such message last week14:07
mlavalleYeah, include "LAST CALL" in the subject14:07
slaweqbut I will sent one or two more before Ussuri-214:07
slaweqmlavalle: sure, I will do that14:07
amotokiyeah. in addition, "deprecation" notice in Ussuri release may bring another chance someone notices it... (though deprecation is not a great thing)14:07
slaweqamotoki: yes, I agree, that will be "very last call" in fact :)14:08
slaweqand that's all announcements from me14:09
slaweqanyone has got anything else to share with the team?14:09
ralonsohhi14:10
bcafarelon stable branches if you had recent failures this should be fixed now with http://lists.openstack.org/pipermail/openstack-discuss/2020-January/011970.html14:12
bcafarelfeel free to send rechecks :) (even if that adds to slaweq's stats)14:12
slaweqbcafarel: You read my post, thx :)14:12
bcafarel:)14:13
slaweqand thx for sharing info about this CI issue14:13
slaweqactually it's not only for stable branches, for master it should works also if You recheck now14:13
slaweqok, next topic than14:15
slaweq#topic Blueprints14:15
*** openstack changes topic to "Blueprints (Meeting topic: networking)"14:15
slaweqBlueprints for Ussuri-2: https://launchpad.net/neutron/+milestone/ussuri-214:15
slaweqI updated status of some of them today14:15
slaweqanyone has got any updates about BPs?14:15
*** eharney has joined #openstack-meeting14:16
njohnstonI think stateless security groups is coming along well, not that long before I can imagine it merging14:16
mlavallein regards to https://launchpad.net/bugs/1815933, I think this patch is good to go: https://review.opendev.org/#/c/70075514:16
openstackLaunchpad bug 1815933 in neutron "[RFE] Allow bulk-tagging of resources" [Wishlist,In progress] - Assigned to Miguel Lavalle (minsel)14:16
njohnstonmlavalle: Excellent!  I was going to review that later14:16
mlavallethis patch will be followed by other two: api-ref and a tempest api test14:17
mlavallein neutron-tempest-plugin of course14:17
slaweqgreat mlavalle, thx a lot14:17
mlavalleafter that I will move to work on the policy engine update14:18
slaweqnjohnston: yes, I was checking stateless security groups patch recently and it was pretty close IMO14:18
slaweqmlavalle: thx for working on both :)14:18
slaweqI would like to ask about https://blueprints.launchpad.net/neutron/+spec/metadata-over-ipv614:20
slaweqI got today info from rubasov that he don't have time to work on this one14:20
slaweqthx rubasov for this info14:20
slaweqso I have actually 2 questions:14:20
slaweq1. is there any volunteer to work on that?14:21
rubasovsorry for not making progress with that14:21
slaweq2. haleyb: did You get some info about IPv6 address which we should use and if we should "reserve" it with some RFC?14:21
slaweqrubasov: no problem :)14:22
slaweqI think haleyb is not here now so I will probably ping him later during this week about it14:23
mlavalleThis RFE is important in China, which is a big market for OepnStack14:23
haleybhi14:23
slaweqmlavalle: I think this RFE should be important for everyone in 2020 ;)14:24
slaweqhi haleyb :)14:24
haleybslaweq: i had a few suggestions, but in the end they raised more questions than answers14:24
mlavalleso, while I don't want to commit now, please leave it in the dashboard and I will try to come to it later14:24
slaweqmlavalle: sure14:24
slaweqI will also try to help with this if I will have some time14:25
haleybso i think we just talk to the cloud-init people and agree on an address, otherwise it could take forever14:25
slaweqhaleyb: that's what I was affraid of actually :)14:25
mlavalleunless our fearless leader tells me that this RFE has priority over the policy engine update. The I'll start with it after the bulk tagging14:25
mlavalleThen*14:26
slaweqmlavalle: TBH I think this is bigger priority14:26
haleybi had these three questions i remember, "what about security?", "why are you making this look like IPv4?", "what about using mDNS instead?"14:26
slaweqas this would be something "big" which we can share for Ussuri release :)14:26
haleybi let out a sigh after that14:26
*** Lucas_Gray has joined #openstack-meeting14:27
mlavalleok in that case, I will explore how to move forward with this RFE. I'll discuss with haleyb his concerns to make sure we can move forward14:27
slaweqmlavalle: haleyb: great, thx a lot14:28
haleybmlavalle: ack, let's talk about it offline14:28
slaweqplease keep me in the loop if You would have something interesting :)14:28
mlavalleslaweq: if I drop the policy engine update, you deal with the Keystone lady14:28
slaweqmlavalle: ok :)14:28
slaweqok, so lets move on to the next topics than14:29
slaweq#topic Community goals14:29
*** openstack changes topic to "Community goals (Meeting topic: networking)"14:29
slaweqnjohnston: any updates on dropping py2 support?14:29
*** ociuhandu has quit IRC14:29
njohnstonOur part of the drop-py27-support goal is almost done.  Remaining changes are:14:30
njohnstonneutron: https://review.opendev.org/70140914:30
njohnstonnetworking-bagpipe: https://review.opendev.org/70135614:30
njohnstonneutron-fwaas: https://review.opendev.org/68827814:30
njohnstonThe zuulv3 goal is not as close.  The following projects don't appear to have zuulv3 conversion changes underway: networking-bgpvpn networking-midonet networking-odl neutron-dynamic-routing neutron-vpnaaa.  Everything else is completed.14:30
* mlavalle assigned the metadata RFE to himself14:30
njohnstonthanks everyone for all the attention and reviews for these changes, this has been going quite smoothly all things considered14:31
slaweqnjohnston: and what about networking-midonet? What's status of it according to dropping py27 testing?14:31
njohnstonslaweq: That change merged already https://review.opendev.org/70121014:31
slaweqok, but this basically means that networking-midonet is doing only UT jobs now14:32
slaweq:/14:32
mlavalledang14:33
njohnstonYeah, I can't say what is the right or wrong strategy for that project.  But they are fully compliant now.14:33
amotokinjohnston: the patch in netwokring-midonet has not merged yet. it depends on a grenade patch.14:34
njohnstonamotoki: Oh gosh, thanks for pointing that out.  I'll add https://review.opendev.org/#/c/695094 to my tracking.14:35
slaweqthx for update njohnston, so we are quite close to accomplish this goal soon14:35
slaweqaccording to the "Project Specific PTL and Contributor Documentation" goal, I started looking into our docs this week14:36
slaweqand I will start writing some guide for that14:36
njohnstonfor dropping py27, yes.  I would not say we are as close with the zuulv3 since there are a lot of changes needed that do not exist yet.14:36
slaweqthan I will send it to mlavalle to review as much more experience ptl :)14:36
slaweqnjohnston: yes, sure, but community goal is only about dropping py2 support, zuulv3 is another story and it's not part of this goal community wide14:37
slaweqit was our "internal goal" IIRC14:37
amotokinjohnston: is the zuulv3 stuffs a part of the  py27 drop goal? I see another goal proposal on zuulv3 in https://review.opendev.org/#/c/691278/14:39
amotokiof course it is worth tracking them.14:39
njohnstonamotoki: No they are separate goals, I am just tracking their progress in the same etherpad14:39
amotokinjohnston: thanks for clarification.14:39
slaweqok, lets move on to the next topic14:41
njohnstonthat is it from me14:41
slaweqthx njohnston :)14:41
slaweq#topic Bugs14:41
*** openstack changes topic to "Bugs (Meeting topic: networking)"14:41
slaweqhongbin was on bug deputy. His report is on http://lists.openstack.org/pipermail/openstack-discuss/2020-January/011955.html14:41
slaweqthere is couple of new bugs related to our ci there14:42
slaweqand those needs some volunteers14:42
slaweqlike e.g. https://bugs.launchpad.net/neutron/+bug/1858645 - neutron-fwaas scenario job is unstable, probably some race condition14:42
openstackLaunchpad bug 1858645 in neutron "Neutron-fwaas tempest job is not stable" [Critical,Confirmed]14:42
slaweqfor now neutron-fwaas job in neutron-tempest-plugin is set as non-voting due to this bug14:42
slaweqor https://bugs.launchpad.net/neutron/+bug/1858642 - ssh failure in scenario jobs with dvr14:42
openstackLaunchpad bug 1858642 in neutron "paramiko.ssh_exception.NoValidConnectionsError error cause dvr scenario jobs failing" [High,Confirmed]14:42
slaweqand this is (probably) different ssh failure than failures which we had in the past many times14:43
ralonsohI can take a look at the SSH failure in DVR14:43
slaweqralonsoh: thx a lot14:43
slaweqand one last thing from me regarding bugs14:43
slaweqthere is https://bugs.launchpad.net/neutron/+bug/1858419 which is opened to track progress on docs update for large scale deployments14:44
openstackLaunchpad bug 1858419 in neutron "Docs needed for tunables at large scale" [Medium,Confirmed] - Assigned to Slawek Kaplonski (slaweq)14:44
slaweqliuyulong already commented a lot there but if anyone else has got any experience with that, please check it and comment there too14:44
*** liuyulong has quit IRC14:45
slaweqYou can also push patches with changes related to this bug directly to gerrit :)14:45
slaweqthis week our bug deputy is haleyb14:45
slaweqand next will be lajoskatona14:45
haleybo/14:45
slaweqany other bugs You want to discuss with the team?14:45
lajoskatonaslaweq: my eyes on it (from Monday of course) :-)14:46
slaweqlajoskatona: thx :)14:46
*** dmacpher has quit IRC14:47
slaweqok, so I guess there is no other bugs to discuss for today :)14:48
slaweqnext topic then14:48
slaweq#topic Networking OVN and ML2+OVS+DVR Convergence14:49
*** openstack changes topic to "Networking OVN and ML2+OVS+DVR Convergence (Meeting topic: networking)"14:49
slaweqI don't think lucasgomes or maciejjozefczyk are around14:49
slaweqbut ralonsoh maybe You have any updates on it?14:49
slaweqor haleyb14:49
ralonsohI pinged them14:50
ralonsohcurrent status (so far):14:50
ralonsohmerging the FTs and solving some problems with the contexts14:50
ralonsohalso the devstack entry points are added, just to be able to test within the neutron repo14:51
*** maciejjozefczyk has joined #openstack-meeting14:51
maciejjozefczykhello!14:51
ralonsohmaciejjozefczyk, can you update the OVN migraiton status?14:51
maciejjozefczykSure! For now we just merged OVN mechanism driver to Neutron tree14:52
maciejjozefczykIn meantime we're starting to run tempest tests, for now all seems to be fine, Lucas is on it.14:52
*** vesper has quit IRC14:53
maciejjozefczykWe found one issue with Openflow protocols with using OVS firewall driver, it should be fixed with: https://review.opendev.org/#/c/698715/14:53
*** vesper11 has joined #openstack-meeting14:53
ralonsoh(OVS community is aware of this)14:53
maciejjozefczykOk14:53
maciejjozefczykIf above bug will be merged then we would be able to start merging functional tests for OVN14:54
*** lucasagomes has joined #openstack-meeting14:54
maciejjozefczykI just pushed all of them, we're waiting for CI status14:54
maciejjozefczykIn meantime we're starting setup of OVN Provieder driver repository: https://review.opendev.org/#/c/701947/ (its under Neutron umbrella)14:55
*** dmacpher has joined #openstack-meeting14:56
maciejjozefczykthat's all from my, lucasagomes anything else?14:56
lucasagomesmaciejjozefczyk: well, I guess. I missed most of the update (I wasn't in the room)14:57
ralonsoh+1 for maciejjozefczyk and lucasagomes14:57
slaweqthx guys for the update14:57
lucasagomesbut yeah, tl;dr good progress last week. We got up to the point where we can enable the ovn driver in neutron14:58
lucasagomesand tempest are passing14:58
slaweqlucasagomes: that's great news :)14:58
lucasagomesmaciejjozefczyk: is working on the functional tests now that are missing14:58
lucasagomessorry if I repeated anything14:58
maciejjozefczyklucasagomes, yes, I just pushed all of functional tests :) all were passing on my env14:58
maciejjozefczykslaweq, any update on doc topic?14:59
slaweqmaciejjozefczyk: not too much14:59
slaweqI started merging networking-ovn docs into neutron but it's still failing on docs build14:59
*** Luzi has quit IRC14:59
slaweqso I will continue this during this week14:59
slaweqok, we are almost out of time now14:59
slaweqthx for attending the meeting14:59
bcafarelo/14:59
njohnstono/15:00
slaweqhave a great week15:00
slaweqo/15:00
slaweq#endmeeting15:00
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"15:00
openstackMeeting ended Tue Jan 14 15:00:04 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:00
ralonsohbye15:00
openstackMinutes:        http://eavesdrop.openstack.org/meetings/networking/2020/networking.2020-01-14-14.00.html15:00
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/networking/2020/networking.2020-01-14-14.00.txt15:00
maciejjozefczykbb!15:00
openstackLog:            http://eavesdrop.openstack.org/meetings/networking/2020/networking.2020-01-14-14.00.log.html15:00
slaweqralonsoh: floor is Yours :)15:00
ralonsohthanks!15:00
lucasagomesbye bye sorry for the delay, I will add it to the agenda!15:00
ralonsoh#startmeeting neutron_qos15:00
openstackMeeting started Tue Jan 14 15:00:26 2020 UTC and is due to finish in 60 minutes.  The chair is ralonsoh. Information about MeetBot at http://wiki.debian.org/MeetBot.15:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:00
*** openstack changes topic to " (Meeting topic: neutron_qos)"15:00
openstackThe meeting name has been set to 'neutron_qos'15:00
ralonsohhello!15:00
slaweqhi :)15:00
slaweq;)15:00
maciejjozefczykhello!15:00
lajoskatonaHi15:00
ralonsohdavidsha is here15:00
davidshaHey!15:01
ralonsohI think we have qorum15:01
ralonsohlet's start15:01
ralonsoh#topic RFEs15:01
*** openstack changes topic to "RFEs (Meeting topic: neutron_qos)"15:01
ralonsoh#link https://bugs.launchpad.net/neutron/+bug/147652715:01
openstackLaunchpad bug 1476527 in neutron "[RFE] Add common classifier resource" [Wishlist,Triaged] - Assigned to Igor D.C. (igordcard)15:01
ralonsoh1) the spec15:01
ralonsoh#link https://review.opendev.org/#/c/678865/15:02
ralonsohIMO, we can merge it15:02
ralonsohif slaweq 's comments are solved15:02
*** artom has joined #openstack-meeting15:02
ralonsohare we going to use RBAC and shared?15:02
davidshaI responded, I think QoS has both on qos polices?15:02
ralonsohyes, and yes, QoS has both15:03
davidshaI have the RBAC already in the service plugin, so should I remove shared?15:03
ralonsohslaweq, ^15:04
slaweqsorry, I was in the kitchen for a while15:05
ralonsohif ClassificationGroup is going to have a RBAC policy15:05
ralonsohand this policy is going to be shared or not15:05
slaweqcan be rbac for me15:05
ralonsohthen "shared" is not necessary15:05
*** masahito has joined #openstack-meeting15:05
ralonsohso we agree on this, only RBAC15:05
*** masahito has quit IRC15:06
davidshakk, I'll remove it15:06
slaweqok, thx15:06
ralonsohcool, we should merge the spec this week15:06
*** ociuhandu has joined #openstack-meeting15:06
slaweqbut does QoS policy has "shared" flag too?15:06
slaweqor not?15:06
slaweqif it has, maybe we should add it here too?15:06
ralonsohyes15:06
ralonsohqos has shared15:06
slaweqso You can share qos policy via 2 mechanisms RBAC and shared flag, right?15:07
ralonsohyes and this is something we should avoid15:07
ralonsohbecause eventually we can have a clash15:07
ralonsohbetween both params15:08
slaweqwe have it like that for networks also15:08
slaweqin fact if we want to be consistent with other resources we should add both possibilities to share15:09
slaweqso shared flag would be needed than15:09
davidshaok15:10
slaweqbut if we want to do it only with RBAC, that probably this flag is not needed15:10
slaweqas You want :)15:10
davidshaCool, I'll leave both in!15:11
*** ociuhandu has quit IRC15:11
slaweqok15:11
ralonsohperfect15:11
slaweqso the spec is ready to go now15:11
*** mattw4 has joined #openstack-meeting15:12
ralonsohcool15:12
*** maciejjozefczyk has quit IRC15:12
davidsha\o/15:12
ralonsoh2) the n-lib patch15:12
ralonsoh#link https://review.opendev.org/#/c/670049/15:12
slaweq+W'ed spec patch15:12
*** hyunsikyang__ has quit IRC15:12
ralonsohyou need to address lajoskatona 's comments15:13
davidshaslaweq: thanks!15:13
ralonsohabout the API definition15:13
*** hyunsikyang__ has joined #openstack-meeting15:13
*** dougwig has quit IRC15:13
ralonsohbut apart from this, I'm ok with the n-lib patch15:13
davidshaYes, I'll have those up by the end of the day.15:13
davidshakk15:14
lajoskatonadavidisha and all: good to see this progressing :-)15:14
ralonsohcool15:14
davidshalajoskatona: thanks for the reviews, helps the progress!15:14
davidsha:D15:14
ralonsoh3) and the last patch to be discussed, the neutron patch with the DB definiton and the extension15:15
ralonsoh#link https://review.opendev.org/#/c/670050/15:15
ralonsohapart from waiting for the n-lib patch and then deleting the duplicated exceptions, the patch is OK for me15:15
ralonsohwell, of course15:16
ralonsohwe need testing15:16
davidshaI'll port over the unit and functional tests we have in neutron classifier15:16
slaweqone nitty nit for this last patch, please remove "POC" from the title in next revision if it's going to be merged :)15:16
slaweqI think we shouldn't merge something called POC15:17
davidshaWill do!15:17
ralonsohcool, the classification/plugin.py need some extensive testing (and reviews), it's a hard nut to crack15:17
*** dougwig has joined #openstack-meeting15:17
davidshaAnything I can do to make the reviews easier?15:18
ralonsohI don't know, I just spent 1 hour reading and understanding the code...15:19
lajoskatonaPerhaps an api-ref, I suppose there's something for the original project?15:19
davidshaLol, comments it is ;P15:19
ralonsohis just a matter of time15:19
*** maciejjozefczyk has joined #openstack-meeting15:19
davidshathere should be, I'll try to find it.15:19
lajoskatonadavidisha: thanks15:20
ralonsohok, something else to be commented in this spec?15:21
ralonsoh*RFE15:21
ralonsohok, let's move on15:21
ralonsohnext one, #link https://bugs.launchpad.net/neutron/+bug/185136215:22
openstackLaunchpad bug 1851362 in neutron "[RFE] ports do not inherit their associated network's policy" [Low,In progress] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez)15:22
ralonsohI made a huge mistake in n-lib 1.30.115:22
ralonsohredefining qos_policy_id in port15:22
ralonsohso now we have n-lib 2.0.0 (without py2 support, btw)15:22
ralonsohonce we have the neutron patch #link https://review.opendev.org/#/c/701517/15:23
ralonsohbumping the n-lib version, I'll continue with the neutron patch15:23
ralonsoh#link https://review.opendev.org/#/c/693244/15:23
ralonsohand the OSsdk one15:23
ralonsoh#link https://review.opendev.org/#/c/693247/15:23
ralonsohthat's all, any other comment?15:24
davidshaNone from me.15:24
ralonsohthanks!15:24
ralonsohok, next one15:24
ralonsoh#link https://bugs.launchpad.net/neutron/+bug/184316515:24
openstackLaunchpad bug 1843165 in neutron "RFE: Adding support for direct ports with qos in ovs" [Wishlist,In progress] - Assigned to waleed mousa (waleedm)15:24
ralonsohA "trivial" patch due to the full support of QoS for offloaded ports, in newer OVS versions15:25
ralonsohof course, the patch should make those kind of checks15:25
ralonsoh#link https://review.opendev.org/#/c/611605/15:25
ralonsohplease, review the patch15:25
ralonsohthe main goal of this patch, apart form adding portbindings.VNIC_DIRECT to the ovs driver15:26
ralonsohis to check is this is supported15:26
ralonsohany comment?15:26
davidshano, I'll review later15:27
ralonsohand that's all form my list of RFEs15:27
ralonsohany other one?15:27
slaweqIMO this last patch is almost ready to go15:27
slaweqI had only some comments to the docs15:27
ralonsohI think so15:27
ralonsohI need to push my comments15:28
ralonsohok, let's move to next section15:28
ralonsoh#topic Bugs15:28
*** openstack changes topic to "Bugs (Meeting topic: neutron_qos)"15:28
ralonsoh#link https://bugs.launchpad.net/neutron/+bug/184517615:29
openstackLaunchpad bug 1845176 in neutron "Removing of QoS queue in neutron-ovs-agent fails due to existing references" [Medium,In progress] - Assigned to Rodolfo Alonso (rodolfo-alonso-hernandez)15:29
ralonsohand the patch15:29
ralonsoh#link https://review.opendev.org/#/c/687922/15:29
ralonsohwhat can I say, IMO is ready to be merged!15:29
ralonsohplease, add it to your review piles15:29
ralonsohok, next one15:30
ralonsoh#link https://bugs.launchpad.net/neutron/+bug/185384015:30
openstackLaunchpad bug 1853840 in neutron "Neutron fails to create bandwidth providers if CONF.host is set" [High,Fix released] - Assigned to Bence Romsics (bence-romsics)15:30
ralonsohclosed15:30
ralonsoh#link https://review.opendev.org/#/c/696600/15:30
ralonsohthanks to bence15:30
ralonsohI'll remove it from the list15:31
ralonsohnext one15:31
ralonsoh#link https://bugs.launchpad.net/neutron/+bug/185317115:31
openstackLaunchpad bug 1853171 in neutron "Deprecate and remove any "ofctl" code in Neutron and related projects " [Medium,In progress] - Assigned to David Shaughnessy (david-shaughnessy)15:31
ralonsohthis one will take more time15:31
ralonsohbecause the ocftl command is used in many parts of the code15:32
davidshaThe neutron side is done correct?15:32
ralonsoh#link https://review.opendev.org/#/c/695479/15:32
ralonsohthis patch?15:32
davidshayup, or is there more to be done?15:32
ralonsohthe firewall15:32
davidshaAh15:32
ralonsohit's using it15:32
ralonsohso, because this is not a real bug15:33
ralonsohthe priority is not high15:33
ralonsohonce you have the classifier , you can spend time on this15:33
ralonsohif you have it15:33
davidshakk, I'll try15:33
ralonsohthanks!15:33
davidshanp!15:34
ralonsohany other bug that I missed?15:34
*** jamesmcarthur has joined #openstack-meeting15:34
ralonsohok, let's move to the next section15:35
ralonsoh#topic Open Discussion15:35
*** openstack changes topic to "Open Discussion (Meeting topic: neutron_qos)"15:35
ralonsohI have nothing in the agenda15:35
ralonsoheverything is good in the QoS world15:36
davidsha:D15:36
slaweq\o/15:36
ralonsohperfect, thanks folks! I'll end the meeting here15:36
ralonsohsee you online!15:36
ralonsoh#endmeeting15:36
davidshasee ya!15:36
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"15:36
openstackMeeting ended Tue Jan 14 15:36:48 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:36
openstackMinutes:        http://eavesdrop.openstack.org/meetings/neutron_qos/2020/neutron_qos.2020-01-14-15.00.html15:36
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/neutron_qos/2020/neutron_qos.2020-01-14-15.00.txt15:36
openstackLog:            http://eavesdrop.openstack.org/meetings/neutron_qos/2020/neutron_qos.2020-01-14-15.00.log.html15:36
slaweqo/15:37
lajoskatonao/15:37
*** ociuhandu has joined #openstack-meeting15:42
*** dougwig has quit IRC15:48
*** dougwig has joined #openstack-meeting15:52
*** jamesmcarthur has quit IRC15:55
*** jamesmcarthur has joined #openstack-meeting15:55
*** Lucas_Gray has quit IRC15:57
slaweq#startmeeting neutron_ci16:00
openstackMeeting started Tue Jan 14 16:00:27 2020 UTC and is due to finish in 60 minutes.  The chair is slaweq. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
*** openstack changes topic to " (Meeting topic: neutron_ci)"16:00
openstackThe meeting name has been set to 'neutron_ci'16:00
slaweqwelcome back :)16:00
ralonsohhi16:00
njohnstono/16:01
*** maciejjozefczyk has quit IRC16:02
slaweqlets start, maybe others will join in the meantime16:02
slaweq#topic Actions from previous meetings16:02
*** openstack changes topic to "Actions from previous meetings (Meeting topic: neutron_ci)"16:02
bcafarelhi again16:02
slaweqsorry, first thing:16:02
slaweqGrafana dashboard: http://grafana.openstack.org/dashboard/db/neutron-failure-rate16:02
slaweqPlease open now :)16:02
slaweqand now we can start with first topic16:02
slaweqnjohnston to check failing NetworkMigrationFromHA in multinode dvr job16:02
njohnstonSo I have not been able to find any incidences of that.  I tried last week, and logshash was not showing any.  I tried for about an hour this morning, but logstash became unresponsive a few times so I haven't been able to see if any happened over the weekend16:03
njohnstonI should say, any recent16:03
njohnstonrecent incidences16:03
njohnstonso I will keep searching, and once I find another failure I will poke at it.16:04
slaweqnjohnston: ok, if I will have something like that I will ping You16:04
njohnstonslaweq: thanks!16:04
slaweqnjohnston: I think it's this for example https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_b63/702249/3/check/neutron-tempest-plugin-dvr-multinode-scenario/b631ff4/testr_results.html16:05
njohnstonSee, I know you'd be able to find one. :-) slaweq++16:06
slaweq:)16:06
slaweqnjohnston: thx16:06
slaweqbut I'm not sure if this is the error which You are looking for actually16:06
slaweqhere it seems it's ssh to instance failure16:07
njohnstonthat is all I have ever seen for a failure on this test16:07
slaweqand I'm not sure if this is "router migration specific" problem of general issue16:07
slaweqI know that I saw similar ssh issue on other tests too16:08
slaweqbut maybe it's for some reason failing more often in those migration tests16:08
njohnstonyes, that is the angle I am taking on it16:09
slaweqok, thx njohnston for looking into this issue16:09
slaweqif You will need any help, just let me know :)16:09
njohnstonslaweq: Will do16:09
slaweqthx16:10
slaweqok, lets move on16:10
slaweqralonsoh to report bug for timeout related to bridge creation16:11
ralonsohlet me find the bug16:11
ralonsoh#link https://bugs.launchpad.net/neutron/+bug/185866116:11
openstackLaunchpad bug 1858661 in neutron "Error when creating a Linux interface" [High,Confirmed]16:11
ralonsohbut I didn't work on this one16:11
slaweqralonsoh: thx, we can at least track it if someone will have time to work on this16:13
slaweqthx a lot16:13
ralonsohyw16:13
slaweqand last action from last week16:14
slaweqralonsoh to take a look how to use newer Maridb in periodic job16:14
ralonsohone sec16:14
ralonsoh#link https://review.opendev.org/#/c/702416/16:14
ralonsohwhat I'm doing is, in the zuul job, adding a pre-run task16:14
ralonsohadding, just for ubuntu bionic, the repo with mariadb 10.416:14
njohnstonnice16:15
slaweqYou can sent DNM patch which is on top of this one to run this job in check queue16:16
slaweqjust to see if it will actually work as expected16:16
ralonsohhmmm, you are right16:16
slaweqand thx for that fix :)16:17
ralonsohI'll ask you about this later16:17
ralonsohbecause I though that was a periodic job16:17
ralonsohbut in the neutron channel16:17
slaweqralonsoh: yes, this job is in periodic queue16:17
slaweqand it should be like that16:17
slaweqbut You can send DNM patch where You will add it to check queue16:18
slaweqthen zuul will run it on this patch so we can see results before we will merge Your fix16:18
slaweqI can send this patch if You want16:18
ralonsohahhh ok!16:18
ralonsohunderstood16:18
slaweq:)16:18
slaweqok, next topic16:20
slaweq#topic Stadium projects16:20
*** openstack changes topic to "Stadium projects (Meeting topic: neutron_ci)"16:20
slaweqI think we already have good update about dropping py2 support16:20
slaweqso we don't need to talk about it here probably16:20
slaweqright?16:20
njohnston+116:20
ralonsoh+116:21
bcafarelyep16:21
slaweqbut I have other question related to stadium projects16:21
slaweqwe have now in neutron check queue midonet and tripleo jobs which are non-voting and failing 100% times since very long time16:21
slaweqboth are failing because they try to run on python 2.716:21
slaweqmy question is: what we should do with those jobs?16:21
slaweqI would personally remove them for now from check queue16:22
slaweqas it's only waste of infra resources to run them on each patch16:22
slaweqbut I want to also know Your opinion about it16:22
njohnstonI would remove midonet as they don't have anything but UTs now16:22
njohnstonFor tripleo I would ask if there is an updated job for py3 we could switch to16:22
slaweqnjohnston: there is no currently16:23
bcafarel+1 as these cannot be fixed short-term, we can always add back when there is support16:23
slaweqafaik tripleo pinned neutron to some version which supports py2 still16:23
slaweqand they use it like that in their ci16:23
njohnstonugh.  never mind.  nuke it.16:23
slaweqalso this job runs on Centos 716:23
bcafarelyeah for tripleo we need centos8 support (which is in progress but not there tomorrow)16:23
slaweqso we should probably wait with this job for centos816:23
slaweqso what do You think about removing both jobs from check queue with comment that we can bring them back when it will work?16:24
ralonsohfor now, we should not waste CI resources (139 jobs in the queue now!)16:24
ralonsohwe can comment them16:25
njohnstonagreed 🤯16:25
slaweqok, I will do that16:25
bcafarelgood for me too :)16:25
slaweq#action slaweq to remove networking-midonet and tripleo based jobs from Neutron check queue16:25
slaweqok, that's all from my side regarding stadium projects16:26
slaweqanything else You have in this topic?16:26
njohnstonnope16:26
slaweqok, lets move on than16:27
slaweq#topic Grafana16:27
*** openstack changes topic to "Grafana (Meeting topic: neutron_ci)"16:27
slaweqhttp://grafana.openstack.org/dashboard/db/neutron-failure-rate16:27
*** dosaboy has quit IRC16:28
slaweqall graphs are going to normal values today after yesterday's issue with devstack16:28
njohnstonwell we can see the issues clearly enough16:28
*** lajoskatona has quit IRC16:29
njohnstonwhat was wrong with the neutron-tempest-plugin-scenario-* jobs in the check queue back on 1/8?  They were all at 100% fail then as well.16:29
slaweqnjohnston: I think it was this issue with 'None object don't have open_session" or something like that16:30
njohnstonah ok, I recall that fix16:30
slaweq:)16:30
slaweqother than that I don't see any real problems in grafana16:31
slaweqbut I checked today average number of rechecks in last week and according to my script it was more than 3 rechecks per patch16:32
slaweqwhich isn't good result still :/16:32
njohnstonlet's see if that average is lower next week16:32
slaweqyeah16:33
slaweqI will try to monitor it every week16:33
ralonsoh(can you share it?)16:33
ralonsohif it is possible16:33
ralonsohthe script16:33
slaweqralonsoh: sure16:34
slaweqhttps://github.com/slawqo/tools/blob/master/rechecks.py16:34
ralonsohcool!!16:34
slaweqbut it's nothing really "great"16:34
slaweqjust simple script which parses some comments from gerrit :)16:34
njohnstonralonsoh: It is linked to from the article that describes it: http://kaplonski.pl/blog/failed_builds_per_patch/16:34
slaweqnjohnston: yes, it is16:34
ralonsohthat's right yes!16:35
slaweqI think it works fine and IMO this metric makes some sense16:35
slaweqbut if You have any opinion about it, please let me know16:35
slaweqmaybe my way if thinking here is wrong and this don't have any informational value at all16:35
njohnstonI think you have a good point that it measures the developer pain due to bad CI16:36
njohnstonafter all if it is a code problem then the developer is probably not going to do a bare 'recheck', so they have to be nearly all CI issues that get rechecked16:36
slaweqnjohnston: thx16:36
bcafarelack especially as it focuses on "final" series of rechecks16:37
slaweqyeah, that's why I checked only "build failed" comments from last patchset16:37
slaweqas this in most cases means that code was already fine16:37
slaweqand issues were not related to this patch16:37
slaweqof course in some case it may be differently when patch introduces e.g. some race condition and tests are failing intermittary but in general it shouldn't be the case16:38
bcafarelyeah from personal experience there should be a good signal to noise ratio16:39
slaweqthx bcafarel16:39
slaweqok, anything else You want to talk regarding grafana?16:39
slaweqor can we move on?16:39
bcafarelall good here16:39
slaweqso lets move on than16:40
slaweq#topic fullstack/functional16:40
*** openstack changes topic to "fullstack/functional (Meeting topic: neutron_ci)"16:40
slaweqI found one failure in fullstack tests:16:40
slaweq    neutron.tests.fullstack.test_qos.TestMinBwQoSOvs.test_min_bw_qos_port_removed16:40
slaweq    https://b89f49db332cb8f54892-19780c33aa00a3c0d825d79cd8c225b0.ssl.cf5.rackcdn.com/701571/2/check/neutron-fullstack/51a1d1b/testr_results.html16:40
slaweqbut it's probably issue which should be fixed with https://review.opendev.org/#/c/687922/16:40
slaweqis that correct ralonsoh?16:40
ralonsohlet me check16:41
ralonsohwell, we didn't have the diver cache for qos min rules16:41
ralonsohand this specific test is totally refactored16:41
ralonsohso yes, I think this is going to fix it16:42
ralonsoh(I hope so!)16:42
slaweqok, thx for confirmation16:42
*** gyee has joined #openstack-meeting16:42
slaweqand I don't have any other new failures for functional/fullstack jobs16:42
slaweqso I think we can move on to scenario jobs now16:43
slaweqare You ok with that?16:43
bcafarelI may have a new one for stein branch (functional)16:43
slaweqbcafarel: shoot16:43
bcafarelhttps://review.opendev.org/#/c/701898/ and https://review.opendev.org/#/c/702364/ both failed today on functional neutron.tests.functional.test_server tests16:44
bcafarelmay just be bad node I did not have time to dig in further, for example https://deacf45b9e7640612342-216aa7667ced3686ee75e1188a89b185.ssl.cf2.rackcdn.com/702364/1/check/neutron-functional/a6cf355/testr_results.html16:44
bcafarelbut I don't recall recent changes/fixes in this part of code in master/train16:44
slaweqI remember some failure like that in master branch in the past16:45
slaweqmaybe it's just some missing backport?16:45
ralonsohslaweq, you changed the start method16:47
ralonsohhttps://review.opendev.org/#/c/680001/16:47
ralonsohis this in stein?16:47
bcafarelahah so maybe oslo bump in stein?16:48
slaweqralonsoh: yes, and this patch in oslo was backported to stein: https://review.opendev.org/#/q/I86a34c22d41d87a9cce2d4ac6d95562d05823ecf16:48
slaweq:)16:48
bcafarelthat one I see only in master/train16:48
slaweqso this may be same problem16:48
bcafarelralonsoh: slaweq thanks I will check and send cherry-pick if that is the one16:48
ralonsohmy job is done here!16:48
bcafarelthough I am tempted to bet it is :)16:49
slaweqralonsoh++16:49
slaweqbcafarel++ thx for checking that16:49
slaweq#action bcafarel to send cherry-pick of https://review.opendev.org/#/c/680001/ to stable/stein to fix functional tests failure16:50
slaweqok, anything else regarding functional/fullstack jobs?16:50
bcafarelnothing else from me at least :)16:50
slaweqok, lets move on than16:51
slaweq#topic Tempest/Scenario16:51
*** openstack changes topic to "Tempest/Scenario (Meeting topic: neutron_ci)"16:51
slaweqI have one failure related to scenario jobs to mention16:52
slaweqProblem with ssh: paramiko.ssh_exception.SSHException: No existing session16:52
slaweqe.g. https://947c62482e8e55a27073-47560c94aca274da9e9228ef37db57ef.ssl.cf1.rackcdn.com/701853/2/check/neutron-tempest-plugin-scenario-linuxbridge/e077ad8/testr_results.html16:52
slaweqit may be the same issue like njohnston saw for migration routers tests16:52
slaweqlast week I opened bug for that also https://bugs.launchpad.net/neutron/+bug/185864216:53
openstackLaunchpad bug 1858642 in neutron "paramiko.ssh_exception.NoValidConnectionsError error cause dvr scenario jobs failing" [High,Confirmed]16:53
slaweqbut now it seems that it's not only related to dvr jobs16:53
*** macz has joined #openstack-meeting16:54
ralonsohso you think this is not a DVR/no DVR problem but a paramiko one16:54
ralonsoh?16:54
slaweqnjohnston: if You will find something with router migration, please maybe take a look at this also to check if that's not the same problem16:54
njohnstonwill do16:54
slaweqralonsoh: IMO it's not paramiko problem, but we have just such error from paramiko when there is no ssh connectivity16:54
*** maciejjozefczyk has joined #openstack-meeting16:55
ralonsohok16:55
slaweqahh no16:55
slaweqsorry16:55
slaweqit's not the same error in this linuxbridge job16:55
slaweqnjohnston: so please don't check that one16:55
slaweqit's something different16:55
njohnstonok16:55
slaweqhere it may be some paramiko error or some issue in our tests code16:56
slaweqsorry for mixing things16:56
slaweqso regarding this issue with linuxbridge job, I think that if we will spot it more often, I will open new bug for that16:57
slaweqand we can than check it16:57
slaweqat least for now I saw it only once so I don't think it will be easy/doable to check that16:57
slaweqok, we are almost out of time16:58
slaweqanything else You have to talk today quickly?16:58
slaweqif not, lets end the meeting now, thx for attending o/16:59
slaweq#endmeeting16:59
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"16:59
openstackMeeting ended Tue Jan 14 16:59:43 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:59
openstackMinutes:        http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-01-14-16.00.html16:59
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-01-14-16.00.txt16:59
openstackLog:            http://eavesdrop.openstack.org/meetings/neutron_ci/2020/neutron_ci.2020-01-14-16.00.log.html16:59
ralonsohbye!16:59
njohnstono/16:59
bcafarelo/17:00
*** lucasagomes has quit IRC17:00
*** rpittau is now known as rpittau|afk17:01
*** e0ne has quit IRC17:14
*** e0ne has joined #openstack-meeting17:16
*** ociuhandu_ has joined #openstack-meeting17:20
*** e0ne has quit IRC17:20
*** mattw4 has quit IRC17:22
*** ociuhandu has quit IRC17:24
*** ociuhandu_ has quit IRC17:24
*** ociuhandu has joined #openstack-meeting17:26
*** mlavalle has left #openstack-meeting17:27
*** ociuhandu has quit IRC17:28
*** davidsha has quit IRC17:33
*** brinzhang has quit IRC17:38
*** brinzhang has joined #openstack-meeting17:39
*** dosaboy has joined #openstack-meeting17:59
*** maciejjozefczyk has quit IRC18:02
*** mattw4 has joined #openstack-meeting18:10
*** jamesmcarthur has quit IRC18:10
*** mattw4 has quit IRC18:15
*** mattw4 has joined #openstack-meeting18:15
*** maciejjozefczyk has joined #openstack-meeting18:17
*** jamesmcarthur has joined #openstack-meeting18:20
*** mattw4 has quit IRC18:22
*** jamesmcarthur has quit IRC18:43
*** Shrews has joined #openstack-meeting18:50
*** maciejjozefczyk has quit IRC18:56
*** lajoskatona has joined #openstack-meeting18:56
*** anastzhyr has joined #openstack-meeting18:57
*** maciejjozefczyk has joined #openstack-meeting18:59
*** jamesmcarthur has joined #openstack-meeting18:59
clarkbanyone else here for the infra meeting?19:00
clarkbwe'll get started in a minute or two19:00
ianwo/19:00
*** brinzhang_ has joined #openstack-meeting19:01
clarkb#startmeeting infra19:01
openstackMeeting started Tue Jan 14 19:01:08 2020 UTC and is due to finish in 60 minutes.  The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot.19:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.19:01
*** openstack changes topic to " (Meeting topic: infra)"19:01
openstackThe meeting name has been set to 'infra'19:01
*** lajoskatona has quit IRC19:01
clarkb#link http://lists.openstack.org/pipermail/openstack-infra/2020-January/006570.html Our Agenda19:01
clarkb#topic Announcements19:01
*** openstack changes topic to "Announcements (Meeting topic: infra)"19:01
clarkbOpenStack Foundation Individual Board Member Election happening now. Ends January 17 17:00UTC19:01
diablo_rojoo/19:01
clarkbif you are an OSF individual member you should've received a ballot via email in the last few days19:02
fungialso remember to keep your e-mail address up to date in your osf profile19:02
fungiso that it doesn't go into the void19:02
fungi(unless that's what you're after)19:02
clarkbAlso note that the end of polling is Friday19:04
*** brinzhang has quit IRC19:04
clarkbit is a quick one, so don't forget to vote if you intend to19:04
*** senrique_ has joined #openstack-meeting19:04
*** enriquetaso has quit IRC19:04
clarkb#topic Actions from last meeting19:05
*** openstack changes topic to "Actions from last meeting (Meeting topic: infra)"19:05
clarkb#link http://eavesdrop.openstack.org/meetings/infra/2020/infra.2020-01-07-19.01.txt minutes from last meeting19:05
clarkbmordred had an action to deploy review-dev with ansible + gerrit19:05
clarkbthere is a change, https://review.opendev.org/#/c/702496/1 , up to do that19:05
clarkbthank you mordred19:05
corvuso/19:06
clarkbI had an action item to send email to openstack-discuss re opendev split as well as push a governance change and have not yet done so19:06
clarkbbeen sniped by ssl certs and nodepool things19:06
clarkb#action clarkb push openstack governance change to pull out opendev and start discussion with tc via openstack-discuss19:06
clarkbWith that I think we can dive straight into the ansible + docker things19:06
clarkb#topic Config Management Updates19:07
*** openstack changes topic to "Config Management Updates (Meeting topic: infra)"19:07
clarkb#link https://review.opendev.org/#/c/702496/1 Manage review-dev with ansible and docker19:07
clarkbI think we need to land this change then remove review-dev from the emergency file19:07
*** mattw4 has joined #openstack-meeting19:07
fungii just finished reviewing and approved it19:07
fungiwas a quick read19:07
fungithanks mordred!19:08
clarkbIs it too early to start thinking about what this transition looks like in production?19:08
clarkbmordred: ^19:08
fungiyeah, i too am curious about how we get from point a to point z19:09
funginow that we know where point z is19:10
fungi(or at least we think we know)19:10
corvus(i think mordred has spotty connections today due to travel) but my understanding is that, yeah, next step is "status quo on review.o.o" but with docker19:10
*** brinzhang has joined #openstack-meeting19:10
corvusor, actually, is it podman? :)19:10
fungican we deploy 2.13 in a docker container? or do we need to upgrade to 3.something locally on a clone of review.o.o and then copy the file tree over and plug it into a dockerized deployment?19:11
clarkbfungi: review-dev is a 2.13 container deployment19:11
fungid'oh, right19:11
clarkband we mount the review site into the container fs so we don't even need to rebuild indexes and similar aiui19:12
corvusso we're changing 1 variable at a time19:12
clarkbthe transition should actually be pretty quick and easy once we've got everything lined up19:12
fungiso in theory, clone the git tree and mysqldb, take a brief outage to get those in full sync, then cut over?19:12
corvusi think not even that due to the bind mounts19:12
clarkbfungi: I don't even think we need to do that beyond and backup considerations19:12
fungiahh, do it directly on the existing review.o.o server, not a second server?19:13
corvusyep19:13
fungiyes, that's even faster still19:13
fungireview-dev was a redeployment via ansible though, not a cut-over from puppet to ansible? or am i misremembering?19:13
*** brinzhang_ has quit IRC19:14
clarkbfungi: its a cut over19:14
corvusi think it will mostly be 1 or 2 changes to transfer the production config from puppet to ansible (most of that was taken care of by review-dev, but dev->prod has some deltas) and removing the puppet config.19:14
corvusit was just a really long cutover, mostly spent in the emergency file, as mordred figured out what to do one bit at a time.19:14
fungiokay, yep, i misremembered then. /etc/hostname on review-dev01 is ~10 months old which is well before the dockerization work started for it19:15
corvusbut honestly, i think we're looking at something like mordred preparing the change, and then we clear a friday the next time he's around and just do it.19:15
clarkbcorvus: ++19:15
clarkbI really do expect the total outage time to not be much longer than a normal gerrit restart19:15
fungisounds good to me (as long as it's not friday the 31st)19:16
clarkbits essentially stopping the puppet managed sysv init version and starting the container version19:16
corvusyep.  so i think we can risk a friday for that.19:16
clarkboh that makes me wonder if we properly cleaned up the sysv init script on review-dev19:16
*** pcaruana has quit IRC19:16
corvusit appears to be in place and symlinked19:17
clarkbI don't think the puppet changes would've done that. I'm happy for that to be manual cleanup too19:17
clarkbmordred: ^ if you read scrollback that may be an important piece of the transition that has been missed (so that we properly handle reboots)19:17
corvusi'll cleanup review-dev now19:18
clarkbthanks19:18
clarkbAnything else on this subject or should we continue?19:19
fungijust excited to see this come to fruition19:19
clarkb#topic OpenDev19:20
*** openstack changes topic to "OpenDev (Meeting topic: infra)"19:20
clarkbas mentioned the email and governance change has not yet gone out19:20
clarkbit is high on my list but I've had operational items to look at as well as paperwork stuff (yay beginning of the year) to look at too19:20
clarkbI'll try to get that done this week19:20
fungii've got a change up to reorganize the opendev.org dns zonefile. it's got 2x +2 but i didn't want to self-approve without some visibility19:21
clarkbThe other item I had on this topic was we noticed that we miss gerrit replication events when restarting gitea19:21
fungiahh, yeah, that's a problem19:21
clarkbfungi: has it incorporated the latest LE changes?19:21
clarkbfungi: I'm fine with self approving if its up to date19:21
fungiclarkb: i think i based it on top of your zone changes19:21
fungiahh, nope, there have been more since19:22
clarkbfungi: ok, the insecure-ci-registry change came a little later, not sure if it was accomodated19:22
fungii'll rebase19:22
clarkb(sorry)19:22
fungino worries19:22
fungi#link https://review.opendev.org/701833 [opendev/zone-opendev.org] Reorganize zonefile19:22
fungifor reference19:22
clarkbfor the gitea and gerrit replication thing I've been tossing that around in the back of my mind a bit and haven't really come up with a great solution19:22
corvuslet's do that soon, because i have to imagine it'll be easy to miss a name in a rebase19:23
clarkbpart of the problem here is gerrit does not see any errors so from its perspective replication has succeeded19:23
clarkbcorvus: ++19:23
fungithe not-so-great sledgehammer solution is to force full replication immediately following gitea restarts19:23
clarkbfungi: ya another idea I had was to run periodic full replications19:23
clarkbanother was to replicate behind gitea's back19:23
corvusdo we think there may be a gerrit bug wrt to the "not noticing" bit?19:24
clarkbcorvus: I think it is a gitea issue19:24
fungiit's possible either one is at fault, we could test19:24
corvushow can that be?19:24
clarkbcorvus: since we saw similar when the gitconfig lock file was held, gerrit would push, gitea would say ok, but in reality nothign on disk was modified19:24
clarkbbut ya possible it is gerrit's fault (or jgit)19:24
fungieither gerrit is ignoring push errors or gitea is silently ignoring the pushes/not writing them19:24
corvusi assumed this was some sort of connection refused situation, but you think there's a connection and it's succeeding?19:25
*** maciejjozefczyk has quit IRC19:26
fungiit persisted for over a minute after a container restart (not sure how long exactly)19:26
corvusright,  but gitea does not start immediately19:26
clarkbcorvus: ya and largely based on the gitconfig lock behavior19:26
fungiyeah, it's entirely possible there was no open socket, like i said, probably worth testing19:26
corvusit sounds like we don't have much evidence at the moment.  it would probably be worth getting to the bottom of this behavior, but maybe not until after the gerrit upgrade, since there are like 5 years of bugfixes (and new bugs) in there.19:27
fungii've seen gerrit retry pushes for replication in the past when there are errors (often for a very long time) so i suspect it's not a typical remote outage19:28
clarkb'gerrit.sshConnectionTimeout : Timeout for SSH connections. If 0, there is no timeout and the client waits indefinitely. By default, 2 minutes.' is a thing fwiw19:28
clarkbif it does come down to connection issues we may be able to work around it via config settings19:28
clarkbcorvus: ++ to not trying to solve it for old gerrit19:28
corvusso maybe the sledgehammer approach of a full replication after restarts for now?19:28
clarkbbecause ya if it is a bug in the relpication plugin there is a good chance it will be fixed as soon as we update19:28
fungii'm fine with this plan19:29
*** armax has joined #openstack-meeting19:30
clarkbactually I wonder if we didn't restart the ssh container if that would change anything19:30
clarkbcorvus: ^ the sshd container is just running opensshd on a non standard port right?19:31
clarkbwe don't have to update it when we update gitea?19:31
corvusclarkb: yes but -- it executes a gitea command19:31
corvusssh forced command19:31
clarkbah19:32
*** ykatabam has quit IRC19:32
corvuscould be that sequencing those in some way might help19:32
corvuslike shut them both down, then start web, wait 1 minute, start ssh.19:32
corvus(otoh, would probably be better to just update error handling in the ssh component if that's the problem)19:33
clarkb#agreed Need further debugging on Gerrit replication issues when Gitea is restarted. If Gerrit side issue then work on upgrading Gerrit. If Gitea problem we can sort it out from there.19:33
clarkbhow is ^19:33
corvusoh i was thinking we don't do any more debugging until after upgrading gerrit.  unless someone is bored of course.19:34
fungii'd also be fine just forcing replication until the gerrit upgrade19:34
fungiyeah, that19:34
clarkb#undo19:34
openstackRemoving item from minutes: #agreed Need further debugging on Gerrit replication issues when Gitea is restarted. If Gerrit side issue then work on upgrading Gerrit. If Gitea problem we can sort it out from there.19:34
clarkb#agreed Wait for Gerrit upgrades before digging into replication issues to gitea when gitea is restarted as new Gerrit may fix. In the mean time we can brute force replication post Gitea updates.19:34
mordredo/19:35
mordredyay internet19:35
clarkbAnything else on OpenDev or should we move on?19:35
* mordred agrees with scrollback about gerrit19:36
corvusmordred: you may want to review 19:08-19:1519:36
*** gmann is now known as gmann_afk19:36
mordredcorvus: ++19:36
clarkb#topic General Topics19:37
*** openstack changes topic to "General Topics (Meeting topic: infra)"19:37
clarkbStatic.openstack.org migration19:37
clarkb#link https://review.opendev.org/#/q/status:open+topic:static.opendev.org19:37
clarkbThese changes need reviews.19:37
clarkbianw: it looks like one of them is merge conflicting now19:37
clarkbotherwise they looked good to me, though I did leave a few coments you might want to look at if rebasing for the merge conflict19:38
ianwok, will cycle back19:38
ianwthanks19:38
clarkbI did want to call out that zuul-ci.org has delegated its acme stuff to acme.opendev.org similar to how we plan to do for openstack.org domains19:38
clarkband that is all working as expected19:38
corvusthanks again to ianw for building a solid and versatile system :)19:39
fungiyeah, this has been working out great19:39
corvusand to mnaser for reminding us we can use it that way :)19:40
fungiwe'll likely have a lot more churn over the next year as old certs expire and we want to not have to pay to renew them19:40
clarkbWe should try our bnest to add any newly SSL'd domains to the certcheck list as we add them19:40
fungi(and more importantly, not have to worry about manually swapping them for new certs the following year)19:41
clarkbI did take a note yesterday to make sure we do systemctl reload apache2 equivalents in the restart_apache LE handler19:41
clarkbI should get to that this afternoon19:41
clarkbfungi: ^ unless you already did that19:41
fungii haven't looked to see what the service unit calls, no. ideally it's something like apache2ctl graceful, which sends sigusr1 to the parent process19:42
clarkbk I've got it on my list as cleanup from cert updates as well as updating hiera/hostvars now that we've stopped using some old certs stored there19:43
fungi(same thing the reload action in the initscript does)19:43
*** jamesmcarthur has quit IRC19:43
clarkbNext up is the wiki19:44
clarkbfungi: I don't expect there has been much movement on that in the last week?19:44
*** jamesmcarthur has joined #openstack-meeting19:44
* fungi consults his magic 8-ball19:44
fungi"don't count on it."19:44
clarkbk. That takes us to the end of our regularly scheduled agenda19:44
clarkb#topic Open Discussion19:45
*** openstack changes topic to "Open Discussion (Meeting topic: infra)"19:45
clarkbSetuptools 45 is not compatible with python219:45
clarkbthis would've been unnoticed except it still builds a python2 capable wheel (according to the filename) and our wheel mirror served that19:45
clarkbianw: thank you for working on adding the data-requires-python attributes to our package indexes on the wheel mirror19:46
clarkbfungi: got us to an intermediate fix via removal of setuptools 45 wheel on our mirror19:46
ianwyeah, the idea of not making wheels available on pypi is still a todo but worthwhile too probably19:46
ianwi mean, us not building wheels that are already available on pypi, to be clearer19:47
clarkbyup, it will reduce disk requirements and speed up the jobs that build the wheels we do need19:47
clarkbshould be a good improvement19:47
ianwand i also started looking at getting centos8 in there for wheel builds, and a request for buster builds too19:47
clarkbIn general we should probably expect more fallout from python2 EOL19:48
clarkbthough probably nothing as impactful as setuptools updating19:48
ianwfyi on friday i am moving from sydney to melbourne ... same TZ so not much change there19:50
clarkbianw: does the air quality get better or worse as a result of that?19:50
*** macz has quit IRC19:50
ianwumm, right now worse, maybe :/19:51
*** macz has joined #openstack-meeting19:51
*** jamesmcarthur has quit IRC19:52
fungithat's quite the cross-country haul19:52
fungibut at least you'll be a short boat ride from jhesketh19:52
clarkbfor some values of short19:53
*** jamesmcarthur has joined #openstack-meeting19:53
ianwyes, will be fun to explore a new part of .au19:53
fungigood luck with the move!19:54
ianw2 years ... maybe ... but who knows!  thanks19:54
clarkbyes, I hope it goes well19:55
clarkbI think that may be it for the meeting19:55
clarkbThank you everyone19:55
clarkbSee you next week19:55
clarkb#endmeeting19:55
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"19:55
openstackMeeting ended Tue Jan 14 19:55:27 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)19:55
openstackMinutes:        http://eavesdrop.openstack.org/meetings/infra/2020/infra.2020-01-14-19.01.html19:55
corvusthanks clarkb !19:55
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/infra/2020/infra.2020-01-14-19.01.txt19:55
openstackLog:            http://eavesdrop.openstack.org/meetings/infra/2020/infra.2020-01-14-19.01.log.html19:55
*** Shrews has left #openstack-meeting19:55
fungithanks clarkb!19:56
*** slaweq has quit IRC20:02
*** ralonsoh has quit IRC20:06
*** maciejjozefczyk has joined #openstack-meeting20:13
*** slaweq has joined #openstack-meeting20:20
*** brinzhang_ has joined #openstack-meeting20:24
*** maciejjozefczyk has quit IRC20:25
*** slaweq has quit IRC20:25
*** brinzhang has quit IRC20:27
*** maciejjozefczyk has joined #openstack-meeting20:29
*** slaweq has joined #openstack-meeting20:33
*** artom has quit IRC20:33
*** brinzhang has joined #openstack-meeting20:43
*** bbowen has quit IRC20:45
*** brinzhang_ has quit IRC20:46
*** tesseract has quit IRC20:50
*** maciejjozefczyk has quit IRC20:50
*** ykatabam has joined #openstack-meeting20:57
*** senrique_ is now known as enriquetaso20:59
*** jamesmcarthur has quit IRC20:59
*** jamesmcarthur has joined #openstack-meeting21:03
*** jamesmcarthur has quit IRC21:16
*** brinzhang_ has joined #openstack-meeting21:21
*** brinzhang has quit IRC21:24
*** jamesmcarthur has joined #openstack-meeting21:46
*** bbowen has joined #openstack-meeting21:54
*** mattw4 has quit IRC21:55
*** rcernin has joined #openstack-meeting22:08
*** brinzhang has joined #openstack-meeting22:20
*** jamesmcarthur has quit IRC22:23
*** brinzhang_ has quit IRC22:23
*** slaweq has quit IRC22:34
*** enriquetaso has quit IRC22:39
*** enriquetaso has joined #openstack-meeting22:39
*** enriquetaso has quit IRC22:41
*** enriquetaso has joined #openstack-meeting22:42
*** mattia has quit IRC22:42
*** enriquetaso has quit IRC22:50
*** enriquetaso has joined #openstack-meeting22:50
*** gmann_afk is now known as gmann22:53
*** igordc has joined #openstack-meeting22:58
*** igordc has quit IRC23:01
*** igordc has joined #openstack-meeting23:01
*** igordc has quit IRC23:02
*** igordc has joined #openstack-meeting23:03
*** igordc has quit IRC23:06
*** igordc has joined #openstack-meeting23:07
*** igordc has quit IRC23:09
*** igordc has joined #openstack-meeting23:10
*** igordc has quit IRC23:11
*** igordc has joined #openstack-meeting23:12
*** igordc has quit IRC23:14
*** igordc has joined #openstack-meeting23:15
*** igordc has quit IRC23:19
*** armax has quit IRC23:30
*** ociuhandu has joined #openstack-meeting23:30
*** ociuhandu has quit IRC23:35
*** dviroel has quit IRC23:37
*** enriquetaso has quit IRC23:48

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!