Tuesday, 2020-02-11

*** slaweq has quit IRC00:04
*** mattw4 has quit IRC00:08
*** jamesmcarthur has joined #openstack-meeting00:14
*** jamesmcarthur has quit IRC00:19
*** Liang__ has joined #openstack-meeting00:20
*** jamesmcarthur has joined #openstack-meeting00:24
*** jamesmcarthur has quit IRC00:29
*** enriquetaso has joined #openstack-meeting00:36
*** rfolco has quit IRC01:19
*** yamamoto has joined #openstack-meeting01:30
*** armax has quit IRC01:39
*** enriquetaso has quit IRC01:42
*** david-lyle is now known as dklyle02:05
*** psachin has joined #openstack-meeting02:06
*** jamesmcarthur has joined #openstack-meeting02:09
*** yamamoto has quit IRC02:24
*** nicolasbock has quit IRC02:28
*** jamesmcarthur has quit IRC02:28
*** jamesmcarthur has joined #openstack-meeting02:31
*** dmacpher has quit IRC02:31
*** dmacpher has joined #openstack-meeting02:34
*** jamesmcarthur has quit IRC02:42
*** mhen has quit IRC02:47
*** yamamoto has joined #openstack-meeting03:00
*** yamamoto has quit IRC03:03
*** gyee has quit IRC03:11
*** hongbin has joined #openstack-meeting03:48
*** shilpasd has joined #openstack-meeting04:03
*** yamamoto has joined #openstack-meeting04:37
*** yamamoto has quit IRC04:40
*** hongbin has quit IRC04:41
*** rbudden has quit IRC04:47
*** vesper has quit IRC05:18
*** vesper11 has joined #openstack-meeting05:23
*** lajoskatona has joined #openstack-meeting05:43
*** igordc has joined #openstack-meeting05:51
*** shilpasd has quit IRC05:53
*** lajoskatona has left #openstack-meeting05:54
*** jmasud has joined #openstack-meeting05:56
*** igordc has quit IRC06:00
*** dkushwaha has joined #openstack-meeting06:58
*** lpetrut has joined #openstack-meeting07:03
*** maciejjozefczyk has joined #openstack-meeting07:08
*** Lucas_Gray has joined #openstack-meeting07:52
*** e0ne has joined #openstack-meeting07:57
*** e0ne has quit IRC08:00
dkushwaha#startmeeting tacker08:02
openstackMeeting started Tue Feb 11 08:02:56 2020 UTC and is due to finish in 60 minutes.  The chair is dkushwaha. Information about MeetBot at http://wiki.debian.org/MeetBot.08:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.08:02
*** openstack changes topic to " (Meeting topic: tacker)"08:02
openstackThe meeting name has been set to 'tacker'08:03
dkushwaha#topic RollCall08:03
*** openstack changes topic to "RollCall (Meeting topic: tacker)"08:03
dkushwahawho is here for tacker meeting?08:03
*** jaewook_oh has joined #openstack-meeting08:09
*** jaewook_oh has quit IRC08:09
dkushwahaoh, looks no one available for meeting today..08:09
dkushwahaclosing today's meeting.08:10
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"08:10
openstackMeeting ended Tue Feb 11 08:10:46 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)08:10
openstackMinutes:        http://eavesdrop.openstack.org/meetings/tacker/2020/tacker.2020-02-11-08.02.html08:10
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/tacker/2020/tacker.2020-02-11-08.02.txt08:10
openstackLog:            http://eavesdrop.openstack.org/meetings/tacker/2020/tacker.2020-02-11-08.02.log.html08:10
*** jmasud has quit IRC08:11
*** jmasud has joined #openstack-meeting08:13
*** dkushwaha has quit IRC08:21
*** priteau has joined #openstack-meeting08:28
*** tesseract has joined #openstack-meeting08:29
*** Lucas_Gray has quit IRC08:39
*** e0ne has joined #openstack-meeting08:42
*** e0ne has quit IRC08:44
*** Lucas_Gray has joined #openstack-meeting08:47
*** ralonsoh has joined #openstack-meeting08:52
*** rpittau|afk is now known as rpittau08:55
*** Lucas_Gray has quit IRC09:00
*** Lucas_Gray has joined #openstack-meeting09:01
*** slaweq has joined #openstack-meeting09:07
*** lucasagomes has joined #openstack-meeting09:16
*** jiaopengju1 has quit IRC09:26
*** ociuhandu has joined #openstack-meeting09:28
*** takamatsu has joined #openstack-meeting09:28
*** ociuhandu has quit IRC09:29
*** Lucas_Gray has quit IRC09:33
*** psachin has quit IRC09:42
*** psachin has joined #openstack-meeting09:47
*** Lucas_Gray has joined #openstack-meeting09:51
*** psachin has quit IRC09:54
*** slaweq has quit IRC09:56
*** e0ne has joined #openstack-meeting09:57
*** psachin has joined #openstack-meeting10:02
*** ociuhandu has joined #openstack-meeting10:06
*** ociuhandu has quit IRC10:09
*** ociuhandu has joined #openstack-meeting10:09
*** ociuhandu has quit IRC10:10
*** ociuhandu has joined #openstack-meeting10:11
*** ociuhandu has quit IRC10:18
*** psachin has quit IRC10:20
*** ociuhandu has joined #openstack-meeting10:20
*** psachin has joined #openstack-meeting10:21
*** ociuhandu has quit IRC10:21
*** ociuhandu has joined #openstack-meeting10:26
*** ociuhandu has quit IRC10:27
*** priteau has quit IRC10:28
*** ociuhandu has joined #openstack-meeting10:29
*** ociuhandu has quit IRC10:30
*** TomStappaerts has joined #openstack-meeting10:33
*** priteau has joined #openstack-meeting11:03
*** ociuhandu has joined #openstack-meeting11:04
*** ociuhandu has quit IRC11:09
*** ociuhandu has joined #openstack-meeting11:13
*** ociuhandu has quit IRC11:18
*** rpittau is now known as rpittau|bbl11:21
*** fungi has quit IRC11:24
*** fungi has joined #openstack-meeting11:27
*** TomStappaerts has quit IRC11:31
*** moguimar has quit IRC11:31
*** TomStappaerts has joined #openstack-meeting11:31
*** moguimar has joined #openstack-meeting11:33
*** yamamoto has joined #openstack-meeting11:41
*** TomStappaerts has quit IRC11:49
*** TomStappaerts has joined #openstack-meeting11:49
*** yamamoto has quit IRC11:49
*** ociuhandu has joined #openstack-meeting11:51
*** yamamoto has joined #openstack-meeting11:55
*** ociuhandu has quit IRC11:57
*** Lucas_Gray has quit IRC11:59
*** yamamoto has quit IRC12:01
*** ociuhandu has joined #openstack-meeting12:01
*** nicolasbock has joined #openstack-meeting12:01
*** rfolco has joined #openstack-meeting12:02
*** TomStappaerts has quit IRC12:09
*** ricolin has quit IRC12:10
*** TomStappaerts has joined #openstack-meeting12:10
*** sluna has joined #openstack-meeting12:10
*** jmasud has quit IRC12:11
*** jmasud has joined #openstack-meeting12:14
*** raildo has joined #openstack-meeting12:14
*** ociuhandu has quit IRC12:31
*** yamamoto has joined #openstack-meeting12:32
*** ociuhandu has joined #openstack-meeting12:34
*** dmacpher has quit IRC12:35
*** Lucas_Gray has joined #openstack-meeting12:36
*** TomStappaerts has quit IRC12:46
*** TomStappaerts has joined #openstack-meeting12:47
*** yamamoto has quit IRC13:02
*** rh-jelabarre has joined #openstack-meeting13:07
*** takamatsu has quit IRC13:14
*** jamesmcarthur has joined #openstack-meeting13:15
*** Lucas_Gray has quit IRC13:18
*** Lucas_Gray has joined #openstack-meeting13:18
*** rpittau|bbl is now known as rpittau13:22
*** Lucas_Gray has quit IRC13:24
*** jamesmcarthur has quit IRC13:24
*** jamesmcarthur has joined #openstack-meeting13:25
*** jamesmcarthur has quit IRC13:28
*** jamesmcarthur has joined #openstack-meeting13:28
*** rosmaita has left #openstack-meeting13:29
*** jamesmcarthur has quit IRC13:35
*** takamatsu has joined #openstack-meeting13:37
*** davidsha has joined #openstack-meeting13:37
*** Lucas_Gray has joined #openstack-meeting13:37
*** enriquetaso has joined #openstack-meeting13:43
*** jamesmcarthur has joined #openstack-meeting13:43
*** Lucas_Gray has quit IRC13:50
*** Lucas_Gray has joined #openstack-meeting13:52
*** lajoskatona has joined #openstack-meeting14:02
*** lajoskatona has quit IRC14:26
*** takamatsu has quit IRC14:29
*** TrevorV has joined #openstack-meeting14:35
*** dmacpher has joined #openstack-meeting14:44
*** Liang__ is now known as LiangFang14:44
*** vishalmanchanda has joined #openstack-meeting14:51
*** TomStappaerts has quit IRC14:55
*** TomStappaerts has joined #openstack-meeting14:56
*** ociuhandu has quit IRC14:57
ralonsoh#startmeeting neutron_qos15:01
openstackMeeting started Tue Feb 11 15:01:01 2020 UTC and is due to finish in 60 minutes.  The chair is ralonsoh. Information about MeetBot at http://wiki.debian.org/MeetBot.15:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:01
*** openstack changes topic to " (Meeting topic: neutron_qos)"15:01
openstackThe meeting name has been set to 'neutron_qos'15:01
ralonsohI don't think slawek is going to join us today15:01
ralonsohlet's wait 30 secs more15:01
ralonsoh#topic RFEs15:02
*** openstack changes topic to "RFEs (Meeting topic: neutron_qos)"15:02
ralonsoh#link https://bugs.launchpad.net/neutron/+bug/147652715:03
openstackLaunchpad bug 1476527 in neutron "[RFE] Add common classifier resource" [Wishlist,Triaged] - Assigned to Igor D.C. (igordcard)15:03
ralonsohdavidsha, ^15:03
*** artom has joined #openstack-meeting15:04
davidshaYa, I'm wrapping up the unit tests on the service plugin atm, however my team is being redeployed onto other tasks so I won't be able to continue development of the feature going forward.15:04
ralonsohdavidsha, so are you going to stop the development of the feature?15:05
davidsharalonsoh: yesll post an update onto the patches so everyone is aware.15:05
*** bbowen has quit IRC15:06
*** bbowen has joined #openstack-meeting15:06
ralonsohok, I'll pack all the open patches in the bug15:06
ralonsohjust to have them in a single place15:06
ralonsohbut I no one is going to continue the development, I don't think we should merge any of them15:07
ralonsohincluding the first one, the n-lib one15:07
davidshaack, I'll put a workflow -1 on the patches for the time being.15:08
*** enriquetaso has quit IRC15:08
ralonsohanyway, thank you very much for working in such a difficult feature15:09
*** artom has quit IRC15:09
ralonsohand if you are not going to work (for now) in OpenStack, thank you very much for your time15:09
ralonsohit was a pleasure to work with you  in the same team15:10
davidshathanks, and thank you for all the reviews and recommendations, I'll need to message Lajos aswell and thank them for the API test work15:10
davidshaThank you, the pleasure was all mine :)15:10
ralonsohok, let's move then to the next RFE we have15:11
ralonsoh#link https://bugs.launchpad.net/neutron/+bug/185861015:11
openstackLaunchpad bug 1858610 in neutron "[RFE] Qos policy not supporting sharing bandwidth between several nics of the same vm." [Undecided,New]15:11
*** takamatsu has joined #openstack-meeting15:11
ralonsohwe are still debating the in launchpad about the feasibility of this feature15:11
ralonsohwe have 3 debating points15:12
davidshaYou would need to aggreagate all the ports is it?15:12
*** artom has joined #openstack-meeting15:12
ralonsohthat's one question15:12
ralonsohlest' start by15:12
*** artom has quit IRC15:12
ralonsoh1) the db model15:12
ralonsohthis is the easiest one15:12
*** artom has joined #openstack-meeting15:13
ralonsohto create a new qos rule, but this rule is exclusive with maxBW15:13
ralonsoha qos policy can have maxBW or maxBW shared15:13
ralonsohnot both15:13
ralonsoh(this must be defined with more detail in a spec)15:13
ralonsoh2) the neutron server15:13
ralonsohare we going to allow ports from different VMs with the same qos rule?15:14
ralonsoha rule can define how a port is scheduled?15:14
ralonsohIMO, we should NOT block a VM to be scheduled if a port has a shared maxBW rule and there are others ports, in different VMs, with this rule15:15
ralonsohin this case, the aggreagation is per VM level15:15
ralonsohand the shared BW will apply only for ports in the same VM with the same maxBW shared qos rule15:16
ralonsoh(but this is just my opinion, no spec is defined yet)15:16
ralonsohdavidsha, any comment?15:16
davidsharalonsoh, Just so I'm clear, is it a 1:1 mapping of Rule to VM to say all these ports with these rules are in the same VM?15:17
davidshawith *this* rule are in the same VM*15:17
ralonsohthere is no 1:1 mapping between rule and VM15:18
ralonsohthat's what I want to avoid15:18
ralonsohif we do this, we need to create a placement resource provider to limit the port scheduling15:18
ralonsohand.... this is too much for this RFE15:18
ralonsoh(just my opinion)15:19
davidshaThis nearly sounds like it should be a policy applied to the instance rather than the port.15:19
ralonsohyou can have VMs with ports with the same rule15:19
ralonsoh1 maxBW shared rule15:19
ralonsohapplied to 100 ports, 10 per VM15:19
ralonsohthe 10 ports assigned to a VM will share the defined BW15:19
ralonsohof course, this must be enforced in the backend15:20
ralonsohand this is the third point15:20
ralonsoh3) backend15:20
ralonsoh3.1) LB: similar to the proposal Jie is doing, but I would like to see more detail on this15:20
ralonsoh3.2) OVS: IMO, we **cannnot** introduce a LB in the middle of br-int and a device port15:22
ralonsohthis won't work with DPDK or offload HW15:22
davidshawith DPDK, probably not.15:22
*** Lucas_Gray has quit IRC15:23
ralonsohand that's why I would like Jie to propose a spec, to define those points15:23
*** jamesmcarthur has quit IRC15:23
davidshaFor OvS, it's QoS objects do let you route traffic into queues, I think it's only for egress traffic though15:23
ralonsohdavidsha, you can make it work like in hybrid OVS15:24
ralonsohwith a LB in the middle of br-int and the VM15:24
ralonsohand using the same strategy as in LB15:24
ralonsohbut the performance...15:24
ralonsohand as I said, some compatibility issues15:25
davidshaIt's possible, just not practicle.15:25
*** Lucas_Gray has joined #openstack-meeting15:25
*** jamesmcarthur has joined #openstack-meeting15:26
ralonsohok, let's move to next section15:26
ralonsoh#topic Bugs15:26
*** openstack changes topic to "Bugs (Meeting topic: neutron_qos)"15:26
ralonsoh#link https://bugs.launchpad.net/neutron/+bug/185317115:26
openstackLaunchpad bug 1853171 in neutron "Deprecate and remove any "ofctl" code in Neutron and related projects " [Medium,In progress] - Assigned to David Shaughnessy (david-shaughnessy)15:26
ralonsohas commented, this will take time15:26
davidshaI'm looking into the firewall file at the moment, I'll try to push some initial work for it.15:27
ralonsohno rush15:27
*** ociuhandu has joined #openstack-meeting15:28
ralonsohand the next one we have is15:28
ralonsoh#link https://bugs.launchpad.net/neutron/+bug/164852515:28
openstackLaunchpad bug 1648525 in neutron "[OVN] QoS doesn't work with DVR, vlan tenant networks or provider networks." [Undecided,New]15:28
ralonsoh(filled in 2016)15:28
ralonsohI'll talk to OVN guys to know more about this bug15:29
ralonsohand how to reproduce it15:29
ralonsohso far, I don't have more information about it15:29
ralonsohand that's all I have15:30
ralonsoh#topic Open Discussion15:30
*** openstack changes topic to "Open Discussion (Meeting topic: neutron_qos)"15:30
ralonsohdo you have something for this section, davidsha ?15:30
*** armax has joined #openstack-meeting15:30
davidshaJust to thank everyone again, I enjoyed working with you all and hope to get the chance again!15:31
ralonsohfor sure15:31
ralonsohthank you very much!15:31
ralonsohand see you around15:31
davidshaSee you!15:31
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"15:32
openstackMeeting ended Tue Feb 11 15:32:10 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:32
openstackMinutes:        http://eavesdrop.openstack.org/meetings/neutron_qos/2020/neutron_qos.2020-02-11-15.01.html15:32
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/neutron_qos/2020/neutron_qos.2020-02-11-15.01.txt15:32
openstackLog:            http://eavesdrop.openstack.org/meetings/neutron_qos/2020/neutron_qos.2020-02-11-15.01.log.html15:32
*** jamesmcarthur has quit IRC15:38
*** enriquetaso has joined #openstack-meeting15:42
*** jamesmcarthur has joined #openstack-meeting15:46
*** ociuhandu has quit IRC15:54
*** lajoskatona has joined #openstack-meeting15:55
*** lpetrut has quit IRC16:01
*** Lucas_Gray has quit IRC16:02
*** Trevor_V has joined #openstack-meeting16:03
*** lajoskatona has left #openstack-meeting16:06
*** TrevorV has quit IRC16:07
*** ociuhandu has joined #openstack-meeting16:11
*** rf0lc0 has joined #openstack-meeting16:11
*** ociuhandu has quit IRC16:12
*** ociuhandu has joined #openstack-meeting16:12
*** rfolco has quit IRC16:13
*** gyee has joined #openstack-meeting16:32
*** senrique_ has joined #openstack-meeting16:33
*** enriquetaso has quit IRC16:36
*** e0ne has quit IRC16:40
*** e0ne has joined #openstack-meeting16:41
*** slaweq has joined #openstack-meeting16:47
*** e0ne has quit IRC16:51
*** rpittau is now known as rpittau|afk17:00
*** priteau has quit IRC17:00
*** lucasagomes has quit IRC17:02
*** jmasud has quit IRC17:13
*** jmasud has joined #openstack-meeting17:14
*** gmann is now known as gmann_afk17:20
*** igordc has joined #openstack-meeting17:24
*** ociuhandu_ has joined #openstack-meeting17:26
*** kopecmartin is now known as kopecmartin|afk17:27
*** mattw4 has joined #openstack-meeting17:29
*** ociuhandu has quit IRC17:29
*** ociuhandu_ has quit IRC17:30
*** anastzhyr has joined #openstack-meeting17:37
*** jamesmcarthur has quit IRC17:40
*** e0ne has joined #openstack-meeting17:42
*** e0ne has quit IRC17:58
*** igordc has quit IRC18:02
*** igordc has joined #openstack-meeting18:06
*** davidsha has quit IRC18:07
*** macz has joined #openstack-meeting18:15
*** hjensas has quit IRC18:21
*** umbSublime has quit IRC18:23
*** maciejjozefczyk has quit IRC18:23
*** armax has quit IRC18:32
*** ralonsoh has quit IRC18:33
*** TomStappaerts has quit IRC18:40
*** TomStappaerts has joined #openstack-meeting18:40
*** imcsk8 has joined #openstack-meeting18:44
*** gmann_afk is now known as gmann18:49
*** senrique_ has quit IRC18:54
*** psachin has quit IRC18:57
clarkbmeeting time anyone else here for the meeting?19:00
clarkb*infra meeting19:00
clarkbThings have been on fire today. We'll probably be split brained as a result19:00
clarkb#startmeeting infra19:01
openstackMeeting started Tue Feb 11 19:01:15 2020 UTC and is due to finish in 60 minutes.  The chair is clarkb. Information about MeetBot at http://wiki.debian.org/MeetBot.19:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.19:01
*** openstack changes topic to " (Meeting topic: infra)"19:01
openstackThe meeting name has been set to 'infra'19:01
clarkb#link http://lists.openstack.org/pipermail/openstack-infra/2020-February/006599.html Our Agenda19:01
clarkb#topic Announcements19:01
*** openstack changes topic to "Announcements (Meeting topic: infra)"19:01
clarkbI'm going to use this topic to give a quick tldr on our current fires19:01
clarkbvirtualenv>=20.0.0,<20.0.2 by default installs "seed" packages: pip, setuptools, wheel, and probably something I'm forgetting via symlinks to a common user dir19:02
clarkbThis causes problems if you then copy the virtualenv to someplace else or if you run software out of that venv as a user other than the user that created it and can't follow the symlinks due to permissions errors19:02
clarkbThe first issue hit zuul due to its use of bwrap and the second is hitting opendev's test node images because we have root create venvs for bindep and os-testr19:03
clarkbthen the zuul user can't access the files in /root/.local/some/path to resolve the symlinks in the venv19:03
fungiseemed like a great idea at the time19:03
clarkbThe fix has been to use virtualen --seeder=pip which installs the seed packages normally using pip. But virtualenv==20.0.2 just released like 10 minutes ago to change the default to a file copy not symlink19:04
zbrthe seed issue painful than the incompatibility with six that was introduced.19:04
clarkbright there is a seprate issue that affects you if you use new virtualenv with old six (possibly from distro packages)19:05
clarkbas old six isn't compatible with new virtualenv19:05
zbrmainly neither of the versions of six shipping with centos-8 or centos-7 are compatible with virtualenv 20.x, but somehow that virtualenv gets installed without upgrading six.19:06
clarkbzbr: virtualenv probably doesn't specify a lower bound for six19:06
zbrobviously that overriding the system installed six is another sensitive issue.19:06
clarkbso the installed version is seen as sufficient19:06
clarkboverall it seems we have a handle on things and if we get new images (which I've triggered builds for) we'll settle down and be happy19:06
clarkbthere is also a base jobs workaround that mordred wrote which we should revert once the dust settles19:07
*** maciejjozefczyk has joined #openstack-meeting19:07
mordredyeah. although I think we can go through the normal base-test process to verify it19:07
fungi    six>=1.12.0,<219:07
fungiit's in the install_requires19:07
fungii suspect some jobs are installing distro packages overtop it19:08
zbri know it does, but I also know what I seen in the wild. newer virtualenv complaining about that import from six.19:08
clarkbat this point I think we want to double check any new reports to nesure they aren't different bugs and if not encourage patience, however jobs that start after now (mordreds workaround landing and its fix landing) should be good to go19:08
fricklerqueens and rocky u-c also install six==1.11.019:09
clarkboh right devstack has some pin virtualenv changes to land, thank you frickler19:09
fungipip also probably still doesn't catch when you incompatibly downgrade a dependency in a separate command19:10
clarkbfungi: it does not19:10
mordredthe main thing that triggers that conflict seems to be pip installing tox on a system where python libs are otherwise installed via distro packages19:10
fungiafaik its dependency resolver still doesn't track dependencies for already-installed packages19:10
clarkb(that is something the dependency resolver work in pip should address)19:10
mordredso - I think the contraint bump on six fixes the symptom19:10
mordredbut people should take this as an opportunity to go look at whether they can stop pip installing tox on systems where they install six via packages19:11
mordredbecause that _will_ break again if not addressed19:11
*** LiangFang has quit IRC19:11
fungior switch to the tox-venv plugin if they only test python319:11
zbrand how about systems where tox is not packaged?19:11
mordredmight mean someone making a good usable rpm for tox even19:11
clarkbzbr: then six and tox should probably both come from pypi and not be mixed19:12
mordredzbr: yeah - I'm not saying I know waht the solution is - just that the people who are in that circumstance should look at the options19:12
mordredfungi's is a good one19:12
zbrfungi: i wanted to propose we intall tox-venv by default with tox, it could help us avoid that .... virtualenv issue.19:12
clarkbmordred: ++19:12
mordredalthough tox still has to get installed19:12
fungizbr: i use it heavily for python3-only projects outside openstack19:12
mordredso there's still the issue that tox+six exposes19:12
mordredI'm not going to dig in to it any further - just more a warning that whoever is in the distro-six+pip-tox is _going_ to be broken again in the future19:13
clarkb++ anything else on this? I don't think we should solve all the problems here, but I wanted to do a sumamry to ensure we all had a rough picture of what was going on19:13
clarkbas we are getting many questions19:13
zbranyone against adding tox-venv?19:13
*** senrique_ has joined #openstack-meeting19:14
clarkbzbr: I don't think so but we may have to sort out what that means for python2 ? something to figure otu in review likely19:14
mordredyeah. I think it's worth exploring19:14
fungiit's a good point, `pip install tox` still installs virtualenv whether or not you use it (but if you use tox-venv then virtualenv is not invoked at least)19:14
mordredit still might not solve our issue though19:14
mordredbecause of that ^^19:14
zbrclarkb: it means nothing, tox-venv on python fallback to virtualenv19:14
clarkbya we can debug further after the meeting19:15
zbrit is clearly documented that on platforms where venv is not available, tox-venv will let tox use virtalenv.19:15
fungibut yeah, we can likely move on with the meeting19:15
*** e0ne has joined #openstack-meeting19:15
clarkbMy other last minute announcement is that I have to pop out of the meeting early in order to get kids from school. If we aren't done at about 19:45 fungi has volunteered to take over the chair duties19:15
clarkbJust a heads up that I'll be popping out in about half an hour19:15
fungiso let's wrap up in 30 minutes ;)19:16
fungiotherwise you have to deal with more of me19:16
clarkb#topic Actions from last meeting19:16
*** openstack changes topic to "Actions from last meeting (Meeting topic: infra)"19:16
clarkb#link http://eavesdrop.openstack.org/meetings/infra/2020/infra.2020-02-04-19.01.txt minutes from last meeting19:16
clarkbThere were no actions.19:16
clarkb#topic Priority Efforts19:16
*** openstack changes topic to "Priority Efforts (Meeting topic: infra)"19:16
clarkb#topic OpenDev19:16
*** openstack changes topic to "OpenDev (Meeting topic: infra)"19:16
clarkbmordred: where did we end up with the upgrading gitea stack (if we ignore that landing changes right now might be difficult)19:17
clarkbiirc there was a 1.10.3 upgrade that should be safe, then on top of that a 1.11.0rcX change and then on top of that a roll out master for git cache19:18
clarkbI expect we can land 1.10.3 real soon now then evaluate test results for the other changes?19:18
clarkb(I think mordred is distracted)19:18
mordred1.10.3 is safe to land19:19
mordred1.11 I should go WIP - there are template changes that need to be updated19:19
mordredhowever - we're in good shape broadly because 1.11 and master both at least _build_19:19
clarkb#link https://review.opendev.org/#/c/705804/ upgrade gitea to 1.10.319:19
mordredit's worth noting that 1.11 is using npm directly - so we have to install that into the builder image19:19
clarkbmordred: nodenv might make that easy then we can rm -rf the virtualenv?19:20
mordredclarkb: doesn't matter - it's in the builder image19:20
mordredwe don't use that image in the final output19:20
clarkboh right we build in a throwaway19:20
*** armax has joined #openstack-meeting19:21
clarkbeven if we don't land those right away we'll at least be ready when those releases are cut19:21
clarkbseems worthwhile, thank y ou for that19:21
clarkb(1.12.0 adds the git commit cache to gitea which should speed up rendering time for large repos like nova)19:22
clarkbAnything else on the opendev topic?19:22
clarkb#topic Update Configuration Management19:23
diablo_rojoHave you given thoughts to the docs question I posed in the TC patch?19:23
*** openstack changes topic to "Update Configuration Management (Meeting topic: infra)"19:23
diablo_rojoToo slow lol19:23
openstackRemoving item from minutes: #topic Update Configuration Management19:23
clarkbdiablo_rojo: were there new ones or the ones about user guide?19:23
diablo_rojothe one about the infra manual also being moved out and having openstack specific things extracted into the contrib guide19:24
fungii suspect we're all in agreement the infra manual is going to need a bit of an overhaul and splitting/deopenstacking19:24
*** e0ne has quit IRC19:24
*** maciejjozefczyk has quit IRC19:25
clarkbdiablo_rojo: I guess from openstack's perspective the contributor guide and infra-manual openstack specific bits might be redundant?19:25
clarkbdiablo_rojo: and so it doesn't make sense to keep infra-manual the repo under governance?19:25
fungia bit of dope'n'stacking yes19:25
clarkbif that is the case we can remove it from the yaml file then next time we do a repo renaming move it into opendev/ and work to dopenstack it19:26
diablo_rojothe definitely are redundant which is why I think it would make sense to move the infra manual out and keep the openstack specifics to the contributor guide and keep the opendev stuff to the infra manual19:26
diablo_rojoAgreed :)19:27
clarkbdiablo_rojo: ok, in that case I'll push up a new ps19:27
clarkbany objections to ^19:27
fungii'm on board19:27
fungithanks for the great suggestion, diablo_rojo!19:27
diablo_rojoDouble woot :)19:28
clarkbalright next up is config mgmt19:28
diablo_rojoglad I spoke up :)19:28
diablo_rojothanks clarkb!19:28
clarkb#topic Update Config Management19:28
*** openstack changes topic to "Update Config Management (Meeting topic: infra)"19:28
clarkbmordred: I think despite fires there has been good progress on gerrit ansible+docker?19:28
clarkbincluding addition of LE?19:28
mordredyes! fungi made a great comment which I didn't see19:29
fungii'll try to make my comments more visible in the future19:29
mordreduntil earlier today - which is that we should also grab the LE stuff for the .openstack.org versions so we can do the redirects19:29
mordredso I've got the LE dns records in place for review and review-dev in rackspace dns19:30
fungicutting over without the review.openstack.org redirect would have been not great19:30
mordredand have updated the stack to include the redirects19:30
fungiand now it's failing a puppet4 job19:30
mordredthat stack needs a good recheck after this morning's fun19:30
fungi(in case you haven't seen)19:30
mordred(eyah - that's a virtualenv based issue)19:30
fungigot it19:30
mordredhttps://review.opendev.org/#/c/707214/ <--19:31
clarkbI filed a bug upstream in voxpululi but ^ works around it for us19:31
mordredthat should be the fix for the virtualenv issue19:31
clarkbhttps://github.com/voxpupuli/puppet-python/issues/534 if curous19:31
mordredpuppet askbot will also be borked19:31
clarkbmordred: can probably use a similar workaround there?19:31
*** senrique_ has quit IRC19:32
mordredthat said ...19:33
mordredassuming the puppet patch works and the gerrit stack goes green - a) it's ready for review :) ...19:33
mordredb) we should talk about how we want to do the actual review.o.o19:33
ianwi should move that afsmon call to mirror-update.opendev.org anyway19:33
mordred(cant' remember if I mentioned, but review-dev.opendev.org is running from the tip of the previous rev of that stack - minus the redirects)19:33
clarkbmordred: is this on xenial or bionic (the new stuff)19:34
mordredbecause review.o.o is xenial19:34
clarkbok so we don't have to create a new server and cut over if we don't want to19:34
clarkbbut that may still be a good idea just to start clean?19:34
corvusdo we feel like we need to do the new ip notification dance?19:35
mordrednah - I think let's go with what we've got for now - new server and cutover is a bunch more work19:35
clarkbmordred: got it and good point corvus (we probably would want to do that at least for a week or two)19:35
mordredwe've got decent runway on xenial right?19:36
corvusin which case, yeah, let's keep the existing :)19:36
mordredthe container shift should protect us from userland impacting needs for upgrading for a while longer19:36
clarkbmordred: ~14 months19:36
mordredyeah. that's awesome. we should be able to get firmly onto 3.x and be happy with our container workflow in that time :)19:36
clarkband bionic is 10 yaers of support so we can just park there and retire :)19:37
clarkbalright anything else or should we move on?19:37
fungii got nothin'19:38
clarkb#topic General Topics19:38
*** openstack changes topic to "General Topics (Meeting topic: infra)"19:38
clarkbFirst up, we've been asked if we will want space at the Vancvouer PTG19:38
clarkbI plan to be there and expect that fungi does as well19:38
fungiit's a swell place19:38
clarkbif we have more than 2 I'll fill out the form and request a spot19:39
clarkbso let me know if you think you'll be there19:39
fungicould be opendev or openstack infra i guess19:39
clarkbya I think the overlap will still be large and won't try to be specific to one or the other19:39
mordredI imagine I'll be there - but I'm still in "I don't want to travel anywhere ever again" mindset ...19:40
clarkbI have about 3 weeks to answer so no rush but sooner is probably better for diablo_rojo19:40
clarkbNext up is server upgrades. I'll start with a quick refstack update then ianw and fungi can add wiki and static updates19:40
fungimordred: at least it's within the same conference?19:41
fungier, same continent19:41
* fungi struggles with words19:41
clarkbWith refstack apparently some of the board is still interested in running that service. The foundation is going to ask around and see if any of that translates to willingness to maintain the software19:41
mordredfungi: I did my due-dilligence on amtrak19:41
clarkbI pointed out that I don't think it is significant amounts of work, but someone does need to do it.19:42
clarkbUntil then I'll sit on my dockerfied refstack stack19:42
clarkbfungi: any wiki updates?19:42
fungiyeah, if the board is interested in running the service, then the board should run th eservice19:42
fungino new updates since just prior to fosdem. i've gotten little done in the post-fosdem hangover fog19:42
fungistill need to test plugins now that we have content loading19:43
*** vishalmanchanda has quit IRC19:43
clarkbianw: any thing new on static?19:43
fungiit's basically done except for tarballs, yeah?19:44
ianwumm, i wouldn't say so unfortunately19:44
fungialso i suspect we didn't actually need to migrate the logs site19:44
ianwis ready for review19:44
clarkbah ok need the modified afs vos release toolchain19:44
ianwthere are changes to publish tarballs to AFS in parallel19:44
ianwi have also proposed as clarkb mentions some changes so we can make a dashboard for vos release19:45
ianwbecause i'm a little concerned this will be the biggest volume by far in that path19:45
fungiclarkb: have you #chair'ed me? you need to scoot now, right?19:45
clarkbya I need to scoot19:45
clarkb#chair fungi19:45
openstackCurrent chairs: clarkb fungi19:45
* fungi cackles maniacally with power19:46
clarkbthanks! and I'm out19:46
fungii agree, having good stats around vos release timing should be helpful19:46
ianwthere's still releases after this, and then a few other straggler sites19:46
fungithough hopefully the updates to that volume are not high-impact, as they're generally incremental and append-only19:47
fungi(tarballs i mean)19:47
ianwyep -- i certainly hope that's the case and we see no issues at all :)19:47
fungiit's not like the mirror volumes where we add and delete (far more) data19:48
ianwthere's also the option to serve directly from the r/w volume, at, AIUI at cost of much more network traffic ... but given the loads on the server it may be acceptable19:48
fungialso i'm complicating matters by adding docs.airshipit.io into the mix19:49
ianwanyway, i'll chase up on things as the virtualenvopolypse settles19:49
fungibut it's at least helping me better understand the tooling around all of this19:49
fungii should be able to review the rest of the vos release stack after the meeting19:50
ianwthanks; happy to babysit it as appropriate19:51
fungiokay, on to...19:52
fungiNew Arm64 cloud (ianw 20200211)19:52
ianwi think that is, as they say, fully operational now19:52
ianwwe had some teething problems with routing and storage, but we migrated nb03 to the new region and it appears to be working19:53
fungii appreciate the death star reference19:53
ianwkevinz fixed ceph on the london side so our orphaned images disappeared yesterday afternoon my time19:54
* corvus tries to remember tarkin discussing teething problems19:54
fungithough an upshot of that is we discovered an unresponsive provider will block the image cleanup thread from processing old images in other providers on the same builder19:54
fungicorvus: the "fully operational" line19:54
ianwso, i'm not aware of any outstanding issues19:55
corvusfungi: i'm going to pursue the teething line of inquiry19:55
fungimoff corvus19:55
ianwnote we have "check-arm64" for anyone who would like to add jobs but is a bit shy to put them in their main gate19:55
ianwi think we can promote that more now that we have a bigger cloud, and as it proves itself people can promote jobs to main gates19:56
fungiwhat's the rough quota now?19:56
corvusthis is our second region, right?19:56
fungisecond but, as i understand, much larger?19:56
ianwyes, i think it's 8 nodes in london, and about 48 in US19:56
fungithat is substantial, yes (6x)19:56
fungiso lon may as well not exist, by comparison19:57
fungiif we see significant uptake and then usa falls offline, lon isn't going to make much of a dent in the backlog19:58
fungiwe have like a minute to talk about the airship cloud19:58
fungiand clarkb isn't here to fill us in19:59
fungibut sounds like it's up and in use19:59
fungithere's been some confusion over the naming19:59
fungito be clear, it's resources provided by ericsson at the request of airship by purchasing capacity in citycloud19:59
fungiso ultimately it's in citycloud, hence the name19:59
fungithough it's supposed to also provide some general resource quota for our overall pool too20:00
fungiin addition it has some very large (including 32gb) nested virt flavors20:00
fungiwhich airship requested for their integration testing20:01
fungiand we're over time20:01
fungii can entertain questions (as far as i'm able) in #openstack-infra though20:01
fungithanks all!20:01
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/"20:01
openstackMeeting ended Tue Feb 11 20:01:46 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)20:01
openstackMinutes:        http://eavesdrop.openstack.org/meetings/infra/2020/infra.2020-02-11-19.01.html20:01
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/infra/2020/infra.2020-02-11-19.01.txt20:01
openstackLog:            http://eavesdrop.openstack.org/meetings/infra/2020/infra.2020-02-11-19.01.log.html20:01
diablo_rojoThanks fungi and clarkb!20:02
*** TomStappaerts has quit IRC20:24
*** TomStappaerts has joined #openstack-meeting20:24
*** senrique_ has joined #openstack-meeting20:36
*** anastzhyr has quit IRC20:36
*** Lucas_Gray has joined #openstack-meeting20:41
*** e0ne has joined #openstack-meeting21:19
*** Lucas_Gray has quit IRC21:22
*** mmethot has quit IRC21:36
*** raildo has quit IRC21:36
*** mmethot has joined #openstack-meeting21:37
*** Trevor_V has quit IRC21:37
*** mmethot has quit IRC21:38
*** mmethot has joined #openstack-meeting21:38
*** mmethot has quit IRC21:42
*** senrique_ has quit IRC21:43
*** maciejjozefczyk has joined #openstack-meeting21:57
*** maciejjozefczyk has quit IRC21:59
*** jamesmcarthur has joined #openstack-meeting22:06
*** rcernin has joined #openstack-meeting22:07
*** kaisers has joined #openstack-meeting22:21
*** slaweq has quit IRC22:25
*** mattw4 has quit IRC22:27
*** rh-jelabarre has quit IRC22:31
*** jamesmcarthur has quit IRC22:41
*** slaweq has joined #openstack-meeting22:50
*** slaweq has quit IRC22:55
*** e0ne has quit IRC22:58
*** jamesmcarthur has joined #openstack-meeting23:02
*** senrique_ has joined #openstack-meeting23:04
*** jamesmcarthur_ has joined #openstack-meeting23:05
*** jamesmcarthur has quit IRC23:05
*** ykatabam has joined #openstack-meeting23:06
*** slaweq has joined #openstack-meeting23:11
*** slaweq has quit IRC23:16
*** jamesmcarthur_ has quit IRC23:24
*** jamesmcarthur has joined #openstack-meeting23:25
*** jamesmcarthur has quit IRC23:25
*** jamesmcarthur has joined #openstack-meeting23:26
*** jamesmcarthur has quit IRC23:32
*** armax has quit IRC23:33
*** nicolasbock has quit IRC23:36
*** mmethot has joined #openstack-meeting23:46
*** igordc has quit IRC23:46
*** Liang__ has joined #openstack-meeting23:49
*** jmasud has quit IRC23:49
*** rcernin has quit IRC23:51

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!