15:01:01 <TheJulia> #startmeeting ironic 15:01:02 <openstack> Meeting started Mon Mar 18 15:01:01 2019 UTC and is due to finish in 60 minutes. The chair is TheJulia. Information about MeetBot at http://wiki.debian.org/MeetBot. 15:01:02 <TheJulia> o/ 15:01:03 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 15:01:05 <iurygregory> o/ 15:01:06 <openstack> The meeting name has been set to 'ironic' 15:01:09 <etingof> o/ 15:01:13 <dnuka> o/ 15:01:15 <bdodd> o/ 15:01:33 <arne_wiebalck> o/ 15:01:39 <rpittau> o/ 15:01:48 <rpioso> \o 15:02:16 <NobodyCam> o/ 15:02:19 <stendulker> o/ 15:02:28 <TheJulia> Our agenda is a little short this week on the wiki, given this is essentially release week for ironic, hopefully this meeting will be short. :) 15:02:36 <mgoddard> \o 15:02:48 <jroll> \o 15:02:48 <TheJulia> #link https://wiki.openstack.org/wiki/Meetings/Ironic 15:03:00 <kaifeng> o/ 15:03:06 <TheJulia> #topic Announcements / Reminders 15:03:50 <TheJulia> As previously mentioned, we're working to cut our Stein stable branches early this week. If there are any blockers that anyone is aware of, please raise that visibility as soon as possible. 15:04:06 <TheJulia> #info Ironic to cut stable/stein this week. 15:04:54 <TheJulia> There is a call for help to address issues with Bionic. We'll circle back to this, but we need reviews if there are any explicit remaining items for it. 15:05:54 <dtantsur> right now, IIUC, the multinode grenade job, the UEFI job and the postgres/PXE job do not pass 15:06:06 <jroll> correct 15:06:07 <jroll> #link https://review.openstack.org/#/c/642015/ 15:06:08 <patchbot> patch 642015 - ironic - Move all testing to Bionic - 2 patch sets 15:06:36 <TheJulia> #info the PTG discussion topic etherpad is still available. Some forum sessions were submitted and approved. We do not have an explicit ops feedback session this time. Ops focused contributors are welcome to engage with the ironic community during our PTG meetings. 15:06:38 <iurygregory> we have te problem with sushy with py3 in bionic too 15:06:51 <iurygregory> https://review.openstack.org/#/c/591828/ 15:06:52 <patchbot> patch 591828 - sushy - Change sushy devstack job to python3 - 4 patch sets 15:07:03 <jroll> I have a question on the bionic thing, but can come back in open discussion if folks would rather 15:07:18 <TheJulia> #link https://etherpad.openstack.org/p/DEN-train-ironic-brainstorming 15:07:35 <TheJulia> Does anyone have anything they would like to announce or remind us of? 15:09:04 <TheJulia> I'm taking silence as a no. If there is no objection, we'll jump directly to Discussion/Open Discussion with first Bionic and then any remaining py3 needs. 15:09:38 * iurygregory that was fast XD 15:09:52 <dnuka> :) 15:10:16 <TheJulia> #topic Discussion 15:10:21 <TheJulia> Bionic! 15:10:25 <TheJulia> jroll: you had a question 15:10:26 <jroll> yeah, so 15:10:42 <jroll> I was under the impression that march 15, a patch would land that would force legacy jobs to bionic 15:10:59 <jroll> but I assume our gate isn't broken, so maybe I missed something? or maybe we're doing something unexpected? 15:11:01 <dtantsur> I think it did happen 15:11:11 <dtantsur> but the legacy jobs and the UEFI job hardcode xenial 15:11:23 <dtantsur> the postgres job went down, but it's non-voting 15:11:26 <jroll> oh duh, ok 15:11:32 <iurygregory> XD 15:11:33 <dtantsur> the unit tests had problems, but they got quickly fixed 15:11:52 <TheJulia> There were a couple larger community wide problems, but those were also fixed very quickly 15:12:00 <iurygregory> yeah some jobs we have the node set to xenial, most are ok to switch 15:12:01 <jroll> cool, so we need to fix these things ASAP (because stein release), but we aren't broken 15:12:08 <dtantsur> yeah, so we're running bionic where we don't set xenial explicitly 15:12:24 <jroll> awesome. thanks for getting me back into the loop I fell out of :) 15:12:34 <dtantsur> jroll: last think I heard was that fixing the postgres job requires a new feature in neutron.. 15:12:37 <dtantsur> * thing 15:12:39 <iurygregory> and since we moved most of things to zuulv3 we dont have legacy jobs and by default they are bionic 15:12:52 <dtantsur> iurygregory: grenades are legacy 15:12:56 <rpittau> this is still pending though https://review.openstack.org/642315 15:12:57 <patchbot> patch 642315 - ironic - Migrate ironic-grenade-dsvm-multinode-multitenant ... - 2 patch sets 15:13:04 <dtantsur> or at least this ^^ one 15:13:05 <jroll> dtantsur: ugh. I'm not as concerned about fixing that one, but we should 15:13:16 <iurygregory> yeah grenades cant be moved to zuulv3 at least according to documentation 15:13:22 <dtantsur> jroll: it's the only job covering PXE (as opposed to iPXE) 15:13:36 <rpittau> for postgres, we should at least revert to xenial https://review.openstack.org/642430 15:13:37 <patchbot> patch 642430 - ironic - Pinning postgres job to xenial - 8 patch sets 15:13:44 <dtantsur> iurygregory: we can try moving them to bionic even without moving them to zuul v3 15:14:07 <iurygregory> yeap 15:14:15 <rpittau> then 2 patches are needed, one to fix the missing package https://review.openstack.org/642507 15:14:15 <patchbot> patch 642507 - ironic - Update dist filter for devstack ubuntu - 1 patch set 15:14:16 <jroll> dtantsur: right, which is why I'm not saying "just drop it", it just seems less important than uefi/multinode 15:14:17 <TheJulia> Is it a reasonable test that someone would install rocky on bionic, and then upgrade to stein? 15:14:40 <jroll> I wouldn't be surprised if somebody did 15:14:46 <jroll> just to keep the two upgrades distinct 15:14:49 <dtantsur> but I don't think we supported bionic back then 15:15:01 <dtantsur> so the more reasonable path is rocky -> stein -> bionic 15:15:12 <dtantsur> (because stein was tested with xenial at least to some extent) 15:15:12 <TheJulia> what dtantsur said, so I'm actually less worried about grenade 15:15:36 <TheJulia> but, jroll, your making a good point, I just don't think we have the resources to cover every case either 15:15:50 <jroll> fair nuff 15:16:19 <TheJulia> I feel like there is going to be a larger grenade discussion, or maybe not... at the ptg 15:16:36 <jroll> feels kinda late :P 15:16:41 <openstackgerrit> Ilya Etingof proposed openstack/ironic master: Explicitly start `vbmcd` supervisor https://review.openstack.org/637971 15:16:46 <TheJulia> Anyway, well yeah. 15:16:54 <TheJulia> jroll: maintainership is the other issue 15:17:38 <dtantsur> it seems that infra will have to keep xenial floating for stein lifetime, at least for grenades 15:17:38 <TheJulia> so if we try and migrate grenade stuffs this next cycle, that just leaves us the uefi job right? 15:17:48 <rpittau> TheJulia, dtantsur, the patch on neutron side to fix postgres (and not only that) on bionic is just a PoC for now 15:17:49 <dtantsur> TheJulia: and PXE/postgres 15:18:10 <jroll> does anyone have a link explaining why the pxe job needs a neutron feature? 15:18:14 <TheJulia> rpittau: do you ahve a ink handy? 15:18:17 <jroll> that's very confusing 15:18:26 <rpittau> https://review.openstack.org/643570 15:18:27 <patchbot> patch 643570 - neutron - WiP/PoC - Router Namespace - Connection Tracker he... - 1 patch set 15:18:35 <TheJulia> oh jeeze that 15:18:55 <rpittau> there may be a way to do that with some hack until it's merged 15:19:19 <dtantsur> should we raise this as a transition blocker? 15:19:20 <TheJulia> The last thing I saw was a desire to discuss at the PTG... 15:19:30 <jroll> ... short term it feels like we could turn on nf_conntrack_helper 15:19:46 <dtantsur> I think Derek was looking into it, but he seems offline 15:20:00 <dtantsur> if we get blocked on the neutron patch, we certainly miss stein with it 15:20:02 <TheJulia> jroll: only set on module load.... 15:20:03 <rpittau> jroll I think that requires a reboot 15:20:15 <TheJulia> the module may be able to be unloaded and reloaded, fwiw 15:20:22 <jroll> worst case, put it in the base devstack image 15:20:43 <TheJulia> I suspect that is going to be refused 15:20:49 <TheJulia> or never reviewed 15:20:53 <rpittau> we can create the rule with a script, get the route namespace and add it, in some way..... 15:22:16 <TheJulia> Lets do this. Raise it as a scenario blocker, document it in a release note. Try to fix it during the next cycle. It doesn't sound like postgres, but PXE that is taking the scenario 15:22:17 <dtantsur> is the UEFI problem the same or something else? 15:22:36 <dtantsur> TheJulia: we can keep testing it on xenial, rpittau has a patch for it 15:22:41 <TheJulia> dtantsur: I _think_ it is files moving around... 15:22:41 <dtantsur> s/can/must/? 15:22:58 <rpittau> xenial works fine with the pxelinux pkg installed 15:23:21 <TheJulia> pxelinux for libvirt's usage? 15:23:32 <TheJulia> dtantsur: must could work, we need to document it as a known issue 15:24:25 <dtantsur> ideally, we should update our docs with how to avoid the conntrack problem on bionic 15:24:34 <dtantsur> since it's really just a new installation procedure for PXE boot 15:24:54 <TheJulia> dtantsur: yeah, we don't need docs at this moment, they can get backported too 15:25:03 <TheJulia> release note is slightly more important 15:25:20 <dtantsur> probably. although it's not a bug we can ever fix. 15:25:27 <dtantsur> (if I get it right?) 15:25:49 <rpittau> that's not even a bug, it's "security enhancement" xD 15:25:55 <dtantsur> \o/ 15:26:47 <TheJulia> so uefi, yeah is libvirt fun 15:27:05 <TheJulia> the actual loader has a very limited text output 15:27:18 <TheJulia> heh, joy 15:27:27 * dtantsur knows the top priority for this week now :) 15:28:15 <TheJulia> I think that means the scenario was broken by the libvirt packages and likely can be fixed, but it doesn't mean the scenario is just completely broken. That being said, I think we can proceed to release with no additional note for uefi 15:28:35 <TheJulia> Can I get a volunteer to write a small known issue release note regarding the security enhancement in bionic? 15:28:48 <openstackgerrit> Julia Kreger proposed openstack/ironic master: Train: Bump semver for 12.2.0 to be master https://review.openstack.org/644246 15:29:15 <rpittau> TheJulia, I can take care of that 15:29:20 <openstackgerrit> Julia Kreger proposed openstack/ironic master: Train: Bump semver to 12.2.0 for master https://review.openstack.org/644246 15:29:24 <TheJulia> rpittau: thanks! 15:29:36 <TheJulia> Are we in agreement, and is there anything else pressing to discuss today? 15:29:48 <dtantsur> TheJulia: priorities for the week, if we have any? 15:29:58 <TheJulia> dtantsur: none really, just get the release out I think 15:30:15 * dtantsur imagines punching a bear out of the door 15:30:20 <TheJulia> lol 15:30:34 <TheJulia> so can we get some artwork for this?!? 15:30:35 <TheJulia> lol 15:30:43 <TheJulia> #topic Open Discussion 15:31:52 <dtantsur> cri.. 15:32:03 <dtantsur> .. 15:32:06 <iurygregory> ... 15:32:08 <dtantsur> ..ckets? 15:32:16 <jroll> love me some crickets 15:33:41 <TheJulia> \o/ 15:33:48 <TheJulia> In that case, thanks everyone! Time to go make more coffee! 15:34:03 <iurygregory> time for more coffee and more meetings yay 15:34:36 <rpittau> oh yeah I have time for proper coffee \o/ 15:34:42 <jroll> thanks TheJulia :) 15:35:05 <iurygregory> tks 15:35:06 <TheJulia> Thanks everyone! 15:35:10 <TheJulia> #endmeeting