14:02:16 <weshay|ruck> #startmeeting tripleo 14:02:16 <weshay|ruck> #topic agenda 14:02:16 <weshay|ruck> * Review past action items 14:02:16 <weshay|ruck> * One off agenda items 14:02:16 <weshay|ruck> * Squad status 14:02:17 <weshay|ruck> * Bugs & Blueprints 14:02:17 <openstack> Meeting started Tue Mar 17 14:02:16 2020 UTC and is due to finish in 60 minutes. The chair is weshay|ruck. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:02:18 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 14:02:19 <weshay|ruck> * Projects releases or stable backports 14:02:20 <openstack> The meeting name has been set to 'tripleo' 14:02:21 <weshay|ruck> * Specs 14:02:25 <weshay|ruck> * open discussion 14:02:27 <weshay|ruck> Anyone can use the #link, #action and #info commands, not just the moderatorǃ 14:02:29 <weshay|ruck> Hey folks! who's around? 14:02:35 <ekultails> o/ 14:02:42 <Tengu> \o/ 14:02:54 <rlandy> o/ 14:02:59 <tkajinam> o/ 14:03:25 <openstackgerrit> Gael Chamoulaud proposed openstack/tripleo-validations master: Remove objects migrated to validations-common https://review.opendev.org/713204 14:04:36 <marios> o/ 14:05:20 <weshay|ruck> #topic review past action items 14:05:20 <weshay|ruck> http://eavesdrop.openstack.org/meetings/tripleo/2020/ 14:05:36 <weshay|ruck> anything from previous weeks? I have one thing 14:05:57 <chandankumar> \o/ 14:06:00 * weshay|ruck notes to the tripleo community.. the rdo-info pin on *most* projects have been removed 14:06:15 <weshay|ruck> some pins are still in place and the best POC for that info is #rdo 14:06:53 <weshay|ruck> the CI team promoted the unpinned content yesterday after it had passed through our various pipelines for testing 14:07:03 <rainleander> o/ 14:07:07 <leanderthal> o/ 14:07:11 <leanderthal> we're both here ;-) 14:07:11 <weshay|ruck> I believe neutron is still pinned, and a bit of mistral 14:07:20 <weshay|ruck> leanderthal, :)) welcome 14:07:21 <pkopec> o/ 14:07:27 <weshay|ruck> welcome welcome rather 14:07:42 <weshay|ruck> look for updates on rdo email lists, and #rdo 14:07:57 <weshay|ruck> I'll ask them to summarize the current status of pins 14:08:07 <weshay|ruck> any questions on that? 14:08:42 * weshay|ruck notes.. ussuri is centos-8 only and if you see a centos-7 job we're waiting on a merge to convert or a merge to remove it 14:08:55 <ykarel> weshay|ruck, some info about pins can be seen https://lists.rdoproject.org/pipermail/dev/2020-March/009334.html 14:09:04 <ykarel> with weekly status 14:09:26 <Tengu> that's all good news I'd say. big thanks to all the ppl working on that topic! 14:09:30 <weshay|ruck> k.. thank you ykarel 14:09:32 <weshay|ruck> Pinned projects are unpinned after testing with CentOS8 jobs and 14:09:32 <weshay|ruck> feedback from TripleO team. Mistral and neutron are still pinned, more 14:09:32 <weshay|ruck> details in https://review.rdoproject.org/r/#/c/25612/ 14:09:32 <weshay|ruck> * https://review.rdoproject.org/r/#/c/25612/ 14:09:32 <weshay|ruck> * https://review.rdoproject.org/r/#/c/25727/ 14:09:33 <weshay|ruck> * https://review.rdoproject.org/r/#/c/25719/ 14:10:04 <weshay|ruck> anything else re: centos-8, unpinning etc? 14:10:44 <weshay|ruck> thank you to the rdo community packagers!! 14:10:48 <arxcruz|rover> o/ 14:10:49 <weshay|ruck> #topic Active Squad status 14:10:49 <weshay|ruck> ci 14:10:49 <weshay|ruck> #link https://hackmd.io/IhMCTNMBSF6xtqiEd9Z0Kw?both 14:10:49 <weshay|ruck> validations 14:10:49 <weshay|ruck> #link https://etherpad.openstack.org/p/tripleo-validations-squad-status 14:10:50 <weshay|ruck> ceph-integration 14:10:54 <weshay|ruck> #link https://etherpad.openstack.org/p/tripleo-integration-squad-status 14:10:56 <weshay|ruck> transformation 14:10:58 <weshay|ruck> #link https://etherpad.openstack.org/p/tripleo-ansible-agenda 14:11:00 <weshay|ruck> mistral-to-ansible 14:11:02 <weshay|ruck> #link https://etherpad.openstack.org/p/tripleo-mistral-to-ansible 14:11:14 <weshay|ruck> cloudnull, since we're getting so close to kicking mistral out.. want to summarize where we are? 14:11:26 <weshay|ruck> and any reviews needed? 14:11:46 <weshay|ruck> or anyone from that squad 14:11:54 <Tengu> quick update for the validations! we have 2 new packages getting ready, validations-common and (python[23]-)validations-libs - the latter has already its spec file merged, the -common is in the pipe! 14:12:06 <weshay|ruck> very nice!! 14:12:16 <gchamoul> \o/ 14:12:22 <gchamoul> super nice! 14:12:28 <Tengu> big thumbs up to ykarel and amoralej|lunch for their help, and of course gchamoul and matbu for the code and content :) 14:13:05 <weshay|ruck> ++ 14:13:09 <weshay|ruck> well done 14:13:34 <weshay|ruck> thanks for the update.. moving on 14:13:35 <weshay|ruck> #topic Moderately Active Squads 14:13:35 <weshay|ruck> Ironic-integration 14:13:35 <weshay|ruck> https://etherpad.openstack.org/p/tripleo-ironic-integration-squad-status 14:13:35 <weshay|ruck> upgrade 14:13:35 <weshay|ruck> #link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status 14:13:37 <weshay|ruck> edge 14:13:39 <weshay|ruck> #link https://etherpad.openstack.org/p/tripleo-edge-squad-status 14:13:41 <weshay|ruck> networking 14:13:43 <weshay|ruck> #link https://etherpad.openstack.org/p/tripleo-networking-squad-status 14:13:55 <weshay|ruck> going once , twice for the less active 14:14:09 <weshay|ruck> ccamacho, is bringing up new upgrade jobs and a new scenario 14:14:10 * dtantsur assumes the ironic integration squad is VERY moderately active.. 14:14:21 <weshay|ruck> oops 14:14:22 <fultonj> o/ 14:14:24 <weshay|ruck> cgoncalves, is 14:14:35 <weshay|ruck> please have a look at https://review.opendev.org/#/c/710473/ 14:14:59 <weshay|ruck> hey fultonj, gfidente patches are up to convert ceph-ansible dep ci to centos-8 14:15:05 <weshay|ruck> and podman 14:15:08 <weshay|ruck> EmilienM, ^ 14:15:11 <weshay|ruck> cool 14:15:24 <weshay|ruck> chandankumar, will have the details for both 14:15:37 <fultonj> weshay|ruck: yep, chandankumar mentioned this to us yesterday 14:15:59 <weshay|ruck> #topic bugs and blueprints 14:16:02 <chandankumar> fultonj, bhagyashris is still working on that, https://review.rdoproject.org/r/25769 14:16:14 <weshay|ruck> Blueprints: 14:16:14 <weshay|ruck> 1 Good progress 14:16:14 <weshay|ruck> Bugs: 14:16:14 <weshay|ruck> 5 New, 20 Incomplete, 4 Invalid, 2 Won't Fix, 7 Confirmed, 376 Triaged, 118 In Progress, 2 Fix Committed, 118 Fix Released 14:16:26 <chandankumar> weshay|ruck, EmilienM for podman https://review.rdoproject.org/r/#/q/topic:c8-podman+(status:open+OR+status:merged) 14:16:27 <weshay|ruck> reminder to self triage bugs 14:16:51 <weshay|ruck> set the bug to triaged... and set the milestone, priority etc.. 14:17:09 <weshay|ruck> read the blob of instructions please 14:17:11 <weshay|ruck> chandankumar, ^ 14:17:12 <weshay|ruck> :) 14:17:29 <weshay|ruck> Storyboard bugs. 14:17:29 <weshay|ruck> #link https://storyboard.openstack.org/#!/project_group/76 14:17:39 <weshay|ruck> moving on 14:17:48 <weshay|ruck> #topic projects releases or stable backports 14:18:11 <weshay|ruck> now that most things are unpinned... backports from master are open 14:18:20 <weshay|ruck> but please note.. what is still currently pinned 14:18:28 <weshay|ruck> questions? 14:18:47 <weshay|ruck> moving on 14:18:59 <weshay|ruck> #topic specs 14:18:59 <weshay|ruck> #link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open 14:19:24 <weshay|ruck> ekultails, anything you want to highlight? 14:20:14 <weshay|ruck> #topic open discussion 14:20:14 <weshay|ruck> Anything else that folks want to bring up to the meeting? 14:20:28 <tkajinam> Can I ask one question regarding centos8 jobs ? 14:20:40 <d0ugal> o/ 14:20:40 <cloudnull> o/ 14:20:44 <weshay|ruck> tkajinam, sure 14:20:46 * cloudnull late, sorry 14:20:47 <apetrich> o/ 14:20:48 <EmilienM> hello 14:20:56 <tkajinam> IIUC currently centos jobs are running on master, we still use centos7 for stable branches 14:21:05 <weshay|ruck> cloudnull, please bang erasers after class 14:21:17 <weshay|ruck> tkajinam, correct 14:21:19 <tkajinam> will we stay on centos7 about stable/train or will we also enable centos8 jobs for it ? 14:21:42 * cloudnull channels my inner bart simpson 14:21:48 <tkajinam> I'm asking this because I'm working on a patch to enable centos8 to run ut/lint jobs for puppet modules 14:21:55 <weshay|ruck> tkajinam, the magic 8-ball says... "ask again later", we have not yet been given any requirements to update train to centos-8, but I'm asking about it 14:22:04 <apetrich> We have an issue here https://bugs.launchpad.net/tripleo/+bug/1866621 that I'm trying to see how to best fix it. 14:22:05 <openstack> Launchpad bug 1866621 in tripleo "Can't run container mistral_db_sync" [High,Triaged] 14:22:08 <ekultails> No new info on my AWX integration spec. Will eventually work on more of a proof-of-concept that I can share. Seeing is believing, right? ;-) 14:22:23 <weshay|ruck> ekultails thanks 14:22:31 <tkajinam> weshay|ruck, ok 14:22:39 <EmilienM> cloudnull: do you know why all tripleo-ansible-centos-8-molecule-tripleo_container_* jobs are non voting on tripleo-ansible, and RED ? 14:23:00 <weshay|ruck> apetrich, what's the issue? do you want to highlight for the mtg or is that something else? 14:23:07 <EmilienM> :( 14:23:11 <weshay|ruck> zbr, ^ 14:23:23 <EmilienM> and the job is failing for good reason, idempotency :( 14:23:28 <EmilienM> who did that 14:23:46 <cloudnull> EmilienM zbr was working on that . 14:23:48 <weshay|ruck> who moved it to centos-8 or something else? 14:23:59 <EmilienM> why the job is non voting 14:24:00 <weshay|ruck> ya.. zbr moved to centos-8.. 14:24:04 <EmilienM> and why did this job moved to centos8 14:24:10 <cloudnull> idk why specifically they're non-voting, I suspect there was some issue running the job in cent8 14:24:12 <weshay|ruck> gchamoul, are validation molecule jobs done btw? 14:24:14 <EmilienM> if it's not working, keep it on centos7 for now 14:24:16 <zbr> EmilienM: they got broken long time ago, someone needs to fix them, i am not working on them now. 14:24:19 <EmilienM> we can't afford regressions in that role 14:24:23 <EmilienM> it's used everywhere 14:24:29 <weshay|ruck> hrm 14:24:34 <EmilienM> and why you didn't ping me 14:24:35 <gchamoul> weshay|ruck: nope not yet 14:24:37 <EmilienM> i created that role 14:24:44 <weshay|ruck> gchamoul, k k 14:24:51 <zbr> we cannot have a mix of centos-7 and centod-8 on tripleo-ansible jobs, due to how it was implemented. 14:24:57 <weshay|ruck> zbr, may need assist gchamoul w/ validations 14:25:02 <openstackgerrit> Lukas Bezdicka proposed openstack/tripleo-heat-templates master: [Q->T] Introduce Queens to Train Upgrade https://review.opendev.org/711459 14:25:02 <zbr> that was my first attempt 14:25:07 <EmilienM> ... 14:25:42 <cloudnull> zbr EmilienM to get the job voting again we could put them back to c7 for now ? 14:25:56 <EmilienM> cloudnull: zbr just said we can't. 14:26:00 <weshay|ruck> zbr, also added all of the tripleo-ansible molecule jobs to a periodic upstream weekly pipeline btw 14:26:07 <weshay|ruck> zbr, if you have link to that 14:26:13 <cloudnull> why not? 14:26:22 <EmilienM> folks these roles should NOT be non voting 14:26:31 <EmilienM> no matter the reason, we can't afford regressions in them 14:26:34 <cloudnull> each job runs its own env, we can mix and match OS's 14:26:38 <fultonj> so if you wrote a molecule test for your tripleo-ansible role you should be helping to fix this, right? 14:26:40 <weshay|ruck> they also need to be at centos-8. so let's discuss that offline 14:26:55 <EmilienM> fultonj: yes but I wasn't aware it was red 14:26:57 <weshay|ruck> fultonj++ 14:27:07 <EmilienM> i just found it randomly 14:27:13 <EmilienM> of course I'll fix it, I'm already investigating 14:27:14 <weshay|ruck> either was I tbh, last I looked it was green 14:27:26 <EmilienM> I'm just saying we should not disabling voting like this 14:27:35 <EmilienM> even for centos8 14:27:42 <openstackgerrit> Jesse Pretorius (odyssey4me) proposed openstack/tripleo-heat-templates master: [DNM] Revert "placement: Remove Nova to Placement extraction step" https://review.opendev.org/713455 14:27:49 <fultonj> so any tripleo-ansible patch should have an example of the failing job to debug? 14:28:14 <fultonj> i'm thinking i'm going to go looking for where my job is failing so i'm wondering where to look 14:28:42 <EmilienM> in my case I can see it here : 14:28:44 <EmilienM> https://0fd77280b0334417b6ee-1d67ec5eb204f28641a7073258861323.ssl.cf5.rackcdn.com/712135/6/check/tripleo-ansible-centos-8-molecule-tripleo_container_manage/4e914dc/reports.html 14:28:56 <EmilienM> "msg: fedora container was wrongly re-created" 14:29:02 <EmilienM> it's clearly an idempotency issue 14:29:19 <zbr> EmilienM: while I agree with your statement on nv, you will discover yourself what kind of challenge is to split stuff in tripleo-ansible repo, due to the way jobs are generated. 14:29:20 <weshay|ruck> https://review.opendev.org/#/c/712135/ 14:29:22 <cloudnull> EmilienM if we revert - https://github.com/openstack/tripleo-ansible/commit/326f902710e7f6a41c01b2bdedd7ac512196e5fa - the container_* and ceph_* jobs should run c7, while everthing else is running c8 14:29:59 <zbr> there were 78 jobs there, yep 78. 14:30:00 <weshay|ruck> push forward on getting fixed on c8 imho 14:30:19 <EmilienM> yes I agree... centos8 is priority 14:30:46 <cloudnull> 78 jobs is no big deal, we can change each job independently of every other job, if needed. 14:30:56 <weshay|ruck> oof 14:31:28 <weshay|ruck> ok.. let's get together and figure it out .. offline of this mtg 14:31:35 <weshay|ruck> but thanks for pointing this out 14:31:38 <gfidente> weshay|ruck we should have all deps to build ceph-ansible for centos8 in the sig repo now 14:31:50 <weshay|ruck> gfidente++ chandankumar ^ 14:32:07 <weshay|ruck> gfidente, we should also confirm that kolla is using those repos and deps 14:32:09 <chandankumar> gfidente, we need mock from epele for centos-8 14:32:25 * weshay|ruck wishes rdo would just carry mock 14:32:27 <weshay|ruck> in deps 14:32:32 <weshay|ruck> so we didn't have to touch epel 14:32:34 <fultonj> do you think we should be able to recreate the failure using tripleo-ansible's ./scripts/run-local-test ? 14:32:35 <apetrich> weshay|ruck, sorry had to help the kids. Not for the meeting but help is welcome 14:32:41 <weshay|ruck> chandankumar, ykarel|afk is that possible? 14:32:54 <chandankumar> weshay|ruck, everything is possible 14:32:58 <chandankumar> let me check 14:33:05 <weshay|ruck> chandankumar, \0/ 14:33:17 <weshay|ruck> ok.. anything else??? 14:33:18 <ade_lee> mwhahaha, https://review.opendev.org/#/c/713143/ please 14:33:26 <weshay|ruck> 0/ ade_lee 14:33:34 <gfidente> chandankumar isn't mock-ceph-config https://cbs.centos.org/koji/buildinfo?buildID=28555 from CBS good? 14:33:48 <gfidente> weshay|ruck and yes kolla should be using it, I saw the review in gerrit 14:33:59 <weshay|ruck> ++ 14:34:38 <gfidente> I am pretty sure there is a guy who joined upstream sig meeting 14:34:41 <weshay|ruck> ok.. folks.. thank you .. SERIOUSLY for participating in the meeting and highlighting current events!!! 14:34:42 <gfidente> precisely to do that 14:34:58 <weshay|ruck> ++ tripleo ++ 14:35:03 <weshay|ruck> 0/ 14:35:04 <ratailor> weshay|ruck, do we have any update re https://bugzilla.redhat.com/show_bug.cgi?id=1690281 14:35:04 <openstack> ratailor: Error: Error getting bugzilla.redhat.com bug #1690281: NotPermitted 14:35:07 <chandankumar> gfidente, will poke on that 14:35:12 <weshay|ruck> #endmeeting tripleo