14:02:16 <weshay|ruck> #startmeeting tripleo
14:02:16 <weshay|ruck> #topic agenda
14:02:16 <weshay|ruck> * Review past action items
14:02:16 <weshay|ruck> * One off agenda items
14:02:16 <weshay|ruck> * Squad status
14:02:17 <weshay|ruck> * Bugs & Blueprints
14:02:17 <openstack> Meeting started Tue Mar 17 14:02:16 2020 UTC and is due to finish in 60 minutes.  The chair is weshay|ruck. Information about MeetBot at http://wiki.debian.org/MeetBot.
14:02:18 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
14:02:19 <weshay|ruck> * Projects releases or stable backports
14:02:20 <openstack> The meeting name has been set to 'tripleo'
14:02:21 <weshay|ruck> * Specs
14:02:25 <weshay|ruck> * open discussion
14:02:27 <weshay|ruck> Anyone can use the #link, #action and #info commands, not just the moderatorǃ
14:02:29 <weshay|ruck> Hey folks! who's around?
14:02:35 <ekultails> o/
14:02:42 <Tengu> \o/
14:02:54 <rlandy> o/
14:02:59 <tkajinam> o/
14:03:25 <openstackgerrit> Gael Chamoulaud proposed openstack/tripleo-validations master: Remove objects migrated to validations-common  https://review.opendev.org/713204
14:04:36 <marios> o/
14:05:20 <weshay|ruck> #topic review past action items
14:05:20 <weshay|ruck> http://eavesdrop.openstack.org/meetings/tripleo/2020/
14:05:36 <weshay|ruck> anything from previous weeks? I have one thing
14:05:57 <chandankumar> \o/
14:06:00 * weshay|ruck notes to the tripleo community.. the rdo-info pin on *most* projects have been removed
14:06:15 <weshay|ruck> some pins are still in place and the best POC for that info is #rdo
14:06:53 <weshay|ruck> the CI team promoted the unpinned content yesterday after it had passed through our various pipelines for testing
14:07:03 <rainleander> o/
14:07:07 <leanderthal> o/
14:07:11 <leanderthal> we're both here ;-)
14:07:11 <weshay|ruck> I believe neutron is still pinned, and a bit of mistral
14:07:20 <weshay|ruck> leanderthal, :)) welcome
14:07:21 <pkopec> o/
14:07:27 <weshay|ruck> welcome welcome rather
14:07:42 <weshay|ruck> look for updates on rdo email lists, and #rdo
14:07:57 <weshay|ruck> I'll ask them to summarize the current status of pins
14:08:07 <weshay|ruck> any questions on that?
14:08:42 * weshay|ruck notes.. ussuri is centos-8 only and if you see a centos-7 job we're waiting on a merge to convert or a merge to remove it
14:08:55 <ykarel> weshay|ruck, some info about pins can be seen https://lists.rdoproject.org/pipermail/dev/2020-March/009334.html
14:09:04 <ykarel> with weekly status
14:09:26 <Tengu> that's all good news I'd say. big thanks to all the ppl working on that topic!
14:09:30 <weshay|ruck> k.. thank you ykarel
14:09:32 <weshay|ruck> Pinned projects are unpinned after testing with CentOS8 jobs and
14:09:32 <weshay|ruck> feedback from TripleO team. Mistral and neutron are still pinned, more
14:09:32 <weshay|ruck> details in https://review.rdoproject.org/r/#/c/25612/
14:09:32 <weshay|ruck> * https://review.rdoproject.org/r/#/c/25612/
14:09:32 <weshay|ruck> * https://review.rdoproject.org/r/#/c/25727/
14:09:33 <weshay|ruck> * https://review.rdoproject.org/r/#/c/25719/
14:10:04 <weshay|ruck> anything else re: centos-8, unpinning etc?
14:10:44 <weshay|ruck> thank you to the rdo community packagers!!
14:10:48 <arxcruz|rover> o/
14:10:49 <weshay|ruck> #topic Active Squad status
14:10:49 <weshay|ruck> ci
14:10:49 <weshay|ruck> #link https://hackmd.io/IhMCTNMBSF6xtqiEd9Z0Kw?both
14:10:49 <weshay|ruck> validations
14:10:49 <weshay|ruck> #link https://etherpad.openstack.org/p/tripleo-validations-squad-status
14:10:50 <weshay|ruck> ceph-integration
14:10:54 <weshay|ruck> #link https://etherpad.openstack.org/p/tripleo-integration-squad-status
14:10:56 <weshay|ruck> transformation
14:10:58 <weshay|ruck> #link https://etherpad.openstack.org/p/tripleo-ansible-agenda
14:11:00 <weshay|ruck> mistral-to-ansible
14:11:02 <weshay|ruck> #link https://etherpad.openstack.org/p/tripleo-mistral-to-ansible
14:11:14 <weshay|ruck> cloudnull, since we're getting so close to kicking mistral out.. want to summarize where we are?
14:11:26 <weshay|ruck> and any reviews needed?
14:11:46 <weshay|ruck> or anyone from that squad
14:11:54 <Tengu> quick update for the validations! we have 2 new packages getting ready, validations-common and (python[23]-)validations-libs - the latter has already its spec file merged, the -common is in the pipe!
14:12:06 <weshay|ruck> very nice!!
14:12:16 <gchamoul> \o/
14:12:22 <gchamoul> super nice!
14:12:28 <Tengu> big thumbs up to ykarel and amoralej|lunch for their help, and of course gchamoul and matbu for the code and content :)
14:13:05 <weshay|ruck> ++
14:13:09 <weshay|ruck> well done
14:13:34 <weshay|ruck> thanks for the update.. moving on
14:13:35 <weshay|ruck> #topic Moderately Active Squads
14:13:35 <weshay|ruck> Ironic-integration
14:13:35 <weshay|ruck> https://etherpad.openstack.org/p/tripleo-ironic-integration-squad-status
14:13:35 <weshay|ruck> upgrade
14:13:35 <weshay|ruck> #link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status
14:13:37 <weshay|ruck> edge
14:13:39 <weshay|ruck> #link https://etherpad.openstack.org/p/tripleo-edge-squad-status
14:13:41 <weshay|ruck> networking
14:13:43 <weshay|ruck> #link https://etherpad.openstack.org/p/tripleo-networking-squad-status
14:13:55 <weshay|ruck> going once , twice for the less active
14:14:09 <weshay|ruck> ccamacho, is bringing up new upgrade jobs and a new scenario
14:14:10 * dtantsur assumes the ironic integration squad is VERY moderately active..
14:14:21 <weshay|ruck> oops
14:14:22 <fultonj> o/
14:14:24 <weshay|ruck> cgoncalves,  is
14:14:35 <weshay|ruck> please have a look at https://review.opendev.org/#/c/710473/
14:14:59 <weshay|ruck> hey fultonj, gfidente patches are up to convert ceph-ansible dep ci to centos-8
14:15:05 <weshay|ruck> and podman
14:15:08 <weshay|ruck> EmilienM, ^
14:15:11 <weshay|ruck> cool
14:15:24 <weshay|ruck> chandankumar, will have the details for both
14:15:37 <fultonj> weshay|ruck: yep, chandankumar mentioned this to us yesterday
14:15:59 <weshay|ruck> #topic bugs and blueprints
14:16:02 <chandankumar> fultonj, bhagyashris is still working on that, https://review.rdoproject.org/r/25769
14:16:14 <weshay|ruck> Blueprints:
14:16:14 <weshay|ruck> 1 Good progress
14:16:14 <weshay|ruck> Bugs:
14:16:14 <weshay|ruck> 5 New, 20 Incomplete, 4 Invalid, 2 Won't Fix, 7 Confirmed, 376 Triaged, 118 In Progress, 2 Fix Committed, 118 Fix Released
14:16:26 <chandankumar> weshay|ruck, EmilienM for podman https://review.rdoproject.org/r/#/q/topic:c8-podman+(status:open+OR+status:merged)
14:16:27 <weshay|ruck> reminder to self triage bugs
14:16:51 <weshay|ruck> set the bug to triaged... and set the milestone, priority etc..
14:17:09 <weshay|ruck> read the blob of instructions please
14:17:11 <weshay|ruck> chandankumar, ^
14:17:12 <weshay|ruck> :)
14:17:29 <weshay|ruck> Storyboard bugs.
14:17:29 <weshay|ruck> #link https://storyboard.openstack.org/#!/project_group/76
14:17:39 <weshay|ruck> moving on
14:17:48 <weshay|ruck> #topic projects releases or stable backports
14:18:11 <weshay|ruck> now that most things are unpinned... backports from master are open
14:18:20 <weshay|ruck> but please note.. what is still currently pinned
14:18:28 <weshay|ruck> questions?
14:18:47 <weshay|ruck> moving on
14:18:59 <weshay|ruck> #topic specs
14:18:59 <weshay|ruck> #link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open
14:19:24 <weshay|ruck> ekultails, anything you want to highlight?
14:20:14 <weshay|ruck> #topic open discussion
14:20:14 <weshay|ruck> Anything else that folks want to bring up to the meeting?
14:20:28 <tkajinam> Can I ask one question regarding centos8 jobs ?
14:20:40 <d0ugal> o/
14:20:40 <cloudnull> o/
14:20:44 <weshay|ruck> tkajinam, sure
14:20:46 * cloudnull late, sorry
14:20:47 <apetrich> o/
14:20:48 <EmilienM> hello
14:20:56 <tkajinam> IIUC currently centos jobs are running on master, we still use centos7 for stable branches
14:21:05 <weshay|ruck> cloudnull, please bang erasers after class
14:21:17 <weshay|ruck> tkajinam, correct
14:21:19 <tkajinam> will we stay on centos7 about stable/train or will we also enable centos8 jobs for it ?
14:21:42 * cloudnull channels my inner bart simpson
14:21:48 <tkajinam> I'm asking this because I'm working on a patch to enable centos8 to run ut/lint jobs for puppet modules
14:21:55 <weshay|ruck> tkajinam, the magic 8-ball says... "ask again later", we have not yet been given any requirements to update train to centos-8, but I'm asking about it
14:22:04 <apetrich> We have an issue here https://bugs.launchpad.net/tripleo/+bug/1866621 that I'm trying to see how to best fix it.
14:22:05 <openstack> Launchpad bug 1866621 in tripleo "Can't run container mistral_db_sync" [High,Triaged]
14:22:08 <ekultails> No new info on my AWX integration spec. Will eventually work on more of a proof-of-concept that I can share. Seeing is believing, right? ;-)
14:22:23 <weshay|ruck> ekultails thanks
14:22:31 <tkajinam> weshay|ruck, ok
14:22:39 <EmilienM> cloudnull: do you know why all tripleo-ansible-centos-8-molecule-tripleo_container_* jobs are non voting on tripleo-ansible, and RED ?
14:23:00 <weshay|ruck> apetrich, what's the issue? do you want to highlight for the mtg or is that something else?
14:23:07 <EmilienM> :(
14:23:11 <weshay|ruck> zbr, ^
14:23:23 <EmilienM> and the job is failing for good reason, idempotency :(
14:23:28 <EmilienM> who did that
14:23:46 <cloudnull> EmilienM zbr was working on that .
14:23:48 <weshay|ruck> who moved it to centos-8 or something else?
14:23:59 <EmilienM> why the job is non voting
14:24:00 <weshay|ruck> ya.. zbr moved to centos-8..
14:24:04 <EmilienM> and why did this job moved to centos8
14:24:10 <cloudnull> idk why specifically they're non-voting, I suspect there was some issue running the job in cent8
14:24:12 <weshay|ruck> gchamoul, are validation molecule jobs done btw?
14:24:14 <EmilienM> if it's not working, keep it on centos7 for now
14:24:16 <zbr> EmilienM: they got broken long time ago, someone needs to fix them, i am not working on them now.
14:24:19 <EmilienM> we can't afford regressions in that role
14:24:23 <EmilienM> it's used everywhere
14:24:29 <weshay|ruck> hrm
14:24:34 <EmilienM> and why you didn't ping me
14:24:35 <gchamoul> weshay|ruck: nope not yet
14:24:37 <EmilienM> i created that role
14:24:44 <weshay|ruck> gchamoul, k k
14:24:51 <zbr> we cannot have a mix of centos-7 and centod-8 on tripleo-ansible jobs, due to how it was implemented.
14:24:57 <weshay|ruck> zbr, may need assist gchamoul w/ validations
14:25:02 <openstackgerrit> Lukas Bezdicka proposed openstack/tripleo-heat-templates master: [Q->T] Introduce Queens to Train Upgrade  https://review.opendev.org/711459
14:25:02 <zbr> that was my first attempt
14:25:07 <EmilienM> ...
14:25:42 <cloudnull> zbr EmilienM to get the job voting again we could put them back to c7 for now ?
14:25:56 <EmilienM> cloudnull: zbr just said we can't.
14:26:00 <weshay|ruck> zbr, also added all of the tripleo-ansible molecule jobs to a periodic upstream weekly pipeline btw
14:26:07 <weshay|ruck> zbr, if you have link to that
14:26:13 <cloudnull> why not?
14:26:22 <EmilienM> folks these roles should NOT be non voting
14:26:31 <EmilienM> no matter the reason, we can't afford regressions in them
14:26:34 <cloudnull> each job runs its own env, we can mix and match OS's
14:26:38 <fultonj> so if you wrote a molecule test for your tripleo-ansible role you should be helping to fix this, right?
14:26:40 <weshay|ruck> they also need to be at centos-8. so let's discuss that offline
14:26:55 <EmilienM> fultonj: yes but I wasn't aware it was red
14:26:57 <weshay|ruck> fultonj++
14:27:07 <EmilienM> i just found it randomly
14:27:13 <EmilienM> of course I'll fix it, I'm already investigating
14:27:14 <weshay|ruck> either was I tbh, last I looked it was green
14:27:26 <EmilienM> I'm just saying we should not disabling voting like this
14:27:35 <EmilienM> even for centos8
14:27:42 <openstackgerrit> Jesse Pretorius (odyssey4me) proposed openstack/tripleo-heat-templates master: [DNM] Revert "placement: Remove Nova to Placement extraction step"  https://review.opendev.org/713455
14:27:49 <fultonj> so any tripleo-ansible patch should have an example of the failing job to debug?
14:28:14 <fultonj> i'm thinking i'm going to go looking for where my job is failing so i'm wondering where to look
14:28:42 <EmilienM> in my case I can see it here :
14:28:44 <EmilienM> https://0fd77280b0334417b6ee-1d67ec5eb204f28641a7073258861323.ssl.cf5.rackcdn.com/712135/6/check/tripleo-ansible-centos-8-molecule-tripleo_container_manage/4e914dc/reports.html
14:28:56 <EmilienM> "msg: fedora container was wrongly re-created"
14:29:02 <EmilienM> it's clearly an idempotency issue
14:29:19 <zbr> EmilienM: while I agree with your statement on nv, you will discover yourself what kind of challenge is to split stuff in tripleo-ansible repo, due to the way jobs are generated.
14:29:20 <weshay|ruck> https://review.opendev.org/#/c/712135/
14:29:22 <cloudnull> EmilienM if we revert - https://github.com/openstack/tripleo-ansible/commit/326f902710e7f6a41c01b2bdedd7ac512196e5fa - the container_* and ceph_* jobs should run c7, while everthing else is running c8
14:29:59 <zbr> there were 78 jobs there, yep 78.
14:30:00 <weshay|ruck> push forward on getting fixed on c8 imho
14:30:19 <EmilienM> yes I agree... centos8 is priority
14:30:46 <cloudnull> 78 jobs is no big deal, we can change each job independently of every other job, if needed.
14:30:56 <weshay|ruck> oof
14:31:28 <weshay|ruck> ok.. let's get together and figure it out .. offline of this mtg
14:31:35 <weshay|ruck> but thanks for pointing this out
14:31:38 <gfidente> weshay|ruck we should have all deps to build ceph-ansible for centos8 in the sig repo now
14:31:50 <weshay|ruck> gfidente++ chandankumar ^
14:32:07 <weshay|ruck> gfidente, we should also confirm that kolla is using those repos and deps
14:32:09 <chandankumar> gfidente, we need mock from epele for centos-8
14:32:25 * weshay|ruck wishes rdo would just carry mock
14:32:27 <weshay|ruck> in deps
14:32:32 <weshay|ruck> so we didn't have to touch epel
14:32:34 <fultonj> do you think we should be able to recreate the failure using tripleo-ansible's  ./scripts/run-local-test ?
14:32:35 <apetrich> weshay|ruck, sorry had to help the kids. Not for the meeting but help is welcome
14:32:41 <weshay|ruck> chandankumar, ykarel|afk is that possible?
14:32:54 <chandankumar> weshay|ruck, everything is possible
14:32:58 <chandankumar> let me check
14:33:05 <weshay|ruck> chandankumar, \0/
14:33:17 <weshay|ruck> ok.. anything else???
14:33:18 <ade_lee> mwhahaha, https://review.opendev.org/#/c/713143/  please
14:33:26 <weshay|ruck> 0/ ade_lee
14:33:34 <gfidente> chandankumar isn't mock-ceph-config https://cbs.centos.org/koji/buildinfo?buildID=28555 from CBS good?
14:33:48 <gfidente> weshay|ruck and yes kolla should be using it, I saw the review in gerrit
14:33:59 <weshay|ruck> ++
14:34:38 <gfidente> I am pretty sure there is a guy who joined upstream sig meeting
14:34:41 <weshay|ruck> ok.. folks.. thank you .. SERIOUSLY for participating in the meeting and highlighting current events!!!
14:34:42 <gfidente> precisely to do that
14:34:58 <weshay|ruck> ++ tripleo ++
14:35:03 <weshay|ruck> 0/
14:35:04 <ratailor> weshay|ruck, do we have any update re https://bugzilla.redhat.com/show_bug.cgi?id=1690281
14:35:04 <openstack> ratailor: Error: Error getting bugzilla.redhat.com bug #1690281: NotPermitted
14:35:07 <chandankumar> gfidente, will poke on that
14:35:12 <weshay|ruck> #endmeeting tripleo