14:00:14 <jaosorior> #startmeeting tripleo 14:00:15 <openstack> Meeting started Tue Oct 9 14:00:14 2018 UTC and is due to finish in 60 minutes. The chair is jaosorior. Information about MeetBot at http://wiki.debian.org/MeetBot. 14:00:16 <openstack> Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. 14:00:18 <openstack> The meeting name has been set to 'tripleo' 14:00:33 <jaosorior> #topic agenda 14:00:35 <jaosorior> * Review past action items 14:00:37 <jaosorior> * One off agenda items 14:00:39 <jaosorior> * Squad status 14:00:41 <jaosorior> * Bugs & Blueprints 14:00:43 <jaosorior> * Projects releases or stable backports 14:00:45 <jaosorior> * Specs 14:00:47 <jaosorior> * open discussion 14:00:49 <jaosorior> Anyone can use the #link, #action and #info commands, not just the moderatorǃ 14:00:51 <jaosorior> Hey folks! who's around? 14:00:53 <Tengu> \o/ 14:01:04 <mwhahaha> hi2u 14:01:11 <beagles> o/ 14:01:11 <quiquell> o/ 14:01:12 <marios|rover> o/ 14:01:23 <asbishop> o/ 14:01:28 <jbadiapa> o/ 14:01:40 <ksambor> o/ 14:01:49 <dpeacock> o7 14:01:56 <Tengu> :] 14:02:33 <jtomasek> o/ 14:02:47 <owalsh> o/ 14:03:10 <jaosorior> \o 14:03:24 <jaosorior> #topic review past action items 14:03:28 <matbu> o/ 14:03:32 <jaosorior> None. 14:03:37 <chem`> o/ 14:03:43 <jaosorior> #topic one off agenda items 14:03:45 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-meeting-items 14:03:47 <naturalblue> if trying to import overcloud nodes using manual power management should I use fake, fake_pxe or manual-management. I have tried to get my server imported using ipmi but i keep getting an error "No valid host was found. Reason: No conductor service registered which supports driver....". this has happened with fake, fake_pxe, ipmi, ipmitool. Nothing seems to working. I have tried configuring the enabe_drivers and 14:03:47 <naturalblue> enable_hardware_types in ironic.conf as well as adding the m to undercloud.conf and re-running openstack undercloud install still i am getting nowhere 14:04:31 <jaosorior> Not sure if this would go in this topic... or open discussion. But, I won't be around next week (PTO). Can someone take over this meeting just for next week? 14:04:33 <naturalblue> has anyone any ideas, I can tell the ype of server if needed. i ahve set the BMC ip, username and password for the server 14:05:23 <mwhahaha> yea i can run it 14:05:29 <d0ugal> o/ 14:05:30 <jaosorior> thanks mwhahaha! 14:06:44 <jaosorior> naturalblue: can you wait until after the weekly meeting? (there is also a section on Open discussion if you want to bring your issue there). 14:07:12 <naturalblue> which channel is open discussion 14:07:19 <jaosorior> naturalblue: This channel, just gotta wait 14:07:32 <jaosorior> And folks, the weekly reminder: CI Community Meeting starts immediately upon this meeting closing in #oooq. This is our team's weekly "open office hours." All are welcome! Ask/discuss anything, we don't bite. Agenda (add items freely) --> https://etherpad.openstack.org/p/tripleo-ci-squad-meeting. 14:07:36 <naturalblue> ok, when is the meeting, is it right now :s 14:07:46 <jaosorior> naturalblue: yes. 14:07:59 <naturalblue> ok sorry. i ddint know, please proceed 14:08:05 <jaosorior> #topic Squad status 14:08:07 <jaosorior> ci 14:08:09 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-ci-squad-meeting 14:08:11 <jaosorior> upgrade 14:08:13 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-upgrade-squad-status 14:08:15 <jaosorior> containers 14:08:17 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-containers-squad-status 14:08:19 <jaosorior> integration 14:08:21 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-integration-squad-status 14:08:23 <jaosorior> ui/cli 14:08:25 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-ui-cli-squad-status 14:08:27 <jaosorior> validations 14:08:29 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-validations-squad-status 14:08:31 <jaosorior> networking 14:08:33 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-networking-squad-status 14:08:35 <jaosorior> workflows 14:08:37 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-workflows-squad-status 14:08:39 <jaosorior> security 14:08:41 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-security-squad 14:08:43 <jaosorior> edge 14:08:45 <jaosorior> #link https://etherpad.openstack.org/p/tripleo-edge-squad-status 14:08:47 <jaosorior> Anything the squads would like to bring up to the general community? 14:09:15 <Tengu> jaosorior: some work about the validation framework? 14:09:35 <jaosorior> Tengu: sure 14:09:43 <Tengu> jaosorior: we can expect near to 0 job on that field until milestone 2, as there are a lot of more important things to do. 14:10:08 <Tengu> so basically we will validate the things we want to see in the tech-prev for that framework, and once we get some time, bam, dev. 14:10:15 <ooolpbot> URGENT TRIPLEO TASKS NEED ATTENTION 14:10:16 <ooolpbot> https://bugs.launchpad.net/tripleo/+bug/1796710 14:10:17 <ooolpbot> https://bugs.launchpad.net/tripleo/+bug/1796756 14:10:17 <ooolpbot> https://bugs.launchpad.net/tripleo/+bug/1796764 14:10:17 <openstack> Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] 14:10:18 <openstack> Launchpad bug 1796756 in tripleo "Error searching for image docker.io/tripleorocky/centos-binary-ceilometer-compute - UnixHTTPConnectionPool(host=\'localhost\', port=None): Read timed out." [Critical,Triaged] 14:10:19 <Tengu> one thing though: it is decided to go with ansible-runner 14:10:20 <openstack> Launchpad bug 1796764 in tripleo "undercloud install failing for containers-multinode in the gate "OperationalError: (sqlite3.OperationalError) database is locked "" [Critical,Triaged] 14:10:37 <Tengu> this might be an important thing to note, as it will require some refactoring in tripleo_common. 14:10:52 <Tengu> so yeah. basically, that's it for now :). 14:11:01 <jaosorior> Tengu: thanks for the update 14:11:02 <Tengu> #link https://trello.com/b/x3h5FrnX/validation-framework 14:11:10 <Tengu> if you guys want to follow and have a look. 14:12:36 <jaosorior> ack, checking it out 14:12:43 <jaosorior> Any other squad wanting to bring up updates? 14:14:39 <jaosorior> #topic bugs & blueprints 14:14:41 <jaosorior> #link https://launchpad.net/tripleo/+milestone/stein-1 14:14:44 <jaosorior> For Stein we currently have 31 blueprints open in Launchpad. 14:14:46 <jaosorior> Bugs: 763 (-15) stein-1. 102 (0) open Storyboard bugs. 14:14:46 <openstack> bug 763 in zope2.7 (Ubuntu) "Something wrong on mkzope2.7instance" [Medium,Invalid] https://launchpad.net/bugs/763 14:14:47 <jaosorior> #link https://storyboard.openstack.org/#!/project_group/76 14:16:41 <jaosorior> #topic projects releases or stable backports 14:16:54 <mwhahaha> we released the rocky ga last week 14:17:00 <mwhahaha> to the unhappiness of the upgrade jobs in master 14:17:13 <mwhahaha> we've also done an initial tagging for stein to bump the version numbers 14:17:30 <mwhahaha> EmilienM is visiting the land of Brno so we'll probably do a stable release next week as needed 14:18:08 <mwhahaha> that is all unless folks have specific needs 14:19:17 <jaosorior> ack, thanks mwhahaha 14:20:07 <jaosorior> #topic specs 14:20:09 <jaosorior> #link https://review.openstack.org/#/q/project:openstack/tripleo-specs+status:open 14:21:15 <jaosorior> zzzeek_: could you revisit your zzzeek_ to address the comment there https://review.openstack.org/#/c/600555/ ? after that we can merge it 14:23:03 <jaosorior> #topic open discussion 14:23:14 <jaosorior> Anything else that folks want to bring up to the meeting? 14:23:38 <Tengu> just a small news regarding podman: we're about to get a working "standalone" deploy with selinux :D 14:23:52 <jaosorior> wooo! :D 14:23:59 <Tengu> last patch is in the Gate. 14:24:26 <jaosorior> Tengu: have you taken a look at the custom capabilities to limit the containers that are currently set as privileged? 14:24:51 <Tengu> jaosorior: yeah, in a really quick way. Did not work on that part for now. 14:25:01 <jaosorior> just curiosity 14:25:13 <Tengu> that's the next step I think. Dropping "privileged" is a must. 14:27:01 <zzzeek_> jaosorior: will do later today 14:27:31 <jaosorior> zzzeek_: thanks 14:29:39 <weshay> jaosorior, we have a number of layered bugs on ovb deployments 14:30:19 <jaosorior> weshay: I was aware of the TLS-related bug 14:30:24 <weshay> https://review.openstack.org/#/c/608589/ will help but still seeing deployment failures 14:30:42 <jaosorior> weshay: that timed out. 14:31:13 <marios|rover> jaosorior: yes that is one issue... latest isssues/status tracked in https://review.rdoproject.org/etherpad/p/ruckrover-sprint20 we are alerting in chan for those top 3 for example (these aren't ovb related, these are for check/gate) 14:31:16 <weshay> just fyi.. we have a number of tripleo, ironic, heat bugs we're looking at w/ ovb jobs atm 14:31:39 <weshay> we could use some help in diagnosis 14:32:05 <mwhahaha> weshay: it looks like we need to disable ara as it's running into multi threading issues with the container prep stuff 14:32:32 <marios|rover> jaosorior: in particular https://bugs.launchpad.net/tripleo/+bug/1796764 https://bugs.launchpad.net/tripleo/+bug/1796710 the patch is affected by mirror/network issues: https://bugs.launchpad.net/tripleo/+bug/1796849 14:32:32 <openstack> Launchpad bug 1796764 in tripleo "undercloud install failing for containers-multinode in the gate "OperationalError: (sqlite3.OperationalError) database is locked "" [Critical,Triaged] 14:32:34 <openstack> Launchpad bug 1796710 in tripleo "Tempest tests failed with Read timed out error on tripleo-ci-centos-7-undercloud-containers" [Critical,Triaged] 14:32:35 <openstack> Launchpad bug 1796849 in tripleo "Mirror/network issues at mirror.us-west-1.packethost.openstack.org" [Undecided,New] 14:32:54 <marios|rover> jaosorior: sorry for spam i wont post the rest they are in that status etherpad thanks 14:33:07 <jaosorior> marios|rover, weshay: thanks for bringing it up 14:33:10 * jaosorior reading 14:33:20 <mwhahaha> i think the solution for 1796764 is to disable ara for now 14:33:38 <marios|rover> mwhahaha: if you're referring to https://bugs.launchpad.net/tripleo/+bug/1796764 yeah i was looking into it. i thought perhaps https://review.openstack.org/#/c/604664/ related but not sure still 14:33:38 <openstack> Launchpad bug 1796764 in tripleo "undercloud install failing for containers-multinode in the gate "OperationalError: (sqlite3.OperationalError) database is locked "" [Critical,Triaged] 14:34:16 <weshay> mwhahaha, ya.. marios|rover is looking at that now 14:34:17 <mwhahaha> marios|rover: no it's a concurrency problem with out image prepare because it launches multiple ansible playbooks which is causing problems with ara 14:34:24 <mwhahaha> s/out/our 14:34:39 <marios|rover> mwhahaha: ack thanks maybe join community call in a minute if you can? 14:34:40 <weshay> I'm fine w/ turning it off until we fix 14:34:49 <mwhahaha> yea 14:35:19 * weshay finds patch 14:35:40 <weshay> https://review.openstack.org/#/c/606986/ 14:36:06 <marios|rover> weshay: heh did you see into the future and post the patch one week ago ! 14:36:40 <mwhahaha> we likely need to turn it off every where 14:36:43 <mwhahaha> but we can chat 14:36:45 <weshay> marios|rover, I have powers 14:37:10 <jaosorior> well that was quick :O 14:37:18 <ajo> have you folks experienced this with standalone? https://paste.fedoraproject.org/paste/99N2WnuJ2t2U6qbWVghx2Q 14:37:23 <marios|rover> before it started, like 1 week ago you might say jaosorior 14:38:01 <mwhahaha> ajo: is this under python3? 14:38:14 <marios|rover> not somethign ive seen in ci fwiw ajo 14:38:15 <ajo> mwhahaha: I think it's python2 14:38:24 <ajo> marios|rover: I specified neutron_driver: ovn 14:38:29 <ajo> I can retry with "null" 14:38:29 <weshay> marios|rover, https://bluejeans.com/4113567798 14:38:35 <weshay> mwhahaha, https://bluejeans.com/4113567798 14:38:42 <ajo> but seems like downloading the playbooks or something 14:38:44 * ajo looks at the code 14:38:54 <marios|rover> weshay: you changed the number? (was folcos in the invite) 14:39:03 <mwhahaha> ajo: would be helpful to have the full traceback but it seems like an issue with a character somewhere 14:39:06 <weshay> marios|rover, he's not here, and we need moderator 14:39:08 <jaosorior> I'll end the meeting so folks can join the CI meeting if needed 14:39:17 <jaosorior> Thanks for joining folks! 14:39:21 <jaosorior> #endmeeting'