Thursday, 2019-07-18

*** slaweq has joined #tripleo00:11
*** slaweq has quit IRC00:16
*** cdearborn has quit IRC00:16
*** iurygregory has quit IRC00:17
openstackgerritMerged openstack/tripleo-quickstart master: Fixed roles_path in ansible.cfg  https://review.opendev.org/67133600:46
openstackgerritMerged openstack/tripleo-common master: Ensure we're raising proper exceptions  https://review.opendev.org/67040800:46
EmilienMweshay: lol I'm still a newbie00:51
*** betherly has joined #tripleo00:55
*** betherly has quit IRC01:00
dtrainorOhhh, it's been a while.  I'm trying to do a deployment with profile matching.  I've set the proper capabilities per each node, verified with 'profiles match', but when I deploy, nodes are not being created in to their respective roles https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/profile_matching.html01:02
dtrainorhmm, i'm using scale parameters e.g. --control-scale, do I also need to specify OvercloudControlFlavor (previously --control-flavor) ?  figured that would just work ootb01:04
*** mschuppert has quit IRC01:11
*** apetrich has quit IRC01:12
*** betherly has joined #tripleo01:15
*** ramishra has joined #tripleo01:20
*** betherly has quit IRC01:20
*** apetrich has joined #tripleo01:44
cloudnullyay! https://review.opendev.org/#/c/671336/ - merged, time to recheck all the things01:52
*** betherly has joined #tripleo01:57
*** apetrich has quit IRC01:58
*** betherly has quit IRC02:02
*** slaweq has joined #tripleo02:11
*** slaweq has quit IRC02:15
openstackgerritSteve Baker proposed openstack/tripleo-common master: Add a retry for wait_for_introspection_to_finish  https://review.opendev.org/67138002:27
*** avivgt has quit IRC02:28
*** betherly has joined #tripleo03:09
*** betherly has quit IRC03:14
*** redrobot has quit IRC03:32
*** rh-jelabarre has quit IRC03:34
*** psachin has joined #tripleo03:36
*** Guest99405 has joined #tripleo03:39
*** betherly has joined #tripleo03:40
*** betherly has quit IRC03:45
*** sabedevops has joined #tripleo03:51
*** sabedevops has quit IRC03:53
*** sabedevops has joined #tripleo03:53
*** sabedevops has quit IRC03:57
*** poopcat has quit IRC03:58
*** dsneddon has quit IRC04:05
*** slaweq has joined #tripleo04:11
*** apetrich has joined #tripleo04:16
*** slaweq has quit IRC04:16
*** dsneddon has joined #tripleo04:17
*** ykarel|away has joined #tripleo04:37
*** udesale has joined #tripleo04:39
*** skramaja has joined #tripleo04:47
Tenguhello there!04:57
*** ykarel|away has quit IRC05:04
*** slaweq has joined #tripleo05:11
*** ratailor has joined #tripleo05:13
*** slaweq has quit IRC05:15
*** shyamb has joined #tripleo05:15
openstackgerritRajesh Tailor proposed openstack/tripleo-heat-templates stable/rocky: Add new role parameter NovaLibvirtMemStatsPeriodSeconds  https://review.opendev.org/67139705:18
*** ykarel|away has joined #tripleo05:20
*** dsneddon has quit IRC05:21
ykarel|awayis the issue related to docker registory mirror known? i see many jobs failing05:24
*** ykarel|away is now known as ykarel05:24
*** jjoyce has quit IRC05:31
*** ccamacho has quit IRC05:33
openstackgerritRajesh Tailor proposed openstack/tripleo-heat-templates stable/queens: Add new role parameter NovaLibvirtMemStatsPeriodSeconds  https://review.opendev.org/67140005:33
*** marios|rover has joined #tripleo05:37
*** marios|rover is now known as marios|ruck05:37
*** shyamb has quit IRC05:39
*** pcaruana has joined #tripleo05:44
*** holser has joined #tripleo05:51
*** dsneddon has joined #tripleo05:53
*** jjoyce has joined #tripleo05:54
openstackgerritwaleed mousa proposed openstack/os-net-config master: fix missing shared_block for PF interface  https://review.opendev.org/67074005:56
*** shyamb has joined #tripleo05:56
openstackgerritwaleed mousa proposed openstack/os-net-config master: fix missing shared_block for PF interface  https://review.opendev.org/67074005:58
Tenguhm... apparently CI still down. "yay".-06:03
Tenguhmm. http://logs.openstack.org/13/671313/1/check/tripleo-ci-centos-7-containers-multinode/de63812/job-output.txt.gz#_2019-07-18_05_28_14_59145306:04
Tenguthat's interesting... weren't you working on clouds.yaml related things, sshnaidm|afk ?06:04
*** jfrancoa has joined #tripleo06:05
ykarelraukadah, was working on ^^06:05
Tenguah, right.06:05
Tenguapparently something's broken at some point, I'd say, reading the log :/06:05
Tenguyeah. missing remote_src....06:06
*** holser has quit IRC06:08
openstackgerritCédric Jeanneret (Tengu) proposed openstack/tripleo-quickstart-extras master: Add missing remote_src param for copy  https://review.opendev.org/67140306:08
Tenguykarel raukadah -^^06:09
Tenguoh. wait. that's apparently also wrong.06:10
Tenguhttp://logs.openstack.org/13/671313/1/check/tripleo-ci-centos-7-containers-multinode/de63812/logs/undercloud/home/zuul/.config  <- 40406:10
Tengushouldn't be the case.06:10
raukadahTengu: yes, the clouds.yaml is not there06:11
Tenguraukadah: maybe the copy happens too early?06:11
ykarelthat job passed in original patch https://review.opendev.org/#/c/667323/06:11
Tenguraukadah: basically, this thing exploded CI...06:11
raukadahTengu: https://github.com/openstack/python-tripleoclient/commit/b2e8787c2d868cc32b888ae208cbc569467b10ed#diff-ea4878148660c3a8a4a2392e78af65bfR128 -> might not properly resolves06:12
Tenguraukadah: hmm... depends on the user used at that point.06:12
Tenguisn't it root, just for fun?06:12
raukadahTengu: nope, but overcloud deployment happens as a normal user06:13
Tenguwith a lot of sudo calls06:13
Tenguwould be fun to add a "whoami"-like call within that constant.py06:14
Tengujust to ensure it's called with the right user.....06:14
Tengusince CI doesn't collect /root content.06:14
ykarelthis is queens job06:16
ykarelhttp://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-containers-multinode&branch=stable%2Fqueens06:17
ykarelbroken since 16th July06:17
ykarelhttps://review.opendev.org/#/c/667390/18/zuul.d/multinode-jobs.yaml06:18
openstackgerritKeigo Noha proposed openstack/os-net-config master: Add ETHTOOL_OPTS support for LinuxBond class  https://review.opendev.org/67140606:19
Tenguraukadah ykarel https://github.com/openstack/python-tripleoclient/blob/b2e8787c2d868cc32b888ae208cbc569467b10ed/tripleoclient/constants.py#L22  does it resolve correctly?06:24
Tengumore over: https://github.com/openstack/python-tripleoclient/blob/b2e8787c2d868cc32b888ae208cbc569467b10ed/tripleoclient/constants.py#L2606:25
TenguI'd say the resolution added for the cloud.yaml doesn't work as expected, seeing how those two others are setting the home dir.06:25
Tenguthere are some other examples.06:25
Tengulike line 42 of that same file.06:25
raukadahTengu: I need to reuse the undercloud home dir06:26
Tenguthat's maybe "just" that.06:26
Tenguraukadah: yeah, might be even better :)06:26
Tenguor DEFAULT_ENV_DIRECTORY ?06:26
ykarelTengu, actually issue is os_tempest was enabled in jobs for non master06:26
Tenguah, nah, didn't see.06:26
Tenguykarel: ok.. ? so it should be non-voting on non-master?06:26
Tenguor disabled on non-master in fact.06:27
ykarelTengu, job definition needs to be changed so old multinode jobs don't run with os_tempest06:27
raukadahykarel: https://github.com/openstack/tripleo-ci/commit/f16575e5ebe114f24f8a427776f5bac54b78b2fc06:27
ykarelso master with os_tempest, non-master without temppest06:27
*** holser has joined #tripleo06:28
*** slaweq has joined #tripleo06:28
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-ci master: Run os_tempest multinode job on master only  https://review.opendev.org/67140806:30
*** saneax has joined #tripleo06:31
*** mschuppert has joined #tripleo06:32
*** raukadah is now known as chandankumar06:35
*** dsneddon has quit IRC06:39
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-quickstart-extras master: Run os_tempest playbook for master only in multinode jobs  https://review.opendev.org/67141006:39
chandankumarykarel: ^^06:40
*** rcernin has quit IRC06:44
*** holser has quit IRC06:55
*** kopecmartin|off is now known as kopecmartin06:59
*** yprokule has joined #tripleo07:04
*** jbadiapa has joined #tripleo07:04
*** xek has joined #tripleo07:06
*** marios has joined #tripleo07:06
*** dsneddon has joined #tripleo07:11
*** rpittau|afk is now known as rpittau07:11
*** jpich has joined #tripleo07:24
*** amoralej|off is now known as amoralej07:24
openstackgerrityatin proposed openstack/tripleo-ci master: Run os_tempest multinode job on master only  https://review.opendev.org/67140807:25
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates master: WIP Tls priorities for pcmk  https://review.opendev.org/67018607:26
sshnaidm|afkjfrancoa, commented https://review.opendev.org/#/c/67097107:26
ykarelchandankumar, i cannot think any better alternative than ^^ as i see multiple project relies on old container-multinode job07:26
ykarelplease check07:26
ykarelsshnaidm|afk, can u check https://review.opendev.org/67140807:27
ykarelactually container-multinode job is broken in non master releases07:27
*** shyamb has quit IRC07:27
Tengugchamoul: heya! would you have a quick moment this afternoon for a chat with weshay about CI job running validations? We might have an opportunity to get a slot :)07:29
sshnaidm|afkykarel, chandankumar is it easier to have this logic in featureset file? "if master -> os_tempest, else -> not"07:29
sshnaidm|afkwhy to use featureset override if you create a different job anyway07:30
ykarelsshnaidm|afk, yes i prefer ^^07:31
ykarelin featureset07:32
ykarelsshnaidm|afk, in that case i think it's better to revert original patch https://review.opendev.org/#/c/667390 and do featureset tweaks07:32
ykarelwdyt?07:32
openstackgerrityatin proposed openstack/tripleo-ci master: Revert "Move tripleo-ci-centos-7-containers-multinode to os_tempest"  https://review.opendev.org/67141907:35
ykarelsshnaidm|afk, chandankumar reverted ^^07:36
*** ccamacho has joined #tripleo07:36
*** ykarel is now known as ykarel|lunch07:37
Tengugchamoul: hmmm... apparently, mistral is still the default engine for validations... ? Unless I missed a thing.07:38
*** cylopez has joined #tripleo07:39
*** hberaud|gone is now known as hberaud07:46
Tenguchandankumar: http://logs.openstack.org/89/671289/2/check/tripleo-ci-centos-7-containers-multinode/82fea33/job-output.txt.gz#_2019-07-17_19_05_56_640163 fyi - that's on master..07:55
*** lucasagomes has joined #tripleo07:56
*** florianf has quit IRC07:57
*** holser has joined #tripleo07:58
jfrancoasshnaidm|afk: thanks for the review, I'll reply in the patch08:00
*** avivgts has joined #tripleo08:02
*** jpich has quit IRC08:06
*** jpich has joined #tripleo08:06
*** pkopec has joined #tripleo08:07
*** dtantsur|afk is now known as dtantsur08:09
*** yolanda has joined #tripleo08:09
*** yolanda has quit IRC08:10
*** shyamb has joined #tripleo08:19
*** derekh has joined #tripleo08:20
*** rascasoft has quit IRC08:25
*** rascasoft has joined #tripleo08:25
Tengugchamoul: damn... mistral still needed for validation *listing*, meaning it's needed when we want to run a group of validations. My bad.08:26
Tengupfff.08:27
*** sshnaidm|afk is now known as sshnaidm08:27
*** tosky has joined #tripleo08:31
*** florianf has joined #tripleo08:35
*** tkajinam has quit IRC08:40
*** xek has quit IRC08:42
*** xek has joined #tripleo08:43
openstackgerritMerged openstack/os-net-config master: ifdown does not work if no ifcfg file exist  https://review.opendev.org/67002008:43
openstackgerritMerged openstack/tripleo-ci master: Remove shyaml and te-broker lines  https://review.opendev.org/66899408:43
sshnaidmjfrancoa, sorry, I miss the context in the patch, how does it guard from missing docker-py? https://review.opendev.org/#/c/670971/3/tripleo_ansible/roles/tripleo-container-rm/tasks/tripleo_docker_container_rm.yml08:44
*** bogdando has joined #tripleo08:46
*** iurygregory has joined #tripleo08:46
*** xek has quit IRC08:47
jfrancoasshnaidm: because we mostly do not execute the docker_container module. As soon as you Ansible will execute that task it will fail because python-docker isn't present in the system and Ansible requires it to be able to remove (or even check if it's needed to be removed). But if we first check if the container is not present and if it's isn't we skip the execution of the task, the issue is solved08:48
jfrancoasshnaidm: I am also guessing that if the container is present, then the python-docker rpm will be present...that's why I suggested I could change that check for the one we were having previously in tripleo-docker-rm08:49
*** xek has joined #tripleo08:51
openstackgerritMarios Andreou proposed openstack/tripleo-ci master: Revert "Move tripleo-ci-centos-7-containers-multinode to os_tempest"  https://review.opendev.org/67141908:51
marios|ruckykarel|lunch:  updated to add the bug so we can merge sshnaidm can you revote please ^08:52
marios|ruckchandankumar: ^^08:52
*** xek has quit IRC08:52
sshnaidmjfrancoa, hmm.. I think having container or docker executable doesn't force python-docker to be present, moreover I'm afraid if there is any docker_container task then python-docker presence will be checked no matter if it's skipped or not08:55
sshnaidmjfrancoa, maybe just remove it with docker command and that's it?08:56
jfrancoasshnaidm: well, the job passed, so if the task is skipped then the python-docker presence isnt' verified08:57
sshnaidmjfrancoa, which job passed?08:57
*** avivgts has quit IRC08:58
jfrancoasshnaidm: http://logs.openstack.org/96/670796/2/check/tripleo-ci-centos-7-standalone-upgrade/fefea6f/job-output.txt.gz08:58
jfrancoasshnaidm: in this patch https://review.opendev.org/#/c/670796/ I have a depends on to the tripleo-ansible role one. and in the last execution, the standalone-upgrade job passed..so the skipping of the task helped08:59
jfrancoasshnaidm: now it's just a matter of tuning in the check, it can be either verifying if the container is running or if the python-docker rpm is present, but we need to skip it upon some of those conditions09:00
*** ykarel|lunch is now known as ykarel09:00
ykarelmarios|ruck, ack09:01
*** arxcruz|ruck is now known as arxcruz09:01
sshnaidmjfrancoa, and in this job docker-py wasn't installed, right? When do we install it then?09:02
sshnaidmjfrancoa, because if it's not installed, let's not use docker module at all09:02
jfrancoasshnaidm: exactly, I did run a reproducer on the job and checked in the system. python-docker wasn't present, however docker's binary is, and if you do a docker ps, you get output (but no containers in the output)09:03
*** bogdando has quit IRC09:03
*** bogdando has joined #tripleo09:03
*** apetrich has quit IRC09:06
*** apetrich has joined #tripleo09:07
jfrancoasshnaidm: that's a good question, I'm not really sure when do we install it and why it isn't present, if docker it's in the system...09:07
sshnaidmjfrancoa, it's not a dependency, so not sure where it's installed, but if it's not - docker module won't work and won't remove container then, do I miss something?09:10
sshnaidmjistr, can you please unworkflow https://review.opendev.org/#/c/670971/ ? I still have a few questions about it09:12
openstackgerritSagi Shnaidman proposed openstack/tripleo-ansible master: Cover the case when the container engine is not available.  https://review.opendev.org/67097109:13
jistrsshnaidm: let's land it? it is a CI blocker fix09:15
jfrancoasshnaidm: exactly, that's right. the system does not have docker-py installed and all the calls to the docker_container Ansible module would fail09:15
sshnaidmjistr, I'm afraid it won't do what it should do09:16
sshnaidmjfrancoa, yes, but it's tripleo-docker-rm role and it should remove this container09:16
jistrsshnaidm: well the other patch proved it does fix the CI, but it's fine to discuss more if there are some other concerns09:16
marios|rucksshnaidm: jistr jfrancoa guys sometimes 2 mins call is easier i can host if you like https://redhat.bluejeans.com/7661925373/09:16
sshnaidmjistr, it won't help if it will break other parts, I'm not nitting09:17
jfrancoasshnaidm: well, it unlocks the CI by skipping the task, other thing is that the fix could be enhanced..but it unlocks the CI09:17
sshnaidmjistr, it's not only about CI09:17
jistrsshnaidm: yea i'm not suggesting you're nitpicking, let's discuss :)  marios|ruck's call?  cc jfrancoa09:17
marios|rucksshnaidm: i didn't follow the conversation but what is the problem with checking that the container is present via its cli, before stop/remove it09:18
jfrancoajistr: ack, joining09:18
marios|ruckreading back09:18
openstackgerritMerged openstack/tripleo-ansible master: Create a podman role  https://review.opendev.org/67110009:19
*** apetrich has quit IRC09:19
openstackgerritNatal Ngétal proposed openstack/diskimage-builder master: [Configuration] Switch to stestr.  https://review.opendev.org/62941409:19
*** florianf has quit IRC09:24
*** xek has joined #tripleo09:26
*** florianf has joined #tripleo09:29
*** apetrich has joined #tripleo09:31
*** skramaja has quit IRC09:34
openstackgerritCédric Jeanneret (Tengu) proposed openstack/python-tripleoclient master: Allow to pass "plan" name to tripleo-ansible-inventory script  https://review.opendev.org/67143909:36
Tengugchamoul: -^^ :)09:36
marios|ruckjistr: jfrancoa sshnaidm i think this is the doc i had in mind re docker-py https://docs.ansible.com/ansible/latest/scenario_guides/guide_docker.html#requirements09:37
gchamoulTengu: Already pushed a review for that yesterday https://review.opendev.org/#/c/671289/09:39
gchamoulTengu: and yes it's still depending on Mistral09:40
Tengugchamoul: daaamn... and I saw it, but didn't realize because I didn't check the last file. well, at least.... we're on the same line for that plan thingy ^^09:40
Tengugchamoul: so I have an asciinema showing of a single validation run without mistral :). That's already a good step09:41
Tengujust wondering why it takes so long though09:41
openstackgerritMerged openstack/tripleo-heat-templates master: Add facter cache for container configurations  https://review.opendev.org/66901109:42
openstackgerritMerged openstack/tripleo-heat-templates master: Remove support for Cisco UCSM plugin  https://review.opendev.org/67085309:42
openstackgerritSagi Shnaidman proposed openstack/tripleo-ci master: Run upgrades-stein job in CI repos on master  https://review.opendev.org/67105509:43
gchamoulTengu: ansible-playbook is not known to be fast AFAIK09:43
gchamoulTengu: and the tripleo-ansible script isn't as well.09:44
gchamoulTengu: much faster that it was a long time ago but still slow09:44
Tengugchamoul: wokay. fect collection is probably the root cause.09:44
Tengu*fact09:45
gchamoulyeah another lead here ^09:45
Tenguwe need some of them though. I know mwhahaha is working hard on that field. iirc he talked about "fetching only requested/mandatory facts" on demand instead of the full fact fetching at the beginning.09:45
Tenguthat might be a nice lead indeed.09:45
*** dsneddon has quit IRC09:46
Tengumost of the validations don't rely on the facts iirc. just ram and cpu, maybe disks. but the others? nope.09:46
gchamoulTengu: and we run them one by one (I admit that it was not subtle to do that)09:46
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Run upgrade-stein job on quickstart-extra changes  https://review.opendev.org/67017609:46
gchamoulTengu: yes we probably need to optimize the validations which doesn't care about the fact09:47
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart master: Run upgrade-stein job on quickstart changes  https://review.opendev.org/67017509:47
Tengu:)09:47
Tengugchamoul: iirc adding a simple "gather_facts: no" or something like that in the playbooks will already be nice.09:47
gchamoulTengu: yes was thinking about that09:48
Tengu:)09:48
gchamoulTengu: we need to add card about the validations optimization09:48
Tengugchamoul: on my way.09:48
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Run upgrade-stein job on quickstart-extra changes  https://review.opendev.org/67017609:49
* gchamoul will have to skip his summer PTOs, if it will continue lol09:49
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart master: Run upgrade-stein job on quickstart changes  https://review.opendev.org/67017509:49
Tengugchamoul: well, nope, should be fine, we're way ahead for the tech preview imho :909:50
Tengugchamoul: https://trello.com/c/dq8GaOA2/81-validation-optimization fyi. Add your thoughts if needed.09:50
openstackgerritSagi Shnaidman proposed openstack/tripleo-ci master: Run upgrades-stein job in CI repos on master  https://review.opendev.org/67105509:51
gchamoulTengu: sorry but when I read or listen tech-preview for validations, it makes me laugh or sometimes it makes me angry!09:51
Tengugchamoul: same for me... think more "the new way to run them is on tech-prev"... ? :)09:52
*** gfidente|afk is now known as gfidente09:52
*** avivgta has joined #tripleo09:54
*** hberaud is now known as hberaud|lunch09:56
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: Enable os_tempest for master multinode jobs  https://review.opendev.org/67144710:05
*** jpich has quit IRC10:06
chandankumarTengu: marios|ruck sshnaidm https://review.opendev.org/#/c/671447/ will fix multinode job properly10:07
*** jpich has joined #tripleo10:07
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart master: Run multinode jobs on all patches  https://review.opendev.org/67071910:11
sshnaidmchandankumar, please rebase on this patch ^^10:12
sshnaidmchandankumar, currently multinode doesn't run on master, I fix it10:12
*** paramite has quit IRC10:14
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: DO-NOT-MERGE Test new ceph-ansible builds  https://review.opendev.org/50198710:14
openstackgerritGiulio Fidente proposed openstack/tripleo-quickstart master: DO-NOT-MERGE Enable the centos testing repo for ceph  https://review.opendev.org/50181010:14
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: DO-NOT-MERGE Test new ceph-container builds  https://review.opendev.org/56221310:16
*** dsneddon has joined #tripleo10:18
*** pkopec has quit IRC10:20
*** pkopec has joined #tripleo10:20
*** shyamb has quit IRC10:23
*** shyam89 has joined #tripleo10:23
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: Enable os_tempest for master multinode jobs  https://review.opendev.org/67144710:27
*** morazi has quit IRC10:27
chandankumarsshnaidm: done10:27
*** shyam89 has quit IRC10:29
sshnaidmmarios|ruck, please revote https://review.opendev.org/#/c/67071910:29
marios|rucksshnaidm: NO NEIN LA ΟΧΙ never10:33
sshnaidmmarios|ruck, нет?10:33
sshnaidmmarios|ruck, למה?10:34
marios|ruck(already voted )10:34
sshnaidmmarios|ruck, спасибо10:36
* marios|ruck bows10:37
openstackgerritMerged openstack/tripleo-common master: Set scenario009 job voting to false  https://review.opendev.org/67097910:43
openstackgerritMerged openstack/tripleo-upgrade master: Handle when upgrade_prepare_extra_params is a string.  https://review.opendev.org/67013010:43
openstackgerritCarlos Camacho proposed openstack/tripleo-ansible master: Add playbook to stop containers  https://review.opendev.org/66965010:45
*** shyamb has joined #tripleo10:46
*** hberaud|lunch is now known as hberaud10:50
*** amoralej is now known as amoralej|lunch10:56
Tengugchamoul: https://asciinema.org/a/K8TgP2Z1LYk9zOVq7RSMHGNb2 :)10:58
openstackgerritM V P Nitesh proposed openstack/diskimage-builder master: efibootmgr is need to create boot entries  https://review.opendev.org/67145611:01
gchamoulTengu: Cool!11:01
Tengugchamoul: I've integrated your latest change for the --plan thingy. Working just fine :). Can't wait to see the listing without mistral :D11:03
Tengugchamoul: I'll work a bit on the playbook optimization.11:03
Tengui.e. drop the fact gathering.11:03
*** holser has quit IRC11:04
*** holser has joined #tripleo11:04
*** bogdando has quit IRC11:04
gchamoulTengu: cool, thanks!11:04
*** bogdando has joined #tripleo11:06
*** holser has quit IRC11:08
openstackgerritGael Chamoulaud proposed openstack/python-tripleoclient master: Add plan parameter to run_ansible_playbook function  https://review.opendev.org/67128911:10
gchamoulTengu: it adds the --stack alias to the --plan arg11:11
gchamoul^^^11:11
Tengugchamoul: :+1: :)11:11
openstackgerritHaresh proposed openstack/tripleo-heat-templates master: Change datatype of revalidator,handler threads  https://review.opendev.org/67145811:18
Tengugchamoul: about 4s less if we drop the fact gathering on a simple validation. Worth it. But we're still at 6s for the "undercloud-selinux-mode" for instance.11:19
openstackgerritCédric Jeanneret (Tengu) proposed openstack/tripleo-validations master: Small optimization for validations run: ignore facts  https://review.opendev.org/67146011:26
Tengugchamoul: -^11:26
*** waleedm has joined #tripleo11:27
*** shyamb has quit IRC11:29
*** skramaja has joined #tripleo11:31
*** dsneddon has quit IRC11:32
*** rh-jelabarre has joined #tripleo11:33
*** dsneddon has joined #tripleo11:33
*** tesseract has joined #tripleo11:38
*** dsneddon has quit IRC11:39
*** ratailor has quit IRC11:40
*** holser has joined #tripleo11:42
*** paramite has joined #tripleo11:44
*** marios|ruck is now known as marios|ruck|call11:46
marios|ruck|callrfolco: o/ can you take over for the next hour or so i have call .. nothing much atm incase there are any pings... see https://etherpad.openstack.org/p/ruckroversprint1311:46
marios|ruck|callrfolco: and i'm happy to carry on for first shift. we can sync after the call if you like (well we have planning but after)11:47
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-ci master: RHEL8 support for containers build  https://review.opendev.org/66948711:47
chandankumarsshnaidm: needs +w on this11:48
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-ci master: RHEL8 support for containers build  https://review.opendev.org/66948711:49
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-ci master: RHEL8 support for containers build  https://review.opendev.org/66948711:49
openstackgerritCarlos Camacho proposed openstack/tripleo-ansible master: Add playbook to stop containers  https://review.opendev.org/66965011:54
*** morazi has joined #tripleo11:54
openstackgerritChandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: Enable os_tempest for master multinode jobs  https://review.opendev.org/67144711:54
gchamoulTengu: did you run nova-status or mysql-open-files-limit validations on your env?11:57
gchamoulTengu: if yes did you have issue like "Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?" :/11:58
openstackgerrityatin proposed openstack/tripleo-quickstart master: Enable os_tempest for master multinode jobs  https://review.opendev.org/67144711:58
Tengugchamoul: hmm nope, didn't launched them. Docker you say? that's bad.11:59
Tengugchamoul: lemme try it.11:59
gchamoulTengu: yes validations targeting the overcloud nodes and using Docker as container_cli seem bad tempered today!12:00
Tengugchamoul:     Message: Command `"podman" exec -u root $("podman" ps -q --filter "name=mysql|galera-bundle" | head -1) /bin/bash -c 'ulimit -n'` exited with code: 125: non-zero return code12:00
Tenguinteresting.... that failed on overcloud-0-controller-012:00
gchamoulTengu: yes I don't like the `"podman" ...`12:01
gchamoulTengu: the double-quotes ... in the command12:01
gchamoulTengu: I WANT A CI! :D12:01
*** dsneddon has joined #tripleo12:01
*** dsneddon has quit IRC12:07
Tengugchamoul: let's talk with weshay when he's here :)12:08
Tengugchamoul: we might (MIGHT) have a job.12:08
Tengugchamoul: that said, the error is: Error: unable to exec into /bin/bash: no container with name or ID /bin/bash found: no such container12:09
gchamoulTengu: yes scenario00312:09
Tengugchamoul: meaning: not a quoting issue apparently :/12:09
Tengugchamoul: that one yes12:09
*** ansmith has quit IRC12:10
Tengugchamoul: so yeah. the --filter value isn't working.12:10
*** aakarsh|2 has quit IRC12:10
Tengui.e. "name=mysql" will pass, but not with the "|galera"12:11
rfolcomarios|ruck|call, ok np12:12
*** rfolco is now known as rfolco|rover12:12
openstackgerritMerged openstack/tripleo-heat-templates master: Add missing update_serial key to compute roles  https://review.opendev.org/67131412:12
Tengugchamoul: guess we're good for some bug opening against podman/libpod in order to make the "filter" option work as docker...12:13
openstackgerritHarald Jensås proposed openstack/python-tripleoclient stable/rocky: Only validate admin and public host in local_subnet cidr  https://review.opendev.org/67147012:15
openstackgerritCédric Jeanneret (Tengu) proposed openstack/tripleo-validations master: Small optimization for validations run: ignore facts  https://review.opendev.org/67146012:20
*** shyamb has joined #tripleo12:23
Tengugchamoul: updated, didn't see those 3 roles were using roles... thanks for reviewing!12:23
ccamachohey cloudnull! so I just finished to test the tripleo-ansible role (containers stop) in my queens environment and it has the same behavior than the one in queens12:25
ccamachoI removed the workflow -112:25
ccamachothanks!12:25
ccamachohttps://review.opendev.org/#/q/topic:stop-pre-upgrade+(status:open+OR+status:merged)12:25
ccamacho;)12:25
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Set canonical hostname in octavia config inventory  https://review.opendev.org/67108712:25
openstackgerritBrent Eagles proposed openstack/tripleo-heat-templates master: Set canonical hostname in octavia config inventory  https://review.opendev.org/67108712:26
openstackgerritBrent Eagles proposed openstack/tripleo-ansible master: Use canonical hostname when setting up network ports  https://review.opendev.org/67108812:26
*** udesale has quit IRC12:26
*** amoralej|lunch is now known as amoralej12:26
*** udesale has joined #tripleo12:27
Tengugchamoul: do you have a way to check how `docker ps --filter "name=foo|bar"' is working? I don't see mention of that usage in their doc. Wondering if it works, if so I'll open an issue against libpod.12:31
EmilienMcloudnull: hey, checkout my comment on https://review.rdoproject.org/r/#/c/21520/12:31
*** saneax has quit IRC12:32
gchamoulTengu: we use it since rocky and it was working but I don't remember where I found this trick12:32
gchamoultbh12:33
*** raildo has joined #tripleo12:34
*** dsneddon has joined #tripleo12:34
openstackgerritCarlos Camacho proposed openstack/tripleo-ansible master: Add playbook to stop containers  https://review.opendev.org/66965012:35
*** aakarsh|2 has joined #tripleo12:36
openstackgerritGrzegorz Grasza proposed openstack/tripleo-heat-templates stable/queens: Support TLS deployments with KernelDisableIPv6 enabled  https://review.opendev.org/67147312:36
openstackgerritCarlos Camacho proposed openstack/tripleo-common stable/stein: Add playbook to stop containers (stein only)  https://review.opendev.org/66934512:37
*** ansmith has joined #tripleo12:42
*** avivgta has quit IRC12:42
cloudnullmornings all12:44
openstackgerritMerged openstack/tripleo-ansible master: Cover the case when the container engine is not available.  https://review.opendev.org/67097112:44
*** ekultails has joined #tripleo12:50
weshayTengu gchamoul hey guys..12:53
weshayTengu so sounds like you're clear to take over scen003 but Alex would like to leave designate for now.. unless the networking team confirms it will never come back12:55
*** vinaykns has joined #tripleo12:56
cloudnullping - cloudnull mwhahaha sshnaidm ekultails sshnaidm zbr owalsh EmilienM dpeacock slagle mnaser Tengu gchamoul - transformation meeting starting in a couple minutes12:58
sshnaidmcloudnull, can we consider the meeting time change? I think we talked about it previous time13:00
* EmilienM transforms himself13:00
sshnaidmnot sure what was decided13:00
cloudnull++ lets talk about it, we brought it up last week but nobody voted on it :'(13:00
sshnaidmEmilienM, Optimus? :)13:01
zbro/13:01
cloudnull#startmeeting tripleo13:01
openstackMeeting started Thu Jul 18 13:01:18 2019 UTC and is due to finish in 60 minutes.  The chair is cloudnull. Information about MeetBot at http://wiki.debian.org/MeetBot.13:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.13:01
*** openstack changes topic to " (Meeting topic: tripleo)"13:01
openstackThe meeting name has been set to 'tripleo'13:01
cloudnull#topic rollcall13:01
*** openstack changes topic to "rollcall (Meeting topic: tripleo)"13:01
cloudnullwho's not here :D13:01
zbri have some news regarding molecule and rhel813:02
cloudnullvery cool, lets make sure to raise that in open discussion.13:02
zbrsure13:03
cloudnullfor a reminder13:03
cloudnull#link https://storyboard.openstack.org/#!/project/openstack/tripleo-ansible13:03
cloudnull#link https://etherpad.openstack.org/p/tripleo-ansible-agenda13:03
cloudnulletherpad and storyboard project13:03
gchamoulweshay: o/13:03
cloudnull#link https://storyboard.openstack.org/#!/board/17413:04
cloudnulland our general work board.13:04
cloudnullgive folks a few more minutes to trickle in13:04
*** shyamb has quit IRC13:05
gchamouloh didn't notice that storyboard could replace trello! :D13:05
cloudnull++13:05
cloudnullshameless plug https://cloudnull.io/2019/06/trello-to-storyboard-migration/13:05
Tenguweshay: yep (sorry, on mtg until now). let's see how it goes with designate.13:06
cloudnullgchamoul ^13:06
cloudnullanyway, getting on with it13:06
cloudnull#topic recap from past weeks13:06
*** openstack changes topic to "recap from past weeks (Meeting topic: tripleo)"13:06
weshayTengu you can add some services as well that may be better for validations13:06
cloudnullprevious ACTION: ekultails to work on getting tripleo-persist into tripleo-ansible13:07
gchamoulcloudnull: impressive!13:07
cloudnullekultails hows that going?13:07
cloudnulllooks like there is a review for it13:08
cloudnull#link https://review.opendev.org/#/c/670362/13:08
cloudnullthough its in merge conflict, is there anything we can do to help that along ?13:08
cloudnullprevious ACTION: cloudnull to start working on porting the hiera roles to tripleo-ansible13:08
cloudnull^ I've held back becuase the hiera roles are being worked on in tripleo-common. once we've stabalized those existing roles I'll work on porting them -cc EmilienM slagle13:09
openstackgerritJose Luis Franco proposed openstack/tripleo-heat-templates master: Force removal of docker container in tripleo-docker-rm.  https://review.opendev.org/67079613:09
paramiteGuys, pretty please merge this: https://review.opendev.org/#/c/624325/13:10
paramitepanda, ^13:10
cloudnullprevious ACTION: sshnaidm to look into ARA.13:10
EmilienMcloudnull: feel free to move it13:10
cloudnullis that still on-hold at this point?13:10
EmilienMcloudnull: I haven't been able to address slagle's review yet13:10
sshnaidmcloudnull, started to play with it in molecule jobs, but no review still13:10
EmilienMcloudnull: if you move it, I'll rework my patch on top of yours, so no biggies13:11
cloudnullEmilienM ++ I just didn't want to impede progress, however I can get on that ASAP.13:11
EmilienM+113:11
cloudnull#ACTION cloudnull to start porting hiera roles, for real this time13:11
openstackgerritGael Chamoulaud proposed openstack/python-tripleoclient master: Add plan parameter to run_ansible_playbook function  https://review.opendev.org/67128913:11
cloudnullonce these three roles are moved over, we're out of tripleo-common13:12
cloudnull#link https://github.com/openstack/tripleo-common/tree/master/roles13:12
Tengugchamoul: ok, I can open an issue against libpod "filter". Could prove the docker version does work with "foo|bar".13:12
cloudnulland ekultails has taken care of the persist role.13:12
cloudnullso good progress.13:12
cloudnullsshnaidm cool13:12
cloudnullanything we can help with on that front ?13:13
gchamoulTengu: like I said, we use it since Rocky so with docker.13:13
sshnaidmcloudnull, not right now13:13
cloudnull++13:13
sshnaidmcloudnull, I think we need to consider a standard way to add plugins/modules/whatever to ansible run in tripleo, not sure if it exists..13:13
*** Guest99405 is now known as redrobot13:13
sshnaidmcloudnull, ara is not last plugin we'll want to use13:14
cloudnullwe have that here https://github.com/openstack/tripleo-ansible/tree/master/tripleo_ansible/ansible_plugins for plugins we make13:14
EmilienMI think sshnaidm means a place where we control which ones we enable in a centralized way?13:15
sshnaidmwhat EmilienM said ^13:15
sshnaidmcurrently ara is installed in CI in mistral container in hacky way13:16
sshnaidmit should change13:16
EmilienMok I see, we need an interface to configure which plugins we want to enable when deploying tripleo13:16
EmilienMno matter it's standalone, undercloud or overcloud13:16
sshnaidmyeah, install them, their dependencies and enable13:16
sshnaidmbecause plugin have also dependencies we should care about them13:17
EmilienMso for undercloud it could be a new parameter in undercloud.conf, and in overcloud/standalone, a heat parameter13:17
EmilienMwhich would lay down the config13:17
mwhahahawe already expose being able to provide the ansible.cfg, so what's missing?13:17
Tengugchamoul: https://github.com/containers/libpod/issues/359613:17
mwhahahaalso we don't expect customers to add plugins13:17
sshnaidmmwhahaha, I think installation and dependencies13:17
mwhahahashould be rpms in standard locations13:18
cloudnullwe could edit the ansible action script to do that ?13:18
cloudnull#link https://github.com/openstack/tripleo-common/blob/master/tripleo_common/actions/ansible.py#L5213:18
mwhahahaif they aren't, we're doing it wrong13:18
sshnaidmmwhahaha, ara doesn't have rpm afaik13:18
mwhahahaara won't be shipped13:18
gchamoulTengu: ++13:18
mwhahahaso that's something specific to us and not part of tripleo proper13:18
mwhahahaalso ara 1.x is problematic so i don't really want to add ara support right now13:18
sshnaidmmwhahaha, yes, but we still want it13:19
mwhahahai think that's an ara problem not tripleo13:19
cloudnull-cc dmsimard13:19
sshnaidmmwhahaha, it can work with <1 version like we have now in CI13:19
sshnaidmmwhahaha, and maybe to enable it for undercloud eventually13:20
mwhahahaafter we get rid of mistral maybe13:20
mwhahahaand then this is moot13:20
mwhahahai wouldnt' spend time trying to fix the mistral integration13:20
Tengupoor mistral. nobody's loving it13:20
d0ugallol13:20
mwhahahawhich is why it's such a hack to enable13:21
sshnaidmwhen do we plan to get rid of it?13:21
* d0ugal ducks13:21
mwhahahasoonish (tm)13:21
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Bump ceph/daemon container image to v4.0.1  https://review.opendev.org/67148213:21
mwhahahawe're looking into it now13:21
sshnaidmnever liked it13:21
mwhahahapoint being, we should spend the resources to fix why we have this problem rather than working around it :D13:22
sshnaidmok, so leaving the old way of injecting ara in CI?13:23
mwhahahafor now13:23
sshnaidmack13:23
sshnaidmand what with other possible fancy plugins?13:23
mwhahahawe revisit when we have new fancy plugin13:23
cloudnullsshnaidm if its something we're shipping with tripleo I think we would just need to add them to13:24
cloudnull#link https://github.com/openstack/tripleo-ansible/tree/master/tripleo_ansible/ansible_plugins13:24
cloudnullunless its something that has to be specifically enabled, like a call back13:24
cloudnullthen we'd have to edit the tripleo action config too13:24
sshnaidmcloudnull, ok13:25
cloudnullthings like action plugins, libraries, etc would get automatically picked up if we put them in that path13:25
cloudnullwe do have a few plugins, and they're doc'd13:25
cloudnull#link https://docs.openstack.org/tripleo-ansible/latest/modules.html13:25
sshnaidmcloudnull, well, we can't just take plugin of somebody and put in our repo13:26
sshnaidmI think13:26
cloudnull++ correct, I think that would be bad form13:26
sshnaidmis it's just python package13:26
mwhahahain order for it to be in tripleo it needs to be packageds13:26
mwhahahaand should use standard paths that we can add13:26
sshnaidmmwhahaha, in case we ship it13:26
sshnaidmand it's part of the product13:27
cloudnullthe plugins in tripleo-ansible were all written by us.13:27
mwhahahaunless you have a specific example i think we're going to keep going around in circles on this13:27
cloudnull++13:27
sshnaidmyeah, agree, let's move on13:27
sshnaidmwe'll talk about it when I find next fancy callback plugin13:27
cloudnull:)13:27
cloudnull#topic THT 2 TripleO-Ansible13:27
*** openstack changes topic to "THT 2 TripleO-Ansible (Meeting topic: tripleo)"13:27
cloudnullHere is our current work-lists13:27
cloudnull#link https://storyboard.openstack.org/#!/worklist/68513:27
cloudnull#link https://storyboard.openstack.org/#!/worklist/71113:27
*** hoonetorg has quit IRC13:28
cloudnullI started on a couple services/roles, which could use some reviews13:28
cloudnull#link https://review.opendev.org/#/q/topic:podman-role+(status:open+OR+status:merged)13:28
cloudnull#link https://review.opendev.org/#/q/topic:time-role+(status:open+OR+status:merged)13:28
cloudnullbut there are A LOT of things in those lists13:28
cloudnullso help would be greatly appreciated.13:28
cloudnullunless folks want to talk more about that, I'd like to move right in to Open Discussion13:29
cloudnull#topic Open Discussion13:29
*** openstack changes topic to "Open Discussion (Meeting topic: tripleo)"13:29
cloudnullzbr what to kick us off with the RHEL 8 bits ?13:29
cloudnullEmilienM new role for config things ?13:30
EmilienMo/13:30
EmilienMI'm currently exploring the replacement of Puppet by Ansible to generate config files13:30
EmilienMwe started the process to import ansible-config_template in RDO13:31
EmilienMand I plan to create a basic role in tripleo-ansible to consume that plugin13:31
EmilienMthat module*13:31
cloudnull#link https://review.rdoproject.org/r/#/q/(topic:ansible_config_template+OR+topic:pkg-config_template)+(status:open+OR+status:merged)13:32
EmilienMthis role would be the interface for THT to generate the configuration files13:32
cloudnullthank you chandankumar and others for helping to move that along13:32
EmilienMI'll give more updates when I have actual progress. I just wanted to share the plan13:33
cloudnullcool!13:33
* EmilienM done13:33
openstackgerritMartin Schuppert proposed openstack/tripleo-heat-templates master: Only run cellv2 host discovery on default cell  https://review.opendev.org/67148613:34
cloudnull#link https://review.opendev.org/#/c/669672/13:34
zbrcloudnull: re rhel8, I added some comments on the document. if we write molecule.yml files with overridable vars inside, we can test on alternative platforms.13:34
cloudnullto EmilienM role13:34
*** waleedm has quit IRC13:34
cloudnullzbr mind walking us through some of what you were thinking ?13:35
zbrsadly i do not have something ready, but you can get an idea from https://review.rdoproject.org/r/#/c/21489/11/molecule/default/molecule.yml13:36
cloudnullin tripleo-ansible we do have a couple roles running with the delegated driver, is there something we need to change to make what your thinking go ?13:36
zbrif we put a single platform at platforms, and use envvars, we can create additional jobs that override default platform.13:36
*** beekneemech has joined #tripleo13:36
*** bnemec has quit IRC13:37
cloudnulloic13:37
cloudnullso then we'd have 1 job per OS?13:37
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Skip standalone deploys if tox jobs fail  https://review.opendev.org/67107113:37
cloudnullin most cases, at this point, that would be CENT7 and FED28 (for tripleo-ansible)13:38
mariosfolks zbr is currently on the phone with tripleo-ci squad for sprint planning he might be a bit slow to respond for few mins13:38
* mnaser lurks13:39
cloudnullnp13:39
cloudnullsshnaidm want to talk about meeting times?13:39
sshnaidmcloudnull, yeah :D we're double booked13:39
sshnaidmcloudnull, I thought about voting on doodle or kind of13:40
cloudnullthere was a vote here in the last IRC meeting, however, nobody, except me, voted.13:40
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Revert "Linting hardening via pre-commit"  https://review.opendev.org/67105613:40
cloudnull#link http://eavesdrop.openstack.org/meetings/tripleo/2019/tripleo.2019-07-11-13.00.html13:41
cloudnullitem 6.13:41
cloudnullhowever we can do that again? or do we want to send something to the ML13:41
openstackgerritAlex Schultz proposed openstack/tripleo-common master: Set container=oci for our containers  https://review.opendev.org/67057413:42
sshnaidmcloudnull, whatever works, but not changing this after voting like we did :)13:43
cloudnullhahaha.13:44
openstackgerritGael Chamoulaud proposed openstack/python-tripleoclient master: Don't use local connection by default for the validations  https://review.opendev.org/67149113:44
mnaserEmilienM, cloudnull: just fyi i'm going to be reviewing and clearing up all open ansible-config_template reviews, feel free to ping me if you need any review work13:44
sshnaidmcloudnull, we can submit a patches with times and people can +1/-1 them13:44
*** dsneddon has quit IRC13:45
cloudnull#action cloudnull to send a message to the ML w/ a doodle so we can nail down an appropriate meeting time that works for more folks.13:45
* mnaser has a small thing to bring up after the time discussion13:45
cloudnullsshnaidm I'll take it to the ML so everyone has a chance to participate13:46
* cloudnull hands mic to mnaser13:46
sshnaidmcloudnull, ack, maybe using like that: https://doodle.com/poll/2hb42hhq678m9f5k13:46
ekultails++13:46
cloudnullsshnaidm ++13:46
mnaserso one of the things that's awesome is that we're sharing a lot of stuff together (yay), but i feel like an odd thing seems like one group or another has 'ownership' over the stuff we collaborate one13:47
mnaserso triploe consumes ansible-config_template and os_tempest but its technically "openstack-ansible" yet no one from tripleo team is in openstack-ansible so logistically i feel like that might be limiting from time to time13:47
mnaseri'm wondering if there maybe a good idea in possibly taking s ome openstack-ansible repos and having them with a shared core-wnership from tripleo-ansible and openstack-ansible13:48
EmilienMwe don't consume ansible-config_template yet btw, we're in the process to look at it :D13:48
EmilienMbut yeah13:49
mnaserwell just in general, yeah, as an overall idea13:49
EmilienM+1 for shared ownership13:49
arxcruzEmilienM, we use it on os_tempest13:49
cloudnullmnaser that's a good idea13:50
ekultailsDefinitely +113:50
*** raildo has quit IRC13:50
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates stable/stein: Add facter cache for container configurations  https://review.opendev.org/67149213:50
mnasertotally ok with any other proposals but given the "openstack-ansible" seems like a pretty .. good namespace for shared workspace, i think it might be good to keep it and maybe create an acl called openstack-ansible-collab and have both OSA cores and tripleo-ansible cores in there?13:51
cloudnullarxcruz ++ hopefully we can start using the shiny new package for the config_template plugin soon :)13:51
cloudnullis still OSA core on all the things13:52
* cloudnull hides 13:52
mnaser:P13:52
sshnaidmmnaser, I think we don't have "tripleo-ansible" cores, tripleo has a shared cores space13:52
sshnaidmmnaser, but could be a tripleo-ansible squad13:53
cloudnullI think there is a project config for it, though im not sure anyone is in the group though13:53
mwhahahawe can create a tripleo-ansible group13:53
mwhahahano big deal13:53
mnaseri guess as long as we try to 'share' ownership (i.e. like at least have an OSA core 'ok' a patch alongside a tripleo one) that would be nice13:53
dmsimardmwhahaha, sshnaidm, cloudnull: let's take a few mins to sync about the status of ara 1.x after meeting :)13:53
mwhahahamight help with some of the ansible review thingies13:53
mnaserbut i think we all have been around enough to trust each other not to break eachother :D13:54
sshnaidmdmsimard, sure13:54
mnaser(and hopefully that encourages use of more cross-project jobs so we dont accidentally break each other anyways)13:54
cloudnullmwhahaha https://review.opendev.org/#/admin/projects/openstack/tripleo-ansible,access - so maybe we just need to add people to that group?13:54
cloudnulldmsimard ++13:55
mwhahahawill need to check if that's actually in use13:55
mwhahahabut yea13:55
mnasertripleo-ansible-core seems to have all of tripleo inside of it13:55
cloudnullmnaser ++13:55
mnaserwhich tbh, i dont really mind as long as people arent just merging random stuff anyways :p13:55
* cloudnull broke the gate yesterday with my config_template patch .... 13:55
mnaserso not to complicate things, ill push up a patch for openstack-ansible-collab and add both tripleo-ansible-core and openstack-ansible-core to it13:55
mwhahahawe'll just blame cloudnull13:55
cloudnulla cross project gate would have been super useful13:56
*** artom has quit IRC13:56
cloudnullmwhahaha that's fair13:56
arxcruzcloudnull, https://www.youtube.com/watch?v=SrDSqODtEFM13:56
mnaserand then maybe ansible-config_template or os_tempest could be the first target to add13:56
mnaserdoes that sound good? :>13:56
cloudnullarxcruz https://twitter.com/cloudnull/status/115158894860880281613:56
arxcruzcloudnull, i see that :)13:56
cloudnull:D13:57
cloudnullmnaser ++13:57
mnaserok ill try to do this today13:57
cloudnullany takers to work on that ?13:57
cloudnullcool !13:57
mnaserill do the acl-y stuff13:57
cloudnull#action mnaser to see about setting up acl-y stuff for cross project thing-a-me's13:58
cloudnullok welp, we're just about out of time. anything else ?13:58
cloudnullOK well, great meeting all!13:58
cloudnull#endmeeting13:58
*** openstack changes topic to "CI Status: RED RDOCloud Status: MEHish | community irc meeting Tues@1400 UTC - tripleo-ci-community meeting Tues@1330 UTC | https://docs.openstack.org/tripleo-docs/latest/"13:59
openstackMeeting ended Thu Jul 18 13:58:59 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)13:59
openstackMinutes:        http://eavesdrop.openstack.org/meetings/tripleo/2019/tripleo.2019-07-18-13.01.html13:59
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2019/tripleo.2019-07-18-13.01.txt13:59
openstackLog:            http://eavesdrop.openstack.org/meetings/tripleo/2019/tripleo.2019-07-18-13.01.log.html13:59
cloudnulldmsimard mwhahaha sshnaidm - still around and want to talk ara ?14:00
dmsimardyup14:00
*** cylopez has quit IRC14:00
dmsimardso, in a nutshell14:00
dmsimardfeature parity for the sqlite middleware (i.e, what runs "ara-report" from sqlite databases on logs.o.o) has landed and we're experimenting with static generation14:01
mwhahahayea i saw that was in progress14:01
mwhahahawhat about rpm distribution?14:02
dmsimardfor packaging, I'm working on updating the spec in fedora: https://src.fedoraproject.org/rpms/ara/pull-request/114:02
dmsimardI got a little rabbit holed by missing deps but I got a successful local build off14:02
mwhahahabut is python3 only?14:03
dmsimardnow, while the API is py3 only (as per django dependency), the ansible plugins (like the callback) /could/ work on py214:03
dmsimardlacking human bandwidth to support many things concurrently14:03
dmsimardfwiw the api server is a good candidate for being put in a container14:04
dmsimardI haven't yet looked at what is missing to bring the packaging to centos8, wouldn't complain if someone wanted to help with that14:05
mwhahahaso it sounds like we'll need centos8 and then we can revisit it14:06
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Remove support for Cisco N1KV  https://review.opendev.org/66995014:07
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Remove support for Midonet plugin  https://review.opendev.org/67082814:07
dmsimardsomething that I think would be interesting to consider with the new API would be to have all the results in a single place instead of scattered across different reports (due to nested ansible use)14:07
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Remove mac_hostname & random_string  https://review.opendev.org/67091614:07
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Move instanceha into scripts  https://review.opendev.org/67112914:07
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Remove extraconfig/services directory  https://review.opendev.org/67114014:08
mwhahahai think if we can get it packaged and working under centos8 it might be something we can consider for including on the undercloud14:08
dmsimardI'll be writing a spec to plan the upgrade from a Zuul perspective14:09
*** yolanda has joined #tripleo14:09
dmsimardmwhahaha: wfm14:10
mnasermwhahaha, EmilienM, cloudnull, ekultails, arxcruz, sshnaidm: http://lists.openstack.org/pipermail/openstack-discuss/2019-July/007880.html :)14:11
*** ykarel is now known as ykarel|away14:12
ekultailsmnaser: Great, thanks for writing that up and sending it out!14:13
ekultails++14:13
arxcruzmandre, u da man14:13
cloudnullmnaser ++14:14
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates stable/rocky: Add facter cache for container configurations  https://review.opendev.org/67149914:14
*** dsneddon has joined #tripleo14:15
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates stable/queens: Add facter cache for container configurations  https://review.opendev.org/67150014:15
bogdandoPTAL https://review.opendev.org/#/c/669178/14:15
*** ccamacho has quit IRC14:15
mwhahahabogdando: i had comment on that patch14:15
mnasercool, appreciate comments/replies on it14:16
*** avivgta has joined #tripleo14:17
*** ykarel|away has quit IRC14:17
chandankumarcloudnull: blame me for not adding the job there, tripleo job is already there against python-venv_build and os_tempest14:19
*** ccamacho has joined #tripleo14:20
*** iurygregory has quit IRC14:23
openstackgerritLuke Short proposed openstack/tripleo-ansible master: Import the tripleo-persist role from tripleo-common.  https://review.opendev.org/67036214:24
cloudnullchandankumar its not your fault.14:28
cloudnullsome of these cross project initiatives are new, so there are bound to be gaps14:28
cloudnulland its not like you submitted a review to change the install path :P14:28
*** sabedevops has joined #tripleo14:34
*** vinaykns has quit IRC14:39
*** iurygregory has joined #tripleo14:40
*** vinaykns has joined #tripleo14:41
EmilienMmnaser: lol 0 1 2 = 3 ;-)14:42
mnaserits early ok :(14:43
chandankumarmwhahaha: EmilienM https://review.opendev.org/#/c/671447/ please have a look thanks since clouds.yaml came in play for master release only fs1014:44
chandankumaris used for testing branchless projects also14:44
*** Vorrtex has joined #tripleo14:48
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Add var for {{network.name_lower}}_cidr  https://review.opendev.org/67150414:51
openstackgerritLuke Short proposed openstack/tripleo-ansible master: Import the tripleo-persist role from tripleo-common.  https://review.opendev.org/67036214:53
*** hberaud has quit IRC14:57
*** ratailor has joined #tripleo14:58
xektesseract, I'm building a new package https://brewweb.engineering.redhat.com/brew/taskinfo?taskID=2268710014:58
xekww14:59
tesseractxek++ woot, awesomesauce (and sorry for all the SPAM on your bug; me--)14:59
*** hberaud has joined #tripleo14:59
*** cylopez has joined #tripleo15:00
*** kopecmartin is now known as kopecmartin|off15:03
*** skramaja has quit IRC15:06
openstackgerritBrent Eagles proposed openstack/tripleo-quickstart-extras master: Add support for running Octavia tempest tasks  https://review.opendev.org/67013515:07
*** artom has joined #tripleo15:08
openstackgerritMerged openstack/tripleo-ci master: Revert "Move tripleo-ci-centos-7-containers-multinode to os_tempest"  https://review.opendev.org/67141915:10
*** cdearborn has joined #tripleo15:16
*** ykarel|away has joined #tripleo15:23
*** hoonetorg has joined #tripleo15:26
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-heat-templates master: Convert THT file to use new role  https://review.opendev.org/67110715:26
ykarel|awayEmilienM, mwhahaha can u review https://review.opendev.org/#/c/671220/15:26
EmilienMlooking15:27
EmilienMlgtm15:29
*** moguimar has left #tripleo15:29
ykarel|awayEmilienM, Thanks15:30
*** dsneddon has quit IRC15:30
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Use ansible vars in single-nic-vlans nic config  https://review.opendev.org/67151315:32
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Create a time role  https://review.opendev.org/67116515:33
openstackgerritJames Slagle proposed openstack/tripleo-heat-templates master: Use ansible vars in single-nic-vlans nic config  https://review.opendev.org/67151315:34
openstackgerritMerged openstack/tripleo-common master: Rsyslog image pull  https://review.opendev.org/62432515:36
*** marios|ruck|call is now known as marios|ruck15:38
*** pbandark has joined #tripleo15:39
*** dsneddon has joined #tripleo15:40
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Rsyslog composable service  https://review.opendev.org/62433015:41
*** sabedevops has quit IRC15:41
openstackgerritMartin Mágr proposed openstack/tripleo-heat-templates master: Rsyslog composable service  https://review.opendev.org/62433015:41
*** sabedevops has joined #tripleo15:41
*** dsneddon has quit IRC15:50
*** dsneddon has joined #tripleo15:55
*** marios|ruck is now known as marios|ruck|call15:57
*** beekneemech has quit IRC15:57
*** bnemec has joined #tripleo15:58
*** dsneddon has quit IRC16:00
*** iurygregory has quit IRC16:01
*** dsneddon has joined #tripleo16:03
*** sabedevops has quit IRC16:04
*** lucasagomes has quit IRC16:05
*** jfrancoa has quit IRC16:05
*** rpittau is now known as rpittau|afk16:05
*** ratailor has quit IRC16:05
slagleEmilienM: have you seen this during the generate config step? http://paste.openstack.org/show/754560/16:06
*** sabedevops has joined #tripleo16:06
*** bogdando has quit IRC16:09
mnaserany tripleo experts can verify that https://review.opendev.org/#/c/671501/ is indeed using the ansible-config_template that was checked out?16:10
EmilienMslagle: looks like related to https://review.opendev.org/#/c/669011/11/common/container-puppet.py16:10
slagleoh indeed16:10
EmilienMmnaser: it's not useful yet IMHO16:11
EmilienMmnaser: we aren't using ansible-config_template anywhere in tripleo yet16:11
mnaserEmilienM: well os_tempest is used in that job16:11
EmilienMah16:11
mnaserand that uses it16:11
EmilienMI forgot about this one16:11
EmilienMthen yes16:11
mnaserbut i dont really know the internals enough to know if it checked it out right16:11
EmilienMlet me check16:11
EmilienMchandankumar: ^16:12
EmilienMchandankumar: is ansible-config_template installed from source in tripleo-ci-centos-7-standalone-os-tempest ?16:12
chandankumarEmilienM: yes16:12
mnaserhttp://logs.openstack.org/01/671501/1/check/tripleo-ci-centos-7-standalone-os-tempest/2a8cb3a/job-output.txt.gz#_2019-07-18_14_40_08_18315416:12
mnaseryeah i saw this16:12
EmilienMmwhahaha: fyi http://paste.openstack.org/show/754560/ (slagle's comment)16:13
chandankumarmnaser: let me guide it16:13
mnaserchandankumar: if you can just confrim its all good, then ill +w16:13
EmilienMmwhahaha: i'm wondering if we need to change the permissions on the host16:14
chandankumarmnaser: https://github.com/openstack/tripleo-quickstart/blob/master/quickstart-extras-requirements.txt it all install in TQ venv and there is a https://github.com/openstack/tripleo-quickstart/blob/master/ansible.cfg which takes cares of other stuff16:14
EmilienMmwhahaha: the issue is likely during the "Sync cached facts" task16:14
*** marios|ruck|call is now known as marios|ruck16:15
openstackgerritLuke Short proposed openstack/tripleo-ansible master: Import the tripleo-persist role from tripleo-common.  https://review.opendev.org/67036216:15
chandankumarmnaser: it is working fine result is here http://logs.openstack.org/01/671501/1/check/tripleo-ci-centos-7-standalone-os-tempest/2a8cb3a/logs/stestr_results.html16:15
mnaserokay seems good :)16:15
*** sabedevops has quit IRC16:16
*** sabedevops has joined #tripleo16:16
EmilienMI suspect you need a become: true for the task because it's delegate_to the host16:16
*** jpich has quit IRC16:18
EmilienMslagle: can you please paste more logs? maybe the whole file if you can. The CI didn't catch it it seems16:18
slagleEmilienM: sure, http://paste.openstack.org/show/754563/16:20
slagleEmilienM: why is the delegate_to even there?. seems like that's just saying to do what ansible would have done already16:20
EmilienMyeah I think it can be removed16:20
slagleinventory_hostname is just going to be whatever the node being configured is, same as all the other tasks in the file16:21
slagleand everythnig already runs with become:true, but i wonder if the delegate_to is breaking it16:21
slaglei can try removing that line?16:21
mwhahahait was in the synchronize docs16:21
mwhahahabecause the problem is that it's traditionally a local -> remote action16:22
mwhahahawe can try removing it16:22
* mwhahaha blames holser for making me switch from rsync16:22
slagleoh i see, yea i guess it makes sense then16:22
slaglesynchronize is generally a disaster ime16:22
mwhahahado we need a become or something16:22
* holser hides16:23
mwhahahais that error from CI or your local env?16:23
slaglemwhahaha: local16:23
EmilienMi'm trying to find it in CI16:23
mwhahahawe might just need to exclude ok i think we need to add those to teh excludes16:23
holsermwhahaha lets switch back from synchronize to rsync back16:23
mwhahahafor the rsync16:23
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add molecule test structure to ceph roles  https://review.opendev.org/66829416:24
mwhahahait's not the syncrhonize16:24
mwhahahait's the stupid rsyncs we have in container-puppet16:24
mwhahahai think it's trying to clean it up because --delete-after16:24
EmilienMwhat do you want to exclude?16:24
EmilienM/etc/puppetlabs/facter/ ?16:24
mwhahahawe need to exclude /{etc,opt}/puppetlabs/16:25
EmilienMright we don't want that in the rsync, I think it's the right fix16:25
EmilienMinteresting that it passed CI :/16:25
mwhahahait could also be a timesync problem16:27
mwhahahabut either way we should be excluding those from the rsync16:27
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: MetricsQdr: Add InternalTLS support  https://review.opendev.org/66252516:28
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: MetricsQdr: Build sslProfiles without internal TLS  https://review.opendev.org/66252616:28
openstackgerritMerged openstack/tripleo-heat-templates master: Set scenario009 job voting to false  https://review.opendev.org/67097816:28
mwhahahaperhaps a revert/fix?16:28
mwhahahaso we can apply it cleanly in the backports16:28
EmilienMyou can also squash the backports16:29
EmilienMso one less commit on master16:29
mwhahahameh i don't want this to hit promotion16:29
EmilienMfair enough16:29
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Revert "Add facter cache for container configurations"  https://review.opendev.org/67152216:29
mwhahahai'd like to understand wtf as well16:29
mwhahahaslagle, EmilienM -^16:30
*** marios|ruck has quit IRC16:30
*** marios has quit IRC16:30
slagledo you want a boog?16:30
mwhahahawould be nice w/ some details16:30
cloudnullanyone around want to help push https://review.opendev.org/#/c/670820/ through ?16:30
*** pbandark has quit IRC16:32
openstackgerritMerged openstack/tripleo-quickstart master: Run multinode jobs on all patches  https://review.opendev.org/67071916:33
*** ansmith_ has joined #tripleo16:33
EmilienMcloudnull: the depends-on needs to land first; https://review.opendev.org/#/c/669195/16:33
cloudnullEmilienM ++16:34
slaglemwhahaha: https://bugs.launchpad.net/tripleo/+bug/183708216:34
openstackLaunchpad bug 1837082 in tripleo "rsync: readlink_stat(\"/etc/puppetlabs/facter/facter.conf\") failed: Permission denied (13)" [Undecided,New]16:34
cloudnulllooks like that just needs a recheck and workflow16:34
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Revert "Add facter cache for container configurations"  https://review.opendev.org/67152216:35
mwhahahagracias16:35
*** ansmith has quit IRC16:35
*** paramite has quit IRC16:36
*** paramite has joined #tripleo16:37
*** ccamacho has quit IRC16:37
*** sshnaidm is now known as sshnaidm|off16:42
*** amoralej is now known as amoralej|off16:44
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Revert "Revert "Add facter cache for container configurations""  https://review.opendev.org/67152416:45
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Re-Add facter cache for container configurations  https://review.opendev.org/67152416:45
mwhahahaslagle, EmilienM -^ should address the issue, i will test later today16:45
*** ansmith_ has quit IRC16:46
*** ansmith_ has joined #tripleo16:46
EmilienMmwhahaha: how big will be exclude_files list :D16:47
mwhahahanot very16:47
mwhahahait's only 3 things at the moment16:47
EmilienMack16:47
*** ramishra has quit IRC16:49
*** panda is now known as panda|off16:51
EmilienMslagle: nice spot btw :D16:53
*** chandankumar is now known as raukadah16:56
EmilienMslagle: I'm abandoning the patches to consolidate hieradata files : 1. it's more complicated than I thought and I don't want to make it more complicated ;-) and 2. I don't want to break what you did so I'll revisit that later and focus on other priorities16:58
*** derekh has quit IRC17:00
*** udesale has quit IRC17:00
slagleEmilienM: ok, i think that makes sense for now. sorry i didn't spot some of these issues immediately.17:02
slagleEmilienM: i do still want to land https://review.opendev.org/#/c/670596/ b/c i think that is a good clean up17:03
*** holser has quit IRC17:04
*** xek has quit IRC17:06
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: Add tcp-check connect port line to haproxy redis stanza  https://review.opendev.org/67152617:11
*** khyr0n has joined #tripleo17:17
*** tosky has quit IRC17:17
*** khyr0n has quit IRC17:18
*** panda|off has quit IRC17:19
*** panda has joined #tripleo17:21
slaglemwhahaha: patch worked for me17:24
*** raildo has joined #tripleo17:30
openstackgerritMatthew Thode proposed openstack/diskimage-builder master: support alternate portage directories  https://review.opendev.org/67153017:33
*** sabedevops has quit IRC17:37
*** sabedevops has joined #tripleo17:42
*** pv2b has quit IRC17:44
*** pv2b has joined #tripleo17:45
openstackgerritMerged openstack/tripleo-common master: Add get_key tasks for package update  https://review.opendev.org/67105017:46
*** Damjanek has quit IRC17:47
*** Damjanek has joined #tripleo17:49
*** yprokule has quit IRC17:50
*** poopcat has joined #tripleo17:50
*** cylopez has quit IRC17:53
*** poopcat has quit IRC17:54
*** hberaud is now known as hberaud|gone18:03
*** psachin has quit IRC18:04
cloudnullanyone around mind giving https://review.opendev.org/#/c/671165/ a review ?18:04
cloudnullwell - https://review.opendev.org/#/q/topic:time-role+(status:open+OR+status:merged)18:04
cloudnulland https://review.opendev.org/#/q/topic:podman-role+(status:open+OR+status:merged)18:04
*** poopcat has joined #tripleo18:05
cloudnullfirst couple of THT to TripleO-Ansible conversions18:05
*** irclogbot_0 has quit IRC18:07
*** poopcat has quit IRC18:07
*** altlogbot_2 has quit IRC18:07
*** poopcat has joined #tripleo18:08
*** irclogbot_1 has joined #tripleo18:09
*** altlogbot_3 has joined #tripleo18:10
openstackgerritGiulio Fidente proposed openstack/puppet-tripleo master: Allow for customization of the Manila CephFS pool name  https://review.opendev.org/67153818:14
openstackgerritLuke Short proposed openstack/tripleo-ansible master: Import the tripleo-persist role from tripleo-common.  https://review.opendev.org/67036218:15
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: WIP - Introduce tripleo-config role  https://review.opendev.org/66967218:16
openstackgerritGiulio Fidente proposed openstack/tripleo-heat-templates master: Transport ManilaCephFSDataPoolName to Manila CephFS template  https://review.opendev.org/67154118:17
EmilienMcloudnull: questions:18:17
EmilienMcloudnull: when running tox locally on tripleo-ansible18:17
EmilienMtripleo_ansible/roles/openstack-operations is created because it's a dependency required by molecule to run, AFIU18:18
EmilienMwe need to either put the dependencies in another dir and add the dir root in the .gitignore18:18
cloudnullyea that would be a good thing18:18
EmilienMor manually add tripleo_ansible/roles/openstack-operations into .gitignore, but then .gitignore needs an update everytime a new thing is added to reqs18:18
EmilienMthoughts?18:19
cloudnullprobable best to have galaxy install that role in a different path18:19
cloudnullinstead of using the local path18:19
EmilienMwhat is the best practise?18:19
EmilienMin .roles or what?18:20
EmilienMor in .tox ?18:20
cloudnullinstalling the roles in /etc/ansible/roles18:20
cloudnullor ~/.ansible/roles18:20
EmilienMhum18:20
EmilienMI don't want these things on my systemd18:20
EmilienMsystem*18:20
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: WIP - Introduce tripleo-config role  https://review.opendev.org/66967218:22
openstackgerritMatthew Thode proposed openstack/diskimage-builder master: support alternate portage directories  https://review.opendev.org/67153018:23
EmilienMcloudnull: when you have time, you can start reviewing https://review.opendev.org/#/c/669672/ maybe and see my last comment18:23
cloudnullEmilienM you could add something like https://pasted.tech/pastes/117b440496fe40052b3af1497ce0db09db0d3891 here https://github.com/openstack/tripleo-ansible/blob/master/tox.ini#L4518:24
* cloudnull reading 18:24
EmilienMcloudnull: ok18:24
cloudnullor maybe we just add a galaxy role path with a gitkeep file and ignore all the other things added to that path?18:25
EmilienMcloudnull: yes, it sounds good18:26
EmilienMcloudnull: can you send a separated patch for that please?18:32
EmilienMi'll rebase my work on yours18:32
*** gfidente has quit IRC18:34
openstackgerritEmilien Macchi proposed openstack/tripleo-docs master: Remove midonet manual  https://review.opendev.org/67154418:39
openstackgerritMatthew Thode proposed openstack/diskimage-builder master: support alternate portage directories  https://review.opendev.org/67153018:40
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add galaxy role path which will be ignored by git  https://review.opendev.org/67154518:42
cloudnullEmilienM ^18:42
EmilienMcloudnull: sounds clean18:43
EmilienMthanks18:43
cloudnulllimpio :)18:44
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Remove extraconfig/services directory  https://review.opendev.org/67114018:44
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: WIP - Introduce tripleo-config role  https://review.opendev.org/66967218:46
cloudnull^ reviewing that commit now18:47
*** sbroderick has joined #tripleo18:50
*** sabedevops has quit IRC18:50
EmilienMcloudnull: take your time18:51
*** cfontain has joined #tripleo19:03
*** cfontain has quit IRC19:09
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Remove mac_hostname & random_string  https://review.opendev.org/67091619:10
EmilienMmwhahaha: I see a lot of red in functional jobs19:11
EmilienMhttp://logs.openstack.org/28/670828/3/check/tripleo-ci-centos-7-undercloud-containers/9a69cca/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz#_2019-07-18_17_22_56_31619:11
EmilienMHTTPError: 500 Server Error: Internal Server Error for url: https://auth.docker.io/token?scope=repository%3Atripleomaster%2Fcentos-binary-barbican-api%3Apull&service=registry.docker.io19:11
mwhahahadocker.io problems looks like19:11
EmilienMweshay: ^19:11
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Remove support for Midonet plugin  https://review.opendev.org/67082819:12
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Remove support for Cisco N1KV  https://review.opendev.org/66995019:13
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Move instanceha into scripts  https://review.opendev.org/67112919:13
cloudnullRE: I see a lot of red in functional jobs - it wasn't me19:28
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: WIP - Introduce tripleo-config role  https://review.opendev.org/66967219:32
cloudnullEmilienM ^ updated that wip role for the plugin path things19:32
openstackgerritDan Sneddon proposed openstack/os-net-config stable/stein: ifdown does not work if no ifcfg file exist  https://review.opendev.org/67155719:32
EmilienMcloudnull: thanks a lot19:33
EmilienMcloudnull: I won't be able to get back to that role today but will address the reviews tomorrow ish19:34
*** morazi has quit IRC19:34
cloudnullit should work now, though we'll see19:35
openstackgerritDan Sneddon proposed openstack/os-net-config stable/rocky: ifdown does not work if no ifcfg file exist  https://review.opendev.org/67155819:37
openstackgerritDan Sneddon proposed openstack/os-net-config stable/queens: ifdown does not work if no ifcfg file exist  https://review.opendev.org/67156019:40
weshayEmilienM aye19:47
EmilienMci red?19:48
openstackgerritMatthew Thode proposed openstack/diskimage-builder master: support alternate portage directories  https://review.opendev.org/67153019:48
weshayI'm looking19:48
weshayEmilienM it has not been good this week.. due to mirrors in ovh19:49
weshayERROR tripleo_common.image.image_export [  ] Error while writing blob /var/lib/image-serve/v2/tripleomaster/centos-binary-cinder-volume/blobs/sha256:a504aebb7910c3c2b2997a14853069eb485350e3368c82d80a016d30a03d94b3.gz19:50
weshayseeing the error to writes as well this week19:50
weshayImage prepare failed: 401 Client Error: Unauthorized for url: http://mirror.gra1.ovh.openstack.org:8082/v2/tripleomaster/centos-binary-nova-libvirt/blobs/sha256:4c3152bda61158839e096bc06c363fb74f80e1b4c8a568f4365207f4542a65c919:50
weshayhttp://logs.openstack.org/18/663018/3/gate/tripleo-ci-centos-7-scenario010-standalone/71a3c0f/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz19:50
weshayovh again19:50
weshaythe blob writing issue is in http://logs.openstack.org/28/671128/1/gate/tripleo-ci-centos-7-standalone/3825eba/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz19:51
weshayboth failing in gate atm19:51
weshayEmilienM afaict.. I can't do anything about it except nudge infra lightly...19:51
weshaywas hoping the ovh errors would improve.. and they have afaict19:52
weshay4 gate failures today, plus these two.. so six19:52
weshaynot great19:52
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Revert "Add facter cache for container configurations"  https://review.opendev.org/67152219:58
openstackgerritAlex Schultz proposed openstack/tripleo-heat-templates master: Re-Add facter cache for container configurations  https://review.opendev.org/67152419:58
*** pcaruana has quit IRC20:01
*** tesseract has quit IRC20:05
*** Vorrtex has quit IRC20:07
openstackgerritEmilien Macchi proposed openstack/tripleo-specs master: WIP - Specs for removing Puppet from TripleO  https://review.opendev.org/67156320:17
weshayanybody have experience running standalone on rhel8?20:21
weshaysome weirdness http://paste.openstack.org/show/754569/20:21
mnaserhmm20:21
weshayansible can't import jinja but it's there20:21
*** mwhahaha changes topic to "CI Status: YELLOWish RDOCloud Status: MEHish | community irc meeting Tues@1400 UTC - tripleo-ci-community meeting Tues@1330 UTC | https://docs.openstack.org/tripleo-docs/latest/"20:22
mwhahahaweshay: yea it works fine, let me look20:22
mnaseri know ci might be borked rn20:22
mnaserhttp://logs.openstack.org/69/612569/4/check/tripleo-ci-centos-7-standalone-os-tempest/c97400e/logs/20:22
mnaseri was wondering where can  ifind the quickstart deploy logs20:22
mnaseri.e. set -o pipefail && /home/zuul/standalone.sh 2>&1 | awk '{ print strftime(\"%Y-%m-%d %H:%M:%S |\"), $0; fflush(); }' > /home/zuul/standalone_deploy.log20:23
mnaseri assume that is where i can find the failure?20:23
mwhahahamnaser: lookin the job output for what specifclaly failed http://logs.openstack.org/69/612569/4/check/tripleo-ci-centos-7-standalone-os-tempest/c97400e/job-output.txt.gz20:23
mwhahahamnaser: we're having container docker.io issues20:23
weshaymnaser there are links in the logs.. to the important files..  look for standalone.sh and standalone-deploy.log in /home/zuul20:23
weshayon the undercloud20:23
mnaseroooh ther they are20:23
weshaymnaser check the doc in the footer :)20:23
mwhahahaweshay: what version of ansible is that running? also is the jinja package installed?20:23
weshaypython3-jinja2-2.10.1-2.el8_0.noarch20:24
mnaser""20:24
mnaser" the concatenation of all the errors on any node in a single file" this is neat20:24
weshaymwhahaha AH.. ansible-2.7.6-1.el8.noarch  I need 2.8 don't I?20:24
* mnaser should spend sometime at the collect logs role at some point20:24
mwhahahaweshay: yea i think 2.820:24
weshaymnaser there have been a couple emails about collect logs..  trying to close rhel8 work.. and we'll get going on a reorg of that role20:25
weshayw/ you guys20:25
mwhahahaweshay: though i'm pretty sure we had it running on 2.7 so i'm unsure what the deal with that is20:25
weshaymwhahaha /me trying it by hand on a box atm20:25
*** morazi has joined #tripleo20:25
mnaseryeah , i saw those, we'll probably have to get around that, we're just cleaning up our own logging (service logging) and then we can iterate on that20:25
weshayI'll get 2.8 on it20:25
weshaymnaser I don't think there is much work there..  not nearly as much as tempest20:26
openstackgerritJohn Dennis proposed openstack/tripleo-quickstart master: Add Keycloak setup to featureset039  https://review.opendev.org/67156720:30
*** ansmith_ has quit IRC20:43
*** ayoung has quit IRC20:44
weshaymwhahaha weird.. same result w/ the ansible 8.2 rpm20:47
weshayhttp://paste.openstack.org/show/754571/20:47
* mwhahaha shrugs20:47
mwhahahadid it install the wrong ansible20:47
mwhahahalike a python2  version20:47
weshayseems like an ansible bug20:47
* weshay grabs that ansible.cfg template20:48
weshayhttps://github.com/openstack/tripleo-common/blob/7193aef274bfabf874dd9d653c90385b4bb3397b/tripleo_common/actions/ansible.py#L3920:49
weshay?20:49
mwhahahathat's not going to affect the load dir for the python jinja module20:50
*** ayoung has joined #tripleo20:50
weshaytru20:50
mnaserive honestly seen that weird oddities with ansible in the past20:52
mnaseryum reinstall python-jinja2 usually fixes it..20:53
weshayI'll give it a try :) thanks20:53
weshayhrm.. osp is using python3-jinja2-2.10-9.el8.noarch20:58
weshaydangit20:58
*** raildo has quit IRC21:04
*** raildo has joined #tripleo21:04
*** pkopec has quit IRC21:10
*** paramite has quit IRC21:20
*** raildo has quit IRC21:21
*** ekultails has quit IRC21:25
*** cfontain has joined #tripleo21:34
*** aakarsh|2 has quit IRC21:37
*** beekneemech has joined #tripleo21:38
*** beekneemech has quit IRC21:38
openstackgerritMatthew Thode proposed openstack/diskimage-builder master: support alternate portage directories  https://review.opendev.org/67153021:41
weshaywe're doomed21:52
weshaySo the issue is the -s flag in ansible-playbook-321:52
weshay#!/usr/libexec/platform-python -s FAILS21:52
weshay#!/usr/libexec/platform-python WORKS21:52
weshaymwhahaha ^21:52
*** ayoung has quit IRC21:52
weshaycentos8 is going to be a hoot21:52
mwhahahawhat is -s21:52
weshay-s : don't add user site directory to sys.path; also PYTHONNOUSERSITE21:53
mwhahahahrm21:53
mwhahahawhere does ansible-playbook-3 come from21:54
mwhahahaisn't that just a symlink to ansible-playbook21:54
mwhahahaso is that an ansible change?21:54
mwhahahashouldn't we be hitting this downstream :/21:55
*** aakarsh|2 has joined #tripleo21:58
weshaymwhahaha one would think so21:58
weshaymwhahaha this is standalone.. I don't think it's used much in osp land21:59
mwhahahawe use it for testing21:59
weshayk k21:59
mwhahahaalso that's the undercloud22:00
mwhahahaso22:00
mwhahahawe use it all the time22:00
weshaytru22:00
*** bnemec has quit IRC22:03
*** slaweq has quit IRC22:09
* mwhahaha is glad he is on pto tomorrow so someone else can figure it out :D22:09
*** bnemec has joined #tripleo22:13
*** artom has quit IRC22:23
*** bnemec has quit IRC22:42
*** bnemec has joined #tripleo22:43
*** ansmith_ has joined #tripleo22:53
*** tkajinam has joined #tripleo22:58
*** cdearborn has quit IRC23:05
openstackgerritMerged openstack/tripleo-ci master: Tidy up tripleo-standalone-scenarios-full template with anchors  https://review.opendev.org/66301823:10
openstackgerritMerged openstack/tripleo-ci master: Add tripleo-build-images-base job & reparent existing build jobs  https://review.opendev.org/66932923:10
openstackgerritMerged openstack/tripleo-heat-templates stable/stein: Add bind mount for config setup  https://review.opendev.org/67124523:10
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Allow logrotate to access container_file_t files  https://review.opendev.org/67131323:10
*** rcernin has joined #tripleo23:15
*** artom has joined #tripleo23:16
*** sbroderick has quit IRC23:16
*** mwhahaha changes topic to "CI Status: GREENish RDOCloud Status: MEHish | community irc meeting Tues@1400 UTC - tripleo-ci-community meeting Tues@1330 UTC | https://docs.openstack.org/tripleo-docs/latest/"23:19
openstackgerritMerged openstack/tripleo-heat-templates stable/stein: Add a suffix for tmpwatch  https://review.opendev.org/67129523:50

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!