Thursday, 2019-12-19

*** rh-jelabarre has quit IRC00:03
*** waleedm__ has quit IRC00:16
*** ekultails has quit IRC00:55
openstackgerritAlan Bishop proposed openstack/tripleo-heat-templates master: Add ability to deploy glance at DCN/Edge sites  https://review.opendev.org/69988000:55
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Properly set loopback_users via rabbitmq::loopback_users  https://review.opendev.org/69865301:03
openstackgerritMerged openstack/tripleo-heat-templates master: mysql: move firewall_rules to mysql-container-puppet  https://review.opendev.org/69971201:04
openstackgerritMerged openstack/tripleo-quickstart-extras master: Add tempest.api.compute.images test_delete_saving_image to skip  https://review.opendev.org/69962401:04
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/train: HA: increase resource default op timeout for podman bundles  https://review.opendev.org/69990001:52
openstackgerritAthlan-Guyot sofer proposed openstack/tripleo-heat-templates stable/stein: HA: increase resource default op timeout for podman bundles  https://review.opendev.org/69990101:55
*** rh-jelabarre has joined #tripleo02:00
*** ayoung has quit IRC02:07
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-heat-templates master: Correct invalid jinja set  https://review.opendev.org/69990202:37
*** mschuppert has quit IRC02:40
EmilienMfultonj: it's good now02:51
*** EmilienM changes topic to "CI Status: GREEN | community irc meeting Tues@1400 UTC - tripleo-ci-community meeting Tues@1330 UTC | https://docs.openstack.org/tripleo-docs"02:52
*** irclogbot_1 has quit IRC02:56
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates stable/train: Enable additional Swift healtchecks  https://review.opendev.org/69889602:57
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Deploy /etc/openstack/clouds.yaml with Ansible  https://review.opendev.org/69639003:03
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Deploy /etc/openstack/clouds.yaml with Ansible  https://review.opendev.org/69639003:03
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Implement utils.copy_clouds_yaml  https://review.opendev.org/69944803:03
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Revert "Added for support for generating overcloud clouds.yaml"  https://review.opendev.org/69932903:04
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Revert "Added for support for generating overcloud clouds.yaml"  https://review.opendev.org/69932903:04
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Implement utils.copy_clouds_yaml  https://review.opendev.org/69944803:04
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Revert "Added for support for generating overcloud clouds.yaml"  https://review.opendev.org/69932903:04
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Revert "Added support of overcloud os_cloud"  https://review.opendev.org/69920603:05
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-heat-templates master: Update nonha arch env file  https://review.opendev.org/69990703:05
*** irclogbot_1 has joined #tripleo03:16
*** rlandy|bbl is now known as rlandy03:20
*** rlandy has quit IRC03:25
*** dsneddon has quit IRC03:27
*** dsneddon has joined #tripleo03:28
*** rh-jelabarre has quit IRC03:32
*** dsneddon has quit IRC03:36
*** psachin has joined #tripleo03:42
*** holser has joined #tripleo03:43
openstackgerritSergii Golovatiuk proposed openstack/tripleo-upgrade master: Fix python command and fix python3 compatiblity.  https://review.opendev.org/69939104:05
*** ykarel|away has joined #tripleo04:05
*** artom has quit IRC04:14
*** artom has joined #tripleo04:16
openstackgerritSergii Golovatiuk proposed openstack/tripleo-upgrade master: Fix python command and fix python3 compatiblity.  https://review.opendev.org/69939104:16
*** holser has quit IRC04:16
*** apetrich has quit IRC04:29
*** ykarel|away has quit IRC04:30
*** ykarel has joined #tripleo04:45
*** whoami-rajat has joined #tripleo04:47
*** dsneddon has joined #tripleo04:52
*** holser has joined #tripleo04:57
*** bhagyashris has joined #tripleo04:59
*** whoami-rajat has quit IRC05:03
*** whoami-rajat__ has joined #tripleo05:04
*** epoojad1 has joined #tripleo05:13
*** psachin has quit IRC05:36
*** pcaruana has joined #tripleo05:43
*** ramishra has joined #tripleo05:47
*** psachin has joined #tripleo05:56
*** bhagyashris has quit IRC06:00
*** raukadah is now known as chandankumar06:06
*** bhagyashris has joined #tripleo06:06
*** holser has quit IRC06:09
*** rcernin_ has joined #tripleo06:09
*** soniya29 has joined #tripleo06:12
*** rcernin has quit IRC06:12
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates stable/rocky: Increase rabbitmq tcp backlog  https://review.opendev.org/69991506:15
*** surpatil has joined #tripleo06:17
*** surpatil has quit IRC06:18
*** surpatil has joined #tripleo06:19
openstackgerritMichele Baldessari proposed openstack/tripleo-heat-templates stable/queens: Increase rabbitmq tcp backlog  https://review.opendev.org/69991606:20
openstackgerritMerged openstack/instack-undercloud stable/rocky: Remove configuration related to Horizon  https://review.opendev.org/69621506:21
*** lmiccini has joined #tripleo06:24
*** whoami-rajat__ has quit IRC06:28
*** marios has joined #tripleo06:29
*** bhagyashris has quit IRC06:31
*** saneax has joined #tripleo06:31
openstackgerritMichele Baldessari proposed openstack/instack-undercloud stable/queens: Remove configuration related to Horizon  https://review.opendev.org/69991706:37
*** bhagyashris has joined #tripleo06:38
*** yprokule has joined #tripleo06:43
*** jfrancoa has joined #tripleo06:53
*** rcernin_ has quit IRC07:09
*** ratailor has joined #tripleo07:18
*** jbadiapa has joined #tripleo07:20
*** SurajPatil has joined #tripleo07:23
*** surpatil has quit IRC07:26
*** whoami-rajat has joined #tripleo07:26
*** saneax has quit IRC07:43
*** psachin has quit IRC07:44
*** irclogbot_1 has quit IRC07:44
*** ratailor has quit IRC07:45
*** ratailor has joined #tripleo07:45
*** psachin has joined #tripleo07:46
*** irclogbot_0 has joined #tripleo07:46
*** pkopec has joined #tripleo07:46
openstackgerritMerged openstack/tripleo-heat-templates stable/train: HA: enable cluster-common-tag naming scheme by default  https://review.opendev.org/69951107:47
openstackgerritMerged openstack/tripleo-upgrade stable/queens: Update: Run all roles update at once  https://review.opendev.org/69628307:47
openstackgerritMerged openstack/tripleo-upgrade stable/queens: Update: Ensure parallel execution  https://review.opendev.org/69627907:47
*** ykarel is now known as ykarel|lunch07:48
*** surpatil has joined #tripleo07:49
*** mschuppert has joined #tripleo07:50
*** SurajPatil has quit IRC07:52
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP Make the bundle user configurable via hiera  https://review.opendev.org/69992607:53
*** bandini has joined #tripleo07:58
*** ratailor has quit IRC07:58
*** ratailor has joined #tripleo07:58
*** kopecmartin|off is now known as kopecmartin07:58
*** dsneddon has quit IRC08:00
*** waleedm__ has joined #tripleo08:02
openstackgerritDaniel Bengtsson proposed openstack/tripleo-upgrade master: Fix python command and fix python3 compatiblity.  https://review.opendev.org/69939108:06
*** ccamacho has joined #tripleo08:13
*** tosky has joined #tripleo08:14
*** tkajinam has quit IRC08:15
*** dsneddon has joined #tripleo08:20
*** saneax has joined #tripleo08:20
*** hberaud|gone is now known as hberaud08:23
*** bhagyashris has quit IRC08:24
*** dsneddon has quit IRC08:26
*** tmazur has joined #tripleo08:26
*** SurajPatil has joined #tripleo08:26
*** surpatil has quit IRC08:29
*** surpatil has joined #tripleo08:31
*** SurajPatil has quit IRC08:34
*** jpena|off is now known as jpena08:38
*** marios has quit IRC08:40
*** amoralej|off is now known as amoralej08:44
*** ratailor_ has joined #tripleo08:47
*** apetrich has joined #tripleo08:47
*** ratailor has quit IRC08:49
*** ykarel|lunch is now known as ykarel08:50
*** dsneddon has joined #tripleo09:00
*** jpich has joined #tripleo09:09
*** jbadiapa has quit IRC09:13
*** jbadiapa has joined #tripleo09:13
*** dsneddon has quit IRC09:14
*** bhagyashris has joined #tripleo09:16
*** ykarel is now known as ykarel|afk09:16
*** SurajPatil has joined #tripleo09:18
*** rpittau|afk is now known as rpittau09:18
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Fix upper and lower constraints  https://review.opendev.org/69949909:19
*** surpatil has quit IRC09:20
openstackgerritDaniel Bengtsson proposed openstack/tripleo-upgrade master: Fix python command and fix python3 compatiblity.  https://review.opendev.org/69939109:21
*** rcernin_ has joined #tripleo09:21
*** suuuper has joined #tripleo09:22
*** epoojad1 has quit IRC09:24
*** bcafarel has quit IRC09:29
*** rcernin_ has quit IRC09:29
*** dsneddon has joined #tripleo09:29
*** bcafarel has joined #tripleo09:29
*** Chaserjim has quit IRC09:35
*** Chaserjim has joined #tripleo09:35
*** Chaserjim has quit IRC09:37
*** Chaserjim has joined #tripleo09:37
*** dsneddon has quit IRC09:39
*** derekh has joined #tripleo09:41
*** ykarel|afk is now known as ykarel09:42
*** marios has joined #tripleo09:51
*** gfidente|afk is now known as gfidente09:51
openstackgerritMerged openstack/tripleo-heat-templates master: Mount /boot from the host within the nova-compute container  https://review.opendev.org/69888809:55
openstackgerritMerged openstack/tripleo-heat-templates stable/train: scale: fixes for compute scale down  https://review.opendev.org/69878409:59
*** gfidente has quit IRC10:03
*** holser has joined #tripleo10:04
*** holser has quit IRC10:05
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Adapt overcloud upgrade workflow to Train.  https://review.opendev.org/69925610:06
*** tosky_ has joined #tripleo10:07
*** holser has joined #tripleo10:07
*** tosky is now known as Guest9772710:07
*** tosky_ is now known as tosky10:07
*** Guest97727 has quit IRC10:08
openstackgerritSergii Golovatiuk proposed openstack/tripleo-upgrade master: Fix python command and fix python3 compatiblity.  https://review.opendev.org/69939110:15
*** chem has joined #tripleo10:15
*** dsneddon has joined #tripleo10:15
*** dsneddon has quit IRC10:26
*** d0ugal has quit IRC10:28
*** d0ugal has joined #tripleo10:31
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: container-puppet: create containers sequentially to avoid race  https://review.opendev.org/69980310:32
*** gfidente has joined #tripleo10:34
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: Limit concurrency in container-puppet to image pull  https://review.opendev.org/69973710:38
*** leanderthal has joined #tripleo10:39
*** rainleander has joined #tripleo10:40
*** bandini has quit IRC10:41
*** leanderthal has quit IRC10:44
*** rainleander is now known as leanderthal10:44
*** dsneddon has joined #tripleo10:53
*** Chaserjim has quit IRC10:55
*** Chaserjim has joined #tripleo10:55
*** hberaud is now known as hberaud|school-r10:58
*** surpatil has joined #tripleo11:02
*** lbragstad_ has joined #tripleo11:03
*** dsneddon has quit IRC11:04
*** SurajPatil has quit IRC11:04
*** lbragstad has quit IRC11:04
*** hberaud|school-r is now known as hberaud11:07
*** SurajPatil has joined #tripleo11:10
*** surpatil has quit IRC11:12
*** bandini has joined #tripleo11:15
*** sshnaidm|afk is now known as sshnaidm11:21
*** surpatil has joined #tripleo11:32
*** SurajPatil has quit IRC11:35
*** nginxN00b has joined #tripleo11:36
*** raildo has joined #tripleo11:36
*** dsneddon has joined #tripleo11:39
*** nginxN00b has quit IRC11:39
*** Chaserjim has quit IRC11:41
*** Chaserjim has joined #tripleo11:42
*** dsneddon has quit IRC11:48
*** epoojad1 has joined #tripleo11:49
*** epoojad1 is now known as epoojad1|appoint11:51
*** epoojad1|appoint is now known as epoojad111:51
*** epoojad1 is now known as epoojad1|appoint11:51
*** epoojad1|appoint is now known as epoojad1|apointm11:51
*** epoojad1|apointm is now known as epoojad1|away11:51
*** epoojad1|away has quit IRC11:58
*** jpena is now known as jpena|lunch11:58
*** dsneddon has joined #tripleo11:59
*** amoralej is now known as amoralej|lunch12:00
*** dsneddon has quit IRC12:04
*** ratailor_ has quit IRC12:05
Tengufolks, can anyone +A this patch? https://review.opendev.org/699200   thanks!12:07
Tenguthanks marios :)12:14
*** artom has quit IRC12:14
*** artom has joined #tripleo12:15
*** bhagyashris_ has joined #tripleo12:21
openstackgerritMarios Andreou proposed openstack/tripleo-quickstart-extras master: DNM test https://tree.taiga.io/project/tripleo-ci-board/task/1315  https://review.opendev.org/68726712:22
*** B_ddhgbfe has joined #tripleo12:22
*** bhagyashris has quit IRC12:23
openstackgerritGiulio Fidente proposed openstack/tripleo-common master: Bump ceph/daemon container image to v4.0.8  https://review.opendev.org/69996612:23
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates stable/queens: DNM test https://tree.taiga.io/project/tripleo-ci-board/task/1315  https://review.opendev.org/69874712:26
openstackgerritGiulio Fidente proposed openstack/tripleo-common stable/train: Bump ceph/daemon container image to v4.0.8  https://review.opendev.org/69996712:26
*** bhagyashris_ has quit IRC12:27
*** bhagyashris has joined #tripleo12:28
openstackgerritGiulio Fidente proposed openstack/tripleo-common stable/stein: Bump ceph/daemon container image to v4.0.8  https://review.opendev.org/69996812:28
openstackgerritMarios Andreou proposed openstack/tripleo-heat-templates stable/queens: DNM test https://tree.taiga.io/project/tripleo-ci-board/task/1315  https://review.opendev.org/69874712:28
openstackgerritMarios Andreou proposed openstack/tripleo-quickstart-extras master: DNM test https://tree.taiga.io/project/tripleo-ci-board/task/1315  https://review.opendev.org/68726712:29
*** SurajPatil has joined #tripleo12:29
*** B_ddhgbfe has quit IRC12:30
*** surpatil has quit IRC12:31
*** surpatil has joined #tripleo12:31
openstackgerritGiulio Fidente proposed openstack/tripleo-common stable/rocky: Bump ceph/daemon container image to v3.2.10  https://review.opendev.org/69997012:32
openstackgerritCédric Jeanneret (Tengu) proposed openstack/tripleo-heat-templates stable/stein: Install tmpwatch on the overcloud  https://review.opendev.org/69997112:33
*** SurajPatil has quit IRC12:34
*** ansmith has quit IRC12:34
*** ykarel is now known as ykarel|afk12:36
*** bandini has quit IRC12:36
openstackgerritGiulio Fidente proposed openstack/tripleo-common stable/queens: Bump ceph/daemon container image to v3.2.10  https://review.opendev.org/69997312:36
*** dsneddon has joined #tripleo12:38
*** bandini has joined #tripleo12:38
*** ykarel|afk has quit IRC12:41
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Revert "Added support of overcloud os_cloud"  https://review.opendev.org/69997412:41
openstackgerritGiulio Fidente proposed openstack/tripleo-common stable/queens: Bump ceph/daemon container image to v3.2.10  https://review.opendev.org/69997512:41
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Implement utils.copy_clouds_yaml  https://review.opendev.org/69944812:42
*** dsneddon has quit IRC12:42
openstackgerritGiulio Fidente proposed openstack/tripleo-quickstart-extras master: Bumps up default Ceph container images  https://review.opendev.org/69997612:44
*** nkinder has joined #tripleo12:45
*** gfidente has quit IRC12:45
openstackgerritMichele Baldessari proposed openstack/instack-undercloud stable/rocky: Convert all class usage to relative names  https://review.opendev.org/69997712:52
openstackgerritCédric Jeanneret (Tengu) proposed openstack/tripleo-heat-templates master: Create a dedicated log file for healthchecks for collectd  https://review.opendev.org/69922612:54
*** gfidente has joined #tripleo12:54
*** rlandy has joined #tripleo12:57
*** bhagyashris has quit IRC12:59
*** Goneri has quit IRC13:00
*** rh-jelabarre has joined #tripleo13:03
openstackgerritMichele Baldessari proposed openstack/puppet-tripleo master: WIP Make the bundle user configurable via hiera  https://review.opendev.org/69992613:04
*** jpena|lunch is now known as jpena13:11
*** Chaserjim has quit IRC13:12
*** Chaserjim has joined #tripleo13:13
EmilienMchandankumar: how are we doing on the timeout front?13:16
*** dsneddon has joined #tripleo13:18
*** rh-jelabarre has quit IRC13:19
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade stable/train: DNM: Revert "Update: Ensure parallel execution"  https://review.opendev.org/69998313:19
*** leanderthal has quit IRC13:19
chandankumarEmilienM: not too much today13:19
chandankumarEmilienM: queue has started growing now13:19
chandankumar7 hrs13:19
*** leanderthal has joined #tripleo13:20
EmilienMchandankumar: any failures so far?13:21
chandankumarEmilienM: this bro failed https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_f1d/699007/1/gate/tripleo-ci-centos-7-containers-multinode/f1d2eb6/ right now in gate13:22
*** dsneddon has quit IRC13:23
chandankumarhttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_f1d/699007/1/gate/tripleo-ci-centos-7-containers-multinode/f1d2eb6/logs/undercloud/home/zuul/undercloud_install.log.txt.gz13:23
chandankumarI have seen this error at one more place13:23
EmilienMyeah I'm not sure about that, it's again tripleo container image prepare13:24
*** skramaja has quit IRC13:26
openstackgerritDougal Matthews proposed openstack/python-tripleoclient master: WIP Start moving the import CLI command to the Ansible implementation  https://review.opendev.org/69872313:26
*** mcornea has joined #tripleo13:29
*** Chaserjim has quit IRC13:30
*** Chaserjim has joined #tripleo13:30
cloudnullmornings13:33
d0ugalHellp!13:33
d0ugalHello! (I don't need help, I don't think)13:33
fultonj:)13:34
*** amoralej|lunch is now known as amoralej13:34
cloudnullhaha13:35
*** rh-jelabarre has joined #tripleo13:35
*** ansmith has joined #tripleo13:45
*** Goneri has joined #tripleo13:46
*** fmount has quit IRC13:46
openstackgerritSagi Shnaidman proposed openstack/ansible-role-collect-logs master: Render undercloud ara results  https://review.opendev.org/69986713:50
*** dsneddon has joined #tripleo13:50
*** dsneddon has quit IRC13:55
*** ekultails has joined #tripleo14:00
*** lbragstad_ is now known as lbragstad14:02
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: image-uploader: allow an image without Labels to be uploaded  https://review.opendev.org/69999214:02
EmilienMTengu: ^14:02
TenguEmilienM: lemme have a look14:03
TenguEmilienM: sounds good! so no other property is optional?14:04
EmilienMTengu: sounds like it's good now14:04
Tenguok!14:05
TenguEmilienM: guess it needs some backport for train right?14:06
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Run upgrade for previous hosts only in Controller role.  https://review.opendev.org/69966514:07
EmilienMTengu: yes14:07
TenguEmilienM: added tag to the LP then :).14:08
EmilienMcool14:08
*** surpatil has quit IRC14:10
*** rainleander has joined #tripleo14:11
*** leanderthal has quit IRC14:13
*** ykarel|afk has joined #tripleo14:15
*** artom has quit IRC14:16
*** fmount has joined #tripleo14:17
*** ykarel|afk is now known as ykarel14:18
openstackgerritSergii Golovatiuk proposed openstack/tripleo-upgrade master: Fix python command and fix python3 compatiblity.  https://review.opendev.org/69939114:21
*** dsneddon has joined #tripleo14:22
*** tosky_ has joined #tripleo14:23
*** tosky is now known as Guest2789014:23
*** tosky_ is now known as tosky14:23
*** TrevorV has joined #tripleo14:25
*** Guest27890 has quit IRC14:26
*** dsneddon has quit IRC14:27
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-common master: add and unify the retries when messages are published to swift  https://review.opendev.org/69999414:28
EmilienMmwhahaha: I'm going to move all u-1 bugs to u-214:33
mwhahahak14:34
mwhahahawas this week u-1?14:34
*** soniya29 has quit IRC14:34
* mwhahaha can never keep track14:34
EmilienMmwhahaha: last week14:34
EmilienMmwhahaha: tags are ok, remember I pushed them early Dec to fix RDO rpms14:34
mwhahahaoops14:35
openstackgerritBrent Eagles proposed openstack/tripleo-common stable/queens: DNM: testing if assumption of user stack is reason ci isn't working  https://review.opendev.org/69746914:35
*** ayoung has joined #tripleo14:38
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Remove the tripleo.ansible action  https://review.opendev.org/69999614:39
d0ugalSo close to 70000014:40
ayoungWhere are the Tripleo Container Images hosted?14:40
mwhahahaayoung: they are available from docker.io?14:42
*** rfolco has joined #tripleo14:43
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/tripleo-upgrade master: Change roles_data/update_serial without using shell  https://review.opendev.org/69999814:43
ayoungAh...like https://hub.docker.com/r/tripleomaster/centos-binary-keystone14:44
*** morazi has joined #tripleo14:44
EmilienMyes14:44
EmilienMand soon quay.io (spoiler)14:45
ayoungYAY!14:45
openstackgerritDougal Matthews proposed openstack/tripleo-common master: Remove the tripleo.ansible action  https://review.opendev.org/69999614:46
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: image-uploader: allow an image without Labels to be uploaded  https://review.opendev.org/69999214:49
ayoungOK...what dumbness am I doing: $ podman pull tripleomaster/centos-binary-keystone:latest14:50
ayoungTrying to pull docker.io/tripleomaster/centos-binary-keystone:latest...14:50
ayoung  manifest unknown: manifest unknown14:50
ayounghappens withouth the :latest as well. I've done a podman login, too14:50
EmilienMayoung: try with :current-rdo14:52
ayoungSame thing14:52
EmilienMsorry*14:52
EmilienMayoung: try with :current-tripleo14:52
EmilienM(/me always confused)14:53
EmilienMTBH I don't know why we don't push :latest14:53
EmilienMbut someone might know here14:53
ayoungI was doing a bunch of local builds and working with an OpenShift on OpenStack setup I have going, so I am guessing I have something messed up on my podman side, too14:53
*** derekh has quit IRC14:54
ayoung Could also be a bad yum update on my system, as something is a bit wonky with packages right now14:54
*** zaneb has joined #tripleo14:56
openstackgerritLon Hohberger proposed openstack/tripleo-puppet-elements master: RHEL8: Use podman-docker  https://review.opendev.org/70000315:01
openstackgerritLon Hohberger proposed openstack/tripleo-puppet-elements stable/train: RHEL8: Use podman-docker  https://review.opendev.org/70000415:02
*** dsneddon has joined #tripleo15:03
ayoungIt worked when I modified docker pull tripleomaster/centos-binary-keystone:0b024f58f5957808e838a56ca125f3edfe2b72c0_2932899d15:03
openstackgerritLon Hohberger proposed openstack/tripleo-puppet-elements stable/train: RHEL8: Use podman-docker  https://review.opendev.org/70000415:04
*** jpena is now known as jpena|off15:04
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Enable additional Swift healtchecks  https://review.opendev.org/69889615:05
*** Trevor_V has joined #tripleo15:08
*** dsneddon has quit IRC15:08
ayoungcurrent-tripleo working15:11
*** TrevorV has quit IRC15:11
*** yprokule has quit IRC15:11
*** jpena|off is now known as jpena15:13
openstackgerritMerged openstack/tripleo-common master: Make ()'s around step|int optional  https://review.opendev.org/69880415:18
openstackgerritDougal Matthews proposed openstack/python-tripleoclient master: Raise a new ValueError with the contents of the JSON is parsing fails  https://review.opendev.org/70000915:22
openstackgerritLon Hohberger proposed openstack/tripleo-puppet-elements master: RHEL8: Use podman-docker  https://review.opendev.org/70000315:23
openstackgerritGael Chamoulaud proposed openstack/python-tripleoclient master: TripleO Validations Logging CLI Introduction  https://review.opendev.org/69539715:23
openstackgerritLon Hohberger proposed openstack/tripleo-puppet-elements stable/train: RHEL8: Use podman-docker  https://review.opendev.org/70001015:24
paramite|cloneCFD\15:25
paramite|cloneFD6RL 6BC15:26
EmilienM:-O15:26
EmilienMmwhahaha: i moved all bugs to u-2, closed your blueprint about sidecars containers managed by systemd and moved the rest to u-215:27
openstackgerritLon Hohberger proposed openstack/tripleo-puppet-elements stable/train: RHEL8: Use podman-docker  https://review.opendev.org/70001015:28
mwhahahaK15:28
*** rainleander has quit IRC15:30
*** Chaserjim has quit IRC15:35
ayoungAnyone have a sample config.json to run Keystone?15:37
*** dsneddon has joined #tripleo15:37
openstackgerritMerged openstack/python-tripleoclient master: Pass container name to update_nodes workflow  https://review.opendev.org/69718815:37
openstackgerritMerged openstack/tripleo-common stable/train: Add horizon health check  https://review.opendev.org/69900515:37
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Enable image import plugins & image output format  https://review.opendev.org/69855815:38
ayoungwhat should I be passing for the command to start the Keystone server?15:40
EmilienMayoung: what is a config.json?15:40
EmilienMwhat do you mean by command to start?15:41
ayoungThat is what gets passed in to the container to run15:41
EmilienMwhat are you trying to do?15:41
ayounghttps://docs.openstack.org/kolla/latest/admin/kolla_api.html#passing-the-configuration-file-to-the-container15:41
ayoungRun Just the Keystone container15:41
EmilienMwhy don't you use tripleo standalone?15:42
EmilienMit deploys the keystone for yoi15:42
ayoungBecause my end goal is to run Keystone, standalone, in OpenShift.15:44
*** dsneddon has quit IRC15:44
*** hoonetorg has quit IRC15:45
EmilienMayoung: i think dprince (not here) was working on these things15:46
EmilienMhttps://github.com/dprince/keystone-operator15:46
EmilienMnot sure how far he got15:46
ayoungI started building keystone containers myself, but ran in to some permissions issues when running httpd/keystone-as-wsgi15:46
EmilienMbut you might want to talk each others15:46
ayoungI wanted to see what the Kolla container looks like, so I figured I run it and poke at it15:47
ayoungEmilienM, in your standalone setups, are there config.json files for each of the containerized services?15:47
openstackgerritRonelle Landy proposed openstack/ansible-role-collect-logs master: Add functionality to sanitize collected logs  https://review.opendev.org/69199415:48
*** pkopec_ has joined #tripleo15:48
ayoungThey are supposed to end up in /var/lib/kolla/config_files/config.json   when the container is running, but I don't klnow what TripleO does to launch them15:48
*** artom has joined #tripleo15:50
ayoungAh...loks like it is generated from the TripleoHeat template...15:50
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Implement utils.copy_clouds_yaml  https://review.opendev.org/69944815:51
EmilienMayoung: yeah we generate it and we bind mount the config15:51
EmilienMhttps://github.com/openstack/tripleo-heat-templates/blob/master/deployment/keystone/keystone-container-puppet.yaml#L62515:52
EmilienMyou can also find it on your host /var/lib/kolla/config_files/keystone.json15:53
openstackgerritLon Hohberger proposed openstack/tripleo-puppet-elements master: RHEL8: Use podman-docker  https://review.opendev.org/70000315:53
openstackgerritLon Hohberger proposed openstack/tripleo-puppet-elements stable/train: RHEL8: Use podman-docker  https://review.opendev.org/70001015:53
openstackgerritLon Hohberger proposed openstack/tripleo-puppet-elements master: RHEL8: Use podman-docker  https://review.opendev.org/70000315:55
ayoung command: /usr/sbin/httpd15:55
*** pkopec_ has quit IRC15:57
chandankumarEmilienM: can we update the channel message saying workflow the patches based on checking gate queue?15:58
*** dsneddon has joined #tripleo15:59
EmilienMchandankumar: sure16:00
*** EmilienM changes topic to "CI Status: GREEN | gate queue busy, be careful with +W | community irc meeting Tues@1400 UTC - tripleo-ci-community meeting Tues@1330 UTC | https://docs.openstack.org/tripleo-docs/latest/"16:01
*** EmilienM changes topic to "CI Status: GREENish | gate queue busy, be careful with +W | community irc meeting Tues@1400 UTC - tripleo-ci-community meeting Tues@1330 UTC | https://docs.openstack.org/tripleo-docs/latest/"16:01
EmilienMchandankumar: ^16:01
chandankumarEmilienM: thanks !, rlandy ^^ it will help16:02
*** rpittau is now known as rpittau|afk16:02
*** gfidente has quit IRC16:12
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Replace Fluentd and SensuClient from roles_data.  https://review.opendev.org/69924516:13
*** bandini has quit IRC16:15
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: Revert "tripleo-keystone-resources: reduce permissions for clouds.yaml"  https://review.opendev.org/70001516:16
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Deploy /etc/openstack/clouds.yaml with Ansible  https://review.opendev.org/69639016:16
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Deploy /etc/openstack/clouds.yaml with Ansible  https://review.opendev.org/69639016:16
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Implement utils.copy_clouds_yaml  https://review.opendev.org/69944816:17
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: WIP - Validate the playboooks metadata structure  https://review.opendev.org/70001616:17
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: Revert "Revert "tripleo-keystone-resources: reduce permissions for clouds.yaml""  https://review.opendev.org/70001716:18
*** ramishra has quit IRC16:18
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Revert "Added for support for generating overcloud clouds.yaml"  https://review.opendev.org/69932916:18
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: Revert "Added support of overcloud os_cloud"  https://review.opendev.org/69997416:19
openstackgerritOliver Walsh proposed openstack/tripleo-ansible master: Add role/playbook to manage nova image cache  https://review.opendev.org/67625216:19
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: tripleo-keystone-resources: handle multiple roles per user  https://review.opendev.org/69928616:19
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Manage all Keystone resources with Ansible  https://review.opendev.org/69698016:19
*** marios is now known as marios|out16:20
*** suuuper has quit IRC16:20
toskykopecmartin, chandankumar: I think I've already asked this, sorry for that: how can find all the jobs which use featureset020 ?16:20
owalshcloudnull: hey, if you get a chance this week would appreciate review on https://review.opendev.org/67625216:21
chandankumartosky: fs020 is runned in periodic only and against skip list validate tempest changes16:21
chandankumartosky: https://review.rdoproject.org/zuul/jobs is the db16:22
toskychandankumar: right, but where is it defined nowadays?16:22
toskyoh, RDO repositories16:22
toskynot tripleo ones16:22
chandankumartosky: https://github.com/rdo-infra/rdo-jobs/tree/master/zuul.d16:22
toskythanks!16:22
chandankumartosky: you can also take a look at fs021 job also it is similar to fs020 but only skiplist as a whitelist tests runned there16:24
chandankumartosky: from tempest prespective there is stnadalone full tempest also running in periodic16:25
toskychandankumar: as far as I can see, only jobs based on featureset020 include the tests from cinder-tempest-plugin16:26
toskywhich is the component I'd like to test, as a slightly updated version is going to be released16:26
cloudnullowalsh looking now16:26
chandankumartosky: for component CI, we have not looked at tempest tests what we want to run there as it is still in POC16:27
cloudnulld0ugal - if you're still around, mind having a look at https://review.opendev.org/#/c/691906/16:27
owalshcloudnull: cheers, latest patch was just a manual rebase for zuul.d/molecule.yaml... wonder if we can do anything to avoid conflicts there?16:27
cloudnullthere were a couple comments / suggestions I think need your thoughts16:27
toskychandankumar: I'm not talking about component CI16:28
toskychandankumar: I see that featureset020 contains/whitelists cinder_tempest_plugin, so I would assume that jobs based on featureset020 run also all cinder_tempest_plugins tests16:28
cloudnullowalsh we should be able to more easily resolve those merge conflicts when a new role is created.16:28
d0ugalcloudnull: sure, I'll take a look16:28
cloudnullmaybe we should sort the job list by role name ?16:28
d0ugalcloudnull: might be tomorrow morning tho'16:28
cloudnulld0ugal np16:29
owalshcloudnull: ack, was about to suggest sorting16:29
owalshmakes it less likely at least16:29
cloudnull++16:29
cloudnullsomething we should look into16:29
*** marios|out has quit IRC16:29
owalshcloudnull: also not sure why flake8 was passing, should have complained about line lenght etc...16:29
chandankumartosky: https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/general_config/featureset020.yml#L211 is the test regex, it also depends on whether some tests might got skipped16:30
cloudnullowalsh there were some changes to the pre-condition runner, maybe something is off there?16:30
*** zaneb has quit IRC16:30
chandankumartosky: http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-master/cc628f5/logs/undercloud/var/log/tempest/tempest_run.log.txt.gz It might help16:31
*** ykarel is now known as ykarel|away16:32
chandankumarand current skip list for that job http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-master/cc628f5/logs/undercloud/home/zuul/tempest/etc/tempest_blacklist.txt.gz16:32
toskychandankumar: yes, it runs cinder_tempest_plugin tests16:32
toskyso that's what I'm looking for16:32
toskyI guess I can recycle kopecmartin's https://review.rdoproject.org/r/#/c/21221 for testing purposes16:32
owalshcloudnull: ack, I'll need to figure it out. Passes a local flake8 in any case16:33
cloudnullmaybe flake8 changed its rules ?16:34
chandankumartosky: you can also do something like this https://review.rdoproject.org/r/#/c/24051/16:34
owalshcloudnull: not when I installed it in a virtualenv ;-) I'll investigate tomorrow16:34
chandankumarit builds the pkg from depends-on and test it16:34
toskychandankumar: but it did time out :)16:35
chandankumartosky: force periodic var for taking unpromoted content16:35
cloudnullowalsh then maybe some rule we're ignoring - https://github.com/openstack/tripleo-ansible/blob/master/.pre-commit-config.yaml#L1416:35
cloudnullowalsh no worries, all that can be a tomorrow problem :D16:35
owalshcloudnull: E501 is line length16:37
owalshEmilienM: if you get a chance would you mind reviewing https://review.opendev.org/67625216:39
EmilienMowalsh: it's big, i'll review it lateer16:39
owalshEmilienM: ack, thanks!16:40
*** hoonetorg has joined #tripleo16:42
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Enable ARA for undercloud and standalone  https://review.opendev.org/70002716:54
openstackgerritLuke Short proposed openstack/tripleo-common stable/train: config: refactor how per step tasks are generated  https://review.opendev.org/70002816:58
openstackgerritLuke Short proposed openstack/tripleo-common stable/train: Add deploy_steps_tasks to PER_TASK_STEPS  https://review.opendev.org/70002916:58
*** pkopec has quit IRC16:58
openstackgerritMerged openstack/tripleo-docs master: Document how to use NodeDataLookup generation utility  https://review.opendev.org/69640616:58
*** lmiccini has quit IRC16:59
*** jpich has quit IRC17:03
openstackgerritLuke Short proposed openstack/tripleo-heat-templates stable/train: Move some common tasks to step 1  https://review.opendev.org/70003017:04
openstackgerritLuke Short proposed openstack/tripleo-heat-templates stable/train: Use include_tasks instead of import_tasks  https://review.opendev.org/69968617:05
openstackgerritLuke Short proposed openstack/tripleo-common stable/train: Default to 50 Ansible forks.  https://review.opendev.org/70003117:06
*** whoami-rajat has quit IRC17:09
openstackgerritMerged openstack/tripleo-validations master: Add a validation to fail if a Ceph dependency is not installed  https://review.opendev.org/69745317:12
openstackgerritMerged openstack/tripleo-heat-templates master: Provide utility to generate NodeDataLookup from Ironic  https://review.opendev.org/69640117:12
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: deploy-steps: use lookup() to get pre|post_deployments_role variables  https://review.opendev.org/69907217:12
openstackgerritMerged openstack/tripleo-heat-templates master: Use paunch to handle container removal.  https://review.opendev.org/69880617:12
*** ykarel|away has quit IRC17:14
*** tmazur has quit IRC17:21
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates stable/train: Provide utility to generate NodeDataLookup from Ironic  https://review.opendev.org/70003517:25
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates stable/stein: Provide utility to generate NodeDataLookup from Ironic  https://review.opendev.org/70003617:26
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates stable/rocky: Provide utility to generate NodeDataLookup from Ironic  https://review.opendev.org/70003717:26
openstackgerritJohn Fulton proposed openstack/tripleo-heat-templates stable/queens: Provide utility to generate NodeDataLookup from Ironic  https://review.opendev.org/70003817:26
*** holser has quit IRC17:26
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Create /var/log/journal directory during step-0  https://review.opendev.org/69943817:27
openstackgerritKevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add job sorting logic to the role-addition playbook  https://review.opendev.org/70004017:30
openstackgerritMerged openstack/tripleo-heat-templates master: Add keystone_puppet_config  https://review.opendev.org/69852817:30
cloudnullowalsh - https://review.opendev.org/#/c/700040/17:30
*** chandankumar has quit IRC17:31
*** paramite|clone has quit IRC17:31
*** paramite|clone has joined #tripleo17:31
openstackgerritJames E. Blair proposed openstack/diskimage-builder master: WIP: test docker element  https://review.opendev.org/70004117:31
openstackgerritMerged openstack/tripleo-upgrade master: Fix bindeps  https://review.opendev.org/69957417:32
openstackgerritMerged openstack/tripleo-heat-templates stable/rocky: Increase rabbitmq tcp backlog  https://review.opendev.org/69991517:32
openstackgerritMerged openstack/tripleo-heat-templates master: Revert "Ensure /var/log/journal exists as soon as possible"  https://review.opendev.org/69942617:32
*** TrevorV has joined #tripleo17:32
*** Trevor_V has quit IRC17:36
cloudnullwhat is the normal cause for timeouts - https://pasted.tech/pastes/5cd2633c09aae13390cd6987b92e0e6f49b59ae0 ?17:36
cloudnullsimple little 4 node environment17:37
fultonjcloudnull: i've seen that before too, but i don't know why17:37
cloudnullim running with the following templates - https://pasted.tech/pastes/fa1997a62ba1321f6b03df607f109551fe81eba517:38
cloudnullI wonder if its something im configuring wrong, or if its simply a matter of ${SOMETHING} taking too long17:38
cloudnullmy parameters - https://pasted.tech/pastes/98ca0fa7d4bdb2e4189c5ed9f87793c8ccfb5fa0.raw17:40
cloudnullmy pre-prov-params as well - https://pasted.tech/pastes/91edf0a24d8bedb29b10d51e97d2b5a227f271de.raw17:40
fultonjcloudnull: are helathchecks disabled?17:41
cloudnullnothing that Im disabling explicitly17:41
cloudnullshoudl I ?17:41
*** ayoung has quit IRC17:41
fultonji've been using 'ContainerHealthcheckDisabled: true' and haven't hit that timeout17:43
cloudnullI will give that a shot now17:43
cloudnullthanks!17:43
fultonjcloudnull: sure, i hope it helps. I don't know for sure that it will as i haven't had the issue in a while and lots changed.17:44
cloudnull++17:44
fultonji wonder though if this workaround is hiding a bigger problem17:44
fultonjEmilienM: ^ ?17:44
*** jpena is now known as jpena|off17:44
cloudnullgiving it a spin now in a new env17:44
cloudnullI will let you know17:44
*** ayoung has joined #tripleo17:44
cloudnullI've hit that timeout twice today17:44
fultonjhttps://opendev.org/openstack/tripleo-heat-templates/commit/170cd2be9d7003789654f85d36a6b613670ebfb317:47
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Enable ARA for undercloud and standalone  https://review.opendev.org/70002717:49
openstackgerritLon Hohberger proposed openstack/tripleo-puppet-elements stable/train: RHEL8: Use podman-docker  https://review.opendev.org/70001017:50
fultonj https://developers.redhat.com/blog/2019/04/18/monitoring-container-vitality-and-availability-with-podman/17:51
fultonjcloudnull: my theory is that it times out while trying to do the health check. i'll be curious if it makes a diff for you17:52
openstackgerritLon Hohberger proposed openstack/tripleo-puppet-elements stable/train: RHEL8: Use podman-docker  https://review.opendev.org/70000417:52
mwhahahai don't think we use the podman health check functionality17:53
mwhahahawe just exec17:53
openstackgerritMerged openstack/tripleo-ansible stable/train: Create Validations logging directory  https://review.opendev.org/69964117:54
openstackgerritMerged openstack/tripleo-ansible master: Update firewall role handlers  https://review.opendev.org/69948617:54
openstackgerritMerged openstack/tripleo-ansible master: Update regex for presistent save roles  https://review.opendev.org/69948917:54
cloudnullfultonj - the deployment is running now . so hopefully I'll have more soon :D18:01
*** aedc has joined #tripleo18:01
*** aedc has quit IRC18:02
fultonjperhaps then s/"while trying to do the health check"/"when paunch is called without --healthcheck-disabled"/18:02
*** udesale has joined #tripleo18:03
* fultonj speculating from loose correlation (very open to better theories)18:03
openstackgerritwes hayutin proposed openstack/puppet-tripleo stable/train: bump metadata for new train version  https://review.opendev.org/70004518:04
weshaymwhahaha, let me know if you have questions re: ^18:05
*** zaneb has joined #tripleo18:08
*** panda has quit IRC18:08
*** artom has quit IRC18:08
cloudnullanyone around want to review - https://review.opendev.org/#/c/699502/18:09
cloudnullcouple of bugs too https://review.opendev.org/#/c/699907/ and https://review.opendev.org/#/c/699902/18:11
*** artom has joined #tripleo18:13
*** panda has joined #tripleo18:13
*** rfolco is now known as rfolco|bbl18:18
*** udesale has quit IRC18:37
*** hberaud is now known as hberaud|gone18:46
openstackgerritJames Slagle proposed openstack/tripleo-common stable/train: Pass container_config to config actions  https://review.opendev.org/70005018:49
*** mcornea has quit IRC18:49
openstackgerritJames Slagle proposed openstack/python-tripleoclient stable/train: Pass container name to update_nodes workflow  https://review.opendev.org/70005118:50
*** amoralej is now known as amoralej|off18:54
*** mcornea has joined #tripleo19:02
fultonjhttp://lists.openstack.org/pipermail/openstack-discuss/2019-December/011671.html19:06
fultonjcan we +w now that fix is released https://bugs.launchpad.net/tripleo/+bug/1856864 ?19:06
openstackLaunchpad bug 1856864 in tripleo "Not all firewall rules are applied, leading to timeouts" [Critical,Fix released] - Assigned to Emilien Macchi (emilienm)19:06
fultonjEmilienM: ^ ?19:06
mwhahahayes19:06
fultonjok thanks19:06
*** zaneb has quit IRC19:10
*** morazi has quit IRC19:11
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Increase rabbitmq tcp backlog  https://review.opendev.org/69991619:11
*** zaneb has joined #tripleo19:12
cloudnulldoes this mean in our multi-node jobs that we're not actually deploying a compute host https://5e45e41fcb76f17c4644-a324dff4dc6433d6fb4085dbd7c0842f.ssl.cf5.rackcdn.com/699907/1/check/tripleo-ci-centos-7-containers-multinode/4317425/logs/undercloud/home/zuul/overcloud-topology-config.yaml.txt.gz ?19:20
mwhahahacloudnull: no, it's an all-in-one in multinode19:20
*** shardy has quit IRC19:20
mwhahahacloudnull: that means we aren't deploying a Compute role19:20
cloudnullah19:20
mwhahahabut we customize the Controler role to include nova services19:20
cloudnullok19:21
cloudnullthanks!19:21
mwhahahacause by default ControllerCount is 1 and ComputeCount is 119:21
*** nkinder has quit IRC19:21
cloudnulland we're making controller == compute via role customization ?19:21
*** ccamacho has quit IRC19:22
mwhahahasomething like that19:22
cloudnullnext question - https://5e45e41fcb76f17c4644-a324dff4dc6433d6fb4085dbd7c0842f.ssl.cf5.rackcdn.com/699907/1/check/tripleo-ci-centos-7-containers-multinode/4317425/logs/undercloud/home/zuul/overcloud_roles.yaml.txt.gz - I see that the job is using the simple bridge template, with that network role. But I don't see where the interfaces are assigned to19:23
cloudnull a given network. will all of those networks be created off of br-ex ?19:23
mwhahahamaybe19:24
cloudnullits using "pre-deployed" nodes, and I see this map - https://5e45e41fcb76f17c4644-a324dff4dc6433d6fb4085dbd7c0842f.ssl.cf5.rackcdn.com/699907/1/check/tripleo-ci-centos-7-containers-multinode/4317425/logs/undercloud/home/zuul/config-download.yaml.txt.gz but only one fixed address is defined19:24
cloudnullnothing that points to what interface goes where, or which host has what address?19:25
* cloudnull may be over thinking things 19:25
mwhahahaso multinode uses fixed ips19:25
mwhahahahttps://5e45e41fcb76f17c4644-a324dff4dc6433d6fb4085dbd7c0842f.ssl.cf5.rackcdn.com/699907/1/check/tripleo-ci-centos-7-containers-multinode/4317425/logs/undercloud/home/zuul/config-download.yaml.txt.gz19:25
*** raildo has quit IRC19:25
mwhahahai also don't think we use network isolation so all the networks are just the ctlplane19:26
*** raildo has joined #tripleo19:26
mwhahahai guess rather than continuing this, let's back up and you tell me what you're doing :D19:26
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Install tmpwatch on the overcloud  https://review.opendev.org/69920019:27
cloudnullI'm attempting to use pre-provisioned nodes in a multi-node environment. so i figured I'd look at the way we setup the muiltinode job to get a better understanding of how its done.19:28
*** psachin has quit IRC19:28
mwhahahayea that's like learning how  rockets are made by checking out the impact on the ground when it fails19:29
cloudnullhahahaa19:29
*** mcornea has quit IRC19:29
mwhahahahttps://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/features/deployed_server.html19:30
mwhahahawe have docs to read instead19:30
cloudnullI did read that (currently have it open)19:30
mwhahahaci is bad example because we do questionable things to the setup beforehand (like creating br-ex)19:31
cloudnullin my environment, I see the overcloud nodes getting br-ex, and I didn't create that myself.19:31
cloudnullI am using the simple bridge template with dhcp, which I suspect is the issue.19:32
mwhahahabr-ex is usually specified in the network config19:32
cloudnull**net-config-static-bridge-with-external-dhcp.yaml19:33
cloudnullthat template seems to create br-ex by default ?19:33
mwhahahayes19:33
cloudnullmaybe I need to read more about network isolation.19:34
*** mcornea has joined #tripleo19:34
cloudnullis there a better template to use?19:35
ekultailscloudnull: I normally skip out on network isolation entirely (everything is separated by subnets anyways) but I know you normally run various VLANs in your home lab.19:35
openstackgerritMerged openstack/puppet-tripleo master: Add octavia::nova to Octavia services  https://review.opendev.org/69907419:38
openstackgerritMerged openstack/tripleo-quickstart master: Move ostempest job definition with in featureset 52  https://review.opendev.org/69821119:38
openstackgerritMerged openstack/tripleo-common stable/stein: Incorrectly derives NeutronPhysnetNUMANodesMapping  https://review.opendev.org/69955119:38
openstackgerritMerged openstack/tripleo-common stable/rocky: OvS DPDK parameters failing in NIC Partitioning  https://review.opendev.org/69955219:39
openstackgerritMerged openstack/tripleo-heat-templates master: Fix typos in hiera values  https://review.opendev.org/69949319:39
cloudnullwith the net-config-static-bridge-with-external-dhcp.yaml template I see my one static address, eth0 > br-ex (this is using the expected DHCP address) but none of the other subnets are present. :\19:40
*** dmsimard has quit IRC19:41
*** dmsimard has joined #tripleo19:41
ekultailsHmm, I wonder if a manual mapping of the other subnets is required for each Overcloud node.19:44
*** Damjanek has quit IRC19:44
*** spotz has quit IRC19:44
*** dabukalam has quit IRC19:44
*** percevalbot has quit IRC19:44
*** Hobbestigrou has quit IRC19:44
mwhahahacloudnull: additional network config examples are in network/config/19:44
mwhahahayou'll need to render them in order to use them19:44
*** Damjanek has joined #tripleo19:44
*** Hobbestigrou has joined #tripleo19:44
cloudnullit looks like default is net-config-bridge.yaml, is it possible to use static bridge with external dhcp for the gateway device and that default for everything else ?19:45
*** percevalbot has joined #tripleo19:50
EmilienMfultonj: yes (sorry for lag19:52
fultonjEmilienM: np, alex told me19:52
fultonjcloudnull: did your deployment still timeout during step5 ?19:53
cloudnullfultonj it did not :)19:53
cloudnullthanks again for the tip19:53
fultonjcloudnull: so the workaround worked19:53
fultonjbut19:54
cloudnullwith a sample size of 1, it worked19:54
fultonjbecause everyone else has the healthchecks enabled we probably need a bug19:54
cloudnulli'll keep using it for the next couple of environments I stand up, but it looks like a promising workaround.19:54
cloudnullagreed19:55
fultonjEmilienM: cloudnull and i are working around https://pasted.tech/pastes/5cd2633c09aae13390cd6987b92e0e6f49b59ae0 by with 'ContainerHealthcheckDisabled: true' does that make any sense?19:57
EmilienMOH MY GOSHH19:57
EmilienMthe paste shows nothing19:57
cloudnullwe were running into a timeout which didn't given any reason why. while i've only attempted using the override once, i haven't run into that timeout with the override in place.19:59
cloudnullI had the same timeout twice today,19:59
fultonjwhy would starting the containers in step5 with 'paunch --healthcheck-disabled' vs 'paunch' make a difference?20:00
*** sshnaidm is now known as sshnaidm|afk20:00
EmilienMmhh20:00
*** saneax has quit IRC20:00
EmilienMcan I ssh?20:00
fultonjat this poing my env worked20:01
fultonji guess cloudnull or i would have to deploy without ContainerHealthcheckDisabled: false20:02
* fultonj has to step out now for an appointment20:02
EmilienMContainerHealthcheckDisabled will definitely make the deployment a little bit faster but not that much20:03
cloudnullI dont have an environment up atm with the issue, though I can recreate one ?20:03
*** PhilSliderS has quit IRC20:05
*** gpocentek has quit IRC20:05
EmilienMcan someone review https://review.opendev.org/#/c/699992/ please, this is urgent20:05
*** irclogbot_0 has quit IRC20:06
cloudnullEmilienM I gave you my +120:07
EmilienMcloudnull, mwhahaha : I need to get https://review.opendev.org/#/c/700015/ in please20:07
EmilienMcloudnull, mwhahaha : it's temporary until I make a proper switch20:07
EmilienMI ahev the revert of that revert up already we won't release without it20:07
*** PhilSliderS has joined #tripleo20:07
cloudnull+220:08
EmilienMthx guys20:08
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Deploy /etc/openstack/clouds.yaml with Ansible  https://review.opendev.org/69639020:09
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: Deploy /etc/openstack/clouds.yaml with Ansible  https://review.opendev.org/69639020:09
*** irclogbot_2 has joined #tripleo20:11
openstackgerritMartin Mágr proposed openstack/puppet-tripleo master: Enable metrics qdr to use public VIP  https://review.opendev.org/68628720:18
*** raildo_ has joined #tripleo20:29
*** Trevor_V has joined #tripleo20:30
*** holser has joined #tripleo20:30
openstackgerritEmilien Macchi proposed openstack/tripleo-common master: image-uploader: allow an image without Labels to be uploaded  https://review.opendev.org/69999220:31
EmilienMstevebaker: ^ done20:31
*** apetrich has quit IRC20:31
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: Limit concurrency in container-puppet to image pull  https://review.opendev.org/69973720:32
*** raildo has quit IRC20:32
*** TrevorV has quit IRC20:33
openstackgerritEmilien Macchi proposed openstack/instack-undercloud stable/queens: Convert all class usage to relative names  https://review.opendev.org/70006620:44
openstackgerritMerged openstack/tripleo-upgrade stable/rocky: Fix the undefined operation_type variable.  https://review.opendev.org/69942320:45
openstackgerritMerged openstack/python-tripleoclient master: Replace ansible shell with python runner  https://review.opendev.org/67187820:45
EmilienMcloudnull: ^ heh20:46
cloudnullwoot!20:49
*** raildo_ has quit IRC20:50
openstackgerritAlex Schultz proposed openstack/instack-undercloud stable/queens: Fix spec helper  https://review.opendev.org/70006720:51
openstackgerritAlex Schultz proposed openstack/instack-undercloud stable/rocky: Fix spec helper  https://review.opendev.org/70006820:52
openstackgerritAlex Schultz proposed openstack/instack-undercloud stable/queens: Apply firewall rule for tripleo ui if ui is really enabled  https://review.opendev.org/69940120:53
openstackgerritAlex Schultz proposed openstack/instack-undercloud stable/rocky: Remove trove firewall rule  https://review.opendev.org/69932820:53
openstackgerritAlex Schultz proposed openstack/instack-undercloud stable/rocky: Apply firewall rule for tripleo ui if ui is really enabled  https://review.opendev.org/69936620:53
openstackgerritAlex Schultz proposed openstack/instack-undercloud stable/queens: Remove configuration related to Horizon  https://review.opendev.org/69991720:54
mwhahahacloudnull: ansible runner is a rpm requirement somewhere right?20:54
cloudnullyes we make it a requirement to the client20:55
mwhahahak20:55
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates master: container-puppet: create containers sequentially to avoid race  https://review.opendev.org/69980320:57
EmilienMcloudnull: you made my patches merge conflict20:58
EmilienMpush ups!20:58
cloudnullwat!?20:58
EmilienMtripleoclient :P20:58
cloudnulloh, you're welcome20:58
EmilienMarrogant !20:59
mwhahahacloudnull: where's the rpm dependency?20:59
* cloudnull ducks the chair 20:59
EmilienMin the distgit tripleoclient iirc20:59
cloudnull^20:59
mwhahahai don't see it20:59
mwhahaha(which is why i'm asking)20:59
EmilienMhttps://review.rdoproject.org/r/#/c/23934/21:00
EmilienMhttps://review.rdoproject.org/r/#/c/23927/21:00
mwhahahahrm wtf21:00
EmilienMit's in buildrequires21:00
EmilienMit's not enough21:00
EmilienMwe need it in requires21:00
EmilienMwhich is here https://review.rdoproject.org/r/#/c/23934/3/openstack-tripleo-common.spec21:00
mwhahahamy rpm-master branch was broken21:01
cloudnullEmilienM - https://github.com/rdo-packages/tripleoclient-distgit/blob/rpm-master/python-tripleoclient.spec#L9421:01
mwhahahai see it now21:01
mwhahahajust checking21:01
ayoungEmilienM, TYVM:  I got it just now:  http://adam.younglogic.com/2019/12/official-tripleo-keystone-images/21:01
EmilienMshould I really click?21:01
EmilienMI clicked21:02
EmilienMglad you got it working :D21:02
EmilienMyou put my name! :D21:02
openstackgerritMerged openstack/tripleo-heat-templates stable/stein: Increase rabbitmq tcp backlog  https://review.opendev.org/69957321:08
openstackgerritMerged openstack/tripleo-heat-templates stable/stein: Install tmpwatch on the overcloud  https://review.opendev.org/69997121:08
openstackgerritEmilien Macchi proposed openstack/tripleo-common stable/train: image-uploader: allow an image without Labels to be uploaded  https://review.opendev.org/70006921:10
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Derive Pci passthrough whitelist disable option  https://review.opendev.org/69940321:12
*** jfrancoa has quit IRC21:15
*** pcaruana has quit IRC21:23
stevebakermwhahaha: hey my ooolpbot replacement is ready. I'll find a place to host it next year21:28
mwhahahak21:28
*** pequbot-test has joined #tripleo21:29
pequbot-testURGENT TRIPLEO TASKS NEEDING ATTENTION: 921:29
pequbot-testhttps://bugs.launchpad.net/tripleo/+bug/184003621:29
openstackLaunchpad bug 1840036 in tripleo "[check][container-build] RHEL-8 patch pulled, needs to be rebased against kolla patch running in check" [Critical,Triaged] - Assigned to chandan kumar (chkumar246)21:29
pequbot-testhttps://bugs.launchpad.net/tripleo/+bug/184061621:29
pequbot-testhttps://bugs.launchpad.net/tripleo/+bug/184856421:29
pequbot-testhttps://bugs.launchpad.net/tripleo/+bug/185301221:29
pequbot-testhttps://bugs.launchpad.net/tripleo/+bug/185397821:29
openstackLaunchpad bug 1840616 in tripleo "Master/stein check and promotion OVB jobs are randomly giving ansible time out while overcloud deploy" [Critical,Triaged] - Assigned to Ronelle Landy (rlandy)21:29
openstackLaunchpad bug 1848564 in tripleo "rhel8 buildimage oc failing: incorrect deps repo" [Critical,Triaged] - Assigned to Rafael Folco (rafaelfolco)21:29
openstackLaunchpad bug 1853012 in tripleo "Standalone upgrade job is failing - On ovn upgrade" [Critical,In progress] - Assigned to mathieu bultel (mat-bultel)21:29
openstackLaunchpad bug 1853978 in tripleo "periodic train rhel8 ovb overcloud deployment failed with Could not find class ::tripleo::profile::base::neutron::ovn_metadata_agent_wrappers" [Critical,Triaged]21:29
stevebakerit has a configured limit of 5 links, hence the 9 != 521:30
*** pequbot-test has quit IRC21:30
*** Goneri has quit IRC21:35
*** ansmith has quit IRC21:40
ayoungLinks to my blog are usually safe to click.  Usually21:42
*** ayoung has quit IRC21:42
*** Trevor_V has quit IRC22:05
*** rfolco|bbl has quit IRC22:06
*** waleedm__ has quit IRC22:07
*** holser has quit IRC22:07
openstackgerritMerged openstack/tripleo-heat-templates master: Provide option to set reserved_huge_pages  https://review.opendev.org/69399422:19
openstackgerritMerged openstack/ansible-role-collect-logs master: Render undercloud ara results  https://review.opendev.org/69986722:19
openstackgerritMerged openstack/tripleo-validations master: Remove the useless environment variable.  https://review.opendev.org/69966722:19
openstackgerritMerged openstack/tripleo-quickstart-extras master: Ensure NSS package is updated for FreeIPA deploy  https://review.opendev.org/69858522:19
openstackgerritLance Bragstad proposed openstack/tripleo-heat-templates master: WIP: Ensure CRL is on the haproxy container  https://review.opendev.org/70008122:22
*** cschwede has quit IRC22:30
*** mcornea has quit IRC22:33
openstackgerritAlex Schultz proposed openstack/python-tripleoclient master: Catch exceptions when processing subnets  https://review.opendev.org/70008222:34
*** ayoung has joined #tripleo22:43
openstackgerritSagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Enable ARA for undercloud and standalone  https://review.opendev.org/70002722:47
*** slaweq has quit IRC22:51
openstackgerritEmilien Macchi proposed openstack/python-tripleoclient master: Implement utils.copy_clouds_yaml  https://review.opendev.org/69944822:54
openstackgerritJames E. Blair proposed openstack/diskimage-builder master: Add containerfile element  https://review.opendev.org/70008323:01
openstackgerritEmilien Macchi proposed openstack/tripleo-ansible master: tripleo-keystone-resources: handle multiple roles per user  https://review.opendev.org/69928623:01
openstackgerritEmilien Macchi proposed openstack/tripleo-heat-templates master: WIP - Manage all Keystone resources with Ansible  https://review.opendev.org/69698023:02
openstackgerritJames E. Blair proposed openstack/diskimage-builder master: WIP: test docker element  https://review.opendev.org/70004123:04
*** tkajinam has joined #tripleo23:04
*** ekultails has quit IRC23:06
openstackgerritMerged openstack/tripleo-ansible master: Revert "tripleo-keystone-resources: reduce permissions for clouds.yaml"  https://review.opendev.org/70001523:13
*** jbadiapa has quit IRC23:13
*** tkajinam has quit IRC23:17
*** tkajinam has joined #tripleo23:17
*** ansmith has joined #tripleo23:18
*** tosky has quit IRC23:22
mwhahahaEmilienM: do you see the failure in this? https://f5e4995f33a84fedb066-306bf88b8b0223e04364eb41d42ffe2c.ssl.cf1.rackcdn.com/699359/2/check/tripleo-ci-centos-7-containers-multinode/3c0e8b5/job-output.txt23:23
mwhahahaEmilienM: job failed with a non-zero return code but no error that i can see23:23
*** ayoung has quit IRC23:23
EmilienMlooking23:23
*** bnemec has quit IRC23:24
*** bnemec has joined #tripleo23:24
EmilienMweird23:24
EmilienM2019-12-19 22:54:05.266660 | primary | Quickstart completed.23:25
EmilienM2019-12-19 22:54:05.266746 | primary | +(./toci_quickstart.sh:170): exit 023:25
EmilienM2019-12-19 22:54:05.294224 | primary | +(/home/zuul/src/opendev.org/openstack/tripleo-ci/toci_gate_test.sh:171): echo 'Run completed'23:25
EmilienM2019-12-19 22:54:05.294317 | primary | Run completed23:25
EmilienM2019-12-19 22:56:51.673415 | primary | ERROR23:25
EmilienM2019-12-19 22:56:51.676300 | primary | {23:25
EmilienM2019-12-19 22:56:51.676421 | primary |   "delta": "0:04:10.941172",23:25
EmilienM2019-12-19 22:56:51.676530 | primary |   "end": "2019-12-19 22:56:51.084226",23:25
EmilienM2019-12-19 22:56:51.676634 | primary |   "msg": "non-zero return code",23:25
EmilienM2019-12-19 22:56:51.676735 | primary |   "rc": 2,23:25
EmilienM2019-12-19 22:56:51.676836 | primary |   "start": "2019-12-19 22:52:40.143054"23:25
EmilienM2019-12-19 22:56:51.676934 | primary | }23:25
EmilienM2019-12-19 22:56:51.850712 |23:25
EmilienM2019-12-19 22:56:51.850923 | PLAY RECAP23:25
EmilienM2019-12-19 22:56:51.851085 | primary | ok: 8 changed: 5 unreachable: 0 failed: 1 skipped: 11 rescued: 0 ignored: 023:25
*** ayoung has joined #tripleo23:25
mwhahahawonder if it's like a pipe fail23:25
EmilienMah23:26
EmilienMThere was an issue creating /root/DLRN as requested: [Errno 13] Permission denied: '/root/DLRN'23:26
EmilienMhttps://f5e4995f33a84fedb066-306bf88b8b0223e04364eb41d42ffe2c.ssl.cf1.rackcdn.com/699359/2/check/tripleo-ci-centos-7-containers-multinode/3c0e8b5/logs/quickstart_install.log23:26
EmilienMmhh no23:26
EmilienMit would have failed earlier23:26
EmilienM(still the task failed)23:26
mwhahahaecho "Run completed" is the last line in toci_gate_test.sh.j223:27
mwhahahaso wonder if it was the ansible playbook23:27
* mwhahaha shrugs23:27
EmilienMsame23:28
EmilienMno idea but this DLRN issue isn't normlal23:28
mwhahahawell it is missing the become true23:32
mwhahahathough unsure why it's using /root/23:32
*** rcernin has joined #tripleo23:39
sshnaidm|afkmwhahaha, EmilienM that was problem with nodepool node and its user23:42
sshnaidm|afkit happens sometimes, was a bug about it23:42
mwhahahak23:42
EmilienMsshnaidm|afk: any patch in progress or?23:42
EmilienMlet's fix it23:42
sshnaidm|afkI think it was infra stuff23:43
EmilienMit's not super obvious when debugging23:43
sshnaidm|afkiirc zuul reconnect to nodepool as root user and not zuul, no idea why..23:46
*** Goneri has joined #tripleo23:52
EmilienMsshnaidm|afk: should we become: true as a workaround (only for that task)?23:54
sshnaidm|afkEmilienM, nah, I think it will fail later anyway23:57
sshnaidm|afkwe are not supposed to run it as root23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!