Tuesday, 2022-01-11

*** rlandy|dentist is now known as rlandy|ruck00:10
*** rlandy|ruck is now known as rlandy|out00:31
opendevreviewMerged openstack/tripleo-heat-templates stable/wallaby: Move *NetworkConfigTemplate to parameter_defaults  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82388102:43
opendevreviewMerged openstack/tripleo-heat-templates stable/victoria: Use public endpoint for [keystone_authtoken] www_authenticate_uri  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82358904:20
opendevreviewMerged openstack/tripleo-heat-templates stable/ussuri: Use public endpoint for [keystone_authtoken] www_authenticate_uri  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82361004:20
opendevreviewMerged openstack/tripleo-heat-templates stable/train: Use public endpoint for [keystone_authtoken] www_authenticate_uri  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82361104:21
opendevreviewMerged openstack/tripleo-heat-templates stable/wallaby: Fix killscript regex match for libpod-conmon-*  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82384704:21
opendevreviewMerged openstack/tripleo-heat-templates stable/victoria: Fix killscript regex match for libpod-conmon-*  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82384904:21
opendevreviewMerged openstack/tripleo-heat-templates stable/ussuri: Fix killscript regex match for libpod-conmon-*  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82384804:21
opendevreviewMerged openstack/tripleo-heat-templates master: Revert "Revert "Add chrony waitsync back in""  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82294804:21
opendevreviewMerged openstack/tripleo-heat-templates stable/train: Fix killscript regex match for libpod-conmon-*  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82260604:21
opendevreviewchandan kumar proposed openstack/tripleo-quickstart master: Pull DLRN from github for CS9  https://review.opendev.org/c/openstack/tripleo-quickstart/+/82397505:14
*** ysandeep|out is now known as ysandeep05:36
chandankumardvd: abishop: hello, please have a look at this bug https://bugs.launchpad.net/tripleo/+bug/1957031 when around, thanks !06:44
Tenguchandankumar: hello there! quick question: in CI, how are the overcloud images builts? from dedicated VM, or from within some container? here, I'm trying to make the oooci-build-images work from within a container so that I can build cs8 and cs9 based images, but I'm facing some (weird) issues. So I just want to know if this is something that was already done, or not :)07:08
chandankumarTengu: from a dedicated vm07:08
Tenguhmm. ok.07:08
TenguI'd rather avoid that, but...07:08
TenguI'll do some more testing today with my container (I'm not THAT far I think).07:09
Tenguchandankumar: would CI be interested in this, btw? in order to get ONE VM building multiple releases?07:09
chandankumarTengu: if it builts in container, we may want to give it a shot07:10
Tenguchandankumar: ah, here I'm talking about the overcloud-full qcow207:11
Tenguchandankumar: but... I also have container building the containers :)07:11
Tenguit requires somes hacks, but it seems to work07:11
chandankumarTengu: one vm building multiple releases not sure, for each release, we have a job to build release specific images07:11
chandankumarTengu: may be a good topic to bring it to tripleo ci community call07:12
Tenguchandankumar: that's today right?07:12
TenguI can jump in07:12
chandankumarTengu: yes07:12
chandankumarTengu: sounds awesome :-)07:12
Tenguadding a topic in the hackmd07:12
chandankumarbhagyashris: ^^07:13
chandankumarTengu: thanks :-)07:13
Tengu#done07:13
Tenguplease ping me if I'm not on the call, I may not see the time07:14
chandankumarTengu: sure07:14
Tengu:) ok. going back to my DIB thing.07:15
opendevreviewchandan kumar proposed openstack/tripleo-quickstart master: Pull DLRN from github for CS9  https://review.opendev.org/c/openstack/tripleo-quickstart/+/82397507:18
opendevreviewJiri Podivin proposed openstack/validations-common master: Bumping the ansible-lint version to 5.3.2 in order to resolve CI failure  https://review.opendev.org/c/openstack/validations-common/+/82408807:48
bhagyashrischandankumar, ack07:58
opendevreviewJiri Podivin proposed openstack/tripleo-validations master: Bumping the ansible-lint version to 5.3.2 in order to resolve CI failure  https://review.opendev.org/c/openstack/tripleo-validations/+/82408907:59
*** amoralej|off is now known as amoralej08:06
opendevreviewchandan kumar proposed openstack/tripleo-common master: Remove remove-machine-id element  https://review.opendev.org/c/openstack/tripleo-common/+/82409208:17
*** ysandeep is now known as ysandeep|afk08:21
opendevreviewchandan kumar proposed openstack/tripleo-puppet-elements master: Revert "Add remove-machine-id element"  https://review.opendev.org/c/openstack/tripleo-puppet-elements/+/82252808:27
*** jpena|off is now known as jpena08:36
opendevreviewchandan kumar proposed openstack/openstack-tempest-skiplist master: Move volume tests to skip lists  https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/82409708:40
*** ysandeep|afk is now known as ysandeep08:47
*** pojadhav- is now known as pojadhav08:54
opendevreviewAndre Aranha proposed openstack/tripleo-validations master: Remove content of TLS-Everywhere molecule.conf  https://review.opendev.org/c/openstack/tripleo-validations/+/82410009:09
opendevreviewAdriano Petrich proposed openstack/python-tripleoclient master: Exposes the community validation init command  https://review.opendev.org/c/openstack/python-tripleoclient/+/82354309:30
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/victoria: Optimize linters executions from tox and pre-commit  https://review.opendev.org/c/openstack/tripleo-validations/+/82410709:38
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/victoria: Use centos-8 stream for molecule jobs  https://review.opendev.org/c/openstack/tripleo-validations/+/82410809:38
opendevreviewMerged openstack/diskimage-builder master: centos: work around 9-stream BLS issues  https://review.opendev.org/c/openstack/diskimage-builder/+/82177209:38
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/wallaby: Bumping the ansible-lint version to 5.3.2 in order to resolve CI failure  https://review.opendev.org/c/openstack/tripleo-validations/+/82411109:41
opendevreviewchandan kumar proposed openstack/openstack-tempest-skiplist master: Move test_network_basic_ops to skip list  https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/82411909:50
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/victoria: [Victoria-only] Bumping the ansible-lint version to 5.3.2 in order to resolve CI failure  https://review.opendev.org/c/openstack/tripleo-validations/+/82412009:51
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/ussuri: [Ussuri-only] Bumping the ansible-lint version to 5.3.2 in order to resolve CI failure  https://review.opendev.org/c/openstack/tripleo-validations/+/82412309:53
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/train: [Train-only] Bumping the ansible-lint version to 5.3.2 in order to resolve CI failure  https://review.opendev.org/c/openstack/tripleo-validations/+/82412509:54
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/wallaby: Optimize linters executions from tox and pre-commit  https://review.opendev.org/c/openstack/tripleo-validations/+/82105909:56
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/wallaby: Use centos-8 stream for molecule jobs  https://review.opendev.org/c/openstack/tripleo-validations/+/82106009:56
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/wallaby: undercloud-debug validation documentation improvement  https://review.opendev.org/c/openstack/tripleo-validations/+/82363509:56
opendevreviewMikolaj Ciecierski proposed openstack/tripleo-upgrade stable/wallaby: Fix services stack export to respect overcloud stack name  https://review.opendev.org/c/openstack/tripleo-upgrade/+/82402110:04
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/ussuri: Optimize linters executions from tox and pre-commit  https://review.opendev.org/c/openstack/tripleo-validations/+/82413410:13
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/ussuri: Use centos-8 stream for molecule jobs  https://review.opendev.org/c/openstack/tripleo-validations/+/82413510:13
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/ussuri: Optimize linters executions from tox and pre-commit  https://review.opendev.org/c/openstack/tripleo-validations/+/82413410:14
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/ussuri: Use centos-8 stream for molecule jobs  https://review.opendev.org/c/openstack/tripleo-validations/+/82413510:14
opendevreviewMerged openstack/tripleo-quickstart-extras master: Fix ansible-lint failure  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82398110:16
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/victoria: Optimize linters executions from tox and pre-commit  https://review.opendev.org/c/openstack/tripleo-validations/+/82410710:16
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/victoria: [Victoria-only] Bumping the ansible-lint version to 5.3.2 in order to resolve CI failure  https://review.opendev.org/c/openstack/tripleo-validations/+/82412010:16
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/victoria: Use centos-8 stream for molecule jobs  https://review.opendev.org/c/openstack/tripleo-validations/+/82410810:16
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/victoria: Optimize linters executions from tox and pre-commit  https://review.opendev.org/c/openstack/tripleo-validations/+/82410710:17
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/victoria: Use centos-8 stream for molecule jobs  https://review.opendev.org/c/openstack/tripleo-validations/+/82410810:17
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/ussuri: [Ussuri-only] Bumping the ansible-lint version to 5.3.2 in order to resolve CI failure  https://review.opendev.org/c/openstack/tripleo-validations/+/82412310:25
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/ussuri: Optimize linters executions from tox and pre-commit  https://review.opendev.org/c/openstack/tripleo-validations/+/82413410:26
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/ussuri: Use centos-8 stream for molecule jobs  https://review.opendev.org/c/openstack/tripleo-validations/+/82413510:26
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/train: [Train-only] Bumping the ansible-lint version to 5.3.2 in order to resolve CI failure  https://review.opendev.org/c/openstack/tripleo-validations/+/82412510:29
opendevreviewBogdan Dobrelya proposed openstack/tripleo-quickstart master: [cs9] add requirements for virt-* commands  https://review.opendev.org/c/openstack/tripleo-quickstart/+/82170010:35
opendevreviewBogdan Dobrelya proposed openstack/tripleo-quickstart master: Add missing lxml requirement for libvirt modules  https://review.opendev.org/c/openstack/tripleo-quickstart/+/82169710:35
opendevreviewamolkahat proposed openstack/tripleo-ci master: [DNM][WIP] Use release file for C8  https://review.opendev.org/c/openstack/tripleo-ci/+/82368810:37
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/train: Optimize linters executions from tox and pre-commit  https://review.opendev.org/c/openstack/tripleo-validations/+/82413810:38
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/train: Use centos-8 stream for molecule jobs  https://review.opendev.org/c/openstack/tripleo-validations/+/82413910:38
opendevreviewBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Make sure libvirt guests shut down before network  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82230910:42
opendevreviewDaniel Bengtsson proposed openstack/python-tripleoclient master: Stop configuring install_command in tox.  https://review.opendev.org/c/openstack/python-tripleoclient/+/69350210:43
Tenguchandankumar: ah! the diskimage-builder patch is apparently in. When shall we get a newer overcloud-full image? iirc it's not really scheduled, more something based on promotion, isn't it?10:52
*** ysandeep is now known as ysandeep|coffee11:01
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/wallaby: Optimize linters executions from tox and pre-commit  https://review.opendev.org/c/openstack/tripleo-validations/+/82105911:02
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/wallaby: Use centos-8 stream for molecule jobs  https://review.opendev.org/c/openstack/tripleo-validations/+/82106011:02
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/wallaby: undercloud-debug validation documentation improvement  https://review.opendev.org/c/openstack/tripleo-validations/+/82363511:02
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/victoria: Optimize linters executions from tox and pre-commit  https://review.opendev.org/c/openstack/tripleo-validations/+/82410711:03
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/victoria: Use centos-8 stream for molecule jobs  https://review.opendev.org/c/openstack/tripleo-validations/+/82410811:03
chandankumarTengu: promotion job will kick in an hour11:06
chandankumarwe will be having a newere image11:07
*** rlandy|out is now known as rlandy|ruck11:09
Tenguchandankumar: cool!11:10
opendevreviewMerged openstack/diskimage-builder master: Bump Ubuntu release to focal  https://review.opendev.org/c/openstack/diskimage-builder/+/80629611:21
Tenguaha. need to run podman as root, with --privileged. seems to be better.11:21
*** dviroel|out is now known as dviroel11:23
Tengufar, far better. ok. rootless podman isn't possible for DIB.11:27
Tenguchandankumar: I apparently am able to build the OC images from within a container :). And this is cool!11:27
opendevreviewOliver Walsh proposed openstack/tripleo-heat-templates master: Disable metrics_qdr binding in HAProxyEdge  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82414511:28
*** jcapitao is now known as jcapitao_lunch11:31
*** ysandeep|coffee is now known as ysandeep11:43
opendevreviewJose Luis Franco proposed openstack/tripleo-ci master: WIP: Add undercloud-ffu-wallaby job.  https://review.opendev.org/c/openstack/tripleo-ci/+/82271611:47
chandankumarartom: hello, please have a look at this bug https://bugs.launchpad.net/tripleo/+bug/1956563 11:55
opendevreviewFrancesco Pantano proposed openstack/tripleo-specs master: Introduce TripleO Ceph Ingress Integration  https://review.opendev.org/c/openstack/tripleo-specs/+/82414611:58
chandankumarartom: thanks!11:58
opendevreviewMerged openstack/openstack-tempest-skiplist master: Move test_network_basic_ops to skip list  https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/82411912:16
opendevreviewRonelle Landy proposed openstack/tripleo-quickstart-extras master: Inject gating gating repo during image build  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82289712:17
opendevreviewchandan kumar proposed openstack/openstack-tempest-skiplist master: Move volume tests to skip lists  https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/82409712:25
opendevreviewRajesh Tailor proposed openstack/tripleo-validations master: Remove pre-deployment validation  https://review.opendev.org/c/openstack/tripleo-validations/+/82031412:26
chandankumarTengu: https://review.rdoproject.org/zuul/status openstack-periodic-integration-main-cs9 has just started, we will have new images and containers in an hour12:27
*** beagles is now known as beagles-afk12:33
Tengu\o/12:35
opendevreviewMarios Andreou proposed openstack/tripleo-ci master: Add C9 content provider and standalone scenarios to gate queue  https://review.opendev.org/c/openstack/tripleo-ci/+/82417412:49
opendevreviewMarios Andreou proposed openstack/tripleo-ci master: Add C9 undercloud jobs to gate queue and voting  https://review.opendev.org/c/openstack/tripleo-ci/+/82417512:49
opendevreviewMarios Andreou proposed openstack/tripleo-ci master: Add C9 multinode jobs to gate queue and voting  https://review.opendev.org/c/openstack/tripleo-ci/+/82417612:49
opendevreviewMarios Andreou proposed openstack/tripleo-ci master: Add C9 deployment image build jobs to gate queue and voting  https://review.opendev.org/c/openstack/tripleo-ci/+/82417712:49
opendevreviewMerged openstack/openstack-tempest-skiplist master: Move volume tests to skip lists  https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/82409712:59
*** amoralej is now known as amoralej|lunch13:04
*** jcapitao_lunch is now known as jcapitao13:06
opendevreviewJose Luis Franco proposed openstack/tripleo-heat-templates stable/wallaby: DNM: Test undercloud ffu wallaby upgrade.  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82396613:07
opendevreviewMikolaj Ciecierski proposed openstack/tripleo-upgrade master: Set ephemeral-heat option to true by default for Wallaby+  https://review.opendev.org/c/openstack/tripleo-upgrade/+/82417813:12
opendevreviewJose Luis Franco proposed openstack/tripleo-quickstart-extras master: Adapt standalone-upgrade to run tripleo operator  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81755213:15
chandankumarTengu: https://images.rdoproject.org/centos9/master/rdo_trunk/tripleo-ci-testing/ freshly built images13:16
rlandy|ruckmwhahaha: ade_lee: created bug for the multinode-ipa ntp issue: https://bugs.launchpad.net/tripleo/+bug/195708313:18
Tenguchandankumar: I'll check in a few if it works better :)13:20
opendevreviewBogdan Dobrelya proposed openstack/tripleo-heat-templates stable/wallaby: Update cell0 db connection, if required  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82415113:21
opendevreviewRonelle Landy proposed openstack/tripleo-quickstart-extras master: DNM: Add entries to /etc/hosts - pool.ntp.org  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82406113:22
opendevreviewRonelle Landy proposed openstack/tripleo-quickstart-extras master: Enable IPA debug logging  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82406713:23
opendevreviewFrancesco Pantano proposed openstack/tripleo-specs master: Introduce TripleO Ceph Ingress Integration  https://review.opendev.org/c/openstack/tripleo-specs/+/82414613:25
opendevreviewRonelle Landy proposed openstack/tripleo-quickstart-extras master: DNM: Removing default NTP servers when not defined in job  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82418113:30
opendevreviewamolkahat proposed openstack/tripleo-ci master: [DNM][WIP] Use release file for C8  https://review.opendev.org/c/openstack/tripleo-ci/+/82368813:30
abishopchandankumar: just coming online now, will look at tempest lp you flagged, someone from nova should also look13:32
chandankumarabishop: awesome, we have opened one more bug https://bugs.launchpad.net/tripleo/+bug/1957060 those tests are also failing here .13:33
chandankumarsure, thanks :-)13:33
abishopchandankumar: first one you flagged is definitely nova/libvirt, see 14:34:44.309 time in https://logserver.rdoproject.org/openstack-periodic-integration-main-cs9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-standalone-full-tempest-api-master/1dc7580/logs/undercloud/var/log/containers/nova/nova-compute.log.1.gz13:38
opendevreviewDavid Hill proposed openstack/tripleo-ansible master: Added controller_group_name to override group name  https://review.opendev.org/c/openstack/tripleo-ansible/+/82374013:45
opendevreviewAndre Aranha proposed openstack/tripleo-validations stable/train: Change ansible_hostname to use ansible_facts  https://review.opendev.org/c/openstack/tripleo-validations/+/82384314:01
opendevreviewAndre Aranha proposed openstack/tripleo-validations stable/train: Make sure fact is available to find hostname  https://review.opendev.org/c/openstack/tripleo-validations/+/82384414:02
opendevreviewAndre Aranha proposed openstack/tripleo-validations stable/train: Remove domain equivalence check  https://review.opendev.org/c/openstack/tripleo-validations/+/82399514:02
opendevreviewAndre Aranha proposed openstack/tripleo-validations stable/train: Remove Docker references  https://review.opendev.org/c/openstack/tripleo-validations/+/82403514:02
opendevreviewAndre Aranha proposed openstack/tripleo-validations stable/train: Add undercloud-ipa-server-check task  https://review.opendev.org/c/openstack/tripleo-validations/+/82404614:02
*** amoralej|lunch is now known as amoralej14:05
opendevreviewJiri Podivin proposed openstack/tripleo-ci master: WIP/DNM - Add fips jobs  https://review.opendev.org/c/openstack/tripleo-ci/+/80821514:09
*** akahat_ is now known as akahat14:25
abishopchandankumar: https://bugs.launchpad.net/tripleo/+bug/1957060/comments/214:27
chandankumarabishop: thanks :-)14:36
chandankumarabishop++14:36
opendevreviewBogdan Dobrelya proposed openstack/tripleo-heat-templates stable/train: Update cell0 db connection, if required  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82419414:40
bogdandosshnaidm: libvirt reproducer now fails on bad registry URI, like  https://quay.io/v2/tripleomastercentos9/openstack-nova-scheduler/manifests/<tag>14:45
bogdandoI think there is no such a namespace yet?14:46
bogdandohow could I fix that?14:46
chandankumarbogdando: containers are not yet pushed to quay.io14:47
bogdandoany place to tweak?14:47
bogdandoto have that uri crafted right14:47
chandankumaryou can pull it from trunk.registry.rdoproject.org14:47
chandankumarin release file14:47
bogdandoaha, thanks14:47
sshnaidmbogdando, and also in job vars iirc14:47
*** beagles-afk is now known as beagles14:48
sshnaidmbogdando, alt_container_registry: trunk.registry.rdoproject.org14:48
bogdandomany thanks14:48
chandankumarbogdando: https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/release/tripleo-ci/CentOS-9/master.yml#L1514:48
sshnaidmbogdando, https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/CentOS-9/master.yml#L2414:49
sshnaidm:)14:49
bogdandobut direct substitution still gives malformed URI14:49
sshnaidmbogdando, substitution where?14:50
bogdandohttps://quay.io/v2/tripleomastercentos9/openstack-nova-scheduler/manifests/%3Ctag%3E and https://trunk.registry.rdoproject.org/v2/tripleomastercentos9/openstack-nova-scheduler/manifests/%3Ctag%3E are both dead14:50
bogdandowrong namespace?14:50
bogdandoor auth is needed?14:51
sshnaidmbogdando, what is tag you try to pull?14:51
sshnaidmbogdando, does it work with docker.io ?14:51
bogdandonope14:54
bogdandotag is the dlrn hash id I picked to deploy with...14:54
bogdandodlrn_hash_tag: dea59c8788a0ae58fda5b100cd92844a <<< in current-tripleo14:54
bogdandodlrn_hash_tag_newest: fd09e9932887deea81042c762492e506 << in current14:55
bogdandotogether that magic pair works for me :)14:55
bogdandoat least for repo setup steps14:55
bogdandothat's some recent Jan 22 builds14:55
bogdando2022* :)14:55
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Horizon: Manage policy files  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82389115:01
*** xek_ is now known as xek15:04
bogdandosshnaidm, chandankumar: so, my containers prepare yaml has namespace: quay.io/tripleomastercentos9, what is another workable source?15:06
artomchandankumar, did you ping me https://bugs.launchpad.net/tripleo/+bug/1956563 because you think it's a Nova issue?15:20
artomOr did you mean to ping another Art(e|o)m?15:20
opendevreviewRafael Castillo proposed openstack/tripleo-quickstart master: Allow overriding the container registry namespace for Ussuri  https://review.opendev.org/c/openstack/tripleo-quickstart/+/82405615:23
opendevreviewAlex Schultz proposed openstack/tripleo-quickstart-extras master: Enable IPA debug logging  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82406715:24
bogdandochandankumar, sshnaidm: namespace: trunk.registry.rdoproject.org/tripleomastercentos9 worked15:25
bogdandonot entirely sure though how to adjust the reproducer luncher job vars to get exactly that in that place15:26
bogdandowill try later if alt_container_registry: trunk.registry.rdoproject.org does that15:26
bogdandolauncher* :)15:26
rlandy|ruckartom: ack - chandankumar was looking for you wrt  https://bugs.launchpad.net/tripleo/+bug/195656315:27
rlandy|ruckartom: per abishop's comments15:27
*** dviroel is now known as dviroel|lunch|errand15:29
sshnaidmbogdando, yeah, we have "quay.io" as default, probably we will push there containers as well - chandankumar do you know if it's planned?15:29
sshnaidmbogdando, otherwise, I think we can pass this var in reproducer..15:29
bogdandorlandy|ruck, artom: did you mean https://bugs.launchpad.net/tripleo/+bug/1957060 maybe15:29
opendevreviewJohn Fulton proposed openstack/tripleo-common master: Add ceph_spec library to tripleo-common  https://review.opendev.org/c/openstack/tripleo-common/+/82420315:29
opendevreviewAlex Schultz proposed openstack/tripleo-quickstart-extras master: Enable IPA debug logging  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82406715:31
bogdandomhm, was that linked periodic-tripleo-ci-centos-9-standalone-full-tempest-api-master job logs for which of lp bugz?..15:32
bogdandoabishop: ^^15:33
bogdando1957060 or 195656315:33
rlandy|ruckabishop: artom: bogdando: ack https://bugs.launchpad.net/tripleo/+bug/1957060/15:33
rlandy|rucktoo many bugs flying around :)15:33
bogdandoyea15:33
artomrlandy|ruck, bogdando, so which bug am I supposed to look at? *very confused* :)15:35
bogdandoall? :)15:35
artomNo :P15:35
bogdandoheh15:36
opendevreviewDavid Hill proposed openstack/tripleo-heat-templates master: Disable libvirtd and stop it  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82420415:37
rlandy|ruckartom: https://bugs.launchpad.net/tripleo/+bug/1957060/15:37
bogdandorlandy|ruck: and that openstack-periodic-integration-main-cs9 references a 3rd bug it seems? chandankumar?15:39
abishopartom: it's https://bugs.launchpad.net/tripleo/+bug/1957031, I pointed chandankumar to it seeming to be a nova/libvirt issue15:39
bogdandoso indeed15:39
Tenguchandankumar: heya! question about DIB: using the ooci-thing, I hit a failure: diskimage_builder.element_dependencies.MissingElementException: Element 'openvswitch' not found    is this expected? or am I missing some parameter?15:39
bogdandoartom: sorry for confustion!15:39
artomabishop, aaaaa, that's a 3rd different bug ID15:40
Tenguhmmm. weird. I do have this element.15:40
rlandy|ruckmwhahaha: ade_lee: we will need to pull multinode-ipa out of gating/voting if we see more failures15:40
mwhahahayea we'll need to pull it15:40
opendevreviewAlex Schultz proposed openstack/tripleo-ci master: Revert "Revert "Make standalone-ipa job non-voting during debug""  https://review.opendev.org/c/openstack/tripleo-ci/+/82415715:42
mwhahaharlandy|ruck: -^15:42
* rlandy|ruck cries15:42
rlandy|ruckbut yeah15:42
rlandy|rucklet's at least prep that patch15:43
rlandy|ruckarxcruz|ruck: rcastillo|rover: ^^15:44
artomchandankumar, https://bugs.launchpad.net/tripleo/+bug/1957031 looks very much like https://bugzilla.redhat.com/show_bug.cgi?id=201209615:44
rlandy|ruckpulling ipa from voting again15:44
rlandy|ruckchandankumar is EoD I think15:45
* rlandy|ruck will check after EL9 call15:45
Tenguah, nevermind, found out the issue about that element.15:50
* ade_lee crying with rlandy|ruck 15:50
rlandy|ruckade_lee: there are two patches in progress now - will review with you this afternoon15:51
ade_leerlandy|ruck, ok15:51
bogdandosshnaidm, chandankumar: at last I have a standalone reproducer deployed with some magic to avoid dlrn build bug15:53
bogdandocs9!!!15:53
sshnaidmbogdando++15:53
bogdando(the magic was manually hack t-h-t instead of failing depends-on)15:54
sshnaidmbogdando, does depends-on fail?15:54
bogdandoyes, cuz of the known dlrn bug, I've also commented about the fix didn't work15:55
bogdandohttps://review.opendev.org/c/openstack/tripleo-quickstart/+/82397515:55
bogdandosshnaidm: so if I add https://review.opendev.org/c/openstack/tripleo-heat-templates/+/823994 as a depends-on, it hits https://bugs.launchpad.net/tripleo/+bug/195694615:56
sshnaidmbogdando, iiuc from bug the new DLRN should solve it?15:59
bogdandoperhaps15:59
sshnaidmand it's released.. can you check which version do you have?15:59
sshnaidmbogdando, per chandankumar DLRN==0.24.0 should contain the fix16:00
bogdando(dlrn-venv) [zuul@subnode-0 ~]$ pip freeze | grep DLRN16:01
bogdandoDLRN==0.24.016:01
sshnaidmhmm16:02
sshnaidmmaybe reinstall it..16:02
bogdandowill retry16:03
bogdandothe job run16:03
opendevreviewDavid Hill proposed openstack/tripleo-heat-templates master: Disable libvirtd and stop it  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82420416:03
opendevreviewDavid Hill proposed openstack/tripleo-heat-templates master: Disable libvirtd and stop it  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82420416:12
*** rlandy|ruck is now known as rlandy|ruck|brb16:19
bogdandosshnaidm: yes, it worked this time16:21
sshnaidmbogdando, cool16:22
*** ysandeep is now known as ysandeep|out16:23
*** sshnaidm is now known as sshnaidm|afk16:23
opendevreviewAlex Schultz proposed openstack/ansible-role-collect-logs master: Add ipa command log collection  https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/82420816:25
opendevreviewAlex Schultz proposed openstack/tripleo-heat-templates master: [DNM] Troubleshooting ntp & ipa stuff  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82406916:27
opendevreviewFrancesco Pantano proposed openstack/tripleo-specs master: Introduce TripleO Ceph Ingress Integration  https://review.opendev.org/c/openstack/tripleo-specs/+/82414616:29
*** rlandy|ruck|brb is now known as rlandy|ruck16:35
rlandy|ruckade_lee: please ping when you have time to chat about patches for multinode-ipa. thanks16:40
ade_leerlandy|ruck, will do, right now chatting with xek about https://logserver.rdoproject.org/74/35174/14/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039-master/a6684bc/job-output.txt16:42
ade_leerlandy|ruck, whenever you're ready17:04
rlandy|ruckade_lee: at half past the hour? 12:30 EST ok?17:07
ade_leerlandy|ruck, yup 17:07
ade_leerlandy|ruck, I'm chatting right now with rjeffman on ipa side , looking at what logs we have17:08
opendevreviewAlex Schultz proposed openstack/tripleo-quickstart-extras master: Enable IPA debug logging  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82406717:09
opendevreviewAndre Aranha proposed openstack/tripleo-validations stable/train: Add validation for tripleo-ipa  https://review.opendev.org/c/openstack/tripleo-validations/+/82421617:09
*** dviroel|lunch|errand is now known as dviroel17:18
opendevreviewRonelle Landy proposed openstack/tripleo-quickstart-extras master: Removing default NTP servers when not defined in job  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82418117:29
opendevreviewAndre Aranha proposed openstack/tripleo-validations stable/train: Add validation for tripleo-ipa  https://review.opendev.org/c/openstack/tripleo-validations/+/82421617:29
rlandy|ruckade_lee: https://meet.google.com/dht-verb-qib?pli=1&authuser=017:30
*** jpena is now known as jpena|off17:38
*** amoralej is now known as amoralej|off17:38
*** jcapitao is now known as jcapitao_off17:39
opendevreviewJohn Fulton proposed openstack/tripleo-ansible master: Import ceph_spec from tripleo-common  https://review.opendev.org/c/openstack/tripleo-ansible/+/82282917:45
opendevreviewJohn Fulton proposed openstack/python-tripleoclient master: Introduce "openstack overcloud ceph spec"  https://review.opendev.org/c/openstack/python-tripleoclient/+/82283517:51
opendevreviewAlex Schultz proposed openstack/tripleo-quickstart-extras master: Enable IPA debug logging  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82406718:01
Tengufultonj: heya! fyi, here's a small set of tools I'm using for the container copying/build: https://github.com/cjeanner/tripleo-tools18:41
Tengufultonj: note that, at least for the "container-copy", it generates a tripleo-lab container-prepare-override file :)18:42
fultonjTengu: thanks18:43
Tengufultonj: I'm currently fighting DIB in order to be able to build OC images from within a container.18:43
TenguI'm *that* close to a success - but it's hard to debug.18:43
fultonjif you're having trouble with containers the solution is to use them more, e.g. trouble building contianers? build the m with a container18:43
fultonj;)18:43
Tengufultonj: building container in container is a thing :). Building qcow2 images within a container is... currently failing due to weird issues.18:44
Tenguseems to be linked to mkfs.ext4 - but I suspect it has to do with the actual image itself and how it's presented.18:44
opendevreviewRonelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add entries to /etc/hosts - pool.ntp.org  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82406118:45
opendevreviewRonelle Landy proposed openstack/tripleo-ci master: Revert "Revert "Make standalone-ipa job non-voting during debug""  https://review.opendev.org/c/openstack/tripleo-ci/+/82415718:48
Tengurlandy|ruck: o_O isn't freeipa supposed to be an actual resolver? I mean, it's supposed to be ablet to resolve hosts once it's deployed... ??18:48
rlandy|ruckTengu: you just missed that fun dicsussion18:49
Tengurlandy|ruck: sorry :/. what was it about ?18:49
rlandy|ruckTengu: https://bugs.launchpad.net/tripleo/+bug/1957083 ... a couple issues in play18:50
Tenguthe LP doesn't provide much... sounds like a dns forwarder issue mostly?18:50
rlandy|rucksome providers are not resolving the NTP server host names18:51
rlandy|ruckcorrect - forwarder issue18:51
rlandy|rucktrying to determine why some requests are refused18:51
rlandy|ruck<ade_lee> rlandy|ruck, I'm chatting right now with rjeffman on ipa side , looking at what logs we hav18:51
Tenguhmm. iirc freeipa was an open recursive resolver, and I pushed a patch to lock that. Maybe that's part of the issue? Especially if it's running on a dedicated node.18:52
rlandy|ruckwe are moving the job back to non-voting to free up the gate18:52
Tengu'k18:52
opendevreviewJose Luis Franco proposed openstack/tripleo-heat-templates stable/wallaby: DNM: Test undercloud ffu wallaby upgrade.  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82396618:52
rlandy|ruckTengu: when was that?18:52
Tengurlandy|ruck: errr.... long time ago18:53
rlandy|ruckthe job only started failing again recently18:53
Tenguover a year I think.18:53
rlandy|ruckit's not you18:53
Tenguok. maybe an update broke it (again)18:53
TenguI decently decided to drop my freeIPA infra due to the oh-so-many issues it has..18:54
Tengus/decently/recently/18:54
TenguI meant : I recently decided to drop my freeIPA infra due to the oh-so-many issues it has..18:54
Tengu.... though it was a decent decision :D18:54
Tenguespecially with upgrades -_-18:54
rlandy|ruckissues were uncovered by mwhahaha's changes - but were there for a wheil18:54
rlandy|ruckwhile18:54
Tenguvalidations/checks are useless, let's drop them ;)18:55
Tenguidealy, we should scrap the content of the /etc/resolv.conf, extract the nameservers, and inject them as forwarder during the IPA install. Is this already the case?18:56
mwhahahaTengu: that's what we're doing,s omething else is happening18:58
Tengu(this should prevent provider blocking external DNS queries, for instance ;))18:58
Tenguhmmm. interesting$18:58
mwhahahawe're troubleshooting18:58
mwhahahai think it might be because of teh addresses the nodes get in those two providers causing ipa to dos omething differently18:58
mwhahahawe'll see18:59
Tengudo we have the logs in /var/log/dirsrv or something like that?18:59
mwhahahayes18:59
mwhahahathey are getting REFUSED in the query log18:59
mwhahahawe're working on it18:59
Tengubleh.18:59
TenguI'd be interested to know the outcome.19:06
Tenguespecially since a dig/host/ping apparently works when we don't use freeIPA dns service...19:06
fultonjMy depends-on chain doesn't work as I hoped https://zuul.opendev.org/t/openstack/build/427c945f8fb3491d8a9c83007b2eb47419:25
fultonjhttps://review.opendev.org/q/topic:%22ceph_spec%2219:25
fultonjpython-tripleoclient --> tripleo-ansible --> tripleo-common19:25
fultonjShould I update python-tripleoclient to directly depend on tripleo-common?19:25
mwhahahatripleo-common needs to be released for stuff to get picke dup19:26
fultonjso wait for https://review.opendev.org/c/openstack/tripleo-common/+/824203 to merge and promote before re-checking the other patches which need the library being moved to it?19:28
mwhahahathat'd need to be landed, released and a rev in tripleoclient requirements19:29
fultonjhttps://github.com/openstack/python-tripleoclient/blob/master/requirements.txt#L1419:31
fultonjmwhahaha: ok, thanks for explaining why i'm seeing this19:31
fultonjmwhahaha: i'd be curious if you think i'm on the right approach 19:32
fultonjhttps://review.opendev.org/q/topic:"ceph_spec"19:32
mwhahahawill check in a bit and comment as needed19:32
fultonjok, thanks19:32
fultonjbasically moving the lib to common so i can call it directly from the client instead of an ansible module which will be removed19:33
opendevreviewJakub Libosvar proposed openstack/tripleo-heat-templates master: README: Remove OVN row  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82422719:51
mwhahahafultonj: commented on tripleoclient patch but yea you need to land tripleo-common and release it first20:06
fultonjmwhahaha: ok, thanks20:12
mwhahahafultonj: https://review.opendev.org/c/openstack/python-tripleoclient/+/788737 you can also work around it with try/except20:14
mwhahahaso if you want to wait less20:14
mwhahahait's mostly to get the tox jobs to pass because those use pip and not rpms/latest20:15
fultonjso i'd have to try/except import it from tripleo-ansible 20:22
fultonjhttps://review.opendev.org/c/openstack/tripleo-ansible/+/822829/4/tripleo_ansible/ansible_plugins/module_utils/ceph_spec.py20:22
fultonji suppose i could try that20:22
fultonjand tripleo-ansible patches could do the same (if not common use your copy)20:23
mwhahahayou'd import from tripleo-common not tripleo-ansible but yea20:31
fultonjthe library is in tripleo-ansible today and moving to tripleo-common 20:31
mwhahahatripleo-ansible can't be imported in tripleoclient20:32
fultonjah so same problem20:32
opendevreviewRonelle Landy proposed openstack/tripleo-ci master: Make multinode-ipa non-voting  https://review.opendev.org/c/openstack/tripleo-ci/+/82423320:33
rlandy|ruckdviroel: ^^ submitted a clean patch20:34
dviroelack20:34
rlandy|rucklet's see if tox still objects20:34
mwhahahamine might had just needed a rebase20:34
rlandy|ruckrebased it20:40
mwhahahait was still failing?20:40
* mwhahaha goes looking20:41
rlandy|ruckstill failing20:41
rlandy|ruckdviroel: rcastillo|rover: ^^ ugh20:41
rlandy|ruck2022-01-11 20:41:05.046055 | primary | The offending line appears to be:20:41
rlandy|ruck2022-01-11 20:41:05.046077 | primary |20:41
rlandy|ruck2022-01-11 20:41:05.046112 | primary |   tasks:20:41
rlandy|ruck2022-01-11 20:41:05.046137 | primary |     - name: Destroy molecule instance(s)20:41
rlandy|ruck2022-01-11 20:41:05.046162 | primary |       ^ here20:41
mwhahahamissing docker module?20:42
rlandy|ruckhttps://zuul.opendev.org/t/openstack/stream/ff1a0ece0aa64d6399c8c5728358b215?logfile=console.log20:42
rlandy|ruckall of a sudden 20:42
mwhahahahttps://zuul.openstack.org/builds?job_name=tripleo-tox-molecule20:42
mwhahahastarted recently20:42
* mwhahaha bets release20:43
rlandy|ruckTengu: lada still downand CIX tool20:43
mwhahaharlandy|ruck: https://paste.opendev.org/show/812050/20:44
mwhahahaansible-compat-1.0.0 release20:44
mwhahahahttps://pypi.org/project/ansible-compat/#history20:44
mwhahaha4 hours ago20:44
mwhahaha*poof*20:44
rlandy|rucksounds about rights20:45
* rlandy|ruck gets rid of current patch20:45
rlandy|ruckwe need to lock those20:45
dviroelcan be ansible-compat20:45
dviroelbut still passing on my machine20:46
dviroelansible-compat==1.0.0 here20:46
rlandy|ruckyeah ... but zuul will update20:46
rlandy|ruckrcastillo|rover: dviroel: let's fix this ... 20:46
opendevreviewKevin Carter proposed openstack/python-tripleoclient master: [WIP] Add Ansible execution environment support  https://review.opendev.org/c/openstack/python-tripleoclient/+/77656420:46
mwhahahacloudnull: -^ did you lose a bet?20:47
cloudnulli just hate myself 20:47
mwhahahathe usual, got it20:47
opendevreviewKevin Carter proposed openstack/tripleo-common master: [WIP] Add Ansible execution environment  https://review.opendev.org/c/openstack/tripleo-common/+/77667420:50
opendevreviewRonelle Landy proposed openstack/tripleo-ci master: Make multinode-ipa non-voting  https://review.opendev.org/c/openstack/tripleo-ci/+/82423320:53
*** dviroel is now known as dviroel|afk21:15
opendevreviewdasm proposed openstack/tripleo-quickstart master: Add puppet-pacemaker to CentOS9 Wallaby job  https://review.opendev.org/c/openstack/tripleo-quickstart/+/82424121:19
opendevreviewMerged openstack/tripleo-docs master: Fixed duplicated word  https://review.opendev.org/c/openstack/tripleo-docs/+/82356221:31
rlandy|ruckrestarting CIX tool21:36
opendevreviewMerged openstack/tripleo-heat-templates stable/ussuri: Add chrony waitsync back in  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82251021:39
opendevreviewMerged openstack/tripleo-quickstart master: Fix ansible-lint and tox-molecule failures  https://review.opendev.org/c/openstack/tripleo-quickstart/+/82403721:39
opendevreviewMerged openstack/tripleo-heat-templates master: Add show all host_status policy to scn001  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81908021:39
opendevreviewMerged openstack/validations-common master: Bumping the ansible-lint version to 5.3.2 in order to resolve CI failure  https://review.opendev.org/c/openstack/validations-common/+/82408821:39
opendevreviewMerged openstack/tripleo-validations master: Bumping the ansible-lint version to 5.3.2 in order to resolve CI failure  https://review.opendev.org/c/openstack/tripleo-validations/+/82408921:39
opendevreviewMerged openstack/tripleo-heat-templates stable/wallaby: Enable enable_proxy_headers_parsing in Designate API  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82336821:39
opendevreviewMerged openstack/tripleo-quickstart-extras master: set NovaLibvirtNumPciePorts to 12  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82234421:39
opendevreviewMerged openstack/tripleo-heat-templates master: Update cell0 db connection, if required  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82123021:39
opendevreviewMerged openstack/tripleo-upgrade stable/wallaby: Fix services stack export to respect overcloud stack name  https://review.opendev.org/c/openstack/tripleo-upgrade/+/82402121:40
opendevreviewMerged openstack/tripleo-heat-templates stable/train: Remove ganesha_vip extra config workaround  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82375021:40
opendevreviewMerged openstack/tripleo-heat-templates stable/train: [train,ussuri] Set cinder's __DEFAULT__ vol type description  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82400121:40
opendevreviewMerged openstack/tripleo-heat-templates master: Disable metrics_qdr binding in HAProxyEdge  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82414521:40
opendevreviewMerged openstack/tripleo-validations stable/wallaby: Bumping the ansible-lint version to 5.3.2 in order to resolve CI failure  https://review.opendev.org/c/openstack/tripleo-validations/+/82411121:40
opendevreviewMerged openstack/tripleo-validations stable/wallaby: Optimize linters executions from tox and pre-commit  https://review.opendev.org/c/openstack/tripleo-validations/+/82105921:40
opendevreviewMerged openstack/tripleo-validations stable/wallaby: Use centos-8 stream for molecule jobs  https://review.opendev.org/c/openstack/tripleo-validations/+/82106021:40
opendevreviewMerged openstack/tripleo-validations stable/wallaby: undercloud-debug validation documentation improvement  https://review.opendev.org/c/openstack/tripleo-validations/+/82363521:40
opendevreviewMerged openstack/python-tripleoclient master: Use Python3 yoga unit tests  https://review.opendev.org/c/openstack/python-tripleoclient/+/82168121:40
mwhahaharlandy|ruck: is job.consumer_job used to determine if there's a content provider?21:45
opendevreviewRonelle Landy proposed openstack/tripleo-ci master: Lock versions of ansible-compat and identify  https://review.opendev.org/c/openstack/tripleo-ci/+/82424621:55
rlandy|ruckdasm: mwhahaha: ^^ wil rebase the revert patch on that21:56
rlandy|ruckmwhahaha: ack - of it's using a content provider21:56
rlandy|ruckif21:56
* rlandy|ruck gets rid of combination test patch21:57
dasmthanks21:57
opendevreviewMerged openstack/tripleo-repos master: yum-config compose-repos generation improvements  https://review.opendev.org/c/openstack/tripleo-repos/+/81936422:08
opendevreviewRonelle Landy proposed openstack/tripleo-ci master: Lock versions of ansible-compat and identify  https://review.opendev.org/c/openstack/tripleo-ci/+/82424622:16
opendevreviewAlex Schultz proposed openstack/tripleo-quickstart-extras master: Enable unbound as a dns source on the provider node  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82424822:21
mwhahaharlandy|ruck: -^ i think those are updates to needed to make the provider node an dns resolver, we'll see what ci kicks out22:22
rlandy|ruckmwhahaha: k - will watch22:23
rlandy|ruckmwhahaha: you ok with https://review.opendev.org/c/openstack/tripleo-ci/+/824246/ before I rebase the revert patch on it?22:33
mwhahahayea22:34
mwhahahait works for temporary stuff22:34
mwhahahawill need to figure out how to lift those restrictions later22:34
rlandy|ruckok22:35
opendevreviewOliver Walsh proposed openstack/tripleo-heat-templates stable/wallaby: Disable metrics_qdr binding in HAProxyEdge  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82425022:35
opendevreviewJulia Kreger proposed openstack/tripleo-heat-templates master: Add ironic-inspector TLS endpoint port to be reachable  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82425122:37
opendevreviewOliver Walsh proposed openstack/tripleo-heat-templates stable/victoria: Disable metrics_qdr binding in HAProxyEdge  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82425222:37
opendevreviewOliver Walsh proposed openstack/tripleo-heat-templates stable/ussuri: Disable metrics_qdr binding in HAProxyEdge  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82425322:38
opendevreviewOliver Walsh proposed openstack/tripleo-heat-templates stable/train: Disable metrics_qdr binding in HAProxyEdge  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82425422:38
opendevreviewRonelle Landy proposed openstack/tripleo-ci master: Revert "Revert "Make standalone-ipa job non-voting during debug""  https://review.opendev.org/c/openstack/tripleo-ci/+/82415722:39
opendevreviewAlex Schultz proposed openstack/tripleo-quickstart-extras master: Enable unbound as a dns source on the provider node  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82424822:45
*** dasm is now known as dasm|off22:52
mwhahaharlandy|ruck: so my test job did manage to get the ipa job to fail with increased logging https://e1b4a000abb204735f68-a5eaa5fff2c515ea49b3535d0a4d47d3.ssl.cf1.rackcdn.com/824067/7/check/tripleo-ci-centos-8-standalone-on-multinode-ipa/caa004b/logs/149.202.179.165/var/named/data/index.html22:52
mwhahaha11-Jan-2022 20:23:09.076 debug 3: client @0x7f7bb01abae0 149.202.162.152#54524: recursion not available22:53
mwhahahaseems like a bad config somewhere22:53
rlandy|rucklooking22:54
mwhahahathat one had --forwarder-policy first too22:54
rlandy|ruckso strange - considering what we heard today22:55
mwhahahapretty much22:55
rlandy|ruckade_lee: ^^ so here we are again22:55
mwhahahathat was an ovh node22:55
mwhahahai feel like this is going to be a battle all week22:56
* mwhahaha sighs22:56
mwhahahawell if we can limit it to a week, it'll be great :D22:56
rlandy|ruckI thought you were going to day the debug job passed22:57
rlandy|ruckat least there is a fail22:57
mwhahahait usually passes :D22:57
rlandy|ruckcan we force the setting?22:57
mwhahahathe patch does22:58
rlandy|ruck --forwarder-policy22:58
mwhahahait forced it to only22:58
rlandy|ruckoh right22:58
mwhahahahttps://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82406722:58
mwhahahawonder if it needs to be first22:58
mwhahahahttps://www.freeipa.org/page/V4/Forward_zones#Forward_Policy for reference22:58
mwhahahaunfortunately that patches doesnt' have my collect-logs patch to grab the state of ipa22:59
ade_leemwhahaha, hmm .. sorry gotta head out - but I'll forward this to rjeffman23:00
rlandy|ruckbefore forwarders?23:01
ade_leemwhahaha, rlandy|ruck rjeffman looking at logs23:03
*** dviroel|afk is now known as dviroel23:05
opendevreviewAlex Schultz proposed openstack/tripleo-quickstart-extras master: Enable IPA debug logging  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82406723:07
opendevreviewAlex Schultz proposed openstack/tripleo-quickstart-extras master: Enable unbound as a dns source on the provider node  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82424823:07
opendevreviewAlex Schultz proposed openstack/tripleo-heat-templates master: [DNM] Troubleshooting ntp & ipa stuff  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82406923:09
*** dviroel is now known as dviroel|out23:10
opendevreviewRonelle Landy proposed openstack/tripleo-quickstart-extras master: WIP: Add entries to /etc/hosts - pool.ntp.org  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82406123:12
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Cinder: Remove support for deprecated Dell EMC volume drivers  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82390823:25
opendevreviewTakashi Kajinami proposed openstack/puppet-tripleo master: Cinder: Clean up deprecated Dell EMC volume drivers  https://review.opendev.org/c/openstack/puppet-tripleo/+/82391123:26
opendevreviewBrent Eagles proposed openstack/tripleo-ansible master: Add logging configuration for designate bind  https://review.opendev.org/c/openstack/tripleo-ansible/+/82398923:34
opendevreviewMerged openstack/python-tripleoclient master: Remove additional patching to use gitpython with eventlet  https://review.opendev.org/c/openstack/python-tripleoclient/+/82178423:40
ade_leemwhahaha, rlandy|ruck feedback from rjeffman23:40
ade_lee<rjeffman> It seems the host is under OVH cloud (149.202.179 network).23:40
ade_lee<rjeffman> After (circa) 11-Jan-2022 20:07:38.610 all queries seem to be redirected to 149.202.179.165, which seems to be a nameserver under OVH.23:40
ade_lee<rjeffman> SOA for these IPs is dns111.ovh.net (213.251.188.155)23:40
ade_lee<rjeffman> (this IP is provided TO ME, probably due to LACNIC being in the 'dig +trace', I'm not sure you'll se the same) 23:40
ade_lee<ade_lee> ok ..23:40
ade_lee<rjeffman> so, I can contact ds111.ovh.net, but every request returns "recursion not available".23:40
ade_lee<rjeffman> now, why is this nameserver being used, I don't know.23:40
mwhahahawonder if they capture all dns requests at a networking level23:41
mwhahahaout of the cloud to prevent the cloud requests from doing bad things23:41
mwhahahai guess i'll try some more debug stuff tomorrow23:42
ade_leeack23:44
ade_leemwhahaha, I'll ley rjeffman know in case we need more help23:45
mwhahahayea thanks. at least we've got some more debugging.  should we be using only or first for the policy23:45
mwhahahawasn't sure which was more appropriate. that one has 'only' defined23:45
ade_leemwhahaha, rjeffman> for low traffic, it shouldn't matter.23:47
mwhahahak23:47
ade_leehasta manana then ..23:48
* mwhahaha flips tables and gives up23:49

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!