Friday, 2022-01-14

*** ysandeep|out is now known as ysandeep00:39
opendevreviewSteve Baker proposed openstack/diskimage-builder master: Make grub2-switch-to-blscfg explicit about efi  https://review.opendev.org/c/openstack/diskimage-builder/+/82465901:03
opendevreviewSteve Baker proposed openstack/diskimage-builder master: Fixes for centos-9-stream efi behaviour  https://review.opendev.org/c/openstack/diskimage-builder/+/82466001:03
ysandeepstevebaker[m], thanks for your review https://review.opendev.org/c/openstack/tripleo-common/+/824598 , this looks wrong as well then https://github.com/openstack/tripleo-common/blob/master/image-yaml/overcloud-images-rhel8.yaml#L8 01:16
stevebaker[m]ysandeep: yes it does, overcloud-hardened-images-uefi-rhel8.yaml does the right thing01:19
ysandeepstevebaker[m], thanks! I will fix rhel8 in a separate patch , one small query here: https://review.opendev.org/c/openstack/tripleo-common/+/824598/1/image-yaml/overcloud-images-rhel9.yaml#22 01:21
ysandeepstevebaker[m], ++ thanks!01:23
stevebaker[m]ysandeep: replied. having the centos images enforcing would be an aspirational thing to go for. If only Cedric was around to share an opinion01:24
opendevreviewSandeep Yadav proposed openstack/tripleo-common master: Add configs for RHEL 9 image  https://review.opendev.org/c/openstack/tripleo-common/+/82459801:25
ysandeepstevebaker[m], nice , just in images or everywhere in our tripleo upstream jobs? :D01:26
stevebaker[m]ysandeep: heh, good question01:27
ysandeepI thought there was some reason we don't enable selinux in upstream job, but couldn't recall at this moment. 01:31
opendevreviewSteve Baker proposed openstack/diskimage-builder master: Make grub2-switch-to-blscfg explicit about efi  https://review.opendev.org/c/openstack/diskimage-builder/+/82465901:33
opendevreviewSteve Baker proposed openstack/diskimage-builder master: Fixes for centos-9-stream efi behaviour  https://review.opendev.org/c/openstack/diskimage-builder/+/82466001:33
opendevreviewSandeep Yadav proposed openstack/tripleo-common master: Remove selinux-permissive from rhel8 image  https://review.opendev.org/c/openstack/tripleo-common/+/82466201:33
*** rlandy|ruck|bbl is now known as rlandy|ruck01:51
*** rlandy|ruck is now known as rlandy|out01:57
*** ysandeep is now known as ysandeep|afk02:05
*** artom__ is now known as artom02:07
opendevreviewMerged openstack/tripleo-ci master: Makes tripleo-ci-centos-9-standalone-on-multinode-ipa non voting in check  https://review.opendev.org/c/openstack/tripleo-ci/+/82436402:44
opendevreviewMerged openstack/tripleo-heat-templates stable/wallaby: Move ephemeral heat upgrade to the service  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82453202:44
opendevreviewMerged openstack/tripleo-heat-templates stable/wallaby: Add ephemeral Heat entry to clouds.yaml  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82453102:44
opendevreviewMerged openstack/tripleo-upgrade master: Fast and furious upgrade  https://review.opendev.org/c/openstack/tripleo-upgrade/+/82453302:44
opendevreviewSteve Baker proposed openstack/diskimage-builder master: Fixes for centos-9-stream efi behaviour  https://review.opendev.org/c/openstack/diskimage-builder/+/82466003:44
opendevreviewSteve Baker proposed openstack/diskimage-builder master: Make grub2-switch-to-blscfg explicit about efi  https://review.opendev.org/c/openstack/diskimage-builder/+/82465903:44
opendevreviewMerged openstack/tripleo-validations master: Remove pre-deployment validation  https://review.opendev.org/c/openstack/tripleo-validations/+/82031404:29
opendevreviewMerged openstack/tripleo-ci master: Set ping_group_range  https://review.opendev.org/c/openstack/tripleo-ci/+/82463505:58
opendevreviewamolkahat proposed openstack/tripleo-ci master: [DNM][WIP] Use release file for C8  https://review.opendev.org/c/openstack/tripleo-ci/+/82368806:15
opendevreviewamolkahat proposed openstack/tripleo-ci master: CentOS-9 build containers base job  https://review.opendev.org/c/openstack/tripleo-ci/+/82085206:24
opendevreviewJose Luis Franco proposed openstack/tripleo-heat-templates stable/wallaby: DNM: Test undercloud ffu wallaby upgrade.  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82396607:02
*** pmannidi is now known as pmannidi|brb07:39
opendevreviewFrancesco Pantano proposed openstack/tripleo-common master: Split off Ceph related container images  https://review.opendev.org/c/openstack/tripleo-common/+/82443107:46
opendevreviewFrancesco Pantano proposed openstack/tripleo-common master: Split off Ceph related container images  https://review.opendev.org/c/openstack/tripleo-common/+/82443108:03
opendevreviewFrancesco Pantano proposed openstack/tripleo-specs master: Introduce TripleO Ceph Ingress Integration  https://review.opendev.org/c/openstack/tripleo-specs/+/82414608:03
*** jpena|off is now known as jpena08:10
opendevreviewmbu proposed openstack/python-tripleoclient master: Exposes the community validation init command  https://review.opendev.org/c/openstack/python-tripleoclient/+/82354308:10
opendevreviewmbu proposed openstack/python-tripleoclient master: Exposes the community validation init command  https://review.opendev.org/c/openstack/python-tripleoclient/+/82354308:11
opendevreviewmbu proposed openstack/python-tripleoclient master: Exposes the community validation init command  https://review.opendev.org/c/openstack/python-tripleoclient/+/82354308:11
*** ysandeep|afk is now known as ysandeep08:19
opendevreviewAnanya proposed openstack/openstack-tempest-skiplist master: Adding periodic-tripleo-ci-centos-9-ovb-1ctlr_2comp-featureset020-master to existing neutron tests  https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/82467708:19
opendevreviewFrancesco Pantano proposed openstack/tripleo-common master: Split off Ceph related container images  https://review.opendev.org/c/openstack/tripleo-common/+/82443108:21
opendevreviewAnanya proposed openstack/tripleo-ci master: Removing tripleo-ci-centos-7-containers-multinode from gate and making it non voting  https://review.opendev.org/c/openstack/tripleo-ci/+/82460608:25
opendevreviewJose Luis Franco proposed openstack/tripleo-ci master: WIP: Add undercloud-ffu-wallaby job.  https://review.opendev.org/c/openstack/tripleo-ci/+/82271608:44
opendevreviewJose Luis Franco proposed openstack/tripleo-quickstart-extras master: Adapt standalone-upgrade to run tripleo operator  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81755208:48
opendevreviewJiri Podivin proposed openstack/python-tripleoclient stable/ussuri: Fix the validations_log_basedir overriding  https://review.opendev.org/c/openstack/python-tripleoclient/+/82364308:51
opendevreviewMerged openstack/tripleo-heat-templates master: Enable policy rule management in nova-compute  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82299209:46
opendevreviewGregory Thiemonge proposed openstack/tripleo-ansible master: Disable gateway for Octavia management subnet  https://review.opendev.org/c/openstack/tripleo-ansible/+/82468809:47
opendevreviewMarios Andreou proposed openstack/openstack-tempest-skiplist master: Add fs1 centos 9 to tempest.api.compute tests skip for bug  https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/82468909:48
*** ysandeep is now known as ysandeep|afk09:51
opendevreviewTakashi Kajinami proposed openstack/puppet-tripleo stable/wallaby: Enable policy rule management in nova-compute  https://review.opendev.org/c/openstack/puppet-tripleo/+/82469009:54
opendevreviewJiri Podivin proposed openstack/validations-libs master: Validation actions refactor  https://review.opendev.org/c/openstack/validations-libs/+/80290110:06
*** chem is now known as Guest55010:20
opendevreviewJose Luis Franco proposed openstack/python-tripleoclient stable/wallaby: Write clouds.yaml/heatrc for tripleo launch heat  https://review.opendev.org/c/openstack/python-tripleoclient/+/82462410:25
*** ysandeep|afk is now known as ysandeep10:42
*** arxcruz|ruck is now known as arxcruz11:13
opendevreviewMerged openstack/python-tripleoclient master: Guard against NoneType  https://review.opendev.org/c/openstack/python-tripleoclient/+/82459111:13
*** dviroel|out is now known as dviroel11:21
*** rlandy|out is now known as rlandy|ruck11:25
opendevreviewMerged openstack/openstack-tempest-skiplist master: Adding periodic-tripleo-ci-centos-9-ovb-1ctlr_2comp-featureset020-master to existing neutron tests  https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/82467711:27
opendevreviewJose Luis Franco proposed openstack/python-tripleoclient stable/wallaby: Write clouds.yaml/heatrc for tripleo launch heat  https://review.opendev.org/c/openstack/python-tripleoclient/+/82462411:27
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/train: [Train-Only] Instruct container-status validation to accept 137, 142 and 143 exit code status  https://review.opendev.org/c/openstack/tripleo-validations/+/82469311:30
*** ysandeep is now known as ysandeep|afk11:40
opendevreviewMerged openstack/tripleo-common master: Remove remove-machine-id element  https://review.opendev.org/c/openstack/tripleo-common/+/82409211:55
*** anbanerj is now known as frenzyfriday|ruck12:02
*** jcapitao is now known as jcapitao_lunch12:03
opendevreviewFrancesco Pantano proposed openstack/tripleo-docs master: Split off Ceph related container images  https://review.opendev.org/c/openstack/tripleo-docs/+/82470412:20
opendevreviewFrancesco Pantano proposed openstack/tripleo-heat-templates master: Add CephIngress resource  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82445912:24
rlandy|ruckxek: hi .. do you have core merge rights on https://review.opendev.org/c/openstack/keystone-tempest-plugin/+/74057212:25
arxcruzlbragstad: ^12:25
rlandy|ruckblocking our wallaby  c9 tests12:25
xekrlandy|ruck, no, I guess we have to wait for Lance or Gage12:28
opendevreviewMerged openstack/tripleo-validations master: Make sure fact is available to find hostname  https://review.opendev.org/c/openstack/tripleo-validations/+/82374612:29
arxcruzade_lee: do you have core rights ? ^12:30
*** holser is now known as holser_12:35
*** ysandeep|afk is now known as ysandeep12:41
rlandy|ruckxek: thanks arxcruz is chasing this down12:43
opendevreviewAnanya proposed openstack/tripleo-quickstart-extras master: Removing install epel-release from deploy freeIPA command  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82470512:48
*** amoralej is now known as amoralej|lunch13:06
opendevreviewMerged openstack/tripleo-ci master: Add C9 multinode jobs to gate queue and voting  https://review.opendev.org/c/openstack/tripleo-ci/+/82417613:15
opendevreviewMerged openstack/tripleo-ci master: Add C9 deployment image build jobs to gate queue and voting  https://review.opendev.org/c/openstack/tripleo-ci/+/82417713:15
*** rcastillo|rover is now known as rcastillo13:23
rlandy|ruckjpodivin: https://review.opendev.org/c/openstack/tripleo-validations/+/823747/ - legit tox error on validations or can just recheck?13:28
jpodivinrlandy|ruck: Let me see.13:28
jpodivinrlandy|ruck: this seems to be on the ansible-galaxy side. 13:30
rlandy|ruckjpodivin: k  - will recheck13:31
jpodivinrlandy|ruck: the url appears to be accessible now, so it should work.13:32
*** dasm|off is now known as dasm13:32
opendevreviewFrancesco Pantano proposed openstack/tripleo-common master: Split off Ceph related container images  https://review.opendev.org/c/openstack/tripleo-common/+/82443113:32
cloudnullmornings 13:42
striderjpodivin, rlandy|ruck: FYI, yesterday i've got the same issue while running the molecule locally on my laptop .. during my evening13:44
rlandy|ruckstrider: k - so let's see if it's corrected now or not13:54
* rlandy|ruck doesn;t want to blindly recheck13:54
*** amoralej|lunch is now known as amoralej14:01
opendevreviewJose Luis Franco proposed openstack/tripleo-ci master: WIP: Add undercloud-ffu-wallaby job.  https://review.opendev.org/c/openstack/tripleo-ci/+/82271614:04
opendevreviewJiri Podivin proposed openstack/validations-libs master: Removing pathlib  https://review.opendev.org/c/openstack/validations-libs/+/82460314:05
opendevreviewJose Luis Franco proposed openstack/tripleo-heat-templates stable/wallaby: DNM: Test undercloud ffu wallaby upgrade.  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82396614:05
*** ysandeep is now known as ysandeep|brb14:07
*** holser_ is now known as holser14:12
*** ysandeep|brb is now known as ysandeep14:16
*** holser is now known as holser_14:24
*** rlandy|ruck is now known as rlandy|ruck|brb14:28
opendevreviewJose Luis Franco proposed openstack/tripleo-heat-templates stable/victoria: DNM: Test standalone-upgrade job.  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81771814:30
opendevreviewJose Luis Franco proposed openstack/tripleo-heat-templates stable/ussuri: DNM: Test standalone-upgrade ussuri job.  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82249314:30
opendevreviewJose Luis Franco proposed openstack/tripleo-heat-templates stable/wallaby: DNM: Test standalone-upgrade wallaby.  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82249514:30
ade_leearxcruz, to validations , no14:36
ade_leearxcruz, oh, to keystone-tempest-plugin - no either :/14:37
mwhahaharlandy|ruck|brb: https://bugzilla.redhat.com/show_bug.cgi?id=2037807 jfyi the fix went into systemd so that likely may promote soonish14:41
fultonj_My tripleo-common patch has merged. How do I find out when it will be promoted?14:41
fultonj_https://review.opendev.org/c/openstack/tripleo-common/+/82420314:41
fultonj_I ask because I have something blocked until then14:41
fultonj_https://review.opendev.org/q/topic:%22ceph_spec%22+(status:open%20OR%20status:merged)14:41
*** fultonj_ is now known as fultonj14:42
mwhahahafultonj_: you shouldn't have to wait for a promotion, a release is needed14:42
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations master: Instruct container-status validation to accept 137, 142 and 143 exit code status  https://review.opendev.org/c/openstack/tripleo-validations/+/82472014:43
fultonjmwhahaha: how do i figure out when a release will be?14:43
mwhahahayou create a PR against openstack/releases and get slagle to +114:43
* fultonj looks for an example of such a PR14:45
fultonjhttps://github.com/openstack/releases/commits/master14:45
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/wallaby: Instruct container-status validation to accept 137, 142 and 143 exit code status  https://review.opendev.org/c/openstack/tripleo-validations/+/82462514:45
*** rlandy|ruck|brb is now known as rlandy|ruck14:45
mwhahahafultonj: https://review.opendev.org/c/openstack/releases/+/78829314:46
rlandy|ruckmwhahaha: nice that the BZ got some attention14:46
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/victoria: Instruct container-status validation to accept 137, 142 and 143 exit code status  https://review.opendev.org/c/openstack/tripleo-validations/+/82462614:46
cloudnullhas anyone run through a full deployment using pre-deployed (no ironic|metalsmith) nodes (off master)?14:46
fultonjcloudnull: not in 2 years14:47
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/ussuri: Instruct container-status validation to accept 137, 142 and 143 exit code status  https://review.opendev.org/c/openstack/tripleo-validations/+/82462714:47
cloudnullsame ... 14:47
fmountfultonj: in theory it's quickstart importing packages from rdo14:47
fmountso ... you should look https://trunk.rdoproject.org/centos8-master/report.html14:47
fmountand see if the new build is present ^14:48
fultonjfmount: ah so i see the 2022-01-14 openstack-tripleo-common hash has my patch14:50
fultonjhttps://github.com/openstack/tripleo-common/commits/master14:51
fultonjso i put in a review requesting that has get a release number14:51
fultonjso i put in a review requesting that HASH get a release number14:51
* fultonj gets a clue14:52
fultonjthanks mwhahaha 14:53
slaglecloudnull: i have about a month back14:55
cloudnullslagle did you happen to get it working?14:55
slagleyea :)14:56
slaglecloudnull: my templates: https://github.com/slagle/tripleo/tree/master/environments/master-upshift14:56
cloudnullwhat if anything did you have to do to make networking happy? following https://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/features/deployed_server.html doesn't seem to go. 14:57
slagledeployrc file in that dir is my list of environments. that rc file is used to control scripts/deploy.sh in that same repo, but you don't need to use that14:57
slaglecloudnull: it's all there in that repo. I did use this: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81891514:58
slaglebut you can right that manually if you want14:58
slagle*write14:59
slagleotherwise, reviews welcome :)14:59
cloudnullI think that template is my missing link 14:59
slaglethat stuff is documented in deployed_server.html, but I wrote that stuff manually15:00
slaglethen I went back and did the patch to generate DeployedNetworkEnvironment from network_data.yaml15:01
slagleonce that's merged, we can update the docs to reference that15:01
*** dkehn_ is now known as dkehn15:02
cloudnullhttps://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/features/deployed_server.html#without-generated-environments-no-neutron - this seems wrong, especially comparing with what you have in the repo.15:03
cloudnullat a minimum https://review.opendev.org/c/openstack/tripleo-heat-templates/+/824588/1/environments/deployed-networks.yaml - is broken. 15:03
cloudnullunless we have the path wrong in the package -- "/usr/share/openstack-tripleo-heat-templates/network/deployed_networks.yaml" ?15:05
slaglelooks like a typo. it's right in my other patch15:08
cloudnullyup yup 15:13
opendevreviewJohn Fulton proposed openstack/python-tripleoclient master: Add --standalone to overcloud ceph user and deploy  https://review.opendev.org/c/openstack/python-tripleoclient/+/82472515:20
*** ysandeep is now known as ysandeep|out15:25
*** dviroel is now known as dviroel|lunch15:33
opendevreviewJohn Fulton proposed openstack/tripleo-docs master: Switch standalone scenario to use deployed ceph  https://review.opendev.org/c/openstack/tripleo-docs/+/82449215:52
*** holser_ is now known as holser15:58
*** dviroel|lunch is now known as dviroel|16:46
*** dviroel| is now known as dviroel16:46
*** marios is now known as marios|out16:47
opendevreviewDouglas Viroel proposed openstack/tripleo-quickstart-extras master: Removing install epel-release from deploy freeIPA command  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82470517:00
opendevreviewMerged openstack/tripleo-validations stable/train: [Train-Only] Instruct container-status validation to accept 137, 142 and 143 exit code status  https://review.opendev.org/c/openstack/tripleo-validations/+/82469317:10
*** jpena is now known as jpena|off17:24
opendevreviewJohn Fulton proposed openstack/python-tripleoclient master: Add --standalone to overcloud ceph user and deploy  https://review.opendev.org/c/openstack/python-tripleoclient/+/82472517:24
*** amoralej is now known as amoralej|off17:33
opendevreviewJohn Fulton proposed openstack/tripleo-ansible master: Add tripleo_cephadm_standalone boolean  https://review.opendev.org/c/openstack/tripleo-ansible/+/82474417:47
opendevreviewRonelle Landy proposed openstack/openstack-tempest-skiplist master: DNM: Testing unskip  nova test c9  https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/82474917:56
opendevreviewJohn Fulton proposed openstack/tripleo-ansible master: Add tripleo_cephadm_standalone boolean  https://review.opendev.org/c/openstack/tripleo-ansible/+/82474418:00
opendevreviewJohn Fulton proposed openstack/tripleo-ansible master: Add tripleo_cephadm_standalone boolean  https://review.opendev.org/c/openstack/tripleo-ansible/+/82474418:02
opendevreviewJohn Fulton proposed openstack/python-tripleoclient master: Add --standalone to overcloud ceph user and deploy  https://review.opendev.org/c/openstack/python-tripleoclient/+/82472518:05
opendevreviewJohn Fulton proposed openstack/tripleo-docs master: Switch standalone scenario to use deployed ceph  https://review.opendev.org/c/openstack/tripleo-docs/+/82449218:08
renichgood day! 0/18:09
renichI have an undercloud with RHOSP 16.2. It started failing suddenly and I cannot pinpoint the cause. openstack undercloud install doesn't work anymore. https://paste.openstack.org/show/bM02e0EUQXuYXIQHCX3I/18:10
renichIt is not the full log but part of it. The facter issue repeats a lot.18:10
opendevreviewJohn Fulton proposed openstack/tripleo-docs master: Switch standalone scenario to use deployed ceph  https://review.opendev.org/c/openstack/tripleo-docs/+/82449218:26
opendevreviewMerged openstack/tripleo-heat-templates master: Make sure libvirt guests shut down before network  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82230918:38
opendevreviewMerged openstack/diskimage-builder master: Use https for base centos image download  https://review.opendev.org/c/openstack/diskimage-builder/+/82464718:48
opendevreviewDouglas Viroel proposed openstack/tripleo-quickstart-extras master: Update freeipa setup scripts for CentOS Stream 9  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82470518:49
opendevreviewRonelle Landy proposed openstack/tripleo-quickstart master: DNM: Testing bug 1957060 - downgraded libvirt  https://review.opendev.org/c/openstack/tripleo-quickstart/+/82477518:59
rlandy|rucklooking into the c9 provider gate failures19:09
opendevreviewMerged openstack/tripleo-validations stable/victoria: Optimize linters executions from tox and pre-commit  https://review.opendev.org/c/openstack/tripleo-validations/+/82410719:17
opendevreviewMerged openstack/tripleo-validations stable/victoria: Use centos-8 stream for molecule jobs  https://review.opendev.org/c/openstack/tripleo-validations/+/82410819:17
opendevreviewMerged openstack/tripleo-validations stable/ussuri: Optimize linters executions from tox and pre-commit  https://review.opendev.org/c/openstack/tripleo-validations/+/82413419:17
opendevreviewMerged openstack/tripleo-validations stable/train: Optimize linters executions from tox and pre-commit  https://review.opendev.org/c/openstack/tripleo-validations/+/82413819:17
opendevreviewMerged openstack/tripleo-validations stable/train: Use centos-8 stream for molecule jobs  https://review.opendev.org/c/openstack/tripleo-validations/+/82413919:17
opendevreviewMerged openstack/tripleo-heat-templates master: Reduce frequency of task retries  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82286119:24
rlandy|ruckhttps://bugs.launchpad.net/tripleo/+bug/1957950 - confirmed mirror sync issue19:35
opendevreviewAlex Schultz proposed openstack/tripleo-quickstart-extras master: Enable unbound as a dns source on the provider node  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82424819:44
opendevreviewMerged openstack/diskimage-builder master: enable cloud-init by default on systemd  https://review.opendev.org/c/openstack/diskimage-builder/+/82222919:47
opendevreviewAlex Schultz proposed openstack/tripleo-ansible master: Fix virtual host for image-serve  https://review.opendev.org/c/openstack/tripleo-ansible/+/82479420:31
opendevreviewMerged openstack/python-tripleoclient stable/wallaby: Write clouds.yaml/heatrc for tripleo launch heat  https://review.opendev.org/c/openstack/python-tripleoclient/+/82462420:50
opendevreviewDouglas Viroel proposed openstack/tripleo-quickstart-extras master: Update freeipa setup scripts for CentOS Stream 9  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82470520:51
*** dviroel is now known as dviroel|out20:57
opendevreviewdasm proposed openstack/tripleo-heat-templates stable/wallaby: Set default for network.ip_subnet  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82479921:14
opendevreviewJohn Fulton proposed openstack/tripleo-ansible master: Import ceph_spec from tripleo-common  https://review.opendev.org/c/openstack/tripleo-ansible/+/82282921:21
opendevreviewJohn Fulton proposed openstack/python-tripleoclient master: Introduce "openstack overcloud ceph spec"  https://review.opendev.org/c/openstack/python-tripleoclient/+/82283521:23
opendevreviewJohn Fulton proposed openstack/python-tripleoclient master: Introduce "openstack overcloud ceph spec"  https://review.opendev.org/c/openstack/python-tripleoclient/+/82283521:25
opendevreviewJohn Fulton proposed openstack/python-tripleoclient master: Add --standalone to overcloud ceph user and deploy  https://review.opendev.org/c/openstack/python-tripleoclient/+/82472521:25
opendevreviewJohn Fulton proposed openstack/tripleo-ansible master: Import ceph_spec from tripleo-common  https://review.opendev.org/c/openstack/tripleo-ansible/+/82282921:27
opendevreviewJohn Fulton proposed openstack/tripleo-ansible master: Add tripleo_cephadm_standalone boolean  https://review.opendev.org/c/openstack/tripleo-ansible/+/82474421:27
opendevreviewMerged openstack/tripleo-validations master: Remove check for certmonger user service  https://review.opendev.org/c/openstack/tripleo-validations/+/82374721:44
*** dasm is now known as dasm|off21:46
renichBTW, problem fixed. This was the workaround that fixed it: https://bugzilla.redhat.com/show_bug.cgi?id=1803198#c5. 21:53
renichIt was supposedly fixed but it still happens on a private cloud; in RHOSP 16.2. 21:53
mwhahaharenich: that shouldn't be happening anymore for a long time. it would be good to open a bz with logs22:25
mwhahaharenich: also i don't see any failures in that paste you profided. factor errors are generally non-fatal22:26
renichmwhahaha, I have a case open. Probably the red hat engineer will follow up. I've provided all kinds of info. 22:27
mwhahahawell if it makes it to a bz it'll come to me which is why i asked22:27
mwhahahabut i didn't see anything fatal in that paste22:28
*** holser is now known as holser_22:29
renichmwhahaha, OK. It was a partial. What I can say is that the re-deploy never finished until I applied the workaround. It seems to me that this fix needs fixing: https://bugzilla.redhat.com/show_bug.cgi?id=1803198.22:49
mwhahahathat's already in 16 which is why i asked for more logs22:49
renichI don't recall if I mentioned this but this has happened to me 3 times already; without an apparent cause. 22:49
renichi can provide them if you like. Let me know how. 22:49
mwhahahathey they are in a case do you have teh #?22:50
mwhahahaspecifically that bz is https://review.opendev.org/c/openstack/tripleo-heat-templates/+/72932622:50
renichmwhahaha, https://access.redhat.com/support/cases/#/case/0312454722:50
mwhahahawhich is already in train for ~2 years now22:50
mwhahahaand we haven't had any more reports around that 22:51
renichI have a sos report and other files there.22:51
renichodd... what might I've done wrong, I wonder?22:51
mwhahahadonno i'll look at the logs22:51
renichmwhahaha, thank you, very much! :D22:52
mwhahahawhat used to happen is that you'd get left over files and end up with bad perms22:52
mwhahahabut it never happened on the undercloud, always overcloud22:52
renichmwhahaha, OK. The thing is, I'll re-deploy, forget about it for a month, do some re-deploy and it happens again.22:52
renichThat's the odd part.22:52
mwhahahayea that shouldn't be a thing but we'll see what the logs say22:53
renichmwhahaha, cool :D22:53
mwhahaharenich: tls everywhere?22:59
renichmwhahaha, no. We have a self-signed CA and stuff.22:59
*** holser_ is now known as holser23:05
mwhahaharenich: weird i don't see anything that would cause this. I'll poke some more next week. The only thing i could think off is that the time sync is off between when we generate the facts and within the containers which causes the facter cache to be expired and attempted to be updated23:07
renichmwhahaha, OK. I'll check our NTP servers and stuff.23:08
mwhahahain theory if you rm -rf /var/lib/container-puppet/puppetlabs before running install it should be fresh23:08
mwhahahathe sosreports said it was insync so very strange23:08
renichOK. Good to know.23:09
renichmwhahaha, I cannot thank you enough for taking the time to check this. :D23:09
mwhahahaanyway i'm out, will update the case if I can reproduce/figure something out23:12
renichmwhahaha, you rock.23:13
*** holser is now known as holser_23:15
mwhahaharenich: one thing is that the var/lib/container-puppet/puppetlabs/facter/cache in the sosreport is dated from Dec 27th but your install was on 1/1323:31
renichYep. So it wasn't in sync. The fix might've just been to delete that.23:32
mwhahahais /opt/puppetlabs/ updated?23:32
mwhahahathat's where we sync from23:32
mwhahahafor the record teh code that's supposed to handle these files is https://github.com/openstack/tripleo-heat-templates/blob/stable/train/common/deploy-steps-tasks.yaml#L72-L14123:33
mwhahahait's supposed to nuke the existing cache https://github.com/openstack/tripleo-heat-templates/blob/stable/train/common/deploy-steps-tasks.yaml#L117 and then regenerate and copy to /var/lib/container-puppet/puppetlabs23:34
mwhahahaand in the ansible output that isn't erroring23:34
mwhahahaand infact it does remove it 2022-01-13 22:25:17.462934 | 566f87cd-003c-d3f7-6f13-000000000ff5 |    CHANGED | Cleanup facter cache if exists | cdmxv-osp-d23:35
mwhahahavery strange23:35
mwhahahaanyway i've kicked off something to reproduce, we'll see23:35
* mwhahaha wanders off23:35
*** holser_ is now known as holser23:52
*** holser is now known as holser_23:52
renichmwhahaha, I deleted /opt/puppetlabs/ manually.23:53

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!