Friday, 2021-04-30

*** rlandy|rover has quit IRC00:01
*** jmasud has joined #tripleo00:22
openstackgerritDavid Vallee Delisle proposed openstack/tripleo-validations stable/victoria: Validation should use the public endpoint  https://review.opendev.org/c/openstack/tripleo-validations/+/78876700:24
openstackgerritDavid Vallee Delisle proposed openstack/tripleo-validations stable/ussuri: Validation should use the public endpoint  https://review.opendev.org/c/openstack/tripleo-validations/+/78876800:24
openstackgerritDavid Vallee Delisle proposed openstack/tripleo-validations stable/train: Validation should use the public endpoint  https://review.opendev.org/c/openstack/tripleo-validations/+/78876900:25
openstackgerritJohn Fulton proposed openstack/tripleo-ansible master: Add CephHciOsdCount/CephHciOsdType to tripleo_derive_hci_parameters  https://review.opendev.org/c/openstack/tripleo-ansible/+/78261000:26
openstackgerritDavid Vallee Delisle proposed openstack/tripleo-validations stable/train: Validation should use the public endpoint  https://review.opendev.org/c/openstack/tripleo-validations/+/78885500:29
*** tmazur has quit IRC00:33
openstackgerritDavid Vallee Delisle proposed openstack/tripleo-validations stable/train: Validation should use the public endpoint  https://review.opendev.org/c/openstack/tripleo-validations/+/78876900:36
*** jmasud has quit IRC00:47
*** jmasud has joined #tripleo00:47
*** jmasud has quit IRC00:49
openstackgerritDavid Vallee Delisle proposed openstack/tripleo-validations stable/victoria: Exposing default variables in playbook  https://review.opendev.org/c/openstack/tripleo-validations/+/78877000:54
openstackgerritDavid Vallee Delisle proposed openstack/tripleo-validations stable/ussuri: Exposing default variables in playbook  https://review.opendev.org/c/openstack/tripleo-validations/+/78877100:54
openstackgerritDavid Vallee Delisle proposed openstack/tripleo-validations stable/train: Exposing default variables in playbook  https://review.opendev.org/c/openstack/tripleo-validations/+/78877200:55
*** jmasud has joined #tripleo00:55
*** jmasud has quit IRC00:56
openstackgerritSteve Baker proposed openstack/tripleo-specs master: Deploy whole disk images by default  https://review.opendev.org/c/openstack/tripleo-specs/+/78885001:04
*** rh-jelabarre has quit IRC01:05
openstackgerritMerged openstack/python-tripleoclient master: Use consistent working dir for ansible-runner  https://review.opendev.org/c/openstack/python-tripleoclient/+/78286701:14
openstackgerritMerged openstack/python-tripleoclient master: Quote -e arg in ansible-playbook-command.sh  https://review.opendev.org/c/openstack/python-tripleoclient/+/78765801:14
openstackgerritMerged openstack/tripleo-ansible stable/victoria: Use centos-8 stream for molecule jobs  https://review.opendev.org/c/openstack/tripleo-ansible/+/78852401:14
openstackgerritMerged openstack/tripleo-validations master: Validation should use the public endpoint  https://review.opendev.org/c/openstack/tripleo-validations/+/78834801:15
openstackgerritMerged openstack/tripleo-validations master: Exposing default variables in playbook  https://review.opendev.org/c/openstack/tripleo-validations/+/78835601:26
*** jmasud has joined #tripleo01:50
openstackgerritMerged openstack/tripleo-heat-templates master: Default CephClientConfigVars within --working-dir  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/78849601:53
openstackgerritMerged openstack/tripleo-ansible stable/ussuri: Use centos-8 stream for molecule jobs  https://review.opendev.org/c/openstack/tripleo-ansible/+/78859701:53
openstackgerritMerged openstack/tripleo-ansible stable/train: Use centos-8 stream for molecule jobs  https://review.opendev.org/c/openstack/tripleo-ansible/+/78859801:54
*** jmasud has quit IRC02:03
*** apetrich has quit IRC02:09
*** jmasud has joined #tripleo02:14
*** jmasud has quit IRC02:23
openstackgerritMerged openstack/puppet-tripleo stable/queens: stable-only: Pin puppetlabs-haproxy  https://review.opendev.org/c/openstack/puppet-tripleo/+/78875802:49
openstackgerritTakashi Kajinami proposed openstack/tripleo-common master: Resolve conflicting definitions of ContainerNeutronConfigImage  https://review.opendev.org/c/openstack/tripleo-common/+/78887302:53
openstackgerritJohn Fulton proposed openstack/tripleo-ansible master: Add CephHciOsdCount/CephHciOsdType to tripleo_derive_hci_parameters  https://review.opendev.org/c/openstack/tripleo-ansible/+/78261002:55
*** rcernin has quit IRC03:03
openstackgerritSteve Baker proposed openstack/tripleo-specs master: Deploy whole disk images by default  https://review.opendev.org/c/openstack/tripleo-specs/+/78885003:08
*** rcernin has joined #tripleo03:34
*** rcernin has quit IRC03:38
openstackgerritJohn Fulton proposed openstack/tripleo-ansible master: Add CephHciOsdCount/CephHciOsdType to tripleo_derive_hci_parameters  https://review.opendev.org/c/openstack/tripleo-ansible/+/78261003:44
openstackgerritJohn Fulton proposed openstack/tripleo-ansible master: Code cleaning of tripleo_derive_hci_parameters module  https://review.opendev.org/c/openstack/tripleo-ansible/+/78887703:44
*** redrobot6 has joined #tripleo03:52
*** redrobot has quit IRC03:55
*** redrobot6 is now known as redrobot03:55
openstackgerritJohn Fulton proposed openstack/tripleo-ansible master: Code cleaning of tripleo_derive_hci_parameters module  https://review.opendev.org/c/openstack/tripleo-ansible/+/78887704:02
openstackgerritJohn Fulton proposed openstack/tripleo-ansible master: Add CephHciOsdCount/CephHciOsdType to tripleo_derive_hci_parameters  https://review.opendev.org/c/openstack/tripleo-ansible/+/78261004:02
openstackgerritSteve Baker proposed openstack/tripleo-ci master: Add jobs for overcloud-hardened-uefi-full-centos-8  https://review.opendev.org/c/openstack/tripleo-ci/+/78887804:08
*** rcernin has joined #tripleo04:08
openstackgerritSteve Baker proposed openstack/tripleo-image-elements master: DNM trigger image build  https://review.opendev.org/c/openstack/tripleo-image-elements/+/78887904:11
openstackgerritJohn Fulton proposed openstack/tripleo-ansible master: Code cleaning of tripleo_derive_hci_parameters module  https://review.opendev.org/c/openstack/tripleo-ansible/+/78887704:12
openstackgerritJohn Fulton proposed openstack/tripleo-ansible master: Add CephHciOsdCount/CephHciOsdType to tripleo_derive_hci_parameters  https://review.opendev.org/c/openstack/tripleo-ansible/+/78261004:12
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Quick documentation content reorganization  https://review.opendev.org/c/openstack/tripleo-validations/+/75524304:17
openstackgerritSteve Baker proposed openstack/tripleo-common master: Update image build dependencies  https://review.opendev.org/c/openstack/tripleo-common/+/78888004:20
openstackgerritSteve Baker proposed openstack/tripleo-common master: Rename image-yaml *-python3* back to *-base*  https://review.opendev.org/c/openstack/tripleo-common/+/78888104:20
*** pojadhav|away is now known as pojadhav|rover04:22
*** radez has joined #tripleo04:23
openstackgerritGael Chamoulaud proposed openstack/tripleo-validations master: Quick documentation content reorganization  https://review.opendev.org/c/openstack/tripleo-validations/+/75524304:25
openstackgerritMerged openstack/diskimage-builder master: Remove dib-nodepool-functional-openstack-ubuntu-bionic  https://review.opendev.org/c/openstack/diskimage-builder/+/78840404:26
*** ratailor has joined #tripleo04:33
openstackgerritSteve Baker proposed openstack/tripleo-common master: Update image build dependencies  https://review.opendev.org/c/openstack/tripleo-common/+/78888004:37
openstackgerritSteve Baker proposed openstack/tripleo-common master: Delete python2 based images  https://review.opendev.org/c/openstack/tripleo-common/+/78888404:37
*** jmasud has joined #tripleo04:55
*** lmiccini has joined #tripleo05:19
openstackgerritMerged openstack/diskimage-builder master: Fix centos stream set mirror  https://review.opendev.org/c/openstack/diskimage-builder/+/78453005:21
*** ysandeep|away is now known as ysandeep05:30
*** saneax has joined #tripleo05:43
*** hakhande has joined #tripleo05:44
*** jpodivin has joined #tripleo05:47
openstackgerritMerged openstack/diskimage-builder master: Collect openstack logs  https://review.opendev.org/c/openstack/diskimage-builder/+/78855305:58
openstackgerritMerged openstack/diskimage-builder master: debian-minimal: Set bullseye version  https://review.opendev.org/c/openstack/diskimage-builder/+/78766505:59
*** slaweq has joined #tripleo06:00
*** apetrich has joined #tripleo06:26
*** jcapitao has joined #tripleo06:31
*** pleimer has quit IRC06:39
*** hoonetorg has quit IRC06:41
openstackgerrityang yawei proposed openstack/os-net-config master: setup.cfg: Replace dashes with underscores  https://review.opendev.org/c/openstack/os-net-config/+/78889506:42
*** cylopez has joined #tripleo06:48
openstackgerritMerged openstack/tripleo-validations stable/victoria: Validation should use the public endpoint  https://review.opendev.org/c/openstack/tripleo-validations/+/78876706:52
*** pmannidi has quit IRC06:54
*** pmannidi has joined #tripleo07:01
openstackgerritGregory Thiemonge proposed openstack/tripleo-heat-templates master: Add amp_ssh_key_dir variable for octavia playbook  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/78382307:10
openstackgerritGregory Thiemonge proposed openstack/tripleo-ansible master: Generate Octavia ssh key from the octavia playbook  https://review.opendev.org/c/openstack/tripleo-ansible/+/78382407:11
*** jmasud has quit IRC07:11
*** bogdando has joined #tripleo07:12
*** ricolin has quit IRC07:18
*** rpittau|afk is now known as rpittau07:24
openstackgerritRabi Mishra proposed openstack/python-tripleoclient master: Simplify undercloud upgrade  https://review.opendev.org/c/openstack/python-tripleoclient/+/78715707:33
*** jpena has joined #tripleo07:35
openstackgerritmbu proposed openstack/python-tripleoclient master: Use Validations libs Client for main validation entry point  https://review.opendev.org/c/openstack/python-tripleoclient/+/78361007:35
*** pcaruana has quit IRC07:38
*** amoralej has joined #tripleo07:44
*** rcernin has quit IRC07:56
openstackgerritMerged openstack/tripleo-docs master: Document Ceph configuration overrides for cephadm  https://review.opendev.org/c/openstack/tripleo-docs/+/78832907:58
*** lucasagomes has joined #tripleo08:12
*** pcaruana has joined #tripleo08:16
*** tosky has joined #tripleo08:21
*** derekh has joined #tripleo08:22
openstackgerritTakashi Kajinami proposed openstack/tripleo-heat-templates master: Make memcached port parameters globally available  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/78663908:30
*** gfidente|off is now known as gfidente08:53
*** saneax has quit IRC08:59
*** hakhande has quit IRC09:00
*** hakhande has joined #tripleo09:13
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade stable/train: Add logic to execute validation groups in updates/upgrades.  https://review.opendev.org/c/openstack/tripleo-upgrade/+/78845209:25
openstackgerritMerged openstack/diskimage-builder master: debian-minimal: bullseye: /updates -> -security  https://review.opendev.org/c/openstack/diskimage-builder/+/78745409:25
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Move FFU validations to right playbook.  https://review.opendev.org/c/openstack/tripleo-upgrade/+/78867709:26
*** shyamb has joined #tripleo09:41
*** dtantsur|afk is now known as dtantsur10:01
*** shyamb has quit IRC10:02
bandinifultonj: I filed https://bugs.launchpad.net/tripleo/+bug/1926746 (fpantano has the live env access, if you happen to have time)10:05
openstackLaunchpad bug 1926746 in tripleo "ceph dashboard fails to get a certificate with tls-e" [Medium,Triaged]10:05
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade master: Move FFU validations to right playbook.  https://review.opendev.org/c/openstack/tripleo-upgrade/+/78867710:18
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade stable/train: Add logic to execute validation groups in updates/upgrades.  https://review.opendev.org/c/openstack/tripleo-upgrade/+/78845210:18
openstackgerritMerged openstack/tripleo-ansible master: Baremetal deploy - user playbook interface  https://review.opendev.org/c/openstack/tripleo-ansible/+/78604510:31
*** dasp has quit IRC10:31
openstackgerritAnanya proposed openstack/tripleo-ci-health-queries master: Adds a user guide for queries.yml  https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/78878510:31
*** jcapitao has quit IRC10:32
*** chem has quit IRC10:34
*** chem has joined #tripleo10:39
*** chem has quit IRC10:53
*** chem has joined #tripleo10:55
*** lmiccini has quit IRC11:04
*** dtantsur is now known as dtantsur|brb11:05
*** dviroel is now known as dviroel|away11:20
*** jpena is now known as jpena|lunch11:30
*** bandini has quit IRC11:34
*** rlandy has joined #tripleo11:42
openstackgerritMerged openstack/tripleo-ci-health-queries master: Adding tests for sova queries  https://review.opendev.org/c/openstack/tripleo-ci-health-queries/+/78869211:51
openstackgerritJohn Fulton proposed openstack/tripleo-ansible master: Remove "cli" prefix from cli-derive-local-hci-parameters.yml  https://review.opendev.org/c/openstack/tripleo-ansible/+/78893811:56
*** dasp has joined #tripleo11:57
*** sshnaidm is now known as sshnaidm|off11:59
*** rh-jelabarre has joined #tripleo12:04
openstackgerritJohn Fulton proposed openstack/tripleo-docs master: Update Derived Parameters doc for new name  https://review.opendev.org/c/openstack/tripleo-docs/+/78894012:05
*** amoralej is now known as amoralej|lunch12:19
openstackgerritMerged openstack/tripleo-upgrade master: Bump Cirros to 0.5.2  https://review.opendev.org/c/openstack/tripleo-upgrade/+/78853612:27
*** dtantsur|brb is now known as dtantsur12:28
openstackgerritMerged openstack/ansible-role-collect-logs master: Add 2 minute timeout for repoquery  https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/78384312:28
openstackgerritMerged openstack/tripleo-quickstart master: ci jobs in ci.centos can pull containers from rdo  https://review.opendev.org/c/openstack/tripleo-quickstart/+/78880912:28
openstackgerritMerged openstack/python-tripleoclient master: Make Python Interpreter option for Ansible Validation Run  https://review.opendev.org/c/openstack/python-tripleoclient/+/78510412:28
openstackgerritMerged openstack/python-tripleoclient stable/victoria: Make Python Interpreter option for Ansible Validation Run  https://review.opendev.org/c/openstack/python-tripleoclient/+/78510712:29
openstackgerritMerged openstack/python-tripleoclient stable/ussuri: Make Python Interpreter option for Ansible Validation Run  https://review.opendev.org/c/openstack/python-tripleoclient/+/78510812:29
*** hakhande has quit IRC12:32
openstackgerritamolkahat proposed openstack/openstack-tempest-skiplist master: Added sc10 jobs in the skip list  https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/78894212:33
*** jpena|lunch is now known as jpena12:34
*** ratailor has quit IRC12:35
*** hakhande has joined #tripleo12:36
*** fultonj has quit IRC12:37
openstackgerritRabi Mishra proposed openstack/python-tripleoclient stable/wallaby: Remove leftover for undercloud keepalived service  https://review.opendev.org/c/openstack/python-tripleoclient/+/78892212:41
*** eliadcohen has quit IRC12:42
*** eliadcohen has joined #tripleo12:45
openstackgerritamolkahat proposed openstack/openstack-tempest-skiplist master: Added sc10 jobs in the skip list  https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/78894212:46
*** tmazur has joined #tripleo12:49
*** dviroel|away is now known as dviroel12:54
*** amoralej|lunch is now known as amoralej13:07
*** ysandeep is now known as ysandeep|away13:11
*** shyam89 has joined #tripleo13:12
*** dwilde has joined #tripleo13:16
shyam89mwhahaha: owalsh: Hi13:19
openstackgerritFrancesco Pantano proposed openstack/tripleo-heat-templates master: DNM - Test Pending Ceph Pacific daemons in CI  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/77891513:20
openstackgerritJose Luis Franco proposed openstack/tripleo-upgrade stable/train: Add logic to execute validation groups in updates/upgrades.  https://review.opendev.org/c/openstack/tripleo-upgrade/+/78845213:20
shyam89mwhahaha: owalsh: TrilioVault service heat template causing all pacemaker resources to restart during overcloud deploy command.13:21
mwhahahais it changing network configuration or something? that seems odd13:21
shyam89This is only happening on RHOSP13. Other releases like RHOSP16 and RHOSP16.1 working fine13:21
mwhahahacan you link the template?13:22
mwhahahanot certain what's going on, the logs will usually tell you why that would occur13:22
shyam89mwhahaha: Sure13:22
shyam89mwhahaha: This is the overcloud deploy command we are using. http://paste.openstack.org/show/804883/13:24
shyam89Here are the templates: https://github.com/trilioData/triliovault-cfg-scripts/tree/master/redhat-director-scripts/rhosp1313:25
mwhahahait's probably the haproxy bits13:27
shyam89mwhahaha: okay13:28
mwhahahaor the database thing13:28
mwhahahalet me see13:28
shyam89mwhahaha: okay13:29
mwhahahayea i don't see anything specific that's jumping out. My assumption is that its' related to the haproxy configuration but that shouldn't cause all of pacemaker to restart. just the haproxy bundle13:30
mwhahahai'd throw the install into debug and see if there's any reference in the puppet logs to see why it restarts13:31
shyam89mwhahaha: We are passing that endpoint map also. Which is replacing the overcloud's endpoint map.13:33
shyam89this endpoint map is from trilio's repo.13:33
mwhahahathat might do it as well if you're changing something unexpecttedly13:33
shyam89mwhahaha: Pattern is, if I change the trilio container tag, then only we are facing this issue. If we keep the same tag and run deploy command again, we are not facing this issue.13:36
shyam89mwhahaha: one more thing, we are replacing openstack horizon container.13:37
mwhahahathat shouldn't affect things but there might be an unrelated bug there13:38
mwhahahai'm not aware of anything13:38
shyam89mwhahaha: okay13:40
mwhahahamight be worth seeing if changing a tag on an unrelated container causes the problem as well13:40
shyam89mwhahaha: okay13:43
shyam89mwhahaha: I will run deploy command in debug mode and provide you the logs.13:44
hakhandecloudnull, ping13:51
cloudnullo/13:52
*** owalsh has quit IRC13:54
openstackgerritSergii Golovatiuk proposed openstack/tripleo-upgrade stable/victoria: Bump Cirros to 0.5.2  https://review.opendev.org/c/openstack/tripleo-upgrade/+/78892414:01
openstackgerritSergii Golovatiuk proposed openstack/tripleo-upgrade stable/ussuri: Bump Cirros to 0.5.2  https://review.opendev.org/c/openstack/tripleo-upgrade/+/78892514:01
openstackgerritSergii Golovatiuk proposed openstack/tripleo-upgrade stable/train: Bump Cirros to 0.5.2  https://review.opendev.org/c/openstack/tripleo-upgrade/+/78892614:02
*** ccamacho has quit IRC14:08
*** rpittau is now known as rpittau|afk14:10
*** shyam89 has quit IRC14:13
*** owalsh has joined #tripleo14:13
*** bogdando has quit IRC14:21
*** jpodivin has quit IRC14:22
*** timeu has quit IRC14:30
hakhandecloudnull, need your reviews https://review.opendev.org/c/openstack/tripleo-ansible/+/78386414:31
cloudnullI’ll take a look.14:35
*** rcernin has joined #tripleo14:48
*** rcernin has quit IRC14:52
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart-extras master: DNM: Separate forwarder condition to support downstream  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/77257114:53
*** hoonetorg has joined #tripleo15:10
*** dwilde has quit IRC15:10
weshay|rucklyarwood, fyi.. is we have go back to cirros 4, that will mess up nova tests I think https://bugs.launchpad.net/tripleo/+bug/192673415:11
openstackLaunchpad bug 1926734 in tripleo "Tempest: cirros-0.5.2 image kernel panic" [Critical,Triaged]15:11
weshay|rucklyarwood, just want to make sure ur in the loop here15:12
lyarwoodweshay|ruck: yeah it will break the q35 tests15:12
weshay|ruckakahat|ruck, arxcruz do not cirros back to 4.0, we'll figure something else out15:13
*** ccamacho has joined #tripleo15:13
lyarwoodweshay|ruck: FWIW devstack switched over to 0.5.2 a few weeks ago and we've not seen issues like this15:14
weshay|ruckheh15:14
weshay|ruckthat old line15:14
weshay|ruck"works in devstack"15:14
lyarwoodright my point was more I doubt this is the image15:15
lyarwoodmore likely the virt stack15:15
openstackgerritDmitry Tantsur proposed openstack/diskimage-builder master: Update the ironic jobs  https://review.opendev.org/c/openstack/diskimage-builder/+/78897215:15
*** shyamb has joined #tripleo15:15
*** jmasud has joined #tripleo15:17
weshay|rucklyarwood, seems to working upstream.. in tripleo just fine.. we'll check it out :)15:17
weshay|rucklyarwood, but had to make fun of the "works in devstack" anytime I hear that15:18
weshay|ruckin fact we have shirts15:18
lyarwoodhehe yeah I recall15:18
weshay|ruck:)15:18
*** dwilde has joined #tripleo15:18
weshay|rucktripleo bingo15:18
lyarwoodweshay|ruck: another workaround could be to build 4.0.0 with the missing ahci module q35 requires15:18
lyarwoodweshay|ruck: that's if you really need to go back to that version15:19
weshay|rucklyarwood, let's see how widespread and how often this happens before we change anything :)15:19
weshay|ruckneed some time15:19
weshay|ruckjust wanted to make you aware of it15:20
lyarwoodkk ack15:21
openstackgerritAde Lee proposed openstack/puppet-tripleo stable/stein: Always update the local certmonger ca cert  https://review.opendev.org/c/openstack/puppet-tripleo/+/78497815:31
openstackgerritAde Lee proposed openstack/puppet-tripleo stable/queens: Always update the local certmonger ca cert  https://review.opendev.org/c/openstack/puppet-tripleo/+/78498015:32
weshay|ruckfmount, 0/ not sure if ur still here... is cephadm the possible root cause here? https://bugs.launchpad.net/tripleo/+bug/192664915:34
openstackLaunchpad bug 1926649 in tripleo "master: Gather podman infos fails w/ no log" [Critical,Triaged]15:34
fmountweshay|ruck: o/ /me looking15:34
*** pleimer has joined #tripleo15:35
weshay|ruckfmount, seems to only happen sometimes..15:35
pleimerHi all, need a CR: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/78834315:35
fmountweshay|ruck: I don't think so, I mean => https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_799/778083/2/gate/tripleo-ci-centos-8-scenario001-standalone/799eeb6/logs/undercloud/home/zuul/standalone-ansible-apvx72ng/cephadm/cephadm_command.log15:35
fmountthe cluster is health_warn (which is good)15:35
weshay|ruckagree15:36
fmountbut I'm not sure how can be related to the podman gathering info15:36
fmountweshay|ruck: I'll take a look at the logs15:36
fmountand see if I can find any relevant clue15:36
weshay|ruckfmount, I'm totally guessing because of NO_LOG15:37
weshay|ruckf.. no_log15:37
fmountyeah I see15:37
fmountalso the ceph config and keyrings (for clients) looks good15:38
*** cylopez has quit IRC15:40
fmountweshay|ruck: I rebased the dnm review on master (it tests pending ceph bits) https://review.opendev.org/77891515:41
fmountlet's see the CI execution ^15:41
fmountand compare the logs15:41
*** jpodivin has joined #tripleo15:54
*** lucasagomes has quit IRC16:00
fmountweshay|ruck: /me stepping out but I'll keep an eye on the jobs and the logs16:01
weshay|ruckfmount, k.. have a good weekend dude16:01
fmountthanks, you too16:02
*** fmount is now known as fmount|afk16:02
arxcruzweshay|ruck: kopecmartin tosky https://review.opendev.org/c/osf/python-tempestconf/+/78897916:09
arxcruzjust in case16:10
arxcruzweshay|ruck: btw, rdo did not update yet cirros 0.5.2 on their mirror16:10
kopecmartinarxcruz: https://review.opendev.org/c/osf/python-tempestconf/+/78848916:10
toskydoes the fallback to 0.4.0 make sense? We may have inconsistent results in some runs16:10
toskyI didn't notice devstack already merged the patch, good16:10
*** jpodivin has quit IRC16:16
*** shyamb has quit IRC16:20
*** shyamb has joined #tripleo16:20
shyambmwhahaha: We are facing the same issue on older triliovault releases also.16:21
shyambRecently we upgraded the rhosp13 setups16:21
shyambI think that could be the issue.16:21
shyambSomething changed from rhosp13 deployment scripts.16:22
*** dtantsur is now known as dtantsur|afk16:27
shyambmwhahaha: If you get anything, please send me on shyam.biradar@trilio.io16:28
shyambI am in IST timezone. taking off.16:28
mwhahahak i'm not aware of anything16:28
shyambokay16:28
mwhahahawe did have a change that fetches the containers so it'll restart if the containers update16:28
mwhahahawe used to not check if the container id was different16:29
mwhahahanot certain if related16:29
shyambmwhahaha: Okay.16:29
shyambIf you have the gerrit link of that commit, please forward me16:29
shyambI will check.16:29
mwhahahahttps://review.opendev.org/c/openstack/paunch/+/75308216:30
mwhahahathough that should only be if you use like :latest16:30
shyambWe change horizon container during deploy. That may be related.16:31
mwhahahait should only restart changed containers however, not everything16:32
shyambokay16:34
shyambmwhahaha: We change haproxy16:34
shyambbut not rabbitmq and mysql16:34
openstackgerritMerged openstack/tripleo-upgrade master: [ffwd] Allow users to replace environment files  https://review.opendev.org/c/openstack/tripleo-upgrade/+/78835916:35
shyambI think this will not cause my issue16:35
openstackgerritMerged openstack/tripleo-heat-templates stable/train: HA: fix race when moving VIP during minor update  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/78293116:35
shyambHere is the pcs status output: http://paste.openstack.org/show/804889/16:35
shyambmwhahaha: ^^16:35
openstackgerritMerged openstack/tripleo-heat-templates master: nova: Default to the unversioned q35 machine type on x86_64  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/78502716:35
mwhahahayea not certain what's up. maybe the vip information is getting lost?16:36
mwhahahaor iptables problems causing failures?16:36
*** hakhande has quit IRC16:37
shyambmwhahaha: hmm.16:37
mwhahahaseems odd on the stop timeout16:37
*** jpena is now known as jpena|off16:38
mwhahahai'd have to defer to someone else on those failures16:38
openstackgerritLuigi Toscano proposed openstack/tripleo-upgrade stable/victoria: [ffwd] Allow users to replace environment files  https://review.opendev.org/c/openstack/tripleo-upgrade/+/78898616:40
openstackgerritLuigi Toscano proposed openstack/tripleo-upgrade stable/ussuri: [ffwd] Allow users to replace environment files  https://review.opendev.org/c/openstack/tripleo-upgrade/+/78898716:40
shyambmwhahaha: okay16:41
openstackgerritLuigi Toscano proposed openstack/tripleo-upgrade stable/train: [ffwd] Allow users to replace environment files  https://review.opendev.org/c/openstack/tripleo-upgrade/+/78745016:42
shyambmwhahaha: Should I send "/var/log/messages" logs?16:43
shyambwill that help or any other logs?16:43
mwhahahai don't know where to start looking16:43
shyambmwhahaha: okay16:43
*** shyamb has quit IRC16:46
*** jbadiapa has quit IRC16:49
openstackgerritMerged openstack/tripleo-upgrade stable/victoria: Add logic to execute validation groups in updates/upgrades.  https://review.opendev.org/c/openstack/tripleo-upgrade/+/78860916:52
openstackgerritMerged openstack/tripleo-validations stable/victoria: Exposing default variables in playbook  https://review.opendev.org/c/openstack/tripleo-validations/+/78877016:52
openstackgerritMerged openstack/tripleo-validations stable/ussuri: Validation should use the public endpoint  https://review.opendev.org/c/openstack/tripleo-validations/+/78876816:52
openstackgerritMerged openstack/tripleo-ansible stable/train: Added back the backup-and-restore molecule to the gate  https://review.opendev.org/c/openstack/tripleo-ansible/+/78640816:52
openstackgerritMerged openstack/tripleo-ansible master: Backup&Restore Snapshots RFE  https://review.opendev.org/c/openstack/tripleo-ansible/+/78638016:54
*** rlandy is now known as rlandy|training16:55
*** jmasud has quit IRC17:18
*** gfidente is now known as gfidente|afk17:22
*** hkominos has joined #tripleo17:25
hkominosHi Guys! Can somebody please with a running ussuri+ installation on Centos8 please run crm_node -l from within a DB container and tell me if the command returns? I am trying to debug an issue in our env and I suspect pcm is the culprit17:27
dsneddonI'm seeing a CI error that isn't familiar to me on https://review.opendev.org/c/openstack/os-net-config/+/78889517:34
dsneddonError is: "Unable to freeze job graph: Job tripleo-ci-centos-8-containers-multinode depends on tripleo-ci-centos-8-content-provider which was not run."17:34
dsneddonAny idea what that is or how to fix it?17:35
*** jmasud has joined #tripleo17:38
weshay|ruckdsneddon, /me looks17:41
*** jmasud has quit IRC17:43
openstackgerritwes hayutin proposed openstack/tripleo-ci master: ignore setup.cfg for multinode jobs  https://review.opendev.org/c/openstack/tripleo-ci/+/78899017:44
openstackgerritwes hayutin proposed openstack/os-net-config master: setup.cfg: Replace dashes with underscores  https://review.opendev.org/c/openstack/os-net-config/+/78889517:45
openstackgerritwes hayutin proposed openstack/tripleo-ci master: ignore setup.cfg for multinode, upgrade jobs  https://review.opendev.org/c/openstack/tripleo-ci/+/78899017:48
*** jmasud has joined #tripleo17:50
weshay|ruckdsneddon, ok.. should be good to go17:50
dsneddonweshay|ruck, Thanks!18:00
*** rlandy|training is now known as rlandy18:01
*** owalsh has quit IRC18:04
*** apetrich has quit IRC18:04
*** damani has quit IRC18:04
*** lbragstad_ has quit IRC18:04
*** jlarriba has quit IRC18:04
*** dciabrin has quit IRC18:04
*** gthiemonge has quit IRC18:04
*** hjensas has quit IRC18:04
*** akahat|ruck has quit IRC18:04
*** jmasud has quit IRC18:05
*** owalsh has joined #tripleo18:07
*** apetrich has joined #tripleo18:07
*** damani has joined #tripleo18:07
*** lbragstad_ has joined #tripleo18:07
*** jlarriba has joined #tripleo18:07
*** dciabrin has joined #tripleo18:07
*** gthiemonge has joined #tripleo18:07
*** hjensas has joined #tripleo18:07
*** akahat|ruck has joined #tripleo18:07
*** jmasud has joined #tripleo18:08
*** gouthamr has quit IRC18:08
*** gouthamr has joined #tripleo18:10
openstackgerritMerged openstack/tripleo-heat-templates stable/ussuri: Switch Octavia external tasks to 'post deploy'  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/78850418:21
*** hkominos has quit IRC18:22
weshay|ruckcloudnull, was there a change to overcloud deployments to NOT pull containers from the undercloud reg?18:22
weshay|ruckmwhahaha, ^18:23
cloudnullnone that I'm aware of18:26
mwhahahaweshay|ruck: no why?18:27
mwhahahaweshay|ruck: also the default is to not pull from the undercloud, so it's something you opt in to (sounds like maybe someone broke something else)18:30
weshay|ruckmwhahaha, ya.. the podman registry is set.. but the overcloud nodes still pull from the tc setting18:31
weshay|rucksomething changed18:31
weshay|ruckmwhahaha, https://bugs.launchpad.net/tripleo/+bug/192675818:31
openstackLaunchpad bug 1926758 in tripleo "overcloud deployment is not respecting the "DockerInsecureRegistryAddress" address variable for the container registry." [Undecided,Triaged] - Assigned to Pooja Jadhav (poojajadhav22)18:31
weshay|ruckmaybe the podman version18:32
* weshay|ruck trolls back18:32
mwhahahano18:32
mwhahahathat's all our code18:32
mwhahahalet me look18:32
weshay|ruckmwhahaha, was working from the undercloud reg: on 4/2418:35
weshay|ruckso fairly recent18:35
mwhahahait's fine in the undercloud18:35
mwhahahai wonder if it's related to slagle's efforts18:36
* mwhahaha puts the bus into gear18:36
weshay|ruckvrrmmm18:36
weshay|ruckworking on the 4/2518:36
mwhahahait's fine in that job on the undercloud https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-master/19dac6d/logs/undercloud/home/zuul/undercloud_install.log.txt.gz18:36
mwhahahaso it's specific to the overcloud deploy18:36
weshay|ruckyes18:37
weshay|ruckpojadhav|rover, fyi review this later :)18:37
weshay|ruckworking on 4/2618:38
weshay|ruckworking on 4/2718:39
mwhahahaif i had to guess with no actual looking, https://review.opendev.org/c/openstack/python-tripleoclient/+/76998418:39
mwhahahabecause that moved the container image prepare bits18:40
*** cyberpear has joined #tripleo18:41
weshay|ruckslagle, ping18:42
*** hoonetorg has quit IRC18:44
mwhahahahttps://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-master/19dac6d/logs/undercloud/home/zuul/overcloud-deploy/overcloud/tripleo-heat-templates/user-environments/tripleoclient-parameters.yaml.txt.gz18:45
mwhahahadoesn't have the correct container image prepare options18:45
weshay|ruckya.18:45
mwhahahaso yea likely related to teh reorg of the container image prepare bits in https://review.opendev.org/c/openstack/python-tripleoclient/+/769984/50/tripleoclient/v1/overcloud_deploy.py18:45
mwhahahathe update is getting lost18:45
* mwhahaha runs away screaming18:46
openstackgerritwes hayutin proposed openstack/python-tripleoclient master: Revert "Support using ephemeral Heat"  https://review.opendev.org/c/openstack/python-tripleoclient/+/78899818:46
weshay|ruckwip -1 wf18:46
weshay|rucktest18:46
*** jmasud has quit IRC18:46
*** rcernin has joined #tripleo18:48
*** hoonetorg has joined #tripleo18:51
dsneddonweshay|ruck, Thanks for the fix on that change, it looks good now.18:52
weshay|ruckdsneddon, rock on18:52
*** rcernin has quit IRC18:53
openstackgerritwes hayutin proposed openstack/tripleo-ci master: update the ci logs doc w/ more tripleo config data info and links  https://review.opendev.org/c/openstack/tripleo-ci/+/78901719:04
openstackgerritDavid Vallee Delisle proposed openstack/tripleo-validations master: [WIP] Introducing the validations_podman library  https://review.opendev.org/c/openstack/tripleo-validations/+/78835819:04
openstackgerritDavid Vallee Delisle proposed openstack/tripleo-validations master: [WIP] Introducing the validations_podman library  https://review.opendev.org/c/openstack/tripleo-validations/+/78835819:06
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Switch Octavia external tasks to 'post deploy'  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/78850519:08
*** slaweq has quit IRC19:18
*** dwilde has quit IRC19:26
openstackgerritDavid Vallee Delisle proposed openstack/tripleo-validations master: [WIP] Introducing the validations_podman library  https://review.opendev.org/c/openstack/tripleo-validations/+/78835819:35
*** dwilde has joined #tripleo19:49
*** dviroel is now known as dviroel|afk19:55
*** jfrancoa has quit IRC20:22
openstackgerritDavid Vallee Delisle proposed openstack/tripleo-validations master: [WIP] Introducing the validations_podman library  https://review.opendev.org/c/openstack/tripleo-validations/+/78835820:24
*** poopcat has quit IRC20:37
*** ccamacho has quit IRC20:47
*** rcernin has joined #tripleo20:48
*** rcernin has quit IRC20:53
*** ramishra has quit IRC21:07
*** pleimer has quit IRC21:15
*** hoonetorg has quit IRC21:34
*** derekh has quit IRC21:44
*** hoonetorg has joined #tripleo21:44
*** jmasud has joined #tripleo21:45
*** rlandy has quit IRC21:47
*** zzzeek has quit IRC21:55
*** zzzeek has joined #tripleo21:58
*** pleimer has joined #tripleo22:07
*** zzzeek has quit IRC22:44
*** pleimer has quit IRC22:45
*** zzzeek has joined #tripleo22:47
*** ccamacho has joined #tripleo22:54
openstackgerritDavid Vallee Delisle proposed openstack/tripleo-validations master: [WIP] Introducing the validations_podman library  https://review.opendev.org/c/openstack/tripleo-validations/+/78835823:06
*** derekh has joined #tripleo23:16
*** derekh has quit IRC23:17
*** dwilde has quit IRC23:26
*** tosky has quit IRC23:31
*** poopcat has joined #tripleo23:44
openstackgerritMerged openstack/python-tripleoclient stable/train: [only-train] BnR overwrite the json output  https://review.opendev.org/c/openstack/python-tripleoclient/+/78845923:49

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!