Friday, 2022-09-02

tkajinamis anybody aware of broken content provider jobs ?01:11
tkajinamhttps://4232a5777fe8521e933a-68bc071a5cbea1ed39a41226592204b6.ssl.cf5.rackcdn.com/855194/3/gate/puppet-cinder-tripleo-standalone/3e0cfc0/job-output.txt01:11
tkajinamhttps://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-9-content-provider&skip=001:12
tkajinamseems it has never succeeded since 2022-09-01 18:26:2601:13
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: OVN: Remove standalone OVN DB deployment  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/85558102:19
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: OVN: Remove unused deployment methods of OVN DB  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/85558102:24
*** rlandy is now known as rlandy|out02:47
opendevreviewBrendan Shephard proposed openstack/tripleo-common stable/train: [TRAIN-ONLY] Use full_listing with Swift get_container  https://review.opendev.org/c/openstack/tripleo-common/+/85472203:28
tkajinamhttps://bugs.launchpad.net/tripleo/+bug/198850003:55
tkajinamrcastillo|rover_, we have broken CI now ^^^03:56
* tkajinam could not find ruck03:56
*** rcastillo|rover_ is now known as rcastillo03:56
opendevreviewMerged openstack/tripleo-heat-templates stable/train: Fix wrong parameter assignation  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/85429404:20
*** chandankumar is now known as chkumar|ruck05:02
chkumar|ruckthank you tkajinam for reporting this bug https://bugs.launchpad.net/tripleo/+bug/198850005:02
*** ysandeep|out is now known as ysandeep05:22
opendevreviewchandan kumar proposed openstack/tripleo-quickstart master: Downgrade containers-common to 1-40  https://review.opendev.org/c/openstack/tripleo-quickstart/+/85558705:38
opendevreviewchandan kumar proposed openstack/tripleo-quickstart master: Revert "Temporarily install catatonit"  https://review.opendev.org/c/openstack/tripleo-quickstart/+/85555205:47
opendevreviewCedric Jeanneret proposed openstack/puppet-tripleo master: Allow disabling puppet tasks to configure apache/vhost  https://review.opendev.org/c/openstack/puppet-tripleo/+/85436005:56
tkajinamchkumar|ruck, np :-)05:58
opendevreviewCedric Jeanneret proposed openstack/tripleo-heat-templates master: [WIP] Convert apache configurations to new role  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/85456806:05
tkajinamchkumar|ruck, for that bug, I'm wondering whether we should file a bug for cs906:05
tkajinamchkumar|ruck, if they'll soon release pomdna >5.22.0 then it's ok, but that really looks like an unexpected breakage06:06
chkumar|rucktkajinam: you mean filing  a bug on RH Bugzilla or github issue?06:08
tkajinamon RH bugzilla, for CentOS Stream.06:11
* tkajinam is creating one06:11
lecris[m]<beagles> "just curious if anybody else has..." <- I cannot get tls-e to work for at least 3 broken steps: redis, rabbitmq, and horizon06:11
chkumar|rucktkajinam: thank you :-)06:11
chkumar|rucktkajinam++06:11
lecris[m]beagles: I reported it, but nobody is following on my bug reports for 3 weeks now06:12
lecris[m]It does not help that this channel is flooded with bot messages and the community is on IRC, so that my cries for help are like screaming into the void06:14
ykarelchkumar|ruck, tkajinam, looks like latest podman don't have the issue 4.2.0-3.el9.x86_6406:17
tkajinamykarel, seems like that latest podman is not installed06:18
tkajinamykarel, I'm now looking at mirror06:18
ykareltkajinam, yes that's needs to be find out, why06:18
opendevreviewIan Wienand proposed openstack/diskimage-builder master: Start running dib-lint again  https://review.opendev.org/c/openstack/diskimage-builder/+/85558906:18
tkajinamlecris[m], do you care to share the bug number ?06:19
ykarelhttp://mirror.stream.centos.org/9-stream/AppStream/x86_64/os/Packages/podman-4.2.0-3.el9.x86_64.rpm06:19
ykarelhttp://mirror.facebook.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/podman-4.2.0-3.el9.x86_64.rpm06:20
chkumar|ruckykarel: can you check the opendev mirror?06:20
tkajinam [ ]podman-4.2.0-3.el9.x86_64.rpm2022-08-23 09:50 12M 06:20
tkajinamthere is one it seems06:20
ykarelhttp://mirror.ord.rax.opendev.org/centos-stream/9-stream/AppStream/x86_64/os/Packages/podman-4.2.0-3.el9.x86_64.rpm06:20
tkajinamhttp://mirror.iad3.inmotion.opendev.org/centos-stream/9-stream/AppStream/x86_64/os/Packages/podman-4.2.0-3.el9.x86_64.rpm06:20
ykarelchkumar|ruck, yes it's exists06:20
chkumar|ruckwhy it is picking the older podman package06:21
tkajinammaybe I checked the things in the bad timing ?06:21
ykarelthat's something to find out06:21
lecris[m]tkajinam: can you access my profile bug list? https://bugs.launchpad.net/~lecris06:21
chkumar|ruckhttps://ad4a918c918d1cf92f3d-b971135d7916cb5f7bbc35fdb125d434.ssl.cf5.rackcdn.com/855552/1/check/tripleo-ci-centos-9-content-provider/b701413/logs/undercloud/var/log/extra/rpm-list.txt06:21
chkumar|ruckpodman-4.2.0-3.el9.x86_6406:22
chkumar|ruckit is the latest failure06:22
ykarelohkk i checked only bug comments and there older one was mentioned06:22
ykarellocally i don't see issue with 4.2.0-306:22
chkumar|ruckopen /etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-beta: no such file or directory; open /etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-beta: no such file or directory; open /etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-beta: no such file or directory; open /etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-beta: no such file or directory; open /etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-beta:06:23
tkajinamlecris[m], is this the one ? https://bugs.launchpad.net/tripleo/+bug/198764406:23
chkumar|ruckcontainers-common-1-44.el9.x86_6406:23
lecris[m]Yep, I think there is one more related06:25
lecris[m]Oh I did not add the latest rabbitmq issues to it06:26
ykarelchkumar|ruck, ok so it failed at different place06:28
ykarelwith new podman06:28
chkumar|ruckyes06:28
chkumar|ruck/etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-beta06:28
chkumar|ruckwe will be also needing this https://review.opendev.org/c/openstack/tripleo-quickstart/+/85558706:28
lecris[m]I will reset and try again, I got issues with deploying without tls-e as well06:29
tkajinamlecris[m], I'd strongly recommend not adding multiple problems into a single bug06:30
tkajinama single bug should focus on one problem06:30
tkajinamcreate a separate one for a different problem. we might end up closing it as a duplicate but that's much easier than dealing with multiple things in a single bug06:30
chkumar|ruckhttps://gitlab.com/redhat/centos-stream/rpms/containers-common/-/tree/c9s06:32
chkumar|ruckhttps://gitlab.com/redhat/centos-stream/rpms/containers-common/-/blob/c9s/RPM-GPG-KEY-redhat-release file exists06:32
chkumar|ruckbut no beta files06:33
ykarelchkumar|ruck, yeap ^ is bug 06:33
tkajinamreasons: open /etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-beta: no such file or directory; open /etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-beta: no such file or directory; open /etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-beta: no such file or directory; open /etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-beta: no such file or directory; open /etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-beta: no such file or directory; open /etc/pki/rpm-gpg/RPM-GPG-KEY-redhat-beta: no 06:33
tkajinamsuch file or directory06:33
* tkajinam is catching up06:33
chkumar|ruckopening a new bug06:34
tkajinamlecris[m], I'm not TLS-e expert and don't have full understanding about the issue but left a few comments from tht/heat's PoV06:34
tkajinamin that bug06:34
lecris[m]Any feedback is ok. Not having anything I cannot get any stack running these days06:35
chkumar|ruckhttps://bugs.launchpad.net/tripleo/+bug/198851406:42
chkumar|ruckdropped an email for gate blocker06:47
opendevreviewchandan kumar proposed openstack/tripleo-quickstart master: Revert "Temporarily install catatonit"  https://review.opendev.org/c/openstack/tripleo-quickstart/+/85555206:48
tkajinamchkumar|ruck, so is that a bug of the container-common package right ?06:49
chkumar|rucktkajinam: yes06:49
tkajinamchkumar|ruck, they forgot to add the release file06:49
chkumar|rucktkajinam: you are opening the bug?06:49
tkajinamnot release file but a GPG key file06:49
chkumar|ruckyes06:49
tkajinamif nobody is creating one06:50
chkumar|rucktkajinam: please go ahead and create one06:50
chkumar|rucktkajinam: please add the bz link here in this bug https://bugs.launchpad.net/tripleo/+bug/198851406:50
chkumar|ruckwith containers common downgrade https://zuul.opendev.org/t/openstack/status#855587 content provider is working fine06:52
chkumar|ruckwaiting for child job to finish06:52
tkajinamhttps://bugzilla.redhat.com/show_bug.cgi?id=212361106:56
tkajinamposted the link to that lp bug as well06:56
chkumar|rucktkajinam: thank you :-)07:03
*** arxcruz is now known as arxcruz|rover07:12
opendevreviewMerged openstack/diskimage-builder master: Add subscription-manager repo names for RHEL-9  https://review.opendev.org/c/openstack/diskimage-builder/+/85173407:35
*** jpena|off is now known as jpena07:36
opendevreviewRafal Lewandowski proposed openstack/diskimage-builder master: changed release check logic in lvm element  https://review.opendev.org/c/openstack/diskimage-builder/+/85561608:06
opendevreviewRafal Lewandowski proposed openstack/diskimage-builder master: changed release check logic in lvm element enabling lvm for all ubuntu releases except for trusty Change-Id: I77184990270be74afa6542fd16b8e05bd1a27e04  https://review.opendev.org/c/openstack/diskimage-builder/+/85561608:14
opendevreviewRafal Lewandowski proposed openstack/diskimage-builder master: changed release check logic in lvm element  https://review.opendev.org/c/openstack/diskimage-builder/+/85561608:14
tkajinamseems like ansible galaxy or connection to it is unstable08:47
chkumar|rucktkajinam: we are in kind of chicken egg issue https://review.opendev.org/c/openstack/tripleo-quickstart/+/855587 and https://review.opendev.org/c/openstack/tripleo-quickstart/+/855552/2 issue together08:48
chkumar|ruckotherwise wallaby jobs will fail08:48
tkajinamERROR! Unknown error when attempting to call Galaxy at 'https://galaxy.ansible.com/api/': <urlopen error [Errno 104] Connection reset by peer>08:48
chkumar|ruckhttps://1e736d55beaaabb3ac5c-2a9f287b095afbccb31b318c52b33558.ssl.cf1.rackcdn.com/855587/1/check/tripleo-ci-centos-9-containers-multinode-wallaby/eea642c/logs/undercloud/home/zuul/overcloud_deploy.log08:49
tkajinamI'd personally prefer making wallaby job non-voting in the first patch08:49
tkajinamI mean in the patch to pin containers-common08:49
tkajinamand revert that non-voting change as part of that revert of catatonit thing08:49
chkumar|ruckDepsolve Error occurred: \n Problem: problem with installed package catatonit-3:0.1.7-7.el9.x86_64\n  - package podman-2:4.2.0-3.el9.x86_64 conflicts with catatonit provided by catatonit-3:0.1.7-7.el9.x86_64\n  - cannot install the best candidate for the jobDepsolve Error occurred: \n Problem: problem with installed package catatonit-3:0.1.7-7.el9.x86_64\n  - package08:49
chkumar|ruckpodman-2:4.2.0-3.el9.x86_64 conflicts with catatonit provided by catatonit-3:0.1.7-7.el9.x86_64\n  - cannot install the best candidate for the job08:49
tkajinamah, ok08:49
opendevreviewSoniya Murlidhar Vyas proposed openstack/tripleo-quickstart master: Run featureset002 job with tempest-allow  https://review.opendev.org/c/openstack/tripleo-quickstart/+/83972508:54
opendevreviewchandan kumar proposed openstack/tripleo-quickstart master: Downgrade containers-common to 1-40  https://review.opendev.org/c/openstack/tripleo-quickstart/+/85558708:55
tkajinamchkumar|ruck, fortunately these two are in the same repo so we might end up with squashing these two08:55
tkajinamunless centos folks fixes the package quite soon08:55
chkumar|rucktkajinam: ^^ yes done08:55
tkajinamchkumar|ruck, nice :-D08:56
lecris[m]Just a rant, but as I understand, centos was chosen as a default because it is "stable" but as far as I've seen it is not that with podman missing catatonit at some point and so on09:07
lecris[m]Honestly supporting Fedora is not much different and it would more user friendly to include the packages in copr and/or fedora core. Using rdo has not been more stable either as at one point it renamed openvswitch packages making undercloud uninstallable for a few days09:10
opendevreviewCedric Jeanneret proposed openstack/tripleo-heat-templates master: [WIP] Convert apache configurations to new role  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/85456809:12
lecris[m]Can we track anywhere common tripleo configurations that a user would encounter at first and second execution according to the documentations?09:14
*** ysandeep is now known as ysandeep|afk09:49
lecris[m]What is the role/play responsible for installing the `centos-release-ceph-pacific` in the image building? It needs to be upgraded to `quincy` otherwise  ceph deploy fails10:25
*** rlandy|out is now known as rlandy10:37
opendevreviewRafal Lewandowski proposed openstack/diskimage-builder master: changed release check logic in lvm element  https://review.opendev.org/c/openstack/diskimage-builder/+/85456610:40
opendevreviewManojkatari proposed openstack/tripleo-ansible master: Add tripleo_etcd ansible role  https://review.opendev.org/c/openstack/tripleo-ansible/+/84902410:41
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/wallaby: Avoid failure when non DPDK instances present  https://review.opendev.org/c/openstack/tripleo-validations/+/85564410:55
opendevreviewJiri Podivin proposed openstack/tripleo-validations stable/train: Avoid failure when non DPDK instances present  https://review.opendev.org/c/openstack/tripleo-validations/+/85564510:57
jpodivinBoth ^^ WIP until master is merged and train tested. 10:57
*** ysandeep|afk is now known as ysandeep11:08
opendevreviewamolkahat proposed openstack/tripleo-quickstart-extras master: [DNM] Testing dlrn_hash_tags for compute deployment  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/85391511:08
*** carloss is now known as carloss|afk11:28
opendevreviewmbu proposed openstack/validations-libs master: Add CI job for podified VF  https://review.opendev.org/c/openstack/validations-libs/+/85564711:32
opendevreviewmbu proposed openstack/validations-libs master: Add CI job for podified VF  https://review.opendev.org/c/openstack/validations-libs/+/85564711:44
*** bogdando_ is now known as bogdando11:46
opendevreviewRafal Lewandowski proposed openstack/diskimage-builder master: - added elrepo element  https://review.opendev.org/c/openstack/diskimage-builder/+/85381711:49
*** bogdando_ is now known as bogdando11:54
opendevreviewDaniel Bengtsson proposed openstack/tripleo-heat-templates master: Use python -m instead pip directly.  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/85565112:00
chkumar|ruckslagle: hello12:27
chkumar|ruckslagle: we need to do a force merge https://review.opendev.org/c/openstack/tripleo-quickstart/+/855587/ 12:27
chkumar|ruckto clear our gate12:27
chkumar|ruckhttps://zuul.opendev.org/t/openstack/status#855587, - one of the job is stuck12:27
chkumar|ruckif tripleo-ci-centos-9-undercloud-containers - https://zuul.opendev.org/t/openstack/stream/52ffc5d44ebd456e94bbbab7b740a1c0?logfile=console.log12:28
chkumar|ruckUpdate all installed packages after new repos are setup12:28
chkumar|ruckif we update the patch, it will take 3+hr to finish the check and another 3 to gate12:28
slaglechkumar|ruck: wfm. I added my +2. 12:29
chkumar|ruckslagle: thank you :-)12:29
chkumar|ruckI already got the vote from slagle12:29
chkumar|rucksorry12:29
slagledo we need to ping infra?12:31
chkumar|ruckslagle: I already pinged infra on #opendev12:32
chkumar|ruckwaiting for someone to respond12:32
opendevreviewBogdan Dobrelya proposed openstack/ansible-role-collect-logs master: Also collect TCIB logs for containers  https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/85565512:33
opendevreviewBogdan Dobrelya proposed openstack/tripleo-common stable/wallaby: Update ovmf-amdsev from ovmf-cc to boot UEFI VMs  https://review.opendev.org/c/openstack/tripleo-common/+/85514212:36
opendevreviewRafal Lewandowski proposed openstack/diskimage-builder master: added elrepo element  https://review.opendev.org/c/openstack/diskimage-builder/+/85381712:38
opendevreviewDavid Hill proposed openstack/puppet-tripleo master: Allow a user to override HostKey  https://review.opendev.org/c/openstack/puppet-tripleo/+/85565712:45
chkumar|ruckseems no one is around, updating the patch12:51
opendevreviewchandan kumar proposed openstack/tripleo-quickstart master: Downgrade containers-common to 1-40  https://review.opendev.org/c/openstack/tripleo-quickstart/+/85558712:52
chkumar|ruckslagle: rlandy dviroel please add https://review.opendev.org/c/openstack/tripleo-quickstart/+/855587/ +2 and +w thanks!12:58
*** dasm|off is now known as dasm13:00
*** carloss|afk is now known as carloss13:03
opendevreviewRafal Lewandowski proposed openstack/diskimage-builder master: added elrepo element  https://review.opendev.org/c/openstack/diskimage-builder/+/85381713:09
opendevreviewmbu proposed openstack/validations-libs master: Add CI job for podified VF  https://review.opendev.org/c/openstack/validations-libs/+/85564713:16
opendevreviewCedric Jeanneret proposed openstack/tripleo-heat-templates master: [WIP] Convert apache configurations to new role  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/85456813:19
opendevreviewchandan kumar proposed openstack/tripleo-quickstart master: Use featureset053 for standalone roles testing  https://review.opendev.org/c/openstack/tripleo-quickstart/+/85433713:27
opendevreviewchandan kumar proposed openstack/tripleo-quickstart master: Use featureset053 for standalone roles testing  https://review.opendev.org/c/openstack/tripleo-quickstart/+/85433713:27
opendevreviewCedric Jeanneret proposed openstack/tripleo-heat-templates master: [WIP] Convert apache configurations to new role  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/85456813:27
opendevreviewchandan kumar proposed openstack/tripleo-quickstart-extras master: Initial playbook to compute node using standalone ansible playbook  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/84383513:28
opendevreviewJiri Podivin proposed openstack/validations-libs master: VF container security and stability adjustment  https://review.opendev.org/c/openstack/validations-libs/+/85478213:38
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: Add openssh test_deps as container manager needs it  https://review.opendev.org/c/openstack/tripleo-ansible/+/85535813:44
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: tripleo_nova_libvirt: add for standalone roles  https://review.opendev.org/c/openstack/tripleo-ansible/+/84215213:44
opendevreviewBogdan Dobrelya proposed openstack/tripleo-ansible master: tripleo_nova_compute: add for standalone roles  https://review.opendev.org/c/openstack/tripleo-ansible/+/84365913:44
opendevreviewmbu proposed openstack/validations-libs master: Add CI job for podified VF  https://review.opendev.org/c/openstack/validations-libs/+/85564713:59
*** jpena is now known as jpena|off14:07
opendevreviewCedric Jeanneret proposed openstack/tripleo-heat-templates master: [WIP] Convert apache configurations to new role  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/85456814:26
*** ysandeep is now known as ysandeep|out14:34
lecris[m]tkajinam: beagles: https://bugs.launchpad.net/tripleo/+bug/198857814:36
lecris[m]This is the rabbitmq error I keep having with tls-e14:36
lecris[m]Maybe important to note, the ipa ca is signed by a separate ca root14:48
*** dviroel is now known as dviroel|lunch15:13
opendevreviewMerged openstack/tripleo-quickstart master: Downgrade containers-common to 1-40  https://review.opendev.org/c/openstack/tripleo-quickstart/+/85558716:13
*** dviroel|lunch is now known as dviroel16:41
*** dviroel is now known as dviroel|out20:56
*** dasm is now known as dasm|off21:32
opendevreviewMerged openstack/tripleo-common stable/wallaby: Clustercheck healthcheck with socat and ipv6  https://review.opendev.org/c/openstack/tripleo-common/+/85209823:40
opendevreviewMerged openstack/tripleo-ansible stable/train: tripleo-keystone-resources: reduce permissions for clouds.yaml  https://review.opendev.org/c/openstack/tripleo-ansible/+/85414123:40
opendevreviewMerged openstack/tripleo-heat-templates stable/wallaby: Fix collectd-sensubility script output  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/85413923:40
opendevreviewMerged openstack/tripleo-heat-templates master: Add 'ResellerAdmin' role to ceilometer user  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/85403323:40

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!