Thursday, 2021-01-07

« Wednesday, 2021-01-06 Index Friday, 2021-01-08 »
openstackgerritMerged openstack/tripleo-validations stable/victoria: Use the UBI8 image for testing  https://review.opendev.org/c/openstack/tripleo-validations/+/76910800:08
openstackgerritMerged openstack/tripleo-upgrade stable/victoria: Add wait_for_connection check after system_upgrade  https://review.opendev.org/c/openstack/tripleo-upgrade/+/76832500:08
openstackgerritMerged openstack/ansible-role-collect-logs master: Add conflict packages pattern  https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/76947600:08
openstackgerritMerged openstack/ansible-role-collect-logs master: Changing bash executable  https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/76720800:08
*** rfolco has joined #tripleo00:17
*** rfolco has quit IRC00:22
openstackgerritMerged openstack/tripleo-upgrade master: [FFWD] Propose a fix for node_upgrade_pre.sh.j2  https://review.opendev.org/c/openstack/tripleo-upgrade/+/76183600:22
openstackgerritMerged openstack/tripleo-image-elements master: Add doc/requirements  https://review.opendev.org/c/openstack/tripleo-image-elements/+/76929800:22
*** jmasud has quit IRC00:29
*** jmasud has joined #tripleo00:42
*** rfolco has joined #tripleo00:43
*** ayoung has quit IRC00:44
*** ayoung has joined #tripleo00:55
openstackgerritMerged openstack/python-tripleoclient master: Add --disable-container-prepare flag  https://review.opendev.org/c/openstack/python-tripleoclient/+/75344300:56
*** pmannidi_ has joined #tripleo01:08
*** pmannidi has quit IRC01:08
*** jmasud has quit IRC01:12
*** zzzeek has quit IRC01:19
*** zzzeek has joined #tripleo01:21
*** jmasud has joined #tripleo01:24
*** rh-jelabarre has joined #tripleo01:29
*** zzzeek has quit IRC01:33
*** zzzeek has joined #tripleo01:34
*** rh-jelabarre has quit IRC01:41
*** pmannidi has joined #tripleo01:46
openstackgerritMerged openstack/tripleo-heat-templates stable/victoria: Adding key_size option on the certificate creation  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/76950901:48
*** pmannidi_ has quit IRC01:49
*** holser has quit IRC01:55
openstackgerritRafael Folco proposed openstack/tripleo-ci master: Fix container-builds logs  https://review.opendev.org/c/openstack/tripleo-ci/+/76963502:05
*** zzzeek has quit IRC02:23
*** zzzeek has joined #tripleo02:26
*** rfolco has quit IRC02:41
*** skramaja has joined #tripleo03:00
*** jmasud has quit IRC03:21
openstackgerritMerged openstack/tripleo-image-elements master: ensure any ens3 interface is nuked during image build  https://review.opendev.org/c/openstack/tripleo-image-elements/+/76920903:25
*** jmasud has joined #tripleo03:28
*** psachin has joined #tripleo03:57
*** ysandeep|away is now known as ysandeep04:19
openstackgerritAlan Bishop proposed openstack/tripleo-common master: [WIP] TCIB: Add cinder-volume extend_start.sh script  https://review.opendev.org/c/openstack/tripleo-common/+/76965904:22
*** psachin has quit IRC04:33
*** jmasud has quit IRC04:37
*** sanjayu_ has joined #tripleo04:43
*** artom has quit IRC04:50
*** ratailor has joined #tripleo05:00
*** udesale has joined #tripleo05:02
*** ykarel has joined #tripleo05:03
*** jmasud has joined #tripleo05:15
*** udesale has quit IRC05:26
*** zzzeek has quit IRC05:29
*** udesale has joined #tripleo05:29
*** sanjayu_ has quit IRC05:34
*** zzzeek has joined #tripleo05:35
*** zzzeek has quit IRC05:46
*** zzzeek has joined #tripleo05:52
*** zzzeek has quit IRC06:02
*** zzzeek has joined #tripleo06:04
pojadhav|roverykarel, 0/06:20
*** zbr has quit IRC06:21
ykarelpojadhav|rover, o/06:22
pojadhav|roverwant to discuss about comment : https://review.opendev.org/c/openstack/tripleo-ci/+/769536/1/roles/run-test/templates/toci_gate_test.sh.j206:22
*** ysandeep is now known as ysandeep|afk06:23
ykarelreading06:23
*** sanjayu_ has joined #tripleo06:23
pojadhav|roverdo I need to add seperate condition to check if package manger is "/usr/bin/yum"..?06:23
*** zbr has joined #tripleo06:23
pojadhav|roverand also need to unserstand why we need this condition.06:24
ykarelpojadhav|rover, yes additional condition for /usr/bin/yum, as python3-requests is not available in CentOS7 base repos06:25
ykarelso we can install requests via pip on those systems06:25
pojadhav|roverykarel, ack06:26
openstackgerritMerged openstack/tripleo-quickstart master: Enable QoS related L3 agent extensions in featureset020  https://review.opendev.org/c/openstack/tripleo-quickstart/+/75983206:27
openstackgerritMerged openstack/tripleo-quickstart master: Only use repo_config for dependency if file exists  https://review.opendev.org/c/openstack/tripleo-quickstart/+/76954506:27
*** hakhande has joined #tripleo06:29
*** hakhande_ has joined #tripleo06:29
*** ksambor has joined #tripleo06:29
ykareli replied on patch too ysandeep|afk pojadhav|rover06:30
pojadhav|roverykarel, ack06:48
*** lmiccini has joined #tripleo06:53
*** marios has joined #tripleo06:55
*** ysandeep|afk is now known as ysandeep06:58
openstackgerritPooja Jadhav proposed openstack/tripleo-ci master: Fix import error for requests module  https://review.opendev.org/c/openstack/tripleo-ci/+/76953607:00
*** rcernin has quit IRC07:07
openstackgerritPooja Jadhav proposed openstack/tripleo-ci master: Fix import error for requests module  https://review.opendev.org/c/openstack/tripleo-ci/+/76953607:12
ykarelpojadhav|rover, a fix needed in ^07:12
pojadhav|roverif/else block only?07:13
*** hjensas|PTO has quit IRC07:13
ykarelpojadhav|rover, i mean just space07:19
ysandeepykarel, ack , thanks!07:20
*** hjensas has joined #tripleo07:20
*** hakhande has quit IRC07:22
*** hakhande_ has quit IRC07:22
openstackgerritPooja Jadhav proposed openstack/tripleo-ci master: Fix import error for requests module  https://review.opendev.org/c/openstack/tripleo-ci/+/76953607:23
*** hakhande has joined #tripleo07:23
openstackgerritHarald Jensås proposed openstack/tripleo-quickstart-extras master: Add ironic_network_interface opts undercloud.conf.j2  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/75943307:26
openstackgerrityatin proposed openstack/tripleo-quickstart master: [DNM] Test ci.centos job with current-tripleo  https://review.opendev.org/c/openstack/tripleo-quickstart/+/76967807:35
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Add deployed_port template  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/76449307:37
openstackgerritHarald Jensås proposed openstack/tripleo-heat-templates master: Add sample network data files for network-data-v2  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/76521807:37
*** bandini has joined #tripleo07:38
*** sshnaidm has quit IRC08:02
*** jcapitao has joined #tripleo08:03
*** slaweq has joined #tripleo08:06
*** ysandeep is now known as ysandeep|lunch08:13
*** sshnaidm has joined #tripleo08:15
*** fmount has joined #tripleo08:16
*** gfidente has joined #tripleo08:17
*** jmasud has quit IRC08:19
*** amoralej has joined #tripleo08:22
openstackgerrityatin proposed openstack/tripleo-ci master: Fix import error for requests module  https://review.opendev.org/c/openstack/tripleo-ci/+/76953608:27
*** rpittau|afk is now known as rpittau08:37
*** tosky has joined #tripleo08:39
*** zzzeek has quit IRC08:53
openstackgerritShnaidman Sagi proposed openstack/tripleo-ansible stable/train: Remove pin of container tools  https://review.opendev.org/c/openstack/tripleo-ansible/+/76947808:53
*** zzzeek has joined #tripleo08:55
*** sanjayu_ has quit IRC09:00
*** lucasagomes has joined #tripleo09:03
ykarelsshnaidm, from rhel8 stream too it conflicts09:04
ykarelwrt ^ commit message09:04
sshnaidmykarel, yeah, seems like need to install either docker or podman?09:04
ykarelyes that should avoid it09:05
ykarelbut didn't get how it used to pass earlier09:05
ykarelif we have any success log we can confirm that09:05
*** jpich has joined #tripleo09:05
*** ysandeep|lunch is now known as ysandeep09:07
*** saneax has joined #tripleo09:08
sshnaidmykarel, it didn't pass09:10
sshnaidmykarel, jobs that use this playbook didn't run..09:10
sshnaidmit wasn't tested actually in the patch09:11
ykarelohkk makes sense than09:11
*** paramite has joined #tripleo09:12
*** zzzeek has quit IRC09:13
*** cylopez has joined #tripleo09:14
*** zzzeek has joined #tripleo09:14
*** paramite has quit IRC09:14
openstackgerritSofer Athlan-Guyot proposed openstack/tripleo-heat-templates stable/queens: [Queens] Handle ceph service restart during update.  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/76916909:21
openstackgerritShnaidman Sagi proposed openstack/tripleo-ansible stable/train: Don't install docker on centos 8  https://review.opendev.org/c/openstack/tripleo-ansible/+/76947809:25
*** zzzeek has quit IRC09:28
*** zzzeek has joined #tripleo09:30
*** derekh has joined #tripleo09:32
*** zzzeek has quit IRC09:35
*** zzzeek has joined #tripleo09:36
*** zzzeek has quit IRC09:49
*** zzzeek has joined #tripleo09:50
*** zzzeek has quit IRC09:54
*** zzzeek has joined #tripleo09:56
*** bogdando has quit IRC09:57
*** dtantsur|afk is now known as dtantsur10:02
*** pmannidi has quit IRC10:12
*** pmannidi has joined #tripleo10:15
openstackgerritdaniel.pawlik proposed openstack/diskimage-builder master: Replace Fedora 31 functional tests with Fedora 33  https://review.opendev.org/c/openstack/diskimage-builder/+/76809210:22
*** zzzeek has quit IRC10:33
*** zzzeek has joined #tripleo10:34
openstackgerritShnaidman Sagi proposed openstack/tripleo-ansible stable/train: Don't install docker on centos 8  https://review.opendev.org/c/openstack/tripleo-ansible/+/76947810:41
*** efoley has joined #tripleo10:55
openstackgerritSorin Sbârnea proposed openstack/tripleo-common stable/victoria: Enable pylint  https://review.opendev.org/c/openstack/tripleo-common/+/76959411:00
openstackgerritSorin Sbârnea proposed openstack/tripleo-common stable/ussuri: Enable pylint  https://review.opendev.org/c/openstack/tripleo-common/+/76959511:01
openstackgerritHarald Jensås proposed openstack/python-tripleoclient master: Add routes and MTU to ctlplane attrs for standalone  https://review.opendev.org/c/openstack/python-tripleoclient/+/76970911:08
*** udesale_ has joined #tripleo11:15
*** udesale has quit IRC11:17
*** cylopez has quit IRC11:24
*** jmasud has joined #tripleo11:38
*** jcapitao is now known as jcapitao_lunch11:38
openstackgerritShnaidman Sagi proposed openstack/tripleo-ansible stable/train: Don't install docker on centos 8  https://review.opendev.org/c/openstack/tripleo-ansible/+/76947811:44
*** zzzeek has quit IRC11:46
*** zzzeek has joined #tripleo11:47
*** pleimer has quit IRC11:50
*** pleimer_ has joined #tripleo11:50
*** zzzeek has quit IRC11:59
*** zzzeek has joined #tripleo12:01
*** ratailor has quit IRC12:06
openstackgerrityatin proposed openstack/tripleo-quickstart master: [DNM] Test ci.centos job with current-tripleo  https://review.opendev.org/c/openstack/tripleo-quickstart/+/76967812:13
*** rfolco has joined #tripleo12:19
openstackgerritEduardo Olivares proposed openstack/tripleo-heat-templates master: Configure OVNCMSOptions=enable-chassis-as-gw within neutron-ovn-sriov.yaml  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/76971812:19
*** udesale__ has joined #tripleo12:19
*** udesale_ has quit IRC12:22
*** udesale_ has joined #tripleo12:22
openstackgerritRafael Folco proposed openstack/tripleo-ci master: Fix container-builds logs  https://review.opendev.org/c/openstack/tripleo-ci/+/76963512:25
*** udesale__ has quit IRC12:25
*** jmasud has quit IRC12:27
*** abdysn has joined #tripleo12:35
openstackgerritMerged openstack/tripleo-common stable/train: Fix ImportWarning during importing a module  https://review.opendev.org/c/openstack/tripleo-common/+/76840812:36
*** rh-jelabarre has joined #tripleo12:40
*** zzzeek has quit IRC12:42
*** zzzeek has joined #tripleo12:43
openstackgerritFrancesco Pantano proposed openstack/tripleo-heat-templates stable/queens: [QUEENS-ONLY] - Add ignore_errors to the docker stop task  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/76972112:43
*** rlandy has joined #tripleo12:51
sshnaidmcloudnull, hi, maybe you will have thoughts about: https://bugs.launchpad.net/tripleo/+bug/191053612:58
openstackLaunchpad bug 1910536 in tripleo "The retrying containers build fails in content provider jobs" [Critical,Triaged]12:58
sshnaidmweshay|ruck, pojadhav|rover fyi ^12:59
sshnaidmmwhahaha, take a look please, unblocking train: https://review.opendev.org/c/openstack/tripleo-ansible/+/76947813:00
*** jcapitao_lunch is now known as jcapitao13:06
*** amoralej is now known as amoralej|lunch13:09
*** lmiccini has quit IRC13:13
*** lmiccini has joined #tripleo13:17
openstackgerritMerged openstack/tripleo-quickstart-extras master: Switch to python3 venv by default  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/76423213:19
openstackgerritSorin Sbârnea proposed openstack/tripleo-common master: pylint: fixed logging  https://review.opendev.org/c/openstack/tripleo-common/+/76953913:33
*** gchamoul has quit IRC13:41
openstackgerritDamien Ciabrini proposed openstack/tripleo-heat-templates stable/ussuri: Rolling certificate update for HA services  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/76011713:42
*** gchamoul has joined #tripleo13:43
*** gchamoul has quit IRC13:44
*** gchamoul has joined #tripleo13:45
*** gchamoul has quit IRC13:46
*** gchamoul has joined #tripleo13:50
*** xek has quit IRC13:56
*** xek has joined #tripleo14:05
*** artom has joined #tripleo14:07
*** irclogbot_0 has quit IRC14:09
*** amoralej|lunch is now known as amoralej14:11
cloudnullsshnaidm looking into https://bugs.launchpad.net/tripleo/+bug/1910536 now14:13
openstackLaunchpad bug 1910536 in tripleo "The retrying containers build fails in content provider jobs" [Critical,Triaged]14:13
*** irclogbot_1 has joined #tripleo14:13
cloudnullsshnaidm I wonder if our use of tenacity is in the wrong section, like its retrying and skipping sections of code in the process?14:15
cloudnullIDK if there's a good fix for that, is there a way to simply increase the timeout in slow environments?14:15
openstackgerritHarald Jensås proposed openstack/python-tripleoclient master: Add routes and MTU to ctlplane attrs for standalone  https://review.opendev.org/c/openstack/python-tripleoclient/+/76970914:16
sshnaidmcloudnull, this is actually repeating of whole build role14:19
openstackgerritAlan Bishop proposed openstack/tripleo-heat-templates master: DNM: Don't run c-vol under pcmk to test TCIB change  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/76973414:20
sshnaidmcloudnull, afaiu it should repeat the whole process14:20
sshnaidmbut maybe I miss something14:20
openstackgerritJohn Fulton proposed openstack/tripleo-docs master: Document CinderVolumeEdge service  https://review.opendev.org/c/openstack/tripleo-docs/+/76956114:20
*** avivgta has quit IRC14:21
openstackgerritJohn Fulton proposed openstack/tripleo-docs master: Document CinderVolumeEdge service  https://review.opendev.org/c/openstack/tripleo-docs/+/76956114:22
openstackgerritAlex Schultz proposed openstack/tripleo-common stable/victoria: Fix localization for horizon container  https://review.opendev.org/c/openstack/tripleo-common/+/76973714:22
*** paramite has joined #tripleo14:22
cloudnullsshnaidm it looks like its failing here -https://github.com/openstack/tripleo-common/blob/master/tripleo_common/image/builder/buildah.py#L150-L158 and repeating the build function, which is called here https://github.com/openstack/tripleo-common/blob/master/tripleo_common/image/builder/buildah.py#L142 and threaded here14:23
cloudnullhttps://github.com/openstack/tripleo-common/blob/master/tripleo_common/image/builder/buildah.py#L329-L33914:23
openstackgerritJohn Fulton proposed openstack/tripleo-docs master: Document CinderVolumeEdge service  https://review.opendev.org/c/openstack/tripleo-docs/+/76956114:24
cloudnullso I think its trying to rerun just the failed command, but idk if that is working as we think it should14:24
paramiteGreetings guys, can somebody please move on with any of https://review.opendev.org/q/owner:mmagr%2540redhat.com+status:open ? I would be really glad for having the backports merged at least.14:24
cloudnullI wonder if there's a fail cooldown we should add?14:25
cloudnullparamite looking14:25
sshnaidmzbr, I think you worked on this recently, right? ^^ and  https://bugs.launchpad.net/tripleo/+bug/191053614:25
openstackLaunchpad bug 1910536 in tripleo "The retrying containers build fails in content provider jobs" [Critical,Triaged]14:25
zbrsshnaidm: i worked only on retry logging, the errors has nothing to do with my work.14:27
zbrthe missing container files comes from the code, unrelated to the retry.14:27
sshnaidmzbr, they come from retry actually14:28
zbrwhich is normal, but I do not see a problem within tenacity itself.14:28
zbrthe error is clearly an ProcessExecutionError14:29
zbr"buildah bud" returned 1, so clearly failed.14:29
sshnaidmzbr, so seems like tenacity doesn't work with builds14:33
sshnaidmit fails when retries14:33
cloudnullyeah I think there may need to be some cleanup when it fails before the buildah command can be executed again14:33
cloudnullidk what we'd need to clean up though14:33
zbrcloudnull: or fix buildah to be make it idempotent? in the end is not the role of the retry library to clean buildah mess ;)14:34
mwhahahathe generated file shouldn't go away if the bud call fails14:34
mwhahahathis feels like a filesystem issue14:34
zbri read something about AFP issues on infra14:34
cloudnull++ that could be an issue too14:35
cloudnullmaybe a simple cooldown when executing a retry would solve it?14:35
sshnaidmcloudnull, idk, if it doesn't find file anymore..?14:36
cloudnulllike in the case of a filesystem lock or missing inode ?14:36
zbr afs errors, check #opendev channel14:36
mwhahahaafs wouldn't be the test node14:36
cloudnullespecially in vexx14:36
cloudnullparamite - https://review.opendev.org/c/openstack/tripleo-heat-templates/+/757579 - one comment on that review14:37
cloudnullotherwise the rest look good14:37
*** slaweq has quit IRC14:37
*** skramaja has quit IRC14:37
*** TrevorV has joined #tripleo14:37
openstackgerritRafael Folco proposed openstack/tripleo-ci master: Fix container-builds logs  https://review.opendev.org/c/openstack/tripleo-ci/+/76963514:37
sshnaidmcloudnull, I'll try to increase timeout firstly, but retrying we do mostly on vexx nodes and all retries fail, so I assume it's broken atm14:38
sshnaidmI agree with mwhahaha that files shouldn't be removed when bud fails14:39
*** slaweq has joined #tripleo14:40
sshnaidmideally would be cool that only failed or not-built containers would retry..14:40
mwhahahai thought we do14:40
mwhahahavia tenancity14:40
ykarelactually i think there are two retries running, one via ansible(full command trigger) and other via tenacity(individual image)14:42
ykarelin the above job ansible retry timed out14:42
ykarel2021-01-06 18:36:33.989111 | primary | FAILED - RETRYING: Run tripleo container image build (1 retries left).14:43
ykarel2021-01-06 16:26:41.153918 | primary | TASK [tripleo.operator.tripleo_container_image_build : Run tripleo container image build] ***14:43
sshnaidmso we have nested retries? :)14:46
cloudnullsshnaidm yeah the only retry should be the threaded command. each thread should be one container build command14:46
*** jfrancoa has joined #tripleo14:46
ykarelalso with ansible retry logs from previous run lost due to >/home/zuul/container_image_build.log14:47
sshnaidmykarel, yeah, I'll handle this as well14:47
sshnaidmneed to know what failed in first retry14:47
cloudnullah, ykarel ++ that could cause some confusion / frustration as well14:47
*** pojadhav|rover is now known as pojadhav|away14:58
ykarelsshnaidm, cloudnull https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/build-containers/tasks/build-report.yaml#L5 caused that missing file issue14:58
ykarelzuul run timed out at 19:02:1814:58
ykarelbut in background container build was running14:59
ykareland then mv task moved those files to other location14:59
ykareland container build failed with missing files errors14:59
sshnaidmah, so errors started when job actually finished15:00
*** dasp_ has joined #tripleo15:00
*** dasp has quit IRC15:01
sshnaidmbuild-report runs in post playbooks15:01
sshnaidmwell, need to figure out something for vexx nodes, running build containers for 3 hours it's crazy :(15:02
*** abdysn has quit IRC15:04
cloudnullykarel maybe we cp instead of mv ?15:07
openstackgerritHervé Beraud proposed openstack/openstack-virtual-baremetal master: Add doc/requirements  https://review.opendev.org/c/openstack/openstack-virtual-baremetal/+/76976215:10
*** udesale_ has quit IRC15:11
ykarelyes could be an option or do the processing in same directory instead of copying/moving don't know if there is some specific reason to move those15:11
ykareli see size for that directory is 9.8 M 9.8M/home/zuul/workspace/logs/container-builds15:11
ykarelso copying would lead to duplicate space usage15:12
paramitecloudnull, thank you mister, will check the comment15:13
openstackgerritMartin Magr proposed openstack/tripleo-heat-templates master: Fluentd cleanup in rsyslog implementation  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/75757915:17
*** jfrancoa has quit IRC15:18
openstackgerritEduardo Olivares proposed openstack/tripleo-heat-templates master: Configure OVNCMSOptions=enable-chassis-as-gw within neutron-ovn-sriov.yaml  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/76971815:22
*** slaweq has quit IRC15:22
*** slaweq has joined #tripleo15:28
openstackgerritMartin Magr proposed openstack/tripleo-heat-templates master: Fluentd cleanup in rsyslog implementation  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/75757915:40
openstackgerritAlex Schultz proposed openstack/python-tripleoclient stable/train: [TRAIN-Only] Reduce open mock scope  https://review.opendev.org/c/openstack/python-tripleoclient/+/76959915:40
openstackgerritShnaidman Sagi proposed openstack/tripleo-operator-ansible master: Backup previous log file when retries task  https://review.opendev.org/c/openstack/tripleo-operator-ansible/+/76977315:45
sshnaidmykarel, mwhahaha maybe something like this ^15:45
openstackgerritAlex Schultz proposed openstack/python-tripleoclient stable/victoria: Add --disable-container-prepare flag  https://review.opendev.org/c/openstack/python-tripleoclient/+/76973915:45
ykarelsshnaidm, btw i checked logs, and i see it build all containers on first try and pushed 109/11215:46
mwhahahaehhhh we already preserve log file as part of the overall process15:46
ykareland as per timing it seems it timedout and retried15:46
mwhahahai think the issue is the use of retries15:47
ykareltimeout is 7200 sec15:47
mwhahahai kinda think we shouldn't retry the build command itself15:48
mwhahahasince we already retry a bunch in the command15:48
ykarel+115:48
openstackgerritAlex Schultz proposed openstack/tripleo-ansible stable/ussuri: Allow disabling image_params_prepare task  https://review.opendev.org/c/openstack/tripleo-ansible/+/76977415:49
ykarelfor the slowness, can try bumping 7200 timeout some more15:50
sshnaidmyeah, seems like task retries doesn't help much15:52
openstackgerritShnaidman Sagi proposed openstack/tripleo-quickstart-extras master: Increase timeout for containers build  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/76977715:54
sshnaidmykarel, mwhahaha weshay|ruck ^15:54
openstackgerritMartin Magr proposed openstack/tripleo-heat-templates stable/rocky: Add possibility to set logging source for Horizon  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/76977915:58
openstackgerritKevin Carter proposed openstack/tripleo-common master: Replace swift backend with native OS calls  https://review.opendev.org/c/openstack/tripleo-common/+/75342716:01
openstackgerritAlex Schultz proposed openstack/python-tripleoclient stable/ussuri: Add --disable-container-prepare flag  https://review.opendev.org/c/openstack/python-tripleoclient/+/76978116:04
openstackgerritKevin Carter proposed openstack/python-tripleoclient master: Update client to create local archive  https://review.opendev.org/c/openstack/python-tripleoclient/+/75786816:04
openstackgerritmbu proposed openstack/python-tripleoclient master: Remove tripleo_validator from tripleoclient  https://review.opendev.org/c/openstack/python-tripleoclient/+/76682016:08
*** ykarel has quit IRC16:12
*** tmazur has joined #tripleo16:15
openstackgerritShnaidman Sagi proposed openstack/tripleo-ansible stable/train: Don't install docker on centos 8  https://review.opendev.org/c/openstack/tripleo-ansible/+/76947816:21
weshay|ruckzbr, cloudnull fun fun https://zuul.openstack.org/builds?job_name=tripleo-ansible-centos-8-molecule-tripleo-modules&branch=stable%2Ftrain16:26
openstackgerritMerged openstack/tripleo-heat-templates master: Wire up new tripleo upgrades jobs template  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/76118916:26
weshay|ruckzbr, has some thoughts there16:26
weshay|rucksomething changed on the 4th16:26
zbrcloudnull: mainly master/usuri are green but train fails due to docker/podman conflicts, the green branches already removed docker.16:26
zbrdocker and podman are not compatible on centos-8, you cannot have both of them anymore.16:27
zbrthere were some hacks and for some limited period of time it was possible, but that hack was removed.16:28
*** paramite has quit IRC16:29
sshnaidmweshay|ruck, it's related to  Don't install docker on centos 8  https://review.opendev.org/c/openstack/tripleo-ansible/+/76947816:37
openstackgerritGregory Thiemonge proposed openstack/tripleo-ci master: WIP: enabling smoke tests for octavia scenario  https://review.opendev.org/c/openstack/tripleo-ci/+/76627816:46
*** ysandeep is now known as ysandeep|away16:47
*** lmiccini has quit IRC16:47
openstackgerritMarios Andreou proposed openstack/tripleo-docs master: WIP document the upgrades jobs  https://review.opendev.org/c/openstack/tripleo-docs/+/76979516:48
*** dpeacock has quit IRC16:49
openstackgerritMerged openstack/puppet-tripleo master: Wire up new tripleo upgrades jobs template  https://review.opendev.org/c/openstack/puppet-tripleo/+/76933816:50
*** dpeacock has joined #tripleo16:53
*** marios has quit IRC16:56
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: DNM - Retry connections to rdo trunk  https://review.opendev.org/c/openstack/tripleo-quickstart/+/76979916:57
*** lucasagomes has quit IRC16:58
openstackgerritRonelle Landy proposed openstack/tripleo-ci master: Make standalone-ipa jobs voting again - minus train  https://review.opendev.org/c/openstack/tripleo-ci/+/76276617:01
weshay|rucksshnaidm, ah thanks17:03
openstackgerritRonelle Landy proposed openstack/tripleo-quickstart master: DNM - Retry connections to rdo trunk  https://review.opendev.org/c/openstack/tripleo-quickstart/+/76979917:03
*** jmasud has joined #tripleo17:08
openstackgerritAlex Schultz proposed openstack/tripleo-ansible stable/train: Update for a podman_container from collection  https://review.opendev.org/c/openstack/tripleo-ansible/+/76936417:08
*** dtantsur is now known as dtantsur|afk17:13
openstackgerritRafael Folco proposed openstack/tripleo-ci master: Fix container-builds logs  https://review.opendev.org/c/openstack/tripleo-ci/+/76963517:16
*** rpittau is now known as rpittau|afk17:18
hakhandemwhahaha, ping17:27
mwhahaha?17:28
hakhandemwhahaha, can i speak to you regarding https://review.opendev.org/c/openstack/tripleo-heat-templates/+/748439 ?17:28
mwhahaha?17:29
hakhandemwhahaha, i separated timemaster service from chrony now as we discussed last time and submitted again, need your reviews on this17:30
*** jcapitao has quit IRC17:37
hakhandemwhahaha, thanks for comments17:41
*** jmasud has quit IRC17:49
*** amoralej is now known as amoralej|off17:49
*** hakhande has quit IRC17:53
*** derekh has quit IRC18:00
*** waleedm has joined #tripleo18:02
*** waleedm has quit IRC18:20
*** gfidente is now known as gfidente|afk18:42
*** jpich has quit IRC18:42
*** pleimer_ has quit IRC19:01
*** pleimer_ has joined #tripleo19:02
openstackgerritRafael Folco proposed openstack/tripleo-ci master: Fix container-builds logs  https://review.opendev.org/c/openstack/tripleo-ci/+/76963519:17
cloudnullum.... we have a problem https://review.opendev.org/c/openstack/python-tripleoclient/+/757868 - this got past linting, with the following error - https://review.opendev.org/c/openstack/python-tripleoclient/+/757868/7/tripleoclient/workflows/plan_management.py#18619:25
cloudnullweshay|ruck ^19:25
weshay|ruckheh19:25
* weshay|ruck looks19:25
cloudnullthat's spectacularly broken code which i pushed this morning19:26
*** saneax has quit IRC19:26
weshay|ruck):19:26
cloudnullonly found it because I was trying to build packages locally19:26
weshay|ruck):19:26
weshay|ruck):19:26
weshay|ruck):19:26
weshay|ruck):19:26
cloudnullI run local linting but, as you can see that didn't work19:26
cloudnullso....19:26
openstackgerritKevin Carter proposed openstack/python-tripleoclient master: Update client to create local archive  https://review.opendev.org/c/openstack/python-tripleoclient/+/75786819:27
cloudnullalso that review seemed to get past most of the gates.19:29
cloudnullwhich i think means we're not actually testing the local code changes.19:29
cloudnullunless the plan_management module is just never imported in all of the testing we're doing, except multi-node19:30
openstackgerritMerged openstack/python-tripleoclient stable/ussuri: [Validator Show] Properly throwing an exception for unknown validation  https://review.opendev.org/c/openstack/python-tripleoclient/+/76051919:32
*** jmasud has joined #tripleo19:39
openstackgerritMerged openstack/tripleo-heat-templates stable/victoria: Update container-config-scripts/ folder content before update_tasks.  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/76937319:42
openstackgerritMerged openstack/tripleo-upgrade stable/victoria: Host evacuate dynamic limit  https://review.opendev.org/c/openstack/tripleo-upgrade/+/76958219:42
openstackgerritMerged openstack/tripleo-upgrade stable/victoria: [ffwd] Don't run healthcheck on redis if it's not present  https://review.opendev.org/c/openstack/tripleo-upgrade/+/76957819:42
openstackgerritMerged openstack/tripleo-upgrade stable/victoria: [ffwd] Disable scheduling on computes before upgrade  https://review.opendev.org/c/openstack/tripleo-upgrade/+/76826519:42
*** sshnaidm is now known as sshnaidm|afk19:52
weshay|ruckcloudnull, off the phone.. so we should -1 wf the linter on the other branches19:59
weshay|ruckand put zbr back on the master patch19:59
weshay|ruckhttps://review.opendev.org/c/openstack/tripleo-common/+/76735820:00
openstackgerritMerged openstack/tripleo-common stable/ussuri: Fix localization for horizon container  https://review.opendev.org/c/openstack/tripleo-common/+/76754520:01
weshay|ruckcloudnull, does it fail when you remove some of disable conditions?20:02
cloudnullit only seems to fail when I was building pacakges with DLNR20:02
cloudnullotherwise it seems to pass everything20:03
weshay|ruckhrm..20:03
weshay|ruckbut it should always fail..20:03
mwhahahaif it fails in dlrn it should have failed in ci's building20:03
mwhahahawhat was the failure error?20:03
cloudnullonce i fixed the obvious code failure the packages build just fine20:03
mwhahahaoh i see it20:04
cloudnullyeah https://review.opendev.org/c/openstack/python-tripleoclient/+/757868/7/tripleoclient/workflows/plan_management.py#186 this was the code problem20:06
openstackgerritAlex Schultz proposed openstack/tripleo-repos master: WIP: update repo and module management  https://review.opendev.org/c/openstack/tripleo-repos/+/76982520:14
*** jmasud has quit IRC20:20
openstackgerritRafael Folco proposed openstack/ansible-role-collect-logs master: Fix build report log location  https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/76983020:34
openstackgerritShnaidman Sagi proposed openstack/tripleo-ansible stable/train: Update for a podman_container from collection  https://review.opendev.org/c/openstack/tripleo-ansible/+/76983120:41
sshnaidm|afkmwhahaha, cloudnull combined patches ^^ because of docker limits they can't go one by one20:41
mwhahahak20:42
*** chem has quit IRC20:44
*** chem has joined #tripleo20:46
*** TrevorV has quit IRC20:53
abishopmwhahaha: I could use some help with my tcib patch, https://review.opendev.org/c/openstack/tripleo-common/+/76965921:12
abishopbased on tripleo-build-containers-ubi-8 results, it seems I don't understand the correct layout for files I added to the container-images/kolla tree, as they're no appearing in the image21:13
* mwhahaha defers to cloudnull and runs away21:13
* cloudnull looks 21:13
abishopfor example, I wonder if I need to push my kolla/cinder-volume stuff down another level, go kolla/cinder-base/cinder-volume21:15
abishopI tried building locally, but got tired of shaving yaks deep down a rabbit hole21:15
*** holser has joined #tripleo21:25
openstackgerritAlex Schultz proposed openstack/tripleo-repos master: WIP: update repo and module management  https://review.opendev.org/c/openstack/tripleo-repos/+/76982521:30
mwhahahaabishop: commented, you need to add it into the container yaml so it makes it in there21:34
abishopmwhahaha: ah, like this: https://opendev.org/openstack/tripleo-common/src/branch/master/container-images/tcib/base/os/glance-api/glance-api.yaml#L421:36
mwhahahayes21:36
mwhahahaand the chmod21:36
abishopyep, I have a list of items like this from when I was manually hacking my own Dockerfile21:37
abishopmwhahaha, cloudnull: does each of these 'run' tcb_actions add another container layer? should I try to squash multiple lines when it's feasible?21:39
mwhahahayes21:39
cloudnullyes21:39
openstackgerritMerged openstack/tripleo-heat-templates stable/ussuri: Fix MetricsQdrUseSSL value  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/76212621:41
openstackgerritMerged openstack/tripleo-heat-templates stable/ussuri: Add possibility to set logging source for Horizon  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/75881221:41
openstackgerritRafael Folco proposed openstack/ansible-role-collect-logs master: Fix build report log location  https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/76983021:44
*** rfolco has quit IRC21:51
*** paramite has joined #tripleo21:51
*** pleimer_ has quit IRC21:55
openstackgerritAlan Bishop proposed openstack/tripleo-common master: TCIB: Add cinder-volume extend_start.sh script  https://review.opendev.org/c/openstack/tripleo-common/+/76965921:55
openstackgerritMerged openstack/tripleo-heat-templates stable/train: Add possibility to set logging source for Horizon  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/76221722:05
openstackgerritMerged openstack/tripleo-validations master: Restrict Ansible dependency  https://review.opendev.org/c/openstack/tripleo-validations/+/76622422:06
*** akio has joined #tripleo22:08
akioProblem: package python3-paunch-5.3.3-0.20201114155407.7e49691.el8.noarch requires podman = 1.6.4, but none of the providers can be installed22:10
akioDoes that look familiar to anyone ^^^ Any quick fixes?22:11
mwhahahayou need to use container-tools:2.022:11
akioHappens when deploying to a kvm guest on the virt-customize step on the dnf update at the end.22:12
akiooh! thank you22:12
akioI'm guessing I should hand edit that into the repo_setup.sh script?22:16
mwhahahaprobably22:17
mwhahahathough it seems like something i thought we baked into the containers22:17
mwhahahai guess not?22:17
mwhahahawait what's repo_setup.sh?22:18
akioI'm trying to follow https://opendev.org/openstack/tripleo-quickstart22:19
*** rcernin has joined #tripleo22:19
akioquickstart.sh runs an undercloud to a kvm guest, in the process the qcow2 customisation fails with the error posted abive22:20
mwhahahayou may need to asks the folks in #oooq about that.22:20
akioi've seen the podman 1.6.4 issue in other places - not sure why its happening in a current deployment method22:21
mwhahahayou might try https://github.com/cjeanner/tripleo-lab instead22:21
akiothanks I'll look22:22
akiotrying to help set up the availability monitoring to STF, wanted a test deployment to verify22:22
*** jmasud has joined #tripleo22:23
openstackgerritShnaidman Sagi proposed openstack/ansible-role-collect-logs master: Add pattern for proxy failure  https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/76984722:25
*** jmasud has quit IRC22:29
*** jmasud has joined #tripleo22:30
*** zzzeek has quit IRC22:30
*** jmasud has quit IRC22:30
*** zzzeek has joined #tripleo22:31
*** jmasud has joined #tripleo22:33
*** jmasud has quit IRC22:33
*** zzzeek has quit IRC22:36
*** zzzeek has joined #tripleo22:37
*** efoley has quit IRC22:40
openstackgerritShnaidman Sagi proposed openstack/ansible-role-collect-logs master: Add another packages failure pattern  https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/76985022:55
*** holser has quit IRC23:14
*** jbadiapa has quit IRC23:21
*** rlandy has quit IRC23:25
*** tmazur has quit IRC23:34
openstackgerritMerged openstack/python-tripleoclient stable/victoria: [UX] Align to left the table for the validations run results  https://review.opendev.org/c/openstack/python-tripleoclient/+/76936123:44
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: Use bind mounts for tls certificates  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/76768823:44
openstackgerritMerged openstack/tripleo-heat-templates stable/queens: [Queens] Handle ceph service restart during update.  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/76916923:44
openstackgerritMerged openstack/os-net-config master: Wire up new tripleo upgrades jobs template  https://review.opendev.org/c/openstack/os-net-config/+/76949123:45
openstackgerritMerged openstack/tripleo-quickstart-extras master: Wire up new tripleo upgrades jobs template  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/76949023:45
openstackgerritMerged openstack/tripleo-quickstart master: Wire up new tripleo upgrades jobs template  https://review.opendev.org/c/openstack/tripleo-quickstart/+/76948923:45
openstackgerritMerged openstack/python-tripleoclient master: Wire up new tripleo upgrades jobs template  https://review.opendev.org/c/openstack/python-tripleoclient/+/76933423:45
openstackgerritMerged openstack/tripleo-common master: Wire up new tripleo upgrades jobs template  https://review.opendev.org/c/openstack/tripleo-common/+/76916423:45
*** holser has joined #tripleo23:48
openstackgerritMerged openstack/tripleo-ci master: Allow to override extra_args & bm provisioning  https://review.opendev.org/c/openstack/tripleo-ci/+/76946923:52
openstackgerritMerged openstack/tripleo-heat-templates master: Configure Ceph clients via tripleo-ceph-client (not ceph-ansible)  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/76091523:53
*** tosky has quit IRC23:53
« Wednesday, 2021-01-06 Index Friday, 2021-01-08 »

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!