| *** hoonetorg has quit IRC | 00:10 | |
| *** rfolco has quit IRC | 00:22 | |
| openstackgerrit | Merged openstack/tripleo-ansible master: Login with buildah too to allow registry access with buildah https://review.opendev.org/739415 | 00:36 |
|---|---|---|
| *** rcernin has quit IRC | 00:42 | |
| *** rcernin has joined #tripleo | 00:46 | |
| *** rlandy has quit IRC | 01:28 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible stable/train: Molecule testing for TripleO Strategy Plugins https://review.opendev.org/739587 | 01:48 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible stable/train: Molecule testing for TripleO Strategy Plugins https://review.opendev.org/739587 | 01:48 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible stable/ussuri: Login with buildah too to allow registry access with buildah https://review.opendev.org/739868 | 01:49 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible stable/train: Login with buildah too to allow registry access with buildah https://review.opendev.org/739869 | 01:50 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/ussuri: Implement a new Container Images layout https://review.opendev.org/736751 | 01:53 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/ussuri: tcib/ceilometer-base: remove panko dependency https://review.opendev.org/739532 | 01:53 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/ussuri: Run standalone jobs with locally built images https://review.opendev.org/739533 | 01:54 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/ussuri: tcib: move cradox to gnocchi-base & enable ci on scenario001 https://review.opendev.org/739534 | 01:54 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/ussuri: Fix OVN Octavia provider driver package name https://review.opendev.org/739743 | 01:54 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-common stable/ussuri: Drop systemd support from nsswitch.conf https://review.opendev.org/739744 | 01:54 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/train: Fix privilege escalation https://review.opendev.org/739592 | 01:55 |
| *** rcernin has quit IRC | 02:13 | |
| *** apetrich has quit IRC | 02:14 | |
| *** rcernin has joined #tripleo | 02:15 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: Collapse host prep tasks https://review.opendev.org/739528 | 02:25 |
| openstackgerrit | Merged openstack/tripleo-ci master: Trigger standalone ipa job on changes to puppet rabbitmq https://review.opendev.org/739133 | 02:25 |
| *** rcernin has quit IRC | 02:33 | |
| *** rcernin has joined #tripleo | 02:55 | |
| openstackgerrit | Merged openstack/tripleo-common stable/train: Fix stdout_callback https://review.opendev.org/739283 | 03:17 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: Exclude /etc/hostname https://review.opendev.org/739497 | 03:17 |
| openstackgerrit | Merged openstack/puppet-tripleo stable/ussuri: Add FFU support for ceph_nfs https://review.opendev.org/739781 | 03:17 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: Add new parameter PublicTLSCACert https://review.opendev.org/738507 | 03:17 |
| openstackgerrit | Merged openstack/tripleo-common master: (TCIB) Remove validation related things from mistral container https://review.opendev.org/739746 | 03:17 |
| *** hjensas has quit IRC | 03:42 | |
| *** hjensas has joined #tripleo | 03:43 | |
| openstackgerrit | yatin proposed openstack/tripleo-ansible stable/ussuri: Use registry:2.7.0 instead of registry:2 https://review.opendev.org/739885 | 03:58 |
| openstackgerrit | yatin proposed openstack/tripleo-ansible stable/ussuri: Login with buildah too to allow registry access with buildah https://review.opendev.org/739868 | 03:59 |
| *** skramaja has joined #tripleo | 04:01 | |
| openstackgerrit | yatin proposed openstack/tripleo-ansible stable/train: Use registry:2.7.0 instead of registry:2 https://review.opendev.org/739888 | 04:06 |
| openstackgerrit | yatin proposed openstack/tripleo-ansible stable/train: Login with buildah too to allow registry access with buildah https://review.opendev.org/739869 | 04:10 |
| *** ykarel|away is now known as ykarel | 04:14 | |
| *** udesale has joined #tripleo | 04:28 | |
| *** evrardjp has quit IRC | 04:33 | |
| *** evrardjp has joined #tripleo | 04:33 | |
| *** saneax has joined #tripleo | 04:35 | |
| openstackgerrit | Merged openstack/tripleo-ci master: Add openstack-tempest-skiplist to list of external repos https://review.opendev.org/738022 | 04:50 |
| *** abdysn has joined #tripleo | 05:05 | |
| *** raukadah is now known as chandankumar | 05:09 | |
| *** marios has joined #tripleo | 05:17 | |
| *** lmiccini has joined #tripleo | 05:24 | |
| *** ratailor has joined #tripleo | 05:26 | |
| *** bandini has joined #tripleo | 05:30 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Add support for authfile in buildcontainers role https://review.opendev.org/739710 | 05:37 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/train: Refactor ceph-ansible upgrade https://review.opendev.org/738990 | 05:42 |
| openstackgerrit | Merged openstack/tripleo-common stable/ussuri: Switch to tripleo_dense https://review.opendev.org/739577 | 05:42 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: Add filestore to bluestore migration tags https://review.opendev.org/739611 | 05:42 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-ci master: Introduce stable jobs for tripleo-build-containers-ubi-8 https://review.opendev.org/739596 | 06:15 |
| sshnaidm|ruck | marios, chandankumar can you please review in your time ^ | 06:15 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-ci master: Introduce stable jobs for tripleo-build-containers-ubi-8 https://review.opendev.org/739596 | 06:19 |
| marios | ack sshnaidm|ruck | 06:19 |
| openstackgerrit | yatin proposed openstack/tripleo-ansible stable/train: Debug buildah login train https://review.opendev.org/739898 | 06:24 |
| *** xek has joined #tripleo | 06:25 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-ci master: DNM run tests https://review.opendev.org/739899 | 06:25 |
| *** xek_ has joined #tripleo | 06:27 | |
| *** xek has quit IRC | 06:30 | |
| *** ianw is now known as ianw_pto | 06:38 | |
| *** ccamacho has joined #tripleo | 06:42 | |
| *** dskontra has joined #tripleo | 06:54 | |
| openstackgerrit | Grzegorz Grasza proposed openstack/tripleo-quickstart-extras master: Remove dhclient before changing /etc/resolv.conf https://review.opendev.org/739905 | 06:59 |
| *** rcernin has quit IRC | 06:59 | |
| *** rdopiera has joined #tripleo | 07:02 | |
| *** rcernin has joined #tripleo | 07:06 | |
| *** maciejjozefczyk has joined #tripleo | 07:09 | |
| *** amoralej|off is now known as amoralej | 07:12 | |
| *** bogdando has joined #tripleo | 07:14 | |
| *** jcapitao has joined #tripleo | 07:15 | |
| *** jbadiapa has joined #tripleo | 07:16 | |
| *** lbragstad_ has joined #tripleo | 07:19 | |
| openstackgerrit | Merged openstack/tripleo-ansible master: Introduce an Action Plugin to fetch container infos https://review.opendev.org/738436 | 07:21 |
| openstackgerrit | Merged openstack/tripleo-ansible master: Introduce an Action Plugin to manage systemd services for containers https://review.opendev.org/738118 | 07:21 |
| *** lbragstad has quit IRC | 07:21 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: Fix tempestconf URL https://review.opendev.org/735428 | 07:22 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-ci master: Don't fail on EPEL disable if not exists https://review.opendev.org/739909 | 07:27 |
| sshnaidm|ruck | ykarel, ^^ | 07:27 |
| ykarel | sshnaidm|ruck, looking | 07:27 |
| sshnaidm|ruck | ykarel, do you know if wildcards work there? | 07:27 |
| ykarel | sshnaidm|ruck, wild cards where? | 07:28 |
| ykarel | dnf config-manager? | 07:28 |
| sshnaidm|ruck | ykarel, yeah, like "epel*" | 07:28 |
| ykarel | sshnaidm|ruck, yes it works | 07:29 |
| ykarel | i proposed that only in dib | 07:29 |
| sshnaidm|ruck | ok, so I'll change then | 07:29 |
| *** gfidente has joined #tripleo | 07:29 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-ci master: Don't fail on EPEL disable if not exists https://review.opendev.org/739909 | 07:30 |
| *** xek_ has quit IRC | 07:30 | |
| *** tosky has joined #tripleo | 07:33 | |
| *** zbr has joined #tripleo | 07:35 | |
| *** rcernin has quit IRC | 07:41 | |
| openstackgerrit | yatin proposed openstack/tripleo-ansible stable/train: Debug buildah login train https://review.opendev.org/739898 | 07:42 |
| ykarel | sshnaidm|ruck, chandankumar can u review https://review.opendev.org/#/c/739689/ | 07:44 |
| *** suuuper has joined #tripleo | 07:46 | |
| *** hjensas has quit IRC | 07:49 | |
| *** jpich has joined #tripleo | 07:50 | |
| *** jfrancoa has joined #tripleo | 07:56 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-ansible stable/ussuri: Set short ANSIBLE_SSH_CONTROL_PATH_DIR for all ceph roles https://review.opendev.org/739068 | 08:02 |
| *** dtantsur|afk is now known as dtantsur | 08:10 | |
| openstackgerrit | yatin proposed openstack/tripleo-ansible stable/train: Login with buildah too to allow registry access with buildah https://review.opendev.org/739869 | 08:13 |
| *** sanjayu_ has joined #tripleo | 08:17 | |
| *** lucasagomes has joined #tripleo | 08:19 | |
| *** derekh has joined #tripleo | 08:19 | |
| *** saneax has quit IRC | 08:20 | |
| *** sanjayu_ has quit IRC | 08:22 | |
| *** sanjayu_ has joined #tripleo | 08:22 | |
| *** tkajinam has quit IRC | 08:23 | |
| *** sanjayu__ has joined #tripleo | 08:25 | |
| *** sanjayu_ has quit IRC | 08:27 | |
| *** zbr7 has joined #tripleo | 08:31 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible stable/ussuri: Introduce an Action Plugin to fetch container infos https://review.opendev.org/739927 | 08:41 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Add support for OSP containers in new build process https://review.opendev.org/739385 | 08:50 |
| *** pkopec has joined #tripleo | 08:54 | |
| *** hjensas has joined #tripleo | 09:01 | |
| *** xek_ has joined #tripleo | 09:07 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo master: Fix up cluster_setup_extras usage https://review.opendev.org/739933 | 09:17 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker master: Make sure we pass cluster_setup_extras when using pcs 0.10 https://review.opendev.org/739934 | 09:17 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: WIP Remove deprecated ipv6 corosync parameters https://review.opendev.org/739936 | 09:20 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-ci master: Add centos8 standalone-upgrade master and stable/ussuri jobs https://review.opendev.org/738844 | 09:24 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-ci master: Add centos8 container updates and upgrades jobs -ussuri train https://review.opendev.org/739217 | 09:24 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-ci master: Add centos-8-containerized-undercloud-upgrades job ussuri/master https://review.opendev.org/739218 | 09:24 |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-ci master: Add previous_release_mixed_upgrade_case ussuri to template https://review.opendev.org/739939 | 09:24 |
| *** rcernin has joined #tripleo | 09:27 | |
| *** rcernin has quit IRC | 09:41 | |
| *** xek_ has quit IRC | 09:44 | |
| openstackgerrit | Harald Jensås proposed openstack/openstack-virtual-baremetal master: Add prefix --id support for the radvd and dhcrelay https://review.opendev.org/715575 | 09:45 |
| sshnaidm|ruck | gfidente, do you know maybe what is wrong in train job with ceph-ansible? https://logserver.rdoproject.org/63/27463/16/check/periodic-tripleo-ci-centos-7-scenario004-standalone-train/b23d9a7/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 09:46 |
| sshnaidm|ruck | soniya29|rover, can you please make a bug about? ^ | 09:47 |
| ysandeep | sshnaidm|ruck, https://tree.taiga.io/project/tripleo-ci-board/task/1850?kanban-status=1447275 fyi.. there is a tiaga for same issue | 09:48 |
| gfidente | sshnaidm|ruck yeah it was broken, this should have fixed it https://review.opendev.org/#/c/739613/ | 09:48 |
| sshnaidm|ruck | gfidente, ack, thanks | 09:49 |
| sshnaidm|ruck | ysandeep, cool, but this kind of things have to be in LP, not in taiga | 09:49 |
| ysandeep | sshnaidm|ruck, i agree with you.. may be because these are new jobs.. sometime created tiaga instead of lp | 09:50 |
| sshnaidm|ruck | ysandeep, we should have bugs to launchpad, there are scripts that escalate them from there, triage process etc | 09:50 |
| sshnaidm|ruck | chandankumar, ^ | 09:51 |
| ysandeep | sshnaidm|ruck, I agree | 09:51 |
| ysandeep | bhagyashris, fyi.. https://review.opendev.org/#/c/739613/ might solve issue with sc4 ceph , you can send a test patch to confirm | 09:53 |
| chandankumar | sshnaidm|ruck, ysandeep, yes I agree, while working on c8 tasks, I have added as a task so that team can pick it and fix c8 train failing jobs | 09:54 |
| *** dskontra has quit IRC | 09:54 | |
| sshnaidm|ruck | chandankumar, yeah, it's fine, but need to open bug as well if it affects promotion | 09:54 |
| chandankumar | sshnaidm|ruck, yes | 09:55 |
| *** derekh has quit IRC | 09:57 | |
| *** derekh has joined #tripleo | 09:58 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Fix DIB scripts python version https://review.opendev.org/739844 | 10:06 |
| bhagyashris | ysandeep, ack | 10:21 |
| soniya29|rover | sshnaidm|ruck, ack | 10:22 |
| *** pojadhav is now known as pojadhav|afk | 10:26 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-upgrade master: Fix conditional for python3-tripleoclient in undercloud pre-reqs https://review.opendev.org/739946 | 10:32 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Remove ffwd-upgrade leftovers from THT. https://review.opendev.org/739604 | 10:34 |
| *** rfolco has joined #tripleo | 10:38 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-ci master: Add centos-8-containerized-undercloud-upgrades job ussuri/master https://review.opendev.org/739218 | 10:40 |
| marios | ccamacho: chem: jfrancoa: can you please add to your reviews list for when you next have time thanks https://review.opendev.org/739946 | 10:41 |
| *** bhagyashris is now known as bhagyashris|brb | 10:42 | |
| ccamacho | hi marios :) sure thing | 10:42 |
| marios | ccamacho: thanks :) | 10:42 |
| jfrancoa | marios: sure! | 10:42 |
| marios | thanks jfrancoa | 10:43 |
| *** apetrich has joined #tripleo | 10:44 | |
| *** bhagyashris|brb is now known as bhagyashris | 10:59 | |
| *** jcapitao is now known as jcapitao_lunch | 11:00 | |
| *** udesale_ has joined #tripleo | 11:03 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates stable/train: DNM Test centos8 scen0 containers update train https://review.opendev.org/739459 | 11:04 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: WIP Remove /run from some services https://review.opendev.org/739950 | 11:05 |
| *** udesale has quit IRC | 11:06 | |
| *** ysandeep is now known as ysandeep|brb | 11:11 | |
| *** pojadhav|afk is now known as pojadhav | 11:14 | |
| soniya29|rover | sshnaidm|ruck, https://bugs.launchpad.net/tripleo/+bug/1886806 | 11:16 |
| openstack | Launchpad bug 1886806 in tripleo "standalone deployment fails" [Undecided,Triaged] | 11:16 |
| sshnaidm|ruck | soniya29|rover, this is solved, see above | 11:19 |
| soniya29|rover | sshnaidm|ruck, ohh yes, missed it | 11:25 |
| *** dsneddon has quit IRC | 11:25 | |
| *** ysandeep|brb is now known as ysandeep | 11:25 | |
| *** dsneddon has joined #tripleo | 11:26 | |
| sshnaidm|ruck | stevebaker, can you please take a look? https://bugs.launchpad.net/tripleo/+bug/1879472 | 11:30 |
| openstack | Launchpad bug 1879472 in tripleo "OVB overcloud deploy fails sporadically with "not enough free physical ports" error" [Critical,Triaged] | 11:30 |
| *** sanjayu__ has quit IRC | 11:36 | |
| *** raildo has joined #tripleo | 11:37 | |
| *** pojadhav is now known as pojadhav|brb | 11:39 | |
| *** rlandy has joined #tripleo | 11:41 | |
| *** xek_ has joined #tripleo | 11:44 | |
| bfournie | sshnaidm|ruck: he isn't available right now as he's in NZ, I will work with him on this later in the day today | 11:46 |
| sshnaidm|ruck | bfournie, great, thanks | 11:46 |
| hjensas | sshnaidm|ruck: I see the Stderr: 'qemu-img: error while reading sector 2365184: Input/output error\n' on the latest logs on that bug. | 11:50 |
| hjensas | sshnaidm|ruck: bfournie: Did you try the image_convert_memory_limit setting? | 11:51 |
| sshnaidm|ruck | hjensas, I didn't, but I think we have merged something for that in ironic recently | 11:52 |
| sshnaidm|ruck | tbh no idea where to set it | 11:52 |
| *** pcaruana has quit IRC | 11:54 | |
| *** pcaruana has joined #tripleo | 11:55 | |
| hjensas | sshnaidm|ruck: yeah, couple of months ago - https://opendev.org/openstack/ironic-lib/commit/555c4948dc271ab882525d030303b3eca83585dd | 11:56 |
| hjensas | sshnaidm|ruck: we don't expose the setting in puppet-tripleo or THT afict. | 11:56 |
| sshnaidm|ruck | hjensas, yeah, that's the problem.. | 11:57 |
| bfournie | hjensas: that was there in the latest? so we're still seeing that issue I guess, I didn't see it in yesterday's logs | 11:58 |
| bfournie | hjensas: so we have a way to set that in ironic.conf? | 11:59 |
| bfournie | s/so/do/ | 11:59 |
| *** amoralej is now known as amoralej|lunch | 12:00 | |
| openstackgerrit | yatin proposed openstack/tripleo-heat-templates stable/train: [DNM] enable just iptables not nftables https://review.opendev.org/739963 | 12:02 |
| ykarel | ysandeep, let's try ^ | 12:02 |
| *** xek_ has quit IRC | 12:04 | |
| ysandeep | ykarel, ack, I will add depends-on ^^ on my rdo test patch, once previous execution finishes | 12:05 |
| ykarel | ysandeep, u can add now, that will fail | 12:05 |
| ysandeep | ykarel, that on last step - ansible collect logs.. lets wait for 5 more mins | 12:06 |
| ysandeep | that's* | 12:06 |
| ykarel | okk :) | 12:06 |
| *** rcernin has joined #tripleo | 12:09 | |
| hjensas | bfournie: either we implement it in puppet-ironic + THT or do some ExtraConfig magic to include the ironic::config class and set the value using that. | 12:10 |
| *** pojadhav|brb is now known as pojadhav | 12:12 | |
| *** jcapitao_lunch is now known as jcapitao | 12:14 | |
| *** rcernin has quit IRC | 12:16 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Switch deploy steps to tripleo_free https://review.opendev.org/724734 | 12:16 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Use tripleo linear when not using tripleo free https://review.opendev.org/724769 | 12:16 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Relax facts gathering plays on the overcloud https://review.opendev.org/734649 | 12:16 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/train: Collapse deploy steps https://review.opendev.org/739519 | 12:19 |
| hjensas | sshnaidm|ruck: bfournie: here is a KCS with an example how to use the ExtraConfig with the puppet config class - https://access.redhat.com/solutions/4376501 | 12:21 |
| hjensas | sshnaidm|ruck: bfournie: question is, do we want to do that in CI? Or do we want to add support for the parameter in puppet-ironic + THT instead? | 12:22 |
| openstackgerrit | Oliver Walsh proposed openstack/tripleo-heat-templates master: Avoid failing on deleted file https://review.opendev.org/733906 | 12:24 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/ussuri: Always clear cached facts first https://review.opendev.org/739493 | 12:24 |
| EmilienM | poor gate | 12:24 |
| openstackgerrit | Merged openstack/tripleo-operator-ansible master: Update introspection and discovery with latest options https://review.opendev.org/739432 | 12:25 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo stable/train: Enable to modify params of logrotate-crond.conf https://review.opendev.org/739091 | 12:25 |
| *** ysandeep is now known as ysandeep|mtg | 12:29 | |
| *** ramishra has quit IRC | 12:31 | |
| openstackgerrit | Harald Jensås proposed openstack/tripleo-quickstart-extras master: Set image_convert_memory_limit to 2048 in CI UC https://review.opendev.org/739970 | 12:36 |
| hjensas | bfournie: ^^ might do it ... | 12:36 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/train: Fix privilege escalation https://review.opendev.org/739592 | 12:37 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-validations master: Add "mock" in test-requirements and lower-constraints https://review.opendev.org/739748 | 12:39 |
| *** pcaruana has quit IRC | 12:56 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Allow more tasks to be run in check mode https://review.opendev.org/735179 | 12:58 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: Always clear cached facts first https://review.opendev.org/739494 | 12:58 |
| *** ramishra has joined #tripleo | 13:02 | |
| bfournie | hjensas: thanks, looks good | 13:02 |
| *** xek_ has joined #tripleo | 13:04 | |
| *** pcaruana has joined #tripleo | 13:09 | |
| *** amoralej|lunch is now known as amoralej | 13:11 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates stable/train: Unmount NFS shares before launching LEAPP https://review.opendev.org/739219 | 13:12 |
| gfidente | jfrancoa EmilienM ^^ updated, thanks | 13:13 |
| jfrancoa | gfidente: np, I'll have a look at it in a while | 13:13 |
| *** bandini has quit IRC | 13:18 | |
| openstackgerrit | yatin proposed openstack/tripleo-heat-templates stable/train: [DNM] enable just iptables not nftables https://review.opendev.org/739963 | 13:19 |
| openstackgerrit | Jose Luis Franco proposed openstack/tripleo-heat-templates master: Remove ffwd-upgrade leftovers from THT. https://review.opendev.org/739604 | 13:20 |
| *** ccamacho has quit IRC | 13:23 | |
| *** ekultails has joined #tripleo | 13:24 | |
| *** skramaja has quit IRC | 13:26 | |
| *** TrevorV has joined #tripleo | 13:28 | |
| cloudnull | o/ | 13:29 |
| *** bandini has joined #tripleo | 13:29 | |
| openstackgerrit | Grzegorz Grasza proposed openstack/tripleo-quickstart-extras master: Make /etc/resolv.conf immutable after modification https://review.opendev.org/739905 | 13:29 |
| *** ysandeep|mtg is now known as ysandeep | 13:30 | |
| *** pojadhav is now known as pojadhav|brb | 13:31 | |
| *** jpich has quit IRC | 13:31 | |
| *** pojadhav|brb is now known as pojadhav | 13:32 | |
| *** jpich has joined #tripleo | 13:32 | |
| *** bandini has quit IRC | 13:35 | |
| *** bandini has joined #tripleo | 13:36 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Use container_file_t for Cinder*NfsMountOptions by default https://review.opendev.org/739214 | 13:44 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-common master: First pass at script cleanup https://review.opendev.org/735661 | 13:45 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-common master: Update kolla sudoers to tripleo sudoers https://review.opendev.org/737854 | 13:46 |
| *** Goneri has joined #tripleo | 13:48 | |
| *** ysandeep is now known as ysandeep|afk | 13:52 | |
| *** dprince has joined #tripleo | 13:59 | |
| *** ysandeep|afk is now known as ysandeep | 14:00 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: Use container_file_t for Cinder*NfsMountOptions by default https://review.opendev.org/739214 | 14:01 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: [ovn] Don't add conntrack entries for Geneve https://review.opendev.org/738419 | 14:04 |
| *** bhagyashris is now known as bhagyashris|afk | 14:07 | |
| openstackgerrit | yatin proposed openstack/puppet-tripleo stable/train: [DNM] override service_name firewall https://review.opendev.org/739994 | 14:07 |
| openstackgerrit | yatin proposed openstack/tripleo-heat-templates stable/train: [DNM] enable just iptables not nftables https://review.opendev.org/739963 | 14:09 |
| openstackgerrit | Merged openstack/tripleo-ansible stable/ussuri: Set short ANSIBLE_SSH_CONTROL_PATH_DIR for all ceph roles https://review.opendev.org/739068 | 14:12 |
| *** bhagyashris|afk is now known as bhagyashris | 14:17 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible stable/ussuri: Introduce an Action Plugin to manage systemd services for containers https://review.opendev.org/739998 | 14:17 |
| *** ratailor has quit IRC | 14:18 | |
| *** pojadhav is now known as pojadhav|afk | 14:18 | |
| *** rlandy is now known as rlandy|ruck | 14:19 | |
| openstackgerrit | Giulio Fidente proposed openstack/puppet-tripleo stable/ussuri: Make haproxy.pp honor EnableInternalTLS for rgw https://review.opendev.org/735561 | 14:23 |
| *** abdysn has quit IRC | 14:31 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: Attempt to remove octavia tls proxy service only present https://review.opendev.org/740003 | 14:33 |
| Tengu | folks, can we see this one merged soon? :) https://review.opendev.org/#/c/736959/ thanks! | 14:34 |
| *** dprince has quit IRC | 14:36 | |
| EmilienM | weshay_ruck, bogdando : I think we need to have a general consensus on the new naming conventions, re: https://review.opendev.org/#/c/738894 | 14:38 |
| EmilienM | we need an official email/spec/blueprint where everyone agrees that blacklisted is replaced by skipped, etc etc | 14:38 |
| EmilienM | otherwise I'm afraid this renaming won't be clear to everyone | 14:39 |
| EmilienM | we need it documented before implemented, is my thought. | 14:39 |
| EmilienM | weshay_ruck: we should probably run it via mailing-list to start | 14:41 |
| weshay_ruck | oh boy. naming is hardest part of software development | 14:43 |
| *** rdopiera has quit IRC | 14:46 | |
| EmilienM | Tengu, jfrancoa, bogdando : commented on https://review.opendev.org/#/c/736959 | 14:47 |
| Tengu | EmilienM: saw it. makes sense. | 14:48 |
| EmilienM | Tengu: should I remove it from the gate for now? | 14:49 |
| Tengu | EmilienM: or a follow-up? not sure we can template the redis thing in fact | 14:51 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-heat-templates master: Ensure name consistency for tmpfiles.d configurations https://review.opendev.org/736959 | 14:52 |
| Tengu | EmilienM: the steps are different for the other blocks... unless we can "templatise" only one task? | 14:52 |
| *** ysandeep is now known as ysandeep|away | 14:55 | |
| EmilienM | you could templatize a block | 14:55 |
| EmilienM | but whatever | 14:55 |
| EmilienM | it's just horrible to duplicate the same things 20 times | 14:56 |
| Tengu | well, weshay_ruck dropped it anyway.. | 14:56 |
| Tengu | EmilienM: here we'd need to put the one task in fact. | 14:56 |
| Tengu | because there are differences in the other tasks (at least for the "when") | 14:56 |
| openstackgerrit | Bogdan Dobrelya (bogdando) proposed openstack/tripleo-specs master: Add spec for renaming rules https://review.opendev.org/740013 | 15:00 |
| openstackgerrit | Merged openstack/tripleo-ansible stable/ussuri: Introduce an Action Plugin to fetch container infos https://review.opendev.org/739927 | 15:02 |
| openstackgerrit | Merged openstack/tripleo-ansible stable/train: Use registry:2.7.0 instead of registry:2 https://review.opendev.org/739888 | 15:02 |
| *** ykarel is now known as ykarel|away | 15:04 | |
| Tengu | EmilienM: lemme try something. | 15:05 |
| zbr7 | if anyone wants to test alternatives to the dead irccloud, i deployed an instance of thelounge, ping me. | 15:07 |
| openstackgerrit | Cédric Jeanneret (Tengu) proposed openstack/tripleo-heat-templates master: Ensure name consistency for tmpfiles.d configurations https://review.opendev.org/736959 | 15:13 |
| hjensas | weshay_ruck: sshnaidm|ruck: Looking at the pad with vexx OVB issues, the ipxe-boot image is 7.5 GB ? The ipxe-boot image I use in my lab is 896.00 KB w00t? | 15:13 |
| weshay_ruck | ya.. that is odd.. | 15:14 |
| * weshay_ruck looks | 15:14 | |
| hjensas | weshay_ruck: there was a change in OVB to build a iPXE iso instead of using disk-imagebuilder, https://review.opendev.org/683972 a while ago. Makes it super tiny. | 15:15 |
| weshay_ruck | hjensas, k.. sagi had to step out for a few minutes and I'll need to sync up w/ him about that | 15:17 |
| weshay_ruck | sshnaidm|ruck, fyi ^ | 15:17 |
| weshay_ruck | hjensas, thanks for letting me know | 15:17 |
| weshay_ruck | hjensas, afaict.. that's master only right? | 15:18 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/stein: Refactor ceph-ansible upgrade https://review.opendev.org/739812 | 15:18 |
| hjensas | weshay_ruck: yes, there has'nt been a new release. | 15:19 |
| *** ccamacho has joined #tripleo | 15:20 | |
| hjensas | weshay_ruck: but the image is not built for each job I assume, so should be possible just upload a new image and change the image-id to use. | 15:20 |
| *** ccamacho has joined #tripleo | 15:20 | |
| sshnaidm|ruck | weshay_ruck, back | 15:24 |
| *** lmiccini has quit IRC | 15:25 | |
| sshnaidm|ruck | hjensas, yeah, we use the same image, uploaded once | 15:25 |
| sshnaidm|ruck | and it is 7G, I think we took it from some public place for ovb, lemme check.. | 15:25 |
| hjensas | sshnaidm|ruck: let's change it to a new and much smaller one? | 15:26 |
| sshnaidm|ruck | hjensas, let's try | 15:27 |
| sshnaidm|ruck | hjensas, where can I take it? | 15:27 |
| hjensas | sshnaidm|ruck: I can e-mail it. :) | 15:27 |
| sshnaidm|ruck | hjensas, :D great | 15:27 |
| weshay_ruck | lolz | 15:28 |
| weshay_ruck | thanks sshnaidm|ruck | 15:28 |
| openstackgerrit | Marios Andreou proposed openstack/python-tripleoclient master: Fix package manager used during undercloud packages update https://review.opendev.org/740019 | 15:29 |
| *** bogdando has quit IRC | 15:30 | |
| hjensas | sshnaidm|ruck: weshay_ruck: it should be in your downstream mailboxes by now. | 15:32 |
| sshnaidm|ruck | hjensas, yep, got it | 15:32 |
| weshay_ruck | tis | 15:32 |
| rlandy|ruck | cgoncalves: hi ... we have an error showing up in osp-17 tests that look similar to https://bugs.launchpad.net/tripleo/+bug/1866107 | 15:34 |
| openstack | Launchpad bug 1866107 in tripleo "tripleo-ci-centos-7-scenario010-standalone jobs are failing tesmpest tests "ServiceError: Request on service 'load-balancer' with url 'http://192.168.24.1:9876' failed with code 500"" [Critical,Fix released] | 15:34 |
| rlandy|ruck | https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-rhos-17/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-scenario010-standalone-rhos-17/e6c509c/job-output.txt | 15:34 |
| cgoncalves | looking | 15:35 |
| rlandy|ruck | do we need a similar revert on puppet-octavia rhos-17.0-trunk-patches | 15:35 |
| rlandy|ruck | that repo has not been updated in a while | 15:36 |
| sshnaidm|ruck | weshay_ruck, hjensas running with new image: https://review.rdoproject.org/r/#/c/28381/ | 15:37 |
| weshay_ruck | rock | 15:38 |
| cgoncalves | rlandy|ruck, OSP 17 is not in sync with upstream? probably it should to fix this issue, yeah | 15:39 |
| cgoncalves | isn't DLRN syncing from upstream every so often? | 15:40 |
| rlandy|ruck | cgoncalves: yep - I guess the question is why is that repo so out of sync ... let's chat with #rhos-delivery | 15:40 |
| cgoncalves | ack | 15:40 |
| openstackgerrit | Karthik S proposed openstack/os-net-config master: WIP: Add NIC Partitioning support for Mellanox VFs https://review.opendev.org/740022 | 15:42 |
| openstackgerrit | Merged openstack/tripleo-ansible stable/train: Login with buildah too to allow registry access with buildah https://review.opendev.org/739869 | 15:45 |
| openstackgerrit | Merged openstack/tripleo-ansible stable/ussuri: Use registry:2.7.0 instead of registry:2 https://review.opendev.org/739885 | 15:45 |
| openstackgerrit | Merged openstack/tripleo-ansible stable/ussuri: Login with buildah too to allow registry access with buildah https://review.opendev.org/739868 | 15:45 |
| openstackgerrit | jacky06 proposed openstack/diskimage-builder master: Remove glance-registry https://review.opendev.org/739796 | 15:58 |
| *** bandini has quit IRC | 15:59 | |
| hjensas | 2020-07-08 15:45:10.355532 | primary | stack_status: CREATE_IN_PROGRESS | 16:00 |
| hjensas | 2020-07-08 15:46:57.244593 | primary | stack_status: CREATE_COMPLETE | 16:00 |
| hjensas | sshnaidm|ruck: ^^ was'nt that very quick? | 16:00 |
| openstackgerrit | Merged openstack/tripleo-upgrade stable/rocky: Refactor ceph-ansible upgrade https://review.opendev.org/739816 | 16:01 |
| openstackgerrit | Merged openstack/ansible-role-collect-logs master: Add missing artcl_publish in infrared plugin https://review.opendev.org/738667 | 16:01 |
| openstackgerrit | Merged openstack/tripleo-quickstart-extras master: Fix tempestconf URL https://review.opendev.org/735428 | 16:01 |
| *** dtantsur is now known as dtantsur|afk | 16:01 | |
| openstackgerrit | Merged openstack/tripleo-ci master: Don't fail on EPEL disable if not exists https://review.opendev.org/739909 | 16:01 |
| openstackgerrit | Merged openstack/tripleo-ci master: Add support for OSP containers in new build process https://review.opendev.org/739385 | 16:01 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Task should fail on any failure https://review.opendev.org/739470 | 16:01 |
| sshnaidm|ruck | hjensas, little bit, but within limits | 16:01 |
| sshnaidm|ruck | hjensas, 2-3 minutes is a usual time | 16:01 |
| sshnaidm|ruck | if cloud feels fine | 16:02 |
| hjensas | sshnaidm|ruck: ok, cool. My homelab is obviously _a_lot_ slower than a real cloud. :D | 16:02 |
| sshnaidm|ruck | hjensas, oh, don't be so sure :D | 16:02 |
| * sshnaidm|ruck saw clouds | 16:02 | |
| *** jcapitao has quit IRC | 16:03 | |
| *** marios is now known as marios|out | 16:06 | |
| *** amoralej is now known as amoralej|off | 16:06 | |
| abishop | I guess a new container build process is rolling out? I see some (but not all) cinder images were rebuilt last night, but the cinder UID changed from 42407 to 165 | 16:12 |
| *** suuuper has quit IRC | 16:13 | |
| abishop | weshay_ruck: ^^ is there something behind the cinder UID changing? | 16:14 |
| *** udesale_ has quit IRC | 16:16 | |
| cloudnull | -cc EmilienM ^ | 16:16 |
| cloudnull | Is that something we need to address? | 16:16 |
| *** lucasagomes has quit IRC | 16:18 | |
| EmilienM | abishop: we now rely on what's done via packaging | 16:21 |
| EmilienM | https://github.com/rdo-packages/cinder-distgit/blob/2e6ff7451a5db03868d6fb66e55d32cb0b1aa67c/openstack-cinder.spec#L373 | 16:21 |
| abishop | right, so no weird kolla uid stuff? | 16:22 |
| EmilienM | no weird kolla | 16:22 |
| EmilienM | :D | 16:22 |
| abishop | so I currently have a situation where some of the cinder containers use one uid, and the others the kolla value | 16:22 |
| abishop | using upstream current-tripleo | 16:23 |
| EmilienM | did you mix kolla/non-kolla containers? | 16:23 |
| EmilienM | I don't know what's happening tbh | 16:24 |
| EmilienM | chandankumar might know better | 16:24 |
| abishop | seems like cinder-volume and cinder-backup were rebuilt, but not cinder-api | 16:24 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: Manual backport of "Move sidecar kill scripts to host prep" to Train https://review.opendev.org/739547 | 16:24 |
| openstackgerrit | Merged openstack/tripleo-ci master: Introduce stable jobs for tripleo-build-containers-ubi-8 https://review.opendev.org/739596 | 16:24 |
| *** jpich has quit IRC | 16:25 | |
| EmilienM | abishop: that's the issue | 16:25 |
| EmilienM | the only requirement that is needed is “The UIDs and GIDs of users and groups have to be the same on every OSP server due to regulations by law” | 16:25 |
| EmilienM | the thing we don't do now and that might be required as well is "pre-define at least the range of all GIDs" | 16:25 |
| *** gouthamr has quit IRC | 16:26 | |
| abishop | EmilienM: yup, makes sense, so if I pull a fresh cinder-api will I get a newly built one with cinder's native UID? | 16:27 |
| * abishop will try | 16:27 | |
| EmilienM | you can tell with skopeo inspect | 16:27 |
| EmilienM | I don't know what containers are missing to be pushed in the registry | 16:27 |
| EmilienM | i even didn't know they were live :D | 16:28 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-upgrade master: Add --yes into update commands to autoconfirm. https://review.opendev.org/730328 | 16:34 |
| *** derekh has quit IRC | 16:41 | |
| *** chandankumar has quit IRC | 16:44 | |
| *** xek_ has quit IRC | 16:45 | |
| *** soniya29|rover has quit IRC | 16:46 | |
| *** ykarel|away has quit IRC | 16:46 | |
| *** akahat has quit IRC | 16:46 | |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-upgrade master: Add --yes into update commands to autoconfirm. https://review.opendev.org/730328 | 16:51 |
| *** gouthamr has joined #tripleo | 16:52 | |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-upgrade master: Add --yes into update commands to autoconfirm. https://review.opendev.org/730328 | 16:54 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-upgrade master: Add --yes into update commands to autoconfirm. https://review.opendev.org/730328 | 16:55 |
| abishop | EmilienM: phew, confirmed all of cinder's current-tripleo tagged images use the same UID (not kolla's) | 16:57 |
| weshay_ruck | thanks guys | 16:57 |
| *** jmasud has quit IRC | 17:07 | |
| *** chandankumar has joined #tripleo | 17:11 | |
| *** marios|out has quit IRC | 17:12 | |
| *** rh-jelabarre has quit IRC | 17:17 | |
| *** akahat has joined #tripleo | 17:25 | |
| openstackgerrit | Merged openstack/puppet-tripleo stable/train: Add FFU support for ceph_nfs https://review.opendev.org/739782 | 17:37 |
| *** pojadhav|afk is now known as pojadhav | 17:40 | |
| *** rlandy|ruck is now known as rlandy|ruck2 | 18:10 | |
| EmilienM | abishop: good. Thanks | 18:16 |
| *** sshnaidm|ruck is now known as sshnaidm|afk | 18:25 | |
| openstackgerrit | Sergii Golovatiuk proposed openstack/python-tripleoclient master: Add prompt for overcloud update commands https://review.opendev.org/730325 | 18:41 |
| *** xek_ has joined #tripleo | 18:48 | |
| openstackgerrit | mathieu bultel proposed openstack/python-tripleoclient master: WIP -- Use validations-libs for callback and logging https://review.opendev.org/724289 | 18:55 |
| *** maciejjozefczyk has quit IRC | 18:56 | |
| *** rh-jelabarre has joined #tripleo | 19:15 | |
| sshnaidm|afk | hjensas, weshay_ruck image worked well on vexx, gonna replace it in all clouds | 19:19 |
| * weshay_ruck looks | 19:19 | |
| weshay_ruck | sshnaidm|afk, https://review.rdoproject.org/r/#/c/28381/ ? | 19:20 |
| sshnaidm|afk | weshay_ruck, yes | 19:20 |
| weshay_ruck | sshnaidm|afk, k.. go 4 it.. rdo is down hence the retry? | 19:21 |
| sshnaidm|afk | weshay_ruck, ya | 19:21 |
| weshay_ruck | k.. thanks man | 19:21 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient stable/train: Add openstack tripleo container image build https://review.opendev.org/740095 | 19:21 |
| *** apetrich has quit IRC | 19:31 | |
| *** donnyd has joined #tripleo | 19:31 | |
| *** apetrich has joined #tripleo | 19:31 | |
| *** mnaser has joined #tripleo | 19:32 | |
| *** cyberpear has joined #tripleo | 19:33 | |
| *** dpaterson has joined #tripleo | 19:34 | |
| *** ab-a has quit IRC | 19:37 | |
| *** ab-a has joined #tripleo | 19:38 | |
| *** Ng has joined #tripleo | 19:39 | |
| *** ChanServ sets mode: +v Ng | 19:39 | |
| *** rpittau has joined #tripleo | 19:40 | |
| EmilienM | recheck recheck recheck | 19:40 |
| EmilienM | requests.exceptions.HTTPError: 429 Client Error: Too Many Requests for url: http://mirror.dfw.rax.opendev.org:8082/v2/tripleou/centos-binary-barbican-api/blobs/sha256:15a3874f2bc6e7228f99587b6d7a6cd95a92d85bc85f118503e734b68b129c68 | 19:41 |
| EmilienM | have you seen that? | 19:41 |
| EmilienM | rlandy|ruck2: ^ | 19:41 |
| *** jonmasters has joined #tripleo | 19:41 | |
| rlandy|ruck2 | looking | 19:42 |
| rlandy|ruck2 | yeah - I have seen that from time to time | 19:43 |
| rlandy|ruck2 | EmilienM: job link? | 19:43 |
| EmilienM | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_8e5/739595/2/check/tripleo-ci-centos-8-undercloud-containers/8e53807/logs/undercloud/home/zuul/undercloud_install.log | 19:43 |
| EmilienM | I don't think the "429 Client Error" can be mitigated on our side with retries/sleep | 19:45 |
| EmilienM | it's likely the proxy reached the TPS (transaction per second) in the proxy | 19:46 |
| EmilienM | maybe the proxy should increase RateLimitExceeded if it can handle it | 19:46 |
| rlandy|ruck2 | 2020-07-08 17:21:36 | Error detected in auth headers: error invalid_token | 19:46 |
| rlandy|ruck2 | 2020-07-08 17:21:36 | Re-authenticating: id d125512fa67e216a89bb9fe13182e57088732421, count 1 | 19:46 |
| rlandy|ruck2 | 2020-07-08 17:29:57 | Failure: id d125512fa67e216a89bb9fe13182e57088732421, status 401, reason Unauthorized text {"errors":[{"code":"UNAUTHORIZED","message":"authentication required","detail":[{"Type":"repository","Class":"","Name":"tripleou/centos-binary-barbican-api","Action":"pull"}]}]} | 19:46 |
| EmilienM | I guess a wait would help | 19:47 |
| EmilienM | do we have lp on it? | 19:47 |
| rlandy|ruck2 | I'll create one | 19:47 |
| EmilienM | ok thx. I'm looking at how we can mitigate it | 19:48 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient stable/train: Add openstack tripleo container image build https://review.opendev.org/740095 | 19:48 |
| *** csatari has joined #tripleo | 19:49 | |
| cloudnull | weshay_ruck ping | 19:51 |
| *** zbr_ has joined #tripleo | 19:51 | |
| *** kopecmartin is now known as kopecmartin|pto | 19:52 | |
| EmilienM | rlandy|ruck2: this is weird :/ | 19:52 |
| EmilienM | 2020-07-08 17:21:36 | Re-authenticating: id d125512fa67e216a89bb9fe13182e57088732421, count 1 | 19:53 |
| EmilienM | 2020-07-08 17:29:57 | Re-authenticating: id d125512fa67e216a89bb9fe13182e57088732421, count 2 | 19:53 |
| EmilienM | nearly 8 minutes between both attempts | 19:53 |
| EmilienM | 2020-07-08 17:38:19 | Re-authenticating: id d125512fa67e216a89bb9fe13182e57088732421, count 3 | 19:53 |
| EmilienM | another 8 min | 19:53 |
| rlandy|ruck2 | sec ... | 19:53 |
| EmilienM | our code is already trying as much as it can | 19:53 |
| EmilienM | the proxy just rejects it | 19:53 |
| *** rpioso has joined #tripleo | 19:54 | |
| openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates master: DNM: testing an octavia related openstacklib change https://review.opendev.org/740103 | 19:54 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-common stable/train: Implement a new Container Images layout https://review.opendev.org/736752 | 19:55 |
| rlandy|ruck2 | EmilienM: https://bugs.launchpad.net/tripleo/+bug/1886867 - want that CIX'ed? | 19:59 |
| openstack | Launchpad bug 1886867 in tripleo "Tripleo upstream jobs are failing undercloud install/standalone deploy with "requests.exceptions.HTTPError: 429 Client Error: Too Many Requests for url"" [High,Triaged] | 19:59 |
| * rlandy|ruck2 checks other failing jobs | 20:00 | |
| EmilienM | rlandy|ruck2: I'm not sure tbh | 20:00 |
| EmilienM | it should be reported to Infra for sure | 20:00 |
| hjensas | Do we test deploying with OVS in CI? | 20:01 |
| rlandy|ruck2 | EmilienM: ok - will get zbr to pick this up with infra | 20:01 |
| hjensas | I'm hitting https://bugs.launchpad.net/tripleo/+bug/1886841 - and don't get what's causing it too lookup 'ovn_dbs_vip' when including environments/services/neutron-ovs.yaml | 20:02 |
| openstack | Launchpad bug 1886841 in tripleo "Deploying with OVS fails - puppet-user: Error: Function lookup() did not find a value for the name 'ovn_dbs_vip'" [High,Triaged] | 20:02 |
| EmilienM | beagles: ^ | 20:02 |
| EmilienM | i think we have one job? | 20:02 |
| rlandy|ruck2 | hjensas: https://github.com/openstack/tripleo-heat-templates - scenario007 | 20:02 |
| EmilienM | yea this one | 20:02 |
| *** mnasiadka has joined #tripleo | 20:04 | |
| rlandy|ruck2 | https://zuul.openstack.org/builds?job_name=tripleo-ci-centos-8-scenario007-standalone | 20:04 |
| beagles | hjensas: I vaguely recall running into that before | 20:04 |
| beagles | but like a long time ago | 20:05 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: Remove /run from some services https://review.opendev.org/739950 | 20:05 |
| *** m1p has joined #tripleo | 20:09 | |
| *** johnsom_ has joined #tripleo | 20:10 | |
| *** mwhahaha has joined #tripleo | 20:10 | |
| *** ChanServ sets mode: +v mwhahaha | 20:10 | |
| *** jmasud has joined #tripleo | 20:11 | |
| beagles | hjensas: is this a greenfield deployment or are you trying a redeploy with ovs? | 20:13 |
| hjensas | beagles: a greenfield. | 20:13 |
| beagles | hjensas: weird | 20:13 |
| EmilienM | rlandy|ruck2: scenario001 on train is flacky | 20:14 |
| EmilienM | https://559e26596c131c98a9bb-6bcda3a769a6c31ee12f465dd60bb9a2.ssl.cf1.rackcdn.com/739091/2/check/tripleo-ci-centos-7-scenario001-standalone/43a32df/job-output.txt | 20:14 |
| * EmilienM pulls details | 20:14 | |
| *** simondodsley has joined #tripleo | 20:14 | |
| hjensas | environments/services/neutron-ovs.yaml does OS::TripleO::Network::Ports::OVNDBsVipPort: ../../network/ports/noop.yaml , ci/environments/scenario007-multinode-containers.yaml does'nt. Other than that it looks identical afict. | 20:14 |
| EmilienM | Details: {u'message': u'Unable to complete operation on subnet 55916594-bb32-4c38-8cef-6aef08aa4086: One or more ports have an IP allocation from this subnet.', u'type': u'SubnetInUse', u'detail': u''} | 20:15 |
| EmilienM | rlandy|ruck2: https://559e26596c131c98a9bb-6bcda3a769a6c31ee12f465dd60bb9a2.ssl.cf1.rackcdn.com/739091/2/check/tripleo-ci-centos-7-scenario001-standalone/43a32df/logs/undercloud/home/zuul/tempest/tempest.log | 20:15 |
| EmilienM | ^ | 20:15 |
| hjensas | beagles: I can do a stack delete, and try again from scratch. | 20:15 |
| rlandy|ruck2 | EmilienM: https://559e26596c131c98a9bb-6bcda3a769a6c31ee12f465dd60bb9a2.ssl.cf1.rackcdn.com/739091/2/check/tripleo-ci-centos-7-scenario001-standalone/43a32df/logs/undercloud/var/log/tempest/stestr_results.html easier view | 20:16 |
| EmilienM | rlandy|ruck2: i prefer .logs (joke) | 20:16 |
| EmilienM | https://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-scenario001-standalone&branch=stable%2Ftrain | 20:16 |
| EmilienM | it's not *terrible* but still | 20:16 |
| rlandy|ruck2 | fails every fourth job | 20:17 |
| EmilienM | ok it's terrible | 20:17 |
| EmilienM | :D | 20:17 |
| *** sri_ has joined #tripleo | 20:17 | |
| rlandy|ruck2 | ... /o\ jut sparse enough to get ignored | 20:17 |
| rlandy|ruck2 | ok - time to review ALL gate failures I guess | 20:18 |
| EmilienM | yed | 20:18 |
| EmilienM | yes | 20:18 |
| EmilienM | i have more if you want | 20:18 |
| rlandy|ruck2 | oh joy | 20:18 |
| EmilienM | i can stop looking if you want :D | 20:18 |
| rlandy|ruck2 | if it's not in the list of 27!! here http://tripleo-cockpit.usersys.redhat.com/d/9DmvErfZz/cockpit?orgId=1 - then sure - add it to the list | 20:19 |
| *** EmilienM changes topic to "CI status: Orange / multiple issues under investigation, OVB disabled | community irc meeting 6/23 Tues@1400 UTC - tripleo-ci-community meeting Tues@1330 UTC | https://docs.openstack.org/tripleo-docs" | 20:19 | |
| rlandy|ruck2 | container multinode jobs have had better days | 20:20 |
| rlandy|ruck2 | ok - need a few minutes to merge the new container build/push/upload into downstream integration line ... will be back on this in a bit | 20:21 |
| *** jfrancoa has quit IRC | 20:21 | |
| *** xek_ has quit IRC | 20:22 | |
| *** hrybacki has joined #tripleo | 20:23 | |
| *** gfidente is now known as gfidente|afk | 20:31 | |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-upgrade master: Add --yes into update commands to autoconfirm. https://review.opendev.org/730328 | 20:34 |
| *** flaviof has joined #tripleo | 20:36 | |
| *** NobodyCam has joined #tripleo | 20:36 | |
| rlandy|ruck2 | EmilienM: looks like we are racking up a lot of failures on rax today | 20:39 |
| * EmilienM blames cloudnull | 20:40 | |
| rlandy|ruck2 | why? | 20:40 |
| EmilienM | or lbragstad_ | 20:40 |
| EmilienM | rlandy|ruck2: for free | 20:40 |
| EmilienM | rlandy|ruck2: and also because they used to work there :D | 20:40 |
| rlandy|ruck2 | ah - I see | 20:40 |
| lbragstad_ | did i break something? | 20:42 |
| *** lbragstad_ is now known as lbragstad | 20:42 | |
| EmilienM | lbragstad: no :D | 20:42 |
| cloudnull | lbragstad I think we're guilty by association | 20:42 |
| lbragstad | aha | 20:42 |
| rlandy|ruck2 | we don't have anything specific to pin on you yet - stand by | 20:43 |
| openstackgerrit | Merged openstack/tripleo-common stable/train: Catch exception if servers are in error state with no bm_node attached https://review.opendev.org/739713 | 20:43 |
| rlandy|ruck2 | EmilienM: cloudnull: in other news ... | 20:47 |
| EmilienM | i only take good news | 20:47 |
| rlandy|ruck2 | http://git.app.eng.bos.redhat.com/git/openstack/tripleo-ci-internal-config.git/commit/?id=8169836e4a1204321e5fb06b52d0f47a343c9888 | 20:47 |
| * EmilienM opens | 20:48 | |
| rlandy|ruck2 | new container build/push/upload is officially part of the integration line | 20:48 |
| EmilienM | w00t | 20:48 |
| rlandy|ruck2 | downstream | 20:48 |
| EmilienM | WOW | 20:48 |
| EmilienM | rlandy|ruck2: nicely done :D | 20:48 |
| * rlandy|ruck2 goes back ti gate debug | 20:48 | |
| cloudnull | woot! | 20:48 |
| cloudnull | that's awesome news | 20:48 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-heat-templates stable/ussuri: Task should fail on any failure https://review.opendev.org/740111 | 20:51 |
| openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-heat-templates stable/train: Task should fail on any failure https://review.opendev.org/740112 | 20:51 |
| *** mnaser is now known as mnaser|ic | 20:52 | |
| EmilienM | sshnaidm|afk: hey it's me and my idempotency issues with containers | 20:53 |
| EmilienM | sshnaidm|afk: (yes again) (and yes I'll send a patch) | 20:53 |
| sshnaidm|afk | EmilienM, I need to update the module from collection.. | 20:54 |
| EmilienM | sshnaidm|afk: https://www.diffchecker.com/9zbg3sXj | 20:54 |
| EmilienM | check the /src-tls//etc | 20:54 |
| sshnaidm|afk | yeah, why is that? | 20:55 |
| EmilienM | it's the trailing "/" again | 20:55 |
| EmilienM | in deployment/haproxy/haproxy-container-puppet.yaml | 20:55 |
| EmilienM | weird we didn't see it before? | 20:55 |
| sshnaidm|afk | so it's passed as '//'? | 20:55 |
| EmilienM | sshnaidm|afk: or are we using collection now and it miss some idempotency patches? | 20:55 |
| EmilienM | no | 20:56 |
| EmilienM | i mean yes | 20:56 |
| EmilienM | it worked before | 20:56 |
| sshnaidm|afk | EmilienM, it was issue with ending /, but it's in the middle of string | 20:56 |
| EmilienM | are we using collections onw? | 20:56 |
| sshnaidm|afk | EmilienM, nope | 20:56 |
| EmilienM | sshnaidm|afk: https://github.com/openstack/tripleo-heat-templates/blob/master/deployment/haproxy/haproxy-container-puppet.yaml#L282 | 20:56 |
| EmilienM | here | 20:56 |
| EmilienM | and DeployedSSLCertificatePath defaults to /etc/pki/tls/private/overcloud_endpoint.pem | 20:57 |
| EmilienM | so we end up with double // | 20:57 |
| sshnaidm|afk | well, seems like need to replace // by / | 20:57 |
| EmilienM | yes I need to patch THT | 20:57 |
| EmilienM | because config_data ends up with double // | 20:57 |
| EmilienM | and your module correct it | 20:57 |
| sshnaidm|afk | EmilienM, not my module, but podman | 20:58 |
| EmilienM | right | 20:58 |
| EmilienM | not sure why we didn't catch this one before? | 20:58 |
| EmilienM | I test idempotency from time to time | 20:58 |
| sshnaidm|afk | yeah, weird | 20:59 |
| EmilienM | a lot of services have it wrong :/ | 20:59 |
| openstackgerrit | Merged openstack/tripleo-ansible stable/train: Simplify ssh_known_hosts role https://review.opendev.org/736229 | 20:59 |
| *** raildo has quit IRC | 21:01 | |
| rlandy|ruck2 | HTTPError: 429 Client Error: Too Many Requests for url: http://mirror.iad.rax.opendev.org:8082/v2/tripleotrain/centos-binary-cron/blobs/sha256:ce3f5617efb7c5f4a770ec2dbdfd7fb1fcbd678b7088512ef0ed4193155787d6 | 21:02 |
| rlandy|ruck2 | yep - all rax all the time | 21:02 |
| cloudnull | have we raised that with infra? | 21:03 |
| EmilienM | maybe worth telling infra folks | 21:03 |
| cloudnull | likely an issue with one of their proxy nodes | 21:03 |
| rlandy|ruck2 | yep - on it | 21:04 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: volumes: remove trailing "/" at the end of a directory bind mount https://review.opendev.org/740117 | 21:08 |
| EmilienM | sshnaidm|afk: ^ could you ninja look and tell if I'm good? | 21:08 |
| *** mnaser|ic has quit IRC | 21:08 | |
| *** mnaser|ic has joined #tripleo | 21:08 | |
| *** mnaser|ic has quit IRC | 21:08 | |
| *** mnaser|ic has joined #tripleo | 21:08 | |
| *** mnaser|ic is now known as vexxhost | 21:08 | |
| *** gouthamr has quit IRC | 21:09 | |
| sshnaidm|afk | EmilienM, https://review.opendev.org/#/c/740117/1/deployment/cinder/cinder-common-container-puppet.yaml,unified | 21:10 |
| EmilienM | sshnaidm|afk: ha thx | 21:11 |
| *** gouthamr has joined #tripleo | 21:11 | |
| sshnaidm|afk | https://review.opendev.org/#/c/740117/1/deployment/iscsid/iscsid-container-puppet.yaml,unified | 21:12 |
| EmilienM | yeah | 21:12 |
| EmilienM | how didn't we find this before? | 21:13 |
| *** vexxhost is now known as mnaser | 21:14 | |
| *** mnaser is now known as mnaser|ic | 21:14 | |
| EmilienM | sshnaidm|afk: I wonder if we could workaround it in the module | 21:15 |
| sshnaidm|afk | no idea, I think I fixed it once.. | 21:15 |
| *** gouthamr_ has joined #tripleo | 21:15 | |
| sshnaidm|afk | EmilienM, yeah, need to look, maybe we even have one, but not for '//' | 21:15 |
| EmilienM | sshnaidm|afk: https://github.com/openstack/tripleo-ansible/blob/master/tripleo_ansible/ansible_plugins/modules/podman_container.py#L1704-L1710 | 21:16 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: Collapse deploy steps https://review.opendev.org/739519 | 21:16 |
| sshnaidm|afk | EmilienM, yeah, will add there | 21:18 |
| *** johnsom_ is now known as johnsom | 21:19 | |
| weshay_ruck | cloudnull, pong | 21:19 |
| EmilienM | sshnaidm|afk: ok I'll abandon THT patch | 21:19 |
| *** johnsom has joined #tripleo | 21:19 | |
| cloudnull | we're starting to think about what we need to do to backport the container work to train. upstream train supports both el7 and 8, do we need (want) to support both with the containers v2 work? | 21:21 |
| cloudnull | rlandy|ruck2 weshay_ruck second question, https://review.opendev.org/#/c/736752/4/container-images/tripleo_containers.yaml - should that be pointed at dockerhub ? | 21:26 |
| weshay_ruck | cloudnull, yes.. still docker.io for now | 21:27 |
| EmilienM | I don't think quay.io has demonstrated enough stability for our needs | 21:28 |
| EmilienM | s/our needs/our heavy needs/ | 21:28 |
| EmilienM | even if docker.io hasn't made our life simple with the short token ttl | 21:28 |
| EmilienM | and the rest... | 21:28 |
| cloudnull | ok | 21:31 |
| EmilienM | for question 1 i hope the answer is 8 only | 21:31 |
| cloudnull | weshay_ruck and what about el7 vs 8 ? | 21:31 |
| cloudnull | +1 | 21:31 |
| EmilienM | (i guess it all depends on when we have centos8 jobs ready in train and get rid of centos7 jobs) | 21:32 |
| weshay_ruck | cloudnull, el8 is clearly the althete's choice | 21:32 |
| EmilienM | weshay_ruck: you an althete now? | 21:32 |
| weshay_ruck | cern wants c7-train up | 21:32 |
| EmilienM | damn, i missed that :D | 21:32 |
| weshay_ruck | EmilienM, well.. I can do more pull ups than you | 21:32 |
| weshay_ruck | so.. | 21:32 |
| EmilienM | they want CI or containers? | 21:32 |
| weshay_ruck | both? | 21:32 |
| EmilienM | i can do 6 now lol | 21:32 |
| weshay_ruck | :) | 21:32 |
| EmilienM | i mean | 21:32 |
| weshay_ruck | keep working | 21:32 |
| EmilienM | we could use kolla for train/7 and tcib for train/_ | 21:33 |
| EmilienM | we could use kolla for train/7 and tcib for train/8 | 21:33 |
| EmilienM | and move on | 21:33 |
| *** aedc has quit IRC | 21:33 | |
| EmilienM | if it's just train, cost of maintenance is not high IMO | 21:33 |
| EmilienM | it's not like the container images configs change often | 21:33 |
| cloudnull | can our tooling easily support the two different code path's? | 21:35 |
| EmilienM | with if/then everything is possible | 21:35 |
| cloudnull | also overrides would need to occur in two places for as long we're keeping el 7 and 8 alive? | 21:35 |
| EmilienM | (i read it on stackoverflow) | 21:35 |
| cloudnull | EmilienM while true | 21:35 |
| EmilienM | cloudnull: yes that's what i'm saying re: cost of maintenance | 21:35 |
| weshay_ruck | do | 21:35 |
| cloudnull | that way you get retries :D | 21:36 |
| EmilienM | sounds like we have an agreement ? | 21:37 |
| openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: undercloud/heat: set YAQL memory quota to 200000 https://review.opendev.org/739632 | 21:39 |
| EmilienM | I'll take that as a yes | 21:43 |
| * EmilienM out | 21:43 | |
| weshay_ruck | EmilienM, 0/ | 21:44 |
| *** rfolco has quit IRC | 21:52 | |
| *** ekultails has quit IRC | 21:52 | |
| *** TrevorV has quit IRC | 21:53 | |
| *** slaweq has quit IRC | 21:54 | |
| *** sshnaidm|afk has quit IRC | 22:03 | |
| cloudnull | weshay_ruck so... no containers v2 for el7? | 22:19 |
| weshay_ruck | cloudnull, nope | 22:20 |
| weshay_ruck | NO SOUP FOR U | 22:20 |
| cloudnull | ++ | 22:20 |
| cloudnull | Death to el7 , long live el7 | 22:21 |
| weshay_ruck | so this happens | 22:25 |
| weshay_ruck | 020-07-08 21:59:31 | TASK [Write the puppet step_config manifest] *********************************** | 22:25 |
| weshay_ruck | 2020-07-08 21:59:31 | Wednesday 08 July 2020 21:59:31 +0000 (0:00:00.101) 0:07:20.307 ******** | 22:25 |
| weshay_ruck | 2020-07-08 21:59:32 | Ansible execution failed. playbook: deploy_steps_playbook.yaml, Run Status: failed, Return Code: None | 22:25 |
| weshay_ruck | 2020-07-08 21:59:33 | Not cleaning working directory /home/zuul/tripleo-heat-installer-templates | 22:25 |
| weshay_ruck | 2020-07-08 21:59:33 | Not cleaning ansible directory /home/zuul/undercloud-ansible-9wzxkyk0 | 22:25 |
| weshay_ruck | 2020-07-08 21:59:33 | Install artifact is located at /home/zuul/undercloud-install-20200708215932.tar.bzip2 | 22:25 |
| weshay_ruck | no failures in the heat logs | 22:25 |
| weshay_ruck | https://d1f716ee657057f8c1ed-5067ad0e5cf1f9e6b3e5798c03f452f6.ssl.cf5.rackcdn.com/736751/6/gate/tripleo-ci-centos-8-undercloud-containers/9905372/logs/undercloud/var/log/heat-launcher/undercloud_deploy-2x93zl09/heat.log | 22:25 |
| weshay_ruck | 2020-07-08 21:59:33 | ERROR: Heat log files: /var/log/heat-launcher/undercloud_deploy-2x93zl09 | 22:25 |
| weshay_ruck | seen that a few times | 22:25 |
| *** rlandy|ruck2 is now known as rlandy|bbl | 22:27 | |
| *** tosky has quit IRC | 22:30 | |
| *** rfolco has joined #tripleo | 22:52 | |
| *** rfolco has quit IRC | 22:58 | |
| openstackgerrit | Giulio Fidente proposed openstack/tripleo-heat-templates master: WIP: configure rsyncd without pid file for Swift https://review.opendev.org/739859 | 22:58 |
| *** tkajinam has joined #tripleo | 22:58 | |
| *** rcernin has joined #tripleo | 23:01 | |
| *** gfidente|afk has quit IRC | 23:06 | |
| *** evrardjp has quit IRC | 23:25 | |
| *** evrardjp has joined #tripleo | 23:26 | |
| *** mnaser|ic has quit IRC | 23:38 | |
| *** mnaser|ic has joined #tripleo | 23:38 | |
| *** mnaser|ic has quit IRC | 23:38 | |
| *** mnaser|ic has joined #tripleo | 23:38 | |
| *** mnaser|ic is now known as mnaser | 23:38 | |
| openstackgerrit | Merged openstack/tripleo-ansible stable/train: Molecule testing for TripleO Strategy Plugins https://review.opendev.org/739587 | 23:46 |
| EmilienM | weshay_ruck: might be sporadic | 23:52 |
| *** rfolco has joined #tripleo | 23:58 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!