*** tosky has quit IRC | 00:01 | |
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates stable/train: FFWD: Introduce hybrid state for nova compute https://review.opendev.org/729353 | 00:07 |
---|---|---|
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates stable/train: FFWD: post Leapp package fixups https://review.opendev.org/729358 | 00:07 |
*** waleedm_ has joined #tripleo | 00:10 | |
*** jmasud has quit IRC | 00:13 | |
*** threestrands has joined #tripleo | 00:19 | |
openstackgerrit | Merged openstack/tripleo-ansible stable/train: Handle generating grub config for EFI partitions https://review.opendev.org/728327 | 00:21 |
openstackgerrit | ada cui proposed openstack/tripleo-heat-templates master: Bump hacking min version to 3.1.0 https://review.opendev.org/729405 | 00:22 |
*** jmasud has joined #tripleo | 00:22 | |
*** jmasud has quit IRC | 00:23 | |
*** jmasud has joined #tripleo | 00:24 | |
*** jmasud_ has joined #tripleo | 00:41 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-operator-ansible master: Add operator for tripleo container image build https://review.opendev.org/729408 | 00:42 |
*** jmasud_ has quit IRC | 00:43 | |
*** jmasud has quit IRC | 00:43 | |
*** cdearborn has quit IRC | 00:48 | |
*** jmasud has joined #tripleo | 00:48 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-operator-ansible master: Add operator for tripleo container image build https://review.opendev.org/729408 | 00:55 |
*** jmasud has quit IRC | 00:55 | |
*** rbrady has quit IRC | 00:59 | |
*** lbragstad has joined #tripleo | 01:10 | |
openstackgerrit | Lance Bragstad proposed openstack/tripleo-docs master: Refactor TLS introduction https://review.opendev.org/729076 | 01:21 |
openstackgerrit | Lance Bragstad proposed openstack/tripleo-docs master: Introduce new TLS-e guide https://review.opendev.org/725607 | 01:21 |
*** jmasud has joined #tripleo | 01:21 | |
openstackgerrit | Lance Bragstad proposed openstack/tripleo-docs master: Add documentation about cleaning up stacks with TLS-e https://review.opendev.org/726155 | 01:21 |
openstackgerrit | Lance Bragstad proposed openstack/tripleo-docs master: Add a separate guide for public TLS https://review.opendev.org/728972 | 01:21 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-operator-ansible master: Add operator for tripleo container image build https://review.opendev.org/729408 | 01:21 |
openstackgerrit | Merged openstack/python-tripleoclient master: Ensure the ansible.cfg file presists https://review.opendev.org/725602 | 01:27 |
*** dmacpher_ has quit IRC | 01:27 | |
*** dmacpher has joined #tripleo | 01:27 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: standalone: add support to build containers before deployment https://review.opendev.org/729465 | 01:33 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: standalone: add support to build containers before deployment https://review.opendev.org/729465 | 01:35 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-quickstart-extras master: standalone: add support to build containers before deployment https://review.opendev.org/729465 | 01:36 |
*** saneax has quit IRC | 01:42 | |
openstackgerrit | Merged openstack/os-net-config master: Skip VFs configured for DPDKs during NIC ordering https://review.opendev.org/727215 | 01:43 |
openstackgerrit | Merged openstack/puppet-tripleo master: Include vendordata in nova-api and nova-metadata-api https://review.opendev.org/729074 | 01:43 |
*** waleedm_ has quit IRC | 01:47 | |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo stable/train: Include vendordata in nova-api and nova-metadata-api https://review.opendev.org/729476 | 02:01 |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo stable/train: [stable only] Fix duplicated test case for nova::api https://review.opendev.org/729478 | 02:06 |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo stable/train: Include vendordata in nova-api and nova-metadata-api https://review.opendev.org/729476 | 02:08 |
*** apetrich has quit IRC | 02:10 | |
*** rlandy has quit IRC | 02:16 | |
openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: DNM: Skip old-style interface/bridge config for new rhel/centos https://review.opendev.org/729415 | 02:21 |
*** jmasud has quit IRC | 02:23 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Drop support for python2 https://review.opendev.org/728889 | 02:35 |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo stable/train: [stable only] Fix duplicated test case for nova::api https://review.opendev.org/729478 | 02:49 |
openstackgerrit | Takashi Kajinami proposed openstack/puppet-tripleo stable/train: Include vendordata in nova-api and nova-metadata-api https://review.opendev.org/729476 | 02:49 |
*** marbindrakon has quit IRC | 02:54 | |
*** marbindrakon has joined #tripleo | 02:54 | |
*** ekultails has quit IRC | 03:09 | |
openstackgerrit | ada cui proposed openstack/tripleo-heat-templates master: Bump hacking min version to 3.1.0 https://review.opendev.org/729405 | 03:11 |
tonyb | I want (really really want) to use both https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/firstboot/userdata_root_password.yaml and https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/firstboot/os-net-config-mappings.yaml on all nodes in a deploy. I can easily see how to use the latter but if I understand correctly I ned to assigned them both to | 03:13 |
tonyb | OS::TripleO::NodeUserData #help? | 03:13 |
*** saneax has joined #tripleo | 03:15 | |
*** psachin has joined #tripleo | 03:37 | |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Drop support for python2 https://review.opendev.org/728889 | 03:38 |
*** rh-jelabarre has quit IRC | 04:03 | |
*** ratailor has joined #tripleo | 04:14 | |
*** lifeless has quit IRC | 04:22 | |
*** ykarel|away is now known as ykarel | 04:24 | |
*** ratailor has quit IRC | 04:27 | |
*** ratailor has joined #tripleo | 04:28 | |
*** evrardjp has quit IRC | 04:33 | |
*** evrardjp has joined #tripleo | 04:33 | |
*** raukadah is now known as chandankumar | 04:36 | |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Remove deprecated UsePrivilegeSeparation option https://review.opendev.org/728896 | 04:38 |
ykarel | tonyb, as per https://opendev.org/openstack/tripleo-heat-templates/src/branch/master/overcloud.j2.yaml#L717-L720 i think you can do that | 04:40 |
ykarel | but u need to assign both seperately, one to NodeData and other to role NodeData | 04:40 |
tonyb | ykarel: Ahh cool thanks | 04:42 |
*** skramaja has joined #tripleo | 04:42 | |
*** jmasud has joined #tripleo | 04:44 | |
openstackgerrit | Merged openstack/tripleo-heat-templates stable/train: Add cacert to clouds.yaml https://review.opendev.org/729090 | 04:50 |
*** lifeless has joined #tripleo | 04:52 | |
openstackgerrit | Ian Wienand proposed openstack/tripleo-ci master: Create Centos-8 only job template https://review.opendev.org/729508 | 05:00 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Drop support for python2 https://review.opendev.org/728889 | 05:01 |
*** udesale has joined #tripleo | 05:04 | |
*** psachin has quit IRC | 05:05 | |
*** jmasud has quit IRC | 05:11 | |
openstackgerrit | Karthik S proposed openstack/os-net-config stable/train: Skip VFs configured for DPDKs during NIC ordering https://review.opendev.org/729509 | 05:15 |
*** jfrancoa has joined #tripleo | 05:20 | |
*** marios has joined #tripleo | 05:33 | |
*** ccamacho has joined #tripleo | 05:34 | |
*** jmasud has joined #tripleo | 05:39 | |
openstackgerrit | Merged openstack/os-collect-config master: Stop testing python2.7 https://review.opendev.org/691638 | 05:40 |
*** gkadam has joined #tripleo | 05:40 | |
*** gkadam has quit IRC | 05:40 | |
*** lifeless has quit IRC | 05:41 | |
*** ccamacho has quit IRC | 05:42 | |
openstackgerrit | Merged openstack/os-collect-config master: Add tls proxy support for Zaqar https://review.opendev.org/726304 | 05:46 |
openstackgerrit | Merged openstack/os-collect-config stable/stein: remove tripleo jobs from os-collect-config stein https://review.opendev.org/728944 | 05:46 |
openstackgerrit | Merged openstack/os-collect-config stable/train: remove tripleo jobs from os-collect-config train https://review.opendev.org/728943 | 05:46 |
*** lifeless has joined #tripleo | 05:50 | |
*** lmiccini has joined #tripleo | 05:55 | |
*** dpawlik has joined #tripleo | 05:57 | |
*** morazi has quit IRC | 06:03 | |
*** morazi has joined #tripleo | 06:07 | |
openstackgerrit | ada cui proposed openstack/tripleo-heat-templates master: Bump hacking min version to 3.1.0 https://review.opendev.org/729405 | 06:18 |
*** ccamacho has joined #tripleo | 06:19 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: [DNM] ussuri current tripleo fun https://review.opendev.org/728424 | 06:21 |
*** abdysn has joined #tripleo | 06:25 | |
*** jmasud has quit IRC | 06:26 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart master: [DNM] ussuri fun tripleo-ci-testing https://review.opendev.org/728425 | 06:30 |
*** yolanda has joined #tripleo | 06:33 | |
*** ysandeep|away is now known as ysandeep | 06:39 | |
*** slaweq has joined #tripleo | 06:46 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-heat-templates master: Adding env file for octavia with kvm https://review.opendev.org/729518 | 06:52 |
*** apetrich has joined #tripleo | 06:55 | |
*** dmellado has quit IRC | 07:02 | |
*** bandini has joined #tripleo | 07:07 | |
*** maciejjozefczyk has joined #tripleo | 07:07 | |
openstackgerrit | Bhagyashri Shewale proposed openstack/tripleo-common stable/train: Fix for CentOS8 containers build https://review.opendev.org/729519 | 07:08 |
*** jcapitao has joined #tripleo | 07:08 | |
*** holser has joined #tripleo | 07:14 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: updates for centos-8-train standalone / undercloud https://review.opendev.org/728294 | 07:25 |
*** suuuper has joined #tripleo | 07:26 | |
*** tosky has joined #tripleo | 07:30 | |
openstackgerrit | Bhagyashri Shewale proposed openstack/tripleo-common stable/train: [Train only] Fix for CentOS8 containers build https://review.opendev.org/729519 | 07:32 |
*** jmasud has joined #tripleo | 07:34 | |
*** bogdando has joined #tripleo | 07:36 | |
*** s8k has quit IRC | 07:38 | |
*** amoralej|off is now known as amoralej | 07:39 | |
*** alexmcleod has joined #tripleo | 07:49 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart-extras master: Parameterize rdoinfo_repo_name for downstream https://review.opendev.org/727200 | 07:50 |
*** jpena|off is now known as jpena | 07:52 | |
*** jpich has joined #tripleo | 08:02 | |
openstackgerrit | Jean Pierre Roquesalane proposed openstack/tripleo-specs master: VxFlexOS integration into Tripleo https://review.opendev.org/724301 | 08:03 |
*** waleedm_ has joined #tripleo | 08:06 | |
*** lucasagomes has joined #tripleo | 08:07 | |
*** ramishra has joined #tripleo | 08:11 | |
*** ramishra has quit IRC | 08:17 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart-extras master: Parameterize rdoinfo_repo_name for downstream https://review.opendev.org/727200 | 08:22 |
*** tkajinam has quit IRC | 08:23 | |
*** xek has joined #tripleo | 08:24 | |
*** dmellado has joined #tripleo | 08:34 | |
*** derekh has joined #tripleo | 08:35 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-ci master: Port sc10 job to os_tempest https://review.opendev.org/729541 | 08:39 |
*** jmasud has quit IRC | 08:39 | |
*** jmasud has joined #tripleo | 08:40 | |
*** gfidente has joined #tripleo | 08:44 | |
*** ramishra has joined #tripleo | 08:46 | |
openstackgerrit | Merged openstack/tripleo-quickstart master: add helpful debug info when fetching images https://review.opendev.org/729404 | 08:48 |
*** ykarel is now known as ykarel|lunch | 08:57 | |
*** aedc has joined #tripleo | 09:00 | |
openstackgerrit | Chandan Kumar (raukadah) proposed openstack/tripleo-quickstart-extras master: Parameterize rdoinfo_repo_name for downstream https://review.opendev.org/727200 | 09:00 |
*** s8k has joined #tripleo | 09:04 | |
openstackgerrit | Bhagyashri Shewale proposed openstack/tripleo-common stable/train: [Train only] Fix for CentOS8 containers build https://review.opendev.org/729519 | 09:09 |
*** chem has quit IRC | 09:09 | |
*** ramishra has quit IRC | 09:09 | |
*** chem has joined #tripleo | 09:11 | |
openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart master: Setup featureset052 to run tempest skipped tests https://review.opendev.org/724256 | 09:11 |
*** shardy has joined #tripleo | 09:12 | |
openstackgerrit | ada cui proposed openstack/tripleo-heat-templates master: Bump hacking min version to 3.1.0 https://review.opendev.org/729405 | 09:15 |
openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Not load tempest_test_blacklist when tempest_run_skipped is true https://review.opendev.org/729185 | 09:20 |
openstackgerrit | Arx Cruz proposed openstack/tripleo-quickstart-extras master: Not load tempest_test_blacklist when tempest_run_skipped is true https://review.opendev.org/729185 | 09:25 |
*** ysandeep is now known as ysandeep|lunch | 09:29 | |
*** ramishra has joined #tripleo | 09:31 | |
*** jpich has quit IRC | 09:33 | |
*** jpich has joined #tripleo | 09:33 | |
*** florianf has joined #tripleo | 09:34 | |
openstackgerrit | Daniel Bengtsson proposed openstack/tripleo-validations master: New validation: ensures we have proper LANG value on the system https://review.opendev.org/724269 | 09:44 |
openstackgerrit | Merged openstack/tripleo-ansible master: Add centos support to EFI kernel args https://review.opendev.org/728351 | 09:46 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Run all noop opeartions in molecule testing. https://review.opendev.org/698526 | 09:49 |
openstackgerrit | ada cui proposed openstack/tripleo-heat-templates master: Bump hacking min version to 3.1.0 https://review.opendev.org/729405 | 09:55 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/tripleo-ansible stable/train: Remove fedora28 from redhat-8 test https://review.opendev.org/729556 | 10:04 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/tripleo-ansible stable/train: Add centos8 file for deps https://review.opendev.org/729557 | 10:08 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/tripleo-ansible stable/train: Add centos8 file for deps https://review.opendev.org/729557 | 10:09 |
openstackgerrit | Merged openstack/puppet-tripleo master: Fix ipv6 addrlabel for ceph-nfs https://review.opendev.org/610987 | 10:09 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/tripleo-ansible stable/train: Correctly match openvswitch package https://review.opendev.org/729396 | 10:09 |
*** ysandeep|lunch is now known as ysandeep | 10:09 | |
*** jpich has quit IRC | 10:12 | |
*** jpich has joined #tripleo | 10:12 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/tripleo-ansible stable/train: Change Ansible group from overcloud to allovercloud. https://review.opendev.org/724292 | 10:20 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: container_manage: relax delay to 10 seconds https://review.opendev.org/729560 | 10:33 |
EmilienM | ykarel|lunch: ^ | 10:33 |
*** hrw has left #tripleo | 10:34 | |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-ansible master: DNM: add verbosity to podman module https://review.opendev.org/729561 | 10:35 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Enable ConfigDebug in CI https://review.opendev.org/728946 | 10:39 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Enable ConfigDebug in CI https://review.opendev.org/728946 | 10:39 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: manila-share https://review.opendev.org/708357 | 10:39 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: ovn dbs https://review.opendev.org/707957 | 10:39 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: redis bundle https://review.opendev.org/707954 | 10:39 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: haproxy bundle https://review.opendev.org/707953 | 10:39 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: mysql https://review.opendev.org/707955 | 10:39 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: cinder backup/volume https://review.opendev.org/707956 | 10:39 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: rabbitmq https://review.opendev.org/707958 | 10:39 |
EmilienM | bandini: adding more debug FYI ^ | 10:39 |
*** jcapitao is now known as jcapitao_lunch | 10:44 | |
*** ykarel|lunch is now known as ykarel | 10:46 | |
ykarel | EmilienM, Thanks | 10:46 |
ykarel | EmilienM, i have also seen it's not finishing in even 15 minutes | 10:46 |
ykarel | not in zuul jobs, but in jenkins job, example https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-current-tripleo-delorean-minimal-733/overcloud-controller-0/var/log/containers/stdouts/keystone_db_sync.log | 10:46 |
EmilienM | ykarel: I wonder if we should increase the retries instead of the delay | 10:46 |
EmilienM | ykarel: to not make the deployment longer | 10:46 |
EmilienM | i suspect delay of 10s is too long | 10:46 |
ykarel | so something is wrong as it should not take more that much time | 10:47 |
ykarel | for db sync | 10:47 |
EmilienM | vms / ios :/ | 10:47 |
ykarel | EmilienM, hmm true the env i shared is libvirt based quickstart deploy | 10:50 |
ykarel | but it never timedout like this | 10:50 |
ykarel | so there is some regression | 10:51 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: podman/create: do not include failed containers in containers_to_check https://review.opendev.org/729238 | 10:53 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: podman/create: do not include failed containers in containers_to_check https://review.opendev.org/729238 | 10:53 |
EmilienM | ykarel: i don't know; probably. These db sync are always super slow and nobody seems to care | 10:53 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates stable/train: Configure valid_exit_code for startup containers https://review.opendev.org/729234 | 10:54 |
EmilienM | gouthamr: thanks for your review on https://review.opendev.org/#/c/722486/60/container-images/tcib/base/dependencies/manila-base/manila-base.yaml -- are you sure we can remove it? do we have generic driver users ? | 10:55 |
ykarel | EmilienM, but 15 minutes is too much i think, in passing jobs i have seen these finishing in seconds | 10:55 |
EmilienM | ykarel: maybe i could just increase the retries and keep 5s delay | 10:56 |
EmilienM | i think 10min and delay of 5s is what we should aim for | 10:57 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Run all noop opeartions in molecule testing. https://review.opendev.org/698526 | 10:58 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: container_manage: fix number of retries to match 10 minutes https://review.opendev.org/729560 | 10:59 |
*** ysandeep is now known as ysandeep|brb | 11:00 | |
openstackgerrit | Bogdan Dobrelya (bogdando) proposed openstack/tripleo-ansible master: Aggregate stats for podman-managed containers https://review.opendev.org/729260 | 11:01 |
ykarel | EmilienM, ok for me, i have tried with 560 retries too just now, and it too failed, issue is related to other rabbitmq_init_bundle | 11:02 |
*** raildo has joined #tripleo | 11:02 | |
ykarel | 560 tries with 5 sec delay is over 40 minutes | 11:02 |
ykarel | https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-current-tripleo-delorean-minimal-739/undercloud/home/stack/overcloud_deploy.log | 11:02 |
ykarel | https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-current-tripleo-delorean-minimal-739/overcloud-controller-0/var/log/containers/stdouts/rabbitmq_init_bundle.log | 11:03 |
EmilienM | ykarel: this is another bug | 11:04 |
EmilienM | https://bugs.launchpad.net/tripleo/+bug/1878405 | 11:04 |
openstack | Launchpad bug 1878405 in tripleo "tripleo ansible sometimes does not run certain containers" [High,Triaged] - Assigned to Emilien Macchi (emilienm) | 11:04 |
*** jmasud has quit IRC | 11:04 | |
ykarel | EmilienM, hmm i seen that | 11:05 |
*** jmasud has joined #tripleo | 11:05 | |
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-upgrade master: WIP: Cleanup in FFWD2 https://review.opendev.org/729566 | 11:07 |
bandini | EmilienM: ack, thanks | 11:07 |
*** ysandeep|brb is now known as ysandeep | 11:13 | |
openstackgerrit | Sergii Golovatiuk proposed openstack/tripleo-upgrade stable/train: Cater to non-composable environments https://review.opendev.org/729568 | 11:13 |
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates stable/train: FFWD: Introduce hybrid state for nova compute https://review.opendev.org/729353 | 11:18 |
openstackgerrit | Lukas Bezdicka proposed openstack/tripleo-heat-templates stable/train: FFWD: post Leapp package fixups https://review.opendev.org/729358 | 11:18 |
openstackgerrit | Merged openstack/tripleo-operator-ansible master: New operator: validator_run https://review.opendev.org/725225 | 11:25 |
*** jpena is now known as jpena|lunch | 11:30 | |
*** jmasud has quit IRC | 11:32 | |
*** sshnaidm is now known as sshnaidm|afk | 11:42 | |
hjensas | does the zuul reproducer work in CentOS 8 with podman? | 11:50 |
hjensas | the gerritconfig container fails to start, getting the logs indicate it's failing name resolution when trying to install ansible using pip. | 11:51 |
* hjensas tries CentOS 7 and docker instead ... | 11:53 | |
*** ekultails has joined #tripleo | 11:57 | |
*** ramishra has quit IRC | 11:58 | |
cloudnull | mornings | 12:00 |
*** raildo has quit IRC | 12:03 | |
*** amoralej is now known as amoralej|lunch | 12:04 | |
*** rh-jelabarre has joined #tripleo | 12:06 | |
*** raildo has joined #tripleo | 12:06 | |
*** abdysn has quit IRC | 12:13 | |
*** jcapitao_lunch is now known as jcapitao | 12:17 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Ensure that the playbooks and roles can display debug data when enabled https://review.opendev.org/715006 | 12:19 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/tripleo-ansible master: Add toggle for sensitive data within octavia https://review.opendev.org/723521 | 12:19 |
*** rlandy has joined #tripleo | 12:21 | |
*** udesale_ has joined #tripleo | 12:23 | |
*** udesale has quit IRC | 12:25 | |
*** jpena|lunch is now known as jpena | 12:26 | |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Run all noop opeartions in molecule testing. https://review.opendev.org/698526 | 12:39 |
EmilienM | sshnaidm|afk, bandini : May 20 12:02:25 standalone.localdomain ansible-podman_container[152375]: PODMAN-CONTAINER-DEBUG STDERR: Error: error checking path "/var/lib/config-data/puppet-generated/rabbitmq": stat /var/lib/config-data/puppet-generated/rabbitmq: no such file or directory | 12:42 |
*** derekh has quit IRC | 12:42 | |
EmilienM | bandini: podman failed with that and the podman_container module didn't catch the error | 12:42 |
bandini | EmilienM: aha! so the issue is that for whatever reason (to be investigated) that folder is missing and not some ansible/async/podman race? | 12:44 |
bogdando | isn't that path created by ansible/async/puppet? :) | 12:45 |
EmilienM | bandini: http://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_4b7/728946/5/check/tripleo-ci-centos-8-scenario002-standalone/4b77d71/logs/undercloud/var/log/extra/journal.txt | 12:45 |
*** Goneri has joined #tripleo | 12:45 | |
EmilienM | bandini: grep for PODMAN-CONTAINER-DEBUG STDERR | 12:45 |
EmilienM | "PODMAN-CONTAINER-DEBUG STDERR: Error" sorry | 12:45 |
bandini | EmilienM: ah thanks, let me look at that | 12:46 |
EmilienM | /var/lib/config-data/puppet-generated/rabbitmq does exist | 12:46 |
openstackgerrit | Slawek Kaplonski proposed openstack/tripleo-heat-templates stable/train: Add support for resource provider bandwidth in Neutron config https://review.opendev.org/727124 | 12:48 |
EmilienM | bandini: it sounds like I hit this error: https://github.com/containers/libpod/blob/dc7d6f4818f4b986cfd15208d53f6765d8fad986/libpod/options.go#L1219 | 12:50 |
EmilienM | I wonder if it's related to https://review.opendev.org/#/c/726832/1/tripleo_ansible/ansible_plugins/modules/podman_container.py | 12:52 |
EmilienM | it changed "workdir" code option | 12:52 |
*** sshnaidm|afk is now known as sshnaidm | 12:53 | |
EmilienM | bandini: it's in podman_container module | 12:53 |
EmilienM | bandini: the real issue is that libpod returns 0 when this error is returned and podman_container doesn't catch it (RC 0) so thinks container is deployed | 12:54 |
bandini | EmilienM: quick sync up? | 12:54 |
EmilienM | ok | 12:54 |
*** derekh has joined #tripleo | 12:59 | |
*** jpich has quit IRC | 12:59 | |
*** jpich has joined #tripleo | 12:59 | |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Run all noop opeartions in molecule testing. https://review.opendev.org/698526 | 13:01 |
*** ramishra has joined #tripleo | 13:03 | |
*** stevebaker has quit IRC | 13:04 | |
weshay|ruck | Tengu, is tripleo-lab running a virt undercloud on centos8 or rhel8? | 13:07 |
weshay|ruck | w/ a bridge on the host? | 13:08 |
*** jdandrea has joined #tripleo | 13:08 | |
Tengu | weshay|ruck: hardware can be centos-7 or 8 - not tested on rhel-8, and the undercloud can be anything rhel-based, 7 and 8 (so centos OK) | 13:10 |
weshay|ruck | Tengu, can you please point me at the code that sets up the network on the virthost | 13:10 |
Tengu | weshay|ruck: it uses 2 libvirt networks, the default one with DHCP, and a "ctlplane" without any DHCP. | 13:10 |
Tengu | 2s | 13:10 |
weshay|ruck | k.. thank you :) | 13:11 |
*** amoralej|lunch is now known as amoralej | 13:11 | |
Tengu | weshay|ruck: https://github.com/cjeanner/tripleo-lab/blob/master/roles/builder/files/virsh/networks/ctlplane.xml the "empty" network where the overcloud is deployed | 13:11 |
*** cdearborn has joined #tripleo | 13:11 | |
Tengu | weshay|ruck: the other one is the default you get on your node - I'm just ensuring it is active. | 13:11 |
Tengu | weshay|ruck: https://github.com/cjeanner/tripleo-lab/blob/master/roles/builder/tasks/libvirt.yaml#L83-L92 | 13:12 |
weshay|ruck | Tengu, which nic is vir-nodhcp tied to? | 13:12 |
Tengu | weshay|ruck: a dummy one | 13:12 |
Tengu | weshay|ruck: it's created without any interface | 13:13 |
weshay|ruck | rlandy, ^ | 13:13 |
*** jamesdenton has joined #tripleo | 13:15 | |
EmilienM | bandini, sshnaidm, bogdando : https://bugs.launchpad.net/tripleo/+bug/1878405/comments/17 | 13:15 |
openstack | Launchpad bug 1878405 in tripleo "tripleo ansible sometimes does not run certain containers" [High,Triaged] - Assigned to Emilien Macchi (emilienm) | 13:15 |
openstackgerrit | Rafael Folco proposed openstack/tripleo-quickstart-extras master: [skiplist] NetworkSecGroupTest timeout (train) https://review.opendev.org/729594 | 13:15 |
*** lbragstad has quit IRC | 13:16 | |
Tengu | weshay|ruck, rlandy libvirt does a magica vir-nodhcp-nic interface - just checked it now on my node :) | 13:16 |
*** lbragstad has joined #tripleo | 13:18 | |
*** abdysn has joined #tripleo | 13:23 | |
*** morazi has quit IRC | 13:24 | |
*** ratailor has quit IRC | 13:24 | |
bandini | EmilienM: ack, I just added a comment as well | 13:27 |
*** morazi has joined #tripleo | 13:28 | |
bogdando | EmilienM: if result is 0, but there is no container created, where is the further flaw resulting it missed in the reported lists of containers? | 13:29 |
EmilienM | bandini: i apparently can't read | 13:29 |
rlandy | Tengu: you're using virtualbmc here? | 13:29 |
bogdando | oh wait, there is probably none. It just reports nothing on the skipped container, right? | 13:29 |
bogdando | I've lost a bit, sorry | 13:30 |
openstackgerrit | amolkahat proposed openstack/tripleo-ci master: [DNM] Testing ironic tempest tests https://review.opendev.org/723876 | 13:38 |
*** waleedm_ has quit IRC | 13:38 | |
openstackgerrit | Pooja Jadhav proposed openstack/tripleo-quickstart-extras master: DNM : Refactor the ipa-multinode role https://review.opendev.org/729601 | 13:39 |
*** TrevorV has joined #tripleo | 13:41 | |
*** ykarel is now known as ykarel|afk | 13:46 | |
openstackgerrit | Alfredo Moralejo proposed openstack/puppet-pacemaker master: Prepare for 1.0.0 release https://review.opendev.org/729606 | 13:48 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-quickstart master: WIP Add featureset 064 to allow octavia version override https://review.opendev.org/729607 | 13:49 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: podman/create: make containers_to_check more realistic https://review.opendev.org/729238 | 13:50 |
EmilienM | bandini: ^ | 13:50 |
Tengu | rlandy: yep | 13:50 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-quickstart-extras master: WIP: allow octavia container images to controlled at deploy https://review.opendev.org/729608 | 13:51 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: podman/create: make containers_to_check more realistic https://review.opendev.org/729238 | 13:52 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-ci master: WIP: testing master octavia against stable https://review.opendev.org/729609 | 13:54 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: Enable ConfigDebug in CI https://review.opendev.org/728946 | 13:55 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: redis bundle https://review.opendev.org/707954 | 13:56 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: redis bundle https://review.opendev.org/707954 | 13:56 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: cinder backup/volume https://review.opendev.org/707956 | 13:56 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: rabbitmq https://review.opendev.org/707958 | 13:56 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: haproxy bundle https://review.opendev.org/707953 | 13:56 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: manila-share https://review.opendev.org/708357 | 13:56 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: ovn dbs https://review.opendev.org/707957 | 13:56 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: WIP pcs commands on host: mysql https://review.opendev.org/707955 | 13:56 |
EmilienM | bandini: trying to reproduce with my patch, hopefully it should fail earlier now | 13:56 |
bandini | nice! | 13:57 |
EmilienM | bandini: It will wait for the container-puppet-* to actually finish. | 13:58 |
*** jdandrea has quit IRC | 13:59 | |
bogdando | so that is a race for container puppet vs deploy steps? | 13:59 |
EmilienM | no | 13:59 |
EmilienM | it's a bad code in containers_to_check | 13:59 |
*** jdandrea has joined #tripleo | 13:59 | |
EmilienM | introduced by https://review.opendev.org/#/c/726933/ | 14:00 |
*** ramishra has quit IRC | 14:03 | |
*** ykarel|afk is now known as ykarel | 14:03 | |
bandini | EmilienM: w00t! | 14:10 |
openstackgerrit | Brent Eagles proposed openstack/tripleo-heat-templates stable/queens: WIP: testing master against stable https://review.opendev.org/729613 | 14:13 |
*** ayoung has joined #tripleo | 14:19 | |
*** holser has quit IRC | 14:29 | |
*** threestrands has quit IRC | 14:34 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Implement a new Container Images layout https://review.opendev.org/722486 | 14:37 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Implement a new Container Images layout https://review.opendev.org/722486 | 14:37 |
EmilienM | cloudnull: ^ i confirmed with gouthamr that we don't need OVS in the manila-based. Pushed a new PS. We're getting close imo | 14:38 |
Tengu | rlandy: need any help on something related to a lab setup? | 14:40 |
rlandy | Tengu: we have a physical provisioning network | 14:40 |
rlandy | Tengu: these are real baremetal deployments - but using a vm for the undercloud | 14:41 |
Tengu | rlandy: oh, ok | 14:41 |
rlandy | when introspection runs we see no DHCP or PXE offers | 14:41 |
Tengu | hmmm | 14:41 |
Tengu | rlandy: VM running on a centos-8 node? firewalld zone? | 14:42 |
rlandy | so something is not configured correctly with the new rhel 8 box setup | 14:42 |
rlandy | this worked fine on centos 7 | 14:42 |
Tengu | rlandy: firewalld, probably, there are zones in it :) | 14:42 |
Tengu | I had some issues with that here - you probably need to enable some stuff in the -errrrr. wait | 14:42 |
rlandy | eno2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 master brovc state forwarding priority 32 cost 100 | 14:43 |
rlandy | says it's forwarding | 14:43 |
*** shardy has quit IRC | 14:43 | |
Tengu | rlandy: libvirt zone | 14:43 |
rlandy | will check firewalld | 14:43 |
rlandy | hmmm... ok firewalld is up | 14:44 |
Tengu | rlandy: https://github.com/cjeanner/tripleo-lab/blob/master/roles/builder/tasks/virtualbmc.yaml#L97-L104 | 14:44 |
Tengu | rlandy: you need to allow some stuff to go from the "public" zone to the "libvirt". | 14:44 |
rlandy | ah ok | 14:44 |
Tengu | you won't see it in iptables - not directly at least. | 14:44 |
Tengu | had to solve this issue for my setup, even for vbmc :) | 14:44 |
rlandy | deciphering this for our setup | 14:44 |
* rlandy is tempted to turn firewalld off to see if that is the issue | 14:45 | |
Tengu | rlandy: maybe you can use some "service". wait. | 14:45 |
Tengu | rlandy: firewall-cmd --zone libvirt --add-service dhcp might help | 14:46 |
Tengu | you should at least see DHCP requests there | 14:46 |
rlandy | Tengu: let's try that to start | 14:47 |
rlandy | firewall-cmd --zone libvirt --add-service dhcp | 14:47 |
rlandy | Warning: ALREADY_ENABLED: 'dhcp' already in 'libvirt' | 14:47 |
rlandy | success | 14:47 |
Tengu | oh. | 14:47 |
Tengu | rlandy: firewall-cmd --zone libvirt --list-services ? | 14:47 |
Tengu | this should show you what's allowed there | 14:48 |
rlandy | dhcp dhcpv6 dns ssh tftp | 14:48 |
rlandy | let's see what's on the vm | 14:48 |
Tengu | maybe you're just missing some MASQUERADE things. lemme check what I have here | 14:48 |
rlandy | not enabled there | 14:49 |
Tengu | rlandy: https://github.com/cjeanner/tripleo-lab/blob/master/roles/builder/tasks/virtualbmc.yaml#L76-L91 is pushing in iptables directly | 14:49 |
*** ayoung has quit IRC | 14:50 | |
rlandy | I think I need to open up direct forwarding | 14:51 |
rlandy | sec | 14:51 |
Tengu | rlandy: probably yeah. That's what I'm doing in the second block I've linked | 14:51 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: podman/create: make containers_to_check more realistic https://review.opendev.org/729238 | 14:52 |
*** ayoung has joined #tripleo | 14:52 | |
cloudnull | EmilienM nice! | 14:53 |
*** holser has joined #tripleo | 14:53 | |
openstackgerrit | Bhagyashri Shewale proposed openstack/tripleo-common stable/train: [Train only] Fix for CentOS8 containers build https://review.opendev.org/729519 | 15:06 |
*** skramaja has quit IRC | 15:09 | |
sshnaidm | what may mean: openstack.exceptions.NotSupported: The baremetal-introspection service for undercloud:regionOne exists but does not have any supported versions | 15:11 |
openstackgerrit | Luke Short proposed openstack/puppet-tripleo master: Allow the Mistral tunnel timeout to be configurable. https://review.opendev.org/728974 | 15:20 |
openstackgerrit | Luke Short proposed openstack/tripleo-heat-templates master: Expose the zaqar_ws_timeout_tunnel variable. https://review.opendev.org/728976 | 15:24 |
*** holser has quit IRC | 15:25 | |
*** pojadhav is now known as pojadhav|dinner | 15:26 | |
*** holser has joined #tripleo | 15:29 | |
xek | mwhahaha, hjensas, please take a look at https://review.opendev.org/#/q/topic:fix_cron_job (queens backport) | 15:37 |
sshnaidm | dtantsur|afk, hi, do you know maybe why this can happen? http://paste.openstack.org/show/793813/ | 15:40 |
sshnaidm | dtantsur|afk, introspection service shuts down, maybe some versions/rpms mismatch? | 15:41 |
ykarel | sshnaidm, where u see this error? | 15:47 |
ykarel | ERROR stevedore.extension AttributeError: module 'construct.core' has no attribute 'Embedded' | 15:47 |
ykarel | ^^ one | 15:47 |
sshnaidm | ykarel, in ussuri ovb job | 15:47 |
ykarel | i know this, it happens when python-construct and ironic-inspector are not compatible | 15:47 |
ykarel | sshnaidm, ^ | 15:47 |
ykarel | sshnaidm, logs | 15:48 |
sshnaidm | ykarel, job is still running, I can add your keys there | 15:48 |
sshnaidm | python3-construct.noarch 2.8.22-1.el8 delorean-ussuri-testing | 15:48 |
openstackgerrit | Bogdan Dobrelya (bogdando) proposed openstack/tripleo-quickstart master: Do not use async/poll for libvirt volume upload https://review.opendev.org/729640 | 15:49 |
ykarel | sshnaidm, construct is good, what is ironic-inspector? | 15:49 |
sshnaidm | ykarel, all versions http://paste.openstack.org/show/793813/ in the bottom | 15:50 |
* ykarel rejoins, some network issue | 15:50 | |
sshnaidm | ykarel, resent you in priv | 15:52 |
*** marios is now known as marios|out | 15:58 | |
*** marios|out has quit IRC | 15:58 | |
*** jcapitao has quit IRC | 16:00 | |
*** rcernin has quit IRC | 16:04 | |
*** lucasagomes has quit IRC | 16:06 | |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Run all noop opeartions in molecule testing. https://review.opendev.org/698526 | 16:06 |
openstackgerrit | Jose Luis Franco proposed openstack/tripleo-upgrade master: Run all noop operations in molecule testing. https://review.opendev.org/698526 | 16:06 |
*** abdysn has quit IRC | 16:12 | |
*** Abdallahyas has joined #tripleo | 16:12 | |
*** pojadhav|dinner is now known as pojadhav | 16:14 | |
*** redrobot has joined #tripleo | 16:16 | |
*** lmiccini has quit IRC | 16:16 | |
*** florianf has quit IRC | 16:20 | |
*** ykarel is now known as ykarel|away | 16:23 | |
openstackgerrit | Dave Wilde (d34dh0r53) proposed openstack/python-tripleoclient master: Detect TLS for pre-provisioned nodes https://review.opendev.org/729652 | 16:23 |
openstackgerrit | Dave Wilde (d34dh0r53) proposed openstack/tripleo-heat-templates master: Add composible service for tls enrollment https://review.opendev.org/729653 | 16:23 |
*** ayoung has quit IRC | 16:23 | |
*** jpich has quit IRC | 16:24 | |
*** jmasud has joined #tripleo | 16:24 | |
*** ayoung has joined #tripleo | 16:26 | |
*** aedc_ has joined #tripleo | 16:32 | |
*** bogdando has quit IRC | 16:33 | |
*** aedc has quit IRC | 16:35 | |
*** Abdallahyas has quit IRC | 16:39 | |
*** ysandeep is now known as ysandeep|afk | 16:42 | |
openstackgerrit | amolkahat proposed openstack/tripleo-ci master: [DNM] Testing ironic tempest tests https://review.opendev.org/723876 | 16:47 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates master: DNM - deploy CI scenarios using new container images from quay.io https://review.opendev.org/727767 | 16:51 |
*** gfidente is now known as gfidente|afk | 16:51 | |
openstackgerrit | Bhagyashri Shewale proposed openstack/tripleo-common stable/train: [Train only] Fix for CentOS8 containers build https://review.opendev.org/729519 | 16:59 |
*** jmasud has quit IRC | 17:00 | |
*** lbragstad has quit IRC | 17:02 | |
*** udesale_ has quit IRC | 17:07 | |
*** jmasud has joined #tripleo | 17:08 | |
*** amoralej is now known as amoralej|off | 17:10 | |
*** derekh has quit IRC | 17:11 | |
*** aedc has joined #tripleo | 17:12 | |
*** holser has quit IRC | 17:12 | |
*** aedc_ has quit IRC | 17:13 | |
*** dpawlik has quit IRC | 17:15 | |
*** jpena is now known as jpena|off | 17:15 | |
openstackgerrit | Merged openstack/tripleo-ansible stable/train: Remove fedora28 from redhat-8 test https://review.opendev.org/729556 | 17:15 |
*** aedc has quit IRC | 17:16 | |
*** aedc has joined #tripleo | 17:17 | |
openstackgerrit | Merged openstack/tripleo-ansible stable/train: Add centos8 file for deps https://review.opendev.org/729557 | 17:17 |
*** holser has joined #tripleo | 17:19 | |
*** ysandeep|afk is now known as ysandeep | 17:22 | |
*** holser has quit IRC | 17:22 | |
*** holser has joined #tripleo | 17:23 | |
*** lbragstad has joined #tripleo | 17:23 | |
openstackgerrit | Merged openstack/tripleo-upgrade stable/train: Remove unused containers from molecule test https://review.opendev.org/728415 | 17:23 |
openstackgerrit | Merged openstack/tripleo-heat-templates master: Revert "Add shared volume for side-car wrapper locks" https://review.opendev.org/728891 | 17:23 |
*** raildo has quit IRC | 17:25 | |
*** aedc has quit IRC | 17:25 | |
*** aedc has joined #tripleo | 17:25 | |
*** raildo has joined #tripleo | 17:25 | |
*** aedc has quit IRC | 17:32 | |
*** ayoung has quit IRC | 17:38 | |
*** ayoung has joined #tripleo | 17:40 | |
sshnaidm | weshay|ruck, hmm.. it fails now on | 17:45 |
sshnaidm | msg: Destination directory /etc/pki/tls/private does not exist | 17:45 |
sshnaidm | TASK [push certificate content] | 17:45 |
sshnaidm | seems like someone didn't mount /etc/pki/tls/private | 17:47 |
weshay|ruck | sshnaidm, hrm.. is the dir there? | 17:49 |
weshay|ruck | or missing? | 17:49 |
sshnaidm | weshay|ruck, there | 17:50 |
sshnaidm | weshay|ruck, but maybe not mounted to container | 17:50 |
weshay|ruck | sshnaidm, k | 17:51 |
*** ayoung has quit IRC | 17:51 | |
weshay|ruck | ade_lee, ping | 17:51 |
weshay|ruck | sshnaidm, we should look at master and see if it's the same issue | 17:51 |
weshay|ruck | master is failing in deployment | 17:51 |
* weshay|ruck looks | 17:51 | |
sshnaidm | weshay|ruck, oops, it was failing on overcloud nodes directory, didn't check it there :( | 17:52 |
weshay|ruck | sshnaidm, master has | 17:53 |
weshay|ruck | TASK [push certificate content] ************************************************ | 17:53 |
weshay|ruck | 2020-05-19 18:52:05 | Tuesday 19 May 2020 18:52:05 +0000 (0:00:00.148) 0:02:13.206 *********** | 17:53 |
weshay|ruck | 2020-05-19 18:52:05 | fatal: [overcloud-controller-0]: FAILED! => changed=false | 17:53 |
weshay|ruck | 2020-05-19 18:52:05 | checksum: 2e9feb2fa9af024b80aca89d62253e5d633a36b2 | 17:53 |
weshay|ruck | 2020-05-19 18:52:05 | msg: Destination directory /etc/pki/tls/private does not exist | 17:53 |
weshay|ruck | 2020-05-19 18:52:05 | fatal: [overcloud-controller-1]: FAILED! => changed=false | 17:53 |
weshay|ruck | bhagyashris|ruck, rfolco|rover do we have bugs on master fs001? | 17:53 |
* weshay|ruck looks | 17:53 | |
*** ayoung has joined #tripleo | 17:53 | |
sshnaidm | weshay|ruck, oh, same | 17:53 |
weshay|ruck | sshnaidm, I'll write it up.. what else did you see there? | 17:54 |
weshay|ruck | overcloud nodes dir? | 17:54 |
sshnaidm | weshay|ruck, nothing else | 17:54 |
sshnaidm | weshay|ruck, there is running another job, we'll look.. | 17:54 |
rfolco|rover | weshay|ruck, I don't think so, let me check | 17:55 |
weshay|ruck | sshnaidm, k.. will probably fail | 17:55 |
weshay|ruck | rfolco|rover, bhagyashris|ruck do you guys have one for the image builds in master? | 17:55 |
rfolco|rover | bhagyashris|ruck mentioned train container build >> https://bugs.launchpad.net/tripleo/+bug/1879638 | 17:56 |
openstack | Launchpad bug 1879638 in tripleo "[Train Only] Error: No matching repo to modify: epel failing container build push on centos-8 train" [High,Triaged] | 17:56 |
rfolco|rover | weshay|ruck, ok let me take care of these 2 | 17:57 |
weshay|ruck | rfolco|rover, https://bugs.launchpad.net/tripleo/+bug/1879766 | 17:58 |
openstack | Launchpad bug 1879766 in tripleo "master ovb jobs failing on Destination directory /etc/pki/tls/private does not exis" [Critical,Triaged] | 17:58 |
rfolco|rover | weshay|ruck, I got 2847364434 tabs open for gate failures, too many different issues.... not sure how many they really are | 17:58 |
weshay|ruck | ade_lee, ^ blocking release of ussuri | 17:58 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Add openstack tripleo container image build https://review.opendev.org/724147 | 17:58 |
weshay|ruck | sshnaidm, do you have a held env? | 17:59 |
weshay|ruck | hrybacki, you still around? | 17:59 |
sshnaidm | weshay|ruck, without ovb stack :( only undercloud, which doesn't help | 17:59 |
weshay|ruck | sshnaidm, k.. can we fire another w/ the hold settings? | 18:00 |
*** amodi has quit IRC | 18:00 | |
sshnaidm | weshay|ruck, yeah | 18:00 |
weshay|ruck | sshnaidm, rfolco|rover bhagyashris|ruck you'll want to watch sshnaidm's review how to do this | 18:00 |
weshay|ruck | and make sure it's doc'd in the ruck/rover notes | 18:00 |
ade_lee | weshay|ruck, hey there -- another day, another fire .. whats up? | 18:01 |
sshnaidm | weshay|ruck, ovb part is not done, so I'll hold it with "sleep" till job timeout | 18:01 |
weshay|ruck | ade_lee, there is a cert issue in master/ussuri | 18:01 |
weshay|ruck | and ussuri is close to release | 18:01 |
weshay|ruck | ade_lee, starting to write up https://bugs.launchpad.net/tripleo/+bug/1879766 | 18:02 |
openstack | Launchpad bug 1879766 in tripleo "master ovb jobs failing on Destination directory /etc/pki/tls/private does not exis" [Critical,Triaged] | 18:02 |
ade_lee | weshay|ruck, are we sure this isn't the same issue as the composes before? | 18:02 |
weshay|ruck | ade_lee, re: images | 18:02 |
ade_lee | yup | 18:02 |
weshay|ruck | and missing files | 18:02 |
weshay|ruck | sshnaidm, says the files are there | 18:02 |
weshay|ruck | just not getting mounted by the container | 18:02 |
sshnaidm | weshay|ruck, no, it was on undercloud | 18:03 |
weshay|ruck | sshnaidm, has a system up atm | 18:03 |
sshnaidm | weshay|ruck, and the error is about overcloud contoller | 18:03 |
weshay|ruck | k.. ya. then not the overcloud image issue we hit before | 18:03 |
*** bandini has quit IRC | 18:03 | |
weshay|ruck | good to ask though :) | 18:03 |
*** jmasud has quit IRC | 18:04 | |
ade_lee | weshay|ruck, wait -- sorry -- I thought sshnaidm was saying it was the same overcloud image as before? | 18:04 |
*** chandankumar is now known as raukadah | 18:06 | |
weshay|ruck | ade_lee, sshnaidm ^ | 18:06 |
ade_lee | weshay|ruck, sshnaidm so trying to understand here -- host_prep_tasks means this is taking place on the undercloud, right? | 18:08 |
sshnaidm | fatal: [overcloud-controller-0]: FAILED! = | 18:09 |
ade_lee | so according to this -- /etc/pki/tls/private does not exist on the undercloud, right? | 18:09 |
sshnaidm | ade_lee, the task was running on controller | 18:09 |
sshnaidm | ade_lee, no ^ | 18:09 |
mwhahaha | weshay|ruck, sshnaidm: /etc/pki/tls/private comes from openssl-libs, bad image? | 18:09 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Add openstack tripleo container image build https://review.opendev.org/724147 | 18:09 |
ade_lee | ok -- then what mwhahaha said ^^ | 18:09 |
mwhahaha | missing dependency? | 18:10 |
*** ysandeep is now known as ysandeep|away | 18:10 | |
mwhahaha | feels like the missing pcsd directory thing where we're missing empty directories in the overcloud-full | 18:11 |
ade_lee | yup | 18:12 |
weshay|ruck | sshnaidm, still w/ us? | 18:17 |
weshay|ruck | can we get on the box | 18:17 |
sshnaidm | weshay|ruck, what's your keys | 18:18 |
sshnaidm | you can check image without job btw | 18:19 |
weshay|ruck | aye | 18:19 |
weshay|ruck | note.. there is a history here | 18:19 |
weshay|ruck | https://github.com/weshayutin.keys | 18:20 |
sshnaidm | https://logserver.rdoproject.org/63/27463/6/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-ussuri/dc57d7d/logs/overcloud-controller-0/etc/pki/tls/ | 18:29 |
sshnaidm | weshay|ruck, ^ | 18:29 |
sshnaidm | weshay|ruck, but exists on undercloud: https://logserver.rdoproject.org/63/27463/6/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-ussuri/dc57d7d/logs/undercloud/etc/pki/tls/ | 18:29 |
*** holser_ has joined #tripleo | 18:30 | |
*** holser has quit IRC | 18:30 | |
sshnaidm | but images contains: virt-ls -a overcloud-full.qcow2 /etc/pki/tls/ | 18:35 |
sshnaidm | ... | 18:35 |
sshnaidm | private | 18:35 |
sshnaidm | ade_lee, ^^ | 18:35 |
openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: Include copy-image for GlanceEnabledImportMethods for dch-hci https://review.opendev.org/729214 | 18:37 |
*** holser_ has quit IRC | 18:40 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-operator-ansible master: Add operator for tripleo container image build https://review.opendev.org/729408 | 18:40 |
*** holser has joined #tripleo | 18:40 | |
openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart-extras master: DNM wait https://review.opendev.org/729740 | 18:41 |
openstackgerrit | John Fulton proposed openstack/tripleo-heat-templates master: Include copy-image for GlanceEnabledImportMethods for dcn-hci https://review.opendev.org/729214 | 18:41 |
ade_lee | sshnaidm, you doing the wait so we can go in and check the overcloud image? | 18:42 |
sshnaidm | ade_lee, hopefully, but qcow image is fine - see above | 18:42 |
ade_lee | sshnaidm, yeah -- I see that | 18:43 |
sshnaidm | ade_lee, something deletes them, because in the end it's not there | 18:43 |
openstackgerrit | Merged openstack/puppet-pacemaker master: Prepare for 1.0.0 release https://review.opendev.org/729606 | 18:49 |
*** jmasud has joined #tripleo | 19:08 | |
weshay|ruck | ade_lee, give me your public keys | 19:12 |
weshay|ruck | we'll hold this env for 4 hours after it passes or fails | 19:12 |
*** ayoung has quit IRC | 19:15 | |
*** lbragstad_ has joined #tripleo | 19:19 | |
*** lbragstad has quit IRC | 19:22 | |
*** jmasud has quit IRC | 19:23 | |
openstackgerrit | Merged openstack/tripleo-upgrade master: Cater to non-composable environments https://review.opendev.org/729203 | 19:26 |
*** stevebaker has joined #tripleo | 19:29 | |
*** jmasud has joined #tripleo | 19:29 | |
*** suuuper has quit IRC | 19:30 | |
*** jfrancoa has quit IRC | 19:32 | |
*** dciabrin has quit IRC | 19:39 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible master: container_manage: fix number of retries to match 10 minutes https://review.opendev.org/729560 | 19:47 |
openstackgerrit | Merged openstack/tripleo-ansible stable/train: Correctly match openvswitch package https://review.opendev.org/729396 | 19:49 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-common master: Fix dry-run for "remote copy deployment file" task https://review.opendev.org/729749 | 20:03 |
*** jmasud has quit IRC | 20:04 | |
*** jmasud has joined #tripleo | 20:08 | |
*** jmasud has quit IRC | 20:12 | |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible stable/train: podman/create: make containers_to_check more realistic https://review.opendev.org/729751 | 20:12 |
openstackgerrit | Emilien Macchi proposed openstack/tripleo-ansible stable/train: [train-squash] Fix default timeouts for container_manage https://review.opendev.org/729752 | 20:12 |
rlandy | Tengu: thank you!!! life saver | 20:16 |
rlandy | firewalld was blocking dhcp | 20:16 |
weshay|ruck | Tengu++ | 20:19 |
*** ccamacho has quit IRC | 20:25 | |
*** maciejjozefczyk has quit IRC | 20:30 | |
*** rlandy is now known as rlandy|biab | 20:32 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/python-tripleoclient master: Add openstack tripleo container image build https://review.opendev.org/724147 | 20:37 |
weshay|ruck | ade_lee, we'll also have a real baremetal env to look here shortly as well thanks to rlandy|biab | 20:42 |
ade_lee | weshay|ruck, so, did we see the same problem? | 20:47 |
ade_lee | weshay|ruck, looks like its there | 20:48 |
weshay|ruck | ade_lee, you on the tmux? sshnaidm files are there | 20:48 |
weshay|ruck | so let's see | 20:48 |
*** xek has quit IRC | 20:49 | |
weshay|ruck | k.. on all 3 atm | 20:51 |
*** rlandy|biab is now known as rlandy | 20:59 | |
EmilienM | weshay|ruck, rlandy : qq: from top of your head, can i set a var in zuul job layout and use it in oooq-extras? | 21:00 |
weshay|ruck | EmilienM, is this the container-build job or something else | 21:00 |
rlandy | EmilienM: yes .. job. | 21:00 |
weshay|ruck | must be something else.. | 21:01 |
rlandy | getting example ... | 21:01 |
EmilienM | weshay|ruck: something NEW | 21:01 |
weshay|ruck | oh boy | 21:01 |
EmilienM | rlandy: ok, job. thanks | 21:01 |
rlandy | EmilienM: see https://github.com/openstack/tripleo-quickstart/blob/master/roles/repo-setup/templates/repo_setup.sh.j2#L24 | 21:02 |
rlandy | job.add_repos | 21:02 |
rlandy | EmilienM: https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/component-jobs.yaml#L432 shows the var defined in the job def | 21:04 |
*** rfolco|rover is now known as rfolco|rover|off | 21:04 | |
EmilienM | rlandy: perfect, tyvm | 21:05 |
rlandy | weshay|ruck: found docker setting - when you are done on the undercloud box, let me know and I'll rerun the deployment | 21:07 |
weshay|ruck | rlandy, you can take it now | 21:08 |
rlandy | ok | 21:08 |
weshay|ruck | ade_lee, it's gone | 21:08 |
weshay|ruck | nevermind | 21:09 |
weshay|ruck | lolz | 21:09 |
weshay|ruck | phat finger | 21:09 |
weshay|ruck | ade_lee, deployment passed :) | 21:10 |
weshay|ruck | dear lord | 21:10 |
weshay|ruck | ade_lee, mwhahaha if it is still the images.. I'll have to kill someone :) | 21:10 |
mwhahaha | sounds accurate | 21:11 |
ade_lee | weshay|ruck, need a list ? :) | 21:12 |
weshay|ruck | ade_lee, of people to kill lolz | 21:13 |
weshay|ruck | sure.. might as well do it all at once | 21:13 |
ade_lee | weshay|ruck, good thing the deployment passed .. | 21:13 |
weshay|ruck | I might as well drink on the job... would get the same results | 21:14 |
*** cdearborn has quit IRC | 21:21 | |
weshay|ruck | mwhahaha, do the heat stacks in the minion test need to have unique names? http://paste.openstack.org/show/793824/ | 21:42 |
mwhahaha | weshay|ruck: it's not the heat stacks, the minion's engine didn't report in | 21:43 |
*** holser has quit IRC | 21:43 | |
weshay|ruck | hrm.. want to make sure that's working for ussuri eh? probably packaging? | 21:45 |
weshay|ruck | https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-containers-undercloud-minion-ussuri&job_name=periodic-tripleo-ci-centos-8-containers-undercloud-minion-master | 21:45 |
weshay|ruck | rlandy, I think if baremetal ussuri works .. https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/stream/b2ba9d8b4f6d4bbc914574e2e7b6f99f?logfile=console.log | 21:49 |
weshay|ruck | we'll release | 21:49 |
weshay|ruck | rlandy, the ovb job passed | 21:49 |
rlandy | weshay|ruck: ack | 21:49 |
rlandy | job in progress | 21:49 |
rlandy | weshay|ruck: bm ussuri may fail for other reasons - we may want to release anyways - will send results by EOD | 21:50 |
weshay|ruck | rlandy, no need my eyes on it :) | 21:51 |
rlandy | ok | 21:51 |
weshay|ruck | rlandy, I need to check w/ #rdo and see if they are ready | 21:51 |
*** raildo has quit IRC | 21:56 | |
*** raildo_ has joined #tripleo | 21:56 | |
*** gfidente|afk has quit IRC | 21:58 | |
openstackgerrit | Merged openstack/tripleo-ansible master: podman/create: make containers_to_check more realistic https://review.opendev.org/729238 | 21:59 |
openstackgerrit | Merged openstack/puppet-tripleo master: Deprecating ScaleIO Volume Config https://review.opendev.org/728728 | 22:01 |
openstackgerrit | Merged openstack/tripleo-common master: Use unittest.mock instead of third party mock https://review.opendev.org/728500 | 22:01 |
*** Goneri has quit IRC | 22:06 | |
*** slaweq has quit IRC | 22:13 | |
*** rh-jelabarre has quit IRC | 22:26 | |
*** rh-jelabarre has joined #tripleo | 22:27 | |
openstackgerrit | Takashi Kajinami proposed openstack/tripleo-heat-templates stable/train: DNM: Test vendordata configuration https://review.opendev.org/729780 | 22:35 |
*** TrevorV has quit IRC | 22:35 | |
*** tkajinam has joined #tripleo | 22:37 | |
weshay|ruck | do we want to maintain https://bugs.launchpad.net/tripleo/+bug/1879081 http://ucw.tripleo.org/ | 22:44 |
openstack | Launchpad bug 1879081 in tripleo "Broken link : Undercloud Installation in tripleo-docs" [Medium,Triaged] | 22:44 |
*** jmasud has joined #tripleo | 22:52 | |
*** jmasud has quit IRC | 23:03 | |
*** raildo_ has quit IRC | 23:03 | |
*** jmasud has joined #tripleo | 23:05 | |
*** rcernin has joined #tripleo | 23:08 | |
*** jmasud has quit IRC | 23:09 | |
openstackgerrit | Rajini Karthik proposed openstack/puppet-tripleo master: Support for Dell EMC VXFlexOS Backend https://review.opendev.org/728720 | 23:19 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Drop support for python2 https://review.opendev.org/728889 | 23:19 |
openstackgerrit | Merged openstack/tripleo-upgrade stable/train: Cater to non-composable environments https://review.opendev.org/728996 | 23:23 |
openstackgerrit | Rajini Karthik proposed openstack/tripleo-heat-templates master: Deprecating Old ScaleIO Volume Config https://review.opendev.org/728729 | 23:25 |
openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Drop support for python2 https://review.opendev.org/728889 | 23:35 |
openstackgerrit | Merged openstack/tripleo-quickstart master: Add Amphora image url in fs038 https://review.opendev.org/728797 | 23:44 |
*** tosky has quit IRC | 23:48 | |
*** threestrands has joined #tripleo | 23:49 | |
*** ekultails has quit IRC | 23:51 | |
cloudnull | weshay|ruck I'd say no? personally I'd like to see that just redirect to https://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/ or something similar. | 23:55 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!