Thursday, 2021-12-02

*** rlandy|ruck|biab is now known as rlandy|ruck00:06
*** rlandy|ruck is now known as rlandy|out00:30
*** rcastillo is now known as rcastillo|out01:23
opendevreviewBrendan Shephard proposed openstack/python-tripleoclient master: WIP - Replace non-inclusive language  https://review.opendev.org/c/openstack/python-tripleoclient/+/82007801:23
*** pmannidi|Interview is now known as pmannidi02:45
opendevreviewMerged openstack/tripleo-heat-templates master: Introduce a new linter for yaml-validate, and correct issues  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81989903:07
opendevreviewMerged openstack/diskimage-builder master: Fix BLS based bootloader installation  https://review.opendev.org/c/openstack/diskimage-builder/+/81885103:26
*** pmannidi is now known as pmannidi|Lunch03:39
opendevreviewKarthik S proposed openstack/os-net-config master: Notify the need for overriding the default driver for Mellanox NIC  https://review.opendev.org/c/openstack/os-net-config/+/81999903:43
opendevreviewKarthik S proposed openstack/os-net-config master: The default max/min tx rates shall not halt deployment  https://review.opendev.org/c/openstack/os-net-config/+/82004003:49
*** ysandeep|out is now known as ysandeep|ruck04:33
*** pojadhav- is now known as pojadhav05:22
Tengurlandy|out: let's see :). Thanks for that revert!05:27
opendevreviewCedric Jeanneret proposed openstack/tripleo-heat-templates stable/wallaby: Introduce a new linter for yaml-validate, and correct issues  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82011105:34
Tengurlandy|out: -^^  started backporting the new linter as well.05:37
*** ysandeep|ruck is now known as ysandeep|afk05:52
*** pmannidi|Lunch is now known as pmannidi06:09
*** ysandeep|afk is now known as ysandeep|ruck06:15
opendevreviewSandeep Yadav proposed openstack/tripleo-ansible master: Custom networks ci nic template  https://review.opendev.org/c/openstack/tripleo-ansible/+/81852906:38
opendevreviewFrancesco Pantano proposed openstack/tripleo-ansible master: Turn crush_hierarchy path into var content  https://review.opendev.org/c/openstack/tripleo-ansible/+/82011606:49
*** raukadah is now known as chandankumar06:51
chandankumarTengu: thank you for working on this https://review.opendev.org/c/openstack/tripleo-heat-templates/+/819646 :-)06:54
Tenguchandankumar: :)06:54
Tenguchandankumar: happy to help ;)06:55
Tenguhmm. the linter backport will be a new world of headaches.06:55
Tenguuho06:55
Tenguok. fun. some mounts/services were apparently removed since wallaby, and the linter backport is showing the trailing "/" on them :D06:56
Tenguerr... wait. what?!06:58
chandankumarhttps://review.opendev.org/c/openstack/tripleo-heat-templates/+/819899/3 this one?06:58
Tenguhttps://review.opendev.org/c/openstack/tripleo-heat-templates/+/82011106:58
Tenguliquidio service.06:58
Tenguiirc it has been removed.06:59
Tengulemme tox -e pep8 and see locally.06:59
Tenguuho... and there are "nice" use of ":z" that won't apply anyway.06:59
Tenguwhat's that service anyway.06:59
opendevreviewSandeep Yadav proposed openstack/tripleo-quickstart-extras master: Update condition to include cloud-names.yaml  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81851807:01
opendevreviewCedric Jeanneret proposed openstack/tripleo-heat-templates stable/wallaby: Introduce a new linter for yaml-validate, and correct issues  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82011107:02
Tenguchandankumar: -^07:02
Tenguadded a note in the commit message about that "conflict".07:02
*** ykarel__ is now known as ykarel07:08
*** ysandeep|ruck is now known as ysandeep|lunch07:23
opendevreviewJiri Podivin proposed openstack/validations-common master: Create security component for CI Validations component jobs  https://review.opendev.org/c/openstack/validations-common/+/81887207:24
*** amoralej|off is now known as amoralej07:54
mariosarxcruz|rover: when you have some time please check https://review.opendev.org/c/openstack/tripleo-ci/+/816991/9#message-ddd5fd0bd7003e793780774b019d10d190d4000708:07
opendevreviewCedric Jeanneret proposed openstack/tripleo-heat-templates stable/wallaby: Introduce a new linter for yaml-validate, and correct issues  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82011108:26
*** ysandeep|lunch is now known as ysandeep08:28
*** ysandeep is now known as ysandeep|ruck08:28
opendevreviewSandeep Yadav proposed openstack/tripleo-heat-templates master: Add templates for for custom network ci job  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81236908:42
opendevreviewSandeep Yadav proposed openstack/tripleo-heat-templates master: Add templates for for custom network ci job  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81236909:18
opendevreviewMarios Andreou proposed openstack/tripleo-ci master: Use repo-setup role and tripleo-quickstart config for C9 images  https://review.opendev.org/c/openstack/tripleo-ci/+/81822209:22
opendevreviewBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Use amqp durable queues for core components' RPC  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82012309:26
*** jbadiapa|off is now known as jbadiapa09:46
opendevreviewSandeep Yadav proposed openstack/tripleo-quickstart master: New featureset: 064 for custom network  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81242809:48
opendevreviewJiri Podivin proposed openstack/validations-libs master: Validation actions refactor  https://review.opendev.org/c/openstack/validations-libs/+/80290109:49
opendevreviewBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Parameters for API policies to show a host status  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81631909:49
opendevreviewSandeep Yadav proposed openstack/tripleo-quickstart master: New featureset: 064 for custom network  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81242809:50
opendevreviewDmitriy Rabotyagov proposed openstack/tripleo-ansible master: Use config_template as a collection  https://review.opendev.org/c/openstack/tripleo-ansible/+/82014010:10
opendevreviewMarios Andreou proposed openstack/tripleo-ci master: Use repo-setup role and tripleo-quickstart config for C9 images  https://review.opendev.org/c/openstack/tripleo-ci/+/81822210:29
opendevreviewMarios Andreou proposed openstack/tripleo-quickstart master: Use centos mirror content instead of compose  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81716110:29
arxcruz|rovermarios: hi, sorry, someone hacked my brazilian bank account, I was handling with some bureaucracy. if you want we can do a call and i'll explain to you what's happening 10:31
mariosarxcruz|rover: can you reply on the review and i will check again? i think it applies to any one who will review that patch 10:32
opendevreviewArx Cruz proposed openstack/tripleo-ci master: Properly set the hash for undercloud upgrade jobs  https://review.opendev.org/c/openstack/tripleo-ci/+/81699110:33
opendevreviewArx Cruz proposed openstack/tripleo-quickstart master: DNM - Testing upgrade job  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81807810:34
opendevreviewMarios Andreou proposed openstack/tripleo-ci master: Use repo-setup role and tripleo-quickstart config for C9 images  https://review.opendev.org/c/openstack/tripleo-ci/+/81822210:41
opendevreviewShnaidman Sagi (Sergey) proposed openstack/tripleo-quickstart master: Add the default collection path to ansible.cfg  https://review.opendev.org/c/openstack/tripleo-quickstart/+/82014310:44
opendevreviewFrancesco Pantano proposed openstack/tripleo-ansible stable/wallaby: Support a custom ceph_crush_hierarchy in the Ceph spec  https://review.opendev.org/c/openstack/tripleo-ansible/+/82009410:55
*** dviroel|out is now known as dviroel11:01
ysandeep|ruckfolks fyi.. some issue ongoing with https://zuul.openstack.org/ please use https://zuul.opendev.org/t/openstack/status for the meantime if you want to check zuul status11:02
ysandeep|ruckinfra has been reported already11:03
ysandeep|ruckykarel++ thanks!11:03
*** rlandy|out is now known as rlandy|ruck11:12
opendevreviewShnaidman Sagi (Sergey) proposed openstack/tripleo-quickstart master: DNM more debug for quickstart  https://review.opendev.org/c/openstack/tripleo-quickstart/+/82014611:30
opendevreviewJames Slagle proposed openstack/tripleo-heat-templates master: Add generated deployed network environment  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81891511:32
*** jcapitao is now known as jcapitao_lunch11:57
*** pojadhav is now known as pojadhav|afk12:01
Tenguhmmm..... folks, can anyone confirm all the trunk.rdoproject mirrors are up-to-date and in-sync?12:02
TenguI suspect delorean.repo is wrong on a host. iirc, someone created a script to check that - maybe you, chandankumar ?12:03
opendevreviewShnaidman Sagi (Sergey) proposed openstack/tripleo-quickstart master: DNM more debug for quickstart  https://review.opendev.org/c/openstack/tripleo-quickstart/+/82014612:12
ysandeep|ruckTengu, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/34441 12:20
Tenguysandeep|ruck: uho, so it's not merged yet?12:21
Tenguah. "waiting on unit tests".12:22
ysandeep|ruckTengu, :) hahaha, looks like i am not the only one who hates unit tests... 12:23
* ysandeep|ruck kidding 12:23
Tengu^^12:24
Tenguanyway. could end up with a "delorean line" providing the patch I need to deploy on cs9 without having to rebuild tripleo-common.12:24
Tengu"current" is nice.12:26
Tengucurrent-tripleo is too old12:26
Tenguysandeep|ruck: btw, is there anything we can do to get a newer "current-tripleo" for centos9-master?12:27
ysandeep|ruckTengu, standalone jobs which are in criteria were failing because of ansible issues, sshnaidm fixed those ansible issue last night.. i think we should get a promotion soon. 12:27
Tenguoh, good!12:27
Tenguthanks sshnaidm :)12:27
* ysandeep|ruck checking status12:27
ysandeep|rucknew failure in tempest run: https://logserver.rdoproject.org/openstack-component-baremetal/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-standalone-baremetal-master/8345eaf/job-output.txt in c9 jobs12:30
ysandeep|ruckAttributeError: 'NoneType' object has no attribute 'version_tuple'", "stdout_lines": ["AttributeError: 'NoneType' object has no attribute 'version_tuple'"]} 12:30
ysandeep|rucki think chandankumar was looking into that ^^12:30
Tenguoh12:31
TenguI hit that one this morning12:31
Tenguit was related to the way a python virtual env is created in ansible.12:32
TenguI had to "just" add a parameter to the "pip" ansible module: virtualenv_command: "{{ ansible_python_interpreter }} -m venv"12:32
Tenguchandankumar: -^^   maybe?12:32
Tenguah. dang. my t-h-t patch isn't in "current".12:33
Tenguhence "out of pty devices" failure on my lab.12:33
Tengu;_;12:33
opendevreviewMerged openstack/tripleo-quickstart-extras master: Fix IPA role issues with CentOS 9  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81792412:33
opendevreviewMerged openstack/tripleo-heat-templates stable/wallaby: Add a global configuration option for secure RBAC  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81890112:33
opendevreviewMerged openstack/tripleo-heat-templates stable/wallaby: Allow Swift to configure secure RBAC options  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81890212:34
Tenguguess it's "tripleo-ci-testing" then.12:34
ysandeep|ruckTengu, which patch is not in current? 12:36
ysandeep|ruckcurrent is more bleeding edge than "tripleo-ci-testing"12:36
Tenguysandeep|ruck: the one about the /dev bind-mount12:36
Tenguysandeep|ruck: really? that's not what the directory dates show here: https://trunk.rdoproject.org/centos9-master/?C=M;O=A12:37
sshnaidmTengu, tripleo-ci-testing is taken from current/consistent12:38
sshnaidmso current is newer12:38
ysandeep|ruckTengu, looks like we are not build anything since 26th : https://trunk.rdoproject.org/centos9-master/component/tripleo/ 12:38
ysandeep|ruckmay be issue with dlrn builder12:38
Tenguysandeep|ruck: erf...12:38
ysandeep|ruckTengu, let me check with infra team 12:38
Tengusshnaidm: funky... the versions.csv is far newer in the tripleo-ci-testing than current directory.12:39
sshnaidmTengu, file creation time doesn't mean versions are newer12:39
Tengusshnaidm: guess so... it's weird.12:39
sshnaidmTengu, we generate it every day I think12:39
chandankumarTengu: proposing a patch  and retrying it12:39
sshnaidmbut with same versions inside12:40
Tenguchandankumar: 'k :)12:40
Tengusshnaidm: "great"...12:40
ysandeep|ruckTengu, checking with #rdo 12:40
Tenguchandankumar: https://github.com/cjeanner/tripleo-lab/blob/fe470eebe665f079aba702454ffdb81e7cea9f93/roles/undercloud/tasks/pkg-build.yaml#L74-L8012:42
Tengumy "hack".12:42
Tenguit's working just fine. not sure if there's such a thing as "pip" call in the CI tempest thing, but...12:42
TenguI'll test it with cs8 shortly.12:42
Tengusshnaidm: ok, so I can confirm: "current" doesn't provide the patch I need in tripleo-common, but that patch is provided in tripleo-ci-testing. go figure....12:52
Tenguunless there's a mirror issue12:53
Tenguwithout that patch, I can't deploy the UC - patch in question: I544d117e03037c8a4744139c36bc63b978c489dd12:53
sshnaidmTengu, hmm.. maybe it's component related12:53
Tenguno idea. it's just what I'm seeing in my env right now :)12:54
*** pojadhav|afk is now known as pojadhav12:54
Tengubut if there's some build issue, of course, it won't help.12:54
opendevreviewShnaidman Sagi (Sergey) proposed openstack/tripleo-quickstart master: DNM more debug for quickstart  https://review.opendev.org/c/openstack/tripleo-quickstart/+/82014612:59
opendevreviewGael Chamoulaud proposed openstack/tripleo-validations stable/ussuri: Get the undercloud.conf file from where it actually is  https://review.opendev.org/c/openstack/tripleo-validations/+/78564513:06
opendevreviewArx Cruz proposed openstack/tripleo-ci master: DNM - Testing zuul variables  https://review.opendev.org/c/openstack/tripleo-ci/+/81964513:08
opendevreviewJuan Badia Payno proposed openstack/tripleo-quickstart master: overcloud-full is uefi but VMs are defined as BIOS  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81876613:10
*** jcapitao_lunch is now known as jcapitao_13:19
*** jcapitao_ is now known as jcapitao13:19
opendevreviewArx Cruz proposed openstack/tripleo-ci master: DNM - Testing zuul variables  https://review.opendev.org/c/openstack/tripleo-ci/+/81964513:22
opendevreviewShnaidman Sagi (Sergey) proposed openstack/tripleo-quickstart master: Install collections in quickstart for all OS  https://review.opendev.org/c/openstack/tripleo-quickstart/+/82017013:28
*** amoralej is now known as amoralej|off13:28
*** rcastillo|out is now known as rcastillo13:32
opendevreviewchandan kumar proposed openstack/tripleo-ci master: Use virtualenv_command as python -m venv  https://review.opendev.org/c/openstack/tripleo-ci/+/82017213:35
opendevreviewMerged openstack/tripleo-quickstart-extras master: Update versions_url for downstream case  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82003313:43
hjensasysandeep|ruck: thanks for bumping requirements for metalsmith! 13:43
ysandeep|ruckhjensas, actually rdo-trunk did that for us :) I just pinged the reviewers 13:44
ysandeep|ruckhjensas, I am testing all baremetal component jobs with new metalsmith here: https://review.rdoproject.org/r/c/testproject/+/32054 13:45
*** pojadhav is now known as pojadhav|afk13:48
opendevreviewHarald Jensås proposed openstack/tripleo-quickstart master: Re-enable protected resource types  https://review.opendev.org/c/openstack/tripleo-quickstart/+/80770413:53
cloudnullmornings13:55
opendevreviewCedric Jeanneret proposed openstack/tripleo-heat-templates master: Remove setype for /var/log/containers creation  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82017414:03
Tengujpich: -^^14:03
jpichI like the backport note so we don't forget it shouldn't be!14:04
Tengujpich: well, if we backport it, we'll crash things :).14:04
Tengunot sure this is wanted at this point, is it? :D14:04
jpichI could use some quiet haha14:05
Tengu;)14:05
*** ysandeep|ruck is now known as ysandeep|afk14:14
*** ysandeep|afk is now known as ysandeep14:20
*** amoralej|off is now known as amoralej14:22
*** ysandeep is now known as ysandeep|afk14:27
opendevreviewLuca Miccini proposed openstack/puppet-tripleo master: Enforce stonith for ComputeInstanceHA nodes  https://review.opendev.org/c/openstack/puppet-tripleo/+/82017714:30
opendevreviewDouglas Viroel proposed openstack/tripleo-quickstart master: [WIP] Add compose_repos repo operation to 'repo-setup'  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81901914:36
opendevreviewDouglas Viroel proposed openstack/tripleo-quickstart master: [WIP] Add compose_repos repo operation to 'repo-setup'  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81901914:42
opendevreviewDamien Ciabrini proposed openstack/tripleo-common master: WIP Do not rotate MysqlClustercheckPassword  https://review.opendev.org/c/openstack/tripleo-common/+/82018115:01
opendevreviewJose Luis Franco proposed openstack/tripleo-heat-templates stable/victoria: DNM: Test standalone-upgrade job.  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81771815:04
*** ysandeep|afk is now known as ysandeep15:12
opendevreviewMerged openstack/tripleo-heat-templates stable/victoria: Sc04: Enable glance sparse image upload  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81957315:18
opendevreviewJiri Podivin proposed openstack/validations-libs master: Validation actions refactor  https://review.opendev.org/c/openstack/validations-libs/+/80290115:20
opendevreviewRonelle Landy proposed openstack/tripleo-heat-templates stable/victoria: DNM: Test standalone-upgrade job.  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81771815:26
opendevreviewJose Luis Franco proposed openstack/tripleo-ci master: Collect logs for the tripleo-upgrade directory when existing.  https://review.opendev.org/c/openstack/tripleo-ci/+/81854215:29
*** ysandeep is now known as ysandeep|out15:34
opendevreviewJiri Podivin proposed openstack/validations-libs master: Validation actions refactor  https://review.opendev.org/c/openstack/validations-libs/+/80290115:38
opendevreviewMarios Andreou proposed openstack/tripleo-ci master: Remove centos 9 task for compose repos setup  https://review.opendev.org/c/openstack/tripleo-ci/+/82018815:43
marioschandankumar: ^^ fyi15:43
chandankumarmarios: thanks!,15:44
opendevreviewAlex Schultz proposed openstack/tripleo-heat-templates master: Role specific container support  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81801815:48
noama_hi15:49
noama_do someone knows how to set machine type to i440 for vms?15:49
mwhahahaNovaHWMachineType ?15:52
noama_ok ty15:53
noama_anywhy to get virsh command in compute nodes?15:58
opendevreviewchandan kumar proposed openstack/python-tripleoclient stable/wallaby: Donot install policycoreutils-python for cs9  https://review.opendev.org/c/openstack/python-tripleoclient/+/82009715:58
opendevreviewMarios Andreou proposed openstack/tripleo-ci master: Remove centos 9 task for compose repos setup  https://review.opendev.org/c/openstack/tripleo-ci/+/82018816:03
opendevreviewBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Use amqp durable queues for core components' RPC  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82012316:07
*** chandankumar is now known as raukadah16:12
*** tosky_ is now known as tosky16:17
*** marios is now known as marios|out16:35
ade_leefultonj, can you look at https://03bdeb201ad5b10b1d29-c8e8f0465e65b3e97bf6a5ab87ec6f98.ssl.cf5.rackcdn.com/808215/60/check/tripleo-ci-centos-8-scenario004-standalone/dbf11a5/logs/undercloud/var/log/tempest/stestr_results.html ?17:07
ade_leefultonj, its the last scenario that appears to be failing in the tripleo fips enabled environment17:08
ade_leefultonj, and cschwede pointed out that the tests that are failing there are ceph and not swift 17:09
*** amoralej is now known as amoralej|off17:32
opendevreviewDouglas Viroel proposed openstack/tripleo-repos master: yum-config compose-repos generation improvements  https://review.opendev.org/c/openstack/tripleo-repos/+/81936417:49
opendevreviewChris Sibbitt proposed openstack/tripleo-heat-templates master: Missing rsyslog parameters for HAProxy  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82021717:58
opendevreviewChris Sibbitt proposed openstack/tripleo-heat-templates master: Missing rsyslog parameters for HAProxy  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82021718:19
opendevreviewMerged openstack/tripleo-quickstart master: Enable setting whole_disk_images=true for wallaby  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81355318:36
opendevreviewMerged openstack/tripleo-quickstart-extras master: Switch default whole_disk_images:true on Wallaby  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81676018:38
opendevreviewMerged openstack/python-tripleoclient master: Pass crush hierarchy data as extra_var  https://review.opendev.org/c/openstack/python-tripleoclient/+/81981518:38
opendevreviewFrancesco Pantano proposed openstack/python-tripleoclient stable/wallaby: Pass crush hierarchy data as extra_var  https://review.opendev.org/c/openstack/python-tripleoclient/+/82010018:42
fultonjade_lee: i left a comment in https://review.opendev.org/c/openstack/tripleo-ci/+/808215 19:02
opendevreviewMerged openstack/tripleo-quickstart master: Use centos mirror content instead of compose  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81716119:12
opendevreviewMerged openstack/os-net-config master: Notify the need for overriding the default driver for Mellanox NIC  https://review.opendev.org/c/openstack/os-net-config/+/81999919:12
ade_leefultonj, so why is this scenario not failing all the time in tripleo?19:12
ade_leefultonj, after all, we didn't do anything special to select an old version of ceph ..19:13
fultonjdo the "all the time jobs" run the same tempest test?19:14
fultonje.g. scenario 004 in https://review.opendev.org/c/openstack/tripleo-heat-templates/+/778915 passed19:15
ade_leefultonj, well - we don't select any specific tests to run scenario 4 -- if its because its the old version, then shouldn't scenario 4 fail everywhere?19:15
fultonjagree19:16
fultonjit's a 50x19:17
opendevreviewBrent Eagles proposed openstack/tripleo-heat-templates master: Run designate-api under apache  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81689519:18
ade_leefultonj, what process is throwing the 50x?19:18
ade_leefultonj, and is there anything in that process log?19:19
fultonji'm just seeing the 50x response when i open the log19:19
* fultonj doesn't know yet if its has proxy or rgw19:19
fultonjha proxy19:19
opendevreviewHarald Jensås proposed openstack/python-tripleoclient master: Fix ports cleanup on node unprovision  https://review.opendev.org/c/openstack/python-tripleoclient/+/82025219:23
fultonjwe have a 502 returned to tempest at 2021-12-01 21:20:26,953 19:26
* fultonj looking at rgw logs to coorelate19:26
fultonjhttps://03bdeb201ad5b10b1d29-c8e8f0465e65b3e97bf6a5ab87ec6f98.ssl.cf5.rackcdn.com/808215/60/check/tripleo-ci-centos-8-scenario004-standalone/dbf11a5/logs/undercloud/var/log/extra/podman/containers/ceph-4b5c8c0a-ff60-454b-a1b4-9747aa737d19-rgw.rgw.standalone.owrezy/index.html19:26
fultonjbeast started at 2021-12-01T21:20:43.508 19:28
fultonjcould this be as simple as RGW not being ready yet for the tempeset test? 19:28
fultonjhow often does that fail ?19:28
ade_leefultonj, every time I think19:29
ade_leefultonj, remember that this is an environment where fips is enabled -- so something could be doing some bad crypto on startup perhaps19:30
ade_lees/bad crypto/disallowed crypto19:31
ade_leelike maybe an md519:31
opendevreviewRonelle Landy proposed openstack/tripleo-ci master: DNM - Testing dowstream override  https://review.opendev.org/c/openstack/tripleo-ci/+/82025319:32
*** artom__ is now known as artom19:36
fultonjade_lee: i left another comment19:37
fultonj(beast is the name of the RGW server)19:38
fultonjthe time stamps imply the service wasn't running yet when it was tested19:38
fultonjit gets running 10 seconds later19:39
fultonjwhen beast runs i don't see any crypto errors in its log19:39
fultonjwhere are the logs of previous failures of secneario004?19:40
ade_leeinteresting -- we can certainly try adding a sleep in the test to see if this fixes things - but it does seem to be happening consistently19:41
* fultonj sees lots of RDO third party failures but only one zuul run19:41
fultonjfrom today19:41
ade_leewhereas it doesn't happen when fips is not enabled as far as I know ..19:41
ade_leeyeah - I haven;t been poking at those -- but if you look at previous zuul runs, scenario 4 has been failing pretty consstently19:42
ade_leewe've only had one run today19:42
ade_leefultonj, is there a parameter we can set to enable debug in beast or other ceph services?19:43
ade_leemaybe we'd see something that would cause beast to take longer to come up?19:44
fultonjbeast logs simply don't start until that time though19:44
fultonj"that time" --> after the test is run19:44
fultonjthere's nothing earlier to look at19:45
* fultonj looking at verbosity settings19:45
fultonjhttps://paste.opendev.org/show/811417/19:51
*** dviroel is now known as dviroel|afk19:53
ade_leefultonj, ok - I can add those as well as a sleep in the test and see if it makes a difference19:55
fultonjbeast container was created after the tempest test ran https://03bdeb201ad5b10b1d29-c8e8f0465e65b3e97bf6a5ab87ec6f98.ssl.cf5.rackcdn.com/808215/60/check/tripleo-ci-centos-8-scenario004-standalone/dbf11a5/logs/undercloud/var/log/extra/podman/containers/ceph-4b5c8c0a-ff60-454b-a1b4-9747aa737d19-rgw.rgw.standalone.owrezy/podman_info.log19:55
fultonjade_lee: ok, let's see if that sleep helps. 19:57
ade_leefultonj, yeah - are there other containers that need to come up first before beast?19:58
ade_leemaybe those have some issue , and so that delays beast ..19:58
fultonjmons, mgrs, 19:58
fultonjhttps://03bdeb201ad5b10b1d29-c8e8f0465e65b3e97bf6a5ab87ec6f98.ssl.cf5.rackcdn.com/808215/60/check/tripleo-ci-centos-8-scenario004-standalone/dbf11a5/logs/undercloud/var/log/extra/podman/containers/index.html19:59
opendevreviewRonelle Landy proposed openstack/tripleo-ci master: DNM - required project and roles for internal  https://review.opendev.org/c/openstack/tripleo-ci/+/82025720:26
opendevreviewOpenStack Release Bot proposed openstack/tripleo-docs stable/wallaby: Update .gitreview for stable/wallaby  https://review.opendev.org/c/openstack/tripleo-docs/+/82026020:49
opendevreviewOpenStack Release Bot proposed openstack/tripleo-docs stable/wallaby: Update TOX_CONSTRAINTS_FILE for stable/wallaby  https://review.opendev.org/c/openstack/tripleo-docs/+/82026120:49
opendevreviewRonelle Landy proposed openstack/tripleo-ci master: DNM - required project and roles for internal  https://review.opendev.org/c/openstack/tripleo-ci/+/82025721:01
opendevreviewRonelle Landy proposed openstack/tripleo-ci master: DNM - required project and roles for internal  https://review.opendev.org/c/openstack/tripleo-ci/+/82025721:11
opendevreviewRonelle Landy proposed openstack/tripleo-ci master: DNM - Test  https://review.opendev.org/c/openstack/tripleo-ci/+/82026621:15
opendevreviewRonelle Landy proposed openstack/tripleo-ci master: DNM - Test  https://review.opendev.org/c/openstack/tripleo-ci/+/82026621:18
opendevreviewRonelle Landy proposed openstack/tripleo-ci master: DNM - Test  https://review.opendev.org/c/openstack/tripleo-ci/+/82026621:21
opendevreviewRonelle Landy proposed openstack/tripleo-ci master: DNM - Test  https://review.opendev.org/c/openstack/tripleo-ci/+/82026621:24
mwhahahacloudnull: plz merge  https://review.opendev.org/q/I3f08fe0efef1e830b034fab06574a05dff89ccc0+status:open21:45
cloudnullDone. 21:55
rlandy|ruckjust FYI - we have a gate blocker: https://bugs.launchpad.net/tripleo/+bug/195308222:26
opendevreviewAde Lee proposed openstack/tripleo-ci master: WIP/DNM - Add fips jobs  https://review.opendev.org/c/openstack/tripleo-ci/+/80821522:43
opendevreviewRonelle Landy proposed openstack/tripleo-quickstart master: Use ansible.posix.authorized_key for ansible > 2.9  https://review.opendev.org/c/openstack/tripleo-quickstart/+/82027222:44
opendevreviewRonelle Landy proposed openstack/tripleo-common stable/train: DNM - Test bug 1953082  https://review.opendev.org/c/openstack/tripleo-common/+/82027322:48
opendevreviewAde Lee proposed openstack/tripleo-heat-templates master: WIP/DNM Added rabbit params for testing  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81969722:49
opendevreviewAde Lee proposed openstack/tripleo-ci master: WIP/DNM - Add fips jobs  https://review.opendev.org/c/openstack/tripleo-ci/+/80821522:52
opendevreviewRonelle Landy proposed openstack/tripleo-common stable/train: DNM - Test bug 1953082  https://review.opendev.org/c/openstack/tripleo-common/+/82027322:57
rlandy|ruckianw: hello - could we get you review (w+ if agree) on https://review.opendev.org/c/opendev/base-jobs/+/820018?23:23
rlandy|ruckthanks23:23
ianwi can monitor this, i agree it looks safe to avoid the base-test swizzle23:28

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!