Monday, 2021-12-06

opendevreviewSteve Baker proposed openstack/tripleo-heat-templates stable/wallaby: Add parameter IronicDefaultBootMode  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82045700:17
opendevreviewSteve Baker proposed openstack/tripleo-heat-templates stable/wallaby: Set default value of IronicDefaultBootMode to uefi  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82045800:17
opendevreviewSteve Baker proposed openstack/tripleo-quickstart master: Use UEFI boot on wallaby libvirt  https://review.opendev.org/c/openstack/tripleo-quickstart/+/82045900:28
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Manila: Use internal endpoints to access other services  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82046000:31
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Nova: Use internal endpoint to access Neutron API  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82046100:35
opendevreviewTakashi Kajinami proposed openstack/tripleo-quickstart-extras master: Replace deprecated ipxe_deploy in undercloud.conf  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/72486001:41
opendevreviewBrendan Shephard proposed openstack/python-tripleoclient master: WIP - Move baremetal CLI commands  https://review.opendev.org/c/openstack/python-tripleoclient/+/82046301:42
opendevreviewBrendan Shephard proposed openstack/python-tripleoclient master: WIP - Move baremetal CLI commands  https://review.opendev.org/c/openstack/python-tripleoclient/+/82046301:44
opendevreviewBrendan Shephard proposed openstack/python-tripleoclient master: WIP - Move baremetal CLI commands  https://review.opendev.org/c/openstack/python-tripleoclient/+/82046301:45
opendevreviewBrendan Shephard proposed openstack/python-tripleoclient master: WIP - Move baremetal CLI commands  https://review.opendev.org/c/openstack/python-tripleoclient/+/82046303:24
opendevreviewTakashi Kajinami proposed openstack/tripleo-common master: Remove unused tripleo_common.utils.time_functions  https://review.opendev.org/c/openstack/tripleo-common/+/82047203:58
opendevreviewTakashi Kajinami proposed openstack/tripleo-common master: Remove unused tripleo_common.utils.time_functions  https://review.opendev.org/c/openstack/tripleo-common/+/82047203:59
opendevreviewTakashi Kajinami proposed openstack/tripleo-common master: Remove unused tripleo_common.utils.time_functions  https://review.opendev.org/c/openstack/tripleo-common/+/82047204:03
*** pojadhav is now known as pojadhav|ruck04:31
*** ysandeep|out is now known as ysandeep04:43
opendevreviewSandeep Yadav proposed openstack/tripleo-quickstart master: New featureset: 064 for custom network  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81242804:57
opendevreviewTakashi Kajinami proposed openstack/tripleo-common master: Remove unused tripleo_common.utils.keystone  https://review.opendev.org/c/openstack/tripleo-common/+/82047405:02
opendevreviewTakashi Kajinami proposed openstack/tripleo-common master: Remove unused tripleo_common.utils.time_functions  https://review.opendev.org/c/openstack/tripleo-common/+/82047205:03
opendevreviewTakashi Kajinami proposed openstack/tripleo-common master: Remove unused tripleo_common.utils.keystone  https://review.opendev.org/c/openstack/tripleo-common/+/82047405:04
*** marios is now known as marios|ruck06:37
*** pojadhav|ruck is now known as pojadhav|rover06:39
Tenguhello there! may I get the needed votes on this backport? https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82011106:59
Tenguthank you :)06:59
opendevreviewSandeep Yadav proposed openstack/tripleo-quickstart-extras master: Update condition to include cloud-names.yaml  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/81851807:37
Tenguhjensas: heya! testing your /etc/hosts patch on my lab, with all the custom things we've set for the domains. if all green, I'll be able to +2 :)07:45
*** ysandeep is now known as ysandeep|lunch08:52
opendevreviewMarios Andreou proposed openstack/tripleo-quickstart master: Revert "Set module_hotfixes to true for centos9 appstream repos"  https://review.opendev.org/c/openstack/tripleo-quickstart/+/82049409:09
*** ysandeep|lunch is now known as ysandeep09:11
opendevreviewMarios Andreou proposed openstack/tripleo-quickstart master: Revert "Set module_hotfixes to true for centos9 appstream repos"  https://review.opendev.org/c/openstack/tripleo-quickstart/+/82049409:12
*** pojadhav is now known as pojadhav|rover09:18
opendevreviewMarios Andreou proposed openstack/tripleo-quickstart master: Revert "Set module_hotfixes to true for centos9 appstream repos"  https://review.opendev.org/c/openstack/tripleo-quickstart/+/82049409:29
opendevreviewOliver Walsh proposed openstack/tripleo-ci master: Restore tempest container  https://review.opendev.org/c/openstack/tripleo-ci/+/82051110:26
opendevreviewOliver Walsh proposed openstack/tripleo-common master: Add tempest to sudoers for tempest container image  https://review.opendev.org/c/openstack/tripleo-common/+/82040810:28
opendevreviewamolkahat proposed openstack/tripleo-quickstart-extras master: Added list type support for var workers_args  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/80874810:43
opendevreviewamolkahat proposed openstack/tripleo-ci master: Convert worker args from string to list.  https://review.opendev.org/c/openstack/tripleo-ci/+/80857710:46
*** bogdando_ is now known as bogdando10:58
*** dviroel|afk is now known as dviroel11:06
opendevreviewMerged openstack/tripleo-heat-templates stable/wallaby: Introduce a new linter for yaml-validate, and correct issues  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82011111:11
*** rlandy is now known as rlandy|ruck11:14
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Nova: Use internal endpoint to access Neutron API  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82046111:14
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Manila: Use internal endpoints to access other services  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82046011:15
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Replace deprecated manila::sql_connection  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82051411:32
opendevreviewSandeep Yadav proposed openstack/tripleo-heat-templates master: Add templates for custom network ci job  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81236911:42
shyambHi11:48
shyambykarel: Tengu: Hi11:48
shyambI want to run puppet code on horizon container11:49
shyambIs it possible to do that? Any example?11:50
ysandeephjensas, when you get chance could you please review this new featureset 64 patches to test custom network deployment + custom overcloud name - https://review.opendev.org/q/topic:%22featureset064%22+(status:open%20OR%20status:merged) 11:50
opendevreviewLukas Bezdicka proposed openstack/tripleo-heat-templates stable/train: [train-only][ffwd] Resolve OVNDB data loss during upgrade  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82002312:02
opendevreviewLukas Bezdicka proposed openstack/tripleo-heat-templates stable/train: [train-only][ffwd] All in one upgrade option  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81794412:02
*** ysandeep is now known as ysandeep|afk12:02
opendevreviewJiri Podivin proposed openstack/validations-libs master: DNM: Coverchange fixes  https://review.opendev.org/c/openstack/validations-libs/+/82051712:04
*** jcapitao is now known as jcapitao_lunch12:08
*** pojadhav|rover is now known as pojadhav|brb12:08
*** pojadhav|brb is now known as pojadhav|rover12:28
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Swift: Stop *-server process gracefully  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81079412:35
opendevreviewTakashi Kajinami proposed openstack/tripleo-heat-templates master: Swift: Use proper signal to reload services  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80121712:35
*** ysandeep|afk is now known as ysandeep12:44
opendevreviewPooja Jadhav proposed openstack/tripleo-ci master: Remove standalone-upgrade job out of check/gate  https://review.opendev.org/c/openstack/tripleo-ci/+/82052012:47
opendevreviewPooja Jadhav proposed openstack/tripleo-ci master: Remove standalone-upgrade job out of check/gate  https://review.opendev.org/c/openstack/tripleo-ci/+/82052013:05
opendevreviewMarios Andreou proposed openstack/tripleo-ci master: Use virtualenv_command as ensure_pip_virtualenv_command  https://review.opendev.org/c/openstack/tripleo-ci/+/82017213:17
*** marios|ruck is now known as marios|call13:37
*** marios|call is now known as marios|ruck|call13:38
*** rcastillo|out is now known as rcastillo13:43
opendevreviewJiri Podivin proposed openstack/validations-libs master: DNM: Coverchange fixes  https://review.opendev.org/c/openstack/validations-libs/+/82051713:48
ysandeephjensas: ++ thank you for reviews!14:09
fultonjade_lee: i left a comment on https://review.opendev.org/c/openstack/tripleo-ci/+/808215/ 14:34
*** marios|ruck|call is now known as marios|ruck14:34
ade_leefultonj, the wait was added here -- https://review.opendev.org/c/openstack/tempest/+/820270/1/tempest/scenario/test_object_storage_basic_ops.py14:38
*** ysandeep is now known as ysandeep|afk14:40
ade_leefultonj, we can certainly try adding a waiter to see what happens, but is there anything that would indicate why beast is taking so long to come up?14:41
rlandy|ruckhjensas: closing out https://bugs.launchpad.net/tripleo/+bug/1951752 - we have seen an issue creating the router for tempest after the overcloud deploy14:41
rlandy|ruckwill log another bug for that14:41
*** ykarel is now known as ykarel|away14:42
fultonji saw lifecycle: RGWLC::process() failed to acquire lock on lc.21, sleep 5, try again14:46
fultonjade_lee: where is the waiter code?14:46
fultonjfmount: gfidente: fyi ^ 14:47
opendevreviewJiri Podivin proposed openstack/validations-libs master: DNM: Coverchange fixes  https://review.opendev.org/c/openstack/validations-libs/+/82051714:47
ade_leefultonj, I just added a sleep here -- https://review.opendev.org/c/openstack/tempest/+/820270/1/tempest/scenario/test_object_storage_basic_ops.py14:47
ade_leeI'd need to add something to ping swift and wait for it to be up ..14:48
fultonjyes, exactly14:49
fultonjloks like you have an obj_url var14:49
opendevreviewGregory Thiemonge proposed openstack/tripleo-heat-templates master: WIP Octavia Jobboard integration  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82053014:50
*** dviroel is now known as dviroel|lunch14:53
ade_leefultonj, well that var seems to come from obj_name, obj_data = self.upload_object_to_container(container_name)14:53
ade_leefultonj, do we know which operation is failing?  that one or beyond?14:54
ade_leefultonj, I suppose I could just wait on self.object_client.base_url ?14:55
opendevreviewTakashi Kajinami proposed openstack/tripleo-common master: Remove additional patching to use gitpython with eventlet  https://review.opendev.org/c/openstack/tripleo-common/+/82053314:55
opendevreviewSandeep Yadav proposed openstack/tripleo-ansible master: Custom networks ci nic template  https://review.opendev.org/c/openstack/tripleo-ansible/+/81852914:57
opendevreviewDavid Hill proposed openstack/tripleo-heat-templates master: Add OVNContainerCpusetCpus  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82053514:58
* fultonj reading tempest code for this test15:00
fmountmmmm ade_lee fultonj o/ that's weird 15:03
fmountI would also check https://5f48111572afd39f0f3d-de9c9aa92c96f031613f73d2359ce388.ssl.cf2.rackcdn.com/808215/62/check/tripleo-ci-centos-8-scenario004-standalone/bae314e/logs/undercloud/var/log/containers/haproxy/haproxy.log15:04
fmounttempest request -> haproxy frontend logs -> rgw logs 15:04
fmountthe weird thing is that rgw is running, it's bound, there are a bunch of requests through haproxy, but I don't see any log in the rgw backend :/15:05
fmountade_lee: any chance to have a reproducer?15:05
ade_leefmount, fultonj yeah - we can run this on rdocloud and ask dviroel|lunch or rlandy|ruck to hold the node15:07
fmountyeah fultonj  ^^15:07
ade_leeits been consistently reproducible ..15:08
rlandy|ruckade_lee: if you're running an upstream job on rdocloud, we don't have access to add keys there - #rhos-ops will help you out there15:10
rlandy|ruckour keys are on jobs that run in rdocloud regularly15:10
rlandy|ruckwe can hold your nodes15:10
fmountade_lee: yeah, not sure why it's happening but I was looking at the timestamps w/ fultonj and we saw that there's a mismatch between haproxy and the rgw backend15:12
fmountit's possible that rgw crashed and when it started again overwrote the logs we're looking at 15:12
fultonjade_lee: so my theory is changing15:12
fultonjade_lee: where did you patch tht to turn on debuglogs?15:13
fultonjfor rgw?15:13
fultonjfmount: i'm thinking of having it log elsewhere so we have more  than the std out logs15:13
ade_leefultonj, https://review.opendev.org/c/openstack/tripleo-heat-templates/+/819697/2/environments/fips.yaml15:14
*** ysandeep|afk is now known as ysandeep15:17
fultonjade_lee: ok, thanks15:17
fultonjade_lee: i might patch over that if you don't mind15:17
ade_leefultonj, go for it15:17
fultonjrlandy|ruck: do you know why scenario004 didn't run in https://review.opendev.org/c/openstack/tripleo-heat-templates/+/819697 ?15:21
* rlandy|ruck looks15:21
fultonjis CI smart enough to stop it self if it sees something else fail (e.g. tripleo-ci-centos-8-content-provider-wallaby )15:22
fultonj?15:22
rlandy|ruckfultonj: if the content provider failed and scenario004 was meant to run - you would see if skipped15:23
rlandy|ruckif it does not run, it's not in the triggers for the templates15:23
rlandy|ruckgetting15:23
fultonj"it's not in the triggers for the templates" 15:24
rlandy|ruckfultonj: https://github.com/openstack/tripleo-heat-templates/blob/master/zuul.d/layout.yaml - those are the  templates in use for THT15:24
rlandy|rucktracing those back ...15:25
fultonjso i'll patch a tht template with something small to trigger 004 to get it running?15:25
rlandy|ruckyeah - getting where to do that15:25
rlandy|ruckfultonj: https://github.com/openstack/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L20815:25
rlandy|ruck^ if you want a permanent trigger15:25
rlandy|ruckfultonj: if you want a once off test, put in a DNM patch and add the test to trigger in https://github.com/openstack/tripleo-heat-templates/blob/master/zuul.d/layout.yaml15:26
rlandy|ruckfultonj: note that template changes will not be seen until merge15:26
rlandy|ruckfultonj: so if you just want a temp check add the trigger to https://github.com/openstack/tripleo-heat-templates/blob/master/zuul.d/layout.yaml15:27
fultonjhttps://github.com/openstack/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L20815:28
fultonjis see !15:28
fultonji* see !15:28
fultonjthanks rlandy|ruck 15:28
opendevreviewMerged openstack/os-net-config stable/train: Add ifcfg-* scripts on boot for Mellanox NIC interface  https://review.opendev.org/c/openstack/os-net-config/+/81975715:29
opendevreviewMerged openstack/tripleo-ansible master: tripleo_hosts_entries - use hosts_entry global_vars  https://review.opendev.org/c/openstack/tripleo-ansible/+/82028715:29
opendevreviewSandeep Yadav proposed openstack/tripleo-ansible master: CI nic config: Remove default route from external  https://review.opendev.org/c/openstack/tripleo-ansible/+/82053815:34
opendevreviewChris Sibbitt proposed openstack/tripleo-heat-templates master: Missing rsyslog parameters for HAProxy  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82021715:40
opendevreviewMerged openstack/tripleo-common master: Add collectd plugins and related packages  https://review.opendev.org/c/openstack/tripleo-common/+/82004115:50
*** dviroel|lunch is now known as dviroel15:55
fultonjade_lee: i'm going to write a patch to get more logs and rebase https://review.opendev.org/c/openstack/tripleo-heat-templates/+/819697 on it16:07
fultonji'm going to balance this project with my other projects16:07
fultonji hope to have the patch up today16:07
ade_leefultonj, ok thanks -- if it makes sense, we could run on rdocloud to keep the environment16:08
ade_leebut maybe the logs you add will be enough16:09
fultonjade_lee: let's try to solve this without doing that16:09
ade_leefultonj, ok - whats the current theory? that the process is crashing and restarting?16:09
fultonjyes16:09
fultonjwe need the logs from when it crashes16:10
fultonjnot just the restart16:10
ade_leefultonj, there was a crash log there -- is that relevant16:10
ade_lee?16:10
ade_leefultonj, https://zuul.opendev.org/t/openstack/build/dbf11a5a5c3340c4b9ca58504f12926a/log/logs/undercloud/var/log/extra/podman/containers/ceph-4b5c8c0a-ff60-454b-a1b4-9747aa737d19-crash.standalone/stdout.log16:11
fultonjyes i saw that16:11
fultonjit's not helpful16:11
ade_leeI has crash in the name :/16:11
opendevreviewHarald JensÃ¥s proposed openstack/tripleo-heat-templates master: Make tools scripts executable  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/82054816:12
ade_leefultonj, is that something that happens all the time -- or just in this environment?16:12
fultonjit doesn't have enough information16:13
fultonjit's like looking at half of the picture16:13
* fultonj has a call now16:13
fultonjis on call16:13
fultonji've seen the cephx permissions thing happen without fips too16:14
ade_leeack ok - well, whenever you've posted a patch, feel free to rekick the tripleo-ci job to get logs16:14
ade_leethanks!16:15
opendevreviewJiri Podivin proposed openstack/validations-libs master: Moving callbacks to validations-libs  https://review.opendev.org/c/openstack/validations-libs/+/82055116:20
*** ysandeep is now known as ysandeep|out16:20
opendevreviewJiri Podivin proposed openstack/validations-common master: removing callbacks from validations-common  https://review.opendev.org/c/openstack/validations-common/+/82056216:33
opendevreviewRiccardo Pittau proposed openstack/diskimage-builder master: Install python versions specific pip and virtualenv modules  https://review.opendev.org/c/openstack/diskimage-builder/+/82056316:41
*** pojadhav|rover is now known as pojadhav|out16:48
*** marios|ruck is now known as marios|out16:54
rlandy|ruckhjensas: jbadiapa: ysandeep|out: we should have a party: https://jenkins-cloudsig-ci.apps.ocp.ci.centos.org/job/tripleo-quickstart-promote-master-current-tripleo-delorean-minimal/16:56
rlandy|ruckfirst green run with uefi boot on virt master in over a month16:56
rlandy|ruckhttps://jenkins-cloudsig-ci.apps.ocp.ci.centos.org/view/phase-1-pipelines/job/rdo_trunk-promote-wallaby-centos8-current-tripleo/16:56
rlandy|ruckwallaby is green as well16:57
rlandy|ruckmarios|out: pojadhav|out: ^^ fyi16:57
hjensasrlandy|ruck: \o/17:05
*** sshnaidm is now known as sshnaidm|afk17:25
*** rlandy|ruck is now known as rlandy|ruck|brb17:26
*** rlandy|ruck|brb is now known as rlandy|ruck18:13
opendevreviewDouglas Viroel proposed openstack/tripleo-quickstart master: [WIP] Add compose_repos repo operation to 'repo-setup'  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81901918:38
opendevreviewDouglas Viroel proposed openstack/tripleo-ci master: [WIP] Set quickstart location when calling repo-setup  https://review.opendev.org/c/openstack/tripleo-ci/+/82058418:48
opendevreviewDouglas Viroel proposed openstack/tripleo-ci master: [WIP] Set quickstart location when calling repo-setup  https://review.opendev.org/c/openstack/tripleo-ci/+/82058419:09
opendevreviewJohn Fulton proposed openstack/tripleo-heat-templates master: WIP/DNM Added rabbit params for testing  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81969719:29
opendevreviewJohn Fulton proposed openstack/tripleo-heat-templates master: WIP/DNM Added rabbit params for testing  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/81969719:40
opendevreviewMerged openstack/diskimage-builder master: Document EFI elements requirements  https://review.opendev.org/c/openstack/diskimage-builder/+/81940619:58
opendevreviewDouglas Viroel proposed openstack/tripleo-ci master: [WIP] Loads dependency vars before start repo-setup tasks  https://review.opendev.org/c/openstack/tripleo-ci/+/82058420:01
opendevreviewDouglas Viroel proposed openstack/tripleo-quickstart master: [WIP] Add compose_repos repo operation to 'repo-setup'  https://review.opendev.org/c/openstack/tripleo-quickstart/+/81901920:17
opendevreviewMerged openstack/diskimage-builder master: Disable all repositories after attaching a pool  https://review.opendev.org/c/openstack/diskimage-builder/+/72787920:20
*** dviroel is now known as dviroel|out20:31
opendevreviewMerged openstack/tripleo-heat-templates master: Add a configuration option to enable secure RBAC in Heat  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/80427921:23
opendevreviewMerged openstack/tripleo-ansible master: Disable image-serve MultiViews  https://review.opendev.org/c/openstack/tripleo-ansible/+/82040421:28
opendevreviewMerged openstack/tripleo-common master: Stop creating manifest .htaccess  https://review.opendev.org/c/openstack/tripleo-common/+/82040521:32
opendevreviewAlex Schultz proposed openstack/tripleo-ansible stable/wallaby: Disable image-serve MultiViews  https://review.opendev.org/c/openstack/tripleo-ansible/+/82050721:32
opendevreviewAlex Schultz proposed openstack/tripleo-common stable/wallaby: Stop creating manifest .htaccess  https://review.opendev.org/c/openstack/tripleo-common/+/82050821:32
opendevreviewAlex Schultz proposed openstack/tripleo-ansible stable/victoria: Disable image-serve MultiViews  https://review.opendev.org/c/openstack/tripleo-ansible/+/82050921:33
opendevreviewAlex Schultz proposed openstack/tripleo-ansible stable/ussuri: Disable image-serve MultiViews  https://review.opendev.org/c/openstack/tripleo-ansible/+/82061021:33
opendevreviewAlex Schultz proposed openstack/tripleo-ansible stable/train: Disable image-serve MultiViews  https://review.opendev.org/c/openstack/tripleo-ansible/+/82059421:34
*** rlandy|ruck is now known as rlandy|out23:37

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!