Thursday, 2022-03-24

*** ysandeep|out is now known as ysandeep06:45
* pojadhav facing power cutoff, due to this connected via mobile hotspot with low internet speed.07:36
*** pojadhav- is now known as pojadhav|rover08:28
*** jpena|off is now known as jpena08:38
*** ysandeep is now known as ysandeep|afk08:45
*** ysandeep|afk is now known as ysandeep09:04
*** pojadhav- is now known as pojadhav|rover09:16
mariosback in a bit09:40
chandankumarrlandy|out: hello, I have taken a look at content provider, gating repo works fine there https://review.opendev.org/c/openstack/tripleo-heat-templates/+/834275/4#message-2733e8a83616543c2077255b9d1a07981b959e48 10:04
chandankumarwe already mount gating repo content during container build https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/container-build/tasks/main.yaml#L78 in content provider job10:06
*** rlandy|out is now known as rlandy10:21
rlandychandankumar: thank you10:22
rlandypojadhav|rover: arxcruz|ruck: hello ... 10:22
arxcruz|ruckrlandy hi 10:22
pojadhav|roverrlandy, hello10:22
rlandyhow are things today10:22
rlandyyesterday a bit wonly due to vexx migration10:22
arxcruz|ruckrlandy i still saw some vexx mirror issues on train job today 10:23
arxcruz|rucki'm rechecking and some jobs already passes 10:23
pojadhav|roverarxcruz|ruck, then please ping dpawlik as asking some time ago about mirror issues..10:24
rlandyarxcruz|ruck: pojadhav|rover: let's sync ...10:24
rlandymarios is out?10:24
pojadhav|roverrlandy, not too bad.. making makes notes in RR hackmd10:24
pojadhav|roverrlandy, nope10:25
arxcruz|ruckrlandy he said he will be back in a few 10:25
rlandyah10:25
*** chem is now known as Guest21610:26
pojadhav|roverrlandy, arxcruz|ruck : https://meet.google.com/tzt-zvkk-eys10:26
rlandywill be there in 510:27
rlandyjust filling out workday stuff10:27
rlandyah - holiday in cypress10:34
rlandypojadhav|rover: arxcruz|ruck: sorry - joining10:35
pojadhav|roverrlandy, ack10:35
chandankumarysandeep: marios undercloud job parents from singlenode and singlenode is used in container build and image build10:57
chandankumarin RDO /Downstream side, will I rename the base to undercloud instead of singlenode?10:57
marioschandankumar: which review? or not posted yet? 10:57
chandankumarI have not posted yet10:58
chandankumarlet me post the reviews10:58
marioschandankumar: yea easier to see and comment10:58
akahatmarios, o/ i know you are working on scenario jobs.. I have few thoughts about re-parenting scenario jobs : https://review.opendev.org/c/openstack/tripleo-ci/+/83184210:59
mariosakahat: i am doing the reparenting in my review 10:59
mariosakahat: checking10:59
akahatysandeep, can also use those in downstream 10:59
akahatmarios, yes. please let me know that i can go forward with this or not.11:00
mariosakahat: please hold i think at this point11:00
chandankumarmarios: rlandy as per this https://review.rdoproject.org/zuul/status#40527 c8 and c9 container build is working fine11:00
chandankumaronly c7 is broken11:00
akahatmarios, okay. 11:00
chandankumarI think we can merge the upstream patch11:00
mariosakahat: i want to get https://review.opendev.org/c/openstack/tripleo-ci/+/831543 hopefully next week and also the patch ontop of it for renaming there https://review.opendev.org/c/openstack/tripleo-ci/+/834861/4 11:01
mariosakahat: and then you can take zuul.d/standalone.yaml control ;)11:01
mariosakahat: please thanks11:01
akahatmarios, okay.. I'll hold until your reviews get merged. 11:03
mariosakahat: thanks for ping about it i commented just now 11:03
akahatthanks11:03
*** ysandeep is now known as ysandeep|afk11:10
* pojadhav|rover tea break... brb11:11
*** ysandeep|afk is now known as ysandeep11:14
rlandymarios: holiday for you today?11:32
mariosrlandy: no, tomorrow, but wanted to chat about that when you have a minute11:33
rlandymarios: around now11:34
rlandymarios: https://meet.google.com/oom-xspp-xou?pli=1&authuser=011:37
mariosrlandy: joining sec thanks11:38
*** ysandeep is now known as ysandeep|afk12:58
dasmo/13:01
bhagyashrisrlandy, ysandeep|afk scrum time13:01
akahathttps://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset00113:03
dasmhttps://review.rdoproject.org/r/c/testproject/+/4033213:07
dviroelhttps://review.opendev.org/c/openstack/tripleo-ci/+/83467813:10
dviroelhttps://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/83455613:10
dviroelfolks, add to your review list https://review.opendev.org/c/openstack/tripleo-docs/+/83495713:10
rlandychandankumar: you may want to abondon restore this job to get it to run https://review.rdoproject.org/r/c/testproject/+/4052713:11
chandankumarrlandy:  done!13:11
* dviroel review bot didn't work for me, what I missed?13:13
dasmdviroel: i don't see review bot on the channel. Maybe that's the issue?13:14
dviroeldasm: yes, your are right13:18
rlandyysandeep|afk: pls ping when you are in13:22
bhagyashrishttps://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/31935213:36
*** ysandeep|afk is now known as ysandeep13:40
ysandeeperrr... I thought scrum is after 1 hour13:40
ysandeeprlandy: back13:41
ysandeepbhagyashris: sorry I got confused with scrum call time today13:42
pojadhav|roverysandeep, RR handoff going on :) 13:43
ysandeeppojadhav|rover: ack13:44
rlandymarios; soniya29: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/4038713:56
chandankumarmarios: rlandy: dviroel: please merge https://review.rdoproject.org/r/c/rdo-jobs/+/40899 and https://review.rdoproject.org/r/c/config/+/40902 14:08
chandankumarin order to start testing undercloud reparenting14:09
chandankumarrlandy: we can also +w this https://review.opendev.org/c/openstack/tripleo-ci/+/831631, will deal c7 train later as a seperate task14:11
marioschandankumar: sure will check in few14:11
*** pojadhav|rover is now known as pojadhav|afk14:12
rlandychandankumar: done14:12
rlandyfor later14:12
arxcruz|ruckbrb, get my daugther at school 14:15
dviroelchandankumar: reviewed14:28
jm1team, hello :) one of our jobs in openstack ansible collection which is based on tripleo-ci-base-standalone-centos-8 fails. since i did not change our collection code, it must be something else. any idea what the reason could be? https://zuul.opendev.org/t/openstack/build/63b8b8fbe2a04a249d96e3d294a79f73/logs14:28
jm1job def is here https://opendev.org/openstack/ansible-collections-openstack/src/commit/f89e9f031e45e9affa113fbc66f6b112e5349793/.zuul.yaml#L36314:30
ysandeepjm1: Are these tempest tests failing consistently? https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_63b/835041/1/check/tripleo-ci-centos-8-standalone-wallaby-osa/63b8b8f/logs/undercloud/var/log/tempest/failing_tests.log14:31
ysandeepbuild history looks good: https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-8-standalone-wallaby-osa&project=openstack/ansible-collections-openstack 14:31
ysandeepjm1: I would give a recheck if only seen once - may be random14:32
jm1ysandeep: will do. are the override-checkout and branch_override lines okay? is this how its supposed to work?14:33
ysandeepseeing this in logs:-14:33
ysandeep~~~14:33
ysandeep2022-03-24 13:36:00.352 ERROR /var/log/extra/podman/containers/nova_conductor/log/nova/nova-compute.log: 8 ERROR nova.compute.manager [instance: 5a9f0de7-1387-4081-9ceb-bb2c71663ca4]     raise exception.VirtualInterfaceCreateException()14:33
ysandeep2022-03-24 13:36:00.352 ERROR /var/log/extra/podman/containers/nova_conductor/log/nova/nova-compute.log: 8 ERROR nova.compute.manager [instance: 5a9f0de7-1387-4081-9ceb-bb2c71663ca4] nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed14:33
ysandeep2022-03-24 13:36:00.352 ERROR /var/log/extra/podman/containers/nova_conductor/log/nova/nova-compute.log: 8 ERROR nova.compute.manager [instance: 5a9f0de7-1387-4081-9ceb-bb2c71663ca414:33
ysandeep~~~14:33
ysandeepI think we had a random tempest failure bug somewhere, dviroel pointed me to that couple of days back - checking14:34
ysandeepi think this was the bug: https://bugs.launchpad.net/tripleo/+bug/1964940 14:36
ysandeepjm1, branch override seems okay to me:-14:38
ysandeephttps://logserver.rdoproject.org/17/40517/1/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-wallaby/94e16ac/zuul-info/inventory.yaml14:38
ysandeepbranch_override: stable/wallaby14:38
jm1ysandeep: is checkout: stable/wallaby supposed to work if only two repos actually use this branch and the rest is using master etc.? https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_63b/835041/1/check/tripleo-ci-centos-8-standalone-wallaby-osa/63b8b8f/zuul-info/inventory.yaml14:41
jm1ysandeep: or does this actually do nothing?14:42
chandankumardviroel: nice catch fixed14:45
chandankumardviroel: marios https://review.rdoproject.org/r/c/config/+/40902 please revote14:46
dviroelchandankumar++14:46
marioschandankumar: since you updated please fix anchor too? 14:49
marioschandankumar: i will revote 14:49
marios:)14:49
chandankumarsure14:49
chandankumarmarios: done14:51
ysandeepjm1: afaik.. In branched jobs we need to specify override checkout so it checksout different branch than zuul.branch(which is mostly master)14:51
ysandeephttps://zuul-ci.org/docs/zuul/latest/config/job.html#attr-job.override-checkout - zuul def is a bit difficult to understand14:52
mariosthanks chandankumar 14:53
jm1ysandeep: but does one really set override-checkout to stable/wallaby if one wants to test the ansible openstack collection against a wallaby tripleo setup? Or is "override-checkout: master" + "branch_override: stable/wallaby" enough for that?14:59
ysandeepjm1: ahh, I think you need "override-checkout: stable/wallaby" otherwise you will not get correct branch from zuul(zuul select a different branch which you mentions in "override-checkout:" for all the repos if available), Alternative is you can use job.required_projects.override-checkout if you just want to be selective - for ex. you can  just checkout tripleo related branches.15:11
ysandeepmarios, chandankumar rlandy ^^ can confirm 15:11
ysandeepIsn't the branch_override var we consume in tripleo ci code, I recall if its not related to what repo branch zuul provides.. Need to refresh my memory..15:13
mariosysandeep: yeah one is for us one is from zuul 15:14
mariosysandeep: https://zuul-ci.org/docs/zuul/latest/config/job.html#attr-job.required-projects.override-checkout vs https://codesearch.opendev.org/?q=branch_override&i=nope&literal=nope&files=&excludeFiles=&repos= 15:15
mariosjm1: ^^15:15
jm1ysandeep, marios: atm stable/wallaby is checked out for openstack/tripleo-ansible and openstack/tripleo-upgrade. but other tripleo repos are using master. openstack/tripleo-ci has no stable/* branches so master has to be used here. but maybe i have to switch the other tripleo repos from master to stable/wallaby?15:16
jm1i am refering to this https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_63b/835041/1/check/tripleo-ci-centos-8-standalone-wallaby-osa/63b8b8f/zuul-info/inventory.yaml15:16
mariosjm1: for a wallaby job yes. it is the branch that zuul will checkout when cloning that repo for use in the job15:17
ysandeepmarios, yeah so branch_override is a var for us which we utilize in our ci code for quickstart and override-checkout is for zuul to select right repo when cloning in job.15:17
mariosysandeep: ack 15:18
ysandeepmarios, thanks for confirming15:18
ysandeepjm1, >> maybe i have to switch the other tripleo repos from master to stable/wallaby? --> In that case you can use https://zuul-ci.org/docs/zuul/latest/config/job.html#attr-job.required-projects.override-checkout for that repo.15:19
jm1ysandeep: ack, i will have to override it on required projects because job.override-checkout does not override job.required-projects.override-checkout from parent jobs. 15:21
jm1ysandeep: can i somehow see in the logs which version of tripleo actually got provisioned?15:21
ysandeepjm1, for tripleo we use rpm so we don't have to worry about tripleo core repos much15:22
ysandeepjm1: check yum repos/ container-prepare file 15:22
ysandeepjm1: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_63b/835041/1/check/tripleo-ci-centos-8-standalone-wallaby-osa/63b8b8f/logs/undercloud/home/zuul/containers-prepare-parameters.yaml15:22
ysandeepjm1: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_63b/835041/1/check/tripleo-ci-centos-8-standalone-wallaby-osa/63b8b8f/logs/undercloud/etc/yum.repos.d/delorean.repo 15:23
jm1ysandeep: oh cool, thanks! so looks like wallaby is taken?15:23
ysandeepyes, looks good to me... another way to confirm is login to node15:24
ysandeepin this dir path where zuul clone things:-15:24
ysandeephttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_63b/835041/1/check/tripleo-ci-centos-8-standalone-wallaby-osa/63b8b8f/logs/undercloud/home/zuul/src/opendev.org/openstack/index.html15:24
ysandeepi think we are not capturing all the repos here in logs, if you login you will see more repos15:25
ysandeeprun "git branch" from inside repo15:25
ysandeepbut we only have login access in rdo only.15:26
ysandeepso you have to do that testing in rdo15:26
ysandeepjm1, ^^ 15:26
jm1or reproducer ;)15:26
ysandeepyes :D15:26
jm1ysandeep: i guess its very likely that wallaby is taken if its the only version in yum.repo.d, so i am happy :)15:27
jm1ysandeep++ marios++ thanks again for your help, now i am waiting for recheck and hopefully the tempest error is gone then ^^15:28
marioso/ np jm1 15:28
ysandeepjm1++ marios++ 15:29
bhagyashrisysandeep, nw15:31
rlandymarios: chandankumar: soniya29: train c8 is promoting now15:52
* dviroel lunch15:53
ysandeeprlandy: you pinged me during scrum time, wanted to discuss something?16:03
rlandyysandeep: mixed rhel mode16:03
rlandyotherwise - will requeue16:03
ysandeeprlandy: I am available to chat if you want to.16:04
rlandyysandeep, https://meet.google.com/qbv-kuwe-uqa?pli=1&authuser=016:04
mariosrlandy: great thank you 16:08
mariosrlandy: chandankumar: going in a few mins o/ thanks again chandankumar will check in tomorrow incase you need something 16:19
rlandymarios: enjoy your day off16:20
rlandywe got this16:20
rlandyunless you "want" us to need you :)16:20
ysandeepdviroel: Incase you meet ceph folks for a meeting, do you mind looping me in too - I would like to test and see some progress for - ceph nodes deployed on ovb env.16:20
rlandywill try to victoria/ussuri to promote16:20
mariosrlandy: ;) 16:20
rlandymarios: send the code word, we will respond accordingly16:21
mariosthanks :)16:24
marioso/16:24
dpawlikHey, feel free to check the Openstack  Opensearch - https://opensearch.logs.openstack.org/_dashboards/app/discover/?security_tenant=global -> user: openstack pass: openstack, tenant: global16:25
rlandydviroel: dasm: rcastillo: will be leaving in 20 mins16:25
dasmrlandy: ack16:25
rlandywill try keep a check on vcitoria and ussuri lines16:25
dasmrlandy: no review meeting today?16:27
rlandydasm: you can go ahead and review with rcastillo and dviroel 16:27
dasmi did already ;)16:28
ysandeepdpawlik++16:29
rcastillorlandy: ack16:30
ysandeeprlandy: I am adding the above "Openstack  Opensearch" details ^^ in our infra doc16:31
rlandyok16:32
dpawliklet me know what visualization will be helpful :)16:32
ysandeepdpawlik, I will try out and let you know :D16:35
* ysandeep out16:36
*** ysandeep is now known as ysandeep|out16:36
dpawlikthanks ysandeep!16:36
soniya29rlandy, ack16:45
rlandysee you all tomorrow16:46
*** rlandy is now known as rlandy|PTO16:46
dasmo/16:50
* dviroel back from lunch16:58
*** jpena is now known as jpena|off17:28
* jm1 out for today, have a nice evening/night :)20:17
dasmhttps://review.rdoproject.org/r/c/testproject/+/40332 with uefi -- passed cs8-wallaby20:21
rcastillodasm++ nice!20:35
dviroeldasm++20:43
* dviroel going out - tomorrow pto - see you all on monday o/20:44
*** dviroel is now known as dviroel|pto20:45
dasmdviroel|pto: have a good weekend!20:49
* dasm leaves21:04
dasmo/21:04
*** dasm is now known as dasm|off21:04

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!