Tuesday, 2022-02-08

*** rlandy|ruck is now known as rlandy|out02:03
*** pojadhav|afk is now known as pojadhav02:36
*** ysandeep|out is now known as ysandeep03:57
ysandeeppojadhav, bhagyashris please hold your recheck for 17 testing, rhel-9 zuul node pool image, needs to be fixed first03:57
bhagyashrisysandeep, ack03:57
pojadhavysandeep, sure04:38
*** ysandeep is now known as ysandeep|afk07:11
*** amoralej|off is now known as amoralej07:33
*** jpena|off is now known as jpena08:03
*** ysandeep|afk is now known as ysandeep08:45
ysandeeppojadhav, bhagyashris do you have few mins for wallaby/17 discussion?09:32
bhagyashrissure09:32
bhagyashrisgive 5 - 10 mins09:32
pojadhavysandeep, yep09:33
ysandeepsure09:33
bhagyashrisysandeep, i am back09:38
ysandeepbhagyashris, pojadhav meet.google.com/muk-uzxo-qca09:41
bhagyashrisysandeep, https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/30944710:01
*** dviroel|out is now known as dviroel|ruck10:05
pojadhavbhagyashris, ysandeep : https://review.opendev.org/q/topic:c8_teardown_master10:10
dviroel|ruckmarios: hi o/10:11
dviroel|ruckmarios: can you just confirm what was the fix for this LP: https://bugs.launchpad.net/tripleo/+bug/1957031 ? - I was seing this issue yesterday again10:13
mariosdviroel|ruck: o /looking10:14
mariosdviroel|ruck: not clear what the fix was for me - but there was at least one more bug (and bugzilla ) sec let me find10:15
dviroel|ruckmarios: https://bugzilla.redhat.com/show_bug.cgi?id=200712910:15
mariosdviroel|ruck: yeah but there https://bugs.launchpad.net/tripleo/+bug/1957060 10:17
mariosdviroel|ruck: e.g. comment 8 has 10:17
mariosYeah, this is looking identical to [1], which itself is a duplicate of [2].10:17
marios[1] https://bugzilla.redhat.com/show_bug.cgi?id=202466210:17
marios[2] https://bugzilla.redhat.com/show_bug.cgi?id=200712910:17
mariosdviroel|ruck: [2] is the one you pointed at10:18
mariosdviroel|ruck: maybe you can find something useful in those comments ;) or the other bz 10:18
mariosdviroel|ruck: especially that looks likely https://gitlab.com/qemu-project/qemu/-/commit/64b4529a432507ee84a924be69a03432639e87ba 10:18
mariosdviroel|ruck: see comments #11 #12 on https://bugs.launchpad.net/tripleo/+bug/1957060 10:19
dviroel|ruckmarios: yeah, i was trying to find which package and version was fixed - BZ says qemu-kvm - but i didn't find in pkg list10:21
dviroel|ruckmarios: ok, tks, it was just to confirm that we didn't create any fix for that10:22
dviroel|ruckmarios: was only external dep10:22
mariosdviroel|ruck: yeah i think so at least i didn't catch any other fixes 10:27
*** rlandy|out is now known as rlandy|ruck11:11
rlandy|ruckmarios: ysandeep: need to meet with ruck/rovers re: master11:13
rlandy|ruckmarios: ysandeep: skip review time? or meet later?11:13
rlandy|ruckyou can join the promote discussion if you want11:13
mariosrlandy|ruck: sure np for me... 11:13
mariosrlandy|ruck: i can join and we can get to it after? whatever11:13
ysandeepokay with me to join now and get the current promotion status for c911:14
rlandy|ruckdviroel|ruck: akaha|rover: hey - let's sync re: master https://meet.google.com/vzm-nrah-qqf?authuser=011:14
rlandy|ruckack it's a party11:14
rlandy|ruckyou can all join11:14
mariosrlandy|ruck: no worries (sorry i hit exit as you were saying sorry :D)11:27
mariosrlandy|ruck: just ping when ready 11:27
rlandy|rucknp - will be back in a few11:27
rlandy|ruckakaha|rover: dviroel|ruck: https://review.rdoproject.org/r/c/testproject/+/2185311:34
rlandy|ruckhere's the damage11:34
rlandy|ruckperiodic-tripleo-centos-9-master-component-security-promote-to-promoted-componentstestprojectmastercheck21853,4511:40
rlandy|ruck3 mins 38 secs2022-02-08 11:35:45SUCCESS11:40
rlandy|ruckperiodic-tripleo-centos-9-master-component-network-promote-to-promoted-componentstestprojectmastercheck21853,4511:40
rlandy|ruck3 mins 42 secs2022-02-08 11:35:34SUCCESS11:40
ysandeepdviroel|ruck, new failure https://review.rdoproject.org/zuul/builds?job_name=tox-py36-ci-config if not already known11:40
rlandy|ruckakaha|rover: ^^ pls check into that11:42
dviroel|ruckrlandy|ruck: ack11:42
rlandy|ruck2022-02-08 11:34:52.269657 | rdo-centos-stream | FAILED ci-scripts/infra-setup/roles/rrcockpit/files/telegraf_py3/tests/test_gerrit_changes.py::TestGerritChanges::test_gerrit_changes11:42
rlandy|ruck2022-02-08 11:34:52.269662 | rdo-centos-stream | FAILED roles/rrcockpit/files/telegraf_py3/tests/test_gerrit_changes.py::TestGerritChanges::test_gerrit_changes11:42
dviroel|ruckysandeep: thanks o/11:42
dviroel|ruckrlandy|ruck: creating skiplist for https://bugs.launchpad.net/tripleo/+bug/196031011:43
rlandy|ruckdviroel|ruck: sure - thank you11:43
rlandy|ruckwe will need to get that merged and then rekick the line11:43
rlandy|ruckmarios: ysandeep: joining again11:52
ysandeepack11:52
mariosrlandy|ruck: on my way 2 mins11:52
mariosrlandy|ruck: please start11:52
akaha|roverrlandy|ruck, o/11:57
* akaha|rover looking11:57
*** ysandeep is now known as ysandeep|mtg12:01
rlandy|ruckakaha|rover: the linter issue is taking out ci-config ... can you check it12:07
akaha|roverrlandy|ruck, looking in it12:08
rlandy|ruckarxcruz: hi ... https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/815654 - pls see comments12:15
rlandy|ruckthere is agreement on the nohub thing12:16
rlandy|rucksoniya29: ^^12:16
rlandy|ruckpls confirm12:16
arxcruzrlandy|ruck is soniya29 back?12:16
arxcruzshould i handle it or her ?12:16
rlandy|ruckmarios: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/82822312:17
rlandy|ruckarxcruz: either12:21
soniya29arxcruz, yeah, i am12:22
soniya29rlandy|ruck, we don't require nohup since earlier issue what we were facing with the above patch was just because we have set timeout to 60 12:24
soniya29rlandy|ruck, i am updating it12:24
* pojadhav will be back in an hour12:33
*** pojadhav is now known as pojadhav|afk12:33
dviroel|ruckrlandy|ruck: ysandeep|mtg https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/82828512:37
rlandy|rucklooking12:37
rlandy|ruckdviroel|ruck: looks good12:38
rlandy|ruckysandeep|mtg: ^^ merging above12:39
ysandeep|mtgrlandy|ruck, voted 12:39
ysandeep|mtglgtm12:39
rlandy|ruckdviroel|ruck: thanks  - when that merges, will rekick master line12:39
dviroel|ruckrlandy|ruck: ack12:40
dviroel|ruckrlandy|ruck: i guess that everything is merged now (https://trello.com/c/IKHQQFTu/2334-cixlp1959582tripleociproa-centos-9-scenario007-standalone-wallaby-ostempest-failing-on-ping-router-ip-address)12:44
rlandy|ruckk - great - you can close out that card12:45
dviroel|ruck\o/12:46
rlandy|ruckdviroel|ruck: akaha|rover: rekicked main line 12:52
rlandy|ruckhere's hoping12:52
rlandy|ruckwaiting for https://trunk.rdoproject.org/centos8-master/queue.html to clear12:53
rlandy|ruckto repromote c8 components12:53
*** ysandeep|mtg is now known as ysandeep12:55
rlandy|ruckhttps://trunk.rdoproject.org/centos8-master/queue.html - lol this queue just got one patch shorter13:00
dviroel|ruckrlandy|ruck: not sure, but looks like the build ratio is 1 at every 5 min13:00
rlandy|ruck124 left13:00
rlandy|rucklike watching a pot boil13:01
rlandy|ruckdviroel|ruck: we need to stop watching dlrn obsessively :)13:01
dviroel|rucklol13:02
rlandy|ruckhttps://logserver.rdoproject.org/openstack-component-network/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-standalone-network-master/e11d1a8/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz13:03
rlandy|ruckugh - think containers got pruned again13:03
rlandy|ruckarxcruz: hey - can you do your copy magic again, pls?13:03
rlandy|ruckmaster c9 back to rdo registry13:04
arxcruzrlandy|ruck sure, the current-tripleo ?13:04
rlandy|ruckpls13:04
rlandy|ruck2022-02-08 12:55:58,730 59228 WARNING tripleo_common.image.image_uploader [  ] [192.168.24.1:8787/tripleomastercentos9/openstack-nova-compute:82142cdf4dd511032b48543abbec9229-updated-20220208073756] Failed to check if the target image exists13:04
*** ysandeep is now known as ysandeep|coffee13:04
rlandy|ruckarxcruz: ^^ yeah - I think we are missing those13:05
rlandy|ruckfrenzy_friday: hey13:07
rlandy|rucknot sure if I answered your question13:07
rlandy|ruckneed to meet?13:07
rlandy|ruckpojadhav|afk: hey https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39207 stil failing13:08
rlandy|ruckcan you recheck pls13:08
rlandy|ruckakaha|rover: hey - can you recheck jobs failing train, ussuri, vic, wallaby promotions13:10
rlandy|ruck2 days out - we can try get those clean13:10
rlandy|ruckwallaby is running now13:10
rlandy|ruckfs039 failed13:10
rlandy|ruckchecking wallaby c913:10
dviroel|ruckrlandy|ruck: i am working in https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3920713:14
dviroel|ruckrlandy|ruck: pojadhav|afk was automatically added reviewer13:14
dviroel|ruckrlandy|ruck: did the recheck, not sure what is the new issue13:15
rlandy|ruckdviroel|ruck++ thanks for picking that up13:15
dviroel|ruckrlandy|ruck: yep, asked akaha|rover to take this issue since I already fixed another one that is similar13:16
dviroel|ruckrlandy|ruck: to take it for me13:16
frenzy_fridayrlandy|ruck, hey, yeah sorry I still had some questions. Is it ok if I book some time on wednesday?13:17
*** amoralej is now known as amoralej|lunch13:18
bhagyashrisarxcruz, sshnaidm, rlandy, rlandy|ruck, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, chandankumar, frenzy_friday, anbanerj,  dviroel, rcastillo, dasm, jm1, rlandy|ruck dviroel|ruck akaha|rover 13:18
bhagyashrisTripleo CI community meeting in 10 mins13:19
rlandy|ruckfrenzy_friday: sure13:19
bhagyashrisfeel free to add topic here https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg?both#2022-02-08-Community-Call @line 3413:19
bhagyashrishttps://meet.google.com/bqx-xwht-wky13:20
rlandy|ruckpython3 roles/rrcockpit/files/telegraf_py3/ruck_rover.py --release wallaby --distro centos-9 - gives me an error13:20
rlandy|ruckwork for anyone??13:20
dviroel|ruckrlandy|ruck: you need ruck_rover_config file updates13:21
dviroel|ruckrlandy|ruck: probably is not in repo yet13:22
rlandy|ruckdviroel|ruck: the option to run wallaby with c9?13:26
rlandy|ruckis not yet in the repo?13:26
rlandy|ruckwill have to try add it13:26
dviroel|ruckrlandy|ruck: https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/rrcockpit/files/telegraf_py3/conf_ruck_rover.yaml#L29-L3113:29
dviroel|ruckrlandy|ruck: you need to add config for wallabu13:29
dviroel|ruckrlandy|ruck: and should work13:29
rlandy|ruckdviroel|ruck: thanks - adding review13:29
dviroel|ruck++13:29
bhagyashrisarxcruz, rlandy|ruck rcastillo dasm|off marios ysandeep|coffee 13:30
bhagyashriscommunity call13:30
bhagyashrispojadhav|afk, 13:30
bhagyashrissoniya29, ^13:30
bhagyashrisdviroel|ruck, 13:30
*** pojadhav|afk is now known as pojadhav13:31
pojadhavrlandy|ruck, dviroel|ruck : looking13:31
dviroel|ruckpojadhav: ok, we are trying to fix some unit tests - waiting ci results again13:33
dviroel|ruckrlandy|ruck: ysandeep|coffee - https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39207 - passing now - please paya attention to commit msg and se if make sense13:39
*** ysandeep|coffee is now known as ysandeep13:39
ysandeepdviroel|ruck, ack will look after community call 13:41
mariosjfrancoa: oooci-jobs.sh:  *** DEFINITION *** https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/standalone-jobs.yaml#L41213:45
rlandy|ruckysandeep: dviroel|ruck:  Add wallaby c9 config for ruck/rover tool  https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3921413:52
rlandy|ruckwfm now13:52
ysandeepvoted ^^13:53
jfrancoamarios: thanks for the link and the info folks!13:55
*** dasm|off is now known as dasm13:55
mariosjfrancoa: o/ np 13:55
dasmo/13:55
marios\o13:55
rlandy|ruckdasm: hey13:55
rlandy|ruckany response on your uefi boot?13:55
rlandy|ruckif not, let's look at it later today13:56
ysandeepdviroel|ruck, checking now13:56
dasmrlandy|ruck: just started checking, but i don't think so.13:56
dasmrlandy|ruck: i'm gonna see again today.13:57
* bhagyashris cooking and dinner brb13:57
pojadhavdviroel|ruck, thanks for fixing :)13:59
dviroel|ruckpojadhav: anytime14:02
rlandy|ruckdviroel|ruck: thanks for https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39207 - merging14:05
arxcruzrlandy|ruck: my internet is down, I'm checking what's going on. I'm using my 3g connection 14:06
rlandy|ruckok14:06
rlandy|ruckonly 117 to go https://trunk.rdoproject.org/centos8-master/queue.html14:06
dviroel|ruckarxcruz: 3g? isn't 5g there already?14:07
rlandy|rucksupposedly openstack won 4g14:07
rlandy|ruckso that exists14:07
rlandy|ruck5g - depends on arae14:07
rlandy|ruckarea14:07
dviroel|ruckt-mobile has a good 4g+ and 5g coverage14:13
dviroel|ruckhttps://www.nperf.com/pt/map/DE/2950159.Berlin/187895.T-Mobile/signal/?ll=52.42587274336118&lg=13.450012207031252&zoom=914:13
rlandy|ruckakaha|rover: dviroel|ruck: who wants to present at the program call this week? I'll update the doc before my EoD14:18
dviroel|ruckrlandy|ruck: i will14:18
rlandy|ruckthank you, sir14:19
akaha|roverrlandy|ruck, i can14:19
rlandy|ruckyou can fight it out :)14:19
akaha|rover:)14:20
dviroel|ruckakaha|rover: i will take cix too, since it will be late for you right14:20
dviroel|ruckakaha|rover: don't worry14:20
akaha|roverdviroel|ruck, then let me attend program call. 14:21
dviroel|ruckakaha|rover: k, i will be the backup then ;)14:21
akaha|roverdviroel|ruck, thanks man!! :)14:21
*** amoralej|lunch is now known as amoralej14:22
ysandeepguys /me updating el9 status, please remind me what was blocking c9 wallaby promotion?14:36
ysandeepdviroel|ruck, ^^14:37
rlandy|ruckwhat dviroel|ruck bugged this morning14:40
rlandy|ruckbut in skiplist14:40
dviroel|ruckysandeep: this one is blocking https://bugs.launchpad.net/tripleo/+bug/1960310 - but we just merged the skiplist - will rerun again14:40
rlandy|ruckwallaby c9 line is running now14:40
dviroel|ruckoh, lets wait then14:40
rlandy|ruckysandeep: master c9 line is also running now14:41
ysandeepdviroel|ruck, thanks! same bug hitting fs064 and fs039 on wallaby c9?14:41
rlandy|ruckso we'll see if that clears14:41
ysandeeprlandy|ruck, ack 14:41
rlandy|rucklooking into the ci.centos thing more mow14:42
rlandy|rucknow14:42
dviroel|ruckysandeep: not yet in criteria I think, the fix was merged, will rerun and add them14:42
ysandeepdviroel++ ack, please take your time.. just want to know status to report in EL9 mtg14:44
dviroel|ruckysandeep: ack14:44
rlandy|ruckysandeep: oh - and we're still waiting on one octavia patch for scenario-10-kvm14:51
ysandeepthanks! added that as well14:53
*** akaha|rover is now known as akahat|dinner14:55
*** dviroel|ruck is now known as dviroel|ruck|lunch15:11
*** ysandeep is now known as ysandeep|dinner15:14
*** pojadhav is now known as pojadhav|dinner15:24
arxcruzand i'm back 15:33
*** ysandeep|dinner is now known as ysandeep15:44
mariosrlandy|ruck: ysandeep: el9 meeting cancelled ? i don't see in calendar any more it was there earlier though 15:45
rlandy|ruckmarios: yep ...15:47
rlandy|ruckmoving to CIX  apparently15:47
mariosrlandy|ruck: thanks15:47
ysandeeprlandy|ruck, did we agreed to moved to cix?15:47
ysandeepi thought that was just an idea15:47
rlandy|ruckthe CIX call is going to become the only meeting you'll ever need15:48
rlandy|ruckall in 30 mins15:48
mariosrlandy|ruck: in 10 mins more like15:50
rlandy|ruckugh - one failure - rerunning periodic-tripleo-ci-centos-9-standalone-full-tempest-scenario-master15:54
rlandy|ruckfs00215:55
mariosrlandy|ruck: ah see what you meant now... cix replacing the c9 call 15:55
mariosack 15:55
*** pojadhav|dinner is now known as pojadhav15:58
dasmhey dviroel|ruck|lunch  I'm trying to renew my kerberos ticket and it's failing. Can you see if that's working for you?16:00
dasm"not found in Kerberos database"16:02
rlandy|ruckdasm: wfm16:03
rlandy|ruckcan you try again kinit username16:04
*** dviroel|ruck|lunch is now known as dviroel|ruck16:06
dasm:/16:06
dviroel|ruckdasm: works for me too16:07
dasmtried few times already. i'll try resetting from scratch16:07
dasmack16:07
dviroel|ruckrlandy|ruck: python-keystone-tests-tempest is the next one :)16:08
rlandy|ruckdviroel|ruck: woohoo - grab the popcorn16:08
rlandy|ruckdasm: did you prepare the right sacrifice for the kerb powers???16:09
dasmrlandy|ruck: i knew i forgot about something! it's sacrifice16:10
dviroel|ruckrlandy|ruck: https://trunk.rdoproject.org/centos8-master/component/security/4e/ff/4eff632695fe79a5d78f400dca3ceab663c83788_5f1db43c/16:13
dviroel|ruckrlandy|ruck: do you have the command to kick security in hands?16:13
rlandy|ruckdviroel|ruck: it's running now16:14
rlandy|ruckwill kill and restart16:14
dviroel|ruck+116:14
rlandy|ruckdone16:19
dviroel|ruckrlandy|ruck: ack 16:20
dviroel|ruckrlandy|ruck: you already started to rerun master and wallaby jobs too - nice16:20
rlandy|ruckdviroel|ruck: yep16:20
dviroel|ruckfeatureset001-wallaby failed on the skipped tests, next run should work16:22
rlandy|ruckhttps://logserver.rdoproject.org/openstack-periodic-integration-stable1-cs9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-wallaby/019fda2/logs/undercloud/var/log/tempest/stestr_results.html.gz16:22
rlandy|ruckyep16:22
rlandy|ruckrerun in progress16:22
dviroel|ruckfs035 was also faling in these tests, should be the same issue16:22
rlandy|ruckadded to rerun testproject16:44
*** jpena is now known as jpena|off17:04
*** akahat|dinner is now known as akahat|rover17:05
rlandy|ruckdviroel|ruck: ok - I think I have all the failing tests in rerun17:05
rlandy|ruckfeel free to edit that testproject if needed17:05
rlandy|ruckfor c817:05
rlandy|ruckwe may need the whole queue to clear17:06
rlandy|ruckbefore we get good results17:06
rlandy|ruckwho knows what we are missing???17:06
rlandy|ruckwallaby c8 is promoting now17:06
dviroel|ruckrlandy|ruck: ack - so, yeah, each test has a different failure atm17:07
dviroel|ruckeach job*17:08
rlandy|ruckysandeep: going to start reporting on rhos-17 on rhel-9 promotions in program call17:11
rlandy|ruckyou'll make everyone happy17:12
dviroel|ruckrlandy|ruck: some component lines will continue to fail, because they need keystone-tempest fix17:16
dviroel|ruckrlandy|ruck: the best is to wait all commits in the queue17:16
rlandy|ruckdviroel|ruck: ack - it will shake out after we promote17:16
rlandy|ruckoh c817:17
rlandy|ruckyeah17:17
rlandy|ruckdviroel|ruck: for today, we should focus on c9 - master, wallaby promotions17:17
rlandy|ruckthen rekick c8 master component jobs that need it17:17
rlandy|ruckpromote tomorrow17:18
*** sshnaidm is now known as sshnaidm|afk17:18
dviroel|ruck+117:20
*** ysandeep is now known as ysandeep|out17:21
dasmok. laptop reboot solved a problem with non-working kerberos creds17:25
dasm\o/17:25
rlandy|ruckgreat17:36
*** amoralej is now known as amoralej|off17:39
rlandy|ruckbhagyashris: hi  - can you send link for victoria promotion?18:05
rlandy|ruckit should be promoting now18:06
bhagyashrisrlandy|ruck, http://10.0.148.74/promoter_logs/?C=M;O=D18:06
bhagyashrisyeah it's promoting ...18:06
rlandy|ruck2022-02-08 17:20:15,634 3585405 INFO     promoter Running: env ANSIBLE_LOG_PATH=/home/promoter/web/promoter_logs/container-push/20220208-171924.log ANSIBLE_DEBUG=False ansible-playbook -v -e @/tmp/tmpqs3dryfc.yaml /home/promoter/ci-config/ci-scripts/container-push/container-push.yml18:06
rlandy|ruckah - it is18:06
rlandy|ruckthank you18:06
rlandy|ruckysandeep|out: sshnaidm|afk: arxcruz: pls review your instances on PSI internal18:41
rlandy|ruckwe need to space to play there 18:41
rlandy|ruckpls delete what is not  in use18:41
rlandy|ruckakahat|rover: bhagyashris: ^^ two promoter servers there18:42
rlandy|ruckdviroel|ruck: fs002 on master18:51
rlandy|rucklooks like repeatable can;t delete stack18:52
rlandy|ruckif that is the only failure, would promote w/o that and bug it18:52
dviroel|ruckrlandy|ruck: +1, we can debug overcloud delete later - akahat|rover already fixed an issue there18:53
rlandy|ruckk18:53
rlandy|rucklet's see how the last few shake out18:54
rlandy|ruckalso trying to promote 1718:54
dviroel|ruckrlandy|ruck: found the commit that adds it https://opendev.org/openstack/tripleo-ansible/commit/2636e84c41f8be28c9f72e8ce126beb72b2cb32c18:59
rlandy|ruckping fmount on #tripleo19:00
rlandy|ruckhis commit19:00
dviroel|ruckrlandy|ruck: 8pm for him already19:07
dviroel|ruckno answers19:07
rlandy|ruckdviroel|ruck: try fultonj19:07
rlandy|ruckceph friends19:08
dviroel|ruckyep19:13
dviroel|ruckbut I think that they broke the vip delete logic - it is failing when we want to delete only using service_name19:13
dviroel|ruckrlandy|ruck: nothing that we will fix today right - you want me to open the bug?19:19
rlandy|ruckdviroel|ruck: ack pls19:20
rlandy|ruckwe'll ping fmount19:20
rlandy|ruckif it's only fs002, let's promote w/o it19:20
rlandy|ruckif it's all ovb, we have a bigger issue19:20
dviroel|ruckrlandy|ruck: agree19:21
rlandy|ruckwatching content provider c819:21
rlandy|rucksome gate failures19:21
rlandy|rucklet's see if there is a legit issue19:21
rlandy|ruckfs001 master passed19:23
rlandy|ruckfs035 failed19:23
rlandy|ruckchecking logs there19:23
dviroel|ruckok19:23
rlandy|ruckfa001 passed on both 19:32
rlandy|ruckfs035 failed on both19:32
dviroel|rucktempest?19:37
dviroel|rucksecurity OATH19:47
dviroel|ruckwill investigate19:47
rlandy|ruckand we have a content provider issue19:52
rlandy|rucklooking19:52
rlandy|ruckugh - I think I know19:54
rlandy|ruckhmmm ... no19:58
rlandy|ruckidk20:00
rlandy|ruckStderr: 'level=debug msg="Pull Policy for pull [PullIfNewer]"\nerror building20:01
dviroel|ruckhumm20:03
rlandy|ruckdviroel|ruck: hmmm ... https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-8-content-provider&skip=020:04
rlandy|ruckso we're definitely dying here20:04
rlandy|ruckand I thought it was https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/828223/1/roles/container-build/tasks/main.yaml20:04
rlandy|ruckbut it's not20:04
rlandy|ruckdviroel|ruck: something that maybe got into current master c820:06
rlandy|rucknot a c9 thing20:06
dviroel|ruckhttps://746b9b3552a84dbbbf46-a133153af68a0459f51ed4b0ea995900.ssl.cf5.rackcdn.com/827518/2/gate/tripleo-ci-centos-8-content-provider/6129769/logs/container-builds/3f06dd55-19c5-46c5-96ad-0bdedb4db623/base/collectd/collectd-build.log20:06
dviroel|ruckdependencie issue?20:07
dviroel|ruckmaybe something wrong with https://trunk.rdoproject.org/centos8-master/deps/collectd/20:10
rlandy|ruckError: Unable to find a match: collectd-libpod-stats collectd-sensubility python3-sqlalchemy-collectd20:10
dviroel|ruckoh, it is disabled20:11
rlandy|ruckwonder if that is messed up as well20:11
rlandy|ruckdviroel|ruck: let's ask on #rhos-ops20:11
dviroel|ruckrlandy|ruck: ok, but this repo is disabled (rdo one)20:12
dviroel|ruckhttps://746b9b3552a84dbbbf46-a133153af68a0459f51ed4b0ea995900.ssl.cf5.rackcdn.com/827518/2/gate/tripleo-ci-centos-8-content-provider/6129769/logs/undercloud/etc/yum.repos.d/quickstart-centos-opstools.repo20:12
rlandy|ruck baseurl: https://trunk.rdoproject.org/centos8-master/deps/collectd/20:13
dviroel|ruckenabled=020:13
rlandy|ruckyea - that was a temp repo20:13
rlandy|ruckhttps://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/CentOS-8/master.yml#L19320:13
dviroel|ruckseems to be there20:14
rlandy|ruckhttps://github.com/openstack/tripleo-quickstart/commit/1ef5d08a82dfac3f245c8be0c1307d8c61fb83d720:14
rlandy|ruckwhy is it disabled?20:16
dviroel|ruckdont know 20:16
dviroel|ruckhttps://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/CentOS-8/master.yml#L20320:16
rlandy|ruckhttps://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_059/828138/2/check/tripleo-ci-centos-8-content-provider/059c3bb/logs/undercloud/etc/yum.repos.d/quickstart-centos-opstools.repo20:17
rlandy|ruck^^ passing job it's enabled20:17
dviroel|ruckon stable/train is20:17
dviroel|rucklook the one below20:17
rlandy|ruckhttps://opendev.org/openstack/tripleo-ci/src/branch/master/roles/tripleo-build-jobs-repos/tasks/load-vars.yaml#L1620:20
rlandy|ruckdviroel|ruck: let's sync20:20
rlandy|ruckhttps://meet.google.com/zse-ryou-uod?pli=1&authuser=020:20
rlandy|ruckdviroel|ruck: sorry - out of meeting20:58
dviroel|ruckrlandy|ruck: just sent https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/82842821:00
* dviroel|ruck 3 bug reports in one day is my personal record21:01
rlandy|ruckdviroel|ruck: amazing21:01
rlandy|ruckdviroel|ruck: ok - let's deal with these one at a time21:01
rlandy|ruckwallaby, master c9 promotions21:02
dviroel|ruckwe can start a testproject with depends-on and see21:02
rlandy|ruckon fs035?21:02
dviroel|ruckyep21:02
rlandy|ruckyeah21:02
rlandy|ruckand then we will need to skip fs002 to promote21:03
dviroel|ruckyeah21:03
rlandy|ruckwrt content provider21:03
rlandy|ruckI'm going to propose a revert21:03
rlandy|ruckand add that as a depends on21:03
rlandy|ruckon a job in upstream21:04
dviroel|ruckok21:04
rlandy|ruckif it gets by, we merge that revert21:04
dviroel|ruckwill create the fs035 one21:04
rlandy|ruckidk if the depends on will take21:05
rlandy|ruckdviroel|ruck: other option is to force enable opstools in our repo21:06
dviroel|ruckrlandy|ruck: yes21:06
dviroel|ruckcan be more tricky - because we will need to disable [centos-opstools] delorean-master-deps.repo and enable quickstart-centos-opstools21:19
rlandy|ruckreally - if it's not ready, I would revert it21:29
rlandy|ruckdviroel|ruck: going to try a patch to remove that line21:30
dviroel|ruckwhich one?21:34
rlandy|ruckwhy are we disabling opstools?21:37
rlandy|ruckat the same time21:37
rlandy|ruckwhether it's enabled or not, makes no diff21:37
rlandy|ruckit's referencing the dlrn one21:37
dviroel|rucklol - don't know - don't have the background of this hac21:38
dviroel|ruckhack21:38
rlandy|rucktripleo-ci-centos-8-content-provider pass on one job21:40
rlandy|rucktransient?21:40
dviroel|ruckrlandy|ruck: can be a mirror issue 21:40
dviroel|ruckanother one build  atm: https://zuul.opendev.org/t/openstack/stream/9c0733c14f134ba793168fb8428989a5?logfile=console.log21:41
rlandy|ruckrechecking the failed gate jobs21:41
dviroel|ruckwaiting to see21:41
rlandy|ruckmaybe it's clearing21:41
rlandy|ruckdviroel|ruck: late for you21:49
rlandy|ruckputting in patch to take fs002 out of criteria21:50
dviroel|ruckrlandy|ruck: ack, i can vote21:51
rlandy|ruckdviroel|ruck: then you can go21:51
rlandy|ruckwill watch the fs03521:51
rlandy|ruckand the content provider mess21:51
dviroel|ruckrlandy|ruck: not too late, but I need to stay with the kid for a moment21:52
rlandy|ruckhttps://review.rdoproject.org/r/c/rdo-infra/ci-config/+/39223 Temp remove fs002 from master c9 criteria21:55
rlandy|ruckdviroel|ruck: ^^ when back21:55
dviroel|ruckvoted21:56
dviroel|ruckrlandy|ruck: going afk - o/22:01
rlandy|ruckdviroel|ruck: sure - hope kid is ok22:01
dviroel|ruckrlandy|ruck: he is better now22:02
dviroel|ruckrlandy|ruck: thanks o/22:02
rlandy|ruck:)22:02
*** dviroel|ruck is now known as dviroel|ruck|afk22:02
rlandy|ruckdasm: how goes uefi?22:16
dasmrlandy|ruck: surprisingly good. it started working without any intervention from my side. just checking if i missed anything22:18
rlandy|ruckwow22:18
rlandy|ruckyou chatted with steve?22:18
* rlandy|ruck checking hardware prov chat22:19
dasmyes22:19
rlandy|ruckok - let's chat tomorrow22:21
dasmk22:21
rlandy|rucklet me know what you found22:21
dasmatm -- nothing. 22:21
dasmit seems to be alright now22:21
dasmand i'm not even sure, why it didn't work yesterday :/22:22
* dasm leaves...23:01
*** dasm is now known as dasm|off23:02
rlandy|ruckamoralej|off: https://review.rdoproject.org/r/c/rdo-infra/ansible-role-dlrn/+/3880423:21
rlandy|ruckfailing content-provider jobs23:21
*** rlandy|ruck is now known as rlandy|ruck|bbl23:24

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!