Friday, 2021-12-10

*** ysandeep|out is now known as ysandeep01:38
*** pojadhav|out is now known as pojadhav|rover03:50
*** marios is now known as marios|ruck06:23
*** ysandeep is now known as ysandeep|lunch07:34
chandankumarmarios|ruck: Good morning, I have refreshed the cs9 packages in component and integration line07:34
chandankumarvia testproject.07:34
chandankumarAll the missing changes will be there07:34
marios|ruckchandankumar: thank you chandankumar that is a great thing to hear on friday morning ;)07:35
chandankumarhappy to help. :-)07:36
marios|ruckwouldn't it be great if we could go get a beer this evening after work 07:36
marios|ruck:/07:36
chandankumarSounds like a good plan :-) sure :-)07:39
bhagyashrisfols kindly add into your review list: https://review.rdoproject.org/r/c/rdo-jobs/+/3699008:13
chandankumarbhagyashris: i think it has merge conflict08:17
*** ysandeep|lunch is now known as ysandeep09:41
chandankumarmarios|ruck: \o09:41
chandankumarmarios|ruck: on fs02 job, I am seeing https://logserver.rdoproject.org/13/36713/6/check/periodic-tripleo-ci-centos-9-ovb-1ctlr_1comp-featureset002-master/00e1d33/logs/undercloud/home/zuul/overcloud_node_provision.log.txt.gz09:42
chandankumarWait for provisioned nodes to boot | overcloud-controller-0 | error={"ansible_facts": {"discovered_interpreter_python": "/usr/bin/python3"}, "changed": false, "elapsed": 601, "msg": "Timeout waiting for provisioned nodes to become available"}09:42
chandankumaris it seen in fs01 also?09:42
marios|ruckchandankumar: sorry in a call right now gimme 209:42
marios|ruckchandankumar: yes same issue 09:42
chandankumarsure09:42
ysandeepchandankumar, do you have latest baremetal component? 09:42
marios|ruckchandankumar: i started digging there yesterday but didn't file a bug yet09:43
ysandeepthat was fixed in metalsmith1.609:43
marios|ruckchandankumar: https://logserver.rdoproject.org/67/36267/38/check/tripleo-stream9-development-centos-9-ovb-3ctlr_1comp-featureset001-master/fb0f656/logs/undercloud/home/zuul/overcloud_node_provision.log.txt.gz 09:43
marios|ruckysandeep: nice anything to reference do we have bug? 09:43
chandankumarysandeep: marios|ruck let me check09:43
ysandeeppython3-metalsmith.noarch          1.6.1-0.20211202211701.81d820f.el9    @delorean-component-baremetal 09:44
ysandeep^^ looks like we already have that here, some thing else then.. 09:44
marios|ruckysandeep: no i have older one so might be09:44
marios|ruckysandeep: python3-metalsmith-1.5.1-0.20210922085423.2a39acc.el9.noarch09:44
marios|ruckhttps://logserver.rdoproject.org/67/36267/39/check/tripleo-stream9-development-centos-9-ovb-3ctlr_1comp-featureset001-master/52147bd/logs/undercloud/var/log/extra/rpm-list.txt.gz09:45
ysandeepmarios|ruck, chandankumar https://bugs.launchpad.net/tripleo/+bug/1952573 09:45
ysandeepfor some reason no console logs here: https://logserver.rdoproject.org/67/36267/38/check/tripleo-stream9-development-centos-9-ovb-3ctlr_1comp-featureset001-master/fb0f656/logs/baremetal_38_22404_0-console.log 09:48
marios|ruckthank you ysandeep 09:48
ysandeepand in fs002 - even console.log file is not present: https://logserver.rdoproject.org/13/36713/6/check/periodic-tripleo-ci-centos-9-ovb-1ctlr_1comp-featureset002-master/00e1d33/logs/ 09:48
marios|ruckbrb09:49
chandankumarysandeep: thanks Sandeep09:50
ysandeepchandankumar, may be worth to check if c9 send logs to serial console, there is a kernel parameter is needed to send console logs 09:50
* ysandeep checking09:50
chandankumarsure09:55
chandankumarmarios|ruck: please have a look at this https://review.opendev.org/c/openstack/tripleo-ci/+/820188 when you get some time.10:33
chandankumarit has merge conflict and few suggestions10:33
marios|ruck chandankumar: ack 10:35
*** ysandeep is now known as ysandeep|afk10:35
marios|ruckpojadhav-: fyi trying to see if we have an issue with ussuri standalone-upgrade new one (cinder Online data migration ) @ https://review.rdoproject.org/r/c/testproject/+/3715010:48
pojadhav-marios|ruck, ack11:02
*** pojadhav- is now known as pojadhav|rover11:02
*** ysandeep|afk is now known as ysandeep11:04
*** rlandy__ is now known as rlandy|ruck11:08
*** chem is now known as Guest813711:08
rlandy|ruckmarios|ruck: pojadhav|rover: hello - how are things?11:10
rlandy|ruckmeeting with chandankumar for a bit - will ping 11:11
rlandy|ruckto sync11:11
marios|ruckrlandy|ruck: nothing major. potential new issue for standalone-upgrade ussuri 11:11
rlandy|ruckmarios|ruck: ack - that line is out by 9 days now11:11
rlandy|rucklet's chat in a bit11:11
marios|rucksure11:11
rlandy|ruckpojadhav|rover: hey - can you look at the jobs failing in 17 now and rerun?11:15
chandankumarmarios|ruck: pojadhav|rover https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/819876 just landed if you see any collection issue on tempest side, please let me know11:15
rlandy|rucksee if there is a real issue there11:15
rlandy|ruckthanks11:15
pojadhav|roverrlandy|ruck, ack11:15
pojadhav|roverchandankumar, sure11:16
marios|ruckthanks chandankumar 11:18
*** dviroel|out is now known as dviroel11:26
pojadhav|roverrlandy|ruck, posted testun : https://code.engineering.redhat.com/gerrit/c/testproject/+/276230/2411:30
*** pojadhav- is now known as pojadhav|rover11:33
*** pojadhav|rover is now known as pojadhav|rover|afk11:33
marios|ruckchandankumar: https://review.opendev.org/c/openstack/tripleo-ci/+/820188/2#message-eb3844444676ad9bade0ce5cb3188d002d7791f111:46
marios|ruckchandankumar: i think we need to keep it11:46
marios|ruckchandankumar: updated for merge conflict let me know if you disagree i will revisit  11:46
marios|ruckthanks11:46
rlandy|ruckmarios|ruck: hey - let's sync quickly re: ussuri11:47
marios|ruckrlandy|ruck: sure gimme 1 min11:47
marios|ruckrlandy|ruck: ready11:48
rlandy|ruckmarios|ruck: https://meet.google.com/aoo-xpgs-mit?pli=1&authuser=011:49
marios|ruck        * https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_ece/periodic/opendev.org/openstack/tripleo-heat-templates/stable/ussuri/tripleo-ci-centos-8-standalone-upgrade-ussuri/ecea72e/logs/undercloud/home/zuul/standalone_upgrade.log11:51
marios|ruckhttps://3a4dcaf3f33e480b265b-98cbd17e2930261ab1c83c6342d64f26.ssl.cf2.rackcdn.com/periodic/opendev.org/openstack/tripleo-heat-templates/stable/ussuri/tripleo-ci-centos-8-standalone-upgrade-ussuri/f15e7c5/logs/undercloud/home/zuul/standalone_upgrade.log11:51
marios|ruckrlandy|ruck: cinder ^^^ 11:51
chandankumarmarios|ruck: thanks for looking into that, checking11:52
marios|ruckhttps://review.opendev.org/c/openstack/tripleo-heat-templates/+/82103211:54
marios|ruckrlandy|ruck: ^^^11:55
marios|ruckrlandy|ruck: eg https://review.opendev.org/q/project:openstack/tripleo-heat-templates+branch:stable/ussuri11:55
*** jpena|off is now known as jpena12:05
marios|ruckpojadhav|rover|afk: rlandy|ruck: fyi https://bugs.launchpad.net/tripleo/+bug/1954431 12:07
rlandy|ruckmarios|ruck: thanks12:12
rlandy|ruckakahat; hey ... wanted to touch base with you about scneario010 in downstream triggering12:12
akahatrlandy|ruck, o/12:13
rlandy|ruckakahat: https://meet.google.com/kbr-nhiw-gss?pli=1&authuser=012:13
rlandy|ruckakahat: https://issues.redhat.com/browse/RHOSZUUL-70012:16
rlandy|ruckakahat: https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/29612312:17
marios|ruckchandankumar: which one cinder?12:24
chandankumarmarios|ruck: this one https://review.opendev.org/c/openstack/tripleo-ci/+/820188 cs9 compose patch12:25
marios|ruckchandankumar: ah i see ack 12:25
chandankumarysandeep: rlandy|ruck https://review.opendev.org/c/openstack/tripleo-ci/+/820188 good to go12:25
marios|ruckrlandy|ruck: have pinged abishop in tripleo to check that cinder issue 12:25
rlandy|ruckakahat: https://code.engineering.redhat.com/gerrit/c/testproject/+/20029512:26
rlandy|ruckakahat: https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/29612312:26
ysandeepdviroel, ++ thanks nice catch on: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/821171 12:29
bhagyashris_rlandy|ruck, 1:113:31
*** bhagyashris_ is now known as bhagyashris13:31
rlandy|ruckjoining13:31
bhagyashrisok13:32
ysandeeprlandy|ruck, 1:114:00
*** rcastillo|out is now known as rcastillo14:14
marios|ruckrlandy|ruck: ruck handoff ... should we wait? 14:31
marios|ruckhttps://trello.com/c/gEoAAZw4/2230-cixlp1950916tripleociproa-qemu-61-in-centos-stream-8-9-regression-in-q35-unable-to-add-more-than-15-pcie-root-ports 14:39
marios|ruckhttps://bugs.launchpad.net/tripleo/+bug/1954431 14:42
marios|ruckhttps://review.rdoproject.org/zuul/status#37150 14:46
marios|ruckhttps://zuul.openstack.org/status#82126414:46
marios|ruckhigh 5 pojadhav ;)14:50
pojadhavmarios|ruck, :D:)14:50
rlandy|ruckakahat: nice - you got a first success14:54
pojadhavfrenzy_friday, hey please update the card, will picked up C9 component stuff from next week from where you left.. :)14:55
*** pojadhav is now known as pojadhav|afk14:59
frenzy_fridaypojadhav|afk, ack, updated the card. Thanks :)15:19
akahatrlandy|ruck, yup.. second failure is tempest15:20
*** ykarel is now known as ykarel|away15:24
chandankumarrlandy|ruck: need some eyes on this bug https://bugs.launchpad.net/tripleo/+bug/195445615:37
chandankumarysandeep: https://bugs.launchpad.net/tripleo/+bug/195445615:37
ysandeepchandankumar, thanks! I am debugging this, will add my comment on bug if I find something15:38
chandankumarysandeep: sure, thanks :-)15:38
akahatrlandy|ruck, https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/jobs15:42
dviroelysandeep: hi, just pinging you to test my hexchat :P15:49
* dviroel expects a pong15:49
ysandeepdviroel, pong o/15:49
dviroelysandeep: tks, i hit a magical keyboard shotcut that added you to ignore list15:50
dviroelshorcut*15:50
ysandeepdviroel,  what did I ever do to your keyboard that it added me to ignore list  :) 15:52
ysandeeprlandy|ruck, as requested added --node_hold_expiration on node_holder.py , https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/37025 , I will write a readme file on Monday and remove the wip for reviews15:54
dviroelysandeep: I recently changed to US keyboard, so i'm hitting wrong keys combinations yet, until i get used 15:54
ysandeep:) okay15:57
*** ysandeep is now known as ysandeep|out16:04
marios|ruckrlandy|ruck: pojadhav|afk: https://review.rdoproject.org/r/c/testproject/+/37150/2#message-8c53d4e8bb6f812bd651f809a775305e31ec776f ussuri job passed there fyi16:15
rlandy|ruckchandankumar: sorry - rolling meetings16:27
rlandy|rucklooking back16:27
rlandy|ruckmarios|ruck: nice16:27
rlandy|ruckthe rest of the ussuri line is a bit red though :(16:27
rlandy|ruckgoing to testproject rerun there16:28
rlandy|ruckysandeep|out: looks cool - thanks16:28
rlandy|ruckchandankumar: need me to investigate?16:29
rlandy|ruckchandankumar: you can also ping stevebaker for help pn hardware provisioning chat16:29
rlandy|ruckI see ysandeep|out did16:30
chandankumarrlandy|ruck: ysandeep|out has pinged already16:30
chandankumarwe can wait for weekend, not urgent16:30
rlandy|ruckchandankumar: I can reach him on my sunday afternoon16:30
rlandy|ruckhis monday morning16:30
chandankumarok, sure, thank you :-)16:31
rlandy|ruckchandankumar: leave whatever notes on the bug and I'll ping him then16:31
chandankumarok16:31
chandankumarI am logging out now16:34
chandankumarhappy weekend people, see ya next week. :-)16:34
marios|ruckhave a good 1 chandankumar 16:34
* marios|ruck out in a few16:34
rlandy|ruckmarios|ruck: have a good weekend16:46
rlandy|ruckhappy no more ruck/rovering16:47
*** dviroel is now known as dviroel|afk16:50
marios|ruckthanks rlandy|ruck have a good weekend 2 u too 16:51
rlandy|ruck:)16:51
*** marios|ruck is now known as marios|out17:01
rlandy|ruckhttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-component-network/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-containers-multinode-network-rhos-16.2/bc11497/job-output.txt17:08
rlandy|ruckysandeep|out: ^^ containers multinode issue on downstream17:08
-opendevstatus- NOTICE: The Gerrit service on review.opendev.org is being quickly restarted for a configuration adjustment, and should return momentarily17:25
akahatrlandy|ruck, what if we fixed the roof and modify shadow ?17:55
rlandy|ruckakahat?17:55
rlandy|ruckif we fixed the roof?17:55
akahatI'm saying if we add one job on zuul opendev side?17:56
akahatand make branching from there17:56
akahatwe can create one base job on opendev side for all common project.17:57
akahatwhich will reflect downstream.17:57
akahatokay.. it's just a thought on our internal project solution..17:59
*** jpena is now known as jpena|off17:59
rlandy|ruckakahat: possibly18:05
rlandy|ruck on a call18:05
akahatrlandy|ruck, i think this will work. 18:05
rlandy|ruckcan you leave details in a review18:05
rlandy|ruckor email 18:05
rlandy|ruckand I'll comment18:06
akahatyup. 18:06
rlandy|ruckthanks18:06
rlandy|ruckon calls for another hour18:06
akahathave a good weekend everybody.18:18
*** dviroel|afk is now known as dviroel19:19
rlandy|ruckakahat: ugh - so sorry missed you19:30
rlandy|ruckdviroel; just fyi - ahead of next week's ruck/rover - have an issue in containers multinode is downstream - will bug19:40
dviroelrlandy|ruck: ack, ty, will take a look monday morning19:42
rlandy|rucksure - leaving notes19:44
-opendevstatus- NOTICE: The Gerrit service on review.opendev.org is being restarted again for a plugin change, and should be back shortly20:16
*** dviroel is now known as dviroel}out21:49
*** dviroel}out is now known as dviroel|out21:50

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!