Wednesday, 2022-08-10

*** dasm|off is now known as Guest16700:20
*** rlandy is now known as rlandy|out00:45
*** ysandeep|out is now known as ysandeep01:23
ysandeepgood morning/evening folks o/01:26
*** ysandeep is now known as ysandeep|afk02:44
*** ysandeep|afk is now known as ysandeep04:57
*** marios is now known as marios|ruck05:37
marios|rucko/05:37
*** pojadhav is now known as pojadhav|rover05:43
marios|rucko/ pojadhav|rover morning05:46
pojadhav|rovermarios|ruck, good morning!05:47
marios|rucko/ hi pojadhav|rover 05:48
marios|ruckpojadhav|rover: sync in ~1 hour as usual OK?05:48
pojadhav|rovermarios|ruck, sure05:49
marios|ruckpojadhav|rover: please join when you can 07:01
marios|ruckpojadhav|rover: see pvt 07:01
pojadhav|rovermarios|ruck, joining07:02
jm1o/07:07
*** ysandeep is now known as ysandeep|afk07:09
*** jpena|off is now known as jpena07:36
*** ysandeep|afk is now known as ysandeep07:37
*** ysandeep is now known as ysandeep|lunch09:34
marios|ruckpojadhav|rover: reminder about the d/stream cix cards please before the call today10:18
*** rlandy|out is now known as rlandy10:37
rlandymarios|ruck: pojadhav|rover: hi  - time tp sync now? before program call?10:40
rlandywe need to remove 17 on 8 and report on 17.1 on 8 plans10:40
marios|ruckrlandy: sure - we already spoke with pojah and prepared that together but yeah lets sync np10:40
marios|rucklets give pojadhav|rover a chance while you catchup rlandy 10:41
marios|ruckand sync in a minute10:41
rlandyyep - waiting for pojadhav|rover to reply10:41
marios|ruckrlandy: just spotted a new blocker looks like hits gate too :/ undercloud-upgrade master10:42
marios|ruckdigging at that for now ping when you want to talk 10:42
pojadhav|roverrlandy, marios|ruck : lets sync now10:42
rlandyalso wanted to discuss master ovb experiment on ibm cloud10:42
rlandyhttps://meet.google.com/ict-fnrh-rjm10:42
*** ysandeep|lunch is now known as ysandeep11:06
soniya29arxcruz, kopecmartin, chandankumar, rlandy, please add/edit today's agenda for tempest meeting:- https://hackmd.io/xWJLuBHGSI2YGX7UlkwRbg11:13
* ysandeep dropped review call as no one joined11:18
chandankumarysandeep: want to join back?11:19
chandankumari have few reviews lined up11:19
reviewbotDo you want me to add your patch to the Review list? Please type something like add to review list <your_patch> so that I can understand. Thanks.11:19
ysandeepchandankumar, yes, I see your 3 patches.. good to get some background on that11:19
* pojadhav|rover taking a short break before program call..11:20
rlandyarxcruz: are you around?11:22
arxcruzrlandy yes11:23
rlandyarxcruz: hey - need to chat with you about openstack-os_tempest11:23
arxcruzrlandy what happened?11:23
rlandyarxcruz: https://meet.google.com/ppp-vyiz-nmp - will be quicker11:24
*** dviroel|out is now known as dviroel11:24
rlandyarxcruz: https://hackmd.io/5zEei6JoTSmZ9mXlN5bxow11:31
*** bhagyashris_ is now known as bhagyashris11:32
rlandymarios|ruck: ha - a lone pass on fs001 master: https://review.rdoproject.org/r/c/testproject/+/3116511:35
marios|ruckgrumble grumble11:36
rlandyarxcruz: https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035-master/09d6423/job-output.txt11:36
arxcruzrlandy https://logserver.rdoproject.org/60/44460/2/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035-master/b2eee76/logs/overcloud-controller-0/var/log/containers/neutron/server.log.txt.gz11:36
rlandy2022-08-08 21:07:14.909 2 ERROR neutron.service 11:37
rlandy2022-08-08 21:07:14.911 2 CRITICAL neutron [None req-30ce8ff1-a463-4530-9482-1a9f7dc89f85 - - - - - -] Unhandled error: Exception: Could not retrieve schema from tcp:[fd00:fd00:fd00:2000::142]:6642,tcp:11:37
rlandymarios|ruck: ^^ for the fs001/fs035 bug11:39
rlandymarios|ruck: do you want me to log that bug?11:39
rlandyif you are busy with the gate blocker11:39
marios|ruckyou mean the ping tempest network fail rlandy ? 11:39
rlandymarios|ruck: ack11:40
marios|ruckrlandy: sure thanks please add to hackmd if you file so we don't duplicate otherwise will do it later 11:40
rlandyok11:40
marios|ruckthank you rlandy & arxcruz 11:42
rlandyit's not os_tempest11:42
rlandybut I'll log what we have11:42
marios|ruckack i gathere that arxcruz helped with the debug/logs rlandy 11:42
bhagyashrisrlandy, hey can we meet for 17.1 ...11:42
rlandybhagyashris: sorry busy with rr now11:43
bhagyashrisrlandy, ack np11:43
rlandybhagyashris: I want to merge the patch to stop the line11:43
rlandybhagyashris: I just wanted to give you a heads up first11:43
rlandyso you knew where the lines went11:43
rlandyyesterday11:43
bhagyashrisack11:44
rlandymarios|ruck; that pass - was ibm cloud11:52
rlandyfs002 had a legit failure on that run11:52
rlandypackage issue11:52
rlandyfor kicks - let me try the two remaining jobs on that hash11:53
rlandychandankumar: ^^ fyi - I;m experimenting with master on ibm cloud11:54
rlandyI tried it yesterday11:54
rlandyand it worked11:54
chandankumarrlandy: awesome11:54
rlandychandankumar: how many ovb stacks should I be able to run concurrently on ibm cloud?11:56
chandankumarrlandy: max 311:56
rlandyah11:56
rlandynot good enough line moves then11:56
rlandychandankumar: are we getting more?11:56
chandankumarrlandy: need to wait for nhilchar to come back and discuss around that with dpawlik also.11:57
chandankumar*nhichar11:57
rlandychandankumar: ok - will ask after program call11:57
*** gthiemon1e is now known as gthiemonge12:09
rlandymarios|ruck: checked the vexx ticket - no update there12:11
marios|ruckrlandy: can you please update with combined contents of https://bugs.launchpad.net/tripleo/+bug/1983817/comments/8 & https://bugs.launchpad.net/tripleo/+bug/1983817/comments/9 ?12:14
marios|ruckrlandy: mainly that the 10.0.0.250 is a red herring /confusion12:14
marios|ruckrlandy: really we don't know for sure cos we have no logs (that 10.0 is from good jobs not failed ones)12:14
marios|ruckrlandy: but in failed ones i see ansible_dns in zuul_info so maybe that's the dns used there12:14
marios|ruckcos they were all focusing on the .0.250 and where it came from rlandy 12:15
marios|ruckplease add to ticket? ^^ 12:15
marios|ruckthanks pojadhav|rover 12:28
*** amoralej is now known as amoralej|lunch12:28
pojadhav|rovermarios|ruck, :)12:28
rlandymarios|ruck: fs001 and fs035 OVB jobs failing to set up private network for os_tempest - https://bugs.launchpad.net/tripleo/+bug/198418412:35
rlandyadded to hackmd12:35
marios|ruckthank you rlandy 12:35
rlandymarios|ruck: so with ibm cloud fs001 gets by and fs035 is consistent12:35
marios|ruckthank you rlandy 12:36
marios|ruckrlandy:++12:36
rlandyadding more info12:36
pojadhav|roverrlandy, we got green run on build containers for 16.2 https://code.engineering.redhat.com/gerrit/c/testproject/+/276230/66#message-f75d010a2c86224344b120a30db32f4ab5bb15ea12:36
marios|ruckscreen break brb12:42
rlandypojadhav|rover: great12:48
rlandyprob temp hitch then12:48
soniya29dviroel, can you please join today's tempest meeting?12:58
soniya29we wanted to discuss about fips and rbac stuffs12:58
soniya29kopecmartin, chandankumar, rlandy, dviroel, tempest meeting?13:00
dviroelsoniya29: yes, can you give me the link?13:05
arxcruzsoniya29 https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/77231913:09
soniya29dviroel, https://meet.google.com/zvw-hnds-ncu13:09
* pojadhav|rover brb13:10
*** amoralej|lunch is now known as amoralej13:20
*** ysandeep is now known as ysandeep|break13:30
rlandyykarel: hello ... can someone on your team take a look at https://bugs.launchpad.net/tripleo/+bug/1984184 - if that sounds like it sits with neutron ... thanks13:31
rlandymarios|ruck: ^^13:31
marios|ruckthanks rlandy 13:34
ykarelrlandy, yes sure, doesn't look related to selinux though as per last comment13:54
ykareli will be out in some time but someone else can check as it will get to CIX13:54
ykarelseems caused by https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83637213:54
* jm1 bbl13:55
ykarelrlandy, asked Terry to look into it14:06
rlandyykarel: thank you - will add your comments to the bug14:11
ykarelrlandy,  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/851450 could be the culprit14:13
ykarelTerry is checking14:13
*** ysandeep|break is now known as ysandeep14:34
rlandypojadhav|rover: pls see https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status14:35
rlandywe need a rerun of periodic-tripleo-rhel-9-buildimage-ironic-python-agent-rhos-17.114:35
rlandybefore trying ovb14:35
chandankumarrlandy: let;s merge https://review.rdoproject.org/r/c/rdo-jobs/+/44461 to move cs8 component line to IBM cloud14:37
chandankumar*cs8 train14:38
rlandypojadhav|rover: marios|ruck: ^^ fyi14:38
rlandyc8 wallaby is looking good14:38
rlandyI;d like to merge this for train component line14:38
rlandychandankumar: pls check status in your morning and let's see what happens14:39
chandankumarrlandy: yes sure14:39
rlandychandankumar: w+'ed14:39
chandankumarrlandy: thanks :-)14:39
rlandychandankumar: we can assess the damage tomorrow morning14:39
chandankumarrlandy: I will take care of that :-)14:40
rlandychandankumar++ thank you14:40
marios|ruckthanks rlandy chandankumar 14:40
chandankumarsee ya people 14:46
rlandybhagyashris: I'm going to merge: https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/42405014:47
*** ysandeep is now known as ysandeep|out14:47
rlandybhagyashris: pls check if I missed something14:48
soniya29arxcruz, https://review.opendev.org/c/openstack/tempest/+/85274514:50
soniya29kopecmartin, ^^14:51
pojadhav|roverrlandy, posting patch for periodic-tripleo-rhel-9-buildimage-ironic-python-agent-rhos-17.115:03
dviroelrlandy: marios|ruck: fyi, I will file a bug for fips, started to fail today with a new gnutls package in baseos15:07
dviroelpojadhav|rover: ^15:08
marios|ruckdviroel: thanks it is blocker (not voting right? )15:08
dviroelyes, non-voting15:08
marios|ruckack thanks dviroel 15:09
marios|ruckcan you please ping when you have bug i can add to our hackmd dviroel 15:09
dviroelsure15:09
pojadhav|roverdviroel, ack15:14
* pojadhav|rover dinner15:14
rlandypojadhav|rover; marios|ruck: I am merging https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/42405015:17
rlandyto delete 17 on 815:17
rlandyif I mess something up, I'll revert15:17
marios|ruckrlandy: thanks 15:17
marios|ruckrlandy: do we need to sync or we OK - i have all the things i know about at https://hackmd.io/5zEei6JoTSmZ9mXlN5bxow?view15:18
marios|ruckrlandy: around for a little longer though not going right now15:18
rlandymarios|ruck: think we ar eok15:21
rlandyI am following up with terry re: fs035 failure15:21
rlandychecking fs002 failure15:21
marios|ruckthanks for your help rlandy 15:21
rlandychecking what we have in the gate blocker15:21
rlandymarios|ruck: fs002 has a real issue15:22
rlandyon master15:22
rlandyhttps://logserver.rdoproject.org/54/36254/146/check/periodic-tripleo-ci-centos-9-ovb-1ctlr_1comp-featureset002-master/22b7ab2/job-output.txt15:22
rlandyalso a package install issue15:23
rlandyhttps://logserver.rdoproject.org/54/36254/146/check/periodic-tripleo-ci-centos-9-ovb-1ctlr_1comp-featureset002-master/22b7ab2/logs/undercloud/home/zuul/build.log.txt.gz15:23
rlandymarios|ruck: I'll bug it for you15:23
rlandy2022-08-10 15:10:32.205 | >  Problem: package fence-agents-sbd-4.10.0-27.el9.noarch requires fence-agents-common = 4.10.0-27.el9, but none of the providers can be installed15:23
rlandy2022-08-10 15:10:32.205 | >   - cannot install both fence-agents-common-4.10.0-28.el9.noarch and fence-agents-common-4.10.0-27.el9.noarch15:23
rlandy2022-08-10 15:10:32.205 | >   - cannot install both fence-agents-common-4.10.0-27.el9.noarch and fence-agents-common-4.10.0-28.el9.noarch15:23
rlandy2022-08-10 15:10:32.206 | >   - package fence-agents-compute-4.10.0-28.el9.x86_64 requires fence-agents-common = 4.10.0-28.el9, but none of the providers can be installed15:23
rlandy2022-08-10 15:10:32.206 | >   - cannot install the best candidate for the job15:23
rlandydoes not show up in regular image build jobs15:24
marios|ruckrlandy: might be same/related to existing blocker for networkmaager (if mirror/sync/centos stream issue)15:25
marios|rucksame kind of trace but different package 15:25
marios|ruckpojadhav|rover: t-24 hours ;)15:28
marios|ruckysandeep|out: lets catchup about the nftables work tomorrow please discussed a bit with Tengu on cix call. especially we'd like to enable for scenario1 standalone master see if it nelps us with https://bugs.launchpad.net/tripleo/+bug/1983718 15:30
dviroelmarios|ruck: https://bugs.launchpad.net/tripleo/+bug/1984237 15:31
marios|ruckthanks dviroel 15:35
*** dviroel is now known as dviroel|lunch15:38
marios|ruckoff in a few mins rlandy o/ pojadhav|rover see you tomorrow15:44
rlandybye15:45
*** marios|ruck is now known as marios|out15:49
*** amoralej is now known as amoralej|off16:08
pojadhav|rovermarios|out, have a good night!16:09
pojadhav|roverrlandy, we have green run on build image on 17.1 https://code.engineering.redhat.com/gerrit/c/testproject/+/286307/26#message-09a359357bc37cbd79fe0b113aeb878e877f8d7216:13
rlandynice16:15
rlandyty16:15
pojadhav|roverrlandy, I am about to leave for the day, before EOD do you want me to look anything ?16:16
pojadhav|roverif nothing will catchup tomorrow morning..16:17
bhagyashrisrlandy, ack. i have started working on building 17.1 on rhel8 https://hackmd.io/kqJ-XcUeQ_24bjQ7pjTVJQ16:18
bhagyashriswill add all integration and component jobs tomorrow 16:19
rlandybhagyashris: great -thank you16:20
rlandypojadhav|rover: shoudl be fine - waiting on word from infra16:21
pojadhav|roverrlandy, ack16:21
pojadhav|roversee you tomorrow then16:21
*** pojadhav|rover is now known as pojadhav|out16:22
*** dviroel|lunch is now known as dviroel16:47
*** jpena is now known as jpena|off16:52
*** rlandy is now known as rlandy|mtg20:16
*** rlandy|mtg is now known as rlandy21:03
*** dviroel is now known as dviroel|out21:48
* dviroel|out /o/21:49
*** rlandy is now known as rlandy|bbl22:17

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!