Tuesday, 2021-06-22

weshay|ruckysandeep|out, you around?02:51
*** ykarel|away is now known as ykarel04:45
*** marios is now known as marios|ruck05:15
*** ysandeep|out is now known as ysandeep06:11
*** amoralej|off is now known as amoralej07:14
anbanerj|roverMorning marios|ruck 07:30
anbanerj|roverOpened a new bug yesterday - https://bugs.launchpad.net/tripleo/+bug/1933115 - checking this (it is in skiplist)07:31
*** jpena|off is now known as jpena07:37
marios|rucko/ anbanerj|rover 07:38
marios|ruckanbanerj|rover: thanks07:39
marios|ruckanbanerj|rover: filed new one today         * https://bugs.launchpad.net/tripleo/+bug/193319307:39
marios|ruckanbanerj|rover: affects tripleo-ci only so far (possibly will hit tripleo-upgrade but nowhere else)07:39
marios|ruckanbanerj|rover: for https://bugs.launchpad.net/tripleo/+bug/1933115 was it only once?07:40
marios|ruckanbanerj|rover: i see just one trace there - try to always include at least 2 07:40
anbanerj|rovermarios|ruck, No it failed 7-8 times consecutively . Adding another log to the bug07:41
marios|ruckanbanerj|rover: ack yes please 07:41
*** ykarel is now known as ykarel|lunch07:50
*** ykarel|lunch is now known as ykarel09:08
*** dviroel|out is now known as dviroel11:20
* anbanerj|rover lunch11:24
*** jpena is now known as jpena|lunch11:36
chandankumarsshnaidm, hello, please have a look at https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/782362 when free, thanks!11:48
chandankumarand this also https://review.opendev.org/c/openstack/tripleo-quickstart/+/79070111:49
dviroelchandankumar: hi o/11:49
chandankumardviroel, hello \o11:50
dviroelchandankumar: regarding the yum-config module, i was taking a look at 'dnf module' command11:50
dviroelchandankumar: so, I'll change everything related to modules to use subprocess11:50
dviroeland it won't be based on config files change anymore11:51
dviroelseems more appropriate11:51
dviroelwe can also add the install/remove packages operation, along with the stream and enabled/disable operations11:51
dviroelwdyt?11:52
dviroelor there is some scenario that we still need to manually change the *.module files?11:53
chandankumardviroel, https://dnf.readthedocs.io/en/latest/use_cases.html11:53
chandankumardviroel, dnf provides python api interfaces, we can use that directly 11:53
dviroelchandankumar: oh, this is great11:54
* dviroel deletes code11:54
chandankumardviroel, some baked stuff https://github.com/mwhahaha/rhos-bootstrap/blob/main/rhos_bootstrap/utils/dnf.py11:54
chandankumarit will help in your implementtion11:54
sshnaidmchandankumar, shouldn't be "become: true" in https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/782362/15/roles/container-build/tasks/non_tripleo_containers.yml#99 ?11:57
sshnaidmchandankumar, I don't see anything with 'buildah images' on standalone host, only with sudo11:57
dviroelchandankumar: tks for the tips11:58
*** ykarel_ is now known as ykarel12:02
chandankumarsshnaidm, nope, we donot need become:true, as we are pulling the containers as a normal user for non-tripleo containers12:02
chandankumarso buildah will list down all the containers which are pulled by podman12:03
* anbanerj|rover back12:05
weshay|ruckmarios|ruck, 0/ let's look at this together at 1-1 https://review.rdoproject.org/r/c/testproject/+/34256/1/.zuul.yaml12:13
marios|ruckweshay|ruck: k 12:13
sshnaidmchandankumar, can we test this patch somehow?12:22
chandankumarsshnaidm, let me put a dnm patch and see12:22
sshnaidmchandankumar, we run them as root, you can see "become: true" in line 97, I missed it12:25
chandankumaroh no, how I missed that12:27
*** amoralej is now known as amoralej|lunch12:28
*** ChanServ changes topic to "Docs: https://docs.openstack.org/tripleo-quickstart/latest/ || 3rd Apr Important promoter patch https://review.rdoproject.org/r/25931"12:30
*** jpena|lunch is now known as jpena12:31
rlandyweshay|ruck: ysandeep: https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/24937612:42
rlandy17 common and tripleo components have not promoted in a while12:43
rlandytripleo may promote with ^^12:43
rlandycommon needs a rerun12:43
ysandeeprlandy: voted, thanks!13:05
rlandythank you13:05
*** marios|ruck is now known as marios|ruck|call13:10
bhagyashrisarxcruz, zbr, sshnaidm, rlandy, marios|ruck|call , ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, weshay|ruck , chandankumar, frenzy_friday, dviroel anbanerj|rover 13:20
bhagyashrisTripleO CI Community Meeting in 9 mins13:21
bhagyashrisfeel free to add agenda at line 32 https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg?both#2021-06-22-Community-call13:21
*** amoralej|lunch is now known as amoralej13:23
*** marios|ruck|call is now known as marios|ruck13:25
rlandyysandeep: weshay|ruck: one more for 17 ... https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/249389 Add missing scenario001 common component test for rhos-17 13:27
ysandeeprlandy, nice catch, its is criteria but not in template13:29
rlandyysandeep: weshay|ruck: pls review ... https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/797146 clear deploy for 17 BM and OVB13:30
rlandythere are if ... else conditions13:30
rlandyso should be a no-op for upstream13:30
bhagyashriszbr, https://meet.google.com/bqx-xwht-wky?authuser=013:32
bhagyashriscommunity meeting13:32
bhagyashrisplz join13:32
zbrtx13:32
ysandeeprlandy: ack will review after community call13:33
rlandythanks'13:33
*** marios|ruck is now known as marios|ruck|call13:34
*** marios|ruck|call is now known as marios|ruck14:00
anbanerj|roverweshay|ruck, marios|ruck, https://bugs.launchpad.net/tripleo/+bug/1933115 - looks like it started failing after this got merged - https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/787718 . Do we need to aff "subnet_types" here - https://opendev.org/openstack/openstacksdk/src/branch/master/openstack/network/v2/subnet.py#L30 ?14:01
marios|ruckanbanerj|rover: will check after in tripleo meet now14:07
rlandysshnaidm: ysandeep: apevec asked about our hitting metadata service on OVB rather than config drive14:14
rlandyI know we looked into it a while back 14:14
rlandywhen downstream was failing and we patched that in other ways14:15
sshnaidmrlandy, what's the question?14:15
rlandysshnaidm: ysandeep: any other thoughts wrt using config drive?14:15
rlandysshnaidm: ysandeep: according to infra, we're hitting metadata service hard in vexxhost hence VM startup failures14:16
sshnaidmrlandy, iirc we try metadata and if it doesn't work - looking at config drive (or vice versa)14:16
sshnaidmhard? that's news14:16
* rlandy looms for code link14:17
rlandylooks14:17
sshnaidmrlandy, that's where we ask metadata: https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/ovb-manage/tasks/find_undercloud_uuid.yml#L2-L1614:17
sshnaidmcurl http://169.254.169.254/openstack/latest/meta_data.json14:18
rlandyright - thanks14:18
sshnaidmand it's only once in a job14:18
rlandyyeah 14:18
rlandyOVB retries a lot14:18
sshnaidmprobably it's something different hit them..14:18
ysandeepthat's my understanding: config drive as backup if metadata is unreachable.. 14:19
sshnaidmyep14:19
rlandysshnaidm: ysandeep: thanks 14:19
sshnaidmyou can switch maybe..14:19
rlandysshnaidm: I don;t know we are there yet14:20
rlandyjust discussing14:20
sshnaidmok14:20
rlandyon rhos-ops14:23
*** ykarel is now known as ykarel|away14:35
ysandeeprlandy: hey o/ do we have a test patch where we tested https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/797146 in internal?14:38
arxcruzweshay|ruck: rlandy https://github.com/gvalkov/tailon14:40
rlandyysandeep: ack ... getting14:40
arxcruzweshay|ruck: http://38.102.83.131/quay/master.txt14:41
rlandyhttps://sf.hosted.upshift.rdu2.redhat.com/logs/72/190672/60/check/periodic-tripleo-ci-rhel-8-bm_envA-3ctlr_1comp-featureset035-rhos-17/cd74dca/logs/undercloud/home/zuul/containers-prepare-parameter.yaml14:41
rlandyysandeep: ^^14:41
* ysandeep looking14:42
rlandyysandeep: see passing deploy there14:42
rlandyin the same logs14:42
*** marios|ruck is now known as marios|ruck|call14:44
*** marios|ruck|call is now known as marios|ruck14:44
ysandeepthanks! looks good to me .. without this patch custom container are missing14:46
akahatmarios|ruck, rlandy arxcruz please review: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/3419614:49
marios|ruckack akahat 14:49
*** ysandeep is now known as ysandeep|out14:57
weshay|ruckcomponent pipeline updates on all-hands fyi15:02
marios|ruckweshay|ruck: anbanerj|rover: /me leaving after this all-hands need sthing?15:46
anbanerj|rovermarios|ruck, all good from my side. When you get some time tomorrow - https://bugs.launchpad.net/tripleo/+bug/1933115 - I have updated it15:49
marios|ruckanbanerj|rover: ack thanks noting15:50
weshay|ruckmarios|ruck, are you refreshing https://review.rdoproject.org/r/c/testproject/+/34256 w/ agg hash?15:53
weshay|ruckoh see comments15:53
marios|ruckweshay|ruck: just started running i updated it already 15:54
marios|ruckweshay|ruck: for some reason it didn't run when i posted v215:54
*** marios|ruck is now known as marios|out16:00
weshay|ruckanbanerj|rover, who is working on https://bugs.launchpad.net/tripleo/+bug/193319317:07
weshay|ruckarxcruz++ re: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/797432 and os-ansible patch17:11
arxcruzyay, it worked 17:13
zbris anyone aware of a bug where `pip install python-nss` fails to compile on fedora?17:19
weshay|rucknot i17:22
weshay|ruckzbr, qq back at you17:24
weshay|ruckhave you seen       file /usr/lib/rpm/ansible-generator conflicts between attempted installs of ansible-2.9.21-1.el8.noarch and ansible-macros-2021.1.2-1.el8.noarch17:24
weshay|ruckis that just a packaging hiccup?17:24
zbrhmm, i never heard of these two ansible things "generator" and "macros"..., time to learn something new?17:25
weshay|ruckrlandy, would not have expected this...17:30
weshay|ruckansible.noarch                              2.9.20-1.el8                              @quickstart-centos-ceph-pacific    17:30
rlandypulling ansible from ceph repo17:31
rlandyme neither17:31
rlandyin downstream we specify an ansible repo17:31
*** amoralej is now known as amoralej|off17:31
rlandyin upstream, not sure17:31
*** jpena is now known as jpena|off17:32
rlandyweshay|ruck: have a job link?17:37
rlandyrepo priorities?17:37
weshay|ruckrlandy, added links to https://bugs.launchpad.net/tripleo/+bug/193319317:37
rlandylooking17:37
weshay|ruckrlandy, we have versioned deps now too17:39
rlandythose logs don;t capture the etc/ dir17:41
rlandyhttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_32f/796812/2/check/tripleo-tox-molecule/32f76c0/zuul-info/inventory.yaml is all we can see17:41
rlandyansible.noarch                              2.9.20-1.el8                              @quickstart-centos-ceph-pacific 17:44
rlandyweird17:44
rlandyweshay|ruck: ok so the standalone job has yum.repos.d access17:45
rlandyhttps://0caa56a8fe761affce01-dc55dfdaf5877a4d04198310cb0fd46a.ssl.cf2.rackcdn.com/periodic/opendev.org/openstack/tripleo-ci/master/tripleo-ci-centos-8-standalone/36762b4/logs/undercloud/etc/yum.repos.d/index.html17:46
rlandyin the case that we don't set an ansible repo17:46
rlandywhere should it come from?17:46
weshay|ruckit's coming from deps17:46
rlandycentos and drln17:46
weshay|ruckrefresh the bug17:46
rlandyyeah17:48
rlandybut if both repos and enabled17:49
rlandyand there is a newer rpm17:49
zbrI ended up filing https://bugzilla.redhat.com/show_bug.cgi?id=197489017:49
zbrthe impact on us is not direct, but it prevents us from properly updating official requirements17:50
weshay|ruckzbr, hey18:03
weshay|ruckthis is running on stream8 right? https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_32f/796812/2/check/tripleo-tox-molecule/32f76c0/tox/reports.html18:03
weshay|ruckzbr, can I see the centos repos it has?18:04
weshay|ruckdoes it have epel?18:04
weshay|ruckmoving that job to non-voting18:05
weshay|ruckhttps://dl.fedoraproject.org/pub/epel/8/Everything/x86_64/Packages/a/ansible-2.9.21-1.el8.noarch.rpm18:05
zbrlooking...18:05
zbryes, is using image: quay.io/pycontribs/centos:stream8 18:06
zbrnot sure how old is that but is stream818:06
zbr4mo old is too old? https://quay.io/repository/centos/centos?tab=tags18:07
zbrinteresting bit is that we can already start testing stream9, you see?18:07
weshay|ruckzbr, hey..  we need to turn epel off in that container18:08
weshay|ruckzbr, how?18:08
zbrweshay|ruck: add a playbook in roles/tripleo-repos/molecule/default/prepare.yml that disables epel18:08
weshay|ruckzbr, https://quay.io/repository/pycontribs/centos/manifest/sha256:d1c995c244438b4082a26f048a996cc7c4c0754409bb10d4becce735020a919a18:09
weshay|ruckzbr, there is no prepare18:10
zbrweshay|ruck: lest me add a CR18:10
zbri know, because we did not need one so far.18:10
weshay|ruckmudda fuckas18:11
weshay|ruckzbr, anything using https://quay.io/repository/pycontribs/centos/manifest/sha256:d1c995c244438b4082a26f048a996cc7c4c0754409bb10d4becce735020a919a needs epel turned off18:12
zbrweshay|ruck: there is another way of doing it: i can remove that line from the image and not install epel-release at all.18:13
zbrweshay|ruck: those images are under *our* control, well mine.18:13
weshay|ruckcan you add a prepare.yml that does it?18:14
zbralready did, running locally to test it, uploading after it does pass.18:15
weshay|ruckzbr, anbanerj|rover how we doing here? https://review.opendev.org/c/opendev/elastic-recheck/+/729623/ 18:19
weshay|ruckrlandy, you are done w/ 16.2 component pipeline testing re: container updates correct? I can take this off my watch list? https://code.engineering.redhat.com/gerrit/c/testproject/+/18944018:22
rlandyyeah - I think so18:23
weshay|ruckzbr, /me updated commit-msg18:23
weshay|ruckrlandy, thanks18:24
weshay|ruckzbr, thanks18:27
rlandyweshay|ruck: name for centos8 stream dep line base on latest compose?18:38
rlandyopenstack-dependencies-centos-8-stream-compose18:38
weshay|ruckdon't care18:38
* zbr out for the day18:50
weshay|ruckzbr, fyi.. that didn't work19:10
weshay|ruckzbr, https://zuul.openstack.org/status#79752819:11
eaglesis there a known issue with tripleo-tox-molecule on the tripleo-ci repo?19:44
rlandyhttps://bugs.launchpad.net/tripleo/+bug/193319319:57
eaglesrlandy: ack thanks!19:57
*** dviroel is now known as dviroel|out20:59
*** njohnston_ is now known as njohnston21:07
weshay|ruckrlandy, sshnaidm woot http://38.102.83.131/22:18
rlandynice22:20
rlandyat least upstream throws a reasonable error22:21
rlandyany guess why downstream is failing in ovb22:21
rlandysome metadata service issues 22:21
rlandybut not all22:22
weshay|ruckrlandy, well.. at least we have baremetal :)22:22
rlandyweshay|ruck: yep22:22
rlandylucky that22:22
rlandywe should think about what configurations we want with the new hardware22:22
rlandywoohoo - triple component should promote for 1722:24
rlandyand then we are clean there22:24
rlandyone patch left multinode fs01022:25

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!