*** rlandy is now known as rlandy|out | 00:29 | |
*** yadnesh|away is now known as yadnesh | 04:14 | |
*** pojadhav|out is now known as pojadhav|ruck | 04:51 | |
*** khomesh|away is now known as khomesh | 06:00 | |
marios | o/ | 06:03 |
---|---|---|
akahat | marios, chandankumar ysandeep can you please +w : https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/45898, https://review.rdoproject.org/r/c/rdo-jobs/+/46183 | 06:39 |
marios | akahat: k i will review 45898 | 06:40 |
akahat | thank you marios! | 06:41 |
marios | pojadhav|ruck: frenzy_friday|rover: o/ invite sent for quick sync please check inbox | 07:45 |
marios | in ~45 mins | 07:45 |
*** ysandeep is now known as ysandeep|afk | 08:02 | |
Tengu | rlandy|out: heya! after checking on some other things, it seems there's *already* a proxy endpoint for ansible-galaxy, for almost a year now: https://review.opendev.org/c/opendev/system-config/+/818787 | 08:04 |
Tengu | and, actually, you voted on its addition :). | 08:04 |
Tengu | so we have basically nothing to do but ensure we're using this endpoint in molecule setup/related. | 08:04 |
Tengu | have to check how to do that. | 08:04 |
Tengu | marios: -^^ you'll be interested as well I guess :) | 08:05 |
Tengu | (and hello there ;)) | 08:05 |
* Tengu braces himself and starts digging in ansible doc | 08:05 | |
chandankumar | marios: thank you for reviewing it https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/863590 is ready for +w | 08:09 |
*** yadnesh is now known as yadnesh|afk | 08:11 | |
pojadhav|ruck | marios, ack | 08:14 |
Tengu | chandankumar, pojadhav|ruck, marios: heya! quick question: do you happen to know the URI of the infra proxies? afaik those are the same as the repositories mirror. | 08:17 |
Tengu | is it something located in the /etc/ci/mirror_info.sh that seems to be available on the VM running the jobs? | 08:19 |
chandankumar | Tengu: yes it comes from /etc/ci/mirror_info.sh which gets available in vm in running job | 08:22 |
Tengu | got it. | 08:22 |
chandankumar | in RDO, we have this https://github.com/rdo-infra/rdo-jobs/blob/master/roles/mirror-info-fork/templates/mirror_info.sh.j2 | 08:22 |
Tengu | chandankumar: are the RDO proxies configured like the opendev ones? | 08:22 |
Tengu | ah. nope. it's not. | 08:23 |
Tengu | not the same endpoint. so it's probably lacking the ansible-galaxy. | 08:23 |
*** jpena|off is now known as jpena | 08:23 | |
chandankumar | Tengu: for ansible galaxy, we donot proxy anything | 08:23 |
Tengu | chandankumar: opendev infra has an endpoint already. so it's "just" a matter of using it | 08:24 |
Tengu | I'll discuss this today over the community CI call. | 08:24 |
chandankumar | sure :-) | 08:24 |
Tengu | I think I have most of the needed things. | 08:25 |
Tengu | chandankumar: care to point to the RDO proxy config? | 08:27 |
*** yadnesh|afk is now known as yadnesh | 08:27 | |
chandankumar | Tengu: I am not sure where is the config https://github.com/rdo-infra/rdo-jobs/blob/master/playbooks/base/pre.yaml#L33 is used for configuring mirror | 08:48 |
chandankumar | https://github.com/rdo-infra/rdo-infra-playbooks/blob/275e4c3d770f7e077a0fe386935ca6f739aed52a/doc/source/afs.rst and https://github.com/rdo-infra/rdo-infra-playbooks/blob/8ed05e8142729c20bc670c33037bfe9c1908eb40/hosts.yml#L18 | 08:48 |
chandankumar | not sure how much it will help | 08:48 |
chandankumar | regarding proxy config may be rdo infra people on #rhos-ops (internal) can help | 08:48 |
Tengu | chandankumar: hmm I'll try to find that configure-mirrors role. | 08:50 |
chandankumar | https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/configure-mirrors | 08:51 |
Tengu | yeah, found it (sorry, was on another issue) | 09:28 |
Tengu | ok, so that's "just" the package mirror. | 09:29 |
* pojadhav|ruck lunch | 09:29 | |
*** ysandeep|afk is now known as ysandeep | 09:36 | |
marios | chandankumar: ysandeep: when you next have time please review https://review.rdoproject.org/r/c/rdo-jobs/+/46147 | 09:38 |
ysandeep | marios, ack | 09:39 |
jm1 | hey folks :) | 09:45 |
marios | \o | 09:45 |
* marios food biab | 09:45 | |
* jm1 finally replaced and restored my two dead and dying hdds. data checksums and raid1 really payed off :D | 09:46 | |
*** rlandy|out is now known as rlandy | 11:05 | |
rlandy | jm1: hey - have a few mins to chat? | 11:07 |
chandankumar | marios: rlandy please +w this https://review.rdoproject.org/r/c/config/+/46208 depends on merged, when free, thank you :-) | 11:09 |
rlandy | marios: need to touch base with you .. pls ping when available | 11:09 |
rlandy | chandankumar: voted - looks ok | 11:10 |
marios | rlandy: o/ | 11:11 |
rlandy | frenzy_friday|rover: pojadhav|ruck: all set? how are thing with zed? | 11:11 |
rlandy | marios: hey ... https://meet.google.com/qhy-vchy-zee?pli=1&authuser=0 - will be quick | 11:11 |
marios | chandankumar: ack | 11:11 |
marios | rlandy: on my way | 11:11 |
frenzy_friday|rover | rlandy, fs64 fails consistently in zed with a couple of errors. I am runnning it in internal | 11:12 |
*** dviroel|afk is now known as dviroel | 11:12 | |
dviroel | o/ | 11:12 |
pojadhav|ruck | rlandy, d/stream is very much good. all reruns got passed. checking on upstream component lines. | 11:12 |
jm1 | rlandy: have 20 minutes | 11:21 |
rlandy | jm1: on call with marios - will ping you later | 11:23 |
jm1 | rlandy: ack :) | 11:23 |
rlandy | jm1: now ok? | 11:34 |
rlandy | marios: frenzy_friday|rover: pojadhav|ruck: any response from rhos-ops on why dowstream zuul is so slow? | 11:39 |
marios | rlandy: not to me | 11:40 |
pojadhav|ruck | rlandy, I (may be more folks from india too) am having znc bouncer issue, I am connecting/disconnecting to internal channels from couple of days. | 11:40 |
ysandeep | pojadhav|ruck: Our ZNC server is hitting some network issues, chandankumar have opened a ticket. In the meantime we are connecting directly to RH irc server without znc. | 11:42 |
pojadhav|ruck | ysandeep, okay i will also try the same | 11:43 |
pojadhav|ruck | thanks! | 11:43 |
rlandy | frenzy_friday|rover: I see the undercloud install error on fs064 internal | 11:43 |
rlandy | I was working on that last night | 11:43 |
* rlandy will try fix | 11:43 | |
frenzy_friday|rover | thanks | 11:44 |
* frenzy_friday|rover brb | 11:44 | |
rlandy | chandankumar: could you pls review https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/45898 | 11:50 |
rlandy | chandankumar: marios: are we ok to w+ https://review.rdoproject.org/r/c/rdo-jobs/+/46183? | 11:51 |
marios | rlandy: yes but has depends-on | 11:54 |
marios | chandankumar: rlandy: commented again, not blocking so i think you can workflow both | 12:00 |
chandankumar | akahat: ^^ do you want to split? | 12:00 |
marios | added w+ on 46183 | 12:00 |
marios | chandankumar: no need to split | 12:01 |
marios | lets go | 12:01 |
chandankumar | marios: ok | 12:01 |
marios | even a commit message update would be nice | 12:01 |
akahat | marios, chandankumar ok. | 12:01 |
marios | but i give up | 12:01 |
marios | akahat: /46183 failed because depends-on needs to merge first. when it does you can recheck /46183 | 12:03 |
* bhagyashris tea brb | 12:06 | |
akahat | updated commit message.https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/45898 | 12:12 |
akahat | revotes needed. | 12:12 |
kkula | hello frenzy_friday, any news about puppet promotion pipeline dashboard? | 12:14 |
*** frenzy_friday is now known as frenzy_friday|rover | 12:15 | |
frenzy_friday|rover | jm1, hey, if you get some time could you please check why https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46047 this dashboard is getting no data. I checked on the staging cockpit - in the panel edit mode the queries/datasource are wrong. But the dashboard jaon looks correct. Not sure what is happenning | 12:27 |
frenzy_friday|rover | hey folks, did anything merge recently related to tempest? I see a lot of jobs failing a bunch of tempest tests | 12:28 |
marios | o/ need reviews please when you have time https://review.rdoproject.org/r/c/rdo-jobs/+/46160 https://review.rdoproject.org/r/c/config/+/46161 (on review list) | 12:35 |
reviewbot | I have added your review to the Review list | 12:35 |
reviewbot | I have added your review to the Review list | 12:35 |
rlandy | bhagyashris: hello - sent you some info on pvt re: 18 | 12:44 |
rlandy | dlrn almost ready | 12:44 |
rlandy | but there is a consistent hash to get started | 12:45 |
bhagyashris | rlandy, hey sorry yesterday i lost my connection may be i missed your messages | 12:45 |
bhagyashris | rlandy, thanks for dlrn update | 12:46 |
rlandy | bhagyashris: let me resend | 12:47 |
frenzy_friday|rover | rlandy, marios I need some help with fs64 (on rdoproj) The errors seem inconsistent but it is failing since a long time . i have updated what I found on https://hackmd.io/Y9s_hAQVQhq5LUKk1lNKPw#Upstream-promotion-pipelines (Zed) | 12:51 |
marios | frenzy_friday|rover: no bug yet? | 12:53 |
frenzy_friday|rover | no, I cant figure out what exactly to bug. The erors are not consistent | 12:53 |
marios | frenzy_friday|rover: ah this is different to 'zed fs64 issue' you were chasing earlier? this is about -internal job/? | 12:53 |
frenzy_friday|rover | no, this is the fs64 on zed. rlandy is working on the internal fs64 on zed | 12:54 |
marios | frenzy_friday|rover: so internal failing in the same way as rdo then? | 12:54 |
marios | brb | 12:54 |
rlandy | iiuc, internal failed undercloud install | 12:56 |
frenzy_friday|rover | marios, fs64-zed-internal is failing at undercloud install (Ronelle is working to fix it) The fs64-zed on rdo jobs are running further and failing at overcloud deploy but with inconsistent failure reasons | 12:56 |
rlandy | rdo is failing overcloud install | 12:57 |
frenzy_friday|rover | lemme bug it anyways and put all the issues I see | 12:57 |
marios | frenzy_friday|rover: yes i think it would be useful, just file what you had can update later don't need the root cause to file it | 12:57 |
rlandy | frenzy_friday|rover: in rotating meetings | 13:01 |
rlandy | frenzy_friday|rover: is 64 the only thing blocking zed? | 13:01 |
rlandy | akahat: will be there in a few | 13:01 |
akahat | rlandy, ack | 13:02 |
rlandy | frenzy_friday|rover: have an open slot after current meeting | 13:03 |
frenzy_friday|rover | rlandy, ack thanks | 13:04 |
* dviroel coffee | 13:04 | |
*** dasm|off is now known as dasm | 13:05 | |
dasm | o/ | 13:05 |
dasm | marios: good catch wrt: https://review.opendev.org/c/openstack/tripleo-ci/+/865050/7/zuul.d/upgrades-jobs-templates.yaml#126 | 13:05 |
marios | frenzy_friday|rover: interesting 2022-11-28 05:42:41.408 23 ERROR keystone.server.flask.application [None req-6702189d-c417-4420-978c-56b09177cab5 87df88ae624449999249d291c465640a - - all default -] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. | 13:08 |
marios | https://logserver.rdoproject.org/openstack-periodic-integration-zed-centos9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset064-zed/9abdf8c/logs/overcloud1-controller-0/var/log/containers/keystone/keystone.log.txt.gz | 13:08 |
marios | frenzy_friday|rover: but lets have that bug so we can put info in one place | 13:08 |
marios | dasm: o/ | 13:08 |
dasm | marios: pushed the update. 8th time is a charm? ;) | 13:09 |
marios | ;) ack dasm will revisit thanks | 13:09 |
dasm | there are so many small quirks | 13:09 |
marios | yes | 13:09 |
marios | brb | 13:09 |
rlandy | dasm: hey - you're here!! | 13:10 |
rlandy | akahat: ^^ | 13:10 |
dasm | rlandy: o/ | 13:10 |
rlandy | dasm: just asked akahat to touch base with you re: promoter infra | 13:10 |
dasm | sure | 13:10 |
dasm | akahat: o/ | 13:10 |
akahat | dasm, o/ | 13:10 |
frenzy_friday|rover | marios, thanks. Updated https://bugs.launchpad.net/tripleo/+bug/1998211 | 13:11 |
rlandy | frenzy_friday|rover: out of 1-1 - do you need to meet re: fs064? | 13:11 |
akahat | dasm, need to talk about infra work. | 13:11 |
dasm | akahat: sure | 13:12 |
akahat | dasm, i'll set up call. | 13:12 |
dasm | ok | 13:12 |
frenzy_friday|rover | rlandy, yep, lets meet quickly | 13:12 |
rlandy | frenzy_friday|rover: https://meet.google.com/zjk-nmup-jwq?pli=1&authuser=0 | 13:13 |
akahat | dasm, In 15 mins ok? | 13:14 |
dasm | akahat: don't we have community call in 15? | 13:14 |
dasm | akahat: ah no. it's later. sure, in 15 works for me | 13:15 |
akahat | dasm, it's shifted. | 13:15 |
* ysandeep stepping out for ~1.5 hour, will be back before community call | 13:16 | |
*** ysandeep is now known as ysandeep|afk | 13:16 | |
*** amoralej is now known as amoralej|lunch | 13:22 | |
*** pojadhav|ruck is now known as pojadhav|out | 13:32 | |
rlandy | akahat: dasm: do you need me at the meeting? | 13:34 |
dasm | rlandy: i don't | 13:34 |
dasm | we can chat with akahat about details. thank you rlandy | 13:34 |
rlandy | k - need to skip - have a bunch of clashes | 13:34 |
rlandy | dviroel: hey - 6pm utc work for you - to meet this afternoon - re: MVP? | 13:41 |
rlandy | sent invite - feel free to change | 13:41 |
*** frenzy_friday|rover is now known as frenzy_friday|rover|food | 13:43 | |
dviroel | rlandy: works for me | 13:59 |
rlandy | akahat: arxcruz: bhagyashris: chandankumar: dviroel: frenzy_friday|rover|food: jm1: marios: rcastillo: dasm: ysandeep|afk: reminder community call in 14 mins | 14:46 |
rlandy | Tengu has added topics | 14:46 |
Tengu | (sorry ^^') | 14:47 |
Tengu | :) | 14:47 |
* dviroel will join in 3 min | 14:59 | |
marios | rlandy: please see pvt when you next get a chance (link to doc/comment) | 15:02 |
*** ysandeep|afk is now known as ysandeep | 15:20 | |
*** amoralej|lunch is now known as amoralej | 15:53 | |
ysandeep | chandankumar, hey around? | 15:56 |
*** dviroel is now known as dviroel|lunch | 16:11 | |
chandankumar | ysandeep: yes, | 16:12 |
ysandeep | chandankumar, ignore we hit the same podman issue you hit last week, its solved now | 16:14 |
ysandeep | earlier, i wanted to confirm the workaround you did.. later found in old irc chat | 16:15 |
chandankumar | ysandeep: anyway it's here also https://gitlab.cee.redhat.com/-/snippets/6011#LC2 | 16:15 |
ysandeep | chandankumar, thanks! | 16:19 |
ysandeep | folks o/ fyi.. I am on PTO tomorrow | 16:20 |
*** ysandeep is now known as ysandeep|out | 16:20 | |
chandankumar | frenzy_friday|rover|food: https://review.rdoproject.org/r/c/rdo-jobs/+/46289 merged this, i will not break anything, if you see any ansible galaxy installation issue do let me know! | 16:21 |
*** frenzy_friday|rover|food is now known as frenzy_friday|rover | 16:21 | |
frenzy_friday|rover | chandankumar, thanks | 16:21 |
rlandy | lunch - brb | 16:44 |
*** marios is now known as marios|out | 16:47 | |
*** dviroel|lunch is now known as dviroel | 17:12 | |
*** jpena is now known as jpena|off | 17:17 | |
*** amoralej is now known as amoralej|off | 18:38 | |
* dasm => offline | 21:39 | |
dasm | o/ | 21:39 |
*** dasm is now known as dasm|off | 21:39 | |
* dviroel out | 22:00 | |
*** dviroel is now known as dviroel|out | 22:00 | |
*** rlandy is now known as rlandy|out | 23:51 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!