*** rlandy|ruck|biab is now known as rlandy|ruck | 00:06 | |
*** rlandy|ruck is now known as rlandy|out | 00:30 | |
*** rcastillo is now known as rcastillo|out | 01:23 | |
*** ysandeep|out is now known as ysandeep|ruck | 04:33 | |
*** pojadhav- is now known as pojadhav | 05:22 | |
*** ysandeep|ruck is now known as ysandeep|afk | 05:52 | |
*** ysandeep|afk is now known as ysandeep|ruck | 06:15 | |
raukadah | \o | 06:51 |
---|---|---|
*** raukadah is now known as chandankumar | 06:51 | |
ysandeep|ruck | chandankumar, o/ welcome back! | 06:55 |
chandankumar | ysandeep|ruck: thanks :-) | 06:55 |
marios | o/ chandankumar :) | 07:05 |
*** ykarel__ is now known as ykarel | 07:08 | |
chandankumar | marios: \o, Thank you for getting the cs9 mirror patch merged and taking over cs9 work. :-) | 07:11 |
marios | chandankumar: o/ i didn't get the cs9 mirror merged it happened before you left i think :) ... mainly last 2 weeks was trying to pay some tech debt we had for repos in containers/images (https://issues.redhat.com/browse/TRIPLEOCI-717) | 07:13 |
*** ysandeep|ruck is now known as ysandeep|lunch | 07:23 | |
marios | chandankumar: o/ sorry got d/c some contractors flipped the electricity switch and internet went for a few misn | 07:32 |
marios | chandankumar: i may have missed if you typed something earlier | 07:33 |
marios | 09:13 < marios> chandankumar: o/ i didn't get the cs9 mirror merged it happened before you left i think :) ... mainly last 2 weeks was trying to pay some tech debt we had for repos in containers/images (https://issues.redhat.com/browse/TRIPLEOCI-717) | 07:33 |
chandankumar | marios: nope, nothing got missed, I am going through the tripleoci-717, :-) | 07:33 |
marios | chandankumar: just 2 patches now https://review.opendev.org/c/openstack/tripleo-ci/+/818222 https://review.opendev.org/c/openstack/tripleo-quickstart/+/817161 | 07:35 |
*** amoralej|off is now known as amoralej | 07:54 | |
*** ysandeep|lunch is now known as ysandeep | 08:28 | |
*** ysandeep is now known as ysandeep|ruck | 08:28 | |
chandankumar | ysandeep|ruck: \o, I am seeing couple of issues on cs9 pipeline, wanted to cross check for bugs, (I checked already on prod chain cix,no bugs there) | 08:41 |
chandankumar | 1. https://logserver.rdoproject.org/openstack-periodic-integration-main-cs9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-9-buildimage-ironic-python-agent-master/f83180b/build.log - Error: Unable to find a match: genisoimage | 08:41 |
chandankumar | 2. https://logserver.rdoproject.org/openstack-periodic-integration-main-cs9/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-undercloud-containers-master/0252076/job-output.txt - Cannot install ansible-core with a pre-existing ansible-base==2.10.15 | 08:42 |
chandankumar | marios: will go over those reviews, Thanks :-) | 08:42 |
marios | chandankumar: 1 is known issue but don't think we have a launcpad for it | 08:42 |
marios | chandankumar: we have bz sec | 08:43 |
marios | https://bugzilla.redhat.com/show_bug.cgi?id=1999713 chandankumar | 08:43 |
ysandeep|ruck | chandankumar, genisoimage still mentioned in dib: https://github.com/openstack/ironic-python-agent-builder/blob/master/dib/ironic-python-agent-ramdisk/package-installs.yaml#L15 | 08:43 |
ysandeep|ruck | chandankumar, regarding 2 sshnaidm have some patches up that will fix the issue, let me check status of them | 08:44 |
chandankumar | marios: thanks for passing, for ustream genisoimage issue tracking, will I open a launchpad bug and proppse the fix? | 08:45 |
marios | chandankumar: sure i didn't do anythign there | 08:45 |
chandankumar | ysandeep|ruck: thank you for the links . | 08:46 |
ysandeep|ruck | chandankumar, looks like fix was merged last night: https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/818354 , could you please rerun the job for the 2nd issue | 08:48 |
ysandeep|ruck | chandankumar, sshnaidm highlighted the geniso issue on Monday, fyi.. some discussion , you may find them useful - https://meetings.opendev.org/irclogs/%23oooq/%23oooq.2021-11-29.log.html#t2021-11-29T12:39:58 | 08:51 |
ysandeep|ruck | chandankumar, fyi.. we already had one previous cix: but that was closed https://trello.com/c/w6cdlyFc/2142-cixlp1946822tripleociproa-standalone-deployment-on-centos9-failing-during-python3-tripleoclient-dependencies-install-nothing-pro | 08:53 |
chandankumar | ysandeep|ruck: thank you for the cix link, I will open a bug and link it back to previous failures also and then propose the fix. | 09:03 |
chandankumar | s/failues/CIX | 09:03 |
ysandeep|ruck | ack | 09:04 |
marios | tripleo-ci please add to your reviews https://review.opendev.org/c/openstack/tripleo-ci/+/818222 https://review.opendev.org/c/openstack/tripleo-quickstart/+/817161 | 09:23 |
ysandeep|ruck | chandankumar, are these duplicate https://bugs.launchpad.net/tripleo/+bug/1953013 https://bugs.launchpad.net/tripleo/+bug/1953012 https://bugs.launchpad.net/tripleo/+bug/1953011 ? | 09:32 |
ysandeep|ruck | marios, ack | 09:33 |
chandankumar | ysandeep|ruck: yes, got created trice, marking them as a duplicate | 09:34 |
chandankumar | sorry for that | 09:34 |
chandankumar | thanks for pointing it out | 09:34 |
ysandeep|ruck | nw :) | 09:35 |
*** jbadiapa|off is now known as jbadiapa | 09:46 | |
marios | anyone know why my jobs aren't triggering here https://code.engineering.redhat.com/gerrit/c/testproject/+/295749/ what did i miss :) ... cant see them at https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status | 10:09 |
marios | ysandeep|ruck: ? ^ | 10:09 |
ysandeep|ruck | marios, checking | 10:10 |
marios | ysandeep|ruck: thanks ... i added the .gitreview (why dont we just merge that btw we should) | 10:10 |
marios | ysandeep|ruck: if you cant see something obvious dont worry i will keep digging | 10:11 |
marios | ysandeep|ruck: just wondering if i missed something for d/stream zuul | 10:12 |
marios | coffee refill | 10:16 |
ysandeep|ruck | marios, can you name that .zuul.yaml instead of zuul.yaml | 10:16 |
marios | ysandeep|ruck: sure can try (but have found earlier examples where it was just zuul.yaml e.g. https://code.engineering.redhat.com/gerrit/c/testproject/+/277478/) | 10:22 |
ysandeep|ruck | something else then :) | 10:23 |
marios | ysandeep|ruck: same.. it appears but then disappears at zuul status page it didn't like something | 10:23 |
marios | ysandeep|ruck: thanks for checking | 10:23 |
marios | 12:16 < ysandeep|ruck> marios, can you name that .zuul.yaml instead of zuul.yaml | 10:25 |
marios | sorry accidental paste | 10:25 |
ysandeep|ruck | crosschecked all those job are defined, may be worth pinging downstream infra.. they can check zuul server side logs.. zuul should report back to patch - what it didn't like. | 10:28 |
marios | ysandeep|ruck: thanks for sanity check on the job names ;) ack will do if i cant find something soon | 10:28 |
chandankumar | marios: ysandeep|ruck seen this error "msg": "stdout: AttributeError: 'NoneType' object has no attribute 'version_tuple'\n" ? | 10:29 |
chandankumar | https://logserver.rdoproject.org/97/36997/3/check/periodic-tripleo-ci-build-containers-centos-9-push-master/4b0d576/job-output.txt | 10:30 |
chandankumar | seeing just recent in my testproject | 10:30 |
marios | chandankumar: not seen that | 10:30 |
ysandeep|ruck | chandankumar, not seen that.. fyi.. We are not monitoring c9 lines till we move image build/container build to use release content... | 10:31 |
marios | chandankumar: yeah so we have put everything else on hold until we fix to use the proper repos... maybe try with 818222 in depends-on? | 10:35 |
marios | chandankumar: e.g. for collectd i had to enable opstools repo with https://review.opendev.org/c/openstack/tripleo-ci/+/818222/47/roles/tripleo-build-jobs-repos/tasks/main.yaml#16 | 10:35 |
chandankumar | marios: ysandeep|ruck ok, sure | 10:40 |
sshnaidm | marios, hey, I wonder if we should install tripleo-repos into virtualenv of quickstart, like we do now with other collections: https://github.com/openstack/tripleo-quickstart/blob/master/install-deps.sh#L296 | 10:45 |
sshnaidm | marios, the default path seems to be not in ansible.cfg: https://review.opendev.org/c/openstack/tripleo-quickstart/+/820143 | 10:46 |
marios | sshnaidm: sure .. you mean move from //github.com/openstack/tripleo-quickstart/blob/master/install-deps.sh#L296 to where the others are installed? | 10:54 |
sshnaidm | marios, in second thought, it will require virtualenv to be set up firstly and it's done only in quickstart.sh.. Ok, probably my patch should be enough | 10:57 |
*** dviroel|out is now known as dviroel | 11:01 | |
*** rlandy|out is now known as rlandy|ruck | 11:12 | |
rlandy|ruck | marios: I triggered a downstream check | 11:18 |
dviroel | chandankumar: welcome back o/ | 11:18 |
rlandy|ruck | ysandeep|ruck: arxcruz|rover: hey - let | 11:19 |
rlandy|ruck | s sync | 11:20 |
ysandeep|ruck | arxcruz|rover, ack o/ | 11:20 |
rlandy|ruck | https://meet.google.com/vzm-nrah-qqf?authuser=0 | 11:20 |
rlandy|ruck | ysandeep|ruck: arxcruz|rover: ^^ | 11:21 |
ysandeep|ruck | rlandy|ruck, https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/295769 | 11:22 |
ysandeep|ruck | rlandy|ruck, https://review.rdoproject.org/r/c/rdoinfo/+/36977 | 11:22 |
rlandy|ruck | sshnaidm: hi - can we recheck the jenkins tests now? ansible path issue | 11:29 |
sshnaidm | rlandy|ruck, I'm investigating it in https://review.opendev.org/c/openstack/tripleo-quickstart/+/820146 | 11:30 |
sshnaidm | need more debug msgs | 11:31 |
marios | dviroel: o/ replied at https://review.opendev.org/c/opendev/base-jobs/+/820018/3#message-3f2489964b12345c86fea94e05bad37453a5e931 i think we have to stick to ID /VERSION_ID | 11:52 |
marios | dviroel: and replied again ;) | 11:57 |
dviroel | marios: | 11:59 |
dviroel | marios: yeah, me too | 11:59 |
dviroel | marios: now there is a issue, OS_VERSION_ID does no exists | 12:00 |
marios | dviroel: i also updated it :) | 12:00 |
marios | dviroel: that's what you get for editing in the browser... fixign | 12:00 |
dviroel | lolz | 12:01 |
marios | dviroel: k done | 12:01 |
*** pojadhav is now known as pojadhav|afk | 12:01 | |
dviroel | ++ | 12:01 |
marios | dviroel: i guess if nothing else the conditional reads nicer now for the humans | 12:01 |
marios | dviroel: functionally its the same | 12:01 |
dviroel | marios: yes | 12:02 |
dviroel | marios: since VERSION_ID={{ ansible_distribution_major_version }} | 12:02 |
dviroel | marios: you will not have issues like 9.x | 12:02 |
marios | right so why do they need to do the cut -d thing... anyway | 12:02 |
dviroel | marios: may legacy code, don't know | 12:03 |
dviroel | maybe* | 12:03 |
ysandeep|ruck | rlandy|ruck, fyi.. retriggered bm line here: https://review.rdoproject.org/r/c/testproject/+/32054 | 12:24 |
rlandy|ruck | ysandeep|ruck; great - thanks | 12:34 |
chandankumar | dviroel: thanks :-) | 12:39 |
ysandeep|ruck | rlandy|ruck, arxcruz|rover have you noticed any similiar issue:- | 12:43 |
ysandeep|ruck | ~~~ | 12:43 |
ysandeep|ruck | 2021-12-02 12:27:37.880072 | primary | TASK [repo-setup : Check DLRN hash format] ************************************* | 12:43 |
ysandeep|ruck | 2021-12-02 12:27:37.880292 | primary | Thursday 02 December 2021 12:27:37 +0000 (0:00:00.155) 0:00:16.160 ***** | 12:43 |
ysandeep|ruck | 2021-12-02 12:27:37.921679 | primary | fatal: [undercloud]: FAILED! => {"changed": false, "msg": "The DLRN hash or tag is not recognized. The hash or tag should not contain path slashes."} | 12:43 |
ysandeep|ruck | ~~~ | 12:43 |
ysandeep|ruck | https://logserver.rdoproject.org/46/28446/57/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-ussuri/8625a47/job-output.txt | 12:43 |
rlandy|ruck | ysandeep|ruck: no - | 12:44 |
ysandeep|ruck | ack, will investigate | 12:44 |
sshnaidm | rlandy|ruck, does job tripleo-quickstart-gate-master-tripleo-ci-delorean-full-featureset052 run on centos 7? | 12:51 |
sshnaidm | and "minimal" too? | 12:52 |
rlandy|ruck | sshnaidm: minimal gets kicked from promotions | 12:52 |
rlandy|ruck | so there is a c7 promotion | 12:53 |
rlandy|ruck | for fs052 | 12:53 |
rlandy|ruck | that gets kicked from tq/tqe changes | 12:53 |
rlandy|ruck | so that should be master | 12:53 |
sshnaidm | I mean the node OS | 12:54 |
*** pojadhav|afk is now known as pojadhav | 12:54 | |
sshnaidm | We run quickstart on centos 7 nodes | 12:54 |
sshnaidm | That's why it didn't work.. I can add collections install for c7 too, didn't think we use it somewhere | 12:54 |
sshnaidm | but can't we run on centos 8 nodes? c7 support is expensive | 12:55 |
ysandeep|ruck | sshnaidm, we still have train on c7 | 12:56 |
ysandeep|ruck | i mean a parallel line but still we have train on c7 | 12:57 |
sshnaidm | ysandeep|ruck, yeah, but tripleo-quickstart-gate-master-tripleo-ci-delorean-full-featureset052 is "master" | 12:59 |
sshnaidm | at least it's named so | 13:00 |
bhagyashris | chandankumar, rlandy|ruck soniya29 crum meeting time | 13:01 |
sshnaidm | bhagyashris, what is the scrum mtg link? | 13:02 |
ysandeep|ruck | sshnaidm, https://meet.google.com/xxq-vevp-vkd?authuser=0 | 13:02 |
sshnaidm | ysandeep|ruck, thanks | 13:02 |
sshnaidm | I don't have scrum in my calendar.. | 13:02 |
ysandeep|ruck | sshnaidm, sry i misunderstood - I thought we have issue with quickstart with C7(I thought our train c7 jobs will also fail now), +1 to move those jobs to C8 | 13:08 |
sshnaidm | ysandeep|ruck, tbh I would check train c7 jobs as well if they are fine | 13:09 |
ysandeep|ruck | i just checked.. looks okay(last run yesterday): https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-integration-stable4-centos7 | 13:09 |
bhagyashris | https://review.opendev.org/c/openstack/tripleo-ci/+/816991 | 13:12 |
dviroel | https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/36911 | 13:23 |
dviroel | https://hackmd.io/G6b1q7wDSImTMTlKgPP75w?view | 13:25 |
sshnaidm | tripleo-quickstart-gate-master-tripleo-ci-delorean-ruck-rover-test-featureset-minimal is running on CentOS 7 node as well, should be replaced to 8 | 13:26 |
*** amoralej is now known as amoralej|off | 13:28 | |
*** rcastillo|out is now known as rcastillo | 13:32 | |
marios | reviews please https://review.opendev.org/c/openstack/tripleo-ci/+/818222 https://review.opendev.org/c/openstack/tripleo-quickstart/+/817161 https://review.opendev.org/c/opendev/base-jobs/+/820018 | 13:37 |
marios | sanity testproject @ https://code.engineering.redhat.com/gerrit/c/testproject/+/295749 | 13:38 |
pojadhav | reviews please : https://review.rdoproject.org/r/c/rdo-jobs/+/36718 | 13:40 |
pojadhav | https://review.opendev.org/c/openstack/tripleo-ci/+/818765 | 13:41 |
pojadhav | https://review.rdoproject.org/r/c/rdo-jobs/+/36959 | 13:41 |
rcastillo | https://review.rdoproject.org/r/c/testproject/+/36988 | 13:41 |
bhagyashris | https://review.rdoproject.org/r/c/rdo-jobs/+/36974 | 13:42 |
rcastillo | https://review.rdoproject.org/r/c/rdo-jobs/+/36974 | 13:42 |
* pojadhav will be out for doctor's appointment. | 13:48 | |
*** pojadhav is now known as pojadhav|afk | 13:48 | |
ysandeep|ruck | https://review.opendev.org/q/topic:%22featureset064%22+(status:open%20OR%20status:merged) | 13:50 |
chandankumar | rlandy|ruck: marios sshnaidm https://paste.openstack.org/raw/811403/ ubi9 beta, It has issues with local pulling Error: Source image rejected, We can use once it is publically available. | 14:03 |
rlandy|ruck | chandankumar: ack | 14:03 |
marios | thanks chandankumar | 14:11 |
*** ysandeep|ruck is now known as ysandeep|afk | 14:14 | |
sshnaidm | chandankumar, just tried and it worked for me, maybe vpn..? | 14:16 |
ysandeep|afk | marios, pojadhav|afk arx/me will be ending our rr week tomorrow (+ arx is on PTO starting next week)- I will send a rr handover meeting tomorrow so that you can start next week. rlandy|ruck fyi.. | 14:19 |
ysandeep|afk | arxcruz|rover, ^^ | 14:20 |
*** ysandeep|afk is now known as ysandeep | 14:20 | |
rlandy|ruck | ysandeep: perfect - thanks | 14:20 |
marios | ysandeep: ack | 14:20 |
chandankumar | sshnaidm: with or without vpn, same issue | 14:20 |
chandankumar | sshnaidm: you are pulling from this registry.access.redhat.com/ubi9-beta/ubi:latest ? | 14:20 |
chandankumar | I am on fedora 35 | 14:21 |
chandankumar | podman 3.4.2 | 14:21 |
sshnaidm | chandankumar, https://paste.opendev.org/show/811406/ | 14:21 |
chandankumar | weired | 14:22 |
*** amoralej|off is now known as amoralej | 14:22 | |
ysandeep | marios, pojadhav|afk rlandy|ruck arxcruz|rover invite for rr sync sent.. Please feel free to propose a new time if that doesn't work with your schedule. | 14:25 |
*** ysandeep is now known as ysandeep|afk | 14:27 | |
chandankumar | sshnaidm: figured out https://github.com/containers/buildah/issues/3659 and https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/9-beta/html-single/9.0_release_notes/index#known-issue_containers | 14:28 |
chandankumar | now pull is working | 14:28 |
sshnaidm | chandankumar, hmm, interesting, I don't have these beta keys.. | 14:39 |
*** ysandeep|afk is now known as ysandeep | 15:12 | |
jfrancoa | ysandeep|afk: hey, one doubt. how could I get access to the environment from a testproject run: https://review.rdoproject.org/r/c/testproject/+/36859 ? | 15:12 |
rlandy|ruck | jfrancoa, you can recheck that job | 15:21 |
rlandy|ruck | we will add your keys once it starts | 15:21 |
rlandy|ruck | and then hold that node | 15:21 |
jfrancoa | rlandy|ruck: I did recheck it a while ago. could you add them please? https://github.com/jfrancoa.keys | 15:22 |
jfrancoa | rlandy|ruck: dciabrin has provided me with a patch that might give a hint on why my upgrade fails with DISK_FULL, but he would like to jump into the env once if finishes | 15:23 |
rlandy|ruck | there is a merged failed | 15:24 |
rlandy|ruck | let me recheck | 15:24 |
rlandy|ruck | This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset. | 15:25 |
rlandy|ruck | jfrancoa: it's complaining about rebase | 15:27 |
rlandy|ruck | ^^ | 15:27 |
rlandy|ruck | I rebased the top patch | 15:27 |
rlandy|ruck | but it's likely one of the depends-on | 15:27 |
jfrancoa | rlandy|ruck: oh, thanks..I'm going to review that | 15:28 |
rlandy|ruck | jfrancoa: once you have a running patch - ping and I'll add your keys and hold your node | 15:28 |
ysandeep | rlandy|ruck, i rekicked https://review.rdoproject.org/r/c/testproject/+/32054 for metalsmith fix, was killed in vexx outage | 15:30 |
* ysandeep out for the day | 15:34 | |
*** ysandeep is now known as ysandeep|out | 15:34 | |
marios | rlandy|ruck: i think i'll workflow -1 @ https://review.opendev.org/c/openstack/tripleo-ci/+/818222 until we sort out the d/stream stuff | 15:38 |
rlandy|ruck | marios: ack - thanks | 15:41 |
rlandy|ruck | sorry - bit scattered atm | 15:42 |
marios | rlandy|ruck: np i did the wf-1 there | 15:43 |
jfrancoa | rlandy|ruck: I think I fixed it: https://review.rdoproject.org/r/c/testproject/+/36859 could you add the keys and hold the node? (also, I'll need some hints on how to jump into the node or at least the credentials) | 15:50 |
rlandy|ruck | job is still queued | 15:50 |
rlandy|ruck | will add when job starts | 15:51 |
jfrancoa | rlandy|ruck: ack, thank you very much | 16:09 |
rlandy|ruck | jfrancoa: I will leave you a PM with the login | 16:11 |
jfrancoa | rlandy|ruck: great, I appreciate a lot (as I'll have to close in a few) | 16:11 |
chandankumar | see ya! | 16:12 |
*** chandankumar is now known as raukadah | 16:12 | |
*** tosky_ is now known as tosky | 16:17 | |
*** marios is now known as marios|out | 16:35 | |
ade_lee | dviroel, so it looks like it finally came back as passed :) so now just scenario 4 | 16:50 |
dviroel | ade_lee: +1 | 17:01 |
*** amoralej is now known as amoralej|off | 17:32 | |
rlandy|ruck | lunch - brb | 18:19 |
*** dviroel is now known as dviroel|afk | 19:53 | |
rlandy|ruck | 2021-12-02 22:05:49.722527 | primary | [WARNING]: Found both group and host with same name: undercloud | 22:17 |
rlandy|ruck | 2021-12-02 22:05:50.306298 | primary | ERROR! couldn't resolve module/action 'authorized_key'. This often indicates a misspelling, missing collection, or incorrect module path. | 22:17 |
rlandy|ruck | sshnaidm: hey ... ansible fall out? https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_5f8/817425/1/gate/tripleo-ci-centos-7-content-provider/5f87ba1/job-output.txt | 22:18 |
rlandy|ruck | https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-7-content-pro | 22:18 |
rlandy|ruck | https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-7-content-provider | 22:18 |
rlandy|ruck | failing since yesterday | 22:18 |
rlandy|ruck | logging bug | 22:20 |
rlandy|ruck | sshnaidm: https://review.opendev.org/c/openstack/tripleo-quickstart/+/820170/ fixes ^^ | 23:11 |
rlandy|ruck | merging unless objections | 23:11 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!