*** rlandy|dentist is now known as rlandy|ruck | 00:10 | |
*** rlandy|ruck is now known as rlandy|out | 00:31 | |
*** ysandeep|out is now known as ysandeep | 05:36 | |
jpodivin | arxcruz|ruck: Hi. Are tracking the ansible-lint that's breaking tox-linters anywhere? https://zuul.opendev.org/t/openstack/build/b8a5e08035714a68825dfb609234c7cc | 07:56 |
---|---|---|
arxcruz|ruck | jpodivin: https://review.opendev.org/q/topic:%22a-lint%22+(status:open%20OR%20status:merged) | 08:00 |
jpodivin | arxcruz|ruck++ awesome. I'm patching VF repos now https://review.opendev.org/q/topic:%22ansiblelintbump%22+(status:open%20OR%20status:merged) | 08:02 |
*** amoralej|off is now known as amoralej | 08:06 | |
*** ysandeep is now known as ysandeep|afk | 08:21 | |
*** jpena|off is now known as jpena | 08:36 | |
chandankumar | marios: frenzy_friday you might be hitting with retry_limit on cs9 ovb jobs due to ovs upgrade happening on vexxhost cloud | 08:40 |
chandankumar | context: 500 error with router attach | 08:40 |
marios | chandankumar: thank you | 08:41 |
*** ysandeep|afk is now known as ysandeep | 08:47 | |
frenzy_friday | chandankumar, thanks | 08:48 |
*** pojadhav- is now known as pojadhav | 08:54 | |
marios | chandankumar: do you have examples of fs2 for tempest timeout (like https://logserver.rdoproject.org/67/36267/44/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-master/a1a7959/logs/undercloud/var/log/tempest/stestr_results.html.gz | 09:02 |
marios | chandankumar: i am looking at https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-ovb-1ctlr_1comp-featureset002-master&project=testproject but cant see timeouts there | 09:02 |
chandankumar | marios: I have not faced any timeouts in fs02 | 09:02 |
marios | chandankumar: ah ok thank i thought you were seeing the same tempest issues for fs2 | 09:03 |
chandankumar | marios: https://logserver.rdoproject.org/13/36713/23/check/periodic-tripleo-ci-centos-9-ovb-1ctlr_1comp-featureset002-master/ee2e466/logs/undercloud/var/log/tempest/stestr_results.html.gz | 09:10 |
chandankumar | marios: is also present in fs01 | 09:10 |
marios | chandankumar: ok but i think might be different bugs not sure yet as the fs1 one fails a bunch of compute tests | 09:10 |
marios | chandankumar: thanks noting for now | 09:10 |
chandankumar | marios: https://launchpad.net/bugs/1957031 from full-tempest-api | 09:11 |
chandankumar | is also present in fs01 but with different reason | 09:11 |
marios | chandankumar: k.. its going to be confusing :) | 09:11 |
marios | chandankumar: thanks | 09:11 |
chandankumar | soniya29: can you also take a look at https://launchpad.net/bugs/1957031 one also | 09:13 |
frenzy_friday | chandankumar, is Attach instance to public OVB network - Failed to attach network adapter device to 626003ac-09f8-4f66-8655-d930fb2f8ddd a known issue? (fs020 c9 is hitting this now) | 09:14 |
chandankumar | frenzy_friday: yes, already reported to dpwalik happening due to ovs upgrade happening on vexxhost side | 09:15 |
frenzy_friday | ohh, you were talking about this one, got it thanks | 09:15 |
soniya29 | chandankumar, looking | 09:18 |
marios | chandankumar: fyi https://bugs.launchpad.net/tripleo/+bug/1957060 | 09:28 |
chandankumar | marios: interesting thanks :-) | 09:29 |
chandankumar | marios++++++++++++++++++++ | 09:29 |
marios | chandankumar: :) | 09:34 |
soniya29 | marios, can you revote on this patch - https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/815654 whenever you have time? | 10:35 |
soniya29 | arxcruz|ruck, ^^ | 10:36 |
arxcruz|ruck | soniya29: tempest_run: 'yes' is it required ? | 10:36 |
*** ysandeep is now known as ysandeep|coffee | 11:01 | |
chandankumar | marios: party time | 11:07 |
chandankumar | marios: dib patch is merged now | 11:07 |
marios | chandankumar: /me throws glitter | 11:07 |
marios | :) | 11:07 |
* chandankumar plays music | 11:08 | |
chandankumar | someone prepare the dance floor | 11:08 |
marios | we need pizz | 11:08 |
marios | pizza | 11:08 |
chandankumar | rlandy|out: is coming online , she can order fresh for all of us | 11:08 |
arxcruz|ruck | marios: pizza + beer | 11:08 |
marios | my kind of party | 11:08 |
*** rlandy|out is now known as rlandy|ruck | 11:09 | |
marios | good morning rlandy|out give us pizza and beer or give us death | 11:09 |
marios | its a revolt | 11:09 |
chandankumar | https://i.pinimg.com/originals/4f/da/94/4fda94f12bc67d853f6693e1b36062f8.gif | 11:09 |
rlandy|ruck | sure order pizza | 11:09 |
marios | :) | 11:10 |
* rlandy|ruck sends credit card | 11:10 | |
rlandy|ruck | OH ... dib patch is merged now | 11:11 |
rlandy|ruck | AMAZING | 11:11 |
arxcruz|ruck | rlandy|ruck: let me know when you wanna sync | 11:11 |
chandankumar | marios: we can move fs01 to the pipeline | 11:11 |
chandankumar | and fs02 also | 11:12 |
rlandy|ruck | chandankumar: syncing with arxcruz|ruck - will join review time in a bit | 11:14 |
rlandy|ruck | will ping you | 11:14 |
marios | chandankumar: not yet i mean tempest bug for fs1 and others for fs2? | 11:14 |
chandankumar | sure | 11:14 |
marios | chandankumar: i don't think we can skip all those compute tests for fs1 yet | 11:14 |
marios | chandankumar: need someone from compute to dig a bit | 11:14 |
rlandy|ruck | arxcruz|ruck: https://meet.google.com/uzn-bxqy-azb?pli=1&authuser=0 | 11:15 |
chandankumar | marios: for fs02, https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/824119 I am moving one test to skip list | 11:16 |
chandankumar | and get the fs02 in the integration line to have some coverage of ovb | 11:16 |
chandankumar | what do you say? | 11:17 |
chandankumar | for fs01, we can wait till the tests gets fixed | 11:17 |
marios | chandankumar: sounds good | 11:17 |
chandankumar | arxcruz|ruck: dviroel|out https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/824119 | 11:17 |
chandankumar | please use your super power | 11:18 |
rlandy|ruck | arxcruz|ruck: https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/302535 | 11:19 |
*** dviroel|out is now known as dviroel | 11:23 | |
rlandy|ruck | https://review.opendev.org/c/openstack/tripleo-quickstart/+/824056 | 11:24 |
rlandy|ruck | akahat: hi - meeting you booked today is a clashing with two other meetings | 11:43 |
*** ysandeep|coffee is now known as ysandeep | 11:43 | |
rlandy|ruck | can you reschedule? or I'll have to join later | 11:44 |
akahat | rlandy|ruck, okay. I'll move it. | 11:44 |
rlandy|ruck | amoralej: hello | 11:44 |
rlandy|ruck | amoralej: dasm has been working on the wallaby c9 standalone | 11:45 |
rlandy|ruck | I think he sent you an email re: failures on puppet-pacemaker | 11:45 |
rlandy|ruck | per the last EL9 meeting, you were expecting some failures ... is that still the case? | 11:46 |
rlandy|ruck | should we create LP bugs to track or are you tracking the wallaby failures elsewhere? | 11:46 |
rlandy|ruck | chandankumar: meet now? | 11:46 |
chandankumar | rlandy|ruck: yes joining | 11:46 |
amoralej | rlandy|ruck, lemme check | 11:47 |
rlandy|ruck | amoralej: thank you | 11:47 |
chandankumar | rlandy|ruck: https://bugs.launchpad.net/tripleo/+bug/1957060 | 11:49 |
rlandy|ruck | rcastillo|rover; hey can you rebase https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/302681 | 12:00 |
rlandy|ruck | merge conflict | 12:00 |
rlandy|ruck | then we can merge that | 12:00 |
amoralej | rlandy|ruck, dasm https://review.rdoproject.org/r/c/puppet/puppet-pacemaker-distgit/+/37975 | 12:00 |
amoralej | missing backport | 12:00 |
amoralej | we only test puppet-pacemaker in tripleo, it's not covered in packstack or p-o-i, so yes, expected | 12:00 |
rlandy|ruck | amoralej: what's the best way to track all of these missing backports? | 12:02 |
amoralej | you are using any etherpad or similar? | 12:02 |
rlandy|ruck | amoralej: we'll start a hackmd | 12:02 |
rlandy|ruck | dasm: ^^ | 12:02 |
rlandy|ruck | and we'll share with you | 12:02 |
ysandeep | chandankumar, rlandy|ruck fix for ansible-lint in downstream http://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/303020 | 12:02 |
ysandeep | and looks like gerrit is down again :( | 12:03 |
rlandy|ruck | ysandeep: we just merged a patch to do that | 12:03 |
rlandy|ruck | get gerrit down | 12:03 |
amoralej | we have 5 of 7 jobs passing on packstack and p-o-i | 12:03 |
ysandeep | rlandy|ruck, nw, I should have added you in review list earlier | 12:04 |
rlandy|ruck | amoralej: great | 12:04 |
ysandeep | rlandy|ruck, just in case please check ^^ once gerrit is back.. we have used a different approach. | 12:05 |
rlandy|ruck | akahat: hey ... we want to merge https://review.opendev.org/q/topic:%22lp1950916%22+(status:open%20OR%20status:merged) - can you paste the testproject where you reverted the release file as well and tested | 12:09 |
rlandy|ruck | the testproject link we have has been resued for another depends-on | 12:09 |
akahat | rlandy|ruck, https://review.rdoproject.org/r/c/testproject/+/36394 this is the test project.. i've tested jobs.. but most of them are failing. | 12:10 |
rlandy|ruck | akahat: thanks - that should be good | 12:12 |
akahat | rlandy|ruck, okay.. np. | 12:13 |
rlandy|ruck | akahat: we w+'ed https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/822344 | 12:13 |
rlandy|ruck | can you update the depends on on the other two patches | 12:13 |
rlandy|ruck | then we can w+ those | 12:13 |
akahat | rlandy|ruck, okay. on it. | 12:14 |
rlandy|ruck | thank you | 12:14 |
akahat | thank you rlandy|ruck chandankumar. | 12:14 |
akahat | rlandy|ruck, this looks good u can +w it: https://review.opendev.org/c/openstack/tripleo-ci/+/818904 | 12:17 |
chandankumar | https://review.rdoproject.org/r/c/puppet/puppet-pacemaker-distgit/+/37975 | 12:20 |
rlandy|ruck | ysandeep: hey - can tel with dead gerrit - did the glance patches merge for 16.2? | 12:29 |
rlandy|ruck | can we promte? | 12:29 |
ysandeep | rlandy|ruck, no they were not merged(when I last checked in afternoon), some glance downstream ci check jobs are failing | 12:31 |
*** beagles is now known as beagles-afk | 12:33 | |
rlandy|ruck | chandankumar: did you keep a list of reviews that were needed for master? | 12:46 |
rlandy|ruck | may help with guessing at wallaby backports | 12:47 |
chandankumar | rlandy|ruck: we backported all of them | 12:47 |
rlandy|ruck | chandankumar: ah ok | 12:47 |
chandankumar | for tripleo ansible tht and tripleoclient and | 12:47 |
chandankumar | tripleo-common | 12:47 |
chandankumar | We might missed few for image build | 12:47 |
rlandy|ruck | chandankumar: I think rcastillo|rover had image build working | 12:48 |
chandankumar | rlandy|ruck: please follow up on this https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/824136/1#message-8c12b90f37a2469434aceec4702db5c76e2b897a with steve, it will unblock rcastillo|rover | 12:48 |
rlandy|ruck | so that should be ok | 12:48 |
rlandy|ruck | ok | 12:48 |
rlandy|ruck | saw that - thanks | 12:48 |
chandankumar | rlandy|ruck: https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/824097 please +w it just a rebase | 12:48 |
rlandy|ruck | done | 12:49 |
rlandy|ruck | ysandeep: https://one.redhat.com/legacy/outages/list/details/61dd719cd3e04f10a80305a2 | 12:51 |
rlandy|ruck | may have hit gerrit | 12:51 |
ysandeep | rlandy|ruck, thanks, yes as per mail on outage list | 12:52 |
rlandy|ruck | arxcruz|ruck: rcastillo|rover: ^^ downstream gerrit | 12:52 |
dasm | o/ | 13:00 |
*** amoralej is now known as amoralej|lunch | 13:04 | |
dasm | amoralej|lunch: rlandy|ruck asked me to create hackmd with found roadblocks: https://hackmd.io/txgCFi5IRIqUOPOD8ekquA if you would prefer other way of notifying you, please let me know. | 13:12 |
rlandy|ruck | dasm: looks good | 13:13 |
rlandy|ruck | you can add that to the EL9 meeting status jira ticket | 13:13 |
rlandy|ruck | chandankumar already put his status | 13:13 |
dasm | chandankumar: i don't see your update on OSPPRODCH-229 is there another ticket used? | 13:18 |
bhagyashris | arxcruz, sshnaidm, rlandy, rlandy|ruck, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, chandankumar, frenzy_friday, anbanerj, dviroel, rcastillo, dasm, jm1, rlandy|ruck arxcruz|ruck rcastillo|rover | 13:22 |
bhagyashris | Tengu, | 13:22 |
bhagyashris | TripleO CI Community Call in 8 mins | 13:22 |
Tengu | yup :) | 13:23 |
bhagyashris | feel free to add topics in agenda https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg?both#2022-01-11-Community-Call @ line 30 | 13:23 |
bhagyashris | https://meet.google.com/bqx-xwht-wky?authuser=0 | 13:23 |
chandankumar | dasm: ysandeep feel free to update the EL9 status https://issues.redhat.com/browse/OSPPRODCH-229?focusedCommentId=19578736&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-19578736 | 13:27 |
dasm | chandankumar: ack. will do. | 13:28 |
chandankumar | we have got cs9 wallaby integration line up https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-integration-stable1-cs9 | 13:29 |
bhagyashris | rlandy|ruck, chandankumar soniya29 ysandeep ^ | 13:30 |
chandankumar | Tengu: thank you for sharing :-) | 13:56 |
Tengu | chandankumar: np :). I'll do some cleaning for the container builder thing and create some github repo for it. | 13:57 |
Tengu | have to jump on some other call now, not sure how long it will be.... So probably for tomorrow | 13:57 |
Tengu | and right now I'm hitting some weird issue with the DIB thing and repositories. probably an easy thing to squash, but still - I have to squash it :) | 13:58 |
dasm | chandankumar: i'm working on standalone-wallaby. i forced a build of new images within my job. the job failed while building. do you have a few to check that with me? https://review.rdoproject.org/zuul/build/33a49633bbaa40d9baba8fd280bb4efc/log/logs/undercloud/home/zuul/container_image_build.log.txt.gz?severity=0 | 13:59 |
frenzy_friday | jm1, thanks for updating the servers! ++ | 14:01 |
chandankumar | dasm: https://logserver.rdoproject.org/61/37861/3/check/periodic-tripleo-ci-centos-9-standalone-wallaby/33a4963/logs/undercloud/home/zuul/container-builds/1a98e2fd-c964-4453-bc1f-e67e363b851b/base/base-build.log.txt.gz | 14:01 |
chandankumar | Error: Could not run transaction. | 14:02 |
dasm | mhm. that's usually when something else has a lock on the db, am i right? is "recheck" sufficient here? | 14:02 |
chandankumar | dasm: yes | 14:03 |
chandankumar | dasm: one more thing you donot need to build containers also | 14:03 |
dasm | thanks. any idea why it went to "bdb_ro"? | 14:03 |
chandankumar | dasm: need to check that one why it coming | 14:03 |
dasm | i don't? | 14:03 |
dasm | the change i need to use got merged like 0.5h ago | 14:03 |
dasm | this: https://review.rdoproject.org/r/c/puppet/puppet-pacemaker-distgit/+/37975 | 14:03 |
rlandy|ruck | arxcruz|ruck: rcastillo|rover: on meeting for a few - will ping to sync with you | 14:05 |
rcastillo|rover | rlandy|ruck: k | 14:05 |
dasm | chandankumar: my understanding was i needed to force the build to get a new image. previous ones were failing with missing files. | 14:05 |
arxcruz|ruck | rlandy|ruck: can it be in a few minutes? my daughter went to take the vaccine today, but my wife forgot her vaccination card, i'll deliver and come back quickly | 14:05 |
*** amoralej|lunch is now known as amoralej | 14:05 | |
rlandy|ruck | arxcruz|ruck: ping when you are back | 14:06 |
rlandy|ruck | arxcruz|ruck: rcastillo|rover: we have a new bug as well | 14:06 |
amoralej | dasm, that's fine, add new issues there and let me know if you find any | 14:07 |
dasm | amoralej: thanks. i'll keep you updated | 14:07 |
chandankumar | dasm: yes correct, you can force the build to get the new content | 14:09 |
dasm | chandankumar: ack, thx | 14:10 |
dviroel | chandankumar: fyi, composes dependency job is now passing with new DLRN release | 14:14 |
chandankumar | dasm: I am trying to reproduce the above issue locally | 14:20 |
dasm | any success? | 14:20 |
dasm | (one day i'm gonna need to learn how to run it locally) | 14:21 |
rcastillo|rover | dasm: chandankumar the bdb_ro error we were running into in the compose job because we were basing images off ubi8 | 14:24 |
marios | rlandy|ruck: fyi https://bugs.launchpad.net/tripleo/+bug/1957060 should hit cix at some point | 14:25 |
*** akahat_ is now known as akahat | 14:25 | |
chandankumar | dtripleo container image build --base ubi8 --debug --distro centos --exclude neutron-mlnx-agent --namespace tripleowallabycentos9 --prefix openstack --push --registry 127.0.0.1:5001 --tag 6f44cd7b11681051b9762037dc86ca79 --volume /etc/yum.repos.d:/etc/distro.repos.d:z --volume /etc/pki/rpm-gpg:/etc/pki/rpm-gpg:z --volume | 14:25 |
dasm | rcastillo|rover: ack. | 14:25 |
chandankumar | --base ubi8 | 14:26 |
chandankumar | rcastillo|rover: thank you for highligthing that | 14:26 |
dviroel | rcastillo|rover++ | 14:26 |
dasm | rcastillo|rover: is there any way forward? or temporary workaround? | 14:27 |
rcastillo|rover | dasm: setting containers_base_image: quay.io/centos/centos:stream9 would help | 14:28 |
dasm | rcastillo|rover: ack. lemme see where should i use that. in zuul.d yaml? | 14:29 |
rlandy|ruck | marios: ack - thanks | 14:29 |
marios | chandankumar: rlandy|ruck: fyi https://review.opendev.org/q/hashtag:c9voting | 14:29 |
rcastillo|rover | dasm: yeah | 14:29 |
dasm | ack, thanks! | 14:29 |
dasm | rcastillo|rover++ | 14:29 |
arxcruz|ruck | rlandy|ruck: rcastillo|rover back | 14:30 |
chandankumar | dasm: https://review.rdoproject.org/r/c/testproject/+/37861/3/.zuul.yaml it will help | 14:31 |
dasm | \o/ i was about to do exactly that :) | 14:31 |
dasm | thanks chandankumar++ | 14:31 |
rlandy|ruck | arxcruz|ruck: rcastillo|rover: woohoo victoria is promoting | 14:32 |
rcastillo|rover | \o/ | 14:32 |
rlandy|ruck | rcastillo|rover: let's sync | 14:32 |
chandankumar | dasm: for reproducing locally these kind of issues, here is what I do: | 14:33 |
chandankumar | 1. Pull the stream 9 container | 14:33 |
chandankumar | 2. download all the repo files from here https://logserver.rdoproject.org/61/37861/3/check/periodic-tripleo-ci-centos-9-standalone-wallaby/33a4963/logs/undercloud/etc/yum.repos.d/ | 14:33 |
chandankumar | 3. Run the commands from the dockerfile https://logserver.rdoproject.org/61/37861/3/check/periodic-tripleo-ci-centos-9-standalone-wallaby/33a4963/logs/undercloud/home/zuul/container-builds/1a98e2fd-c964-4453-bc1f-e67e363b851b/base/Dockerfile.gz | 14:34 |
rlandy|ruck | rcastillo|rover: https://meet.google.com/scp-cwzh-dyg?pli=1&authuser=0 | 14:34 |
dasm | chandankumar: thanks! | 14:35 |
rlandy|ruck | arxcruz|ruck: you back? | 14:35 |
arxcruz|ruck | rlandy|ruck: yes | 14:36 |
rlandy|ruck | arxcruz|ruck: pls join ^^ | 14:36 |
rlandy|ruck | arxcruz|ruck: rcastillo|rover: https://bugs.launchpad.net/tripleo/+bug/1957083 | 14:37 |
arxcruz|ruck | rcastillo|rover: can you paste me the hackmd ? | 14:45 |
rcastillo|rover | arxcruz|ruck: https://hackmd.io/OeHukWRuSSuRTtq3Fb7akw | 14:46 |
rlandy|ruck | 23 days agoclientspromoted-components5 hours ago | 14:46 |
*** beagles-afk is now known as beagles | 14:48 | |
dasm | chandankumar: i just noticed your comment 2h ago on the osp jira ticket. Strange I didn't have it before. Probably some cache or something. I see youmentioned standalone work in progress, so I'm not gonna comment on that further. | 14:59 |
chandankumar | dasm: you can now mention about standalone update there | 15:02 |
dasm | ack | 15:02 |
chandankumar | just removed standalone part | 15:02 |
dasm | haha. i didn't mean that :) | 15:03 |
chandankumar | np :-) | 15:03 |
rlandy|ruck | dasm: hey - let's sync for a few minutes before the el9 call ... https://meet.google.com/sdx-gbbq-hbz?pli=1&authuser=0 | 15:26 |
*** dviroel is now known as dviroel|lunch|errand | 15:29 | |
rlandy|ruck | ysandeep: any other status for el9 meeting? | 15:29 |
ysandeep | rlandy|ruck, rhel9 - container build done, image build - in progress | 15:29 |
* ysandeep waiting for gerrit to comes back up to continue :) | 15:30 | |
rlandy|ruck | ysandeep: ack - thanks | 15:32 |
ysandeep | rlandy|ruck, added comment to url also which chandan gave, but I don't have invite to el9 mtg. | 15:33 |
rlandy|ruck | ysandeep: on rhos meetings | 15:34 |
rlandy|ruck | you can just join | 15:34 |
rlandy|ruck | in 10 minutes | 15:34 |
ysandeep | rlandy|ruck: I see, thanks! | 15:35 |
rlandy|ruck | arxcruz|ruck: rcastillo|rover: see #vexxhost - "failing to attach ports" error on OVB should be g=fixed by upgrade | 15:39 |
rlandy|ruck | we hope | 15:39 |
arxcruz|ruck | ok | 15:39 |
rlandy|ruck | arxcruz|ruck: rcastillo|rover: downstream gerrit is back | 15:56 |
rlandy|ruck | rcastillo|rover: merging https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/302681 | 15:59 |
rlandy|ruck | frenzy_friday: hey - how are you doing?? | 16:07 |
*** rlandy|ruck is now known as rlandy|ruck|brb | 16:19 | |
*** ysandeep is now known as ysandeep|out | 16:23 | |
*** sshnaidm is now known as sshnaidm|afk | 16:23 | |
*** rlandy|ruck|brb is now known as rlandy|ruck | 16:35 | |
rlandy|ruck | dasm: still failing standalone? | 16:40 |
Tengu | chandankumar: fyi: https://github.com/cjeanner/tripleo-tools that's the place I'll push my tooling. There are already 2 tools in there, in case you want to play. | 16:51 |
*** dviroel|lunch|errand is now known as dviroel | 17:18 | |
*** jpena is now known as jpena|off | 17:38 | |
*** amoralej is now known as amoralej|off | 17:38 | |
dasm | rlandy|ruck: last one failed. i'm looking at this right now. amoralej showed me how to check that. | 17:39 |
rlandy|ruck | ok - cool | 17:58 |
rlandy|ruck | dviroel: any idea's what's happening with c9 tests upstream | 18:55 |
rlandy|ruck | rcastillo|rover: hey ... all ok by you | 18:58 |
rlandy|ruck | multinode-ipa still hosing the gate | 18:58 |
* dviroel check | 19:03 | |
dviroel | rlandy|ruck: which ones you looking? | 19:06 |
rlandy|ruck | dviroel: ? | 19:07 |
rlandy|ruck | c9 tests | 19:07 |
* rlandy|ruck gets | 19:07 | |
dviroel | yes | 19:07 |
rlandy|ruck | image build ones seem to be in retry_limit | 19:07 |
dasm | oh, it might be me. i have "build_containers" forced in my testproject. | 19:08 |
rlandy|ruck | dviroel: but it's only two patches | 19:08 |
dviroel | rlandy|ruck: isn't fips patch? fips patch is failing in all c9 | 19:08 |
rlandy|ruck | dviroel: https://zuul.opendev.org/t/openstack/status | 19:09 |
rlandy|ruck | so maybe it's valid | 19:09 |
rlandy|ruck | using release file | 19:09 |
rlandy|ruck | so I think it's probably just a patch thing | 19:09 |
rcastillo|rover | rlandy|ruck: I thought standalone-ipa was the issue? | 19:12 |
rlandy|ruck | it is in the gate | 19:15 |
rlandy|ruck | rcastillo|rover: w+'ed both your patches for the ussuri registry | 19:22 |
rcastillo|rover | rlandy|ruck: great, thx | 19:29 |
rlandy|ruck | rcastillo|rover: will ask arxcruz|ruck to report on the program call - way early for you | 19:33 |
rcastillo|rover | thanks for that | 19:33 |
rlandy|ruck | rcastillo|rover: you can take the CIX call | 19:34 |
rcastillo|rover | sure thing | 19:35 |
rlandy|ruck | will run through card status with you in the morning | 19:35 |
rcastillo|rover | ok | 19:37 |
dasm | amoralej|off: unfortunately your change didn't solve the issue. it seems like the package for puppet-pacemaker hasn't been built. I see the same hash for last job runs: 9f2e6f10a4883041cc3a086ee85be807af6bd4a0 which corresponds to last commit ID on the repo: https://opendev.org/openstack/puppet-pacemaker/commit/9f2e6f10a4883041cc3a086ee85be807af6bd4a0 it corresponds to data from | 19:42 |
dasm | https://trunk.rdoproject.org/centos9-wallaby/report.html | 19:42 |
dasm | amoralej|off: please let me know if i'm missing something | 19:42 |
dasm | this is latest job: https://review.rdoproject.org/zuul/build/3899251d55d54730b9f60e39373e7855/logs | 19:43 |
* dasm => break | 19:48 | |
* rlandy|ruck looks | 19:55 | |
rlandy|ruck | dasm: hey ... | 20:01 |
rlandy|ruck | dasm: hey ... https://trunk.rdoproject.org/centos9-wallaby/component/tripleo/9f/2e/9f2e6f10a4883041cc3a086ee85be807af6bd4a0_f099ad8b/ looks correct | 20:01 |
rlandy|ruck | https://logserver.rdoproject.org/61/37861/5/check/periodic-tripleo-ci-centos-9-standalone-wallaby/3899251/logs/undercloud/etc/yum.repos.d/delorean-current.repo.txt.gz | 20:02 |
rlandy|ruck | dasm: ^^ try bring in current there | 20:02 |
rlandy|ruck | so edit your release file | 20:02 |
rlandy|ruck | https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/CentOS-9/promotion-testing-hash-wallaby.yml#L114 | 20:03 |
rlandy|ruck | add puppet-pacemaker to that list | 20:03 |
jm1 | rlandy|ruck chandankumar: guide to update idrac firmware https://github.com/JM1/shelp/blob/master/idrac.md | 20:04 |
rlandy|ruck | run standalone with building containers (use the var we discussed yesterday) | 20:04 |
rlandy|ruck | jm1++ nice - thank you | 20:04 |
rlandy|ruck | dasm: right now ... puppet-pacemaker.noarch 1.3.1-0.20211224184837.9f2e6f1.el9 @delorean-component-tripleo | 20:05 |
rlandy|ruck | https://logserver.rdoproject.org/61/37861/5/check/periodic-tripleo-ci-centos-9-standalone-wallaby/3899251/logs/undercloud/var/log/extra/package-list-installed.txt.gz | 20:06 |
rlandy|ruck | ysandeep|out: ^^ you can give jm1's guide a shot | 20:06 |
rlandy|ruck | dviroel: hey - https://review.opendev.org/c/openstack/tripleo-ci/+/824157/ still failing openstack-tox-linters | 20:12 |
rlandy|ruck | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_e77/823989/1/check/openstack-tox-linters/e771055/job-output.txt | 20:12 |
rlandy|ruck | were there any outstanding patches on tripleo-ci | 20:12 |
rlandy|ruck | know you edited tripleo-quickstart patch | 20:13 |
dviroel | openstack-tox-linters - success | 20:13 |
dviroel | https://zuul.openstack.org/status | 20:13 |
dviroel | just failed on tripleo-tox-molecule | 20:13 |
rlandy|ruck | sorry tripleo-tox-molecule | 20:13 |
dviroel | looking | 20:13 |
rlandy|ruck | https://67744c8fa84bfaea9e15-3a08f5dd30775d36f5503265ac08cfa4.ssl.cf5.rackcdn.com/824157/2/check/tripleo-tox-molecule/70af1c3/job-output.txt | 20:14 |
rlandy|ruck | couldn't resolve module/action 'community.docker.docker_container' | 20:14 |
dviroel | humm | 20:15 |
rlandy|ruck | dviroel; worth a rerun? | 20:19 |
dviroel | rlandy|ruck: running on my machine now, lets see | 20:21 |
dviroel | rlandy|ruck: https://zuul.openstack.org/builds?job_name=tripleo-tox-molecule&project=openstack%2Ftripleo-ci | 20:21 |
dviroel | 2 failures | 20:21 |
rlandy|ruck | hmmm ... could be another update | 20:22 |
rlandy|ruck | got to get this patch though | 20:22 |
rlandy|ruck | to unblock the gate | 20:22 |
rlandy|ruck | https://zuul.opendev.org/t/openstack/status#openstack/tripleo-ci | 20:23 |
rlandy|ruck | no other tripleo-ci jobs running in the queue atm | 20:24 |
rlandy|ruck | only on that patch | 20:27 |
dviroel | yes | 20:27 |
dviroel | weird | 20:28 |
rlandy|ruck | rcastillo|rover: ^^ you can join the fun | 20:28 |
rlandy|ruck | maybe submit another dummy tripeo-ci patch and see if we get the same error | 20:28 |
rlandy|ruck | dviroel: what happened on your local run | 20:28 |
dviroel | rlandy|ruck: 1 success, did a cleanup on my env, running again to double check | 20:29 |
rlandy|ruck | dviroel: trying another patch | 20:29 |
dviroel | Success again, will checkout the patch now | 20:33 |
rlandy|ruck | ysandeep|out: https://code.engineering.redhat.com/gerrit/c/cinder/+/301330 still not through | 20:39 |
rlandy|ruck | will report on program call | 20:39 |
rlandy|ruck | re: 16.2 glance | 20:39 |
rlandy|ruck | rcastillo|rover: you around? | 20:44 |
rlandy|ruck | we need to fix this | 20:44 |
* dasm <= break | 20:46 | |
rlandy|ruck | rcastillo|rover: dviroel: https://meet.google.com/rgg-ocmc-dtm?pli=1&authuser=0 | 20:46 |
rlandy|ruck | dasm: hey - left you some notes above | 20:47 |
dasm | checking | 20:47 |
dasm | rlandy|ruck: ok, will try that. thanks | 20:48 |
rcastillo|rover | rlandy|ruck: sorry, had to step away for a moment | 21:00 |
rlandy|ruck | rcastillo|rover: updated https://review.opendev.org/c/openstack/tripleo-ci/+/824233 | 21:01 |
rlandy|ruck | rerunning now | 21:01 |
rlandy|ruck | locked ansible-compat | 21:01 |
rlandy|ruck | sshnaidm|afk: hey ... LADA and CIX tool are down | 21:03 |
rlandy|ruck | box is not reachable | 21:03 |
sshnaidm|afk | rlandy|ruck, reran dhclient there, now it has IP | 21:07 |
rlandy|ruck | sshnaidm|afk: hey - I guess we were both on console | 21:07 |
rlandy|ruck | lol | 21:07 |
rlandy|ruck | I am like who is on with me | 21:07 |
sshnaidm|afk | :) | 21:08 |
sshnaidm|afk | it can be shared | 21:08 |
rlandy|ruck | sshnaidm|afk: what did you do to make the machine accessible? | 21:09 |
rlandy|ruck | dell-per620-01.lab4.eng.bos.redhat.com | 21:09 |
sshnaidm|afk | rlandy|ruck, sudo dhclient br0 in idrac console | 21:11 |
rlandy|ruck | rcastillo|rover: dviroel: ok tripleo-ci getting somewhere now | 21:11 |
* rlandy|ruck tries | 21:11 | |
sshnaidm|afk | bridge has problems with getting IP after restart | 21:11 |
rlandy|ruck | sshnaidm|afk: ah - thanks - let me give that a shot | 21:12 |
dviroel | rlandy|ruck: it works | 21:12 |
rlandy|ruck | dviroel: yep - one thing today | 21:12 |
sshnaidm|afk | rlandy|ruck, I rebooted wimp machine, should get IP now | 21:12 |
rlandy|ruck | awesome | 21:12 |
* dviroel going pick up my son + dinner | 21:15 | |
*** dviroel is now known as dviroel|afk | 21:15 | |
sshnaidm|afk | rlandy|ruck, https://10.19.112.189/ | 21:16 |
sshnaidm|afk | rlandy|ruck, lada works now, but by IP, something wrong with its dns | 21:16 |
sshnaidm|afk | that's not server problem though | 21:17 |
rlandy|ruck | can fix that tomorrow | 21:17 |
sshnaidm|afk | it's Tengu that should see if usersys dns up and has right IP | 21:17 |
dasm | rlandy|ruck: qq. Can I use Depends-on from opendev on rdoproject? https://review.opendev.org/c/openstack/tripleo-quickstart/+/824241 | 21:21 |
rlandy|ruck | dasm: yep | 21:21 |
dasm | ack. good to know | 21:21 |
rlandy|ruck | dviroel|afk: rcastillo|rover: can you vote on https://review.opendev.org/c/openstack/tripleo-ci/+/824233/ | 21:36 |
rlandy|ruck | sshnaidm|afk++ it's working | 21:38 |
dasm | rlandy|ruck: test-requirements change looks out of place with ansible-compat and identify. is it required? | 21:43 |
rlandy|ruck | dasm: ... | 21:45 |
rlandy|ruck | <mwhahaha> rlandy|ruck: https://paste.opendev.org/show/812050/ | 21:45 |
rlandy|ruck | <mwhahaha> ansible-compat-1.0.0 release | 21:45 |
rlandy|ruck | <mwhahaha> https://pypi.org/project/ansible-compat/#history | 21:45 |
rlandy|ruck | <mwhahaha> 4 hours ago | 21:45 |
* rlandy|ruck divides patches | 21:45 | |
dasm | ack | 21:46 |
rlandy|ruck | dasm: creating bug to explain | 21:48 |
dasm | thanks | 21:48 |
rlandy|ruck | dasm: you're right to point that out - thank you | 21:57 |
rlandy|ruck | dasm: did adding puppet-pacemaker from current help? | 21:59 |
dasm | still running job. | 22:00 |
dasm | but at least it didn't fail yet | 22:00 |
dasm | last few times it failed aroud 48 minutes time mark. there is still about 10 more minutes to the job to meet the time. | 22:01 |
* dasm is leaving. Will get back later to check the job result. | 22:03 | |
ade_lee | dviroel|afk, hey -- so talking about doing the fips jobs on centos-9 .. | 22:08 |
ade_lee | dviroel|afk, how do want to test this out -- right now, the fips patch sets tripleo-ci-base-required-projects-centos-8 to multinode-fips | 22:10 |
ade_lee | is there an equivalent in centos-9 , we should be modifying? | 22:12 |
ade_lee | rlandy|ruck, ^^ ? | 22:13 |
ade_lee | dasm, ^^ | 22:14 |
* rlandy|ruck looks | 22:16 | |
rlandy|ruck | ade_lee: there is not ... akahat was putting in a patch to create a separate parent for c9 | 22:17 |
rlandy|ruck | but atm they are parented off the same base | 22:18 |
* rlandy|ruck gets | 22:18 | |
rlandy|ruck | you could so the same on the c9 job | 22:18 |
rlandy|ruck | https://github.com/openstack/tripleo-ci/search?q=nodeset%3A+single-centos-9-node | 22:19 |
rlandy|ruck | ade_lee: ^^ that's basically how things are switched | 22:19 |
rlandy|ruck | which job do you want to change? | 22:19 |
ade_lee | rlandy|ruck, so the fips stuff is here -- https://review.opendev.org/c/openstack/tripleo-ci/+/808215 | 22:21 |
ade_lee | rlandy|ruck, I want to change this to use centos-9 | 22:21 |
rlandy|ruck | ade_lee: ok - so you'll need a few changes ... | 22:22 |
ade_lee | rlandy|ruck, though probably in a separate review so that we can continue to get results for centos-8 .. | 22:22 |
rlandy|ruck | ade_lee: let's meet for a few - will explain | 22:22 |
ade_lee | soundss good | 22:23 |
rlandy|ruck | https://meet.google.com/whr-whbm-cyp?pli=1&authuser=0 | 22:24 |
dasm | rlandy|ruck: amoralej|off fyi. the job failed again. forcing puppet-pacemaker didn't change anything. it looks like requirement for is not getting installed. | 22:51 |
*** dasm is now known as dasm|off | 22:52 | |
rlandy|ruck | dasm|off: ok - will touch base with amoralej|off tomorrow on this | 22:55 |
rlandy|ruck | thanks | 22:55 |
dasm|off | rlandy|ruck: will do the same. i just left some additional breadcrumbs in the HackMD: https://hackmd.io/txgCFi5IRIqUOPOD8ekquA | 22:56 |
rlandy|ruck | dasm|off: k - have a good night | 22:58 |
dasm|off | you too | 22:59 |
*** dviroel|afk is now known as dviroel | 23:05 | |
*** dviroel is now known as dviroel|out | 23:10 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!