| *** rlandy|ruck is now known as rlandy|out | 00:37 | |
| *** ysandeep|out is now known as ysandeep | 03:31 | |
| *** ysandeep is now known as ysandeep|afk | 03:38 | |
| *** ysandeep|afk is now known as ysandeep | 05:08 | |
| akahat | ysandeep, o/ | 05:31 |
|---|---|---|
| ysandeep | akahat, hello o/ | 05:32 |
| akahat | ysandeep, i need your help with this review: https://review.opendev.org/c/openstack/tripleo-ci/+/823688, pip is failing, /usr/bin/python3 not found. | 05:32 |
| akahat | do we need to install python3? | 05:34 |
| akahat | a | 05:35 |
| ysandeep | akahat, want to discuss over gmeet? | 05:44 |
| ysandeep | akahat, c8 job is also failing, c8 jobs should have python3 installed: https://db1b21e002606f46c53f-9c4d070fefbaa4f90a8a69af5ec07c7e.ssl.cf2.rackcdn.com/823688/5/check/tripleo-buildimage-overcloud-full-centos-8/f2e8003/job-output.txt | 05:46 |
| akahat | ysandeep, https://meet.google.com/skj-auhe-iuv | 05:51 |
| Tengu | sshnaidm|afk, rlandy|out lada seems to be up again - DNS included. Probably some timing with the internal dynamic dns tool or something. | 06:06 |
| *** ykarel_ is now known as ykarel | 06:13 | |
| akahat | ysandeep, https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/build-images/tasks/main.yml#L32 | 06:13 |
| *** akahat_ is now known as akahat | 06:30 | |
| *** amoralej|off is now known as amoralej | 07:06 | |
| amoralej | dasm|off, what rlandy|out said, you need to get puppet-pacemaker from the current repo | 07:35 |
| *** amoralej is now known as amoralej|afk | 08:04 | |
| *** ysandeep is now known as ysandeep|lunch | 08:16 | |
| chandankumar | frenzy_friday: around | 08:31 |
| chandankumar | frenzy_friday: can you add the job definition of tripleo-ci-centos-9-standalone-on-multinode-ipa for upstream check job | 08:32 |
| chandankumar | it is missing from upstream | 08:32 |
| *** jpena|off is now known as jpena | 08:37 | |
| *** ysandeep|lunch is now known as ysandeep | 08:59 | |
| *** amoralej|afk is now known as amoralej | 09:14 | |
| frenzy_friday | chandankumar, hey, adding | 09:17 |
| *** ysandeep is now known as ysandeep|afk | 10:09 | |
| soniya29 | chandankumar, kopecmartin, ysandeep|afk, arxcruz|ruck, rlandy|out, please add/edit today's agenda for tempest meeting:- https://hackmd.io/fIOKlEBHQfeTZjZmrUaEYQ | 10:30 |
| amoralej | quick question, some changes are coming to qemu-kvn in centos9 that my affect us | 10:43 |
| amoralej | do you know if we do a full "dnf update" in containers or in hosts in oooq jobs? | 10:43 |
| chandankumar | amoralej: https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/release/tripleo-ci/CentOS-9/promotion-testing-hash-master.yml#L170 | 10:46 |
| chandankumar | we run dnf update on all the host in cs9 jobs | 10:46 |
| amoralej | chandankumar, and in containers? | 10:47 |
| chandankumar | amoralej: in containers, nope, we just mount the repos, | 10:48 |
| chandankumar | each day we build new containers | 10:48 |
| chandankumar | and push it to trunk registry | 10:48 |
| chandankumar | amoralej: yes, https://opendev.org/openstack/tripleo-common/src/branch/master/container-images/tcib/base/base.yaml#L56 we also run dnf update in base container | 10:50 |
| amoralej | mmm | 10:50 |
| amoralej | i guess that's bad | 10:51 |
| amoralej | i mean, for this case | 10:51 |
| amoralej | ah, but that is just when building containers | 10:52 |
| amoralej | that's fine | 10:52 |
| amoralej | my concern was more when running jobs with pre-existing containers | 10:53 |
| chandankumar | amoralej: in that case ovb and component jobs gets get impacted if containers packages get updated | 10:54 |
| chandankumar | but we will see | 10:54 |
| chandankumar | amoralej: by the way we are going to make cs9 jobs voting today in upstream | 10:55 |
| chandankumar | for master | 10:55 |
| *** rlandy|out is now known as rlandy|ruck | 11:04 | |
| *** ysandeep|afk is now known as ysandeep | 11:10 | |
| ysandeep | akahat, downstream promoter running okay? 16.2 jobs all jobs passed but it didn't promote the hash. | 11:11 |
| ysandeep | I don't see a log file for today's date | 11:11 |
| ysandeep | rlandy|ruck, ^^ fyi.. | 11:15 |
| rlandy|ruck | ysandeep: may have been impacted by the outage yesterday | 11:15 |
| rlandy|ruck | we had to restart a few tools | 11:15 |
| rlandy|ruck | ysandeep: any response from glance yet? | 11:16 |
| ysandeep | rlandy|ruck, stuck in ci, they are still rechecking there patches :D | 11:17 |
| rlandy|ruck | ysandeep: ok - need to raise that in program call | 11:17 |
| ysandeep | rlandy|ruck, from logs looks like downstream promoter server stuck since 08th, no new file after 08th | 11:18 |
| rlandy|ruck | chandankumar: will join review time at half past the hour | 11:19 |
| rlandy|ruck | just reporting some stuff for CIX | 11:19 |
| rlandy|ruck | arxcruz|ruck: we need to sync | 11:19 |
| arxcruz|ruck | rlandy|ruck: i need 20 min | 11:20 |
| *** dviroel_ is now known as dviroel | 11:21 | |
| chandankumar | rlandy|ruck: ping me when ready | 11:21 |
| rlandy|ruck | arxcruz|ruck: k - pls ping when ready | 11:24 |
| rlandy|ruck | ysandeep: let's meet | 11:24 |
| ysandeep | rlandy|ruck, ack | 11:24 |
| rlandy|ruck | ysandeep: https://meet.google.com/cbd-kdub-tss?pli=1&authuser=0 | 11:25 |
| rlandy|ruck | dviroel: hey - internal cockpit needs some help | 11:26 |
| dviroel | rlandy|ruck: hi, let me see | 11:27 |
| rlandy|ruck | dviroel: outage yesterday probably killed it | 11:27 |
| rlandy|ruck | just checking on the promoter server | 11:27 |
| rlandy|ruck | then will look there | 11:27 |
| ysandeep | akahat: so rlandy|ruck and me looked at downstream promoter and turns out - dlrn-promoter service was down, server went down 3 days ago and because dlrn-promoter was not enabled it was not started on reboot. | 11:47 |
| arxcruz|ruck | rlandy|ruck: i'm ready | 11:47 |
| rlandy|ruck | arxcruz|ruck: going to touch base with chandankumar for a few | 11:48 |
| rlandy|ruck | will reach you after tempest meeting | 11:48 |
| rlandy|ruck | chandankumar: k- let's meet | 11:49 |
| ysandeep | akahat, its giving some error on enabling the service, when you have time - could you please check that. I will pm the details. | 11:49 |
| chandankumar | rlandy|ruck: yes sure | 11:49 |
| *** ysandeep is now known as ysandeep|brb | 11:49 | |
| *** sshnaidm|afk is now known as sshnaidm | 11:58 | |
| rlandy|ruck | sshnaidm: hey - what channel do you usually reach the ansible people on? | 12:02 |
| sshnaidm | rlandy|ruck, #ansible-devel for general questions, ansible-lint etc - #ansible-devtools, all in libera IRC | 12:03 |
| sshnaidm | rlandy|ruck, also #ansible-community for collections | 12:03 |
| sshnaidm | depending what is the question :) | 12:03 |
| rlandy|ruck | sshnaidm: thanks | 12:04 |
| dviroel | rlandy|ruck: dns issues in telegraf_py3 container, restarting the container fixed | 12:06 |
| *** ysandeep|brb is now known as ysandeep | 12:06 | |
| dviroel | rlandy|ruck: waiting for the service to populate influxdb again, lets see if solves the issue | 12:06 |
| chandankumar | marios: ysandeep I will be preparing the cs9 voting annoucement email draft and sharing it with you soon. | 12:07 |
| rlandy|ruck | sshnaidm: was looking for zbr | 12:08 |
| marios | chandankumar: k | 12:08 |
| sshnaidm | rlandy|ruck, then #ansible-devtools | 12:08 |
| ysandeep | chandankumar, ack thanks! | 12:10 |
| chandankumar | marios: on more thing from Tengu fs01 run https://logserver.rdoproject.org/02/38002/2/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-master/cc64131/logs/undercloud/var/log/tempest/tempest_run.log.txt.gz we have only 6 tempest failure | 12:11 |
| marios | chandankumar: yes i saw the same commented there https://bugs.launchpad.net/tripleo/+bug/1957060/comments/3 | 12:12 |
| Tengu | chandankumar: btw, I'm about to open a bug, I'm still unable to provision the nodes, even with tripleo-ci-testing content.. | 12:12 |
| marios | chandankumar: but it is still the same issue those are subset of the original set | 12:12 |
| marios | chandankumar: i was digging in the logs today but still cant find something.. one of the problems is there are LOTS of errors but they also appear in the 'good' log from centos8 job... (https://bugs.launchpad.net/tripleo/+bug/1957060/comments/5 ) | 12:14 |
| *** ysandeep is now known as ysandeep|brb | 12:20 | |
| rlandy|ruck | ysandeep|brb; can this be closed out? https://trello.com/c/7wgJueNL/2281-cixlp1956449tripleociproa-missing-groups-or-modules-mariadb105-virtrhel-virtav-and-redis5-on-rhel-9-container-build | 12:27 |
| chandankumar | marios: can you join this call https://meet.google.com/zvw-hnds-ncu?authuser=0 to discuss fs01 and upstream cs9 voting | 12:29 |
| chandankumar | we are on the line currently | 12:29 |
| marios | chandankumar: sure gimme sec | 12:30 |
| chandankumar | marios: thanks! | 12:30 |
| chandankumar | marios: https://review.rdoproject.org/r/c/rdo-jobs/+/37210 | 12:46 |
| marios | chandankumar: :) thanks | 12:47 |
| dviroel | marios: hey o/ | 12:49 |
| dviroel | marios: let me know when you have some time to talk about director-operator | 12:49 |
| rlandy|ruck | dviroel++ thank you | 12:50 |
| rlandy|ruck | arxcruz|ruck: rcastillo|rover: let's sync for a few | 12:50 |
| arxcruz|ruck | rlandy|ruck: ok | 12:50 |
| rlandy|ruck | https://meet.google.com/anv-wsty-xxk?pli=1&authuser=0 | 12:51 |
| marios | dviroel: o/ hey - yeah sure lets talk in 40 mins is it ok for you? | 12:51 |
| dviroel | marios: sure | 12:51 |
| *** ysandeep|brb is now known as ysandeep | 12:59 | |
| rlandy|ruck | amoralej: hey - just a fyi - wallaby failures on weirdo tests since Jan 9: https://jenkins-cloudsig-ci.apps.ocp.ci.centos.org/job/weirdo-wallaby-centos8-promote-packstack-scenario001/ | 13:00 |
| ysandeep | rlandy|ruck, yes, I have moved the card to done | 13:00 |
| rlandy|ruck | https://jenkins-cloudsig-ci.apps.ocp.ci.centos.org/view/phase-1-pipelines/job/rdo_trunk-promote-wallaby-centos8-current-tripleo/ | 13:00 |
| rlandy|ruck | amoralej: ^^ | 13:00 |
| rlandy|ruck | ysandeep: thanks | 13:00 |
| *** amoralej is now known as amoralej|lunch | 13:04 | |
| marios | rlandy|ruck: fyi apparently lee is moving on in few weeks and artom is th eperson to ping re compute (but lee is having a look/will ping artom about it this time) | 13:05 |
| rlandy|ruck | marios: chandankumar: ack - ok - so artom is on those ... | 13:06 |
| rlandy|ruck | marios: chandankumar: after CIX call, please go forward with plan to start making c9 jobs voting/gating | 13:07 |
| rlandy|ruck | chandankumar; ^^ pls send mail to openstack-discuss re^^ | 13:07 |
| rlandy|ruck | after CIX | 13:07 |
| rlandy|ruck | we will go with OVB w/o compute tests if needed | 13:07 |
| rlandy|ruck | rcastillo|rover: pls ping when you are on line | 13:09 |
| rlandy|ruck | rcastillo|rover: need you to touch base with sshnaidm re: https://bugs.launchpad.net/tripleo/+bug/1957116 | 13:09 |
| rlandy|ruck | temp locked versions on those | 13:10 |
| chandankumar | rlandy|ruck: ci coverager tooling call | 13:31 |
| marios | dviroel: https://github.com/openstack-k8s-operators/osp-director-operator | 13:40 |
| marios | dviroel: for baremetal https://github.com/openstack-k8s-operators/osp-director-operator#install-the-osp-director-operator | 13:40 |
| marios | dviroel: this for baremetal install https://github.com/openstack-k8s-operators/osp-director-dev-tools/tree/master/ansible | 13:40 |
| marios | dviroel: dev env for psi/upshift https://docs.google.com/document/d/1-WTKj5yB6DW7XkWpg4SksU0ivFvHg4Cn-JA9CSRo4wg/edit#heading=h.l6gqzvtdwr49 | 13:41 |
| marios | dviroel: https://docs.openshift.com/container-platform/4.8/authentication/identity_providers/configuring-github-identity-provider.html | 13:45 |
| rcastillo|rover | rlandy|ruck: hello | 13:48 |
| *** dasm|off is now known as dasm | 14:00 | |
| dasm | o/ | 14:00 |
| *** amoralej|lunch is now known as amoralej | 14:04 | |
| *** ykarel_ is now known as ykarel | 14:06 | |
| rlandy|ruck | rcastillo|rover: dasm: hey - good morning | 14:11 |
| rlandy|ruck | dasm: saw amoralej responded to you | 14:11 |
| rlandy|ruck | dasm: just one question - on your run where you added puppet-pacemaker, did you rebuild containers? | 14:12 |
| rlandy|ruck | rcastillo|rover: let's sync | 14:12 |
| rlandy|ruck | https://meet.google.com/mzc-jodv-znn?pli=1&authuser=0 | 14:12 |
| rlandy|ruck | arxcruz|ruck: ^^ you can join briefly to transfer any work items | 14:13 |
| dasm | rlandy|ruck: good morning! i believe, i'm forcing rebuilding containers every time with https://review.rdoproject.org/r/c/testproject/+/37861/6/.zuul.yaml#7 | 14:13 |
| rlandy|ruck | dasm: you need another var ... | 14:14 |
| rlandy|ruck | getting | 14:14 |
| rlandy|ruck | https://github.com/openstack/tripleo-ci/blob/master/zuul.d/standalone-jobs.yaml#L67 | 14:15 |
| rlandy|ruck | dasm: ^^ like that ... build_container_images: true | 14:15 |
| rlandy|ruck | oh forget that | 14:15 |
| rlandy|ruck | you have it | 14:15 |
| rlandy|ruck | then should be right - will look more later | 14:15 |
| dasm | phew. i was confused for a moment :D | 14:15 |
| dasm | i just resolved merge conflict, so i can look into this again. | 14:16 |
| rlandy|ruck | sorry - refresh | 14:16 |
| rlandy|ruck | helps | 14:16 |
| dasm | amoralej: hey. i just downloaded the package, which can be found here: https://trunk.rdoproject.org/centos9-wallaby/component/tripleo/9f/2e/9f2e6f10a4883041cc3a086ee85be807af6bd4a0_f099ad8b/ during installation, it didn't pull in required package of rubygem-rexml: https://paste.opendev.org/show/812075/ | 14:19 |
| dasm | amoralej: it was local fedora35, so not really centos9 | 14:20 |
| * dasm facepals | 14:20 | |
| dasm | i didn't even install it... | 14:20 |
| amoralej | dasm, rpm -q --requires -p https://trunk.rdoproject.org/centos9-wallaby/component/tripleo/9f/2e/9f2e6f10a4883041cc3a086ee85be807af6bd4a0_f099ad8b/puppet-pacemaker-1.3.1-0.20220111132316.9f2e6f1.el9.noarch.rpm | 14:22 |
| amoralej | rubygem-rexml | 14:22 |
| amoralej | it's there, so it should pull it in | 14:22 |
| dasm | hmm.. lemme try again. based on my previous job runs, i have this version installed...] | 14:22 |
| dasm | or, maybe it *looks* like the same version, because the hashtag is the same? | 14:23 |
| dasm | i don't know. | 14:23 |
| dasm | i'll get back to you in about 1h | 14:23 |
| amoralej | dasm, check the entire version-release | 14:23 |
| amoralej | also de timestamp part | 14:23 |
| dasm | amoralej: will do. thanks for the command, it really helps | 14:23 |
| amoralej | in this case, as we built it with a change in distgit, not in code, code hash is the same | 14:24 |
| amoralej | but timestamp after -0. changes | 14:24 |
| dasm | that's what i thought too :) | 14:24 |
| dasm | i'm missing container update somewhere, because last job run had: "0.20211224184837.9f2e6f1" | 14:26 |
| dasm | lemme see if i'm using the right thing here. | 14:26 |
| dasm | wrt containers. | 14:26 |
| rlandy|ruck | rcastillo|rover: arxcruz|ruck: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/824061 | 14:29 |
| marios | rlandy|ruck: cant find comments on my patch.. did you mean this one? https://review.opendev.org/c/openstack/tripleo-ci/+/824364 | 14:32 |
| rlandy|ruck | marios: ack | 14:33 |
| marios | rlandy|ruck: k that is from frenzy_friday | 14:33 |
| rcastillo|rover | /query sshnaidm | 14:35 |
| rcastillo|rover | oops | 14:36 |
| chandankumar | bhagyashris: we have added cs9 fs01 and fs02 to the integration line, we are not going to add it to the promotion criteria till it gets stable | 14:39 |
| frenzy_friday | Hey rlandy|ruck , I am setting the job to voting here https://review.opendev.org/c/openstack/tripleo-ci/+/824364/2/zuul.d/standalone-jobs.yaml#958 . Should I put a -wf till the bug is resolved? | 14:44 |
| amoralej | rlandy|ruck, https://review.rdoproject.org/r/c/openstack/packstack-distgit/+/38024 for the weirdo issue in wallaby | 14:46 |
| rlandy|ruck | thank you | 14:47 |
| rlandy|ruck | frenzy_friday: I commented as per the c8 change | 14:47 |
| rlandy|ruck | the job is still voting but the template is not | 14:47 |
| chandankumar | amoralej: regarding RHEL virt package updates, Does these packages first lands in compose repo or directly hit us on mirror repo? | 14:48 |
| amoralej | what compose you mean? | 14:48 |
| amoralej | will probably arrive at the mirror directly | 14:48 |
| chandankumar | amoralej: cs9 compose | 14:48 |
| amoralej | that's why i was asking about updates before chandankumar | 14:48 |
| amoralej | will arrive at compose first | 14:49 |
| amoralej | but dunno for how long it will be in the compose before being in mirror | 14:49 |
| chandankumar | Any gitlab review request to track it? So that we can test it early | 14:49 |
| chandankumar | if it lands in compose, we might use dviroel dependency line to catch it | 14:50 |
| chandankumar | ysandeep: marios dviroel frenzy_friday http://lists.openstack.org/pipermail/openstack-discuss/2022-January/026634.html - Making CentOS Stream 9 jobs voting and remove cs8 jobs | 14:54 |
| marios | chandankumar: thanks lgtm | 14:55 |
| chandankumar | ysandeep: dviroel feel free to above them when free comfortable https://review.opendev.org/q/hashtag:%22c9voting%22+(status:open%20OR%20status:merged) | 14:55 |
| dviroel | yey | 14:59 |
| amoralej | chandankumar, https://gitlab.com/redhat/centos-stream/src/qemu-kvm/-/merge_requests/60 | 14:59 |
| ysandeep | chandankumar, ack | 14:59 |
| chandankumar | amoralej: thanks :-) | 14:59 |
| dviroel | chandankumar: will start with standalone and content provider, my first w+1 ^ ^ | 15:00 |
| ysandeep | rlandy|ruck, fyi.. I am triggering train tripleo component jobs so that new content can promote early. | 15:00 |
| rlandy|ruck | ysandeep: ack - sure | 15:00 |
| chandankumar | dviroel: aye sir | 15:01 |
| rlandy|ruck | rcastillo|rover: hey - let's go through CIX board: https://meet.google.com/ahj-acgc-dzt?pli=1&authuser=0 | 15:07 |
| frenzy_friday | rlandy|ruck, chandankumar : updated https://review.opendev.org/c/openstack/tripleo-ci/+/824364 (removing cs9voting tag as this is setting the job to non voting) | 15:13 |
| *** dviroel is now known as dviroel|lunch | 15:13 | |
| rlandy|ruck | frenzy_friday: thanks - voted | 15:30 |
| chandankumar | see ya! | 15:34 |
| dasm | \o chandankumar | 15:34 |
| soniya29 | arxcruz|ruck, chandankumar, please add this patch to your review list: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/815654 | 15:46 |
| arxcruz|ruck | soniya29: looks good, I'll check the logs later | 15:47 |
| soniya29 | arxcruz|ruck, thanks :) | 15:47 |
| rlandy|ruck | jpodivin: hey - posted out on #opendev to ask | 15:58 |
| rlandy|ruck | jm1: k - let's chat quickly ... https://meet.google.com/wtm-wvbn-fch?pli=1&authuser=0 | 16:09 |
| *** dviroel|lunch is now known as dviroel | 16:11 | |
| *** ysandeep is now known as ysandeep|out | 16:16 | |
| dasm | rlandy|ruck: fyi, i'm digging through the documentation for zuul to grasp how dependencies on jobs work. i want to understand why it's failing. | 16:22 |
| dasm | it might take me some time today | 16:22 |
| rlandy|ruck | dasm: ok - np - ping if you have questions | 16:23 |
| dasm | sure, thanks | 16:23 |
| * frenzy_friday dinner | 16:25 | |
| rlandy|ruck | frenzy_friday: k - ping me after dinner | 16:26 |
| rlandy|ruck | and we can review your patch | 16:26 |
| frenzy_friday | rlandy|ruck, hey, I am still here | 16:27 |
| frenzy_friday | shall we have a call? | 16:27 |
| rlandy|ruck | frenzy_friday: sure | 16:27 |
| rlandy|ruck | jpodivin: I checked with opendev | 16:27 |
| rlandy|ruck | will pm you info | 16:27 |
| frenzy_friday | rlandy|ruck, https://meet.google.com/mbm-yxfo-vqt | 16:28 |
| rlandy|ruck | joining | 16:29 |
| rlandy|ruck | dasm: just fyi - zuul will give you an inheritance chain ... example: https://review.rdoproject.org/zuul/jobs type in box the job name | 16:47 |
| marios | rlandy|ruck: fyi - our rhos-dev-stage resources are spread a bit thin right now... long story short i broke the cluster ;) and deployed a new one | 16:50 |
| marios | rlandy|ruck: so we now have two ... i may keep the original one for a few days for experiments before clear up | 16:50 |
| marios | rlandy|ruck: letting you nkow in case we have issues with quota or someone shouts about that | 16:50 |
| marios | rlandy|ruck: otherwise, we can consider actually keeping 2 for dev purposes | 16:50 |
| marios | rlandy|ruck: i was sweating and waiting for the install to finish before telling you i broke the original installation ;) | 16:51 |
| rlandy|ruck | marios: no worries | 16:52 |
| rlandy|ruck | you're all good | 16:52 |
| marios | rlandy|ruck: well yeah now there aren't ;) but 20 mins ago phew | 16:53 |
| rlandy|ruck | you're the only one on that tenant - you can use the resources at hand | 16:53 |
| rlandy|ruck | keep both until someone yells | 16:53 |
| marios | rlandy|ruck: we can even consider having a 2nd cluster for dviroel to poke at | 16:53 |
| marios | rlandy|ruck: i have given him access to the original for now | 16:53 |
| marios | rlandy|ruck: k thanks | 16:53 |
| rlandy|ruck | likely we will need one for 17 comptaibility and one for 16.2 | 16:53 |
| marios | rlandy|ruck: k | 16:54 |
| rlandy|ruck | marios: yeah - for now mange the resources as you see fir | 16:54 |
| rlandy|ruck | fit | 16:54 |
| rlandy|ruck | I'll let you know if we get push back | 16:54 |
| rlandy|ruck | go forth and conquer | 16:54 |
| dviroel | :) | 16:54 |
| rlandy|ruck | lunch - brb | 17:10 |
| marios | dviroel: all yours /me off in a few ... tried again with the github integration but no luck will keep poking tomorrow | 17:19 |
| marios | dviroel: feel free to delete/add whatever you want there for the identity provider | 17:20 |
| dviroel | marios: k, thanks, will delete your CR for now, can't have 2 | 17:32 |
| marios | dviroel: yeah sure go ahead | 17:34 |
| dviroel | @team reminder: you can propose names for Z-release, until Jan 24th | 17:34 |
| dviroel | https://wiki.openstack.org/wiki/Release_Naming/Z_Proposals | 17:34 |
| *** amoralej is now known as amoralej|off | 17:34 | |
| marios | OpenStack Zivania has a certain ring to it ;) ( https://en.wikipedia.org/wiki/Zivania ) | 17:34 |
| * marios runs | 17:35 | |
| *** marios is now known as marios|out | 17:35 | |
| rlandy|ruck | Zulu, the NATO phonetic alphabet designation for the letter Z, as well as a storied kingdom and language in what is now South Africa | 17:38 |
| rlandy|ruck | hmmm ... I guess I'd have to put my vote there | 17:39 |
| *** jpena is now known as jpena|off | 17:40 | |
| rlandy|ruck | rcastillo|rover: hey | 17:57 |
| rlandy|ruck | rcastillo|rover: you around? | 17:57 |
| rcastillo|rover | rlandy|ruck: hi, I'm here | 17:59 |
| rlandy|ruck | rcastillo|rover: great - can you join https://meet.google.com/kpr-rqyi-eur?pli=1&authuser=0 | 18:00 |
| rlandy|ruck | dviroel++ ... data on downstream cockpit looks much better | 18:35 |
| rlandy|ruck | dasm: hey | 18:37 |
| rlandy|ruck | dasm: how are you doing? | 18:37 |
| dviroel | rlandy|ruck: great :) | 18:40 |
| dviroel | oh, https://review.opendev.org/c/openstack/tripleo-ci/+/824174/ failed in gates :( | 19:17 |
| dviroel | centos-9-scenario010-standalone, tempest tests | 19:17 |
| dviroel | https://f990b2c4a2005c06be06-fe5720e3ae2bcf1d2e4df6980ffadeb5.ssl.cf5.rackcdn.com/824174/1/gate/tripleo-ci-centos-9-scenario010-standalone/b7faaa0/logs/undercloud/var/log/tempest/stestr_results.html | 19:17 |
| sshnaidm | rcastillo|rover, https://github.com/ansible-community/molecule/blob/main/requirements.txt#L8 | 19:18 |
| sshnaidm | rcastillo|rover, so "ansible-compat" is in molecule requirements | 19:18 |
| sshnaidm | rcastillo|rover, it means we can't remove it, so need just to set a strict version, also better to do it for all test-requirements there including molecule itself | 19:19 |
| sshnaidm | rcastillo|rover, same as we did with ansible-lint.. | 19:20 |
| *** sshnaidm is now known as sshnaidm|afk | 19:20 | |
| dviroel | sshnaidm|afk: ansible-compat==1.0.0 was the version that was failing on our jobs =/ | 19:21 |
| rlandy|ruck | yeah - but sshnaidm|afk and rcastillo|rover are fixing the issue | 19:22 |
| rlandy|ruck | so we can use the updated version | 19:22 |
| sshnaidm|afk | dviroel, yeah, so we need ansible 0.5.0 | 19:22 |
| dviroel | we locked 2 packages | 19:22 |
| sshnaidm|afk | rlandy|ruck, we can't, it's bug in ansible-compat probably | 19:22 |
| dviroel | but ansible-compat should be the issue, probably | 19:22 |
| sshnaidm|afk | rlandy|ruck, ansible-compat is some module of zbr | 19:23 |
| sshnaidm|afk | no idea why it's needed, probably it's not, so let's set a strict version to working on | 19:23 |
| sshnaidm|afk | s/on/one | 19:23 |
| sshnaidm|afk | as we did with ansible-lint | 19:23 |
| dviroel | sshnaidm|afk: btw, ansible-compat==1.0.0 was working in my machine, but was failing in ci | 19:23 |
| sshnaidm|afk | dviroel, because you had collections I suppose | 19:24 |
| dviroel | sshnaidm|afk: might be | 19:24 |
| dviroel | need a clean env to test properly | 19:24 |
| sshnaidm|afk | we can try to use higher version of ansible and maybe install some collections, but I hardly understand why we need to waste this time on that | 19:25 |
| sshnaidm|afk | it's nothing in our code, it's just buggy tools | 19:25 |
| sshnaidm|afk | and they will continue to be buggy | 19:25 |
| * sshnaidm|afk is afk now :) | 19:25 | |
| rcastillo|rover | trying https://review.opendev.org/c/openstack/tripleo-ci/+/824469 as a workaround for the missing collection | 19:27 |
| rcastillo|rover | waiting for results | 19:27 |
| * dviroel crossed fingers | 19:40 | |
| rlandy|ruck | https://source.redhat.com/career/rewards-portfolio/benefits/redhatrecharge/ | 19:48 |
| rlandy|ruck | fyi ^^ | 19:48 |
| rlandy|ruck | for those of us already thinking of recharge | 19:49 |
| rlandy|ruck | dasm: jm1: ^^ | 19:49 |
| dasm | rlandy|ruck: nice! thanks. i already noted these days :) | 19:50 |
| rlandy|ruck | dasm; how's the wallaby stuff? need any help there? | 19:50 |
| dasm | rlandy|ruck: wrt jobs. I'm going layer by layer to see what I'm missing in build. Something is off, because I'm not: either pulling or building recent images. | 19:50 |
| rlandy|ruck | if you're building containers, | 19:51 |
| dasm | currently i'm reading logs for the job, and comparing with ansible playbooks | 19:51 |
| rlandy|ruck | you should not see container updates | 19:51 |
| rlandy|ruck | if you're pulling images, you should | 19:52 |
| rlandy|ruck | do you see container build logs? | 19:52 |
| dasm | 2022-01-11 16:38:58.258121 | primary | TASK [tripleo.operator.tripleo_container_image_build : Run tripleo container image build] *** | 19:53 |
| dasm | 2022-01-11 16:38:58.258168 | primary | Tuesday 11 January 2022 16:38:58 -0500 (0:00:01.726) 0:05:41.384 ******* | 19:53 |
| dasm | 2 | 19:53 |
| dasm | it's waiting on async poll for about 20 minutes. | 19:53 |
| rlandy|ruck | https://review.rdoproject.org/r/c/testproject/+/37861? | 19:54 |
| dasm | yes | 19:54 |
| dasm | https://review.rdoproject.org/zuul/build/0727d5d25d2c4b748f53936d9fe54e3f/log/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz | 19:55 |
| rlandy|ruck | dasm: https://review.rdoproject.org/r/c/testproject/+/37861 has two depends on | 19:55 |
| rlandy|ruck | only one resolves | 19:55 |
| dasm | the other one is on opendev: https://review.opendev.org/c/openstack/tripleo-quickstart/+/824241 | 19:55 |
| rlandy|ruck | I773556f2e1c0f1b9774792cd0f1d04301fd73819 | 19:55 |
| dasm | yesterday I asked if it can be included | 19:55 |
| rlandy|ruck | yeah in a different gerrit | 19:55 |
| rlandy|ruck | so use the whole link | 19:56 |
| * rlandy|ruck updates | 19:56 | |
| dasm | ah | 19:56 |
| rlandy|ruck | dasm: pls see if that works better now | 19:56 |
| rlandy|ruck | in general we always use the full link | 19:56 |
| rlandy|ruck | save the confusion | 19:56 |
| dasm | thanks. will check that one. | 19:57 |
| rlandy|ruck | because we work over multiple systems | 19:57 |
| dasm | i feel like i'm drinking from a fire hose :) | 19:57 |
| rlandy|ruck | dams: welcome to Red Hat | 19:57 |
| rlandy|ruck | dasm: ^^ | 19:57 |
| dasm | xD | 19:58 |
| rcastillo|rover | dasm: you get used to it | 19:58 |
| dasm | rcastillo|rover: did you already? :) | 19:58 |
| rlandy|ruck | dasm; if it makes you feel better, never touched linux before I landed here - so you're way ahead | 19:58 |
| rcastillo|rover | dasm: getting there :) | 19:58 |
| dasm | rlandy|ruck: :) | 19:58 |
| rlandy|ruck | rcastillo|rover: veteran already :) | 19:58 |
| dasm | rcastillo|rover: ping me when you're done with that ;P | 19:59 |
| rcastillo|rover | I'll let you know | 19:59 |
| rlandy|ruck | you guys are doing great | 19:59 |
| * rlandy|ruck needs to go do so manager (virtual) paper work stuff | 20:00 | |
| rlandy|ruck | ping if you need help | 20:00 |
| dasm | thanks! | 20:00 |
| *** dviroel is now known as dviroel|afk | 20:04 | |
| jm1 | rlandy|ruck: thanks, never heard of recharge days before joining RH 😆 | 20:40 |
| rlandy|ruck | rcastillo|rover: hey - have you used command lien ruck rover tool? | 20:44 |
| rcastillo|rover | rlandy|ruck: yeah | 20:44 |
| rlandy|ruck | rcastillo|rover: master promotion is two days out | 20:45 |
| rlandy|ruck | can you testproject the failed jobs | 20:45 |
| rlandy|ruck | so we can promote | 20:45 |
| rlandy|ruck | rick rover tool will give you the testproject to run | 20:45 |
| rlandy|ruck | master and train need to be rerun | 20:46 |
| rcastillo|rover | got it | 20:48 |
| rlandy|ruck | rcastillo|rover++ thank you, sir | 20:49 |
| rlandy|ruck | rcastillo|rover: for train periodic-tripleo-centos-8-buildimage-overcloud-full-train failed | 20:51 |
| rlandy|ruck | so you'll need to rerun that | 20:51 |
| rlandy|ruck | and then all of ovb as a dependency of ^^ | 20:52 |
| rcastillo|rover | oh ok | 20:53 |
| rcastillo|rover | rlandy|ruck: then that won't show up in the rr script right? | 20:53 |
| rlandy|ruck | rcastillo|rover: rr script just shows: | 20:54 |
| rcastillo|rover | I mean, I know they don't show up, I just ran it :p | 20:54 |
| rlandy|ruck | - periodic-tripleo-centos-8-buildimage-overcloud-full-train: | 20:54 |
| rlandy|ruck | vars: | 20:54 |
| rlandy|ruck | force_periodic: true | 20:54 |
| rlandy|ruck | featureset_override: | 20:54 |
| rlandy|ruck | dlrn_hash_tag: f13f1581188376a61ed4654df7f1f088 | 20:54 |
| rlandy|ruck | right :) | 20:54 |
| rcastillo|rover | yeah, that's what I was about to run | 20:54 |
| rlandy|ruck | but if you look at the line now | 20:54 |
| rlandy|ruck | you can see the skips | 20:54 |
| rlandy|ruck | it's good that it gives you the hash | 20:55 |
| rlandy|ruck | you'll need that on the OVB jobs as well | 20:55 |
| rlandy|ruck | and force_periodic: true | 20:55 |
| rcastillo|rover | ok so should I add the ovb jobs and the buildimage job as dependency? | 20:55 |
| rcastillo|rover | all with same hash | 20:56 |
| rlandy|ruck | you can skip fs002 | 20:56 |
| rlandy|ruck | as that one builds images | 20:56 |
| rlandy|ruck | periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-train | 20:56 |
| rlandy|ruck | periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-train | 20:57 |
| rlandy|ruck | periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-train | 20:57 |
| rlandy|ruck | periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-train | 20:57 |
| rlandy|ruck | rcastillo|rover: "ok so should I add the ovb jobs and the buildimage job as dependency?" - correct | 20:58 |
| rcastillo|rover | ok cool | 20:58 |
| rcastillo|rover | rlandy|ruck: train jobs running. I'm getting a confusing error in the master review | 21:07 |
| rcastillo|rover | https://review.rdoproject.org/r/c/testproject/+/38042 | 21:07 |
| rlandy|ruck | looking | 21:08 |
| rcastillo|rover | nvm I figured it out | 21:09 |
| rlandy|ruck | rcastillo|rover: .zuul.yaml | 21:09 |
| rcastillo|rover | yeah | 21:10 |
| rlandy|ruck | o :) | 21:10 |
| jbadiapa | rlandy|ruck, rcastillo|rover: I submitted https://review.opendev.org/c/openstack/tripleo-ansible/+/824484 that I think it fixes https://bugs.launchpad.net/tripleo/+bug/1956902 which is a gate blocker for tripleo-ansible | 21:14 |
| rlandy|ruck | jbadiapa: great - thank you | 21:15 |
| rlandy|ruck | will vote | 21:15 |
| rcastillo|rover | jbadiapa: thanks for that | 21:16 |
| jbadiapa | np! | 21:16 |
| dasm | rlandy|ruck: fyi. latest change with depends-on on the puppet-pacemaker worked. job still failed, but it moved forward with the job. i'm gonna look into why it failed. | 21:49 |
| rlandy|ruck | dasm; ok - at least you are past one issue | 22:07 |
| dasm | indeed | 22:07 |
| rlandy|ruck | dasm: btw: that is expected | 22:07 |
| dasm | oh, is it? | 22:07 |
| rlandy|ruck | that you will go from error to error until we sort all missing backports etc. | 22:07 |
| dasm | i expected it to work ootb ;) | 22:07 |
| dasm | ah, you meant that :D | 22:07 |
| dasm | yeah, i expected that. | 22:08 |
| rlandy|ruck | dasm: so wallaby will be easier than master was | 22:08 |
| dasm | i hope so :) | 22:08 |
| rlandy|ruck | we started that effort in july | 22:08 |
| dasm | Oo | 22:08 |
| rlandy|ruck | https://bugs.launchpad.net/tripleo/+bug/1957709 | 22:16 |
| rlandy|ruck | rcastillo|rover: arxcruz: ^^ one more joy for us | 22:16 |
| dasm | rlandy|ruck: fyi. standalone job failed 7 tempest tests with strange issue of "AttributeError: '<name>' object has no attribute 'assertItemsEqual'". I'm gonna look at this tomorrow. | 22:43 |
| dasm | rlandy|ruck: have a good night! | 22:43 |
| dasm | btw. i might or might not wake up tomorrow for scrum. i'll do my best, but today o overslept my alarm in a morning. | 22:44 |
| *** dasm is now known as dasm|off | 22:45 | |
| rlandy|ruck | dasm|off; no worries | 23:10 |
| rlandy|ruck | dasm|off; if your test got as far as tempest you are doing well | 23:10 |
| *** rlandy|ruck is now known as rlandy|out | 23:16 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!