*** rcastillo is now known as rcastillo|out | 00:18 | |
ysandeep|out | rlandy|testbox, around? | 02:53 |
---|---|---|
*** ysandeep|out is now known as ysandeep | 02:59 | |
ysandeep | ykarel, do you have few mins to discuss https://review.opendev.org/c/openstack/tripleo-common/+/818092/1#message-67bf0b46ea808d5a1a463c4410f38d74c1270bf4 | 06:06 |
ykarel | ysandeep, after half hour? | 06:06 |
ysandeep | ykarel, ack | 06:06 |
ykarel_ | ysandeep, available now | 06:41 |
ysandeep | ykarel_, meet.google.com/rbs-wugs-ggc | 06:41 |
*** ysandeep is now known as ysandeep|PTO | 07:50 | |
*** amoralej|off is now known as amoralej | 08:08 | |
jbadiapa | hi, can some one take a look at https://review.opendev.org/c/openstack/python-tripleoclient/+/813811 and tell me what I need to do to get it merged? | 08:08 |
jbadiapa | It already has the +workflow | 08:09 |
marios | jbadiapa: depends-on | 08:09 |
jbadiapa | the depends-on is merge on master | 08:10 |
marios | jbadiapa: stable/wallaby one Change-Id: I958439e017efa45f316750a61fd7dfdee5afdc8e | 08:10 |
marios | jbadiapa: Depends-On: I958439e017efa45f316750a61fd7dfdee5afdc8e | 08:10 |
jbadiapa | so it does not care/understand about the branches | 08:12 |
jbadiapa | it only sees that there is a patch with that ID that it's not merged. | 08:12 |
jbadiapa | thanks for the clarification | 08:12 |
marios | jbadiapa: if you instead used the gerrit url directly it would be ok like https://review.opendev.org/c/openstack/tripleo-ansible/+/813132 if you only wanted master | 08:13 |
jbadiapa | marios, I thought that the "depends on" needs the ID but if the URL can be used. | 08:15 |
marios | jbadiapa: yeah long time ago it only worked with change id but at some point it was fixed/changed so you can use url | 08:16 |
jbadiapa | I need to think about using it. (pros and cons) as the cherry picks need to be modified to get the "new" url | 08:17 |
marios | jbadiapa: right :) so depends how long it will take for that wallaby pick to merge | 08:17 |
marios | jbadiapa: anyway you know for future | 08:17 |
marios | jbadiapa: i'll workflow that sec let me check | 08:18 |
soniya29|ruck | arxcruz, akahat|rover, will it okay with you if we cancel today's tempest meeting since most of people are either on PTO/holiday? | 08:18 |
jbadiapa | marios: thanks a lot | 08:18 |
jbadiapa | for everything | 08:18 |
marios | jbadiapa: :) np mate just clicked a button and RH pays me for it ;) :D | 08:20 |
jbadiapa | ;) | 08:23 |
*** ykarel_ is now known as ykarel | 08:30 | |
sshnaidm | marios, hi, are you ok with https://review.opendev.org/c/openstack/tripleo-quickstart/+/769480 ? I'd like to merge these patches today to see how it's going | 09:13 |
marios | sshnaidm: o/ hey yeah i was just waiting for you to finish tests etc if you think it is ready lets go | 09:14 |
sshnaidm | marios, great | 09:15 |
*** jpena|off is now known as jpena | 09:50 | |
arxcruz | soniya29|ruck: sure | 10:01 |
arxcruz | kopecmartin: ping | 10:01 |
soniya29|ruck | akahat|rover, https://bugs.launchpad.net/tripleo/+bug/1951241 | 10:28 |
*** soniya29|ruck is now known as soniya29|ruck|afk | 10:33 | |
sshnaidm | marios, I think we need to merge this: https://review.rdoproject.org/r/c/rdo-jobs/+/36720 - it will allow 3party to run | 10:57 |
marios | sshnaidm: ah did it hit? | 10:57 |
marios | sshnaidm: have a link? | 10:57 |
sshnaidm | marios, I mean here: https://review.opendev.org/c/openstack/tripleo-ci/+/815108 | 10:58 |
sshnaidm | marios, all nodesets used in upstream ci should have equivalents in 3party (since it's imported) | 10:58 |
sshnaidm | we did this before for "stream" nodes as well | 11:00 |
marios | sshnaidm: well that's the question /why we are holding on https://review.rdoproject.org/r/c/rdo-jobs/+/36720 to find out. https://review.opendev.org/c/openstack/tripleo-ci/+/815108/6#message-2c52d244239c819d5edbdaa91dea1c828723573a - these jobs should never run in 3rd party and for rdo we override the nodeset | 11:00 |
marios | sshnaidm: i posted the fake nodeset so it is ready | 11:00 |
dviroel | morning o/ | 11:00 |
marios | sshnaidm: like i was wondering if it is the same situation as we had with https://review.opendev.org/c/openstack/tripleo-ci/+/810261/6#message-404679acf0113259cf9014c12ed525fae7c2c1ed and the secret | 11:01 |
sshnaidm | marios, all jobs from tripleo-ci are imported to 3party as configured in zuul, together with configs and nodesets. When 3party CI sees nodeset it doesn't know about - the 3party zull throws an error. It doesn't matter if we actually run these jobs in 3party or not | 11:02 |
marios | sshnaidm: or you really mean, all the jobs have equivalents | 11:02 |
marios | sshnaidm: vote and lets merge the fake https://review.rdoproject.org/r/c/rdo-jobs/+/36720 | 11:02 |
sshnaidm | I voted | 11:03 |
marios | sshnaidm: k w+ | 11:04 |
marios | (I just) | 11:05 |
*** rlandy is now known as rlandy|ruck | 11:13 | |
rlandy|ruck | akahat|rover: soniya29|ruck|afk: hello | 11:14 |
rlandy|ruck | let's ruck/rover sync | 11:15 |
akahat|rover | rlandy|ruck, hello | 11:15 |
dviroel | marios: lets sync after rlandy|ruck rr sync? | 11:18 |
rlandy|ruck | akahat|rover: https://meet.google.com/mrr-euef-icm | 11:18 |
marios | yes dviroel sounds good | 11:18 |
akahat|rover | rlandy|ruck, https://bugs.launchpad.net/tripleo/+bug/1951241 | 11:21 |
akahat|rover | rlandy|ruck, https://review.opendev.org/c/openstack/tripleo-ci/+/818139 | 11:23 |
*** pojadhav is now known as pojadhav|afk | 11:27 | |
akahat|rover | rlandy|ruck, https://review.opendev.org/q/topic:%22bug%252F1950815%22+(status:open%20OR%20status:merged) | 11:30 |
rlandy|ruck | slaweq: hello ... regarding patches for bug/1950815: what is the merge order here? | 11:34 |
rlandy|ruck | https://review.opendev.org/c/openstack/tripleo-heat-templates/+/818060 has no depends on | 11:34 |
rlandy|ruck | can that merge? | 11:34 |
rlandy|ruck | https://review.opendev.org/c/openstack/tripleo-ci/+/818061/2/zuul.d/base.yaml | 11:37 |
rlandy|ruck | slaweq: ^^ added in the wrong place if you want it passed to the deploy | 11:38 |
akahat|rover | rlandy|ruck, https://423b70bc819a8a28a5aa-c8df7fee768f0a38e1c53a0e9f1f4351.ssl.cf5.rackcdn.com/818061/1/check/tripleo-ci-centos-8-scenario010-standalone/108722f/job-output.txt | 11:39 |
rlandy|ruck | if we want this passed to standalone ... | 11:39 |
slaweq | rlandy|ruck: I think that https://review.opendev.org/c/openstack/tripleo-heat-templates/+/818060 is good to go without any dependencies | 11:39 |
slaweq | it will just add new template file which can but don't need to be used | 11:40 |
slaweq | but it is required by https://review.opendev.org/c/openstack/tripleo-ci/+/818061 which uses that new template file | 11:40 |
rlandy|ruck | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/standalone/templates/standalone_config.yaml.j2 | 11:40 |
slaweq | but please keep in mind that maybe I did it in wrong way/place as I'm not tripleo-ci expert for sure | 11:40 |
rlandy|ruck | we could just pass that parameter ^^ | 11:40 |
rlandy|ruck | unless it needs to be in places other than standalone | 11:41 |
slaweq | feel free to set it in some other, better place and abandon my patches | 11:41 |
slaweq | I'm fine with that | 11:41 |
rlandy|ruck | if it needs to go elsewhere, we keep the env file | 11:41 |
rlandy|ruck | ok - we'll test this out | 11:41 |
slaweq | rlandy|ruck: basically it should be set in all ci jobs which runs (or will run) that test | 11:41 |
slaweq | for now it is failing in standalone | 11:42 |
rlandy|ruck | may be some ovb | 11:42 |
slaweq | but maybe it will fail in others too | 11:42 |
slaweq | idk | 11:42 |
rlandy|ruck | we're looking at where to put it - thank you for the fix | 11:42 |
rlandy|ruck | soniya29|ruck|afk: akahat|rover: https://review.rdoproject.org/r/c/testproject/+/16882/46/.zuul.yaml | 11:48 |
*** soniya29|ruck|afk is now known as soniya29|ruck | 11:48 | |
rlandy|ruck | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/standalone/templates/standalone_config.yaml.j2 | 11:50 |
slaweq | rlandy|ruck: thx a lot for help with that :) | 11:53 |
* dviroel get a coffee | 11:59 | |
marios | dviroel: rlandy|ruck: lets sync in 10 mins? https://meet.google.com/knx-oqhi-pah | 12:06 |
rlandy|ruck | sshnaidm: marios: opinion pls ... promotions are 5 days out | 12:11 |
rlandy|ruck | do we want to keep the ansible changes in gate | 12:12 |
rlandy|ruck | or hold for tomorrow | 12:12 |
rlandy|ruck | we were missing container builds fix before | 12:12 |
rlandy|ruck | just merged | 12:12 |
marios | rlandy|ruck: i haven't been following that too closely i don't even know exactly what tests were done (testproject etc) ... sshnaidm have we run standalone etc with ansible 2.11? | 12:12 |
rlandy|ruck | yes | 12:13 |
rlandy|ruck | akahat|rover did testing | 12:13 |
akahat|rover | rlandy|ruck, https://review.opendev.org/c/openstack/tripleo-ci/+/802616 | 12:13 |
rlandy|ruck | and standalone etc. runs in the check/gate | 12:13 |
sshnaidm | marios, yeah, we checked things | 12:13 |
marios | rlandy|ruck: it isn't really a firedrill to merge that i think ... even though it *should* be ok perhaps you might want to hold but... don't know perhaps sshnaidm has been waiting for long already | 12:14 |
marios | so sshnaidm decides i think ;) | 12:14 |
akahat|rover | https://review.rdoproject.org/r/c/testproject/+/36756 | 12:14 |
marios | rlandy|ruck: are you waiting on promotion line right now kind of thing like tests are reporting and looking good? | 12:14 |
rlandy|ruck | no - line is still hosed | 12:14 |
marios | rlandy|ruck: or just general problems/various jobs so ... | 12:15 |
marios | rlandy|ruck: well then merge it :) | 12:15 |
marios | if you need to you can just revert wdyt sshnaidm | 12:15 |
sshnaidm | rlandy|ruck, marios well, currently I don't know about any failures we can have, although I can't guarantee everything will work 100% of course. | 12:15 |
sshnaidm | marios, yeah, I'm fine to revert if any issue will come | 12:15 |
rlandy|ruck | sshnaidm: the only failure I see is OVB | 12:15 |
sshnaidm | rlandy|ruck, where? | 12:15 |
rlandy|ruck | https://review.opendev.org/c/openstack/tripleo-quickstart/+/769480/ | 12:16 |
rlandy|ruck | but two diff failures | 12:16 |
rlandy|ruck | let's let it go | 12:17 |
sshnaidm | rlandy|ruck, it's not related, passed here: https://review.rdoproject.org/zuul/build/4baf8a3d2b4d41b6964413e9726db744 | 12:17 |
rlandy|ruck | ok | 12:17 |
rlandy|ruck | marios: meeting? | 12:19 |
marios | rlandy|ruck: yes i was waiting for you to say ;) dviroel o/ joining now | 12:19 |
dviroel | k | 12:19 |
akahat|rover | rlandy|ruck, fyi https://review.rdoproject.org/r/c/testproject/+/36754 | 12:25 |
rlandy|ruck | akahat|rover: all good except change release not in ['train', 'ussuri'] | 12:26 |
akahat|rover | rlandy|ruck, okay. updating review. | 12:27 |
rlandy|ruck | release is defined and release not in ['train', 'ussuri'] | 12:29 |
rlandy|ruck | akahat|rover: ^^ | 12:29 |
*** ykarel is now known as ykarel|afk | 12:37 | |
dviroel | rlandy|ruck: https://review.rdoproject.org/r/c/rdo-jobs/+/36460 | 12:39 |
dviroel | rlandy|ruck: marios https://review.opendev.org/c/openstack/tripleo-ci/+/817341 | 12:42 |
marios | rlandy|ruck: https://opendev.org/openstack/tripleo-ci/src/commit/ccae098378bc05e22d1647b425b9b38439265dce/roles/oooci-build-images/templates/build-images.sh.j2#L58 | 12:45 |
marios | dviroel: ^^^ | 12:45 |
rlandy|ruck | marios: dviroel: http://git.app.eng.bos.redhat.com/git/openstack/tripleo-ci-internal-jobs.git/tree/playbooks/build-image/images_var.yaml | 12:46 |
*** pojadhav|afk is now known as pojadhav | 12:55 | |
rlandy|ruck | akahat|rover: requeued the master line | 13:10 |
rlandy|ruck | jbadiapa: hello re: https://bugs.launchpad.net/tripleo/+bug/1951260 - looks like a duplicate of https://bugs.launchpad.net/tripleo/+bug/1950383 | 13:14 |
rlandy|ruck | ok if I close that as a dup? | 13:14 |
rlandy|ruck | fix just merged | 13:15 |
jbadiapa | It seems the same yes. | 13:15 |
rlandy|ruck | thanks - closing out | 13:15 |
jbadiapa | rlandy|ruck^ | 13:16 |
sshnaidm | rlandy|ruck, patch merged, keeping eye.. | 13:17 |
rlandy|ruck | sshnaidm: thank you | 13:17 |
jbadiapa | rlandy|ruck, I'm doing another try with the patch and see what's the outcome | 13:18 |
*** amoralej is now known as amoralej|lunch | 13:18 | |
rlandy|ruck | jbadiapa: yep - pls let us know | 13:18 |
jbadiapa | cos, I was not able to provision the nodes. | 13:18 |
jbadiapa | rlandy|ruck, sure | 13:18 |
dviroel | rlandy|ruck: when you have some time: XS fix in tripleo-repos, fixes component name in logging https://review.opendev.org/c/openstack/tripleo-repos/+/817387 | 13:27 |
arxcruz | marios: I give up, the patch is running on the content-provider, but not in the upgrade because in upgrade job you don't run the build-test-packages | 13:28 |
arxcruz | but the patch is required in the upgrade, not in the content-provider | 13:28 |
marios | arxcruz: ack maybe write some summary about the problems testing it and post onto the upstream patch and remove the WIP? | 13:29 |
marios | arxcruz: i'll review it again ... we may want a couple iterations after reviewer comments and we can just try it | 13:29 |
arxcruz | ok, i don't think as it is, it's impossible to test on testproject | 13:29 |
arxcruz | i tried to remove the remove_tags: build | 13:29 |
arxcruz | but it didn't work | 13:29 |
marios | 15:28 < arxcruz> marios: I give up, the patch is running on the content-provider, | 13:30 |
marios | arxcruz: can you include some pointers to logs in the summary ^^^ so we can see what parts of the review were tested | 13:30 |
arxcruz | marios: it's not tested because the content-provider don't have the zuul.dlrn_bla bla bla variable | 13:30 |
arxcruz | i always forgot the name of that variable | 13:30 |
arxcruz | in content-provider, the zuul.dlrn hash variable isn't defined yet | 13:31 |
rlandy|ruck | dviroel: looking | 13:33 |
rlandy|ruck | done | 13:34 |
beagles | marios, rlandy|ruck: are "Depends-On" in patches like https://review.rdoproject.org/r/c/testproject/+/36380 expected to do what is expected? | 13:34 |
arxcruz | marios: dviroel check https://review.opendev.org/c/openstack/tripleo-ci/+/816991 and my comments | 13:37 |
dviroel | ok | 13:37 |
rlandy|ruck | beagles: not sure what you are asking exactly ... | 13:37 |
rlandy|ruck | the patches should be included in the test run on that testproject | 13:38 |
beagles | rlandy|ruck: :) will the depends-on pull in the referenced patch and apply it before running the CI jobs | 13:38 |
*** pojadhav is now known as pojadhav|afk | 13:38 | |
rlandy|ruck | beagles: ack | 13:38 |
rlandy|ruck | beagles: just make sure you are working with the right branch for the patch to take effect | 13:39 |
beagles | rlandy|ruck: ahhhhhh | 13:40 |
rlandy|ruck | beagles: something like https://review.rdoproject.org/r/c/testproject/+/36715 | 13:41 |
beagles | thanks! | 13:43 |
beagles | rlandy|ruck: ^ | 13:43 |
marios | rlandy|ruck: beagles: something weird going on there https://logserver.rdoproject.org/80/36380/7/check/periodic-tripleo-ci-centos-8-scenario010-standalone-ussuri/2a68ce6/job-output.txt 2021-11-17 08:24:33.928508 | primary | TASK [build-test-packages : Print out the change list] ************************* | 13:43 |
marios | 2021-11-17 08:24:33.955450 | primary | "project": "openstack/tripleo-heat-templates", | 13:44 |
marios | 2021-11-17 08:24:33.955462 | primary | "refspec": "refs/changes/20/818120/1" | 13:44 |
marios | ? | 13:44 |
marios | but the depends-on is for octavia https://review.opendev.org/c/openstack/octavia-tempest-plugin/+/818200 | 13:44 |
marios | rlandy|ruck: ah... its an ussuri job beagles .... so it won't include that change for the ussuri job | 13:45 |
beagles | marios: gthiemonge updated the commit message to remove unnecessary depends-on's, that was in the previous commit (patchset 7) | 13:46 |
marios | beagles: rlandy|ruck: i don't think he can test that because the job will have ussuri branch | 13:46 |
marios | beagles: rlandy|ruck: and the depends-on has master | 13:46 |
beagles | marios: yup | 13:46 |
gthiemonge | hmm octavia-tempest-plugin is branch-less | 13:46 |
marios | beagles: rlandy|ruck: https://opendev.org/openstack/tripleo-quickstart-extras/src/commit/e423bb068a96ed919ead08226f9447b2cdfc0332/roles/build-test-packages/tasks/main.yml#L199-L200 | 13:46 |
marios | rlandy|ruck: beagles: so build-test-packages won't include it for your test | 13:46 |
rlandy|ruck | unless you set the branch to ussuri | 13:47 |
marios | rlandy|ruck: but the dependson is master | 13:47 |
marios | rlandy|ruck: testproject was master but the job itself is ussuri ... can also make testproject ussuri but still have mismatch from depends-on | 13:47 |
rlandy|ruck | openstack/octavia-tempest-plugin master only | 13:48 |
*** ykarel|afk is now known as ykarel | 13:49 | |
rlandy|ruck | marios: hmmm ... so most of our branchless repos don't need to be built | 13:52 |
rlandy|ruck | like testing tripleo-quickstart changes with ussuri jobs | 13:52 |
rlandy|ruck | we could do something like | 13:54 |
rlandy|ruck | run test | 13:54 |
rlandy|ruck | hold node | 13:54 |
rlandy|ruck | import change | 13:54 |
rlandy|ruck | and run test again | 13:54 |
*** amoralej|lunch is now known as amoralej | 13:55 | |
ykarel | rlandy|ruck, marios can use https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/815451 or similar approach to test branchless projects builds | 14:03 |
gthiemonge | rlandy|ruck: could I log in to the node while the job is running? (I would not need a depends-on in that case) | 14:06 |
akahat|rover | gthiemonge, yes. you can. | 14:12 |
marios | thanks ykarel | 14:15 |
rlandy|ruck | akahat|rover: pls join #rhos-ops internal | 14:17 |
rlandy|ruck | gthiemonge: ack | 14:17 |
rlandy|ruck | we can add your keys to the node on rdo zuul once it is running | 14:17 |
rlandy|ruck | dviroel: hey ... | 14:25 |
rlandy|ruck | ade_lee asked us to hold a node yesterday | 14:25 |
rlandy|ruck | didn't get to do it | 14:25 |
rlandy|ruck | <ade_lee> dviroel|out, rlandy|ruck so I wonder if we can run and keep the node for tripleo-ci-centos-8-standalone-on-multinode-ipa for https://review.opendev.org/c/openstack/tripleo-ci/+/808215 | 14:25 |
rlandy|ruck | did you yet? | 14:25 |
rlandy|ruck | if not - will do that now | 14:25 |
akahat|rover | gthiemonge, this is the node which you want to hold: https://review.rdoproject.org/zuul/status#36380 ? | 14:28 |
dviroel | rlandy|ruck: i was out by that time. no, i didn't hold the node. You can use this testproject https://review.rdoproject.org/r/c/testproject/+/35121 | 14:28 |
jbadiapa | rlandy|ruck: regarding the https://bugs.launchpad.net/tripleo/+bug/1950383 and the patch https://review.opendev.org/c/openstack/tripleo-quickstart/+/818010 it worked. But I can not provision the nodes https://paste.opendev.org/show/811126/ | 14:28 |
rlandy|ruck | ok - will look in a bit | 14:29 |
dviroel | rlandy|ruck: just wait for a moment, i added a dependency that failed to merge | 14:30 |
dviroel | rlandy|ruck: let fix that i'll trigger the testproject | 14:30 |
rlandy|ruck | dviroel: ok - great - ping when ready - and i'll hold that node | 14:31 |
dviroel | rlandy|ruck: ok | 14:31 |
gthiemonge | akahat|rover: yeah it is | 14:32 |
akahat|rover | gthiemonge, okay.. please share your public key. | 14:33 |
rlandy|ruck | holding node | 14:34 |
rlandy|ruck | 0000001062 | rdoproject.org | review.rdoproject.org/testproject | periodic-tripleo-ci-centos-8-scenario010-standalone-ussuri | refs/changes/80/36380/.* | 1 | debug gthiemonge | 14:36 |
rlandy|ruck | node held | 14:36 |
rlandy|ruck | akahat|rover can add your keys to that to access | 14:37 |
rlandy|ruck | ssh as zuul user | 14:37 |
akahat|rover | raukadah, already done. | 14:37 |
akahat|rover | rlandy|ruck, ^^ | 14:37 |
gthiemonge | rlandy|ruck: akahat|rover: thanks | 14:38 |
rlandy|ruck | great | 14:39 |
ade_lee | rlandy|ruck, dviroel thanks - let me know when the node is ready and I'll point john eckersberg at it. hopefully, the rabbitmq error will recur. | 14:42 |
rlandy|ruck | ade_lee: yeah - sorry - missed reaching you last night when I returned | 14:43 |
rlandy|ruck | on the upside, I don't have covid | 14:43 |
ade_lee | rlandy|ruck, +++ | 14:43 |
dviroel | ade_lee: o/ | 14:49 |
dviroel | ade_lee: there is a merge conflict error https://review.opendev.org/c/openstack/tripleo-ci/+/808215 | 14:50 |
dviroel | ade_lee: I thought that was happening after i added another depends-on, but i removed, still happening | 14:50 |
ade_lee | dviroel, looking -- lets try refreshing all the dependencies .. | 14:51 |
dviroel | ade_lee: https://review.opendev.org/c/openstack/tripleo-ci/+/808215/50..52 | 14:51 |
dviroel | ade_lee: ps50 was running, there is no dependencies change by now | 14:52 |
akahat|rover | rlandy|ruck, hey.. can we have quick meeting ? | 14:53 |
dviroel | ade_lee: https://review.opendev.org/c/openstack/tripleo-quickstart/+/815750 | 14:53 |
dviroel | merge conflict there | 14:54 |
ade_lee | dviroel, yup - I just got there :) | 14:55 |
ade_lee | all the rest have been rebased | 14:55 |
dviroel | ade_lee: i was trying to add this one too: https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/818232 | 14:55 |
ade_lee | dviroel, sure - good idea | 14:55 |
ade_lee | dviroel, let me fix the merge conflict | 14:56 |
dviroel | ade_lee: lets add it to see if collect logs can finish with a higher timeout, can't see any other issue; | 14:56 |
dviroel | ade_lee: sure | 14:56 |
ade_lee | dviroel, ok - conflicts resolved -- go ahead and add the collect logs dep | 15:00 |
dviroel | ok | 15:02 |
* akahat|rover will back in hour. | 15:02 | |
dviroel | ade_lee: https://zuul.openstack.org/status#808215 - ok, seems to be fine now | 15:05 |
dviroel | ade_lee: using this testproject here https://review.rdoproject.org/r/c/testproject/+/35121 | 15:05 |
dviroel | ade_lee: need to wait for multinode-ipa to start, and hold | 15:06 |
dviroel | https://review.rdoproject.org/zuul/status#35121 | 15:06 |
* dviroel lunch | 15:08 | |
*** dviroel is now known as dviroel|lunch | 15:08 | |
*** rcastillo|out is now known as rcastillo | 15:23 | |
gthiemonge | rlandy|ruck: akahat|rover: I think the sc010 stable/ussuri CIX is related to the vexxhost+kvm+centos issue | 15:26 |
gthiemonge | could it be related to https://review.opendev.org/c/openstack/tripleo-ci/+/799958 ? | 15:26 |
rlandy|ruck | gthiemonge: as in centos updated? | 15:26 |
rlandy|ruck | let's check the nodeset on that | 15:27 |
rlandy|ruck | 2021-11-17 13:19:55.017760 | localhost | Provider: vexxhost-nodepool-tripleo | 15:27 |
rlandy|ruck | 2021-11-17 13:19:55.017788 | localhost | Label: upstream-centos-8-stream | 15:27 |
rlandy|ruck | gthiemonge: ^^ looks like it's on the right node | 15:28 |
rlandy|ruck | unless that should also be on nested virt | 15:28 |
rlandy|ruck | am I missing something? | 15:28 |
gthiemonge | the job is configured to use kvm/nested virt | 15:30 |
gthiemonge | so, should we update the nodeset for those jobs? | 15:31 |
gthiemonge | rlandy|ruck: ^ | 15:31 |
rlandy|ruck | gthiemonge; yep - then we'd need to for all scenario010 | 15:31 |
rlandy|ruck | so scenario010 == scenario010-kvm? | 15:32 |
gthiemonge | yeah, I think so, non-kvm jobs for sc010 are mostly useless | 15:33 |
rlandy|ruck | akahat|rover: if the kvm job passes on ussuri, victoria, let's remove vanilla scenario010 from criteria | 15:47 |
rlandy|ruck | we can remove those jobs once check is voting | 15:48 |
gthiemonge | rlandy|ruck: akahat|rover: BTW you can unlock the node | 15:48 |
rlandy|ruck | gthiemonge: ok - will remove the hold | 15:48 |
gthiemonge | thanks | 15:49 |
*** ykarel is now known as ykarel|away | 15:49 | |
rlandy|ruck | arxcruz: akahat|rover: let's talk about merging https://review.opendev.org/c/openstack/tripleo-ci/+/802616 | 15:55 |
akahat|rover | oh.. great. | 15:55 |
akahat|rover | gthiemonge, thank you :) | 15:55 |
rlandy|ruck | https://meet.google.com/dbv-giuw-omc | 15:56 |
akahat|rover | rlandy|ruck, okay. I'll remove vanilla sc10 jobs | 15:56 |
rlandy|ruck | akahat|rover: from criteria | 15:56 |
arxcruz | ok | 15:56 |
rlandy|ruck | arxcruz: https://meet.google.com/dbv-giuw-omc | 15:59 |
rlandy|ruck | arxcruz: https://review.opendev.org/c/openstack/tripleo-ci/+/802616 | 16:05 |
rlandy|ruck | arxcruz: | 16:05 |
rlandy|ruck | https://review.opendev.org/c/openinfra/python-tempestconf/+/814373 | 16:05 |
rlandy|ruck | https://review.opendev.org/c/openinfra/python-tempestconf/+/817348 | 16:05 |
*** dviroel|lunch is now known as dviroel | 16:06 | |
arxcruz | rlandy|ruck: akahat|rover https://review.opendev.org/c/openinfra/python-tempestconf/+/818245 | 16:06 |
rlandy|ruck | akahat|rover: upstream-centos-8-stream | 16:14 |
rlandy|ruck | akahat|rover: https://softwarefactory-project.io/cgit/config/tree/nodepool/providers | 16:19 |
rlandy|ruck | akahat|rover: nodeset: single-centos-8-node-psi | 16:20 |
rlandy|ruck | need got off this | 16:20 |
rlandy|ruck | https://softwarefactory-project.io/cgit/config/tree/nodepool/providers/vexxhost-nodepool-tripleo.dhall#n42 | 16:21 |
rlandy|ruck | no using ci agg | 16:21 |
akahat|rover | rlandy|ruck, https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-octavia-ussuri | 16:39 |
rlandy|ruck | akahat|rover: same issue? | 16:40 |
akahat|rover | rlandy|ruck, no. it is not able to find images | 16:40 |
akahat|rover | tripleou is namespace. but in rdo we have tripleoussuri | 16:40 |
akahat|rover | container images * | 16:40 |
rlandy|ruck | why only on that job? | 16:41 |
akahat|rover | rlandy|ruck, https://logserver.rdoproject.org/openstack-component-octavia/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario010-kvm-standalone-octavia-ussuri/ec2aa73/logs/undercloud/home/zuul/standalone_deploy.log | 16:41 |
rlandy|ruck | ohhh .. component line | 16:42 |
rlandy|ruck | weird | 16:44 |
rlandy|ruck | how was it passing before? | 16:45 |
rlandy|ruck | https://trunk.registry.rdoproject.org/v2/tripleou/centos-binary-memcached | 16:46 |
rlandy|ruck | checking release file | 16:46 |
rlandy|ruck | https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/CentOS-8/promotion-testing-hash-ussuri.yml#L8 | 16:47 |
rlandy|ruck | correct | 16:47 |
rlandy|ruck | https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/CentOS-8/ussuri.yml#L28 | 16:48 |
rlandy|ruck | akahat|rover: ^^ should be correct for | 16:48 |
rlandy|ruck | akahat|rover: ah ok | 16:48 |
rlandy|ruck | so here's the thing | 16:48 |
rlandy|ruck | you need to change ^^ to add psi | 16:48 |
rlandy|ruck | {% if cloudenv is defined and cloudenv in ['rdo', 'vexxhost'] -%} | 16:48 |
rlandy|ruck | cloudenv is psi | 16:48 |
rlandy|ruck | on kvm | 16:48 |
rlandy|ruck | akahat|rover: add that and it should work | 16:48 |
akahat|rover | oh. okay. | 16:49 |
rlandy|ruck | https://github.com/openstack/tripleo-ci/blob/d492451c1311e6d83cc7816ca93a5381948dea50/toci-quickstart/config/testenv/ovb-psi.yml#L7 | 16:49 |
rlandy|ruck | akahat|rover: ^^ as in | 16:49 |
rlandy|ruck | and we will need to add kvm jobs to criteria | 16:50 |
*** marios is now known as marios|out | 16:53 | |
akahat|rover | rlandy|ruck, https://review.opendev.org/c/openstack/tripleo-quickstart/+/818250 | 16:54 |
rlandy|ruck | akahat|rover: thanks | 16:55 |
rlandy|ruck | voted | 16:55 |
rlandy|ruck | lunch brb | 16:57 |
dviroel | arxcruz: https://www.youtube.com/watch?v=gitMjvPnUG0 | 17:12 |
dviroel | https://openinfra.dev/summit/ | 17:12 |
dviroel | Jun 7-9 | 17:13 |
* arxcruz hides in shame... | 17:28 | |
rlandy|ruck | akahat|rover: looking good on https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/818227 | 17:31 |
*** jpena is now known as jpena|off | 17:34 | |
akahat|rover | rlandy|ruck, yup.. it's testproject run is also looks good: https://review.rdoproject.org/zuul/status#36754 | 17:37 |
rlandy|ruck | akahat|rover: did you out in the criteria change yet? just checking if I missed it? | 17:44 |
rlandy|ruck | would like to merge that today | 17:44 |
akahat|rover | rlandy|ruck, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/36821 | 17:44 |
akahat|rover | it's there but we got promotion failures now. | 17:44 |
akahat|rover | looking in it now | 17:44 |
rlandy|ruck | akahat|rover: let's chat | 17:45 |
akahat|rover | ok | 17:45 |
rlandy|ruck | https://meet.google.com/aos-pkeo-yrb | 17:46 |
*** amoralej is now known as amoralej|off | 17:55 | |
strider | arxcruz++ :D | 18:00 |
sshnaidm | rlandy|ruck, so far so good, I don't see much failures in CI, zuul queue is small | 18:02 |
sshnaidm | rlandy|ruck, probably went well | 18:02 |
sshnaidm | at least we didn't explode CI :D | 18:02 |
rlandy|ruck | sshnaidm++ | 18:02 |
rlandy|ruck | yeah - downstream has been hosed due to | 18:03 |
rlandy|ruck | going to start working there now | 18:03 |
rlandy|ruck | hoping to clear promotion pipelines soon | 18:03 |
rlandy|ruck | sshnaidm: thanks for taking care of that | 18:03 |
rlandy|ruck | akahat|rover++ for all great work today - thank you, sir | 18:04 |
sshnaidm | rlandy|ruck, I think will try tomorrow to push ansible-core to tripleo itself too | 18:05 |
rlandy|ruck | sshnaidm: sure - let's keep the same schedule | 18:06 |
sshnaidm | cool | 18:06 |
rlandy|ruck | morning and we can see fallout in the afternoon | 18:06 |
rlandy|ruck | sshnaidm: have a good night | 18:06 |
sshnaidm | rlandy|ruck, thanks! | 18:08 |
dviroel | rlandy|ruck: o/ https://review.rdoproject.org/r/c/testproject/+/35121, need to hold node for tripleo-ci-centos-8-standalone-on-multinode-ipa | 18:32 |
rlandy|ruck | holding | 18:41 |
rlandy|ruck | done | 18:43 |
dviroel | tks | 18:45 |
akahat|rover | victoria, master testproject: https://review.rdoproject.org/r/c/testproject/+/36755, https://review.rdoproject.org/r/c/testproject/+/36756/ | 18:46 |
rlandy|ruck | arxcruz: :) ... your debut on tv | 18:47 |
rlandy|ruck | hmmm .... | 18:52 |
rlandy|ruck | https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/36821 | 18:52 |
rlandy|ruck | failing all promoter jobs | 18:52 |
rlandy|ruck | | /home/zuul/src/review.rdoproject.org/rdo-infra/ci-config/.tox/py36/lib64/python3.6/site-packages/coverage/data.py:118: CoverageWarning: Data file '/home/zuul/src/review.rdoproject.org/rdo-infra/ci-config/.coverage.node-0001781453.51050.759166' doesn't seem to be a coverage data file: Couldn't use data file '/home/zuul/src/review.rdoproject.org/rdo-infra/ci-config/.coverage.node-0001781453.51050.759166': no such table: | 18:52 |
rlandy|ruck | coverage_schema | 18:52 |
akahat|rover | rlandy|ruck, please review: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/36822 | 18:53 |
dviroel | rlandy|ruck: i was trying to reproduce in my env, but it passes | 18:54 |
rlandy|ruck | dviroel anible update from sshnaidm? | 18:54 |
dviroel | akahat|rover: oh, you have a fix already | 18:55 |
rlandy|ruck | akahat|rover: merging that | 18:55 |
akahat|rover | rlandy|ruck, ack | 18:55 |
dviroel | akahat|rover: ++ | 18:55 |
rlandy|ruck | ah to fix ^^ | 18:55 |
rlandy|ruck | thank you | 18:55 |
rlandy|ruck | wow - how is it only wednesday?? | 19:12 |
akahat|rover | ready to merge: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/36821 | 19:38 |
* akahat|rover out | 19:38 | |
*** dviroel is now known as dviroel|afk | 20:00 | |
ade_lee | dviroel|afk, interesting - it seems that the logs did show up now in scenario 2 | 20:11 |
ade_lee | so maybe it was the timeout .. | 20:11 |
ade_lee | dviroel|afk, and the failure there was due to a known test case that I thought we were skipping -- checking | 20:14 |
ade_lee | dviroel|afk, rlandy|ruck were you guys able to hold that node? | 20:15 |
rlandy|ruck | ade_lee: 0000001065 | rdoproject.org | review.rdoproject.org/testproject | tripleo-ci-centos-8-standalone-on-multinode-ipa | refs/changes/21/35121/.* | 1 | debug ade_lee | 20:15 |
rlandy|ruck | autohold says so | 20:15 |
rlandy|ruck | ade_lee: did dviroel|afk put your keys on that box? | 20:16 |
ade_lee | rlandy|ruck, I don't know | 20:23 |
rlandy|ruck | ade_lee: pls see pvt message | 20:23 |
ade_lee | rlandy|ruck, looks like I'm in -- I think this is the ipa node though -- is there access to the controller? | 20:38 |
rlandy|ruck | yeah - there is a second ip | 20:41 |
rlandy|ruck | ade_lee: getting | 20:41 |
rlandy|ruck | ade_lee: sent on rhos-ops | 20:43 |
ade_lee | rlandy|ruck, ack - thanks | 20:44 |
rlandy|ruck | akahat|rover: ok - we need the dns fix on OVB as well | 20:47 |
rlandy|ruck | overcloud deploy | 20:47 |
* rlandy|ruck gets | 20:47 | |
rlandy|ruck | woohoo master should promote | 20:49 |
rlandy|ruck | and ussuri | 20:49 |
rlandy|ruck | getting there | 20:49 |
ade_lee | dviroel|afk, rlandy|ruck fyi eck managed to find the root cause of the rabbit issue with fips. so we can release that node | 22:19 |
ade_lee | dviroel|afk, will sync with you tomorrow but good progress | 22:20 |
rlandy|ruck | ade_lee: great - | 22:39 |
rlandy|ruck | will remove the hold | 22:40 |
*** rlandy|ruck is now known as rlandy|ruck|bbl | 23:09 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!