| *** dviroel|afk is now known as dviroel | 00:31 | |
| * dviroel rechecks and out | 00:35 | |
| *** dviroel is now known as dviroel|out | 00:35 | |
| *** ysandeep|out is now known as ysandeep | 05:16 | |
| chandankumar | frenzy_friday: hello | 05:36 |
|---|---|---|
| chandankumar | frenzy_friday: what is the story with fs020? | 05:36 |
| chandankumar | if few tempest tests are failing and matches with these two bugs https://bugs.launchpad.net/tripleo/+bug/1957031 and https://bugs.launchpad.net/bugs/1957060 | 05:37 |
| chandankumar | then we can move it to skiplist and get it in the pipeline and same to do with fs035 | 05:37 |
| chandankumar | last night we merged fs01 | 05:37 |
| bhagyashris | folks, is gerrit and cockpit down? | 05:48 |
| marios | dentist :( back in a couple hours | 05:48 |
| chandankumar | bhagyashris: both working for me | 05:50 |
| bhagyashris | chandankumar, ack | 05:50 |
| bhagyashris | not sure it's failing to load gerrit and cockpit | 05:51 |
| ysandeep | folks o/ what's the var so that job doesn't report back to dlrn? | 06:10 |
| ysandeep | never mind found it "report_dlrn: false" | 06:12 |
| bhagyashris | ysandeep, ^ | 06:18 |
| * frenzy_friday back in a couple of hrs | 06:19 | |
| ysandeep | bhagyashris, ? | 06:19 |
| bhagyashris | is gerrit and cockpit reachable for you ? | 06:20 |
| chandankumar | ysandeep: yes | 06:20 |
| ysandeep | bhagyashris, checking | 06:23 |
| ysandeep | bhagyashris, yes they are reachable for me | 06:26 |
| bhagyashris | ok | 06:26 |
| *** marios is now known as marios|dentist | 06:44 | |
| chandankumar | dpawlik: hello | 06:46 |
| chandankumar | dpawlik: while pushing containers to quay rdo, the containers are available in private mode | 06:46 |
| chandankumar | dpawlik: is there a way to make them without changing the setting of each containers | 06:47 |
| chandankumar | ? | 06:47 |
| chandankumar | I think it might be a feature of quay registry itself | 06:47 |
| chandankumar | I checked the settings, didnot find anything to make all repositories public | 06:48 |
| chandankumar | dpawlik: just checked the containers, their visibilty mode is public | 06:56 |
| chandankumar | let me check if something got changed | 06:57 |
| chandankumar | sorry for the noise. :-) | 06:57 |
| dpawlik | chandankumar: hey, I'm working on script for doing that | 07:00 |
| dpawlik | chandankumar: also for creating new namespace, robot account etc | 07:00 |
| dpawlik | chandankumar: https://softwarefactory-project.io/r/c/software-factory/sf-infra/+/23567 | 07:01 |
| dpawlik | but it is still in WIP state | 07:01 |
| chandankumar | dpawlik: thank you , will try that out :-) | 07:03 |
| *** bhagyashris_ is now known as bhagyashris | 07:52 | |
| *** amoralej|off is now known as amoralej | 07:58 | |
| *** bhagyashris__ is now known as bhagyashris | 08:07 | |
| chandankumar | frenzy_friday: regarding fs020 failure https://bugs.launchpad.net/tripleo/+bug/1956475 | 08:31 |
| chandankumar | frenzy_friday: can you also check fs035 tempest failures | 08:31 |
| ysandeep | arxcruz, rcastillo|rover, this is also blocking some train component https://bugs.launchpad.net/tripleo/+bug/1957709 as FTBS(rpm build), We will need to clear them soon for 16.2 | 08:34 |
| chandankumar | akahat_: fixed the python3 issue , you can take this patch forward https://review.opendev.org/c/openstack/tripleo-ci/+/823688/9#message-6f7a95943587b8f2078ee373724cc1fc7179ed12 | 08:34 |
| frenzy_friday | chandankumar, checking | 08:35 |
| *** jpena|off is now known as jpena | 08:38 | |
| *** ysandeep is now known as ysandeep|lunch | 08:46 | |
| *** sshnaidm|afk is now known as sshnaidm | 08:49 | |
| amoralej | we've had issues with CS8 in official mirrors some hours ago, it's working fine now | 08:54 |
| amoralej | in case you see jobs failures | 08:54 |
| amoralej | i'm asking in #centos-devel, i'll let you know if i get some info | 08:55 |
| chandankumar | amoralej: https://bugs.launchpad.net/tripleo/+bug/1957709 | 08:55 |
| amoralej | yes, that one | 08:56 |
| chandankumar | marios: sshnaidm please have a look https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/822897 when free, thanks! | 09:05 |
| amoralej | jpodivin, wrt https://review.rdoproject.org/r/c/openstack/tripleo-validations-distgit/+/38052 it was caused by issue in centos mirrors see my comments in https://bugs.launchpad.net/tripleo/+bug/1957709 | 09:10 |
| amoralej | i'm taking care or rechecking the builds | 09:10 |
| marios | chandankumar: k | 09:16 |
| jpodivin | amoralej: awesome. I'll leave it to you then. | 09:17 |
| *** bhagyashris_ is now known as bhagyashris | 09:20 | |
| jpodivin | amoralej: If there is something I can do to help, don't hesitate to ping me. | 09:23 |
| *** ysandeep|lunch is now known as ysandeep | 09:23 | |
| amoralej | ack thanks | 09:23 |
| *** ykarel is now known as ykarel|away | 09:47 | |
| frenzy_friday | chandankumar, fs035 fails with compute tempest tests. fs020 has neutron test fails. fs035 - https://logserver.rdoproject.org/40/37740/5/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset035-master/565e24c/logs/undercloud/var/log/extra/errors.txt.gz | 09:55 |
| sshnaidm | chandankumar, wrt 822897 - do we have patches with dummy change to test it? | 10:01 |
| chandankumar | sshnaidm: testing here https://review.rdoproject.org/r/c/testproject/+/38069 | 10:16 |
| sshnaidm | chandankumar, thanks! | 10:17 |
| chandankumar | frenzy_friday: for fs035 checking now | 10:17 |
| chandankumar | frenzy_friday: seems to be similar failure https://bugs.launchpad.net/tripleo/+bug/1957031 | 10:19 |
| chandankumar | frenzy_friday: better to skip those tests by commenting in the above bug and get it in the pipeline | 10:20 |
| frenzy_friday | chandankumar, ack | 10:20 |
| chandankumar | those tests are already in skiplist just add the job against those tests it will work fine | 10:21 |
| frenzy_friday | https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/824527 - skiplist for fs035 | 11:11 |
| *** dviroel|out is now known as dviroel | 11:15 | |
| *** rlandy|out is now known as rlandy|ruck | 11:15 | |
| rlandy|ruck | arxcruz: hello | 11:18 |
| rlandy|ruck | arxcruz: anything burning? | 11:18 |
| rlandy|ruck | arxcruz: also please nick to ruck | 11:19 |
| rlandy|ruck | chandankumar: joining review time | 11:19 |
| chandankumar | https://zuul.opendev.org/t/openstack/build/48e6b072350548858900696cef0a85ca | 11:21 |
| *** bhagyashris_ is now known as bhagyashris | 11:21 | |
| dviroel | frenzy_friday: o/ - did the last cs9 fs* give some good outputs? | 11:22 |
| *** arxcruz is now known as arxcruz|ruck | 11:25 | |
| arxcruz|ruck | rlandy|ruck: hi, besides the tox, and some ipa job failing, nothing new | 11:25 |
| frenzy_friday | dviroel, https://review.rdoproject.org/r/c/testproject/+/37739 these ones? | 11:25 |
| *** abregman__ is now known as abregman | 11:25 | |
| arxcruz|ruck | rlandy|ruck: sorry, my znc disconnect forgot to change the nickname | 11:26 |
| dviroel | frenzy_friday: yes, i rechecked fs020, fs035, fs039 and fs064 yesterday | 11:29 |
| dviroel | frenzy_friday: fs039 and fs064 still hitting https://bugs.launchpad.net/tripleo/+bug/1956563 - lets ping ade_lee again when he is online | 11:32 |
| frenzy_friday | dviroel, aye. Thanks for updating the patch yesterday :D | 11:33 |
| dviroel | frenzy_friday: :) - np | 11:36 |
| *** bhagyashris_ is now known as bhagyashris | 11:45 | |
| rlandy|ruck | arxcruz|ruck: soniya29: is https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/815654 ready to merge? | 11:52 |
| rlandy|ruck | marios: fyi - w+'ed https://review.opendev.org/c/openstack/tripleo-common/+/824092 | 11:54 |
| rlandy|ruck | let me know if it's a problem | 11:54 |
| marios | rlandy|ruck: ack the recheck completed with clean run so all good thanks | 11:55 |
| rlandy|ruck | frenzy_friday: can you update https://review.opendev.org/c/x/tripleo-ipa/+/824368 to use the multinode-ipa template? | 11:56 |
| rlandy|ruck | then we won't need to update separately | 11:56 |
| rlandy|ruck | you can ping xek on #tripleo to review that | 11:57 |
| frenzy_friday | rlandy|ruck, ack, updating | 11:57 |
| rlandy|ruck | dasm|off: hey ... could you update https://review.opendev.org/c/openstack/tripleo-quickstart/+/824241 to make the same change for all release files? | 11:58 |
| rlandy|ruck | I can help you with that this afternoon | 11:58 |
| chandankumar | frenzy_friday: can you move the fs035 job to the integration line | 12:01 |
| rlandy|ruck | sshnaidm: hey - can you review https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/824181 - thanks | 12:01 |
| chandankumar | since we merged skip list | 12:01 |
| frenzy_friday | chandankumar, ack, updating | 12:02 |
| dasm|off | o/ | 12:02 |
| sshnaidm | rlandy|ruck, done | 12:02 |
| frenzy_friday | chandankumar, fs035 job def is not merged right? I am creating a separate patch for 35 and removing from https://review.rdoproject.org/r/c/rdo-jobs/+/37326 | 12:03 |
| rlandy|ruck | thanks | 12:03 |
| rlandy|ruck | frenzy_friday: how far did the fs039 job get? and how far are you on the internal job? | 12:03 |
| rlandy|ruck | want to try get those two sorted | 12:03 |
| ysandeep | rlandy|ruck, chandankumar fyi.. downstream 17 overcloud-full image successfully created, debugging ipa/uefi one | 12:04 |
| rlandy|ruck | ysandeep++ awesome!! | 12:04 |
| frenzy_friday | rlandy|ruck, fs039 and fs064 are hitting https://bugs.launchpad.net/tripleo/+bug/1956563 again, the dlrn error is gone now | 12:04 |
| rlandy|ruck | arxcruz|ruck: hey - let's sync quickly | 12:05 |
| rlandy|ruck | ok - so that's a real thing | 12:05 |
| chandankumar | ysandeep: few backports are missing | 12:06 |
| chandankumar | for stable/wallaby image build | 12:06 |
| chandankumar | ysandeep: https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/823367 and https://review.opendev.org/c/openstack/ironic-python-agent-builder/+/823365 | 12:07 |
| chandankumar | will clear ipa one | 12:07 |
| chandankumar | few more backports | 12:07 |
| dasm|off | chandankumar: thanks for the explanation wrt https://review.opendev.org/c/openstack/tripleo-quickstart/+/824241/2 To clarify a bit more. Does it always need to be in-sync between all 3 files? If that's so -- why do we need 3 files and not one? | 12:07 |
| chandankumar | https://review.opendev.org/c/openstack/tripleo-common/+/823148 | 12:07 |
| ysandeep | chandankumar, thanks checking | 12:08 |
| chandankumar | dasm|off: yes | 12:08 |
| chandankumar | dasm|off: rlandy|ruck can explain in detail in her afternoon may be | 12:08 |
| *** dasm|off is now known as dasm | 12:08 | |
| chandankumar | about those changes | 12:08 |
| rlandy|ruck | dasm: can run through all that with you | 12:09 |
| dasm | chandankumar: ok. trying to learn more about rationale. | 12:09 |
| chandankumar | frenzy_friday++ dpawlik++ for image pub script :-) | 12:09 |
| dasm | chandankumar: btw. what time is it for you? | 12:09 |
| chandankumar | 5:39 PM | 12:09 |
| dasm | utc is 12:09 PM so you're +5:30 Is my math correct? | 12:10 |
| chandankumar | yes correct | 12:11 |
| dasm | ack. good to know (doing mental math for a future) | 12:11 |
| chandankumar | :-) | 12:12 |
| frenzy_friday | chandankumar, https://review.rdoproject.org/r/c/rdo-jobs/+/37326 for fs035, I'll remove it from the old patch soon | 12:15 |
| rlandy|ruck | arxcruz|ruck: https://meet.google.com/yxb-bioj-pjb?pli=1&authuser=0 | 12:15 |
| chandankumar | rlandy|ruck: https://bugs.launchpad.net/tripleo/+bug/1957789 | 12:23 |
| arxcruz|ruck | rlandy|ruck: https://bugs.launchpad.net/tripleo/+bug/1957792 | 12:28 |
| *** akahat_ is now known as akahat | 12:30 | |
| chandankumar | dasm: https://review.rdoproject.org/r/c/rdo-jobs/+/37860/4#message-9d3c7fdca3f0e67757db9ea3f9c80adcab3ae4a2 please have a look when free, thanks! | 12:31 |
| akahat | folks please +w https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/822344 related fix is merged https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/822344 | 12:31 |
| chandankumar | akahat: for this one we need to testing for all release https://review.opendev.org/c/openstack/tripleo-quickstart/+/824555 | 12:32 |
| dasm | chandankumar: oh, that's neat. thanks for the review | 12:33 |
| akahat | chandankumar, okay | 12:33 |
| ysandeep | rlandy|ruck: before my eod today, Let's sync about 16.2 for few mins | 12:45 |
| rlandy|ruck | ysandeep: can meet with you after ruck/rover sync after scrum | 12:46 |
| ysandeep | rlandy|ruck, ack, works for me | 12:46 |
| ysandeep | rlandy|ruck, I am killing 16.2 scheduled run, I want to run after ~1 hour - expecting some component promotions otherwise will face resource crunch | 12:51 |
| *** anbanerj is now known as frenzyfriday | 12:57 | |
| rlandy|ruck | ok | 12:57 |
| rlandy|ruck | ysandeep: glance?? | 12:57 |
| ysandeep | rlandy|ruck, yes for glance - we need cinder promotion | 12:58 |
| rlandy|ruck | cool | 12:58 |
| chandankumar | frenzyfriday: dviroel can we do similar thing for fs020 also | 12:58 |
| ysandeep | trying to promote cinder and clients and tripleo too | 12:58 |
| chandankumar | frenzyfriday: dviroel https://bugs.launchpad.net/tripleo/+bug/1956475 is known, we can skip the tests and get it in the pipeline | 12:58 |
| bhagyashris_ | akahat, chandankumar rlandy|ruck soniya29 | 13:00 |
| bhagyashris_ | scrum time | 13:00 |
| dviroel | chandankumar: good, i saw different tests failing, but should be the same root cause then | 13:01 |
| bhagyashris_ | rcastillo|rover, ^ | 13:01 |
| chandankumar | dviroel: yes | 13:01 |
| *** amoralej is now known as amoralej|lunch | 13:01 | |
| bhagyashris_ | rlandy|ruck, ^ | 13:02 |
| dviroel | frenzyfriday: you go for fs020? or want me to do it? | 13:02 |
| dviroel | anbanerj: ^ | 13:06 |
| anbanerj | dviroel, I'll add the patches, np | 13:07 |
| * anbanerj realizes my nick changed | 13:07 | |
| *** anbanerj is now known as frenzyfriday | 13:08 | |
| chandankumar | https://bugs.launchpad.net/tripleo/+bug/1957031 - fs035 | 13:09 |
| chandankumar | https://bugs.launchpad.net/tripleo/+bug/1957060 - fs01/02 | 13:09 |
| chandankumar | https://bugs.launchpad.net/tripleo/+bug/1956475 - fs020 | 13:09 |
| chandankumar | https://bugs.launchpad.net/tripleo/+bug/1956563 - fs039/64 | 13:09 |
| akahat | https://review.opendev.org/c/openstack/tripleo-ci/+/823688 | 13:12 |
| akahat | https://review.opendev.org/c/openstack/tripleo-quickstart/+/824555 | 13:12 |
| frenzyfriday | https://review.rdoproject.org/r/c/rdo-jobs/+/37326 | 13:14 |
| frenzyfriday | https://review.rdoproject.org/r/c/rdo-jobs/+/38082 | 13:14 |
| frenzyfriday | https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/37946 | 13:14 |
| dasm | https://review.rdoproject.org/r/c/rdo-jobs/+/37860 | 13:16 |
| dasm | https://review.opendev.org/c/openstack/tripleo-quickstart/+/824241 | 13:16 |
| dasm | arxcruz|ruck: https://review.rdoproject.org/zuul/build/3770abf911ad405c8841a388d9487977/log/logs/undercloud/var/log/tempest/tempest_run.log.txt.gz | 13:19 |
| dviroel | https://review.rdoproject.org/r/c/rdo-jobs/+/36893 | 13:19 |
| dasm | arxcruz|ruck: AttributeError: 'OAUTH1TokensTest' object has no attribute 'assertItemsEqual' and similar | 13:19 |
| arxcruz|ruck | dasm: some unittest package missing | 13:20 |
| arxcruz|ruck | or it's using an old version | 13:20 |
| arxcruz|ruck | this is not "tempest" error | 13:20 |
| arxcruz|ruck | kopecmartin: have you seen this on tempest before ? | 13:20 |
| dasm | no, it's not. it just got stuck on tempest, but looks like some plugin issue: https://opendev.org/openstack/keystone-tempest-plugin/src/branch/master/keystone_tempest_plugin/tests/api/identity/v3/test_identity_providers.py#L25 | 13:21 |
| marios | https://review.opendev.org/q/hashtag:c9voting | 13:21 |
| ysandeep | marios, I am interested in director operator work but want to finish rhel9 osp17 work first. | 13:24 |
| arxcruz|ruck | dasm: here's the problem | 13:29 |
| arxcruz|ruck | https://github.com/testing-cabal/testtools/blob/3bcab148b5fc5491f83232874dd71234ccf94bd8/NEWS#L36 | 13:29 |
| arxcruz|ruck | this was removed from testtools | 13:29 |
| arxcruz|ruck | that is the base class from tempest | 13:29 |
| arxcruz|ruck | so the testtools version you're using might be new with this | 13:30 |
| arxcruz|ruck | kopecmartin: ^ | 13:30 |
| dasm | arxcruz|ruck: thanks. i was just going through dependencies tree. | 13:30 |
| dasm | in that case -- why it's not failing for regular CI tests? | 13:30 |
| dasm | lemme double check how to replace assertItemsEqual | 13:31 |
| rlandy|ruck | https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/824061 | 13:31 |
| dasm | arxcruz|ruck++ for finding that | 13:31 |
| arxcruz|ruck | dasm: probably because upper constraints ? | 13:31 |
| sshnaidm | https://review.opendev.org/q/topic:%22mmm%22+(status:open%20OR%20status:merged) | 13:35 |
| dasm | arxcruz|ruck: i'm going through requirements lists and pinning of those. but future proof it should be changed from assertItemsEqual to assertCountEqual. | 13:37 |
| dasm | https://github.com/openstack/openstacksdk/commit/6ba111be29879cf53ff2874466ca82c53e87d47b | 13:37 |
| arxcruz|ruck | dasm: yeah, i'll ping kopecmartin | 13:37 |
| chandankumar | ysandeep: can you share the uefi build log? | 13:38 |
| ysandeep | chandankumar, pm | 13:41 |
| rcastillo|rover | o/ | 13:42 |
| dasm | arxcruz|ruck: https://review.opendev.org/c/openstack/keystone-tempest-plugin/+/740572 | 13:42 |
| dasm | heh. it's +1 since July 2020 and it's not merged. | 13:43 |
| arxcruz|ruck | dasm: we can blame kopecmartin | 13:43 |
| bhagyashris_ | marios, http://10.0.148.74/promoter_logs/?C=M;O=D | 13:43 |
| arxcruz|ruck | that is pretending is not reading our messages | 13:43 |
| dasm | arxcruz|ruck: let's see if i can use it as the Depends-On for the standalone job. | 13:45 |
| bhagyashris_ | marios, looks like my internet i poor | 13:45 |
| arxcruz|ruck | dasm: probably not, because we build the rpm for keystone-tempest-plugin | 13:45 |
| arxcruz|ruck | actually, all plugins | 13:45 |
| dasm | ah | 13:45 |
| arxcruz|ruck | chandankumar: can you confirm it ? | 13:45 |
| arxcruz|ruck | if we do a depends on, will build the rpm ? | 13:46 |
| dasm | yeah, in that case -- no cake :/ | 13:46 |
| chandankumar | arxcruz|ruck: please put it as a depends on the testproject | 13:46 |
| chandankumar | the job will build the rpm and apply the changes | 13:46 |
| dasm | ok, i'm on it | 13:46 |
| bhagyashris_ | hey guys my internet is very unstable | 13:47 |
| * kopecmartin reading | 13:49 | |
| dasm | kopecmartin: tl;dr there is a patch to change keystone-tempest-plugin: https://review.opendev.org/c/openstack/keystone-tempest-plugin/+/740572 which needs to get merged | 13:50 |
| arxcruz|ruck | rcastillo|rover: https://meet.google.com/ndu-uskh-yqq?authuser=1 | 13:51 |
| arxcruz|ruck | go back | 13:51 |
| chandankumar | rlandy|ruck: arxcruz|ruck https://review.opendev.org/c/openstack/tripleo-ci/+/824441 | 13:54 |
| kopecmartin | dasm: i don't have +2 there, I voted +1 and added a few cores | 13:59 |
| rlandy|ruck | frenzyfriday: https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-7-containers-multinode - you may want to keep an eye on that | 13:59 |
| rlandy|ruck | arxcruz|ruck: frenzyfriday: chandankumar: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/824061 | 14:00 |
| *** amoralej|lunch is now known as amoralej | 14:01 | |
| dasm | kopecmartin: thanks. let's hope it helps | 14:02 |
| chandankumar | dviroel: we have some fixes for fs020 https://bugs.launchpad.net/tripleo/+bug/1956475/comments/3 | 14:03 |
| dviroel | chandankumar: great, distgit fixes can be tested with depends-on too, right? | 14:04 |
| chandankumar | dviroel: nope | 14:05 |
| dviroel | gah | 14:05 |
| rlandy|ruck | frenzyfriday: https://a9cf6c0a9cacb839bc04-ddfff8c833b427ca5733f0dbf055c79b.ssl.cf5.rackcdn.com/824194/2/check/tripleo-ci-centos-7-containers-multinode/654d254/logs/undercloud/home/zuul/undercloud_install.log | 14:07 |
| frenzyfriday | rlandy|ruck, it is the same "No module named pathlib2" for all the tripleo-ci-centos-7-containers-multinode failure , all from 2022-01-12 15:41:12 | 14:10 |
| frenzyfriday | Creating a lp bug | 14:10 |
| chandankumar | rcastillo|rover: https://bugs.launchpad.net/tripleo/+bug/1957789 | 14:14 |
| *** frenzyfriday is now known as frenzyfriday|ruck | 14:18 | |
| chandankumar | amoralej: please have a look https://review.rdoproject.org/r/c/openstack/nova-distgit/+/36142 and https://review.rdoproject.org/r/c/openstack/nova-distgit/+/37773 when free, thanks! | 14:33 |
| rlandy|ruck | arxcruz|ruck; hey - when you create a promotion-blocker bug - status 'triaged' - release is now yoga | 14:34 |
| amoralej | i'd like someone from nova teat to review chandankumar | 14:34 |
| arxcruz|ruck | rlandy|ruck: outch, my bad fixing | 14:34 |
| rlandy|ruck | arxcruz|ruck: np - fixed it | 14:35 |
| chandankumar | marios: by taking a look at recent tempest failure on fs 01 https://logserver.rdoproject.org/67/36267/46/check/periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp-featureset001-master/1309063/logs/undercloud/var/log/tempest/failing_tests.log.txt.gz it is coming round to 4 and all pointing to https://bugs.launchpad.net/tripleo/+bug/1957031 please have a look, when free, thanks! | 14:36 |
| chandankumar | amoralej: sure, thanks :-) | 14:36 |
| rlandy|ruck | frenzyfriday|ruck: hey - can you pass the bug link for tripleo-ci-centos-7-containers-multinode? | 14:38 |
| frenzyfriday|ruck | https://bugs.launchpad.net/tripleo/+bug/1957805\ | 14:38 |
| rlandy|ruck | frenzyfriday|ruck: thanks | 14:39 |
| frenzyfriday|ruck | rlandy|ruck, I am updating the rpm changes related to python on the bug | 14:40 |
| rlandy|ruck | frenzyfriday|ruck: awesome | 14:40 |
| rlandy|ruck | just wanted to add them to the DF meeting | 14:41 |
| frenzyfriday|ruck | rlandy|ruck, there was a tool to compare rpms of 2 logs right? | 14:42 |
| rlandy|ruck | rpms in two jobs | 14:48 |
| amoralej | dasm, chandankumar is the issue with puppet-pacemaker fixed? how is wallaby on centos9 going? | 14:50 |
| dasm | amoralej: yes, it's working. we're pass the pacemaker issue now. | 14:51 |
| dasm | thanks | 14:51 |
| amoralej | good | 14:51 |
| marios | chandankumar: thanks looking | 14:54 |
| rlandy|ruck | frenzyfriday|ruck: just commenting on the DF meeting - then will ping you to look at the bugs | 14:54 |
| frenzyfriday|ruck | rlandy|ruck, cool, thanks | 14:55 |
| rlandy|ruck | frenzyfriday|ruck: https://meet.google.com/vxd-zymq-bii?pli=1&authuser=0 | 15:04 |
| frenzyfriday|ruck | joining | 15:04 |
| frenzyfriday|ruck | rlandy|ruck, problems with headphone, rejoining | 15:05 |
| rcastillo|rover | rlandy|ruck: I'm getting some noise diffing the pkgs since the failing job doesn't get to the point of setting up quickstart repos | 15:07 |
| rlandy|ruck | rcastillo|rover: suspect a centos-8 stream update | 15:08 |
| rlandy|ruck | so stream compose change | 15:08 |
| * dviroel manila community meeting | 15:08 | |
| frenzyfriday|ruck | rlandy_, it is added here https://opendev.org/openstack/requirements/src/branch/master/openstack_requirements/tests/files/upper-constraints.txt#L244 | 15:12 |
| *** rlandy_ is now known as rlandy|ruck | 15:13 | |
| rcastillo|rover | rlandy|ruck: mirror compose id is CentOS-Stream-8-20220104.n.1 | 15:13 |
| rcastillo|rover | so didn't change recently | 15:14 |
| rlandy|ruck | rcastillo|rover: ok - just working with frenzyfriday|ruck: will look more in a bit | 15:29 |
| rcastillo|rover | https://review.rdoproject.org/paste/raw/250/ | 15:30 |
| rcastillo|rover | the packages that updated | 15:30 |
| rlandy|ruck | frenzyfriday|ruck: https://github.com/openstack/python-tripleoclient/commit/bd45a745da1ef95718a5a6893f510ef02937f1b5 | 15:30 |
| rlandy|ruck | Change-Id: Iaeadf412865c059d252ffc7087db3853569b74ee | 15:30 |
| rlandy|ruck | matbu: hey ... | 15:39 |
| chandankumar | frenzyfriday|ruck: rlandy|ruck: https://review.opendev.org/c/openstack/tripleo-ci/+/824597 please have a look when free! | 15:39 |
| rlandy|ruck | matbu: we;re looking at https://bugs.launchpad.net/tripleo/+bug/1957805 | 15:39 |
| rlandy|ruck | could https://opendev.org/openstack/validations-libs/commit/17e689536f1c0e2269434d99c9e83555ef918511 have any impact | 15:40 |
| rlandy|ruck | jpodivin: ^^ ?? | 15:41 |
| rlandy|ruck | could that impact undercloud install | 15:41 |
| matbu | rlandy|ruck: oh its bluid from source or package ? | 15:42 |
| rlandy|ruck | matbu: not totally sure | 15:43 |
| rlandy|ruck | it was just the trace we found with pathlib2 | 15:43 |
| rlandy|ruck | only impact c7 | 15:43 |
| rlandy|ruck | should be package | 15:43 |
| rlandy|ruck | but we do take in current of some | 15:43 |
| matbu | rlandy|ruck: https://github.com/rdo-packages/validations-libs-distgit/commit/57cf2f5729dd761ac3c82100ec795821d63156a1 | 15:44 |
| matbu | rlandy|ruck: because it might be related to that, python-pathlib2 | 15:45 |
| rlandy|ruck | matbu: ok- right way to go about fixing this? | 15:45 |
| rlandy|ruck | gate failures now | 15:45 |
| chandankumar | see ya on monday! | 15:47 |
| rlandy|ruck | chandankumar: have a good night | 15:47 |
| rcastillo|rover | chandankumar: see you monday | 15:47 |
| rlandy|ruck | matbu: frenzyfriday|ruck: pointed to https://review.opendev.org/c/openstack/python-tripleoclient/+/823638/ | 15:48 |
| rlandy|ruck | not yet merged | 15:48 |
| matbu | rlandy|ruck: im just wondering if the python-pathlib2 is the right name in c7 | 15:48 |
| matbu | rlandy|ruck: looks like it's the correct name: https://cbs.centos.org/koji/buildinfo?buildID=25121 | 15:51 |
| ysandeep | rlandy|ruck, /me out, please keep an eye on 16.2 line for promotion, If promotion happens please trigger glance and validation component and I will pick in my morning. | 15:53 |
| rlandy|ruck | ysandeep: will do - thanks | 15:53 |
| ysandeep | rlandy++++++++++ thank you! | 15:54 |
| *** ysandeep is now known as ysandeep|out | 15:54 | |
| rlandy|ruck | matbu: we can make the job non-voting for the moment | 15:56 |
| rlandy|ruck | if this is the real issue | 15:56 |
| rlandy|ruck | and you need a day or so to work it out | 15:56 |
| jpodivin | rlandy|ruck: I see, if it is causing issues we can get rid of it. | 15:56 |
| matbu | rlandy|ruck: i dont understand why this one periodic-tripleo-ci-centos-7-containers-multinode-train | 15:56 |
| matbu | rlandy|ruck: is green | 15:56 |
| jpodivin | pathlib isn't strictly necessary | 15:56 |
| rlandy|ruck | matbu: yeah so ... we were looking at that | 15:57 |
| rlandy|ruck | it ran yesterday | 15:57 |
| rlandy|ruck | and we see the failures only start yesterday | 15:57 |
| matbu | rlandy|ruck: oh it's python3 | 15:57 |
| matbu | ah nop py2 | 15:57 |
| jpodivin | matbu: I can start removing pathlib now. Unless you have other options. | 15:59 |
| matbu | jpodivin: well it's an option but I think trying to get why pathlib2 is on 1 host and not the other is important. Because it might be only a packaging issue | 16:01 |
| jpodivin | matbu: As I have said before, it is a dependency we don't need, that provides next to no benefit to us. I has already led unnecessary hacks, not to mention this gate failure. | 16:02 |
| jpodivin | cut it out now, before it makes more damage I say. | 16:02 |
| matbu | jpodivin: you can start to prepare something, we might fix this pretty quickly i guess | 16:03 |
| matbu | jpodivin: just i hate not getting why those weird things happen :D | 16:03 |
| *** dviroel is now known as dviroel|lunch | 16:05 | |
| rlandy|ruck | matbu: jpodivin: k - so pls just let me know your decision before you are EoD today - and then I'll know if we need to switch the job to non-voting while this is worked out or if there is a fix in progress | 16:13 |
| jpodivin | matbu, rlandy|ruck: first steps on gerrit, I'll finish tests, and docs tomorrow morning (GMT) https://review.opendev.org/c/openstack/validations-libs/+/824603 Don't merge it now though. I have only eyeballed some of those substitutions. | 16:15 |
| jpodivin | sorry about the mess everyone | 16:16 |
| jpodivin | :( | 16:16 |
| matbu | rlandy|ruck: for the diff between the two jobs, i think it's due to the repo settings | 16:16 |
| matbu | pathlib is there: http://mirror.regionone.vexxhost-nodepool-tripleo.rdoproject.org/centos/7/cloud/x86_64/openstack-train/Packages/p/ | 16:17 |
| rlandy|ruck | matbu: you are correct that we do have diff repos laid down ... | 16:17 |
| rlandy|ruck | https://github.com/openstack/tripleo-quickstart/blob/master/config/release/tripleo-ci/CentOS-7/train.yml#L72 | 16:18 |
| rlandy|ruck | come from current | 16:18 |
| rlandy|ruck | that does not happen in periodic | 16:18 |
| *** sshnaidm is now known as sshnaidm|afk | 16:18 | |
| rlandy|ruck | oh in centos itself | 16:19 |
| frenzyfriday|ruck | rlandy|ruck, I am leaving for the day. Should I make the job non voting? | 16:32 |
| rlandy|ruck | frenzyfriday|ruck: pls put in the patch to make the job non-voting and remove gating | 16:33 |
| rlandy|ruck | we may not merge it | 16:33 |
| rlandy|ruck | but let's at least have it start running through check | 16:33 |
| rlandy|ruck | rcastillo|rover: sorry - can look at ipa stuff now | 16:38 |
| rcastillo|rover | rlandy|ruck: np | 16:38 |
| * rlandy|ruck checks bug | 16:38 | |
| rlandy|ruck | rcastillo|rover: https://review.rdoproject.org/paste/raw/250/ - packages that updated ... from checking which files? | 16:39 |
| rcastillo|rover | rpm-list.txt | 16:40 |
| rlandy|ruck | ok | 16:41 |
| * frenzyfriday|ruck afk | 16:44 | |
| rlandy|ruck | rcastillo|rover: looking at updates on http://mirror.regionone.vexxhost-nodepool-tripleo.rdoproject.org/centos/8-stream/BaseOS/x86_64/os/Packages/?C=M;O=D | 16:47 |
| matbu | rlandy|ruck: oh i think i see | 16:48 |
| rlandy|ruck | from 01/11 and 01/10 | 16:48 |
| rlandy|ruck | http://mirror.regionone.vexxhost-nodepool-tripleo.rdoproject.org/centos/8-stream/AppStream/x86_64/os/Packages/?C=M;O=D | 16:48 |
| rlandy|ruck | same here | 16:48 |
| matbu | rlandy|ruck: well i dont get why there is a diff between both jobs | 16:48 |
| matbu | rlandy|ruck: but at least i think I see why the deps are not pulled | 16:48 |
| rlandy|ruck | matbu: ok- that's a good start | 16:48 |
| matbu | rlandy|ruck: yep, for the diff between the build this is really weird because looks like nothing installed pathlib2 | 16:49 |
| matbu | rlandy|ruck: so i'm even wondering if there is no env differences | 16:49 |
| rlandy|ruck | well check and periodic are run on different providers | 16:50 |
| rlandy|ruck | but check is failing across all | 16:50 |
| matbu | rlandy|ruck: do you think it will be possible to test a specfile change in the check jobs ? | 16:53 |
| matbu | rlandy|ruck: i think maybe for today it might safer to make it non-voting, in order to unblock the gates | 16:53 |
| rlandy|ruck | matbu: yeah - I don;t think so ... amoralej: ^^ | 16:54 |
| rlandy|ruck | I think we need to build/merge it | 16:54 |
| rlandy|ruck | rcastillo|rover: possible ... [ ]iputils-ninfod-20180..>2022-01-10 15:06 46K | 16:58 |
| rlandy|ruck | [ ]iputils-20180629-8.e..>2022-01-10 15:06 148K | 16:58 |
| rlandy|ruck | iputils-20180629-7.e..>2021-02-24 04:41 148K | 16:58 |
| *** dviroel|lunch is now known as dviroel | 17:00 | |
| rcastillo|rover | 2022-01-03 - Jan Macku <jamacku@redhat.com> - 20180629-8 - Make ping unprivileged (#2030107) | 17:02 |
| rlandy|ruck | [zuul@node-0001959385 ~]$ rpm -qa | grep iputils | 17:05 |
| rlandy|ruck | iputils-20180629-7.el8.x86_64 | 17:05 |
| rlandy|ruck | node has older version | 17:05 |
| rlandy|ruck | ah but the ipa node has the updated version [zuul@ipa ~]$ rpm -qa | grep iputils | 17:09 |
| rlandy|ruck | iputils-20180629-8.el8.x86_64 | 17:09 |
| rlandy|ruck | [zuul@ipa ~]$ ping redhat.com | 17:09 |
| rlandy|ruck | ping: socket: Operation not permitted | 17:09 |
| rlandy|ruck | rcastillo|rover: there it is | 17:09 |
| rcastillo|rover | rlandy|ruck: seems like a strange thing to change | 17:12 |
| rlandy|ruck | you're telling me | 17:12 |
| rlandy|ruck | rcastillo|rover: updating the bug | 17:12 |
| rlandy|ruck | rcastillo|rover: https://bugs.launchpad.net/tripleo/+bug/1957792/comments/2 | 17:15 |
| rlandy|ruck | feel free to add something if I missed it | 17:15 |
| rcastillo|rover | I've been wondering for a bit | 17:17 |
| rcastillo|rover | how can I ssh into a held node? | 17:17 |
| matbu | rlandy|ruck: amoralej: so this migth help i think : https://review.rdoproject.org/r/c/openstack/validations-libs-distgit/+/38100 | 17:17 |
| rlandy|ruck | rcastillo|rover: sending you pvt message | 17:18 |
| matbu | rlandy|ruck: amoralej: i tested the build via rdoinfo to see if train and py2 was pulling correctly the deps | 17:18 |
| * rlandy|ruck looks | 17:19 | |
| matbu | strider: as well ^ if you want to vote | 17:19 |
| rlandy|ruck | matbu: I'm ok with that - but I don't have rights there | 17:19 |
| rlandy|ruck | #rdo will have more members who can help | 17:20 |
| rlandy|ruck | maybe dpawlik: ^^? | 17:20 |
| matbu | rlandy|ruck: yep strider and amoralej can do it | 17:20 |
| rlandy|ruck | matbu: cool - thanks for the quick action | 17:21 |
| matbu | rlandy|ruck: no pb, I hope it will resolve the issue | 17:21 |
| strider | already +2 | 17:21 |
| matbu | strider: thx | 17:22 |
| strider | matbu: dpeacock doesn't have power neither I think :/ | 17:23 |
| rcastillo|rover | rlandy|ruck: the way I see it we can become root for the ping or configure the image to allow zuul user to be able to ping | 17:26 |
| rlandy|ruck | rcastillo|rover: ... | 17:27 |
| rlandy|ruck | <mwhahaha> rlandy|ruck: probably need a downgrade task somewhere | 17:27 |
| rlandy|ruck | <rlandy|ruck> mwhahaha: yeah - we can temp add that | 17:27 |
| rlandy|ruck | <rlandy|ruck> or disable that iputils version from repo | 17:27 |
| rlandy|ruck | your thoughts? | 17:27 |
| rlandy|ruck | we'll need to add either a downgrade or a disable | 17:27 |
| rlandy|ruck | https://bugzilla.redhat.com/show_bug.cgi?id=2030107 | 17:27 |
| rlandy|ruck | until that is addressed | 17:27 |
| rcastillo|rover | don't have access to bugzilla apparently | 17:28 |
| rcastillo|rover | can't open that link | 17:28 |
| rcastillo|rover | I tried looking there earlier | 17:28 |
| rcastillo|rover | downgrade seems safest | 17:28 |
| *** jpena is now known as jpena|off | 17:31 | |
| rlandy|ruck | rcastillo|rover: are you logged in as red hat associate? | 17:37 |
| rlandy|ruck | if yes, you may also be missing from group as dviroel was | 17:37 |
| rlandy|ruck | pls check with him | 17:37 |
| rcastillo|rover | I am | 17:38 |
| rlandy|ruck | rcastillo|rover; ok - then send me the BZ number and I'll approve | 18:01 |
| rlandy|ruck | you should only need devel group | 18:01 |
| rcastillo|rover | what bz number? | 18:01 |
| rlandy|ruck | from your request | 18:02 |
| rlandy|ruck | dviroel: ^^ can you help rcastillo|rover out here? | 18:02 |
| dviroel | rlandy|ruck: sure | 18:09 |
| dviroel | rcastillo|rover: pvt msg | 18:09 |
| rlandy|ruck | dviroel++ thank you | 18:09 |
| rlandy|ruck | dasm: how are you doing? | 18:11 |
| dasm | rlandy|ruck: we got one +2 on missing keystone-tempest-plugin change. i tried running with its being depends-on, but the test failed. | 18:12 |
| dasm | i'm going through logs to see if the change had been applied (i doubt) | 18:12 |
| rlandy|ruck | dasm; can you paste the change? | 18:12 |
| dasm | https://review.opendev.org/c/openstack/keystone-tempest-plugin/+/740572 | 18:12 |
| dasm | testproject job: https://review.rdoproject.org/r/c/testproject/+/37861 | 18:13 |
| dasm | chandankumar mentioned that it should be good just to add depends-on, but it didn't work | 18:13 |
| rlandy|ruck | ok - it only has a master branch so it's not branch-specific: https://github.com/openstack/keystone-tempest-plugin | 18:13 |
| dasm | errors for tempest are the same like before. i believe (double checking that), we used rpms and not updated keystone plugin. | 18:14 |
| rlandy|ruck | yeah - likely not | 18:16 |
| rlandy|ruck | getting the ones that are installed | 18:16 |
| dasm | https://review.rdoproject.org/zuul/build/df397eb7a2bd45b684630ab013d668e9/log/logs/undercloud/var/log/extra/package-list-installed.txt.gz | 18:16 |
| dasm | https://review.rdoproject.org/zuul/build/df397eb7a2bd45b684630ab013d668e9/log/logs/undercloud/var/log/extra/rpm-list.txt.gz#938 | 18:16 |
| dasm | i'm not sure yet how this plugin is loaded into tempest (or how it's built as an rpm) | 18:17 |
| rlandy|ruck | 2022-01-13 09:49:36.823778 | primary | TASK [os_tempest : Generate list of tempest plugins installed from source code] *** | 18:22 |
| rlandy|ruck | 2022-01-13 09:49:36.823800 | primary | Thursday 13 January 2022 09:49:36 -0500 (0:00:16.401) 0:43:26.173 ****** | 18:22 |
| rlandy|ruck | 2022-01-13 09:49:36.921408 | primary | skipping: [undercloud] => (item={'name': 'keystone-tempest-plugin', 'repo': 'https://opendev.org/openstack/keystone-tempest-plugin', 'branch': 'master', 'install': True}) | 18:22 |
| rlandy|ruck | 2022-01-13 09:49:36.926993 | primary | skipping: [undercloud] => (item={'name': 'neutron-tempest-plugin', 'repo': 'https://opendev.org/openstack/neutron-tempest-plugin', 'branch': 'master', 'install': True}) | 18:22 |
| rlandy|ruck | 2022-01-13 09:49:36.936056 | primary | | 18:23 |
| rlandy|ruck | 2022-01-13 09:49:36.936089 | primary | TASK [os_tempest : Append to list any tempest plugins installed from python packages] *** | 18:23 |
| rlandy|ruck | 2022-01-13 09:49:36.936109 | primary | Thursday 13 January 2022 09:49:36 -0500 (0:00:00.112) 0:43:26.285 ****** | 18:23 |
| rlandy|ruck | 2022-01-13 09:49:37.025827 | primary | skipping: [undercloud] => (item={'name': 'keystone-tempest-plugin', 'repo': 'https://opendev.org/openstack/keystone-tempest-plugin', 'branch': 'master', 'install': True}) | 18:23 |
| rlandy|ruck | 2022-01-13 09:49:37.038494 | primary | skipping: [undercloud] => (item={'name': 'neutron-tempest-plugin', 'repo': 'https://opendev.org/openstack/neutron-tempest-plugin', 'branch': 'master', 'install': True}) | 18:23 |
| rlandy|ruck | would think it would take that build | 18:23 |
| dasm | which log is it? | 18:24 |
| rlandy|ruck | dasm: wondering if we are not missing a wallaby backport of https://github.com/openstack/openstack-ansible-os_tempest/blob/master/vars/redhat-9.yml | 18:28 |
| dasm | checking | 18:28 |
| ade_lee | rlandy|ruck, so xek provided me access to a node to look into https://bugs.launchpad.net/tripleo/+bug/1956563 | 18:29 |
| rlandy|ruck | great | 18:30 |
| dasm | there is no redhat-9.yml for stable/wallaby. hmm | 18:30 |
| ade_lee | rlandy|ruck, I think he got the node from you -- is there a review associated with this? | 18:31 |
| rlandy|ruck | dasm: not sure if that will help | 18:32 |
| rlandy|ruck | but you can propose a cherry-pick and try | 18:32 |
| dasm | rlandy|ruck: i'll check this tip. | 18:32 |
| rlandy|ruck | ade_lee: ananya had the testproject | 18:32 |
| rlandy|ruck | getting | 18:32 |
| rlandy|ruck | ade_lee: https://review.rdoproject.org/r/c/testproject/+/35174 | 18:34 |
| rlandy|ruck | https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-ovb-3ctlr_1comp_1supp-featureset039-master+ | 18:34 |
| rlandy|ruck | ^^ only review with that job today | 18:34 |
| ade_lee | rlandy|ruck, thanks - looking | 18:35 |
| rlandy|ruck | fun week | 18:35 |
| rlandy|ruck | lunch - brb | 18:36 |
| *** beagles_ is now known as eagles | 18:48 | |
| ade_lee | rlandy|ruck, dviroel dasm ok - I'm going to need some help to troubleshoot here. | 18:51 |
| ade_lee | so basically it seems that for some reason ansible can't ssh to the ipa node. it seems to be up in that it responds to pings | 18:52 |
| ade_lee | but we get perm denied when trying to ssh there. | 18:52 |
| dasm | ade_lee: do you have logs handy? | 18:53 |
| ade_lee | dasm, https://review.rdoproject.org/r/c/testproject/+/35174 | 18:53 |
| dasm | (i'm just starting getting my way around, so I might be not educated enough) | 18:53 |
| ade_lee | trying to figure out whats causing https://bugs.launchpad.net/tripleo/+bug/1956563 | 18:53 |
| ade_lee | sure enough, it seems I can't ssh to the ipa node -- so is there some way to get on there through some console on something? | 18:54 |
| ade_lee | to see what state its in? | 18:54 |
| dasm | for that we need to wait for rlandy|ruck to get back from lunch. i don't know about that. | 18:55 |
| ade_lee | and where is the code that copies the extranode key over ? | 18:55 |
| ade_lee | dasm, ack no worries :) | 18:55 |
| rlandy|ruck | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/ovb-manage/tasks/ovb-create-stack.yml#L29 | 18:56 |
| rlandy|ruck | ade_lee: ^^ | 18:56 |
| rlandy|ruck | https://opendev.org/openstack/tripleo-quickstart/src/branch/master/roles/tripleo-inventory/templates/ssh_config.j2#L49 | 18:58 |
| rlandy|ruck | ade_lee: on vexxhost, there is a console for each node | 19:00 |
| rlandy|ruck | not sure that will help | 19:01 |
| ade_lee | yes - I see the ssh_config file and it looks like its correct | 19:01 |
| ade_lee | how do I get to the console for the ipa node? | 19:02 |
| rlandy|ruck | ade_lee: is the extra node also c9? | 19:02 |
| ade_lee | maybe? | 19:02 |
| * rlandy|ruck checks logs | 19:04 | |
| rlandy|ruck | CentOS-Stream-GenericCloud-9-20211216 - as undercloud_image | 19:06 |
| rlandy|ruck | looking for stack | 19:06 |
| rlandy|ruck | yea - blank node that we boot onto | 19:07 |
| dviroel | ade_lee: hey, sorry, didn't see your ping | 19:07 |
| rlandy|ruck | ade_lee: getting you console access | 19:09 |
| ade_lee | dviroel, rlandy|ruck , dasm anyways - found the issue with https://bugs.launchpad.net/tripleo/+bug/1956563 | 19:31 |
| dasm | what is it? | 19:31 |
| ade_lee | turns out that for these c9 images, the magic user is cloud-user not centos | 19:31 |
| rlandy|ruck | ysandeep|out: fyi ... https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-integration-rhos-16.2/opendev.org/openstack/tripleo-ci/429c8be0933ff08272b4347f9b4aa08db72888e5/periodic-tripleo-ci-rhel-8-ovb-1ctlr_2comp-featureset020-internal-rhos-16.2/abd17fc/logs/undercloud/var/log/tempest/stestr_results.html.gz | 19:32 |
| rlandy|ruck | fs020 failure - rerunning | 19:32 |
| dasm | oh... | 19:32 |
| ade_lee | thats the user with the authroized_key etc. | 19:32 |
| rlandy|ruck | ade_lee: sorry - sec - need to get 16.2 promoted | 19:32 |
| dasm | yeah. that makes difference | 19:32 |
| rlandy|ruck | before tomorrow | 19:32 |
| ade_lee | rlandy|ruck, no worries - now that ya;ll know the problem, should be easy to fix. | 19:32 |
| rlandy|ruck | ade_lee: yeah - we should be able to redefine supplemental_user | 19:33 |
| rlandy|ruck | dasm: ^^ | 19:33 |
| ade_lee | rlandy|ruck, gonna leave it to you guys to decide how you want to do it. | 19:33 |
| rlandy|ruck | ade_lee: ack | 19:33 |
| dasm | ade_lee: thanks! | 19:33 |
| rlandy|ruck | dasm: will show you the review in a few | 19:34 |
| dviroel | ade_lee: great finding | 19:36 |
| ade_lee | dviroel, yeah , super convenient of them to change that | 19:39 |
| rlandy|ruck | dviroel: do you know where to redefine that var? | 19:40 |
| rlandy|ruck | if do, please show dasm | 19:40 |
| rlandy|ruck | if not will do it in a few | 19:40 |
| dviroel | i don't, but i can find | 19:43 |
| dasm | tripleo-quickstart/config/general_config/ipa.yml:53:supplemental_user: stack | 19:43 |
| dasm | this one looks like obvious candidate for a change | 19:43 |
| dviroel | https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/freeipa-setup/defaults/main.yml#L7 | 19:44 |
| dviroel | another place ^ | 19:44 |
| dviroel | need to dig into a little bit | 19:44 |
| dasm | based on previous findings wrt ansible not able to ssh | 19:44 |
| dasm | oh. we have few placed to do the same? :( | 19:44 |
| dasm | (probably there is a reason behind that, but looks confusing) | 19:44 |
| dasm | https://codesearch.opendev.org/?q=supplemental_user&i=nope&literal=nope&files=&excludeFiles=&repos= | 19:46 |
| dviroel | there are the default values for roles, but there are also featureset specific vars | 19:50 |
| dviroel | are these users different on C8 and C9? | 19:50 |
| dasm | in that case, are we talking about general config or featureset specific? | 19:50 |
| dasm | i *think* all Centoses have the same user. | 19:51 |
| dasm | but it also begs for a question -- why it sometimes work, and sometimes does nto. | 19:51 |
| dasm | *not | 19:51 |
| rlandy|ruck | https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/general_config/featureset039.yml#L247 | 19:53 |
| rlandy|ruck | dasm: dviroel: ^^ | 19:53 |
| rlandy|ruck | you can try switch case that | 19:53 |
| rlandy|ruck | per ansible distro version | 19:53 |
| dasm | ok, per featureset then | 19:53 |
| rlandy|ruck | randome | 19:54 |
| rlandy|ruck | random | 19:54 |
| dviroel | now curious about 'supplemental_image_url' | 19:54 |
| rlandy|ruck | depends which one takes preference | 19:54 |
| dviroel | didn't see any centos9 set for it | 19:54 |
| dviroel | in codesearch | 19:54 |
| rlandy|ruck | well for starters we can flat change the user | 19:55 |
| dviroel | nothing in rdo codesearch | 19:55 |
| rlandy|ruck | DNM patch add it to ananya's testproject | 19:55 |
| rlandy|ruck | and see if that helps | 19:55 |
| * rlandy|ruck tries | 19:56 | |
| rcastillo|rover | rlandy|ruck: config fix tp done running https://review.rdoproject.org/r/c/testproject/+/38105 | 20:11 |
| rcastillo|rover | nvm just saw #tripleo | 20:11 |
| rlandy|ruck | rcastillo|rover: open to either solution | 20:12 |
| rlandy|ruck | you tell me :) | 20:12 |
| rcastillo|rover | We should go for the config change for sure | 20:17 |
| rcastillo|rover | especially since this seems like intended behavior from ping | 20:18 |
| rlandy|ruck | rcastillo|rover: k - so let's vote on that and get it through | 20:35 |
| rcastillo|rover | sure, have my humble +1 | 20:35 |
| rlandy|ruck | ha - tox linter failure | 20:36 |
| rcastillo|rover | oops | 20:39 |
| rlandy|ruck | updated | 20:45 |
| rlandy|ruck | let's hope the default holds | 20:46 |
| * rcastillo|rover goes to lunch | 20:59 | |
| *** dviroel is now known as dviroel|out | 21:36 | |
| * dasm dasm|off | 21:45 | |
| *** dasm is now known as dasm|off | 21:45 | |
| rcastillo|rover | back | 22:01 |
| strider | rlandy|ruck: https://review.rdoproject.org/r/c/openstack/validations-libs-distgit/+/38100 from matbu is fixing the pathlib issue for py2 | 22:03 |
| strider | dpeacock: still around? | 22:04 |
| rlandy|ruck | strider: ack | 22:05 |
| strider | just need to find someone with +2 power now | 22:05 |
| rlandy|ruck | rcastillo|rover: lol forget it's lunch time by you | 22:05 |
| rlandy|ruck | dark here already | 22:06 |
| rlandy|ruck | strider: ack - I don't have that | 22:06 |
| rlandy|ruck | rcastillo|rover: rechecking https://review.rdoproject.org/r/c/testproject/+/38105 - just to make sure I didn't mess with the results | 22:08 |
| rcastillo|rover | sure, let's be safe | 22:08 |
| strider | rlandy|ruck: you should be able to do it now. | 22:12 |
| rlandy|ruck | strider: thanks for the powers :) | 22:14 |
| rlandy|ruck | strider: will someone get angry if I just w+ this? | 22:14 |
| strider | noooo | 22:14 |
| rlandy|ruck | ok - here we go | 22:14 |
| rlandy|ruck | strider: and looking at the patch ... python%{pyver} | 22:15 |
| rlandy|ruck | oh ok - I can see %if %{pyver} == 2 | 22:16 |
| rlandy|ruck | deed is done | 22:17 |
| strider | thanks! | 22:18 |
| rlandy|ruck | ysandeep|out: 16.2 promoted - but I had to restart promoter service | 23:36 |
| rlandy|ruck | ysandeep|out: retriggered glance | 23:39 |
| rlandy|ruck | validation just started - retriggered as well | 23:40 |
| *** rlandy|ruck is now known as rlandy|ruck|bbl | 23:45 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!