| *** jmasud has quit IRC | 00:13 | |
| *** jmasud has joined #oooq | 00:13 | |
| *** rlandy has quit IRC | 01:34 | |
| *** dsneddon has quit IRC | 02:46 | |
| *** rfolco has quit IRC | 02:53 | |
| *** apetrich has quit IRC | 03:12 | |
| *** beagles_rpm_mode has quit IRC | 03:52 | |
| *** jmasud has quit IRC | 03:54 | |
| *** jmasud has joined #oooq | 03:59 | |
| *** skramaja has joined #oooq | 04:06 | |
| *** udesale has joined #oooq | 04:23 | |
| *** ykarel|away is now known as ykarel | 04:26 | |
| *** ratailor has joined #oooq | 05:03 | |
| bhagyashris | 45218 | 05:31 |
|---|---|---|
| bhagyashris | sent mistakenly | 05:31 |
| *** d0ugal has quit IRC | 05:46 | |
| *** d0ugal has joined #oooq | 05:46 | |
| *** raukadah is now known as chandankumar | 06:03 | |
| *** marios|ruck has joined #oooq | 06:05 | |
| *** jfrancoa has joined #oooq | 06:37 | |
| *** saneax has joined #oooq | 07:00 | |
| chandankumar | ykarel, https://review.opendev.org/#/c/709560/ | 07:03 |
| chandankumar | ykarel, https://review.opendev.org/#/q/topic:c8imagebuild+(status:open+OR+status:merged) | 07:04 |
| ykarel | chandankumar, ack will check | 07:06 |
| ykarel | chandankumar, i was referring https://review.opendev.org/#/c/709664/ for u-c usage | 07:06 |
| ykarel | hmm right only master jobs are running | 07:07 |
| ykarel | ohhk but that jobs runs in stable/stein train too so needs a fix | 07:10 |
| ykarel | infact queens rocky too | 07:10 |
| *** dpawlik has joined #oooq | 07:26 | |
| chandankumar | ykarel, please add the fix for other branches? | 07:31 |
| ykarel | chandankumar, fix would be same | 07:31 |
| ykarel | i mean same patch should work for all branches | 07:31 |
| ykarel | i proposed https://review.opendev.org/709666 to test it for all realeases | 07:32 |
| chandankumar | ykarel, cool, thanks! | 07:33 |
| *** ykarel is now known as ykarel|lunch | 07:41 | |
| chandankumar | marios|ruck, Hello | 07:43 |
| marios|ruck | o/ chandankumar | 07:43 |
| chandankumar | marios|ruck, fedora 30 podman job was broken https://review.rdoproject.org/zuul/builds?project=containers%2Flibpod&job_name=podman-package-fedora-30 | 07:44 |
| chandankumar | marios|ruck, the fix is here https://github.com/containers/libpod/pull/5312 | 07:45 |
| chandankumar | marios|ruck, sharing in advance if you might see that | 07:45 |
| marios|ruck | chandankumar: wonderful news thanks! | 07:46 |
| marios|ruck | chandankumar: thanks mate i will note it for now on etherpad | 07:46 |
| *** bogdando has joined #oooq | 07:50 | |
| *** tosky has joined #oooq | 08:04 | |
| *** ccamacho has joined #oooq | 08:05 | |
| *** jmasud has quit IRC | 08:12 | |
| *** jmasud has joined #oooq | 08:15 | |
| *** tesseract has joined #oooq | 08:23 | |
| marios|ruck | ykarel|lunch: can you add related-bug https://review.opendev.org/#/c/709664/1 and lets merge looks good result https://review.opendev.org/#/c/709666/2 | 08:26 |
| *** ykarel|lunch is now known as ykarel | 08:28 | |
| ykarel | marios|ruck, okk adding | 08:28 |
| *** Tengu has quit IRC | 08:30 | |
| *** Tengu has joined #oooq | 08:32 | |
| *** jpena|off is now known as jpena | 08:32 | |
| *** amoralej|off is now known as amoralej | 08:33 | |
| chandankumar | ykarel, thanks! | 08:33 |
| *** yolanda__ is now known as yolanda | 09:00 | |
| *** udesale has quit IRC | 09:07 | |
| *** chem has joined #oooq | 09:18 | |
| *** apetrich has joined #oooq | 09:22 | |
| chandankumar | sshnaidm, Hello | 09:23 |
| chandankumar | sshnaidm, Do we want to run new fs01 c8 jobs on vexxhost or on rdocloud? | 09:24 |
| chandankumar | jpena, Hello | 09:36 |
| chandankumar | jpena, please have a look at these ovb nodeset https://review.rdoproject.org/r/#/c/25332/2/zuul.d/nodesets.yaml | 09:37 |
| chandankumar | it is giving node_failure | 09:37 |
| chandankumar | jfrancoa, can you check what is going wrong? | 09:37 |
| chandankumar | sorry | 09:38 |
| chandankumar | jpena, ^6 | 09:38 |
| ykarel | chandankumar, that ovb label does not exist https://review.rdoproject.org/zuul/labels | 09:40 |
| ykarel | u need to create it first, or u already proposed? | 09:40 |
| chandankumar | ykarel, ah, the label comes from sf config repo na? | 09:40 |
| ykarel | chandankumar, yes | 09:40 |
| sshnaidm | chandankumar, we want to run on both I think | 09:52 |
| chandankumar | sshnaidm, I am currently using this https://github.com/openstack/tripleo-ci/blob/master/zuul.d/nodesets.yaml#L21 as ovb c8 node | 09:53 |
| sshnaidm | chandankumar, that's fine I think, you can try upstream-centos-8 as well | 09:55 |
| chandankumar | sshnaidm, marios|ruck on c8 standalone plain and scenario 3 are passing | 10:02 |
| chandankumar | 1,2 and 4 are failing at different errors | 10:02 |
| chandankumar | https://logserver.rdoproject.org/29/25329/4/check/periodic-tripleo-ci-centos-8-scenario001-standalone-master/e5f467a/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 10:02 |
| chandankumar | https://logserver.rdoproject.org/29/25329/4/check/periodic-tripleo-ci-centos-8-scenario002-standalone-master/72e3421/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 10:02 |
| chandankumar | https://logserver.rdoproject.org/29/25329/4/check/periodic-tripleo-ci-centos-8-scenario004-standalone-master/83e5958/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 10:03 |
| marios|ruck | chandankumar: ack thanks noting will get some food and check ina bit | 10:03 |
| chandankumar | marios|ruck, these are c8 stuffs | 10:03 |
| sshnaidm | chandankumar, in 004 Destination directory /etc/docker does not exist | 10:05 |
| sshnaidm | it's with manila etc | 10:05 |
| chandankumar | sshnaidm, 1 and 4 ceph related | 10:06 |
| chandankumar | yes 4 is with manial | 10:06 |
| chandankumar | sshnaidm, I am looking at collectd missing container | 10:06 |
| sshnaidm | chandankumar, I think need to remove cli docker from there, how rhel8 004 is configured | 10:06 |
| sshnaidm | chandankumar, where is a patch? | 10:06 |
| marios|ruck | chandankumar: k | 10:07 |
| chandankumar | sshnaidm, https://review.rdoproject.org/r/#/c/25329/ | 10:07 |
| sshnaidm | panda, https://review.rdoproject.org/r/#/c/25326/ | 10:07 |
| chandankumar | going to put all patches in a etherpad to avoid confusion | 10:07 |
| sshnaidm | chandankumar, I'd rather copy or inherit from rhel8 jobs definitions | 10:09 |
| sshnaidm | chandankumar, it's more or like how centos8 jobs should like | 10:09 |
| chandankumar | sshnaidm, yes let me do that | 10:11 |
| sshnaidm | panda, I need you to look at new promoter, it doesn't work for me. When trying to promote rocky it take all possible hashes except the right one: http://38.102.83.109/centos7_rocky.log | 10:39 |
| sshnaidm | panda, tell me when you are available to do it, currently it blocks vexx stuff | 10:43 |
| panda | sshnaidm: and which one is the right one ? | 10:44 |
| sshnaidm | panda, https://trunk.rdoproject.org/centos7-rocky/tripleo-ci-testing/delorean.repo | 10:44 |
| sshnaidm | panda, https://trunk.rdoproject.org/api-centos-rocky/api/civotes_detail.html?commit_hash=dd8d8b52c7702852e93498cf7551667f05cc4568&distro_hash=c26f6cfcc8fc315363b1c156667aac05fe38de35 | 10:45 |
| sshnaidm | panda, I excluded 020 from promotion criteria on the host | 10:45 |
| panda | sshnaidm: 2020-02-25 10:35:06,451 5447 INFO promoter Skipping promotion of centos7-rocky from tripleo-ci-testing to current-tripleo, missing successful jobs: [u'periodic-tripleo-centos-7-rocky-containers-build-push'] | 10:49 |
| panda | should be renamed tp periodic-tripleo-centos-7-rocky-containers-build-push-vexxhost | 10:49 |
| sshnaidm | panda, cool, thanks | 10:49 |
| sshnaidm | maybe worth to make it more visible in logds | 10:51 |
| sshnaidm | panda, http://38.102.83.109/centos7_rocky.log fatal: [localhost]: FAILED! => {"msg": "Unexpected failure in finding the lookup named '{{ source_registry_images.stdout_lines }}' in the available lookup plugins"} | 10:53 |
| panda | sshnaidm: what version of ansible is installed ? | 10:54 |
| chandankumar | sshnaidm, added all c8 patches here https://hackmd.io/HrQd03c9SxOMtFPFrq50tg?view | 10:54 |
| sshnaidm | panda, 2.4.2.0.. that's old | 10:55 |
| panda | sshnaidm: so you didn't use the provision playbook to provision the server. It may be broken but it's still a good base. | 10:55 |
| panda | sshnaidm: Noted about the logs. But the first phase is just a discrete refactor of the old logic, I wanted to maintain as much as possible. The next phase will have more logs | 10:56 |
| sshnaidm | panda, if you mean the promoter role, it was running there | 10:56 |
| sshnaidm | panda, I mean this one https://github.com/rdo-infra/ci-config/tree/master/ci-scripts/infra-setup/roles/promoter | 10:58 |
| panda | sshnaidm: one of the first tasks there is installing epel and then ansible so we getn ansible 2.8 | 10:58 |
| sshnaidm | panda, where? | 10:59 |
| sshnaidm | panda, here? https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/promoter/tasks/main.yml#L103:L103 - it's state "present", doesn't update if exists | 11:01 |
| sshnaidm | and it definitely exists because we install it: https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/tenant_vars/tripleo-infra/servers.yml#L71:L71 | 11:02 |
| panda | sshnaidm: the full chain of provisioning was never tested. We can simulate a provision starting from previous playbook and add a test in molecule to check ansible version now. But first we need to fix rdo-tox-molecule. | 11:04 |
| sshnaidm | panda, well, I'm testing it right now.. | 11:05 |
| panda | sshnaidm: yes, manually, in production, so we know a fix can work for that server, and today. The test will ensure in a short amount of time this will not happen again. | 11:07 |
| sshnaidm | panda, if we fix all this right now, I can reinstall the server and try again, so we can be sure it works | 11:08 |
| sshnaidm | it's too much hacks there already | 11:08 |
| sshnaidm | it would be the best integration test | 11:08 |
| panda | sshnaidm: it would a good production test. Not being automatically repeateble, and needing the time to test it manually, I can't agree on the definition of "best" | 11:12 |
| sshnaidm | panda, but this is only tests that ensures it works as required, so yes, it IS the best test | 11:13 |
| *** udesale has joined #oooq | 11:17 | |
| panda | sshnaidm: are you testing other releases ? other distro promotion ? are you testing the single and the aggregate pipelines ? are you testing when we fail to pull containers and see what happens ? are you testing when we push manifests, when we don't ? when we have a timout in dlrn server ? You can't possibily test every possible combination of execution in the code manually in a reasonable time. So I stand with | 11:19 |
| panda | my definition. Manual production tests are good and necessary, because are the closes to the production, and tst thing we can't elsewhere. But they will not be complete. Hardly deserves the "best" adjective. | 11:19 |
| sshnaidm | panda, yep, all this will be tested, as I deploy a production actually | 11:25 |
| sshnaidm | panda, I'm not against autotests, only for it, but it doesn't guarantee you're free of bugs and can deploy without issues | 11:26 |
| sshnaidm | but it makes breakages less possible | 11:26 |
| sshnaidm | panda, and definitely better than no tests at all | 11:27 |
| ykarel | chandankumar, collectd didn't built https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-8-master-containers-build-push/506af46/logs/containers-successfully-built.log | 11:33 |
| ykarel | chandankumar, possibly due to https://github.com/openstack/kolla/blob/ceae02f09d1c4e67013485c7323c11f8655c9c1e/kolla/image/build.py#L146 | 11:34 |
| ykarel | we have that package in rdo trunk repo now, so can try to build it https://trunk.rdoproject.org/centos8-master/deps/opstools/collectd/x86_64/Packages/ | 11:36 |
| *** pojadhav is now known as pojadhav|afk | 11:48 | |
| amoralej | ykarel, i guess that should be buildable now | 11:48 |
| amoralej | we could test it with kolla patch | 11:48 |
| ykarel | amoralej, yes, u mean to test with http://38.145.34.66/delorean-deps-c8.repo? | 11:52 |
| ykarel | or u planning tu update delorean-deps.repo in centos8 trunk deps | 11:53 |
| amoralej | ykarel, current deps repo is still consolidated one, so it can be tested with repos as-is | 11:53 |
| amoralej | content in http://38.145.34.66/delorean-deps-c8.repo should be exactly the same as the existing repos config in kolla | 11:54 |
| ykarel | amoralej, hmm right then we should be good | 11:54 |
| ykarel | chandankumar, u proposing patch for this? | 11:54 |
| ykarel | https://github.com/openstack/kolla/blob/ceae02f09d1c4e67013485c7323c11f8655c9c1e/kolla/image/build.py#L146 | 11:55 |
| chandankumar | ykarel, propose a patch and pass the link | 11:55 |
| ykarel | chandankumar, asking me to propose that? | 11:56 |
| ykarel | ok doing | 11:56 |
| *** rfolco has joined #oooq | 11:58 | |
| ykarel | chandankumar, https://review.opendev.org/709701 | 12:00 |
| *** jpena is now known as jpena|lunch | 12:01 | |
| *** amoralej is now known as amoralej|lunch | 12:01 | |
| chandankumar | sshnaidm, https://review.rdoproject.org/r/25335 ovb fix for c8 https://logserver.rdoproject.org/32/25332/4/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/d1637dc/job-output.txt | 12:14 |
| sshnaidm | chandankumar, you need to create centos-8.yml in vars | 12:16 |
| chandankumar | sshnaidm, If i remove family then we can reuse the redhat-8.yml var? | 12:17 |
| sshnaidm | chandankumar, no, it's bad idea | 12:18 |
| chandankumar | ok | 12:18 |
| chandankumar | let me create that | 12:18 |
| sshnaidm | chandankumar, they may (and will) differ | 12:18 |
| chandankumar | sshnaidm, done | 12:23 |
| sshnaidm | chandankumar, thanks | 12:25 |
| chandankumar | let's merge that then we can recheck the job | 12:25 |
| *** ykarel is now known as ykarel|afk | 12:29 | |
| rfolco | chandankumar, sshnaidm panda zbr: please review https://review.rdoproject.org/r/#/q/status:open+project:rdo-infra/ci-config+branch:master+topic:get-hash-molecule --> molecule tests for get_hash role. More tests coming... | 12:30 |
| zbr | wow, my foo change worked :D | 12:31 |
| zbr | https://review.rdoproject.org/r/#/c/25270/ | 12:31 |
| zbr | time to give it a description and merge it. | 12:32 |
| rfolco | zbr, and change topic please | 12:32 |
| rfolco | zbr, will review it | 12:32 |
| zbr | rfolco: in fact the topic is correct, i made it for you. | 12:33 |
| rfolco | zbr, this is for rdo-tox-molecule (promoter role), not get_hash | 12:33 |
| rfolco | zbr, it's ok, thanks for fixing molecule jobs :) | 12:34 |
| zbr | not really, is fixing the broken promoter ones. | 12:34 |
| rfolco | yes | 12:34 |
| rfolco | thats what I meant | 12:34 |
| zbr | done, updated it. | 12:39 |
| *** jbadiapa has joined #oooq | 12:40 | |
| *** ratailor has quit IRC | 12:52 | |
| *** holser has joined #oooq | 12:57 | |
| *** sshnaidm is now known as sshnaidm|bbl | 12:59 | |
| ykarel|afk | amoralej|lunch, chandankumar it failed in kolla jobs:- https://2f2cf5041b1c89bd619e-afd92f42827c905443f6faed27a01096.ssl.cf1.rackcdn.com/709701/1/check/kolla-build-centos8-binary/a625ebe/kolla/build/000_FAILED_collectd.log | 12:59 |
| *** ykarel|afk is now known as ykarel | 12:59 | |
| ykarel | they enable epel in there jobs | 12:59 |
| ykarel | Problem: cannot install both collectd-5.8.1-8.el8.x86_64 and collectd-5.9.0-5.el8.x86_64 | 13:00 |
| ykarel | tripleo job should pass though | 13:00 |
| chandankumar | ykarel, it is running still | 13:00 |
| *** rlandy has joined #oooq | 13:00 | |
| rlandy | chandankumar: panda: hi - sync meeting | 13:01 |
| rlandy | arxcruz: zbr: ^^ if interested | 13:01 |
| panda | rlandy: d'oh | 13:02 |
| chandankumar | rlandy, piled all patches at one place https://hackmd.io/HrQd03c9SxOMtFPFrq50tg?view related to c8 | 13:03 |
| ykarel | chandankumar, collectd build in tripleo job https://logserver.rdoproject.org/64/25064/10/check/periodic-tripleo-centos-8-master-containers-build-push-test/e972225/logs/containers-successfully-built.log | 13:09 |
| ykarel | to clear it in kolla needs something else | 13:09 |
| *** jpena|lunch is now known as jpena | 13:15 | |
| *** amoralej|lunch is now known as amoralej | 13:17 | |
| chandankumar | rlandy, https://logserver.rdoproject.org/29/25329/6/check/periodic-tripleo-ci-centos-8-scenario001-standalone-master/73ea538/ | 13:17 |
| chandankumar | https://logserver.rdoproject.org/29/25329/6/check/periodic-tripleo-ci-centos-8-scenario002-standalone-master/db3962e/ | 13:18 |
| chandankumar | https://logserver.rdoproject.org/29/25329/6/check/periodic-tripleo-ci-centos-8-scenario003-standalone-master/e6fc366/ | 13:18 |
| chandankumar | https://logserver.rdoproject.org/29/25329/6/check/periodic-tripleo-ci-centos-8-scenario004-standalone-master/973af23/ | 13:18 |
| amoralej | ykarel, it may make sense to remove epel | 13:18 |
| amoralej | from that container | 13:18 |
| zbr | rfolco: are you rebasing your ci-config patches? | 13:18 |
| rfolco | yes | 13:19 |
| rfolco | right now | 13:19 |
| ykarel | amoralej, u mean remove usage of epel completely from kolla or just remove epel repo? | 13:19 |
| zbr | rfolco: super, i guess panda is doing the same his his . | 13:19 |
| amoralej | ykarel, i mean just removing it in that particular container | 13:19 |
| amoralej | there is some magic in kolla to enable/disable repos on each container | 13:19 |
| ykarel | amoralej, they enable epel in base container install collectd(5.9), disable epel | 13:20 |
| chandankumar | rlandy, https://hackmd.io/4K_NU1PxSDiTYGecnAZNCA | 13:20 |
| ykarel | now collectd-sensubility from RDO needs collectd-5.8 | 13:20 |
| chandankumar | https://review.rdoproject.org/r/#/c/25329/ | 13:21 |
| *** holser has quit IRC | 13:24 | |
| *** holser has joined #oooq | 13:25 | |
| *** marios|ruck is now known as marios|ruck|call | 13:31 | |
| panda | marios|ruck|call: anyone in the community meeting yet ? | 13:32 |
| marios|ruck|call | panda: me u arxcruz | 13:33 |
| *** marios|ruck|call is now known as marios|ruck | 13:33 | |
| marios|ruck | panda: dropped | 13:33 |
| panda | marios|ruck: care to rejoin ? | 13:35 |
| marios|ruck | panda: thanks | 13:36 |
| *** marios|ruck is now known as marios|ruck|call | 13:36 | |
| *** beagles has joined #oooq | 13:48 | |
| zbr | please review https://review.rdoproject.org/r/#/c/25154/ -- enables us to create molecule delegated jobs using centos-8 nodesets. | 13:52 |
| *** ChanServ sets mode: +o panda | 13:57 | |
| *** panda changes topic to "next promoter patch in the chain to review: https://review.rdoproject.org/r/25270" | 13:57 | |
| *** panda changes topic to "Docs: https://docs.openstack.org/tripleo-quickstart/latest/ || next promoter patch in the chain to review: https://review.rdoproject.org/r/24684" | 13:58 | |
| chandankumar | saneax, https://logserver.rdoproject.org/32/25332/5/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/41aa32d/job-output.txt | 13:59 |
| chandankumar | sorry | 13:59 |
| chandankumar | sshnaidm|bbl, https://logserver.rdoproject.org/32/25332/5/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/41aa32d/job-output.txt | 13:59 |
| chandankumar | rlandy, weshay|ruck result from ovb https://logserver.rdoproject.org/32/25332/5/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/41aa32d/job-output.txt | 13:59 |
| rlandy | https://review.opendev.org/#/c/709560/ | 14:00 |
| *** marios|ruck|call is now known as marios|ruck | 14:01 | |
| chandankumar | rlandy, 2020-02-25 13:38:45.371231 | primary | undercloud_image: CentOS-7-x86_64-GenericCloud | 14:05 |
| rlandy | chandankumar: k - can fix that ... | 14:06 |
| chandankumar | rlandy, https://opendev.org/openstack/openstack-virtual-baremetal/src/branch/master/environments/base.yaml#L79 | 14:06 |
| rlandy | chandankumar: you can set that .... getting | 14:07 |
| chandankumar | rlandy, Ok please go ahead , I am heading home | 14:07 |
| rlandy | chandankumar: sure | 14:08 |
| *** dsneddon has joined #oooq | 14:10 | |
| rlandy | chandankumar: https://github.com/rdo-infra/review.rdoproject.org-config/blob/a472941282ff21c1f49fd730d1d344abd7ff4735/roles/ovb-manage/defaults/main.yml | 14:10 |
| rlandy | we need to switch case for centos 8 | 14:10 |
| rlandy | ot set it in the job itself | 14:10 |
| rlandy | editing the job | 14:10 |
| *** pojadhav|afk is now known as pojadhav | 14:22 | |
| rlandy | chandankumar: also checking the nodeset ... | 14:24 |
| rlandy | tripleo-ovb-centos-7 | 14:24 |
| *** Goneri has joined #oooq | 14:24 | |
| rlandy | we have playbooks that run on that :) | 14:24 |
| *** TrevorV has joined #oooq | 14:41 | |
| weshay|ruck | marios|ruck, anything you need to raise to my attention? | 14:42 |
| marios|ruck | weshay|ruck: not really stuff is on the etherpad. new today ismaster/train failing tempests filed bugs/skiplist etc all there | 14:43 |
| weshay|ruck | k.. thanks | 14:43 |
| weshay|ruck | marios|ruck, if things slow down a bit.. please try to spend some time unblocking rdo phase 1 | 14:44 |
| marios|ruck | weshay|ruck: yea i did spend some time there today i added comment at https://bugs.launchpad.net/tripleo/+bug/1863632/comments/7 and tried v3 @ https://review.opendev.org/#/c/708791 but no luck (installing pip first) | 14:44 |
| openstack | Launchpad bug 1863632 in tripleo "lastest virtenv workarounds broke native tripleo-quickstart install" [Critical,Triaged] | 14:44 |
| weshay|ruck | k | 14:45 |
| marios|ruck | weshay|ruck: i was waiting to see results there will revisit it | 14:45 |
| weshay|ruck | marios|ruck, I guess we could put the sudo back into the install-deps.. but I don't think that will fix it either | 14:45 |
| * weshay|ruck will try | 14:45 | |
| *** ykarel is now known as ykarel|away | 14:46 | |
| weshay|ruck | zbr, let me know if we need to chat about v | 14:47 |
| weshay|ruck | https://bugzilla.redhat.com/show_bug.cgi?id=1790174 | 14:47 |
| openstack | bugzilla.redhat.com bug 1790174 in python-virtualenv "virtualenv activate chokes when run from bash scripts in strict mode due to missing PS1" [Medium,Closed: wontfix] - Assigned to python-maint | 14:47 |
| marios|ruck | weshay|ruck: i came across that one today seemed possibly related fyi (added in the comment on bug) https://github.com/pypa/virtualenv/issues/1630 but looked to me like we have new enough versions of pip/venv/ etc mentioned there | 14:50 |
| marios|ruck | weshay|ruck: i know ours isn't 'missing zipp' but we are installing some version of zipp as workaround in the depends-on | 14:50 |
| *** jaosorior has joined #oooq | 14:55 | |
| weshay|ruck | rfolco, what does !!null do? https://review.rdoproject.org/r/#/c/25324/4/ci-scripts/infra-setup/roles/get_hash/tasks/get_hash.yaml | 15:02 |
| rfolco | weshay|ruck, resets var to None | 15:02 |
| weshay|ruck | rfolco, never seen that.. code comments would be helpful | 15:02 |
| rfolco | there is no way to reset vars in ansible | 15:02 |
| chandankumar | rlandy, I am back | 15:03 |
| rfolco | so between tests we can set !!null to unset it | 15:03 |
| rlandy | chandankumar: debugging error | 15:03 |
| weshay|ruck | k.. please get that in the comments | 15:03 |
| rlandy | 2020-02-25 14:47:03.154886 | TASK [ovb-manage : Attach instance to provision OVB network] | 15:03 |
| rlandy | 2020-02-25 14:47:06.185745 | primary | No server with a name or ID of '75501abf-e7aa-4274-9ba7-d637b98e1d20' exists. | 15:03 |
| rlandy | 2020-02-25 14:47:06.705920 | primary | ERROR | 15:03 |
| rlandy | 2020-02-25 14:47:06.706258 | primary | { | 15:03 |
| rlandy | ^^ problem | 15:03 |
| rfolco | weshay|ruck, ok will do | 15:03 |
| rlandy | changed the nodeset | 15:03 |
| rlandy | the undercloud flavor does not matter | 15:03 |
| rlandy | we use the nodepool node as the undercloud | 15:04 |
| rlandy | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/ovb-manage/tasks/ovb-create-stack.yml#L85 | 15:04 |
| rlandy | ^^ fail | 15:04 |
| weshay|ruck | rfolco, can you please stub out in remarked out code.. what osp-17 may look like https://review.rdoproject.org/r/#/c/25242/ | 15:04 |
| chandankumar | rlandy, I have never touched that peice of code | 15:05 |
| rlandy | me neither - changed a lot since I touched it :) | 15:05 |
| rlandy | but running again to watch the tenant | 15:05 |
| rlandy | it can't find the undercloud node | 15:05 |
| rlandy | now we know the issue | 15:05 |
| rlandy | watching the tenant on rerun | 15:05 |
| chandankumar | rlandy, ok, cool | 15:06 |
| rfolco | weshay|ruck, oops I changed the condition but forgot to change the comment | 15:06 |
| chandankumar | rfolco, weshay|ruck https://review.rdoproject.org/r/25330 component criteria | 15:06 |
| weshay|ruck | panda, zbr this is the current state of our tests? https://review.rdoproject.org/r/#/c/25330/ | 15:07 |
| weshay|ruck | tripleo-ci-promotion-stagingFAILURE in 4m 57s (non-voting) | 15:08 |
| weshay|ruck | tripleo-ci-promotion-staging-legacyFAILURE in 5m 08s (non-voting) | 15:08 |
| weshay|ruck | molecule-container-pushRETRY_LIMIT in 3m 18s | 15:08 |
| weshay|ruck | molecule-tripleo-commonRETRY_LIMIT in 3m 23s | 15:08 |
| weshay|ruck | thanks chandankumar | 15:08 |
| chandankumar | rlandy, https://review.rdoproject.org/r/#/c/25329/ for standalone s1-4 I will be not creating parent I will create seperate jov definition for centos-8 | 15:08 |
| *** saneax has quit IRC | 15:09 | |
| panda | weshay|ruck: no, they are all passing now | 15:09 |
| zbr | weshay|ruck: REBASE | 15:09 |
| panda | weshay|ruck: like in https://review.rdoproject.org/r/24687 | 15:10 |
| zbr | with folco change we should have 100% pass on ci-config | 15:10 |
| weshay|ruck | :) | 15:10 |
| *** panda changes topic to "Docs: https://docs.openstack.org/tripleo-quickstart/latest/ || next promoter patch in the chain to review: https://review.rdoproject.org/r/24687" | 15:10 | |
| rlandy | wow - a lot of cruft in our tenant | 15:10 |
| *** panda sets mode: -o panda | 15:10 | |
| weshay|ruck | panda, please fix the merge conflict in https://review.rdoproject.org/r/#/c/24687/ | 15:11 |
| weshay|ruck | and we'll get it merged | 15:11 |
| weshay|ruck | today | 15:11 |
| *** ChanServ sets mode: +o panda | 15:12 | |
| *** panda changes topic to "Docs: https://docs.openstack.org/tripleo-quickstart/latest/ || 25th Feb promoter patch MERGED https://review.rdoproject.org/r/24686 || next promoter patch in the chain to review: https://review.rdoproject.org/r/24687" | 15:13 | |
| panda | weshay|ruck: maybe the topic is more specific now | 15:13 |
| rlandy | oh dear - arewe creating ovb stack and and centos08 nodes is diff tenants????? | 15:15 |
| zbr | weshay|ruck: re https://review.rdoproject.org/r/#/c/25242/ -- is that really a bug or a missing part? if is not a bug, I would workflow it and improve later. | 15:15 |
| rlandy | chandankumar: ^^ | 15:15 |
| rlandy | checking with infra | 15:15 |
| chandankumar | rlandy, may be sshnaidm|bbl knows | 15:15 |
| rlandy | no - it's a tenant allocation thing | 15:16 |
| rlandy | we changed this with tristan last week | 15:16 |
| weshay|ruck | zbr, I'm only asking for code comments | 15:16 |
| weshay|ruck | zbr, will merge it when they are in | 15:16 |
| zbr | rfolco: ^ please update, i want to merge that one. | 15:17 |
| weshay|ruck | zbr, he's going on pto.. so I need rfolco to consider it so we can be in his head while he's at carnival | 15:17 |
| rfolco | weshay|ruck, zbr: updated patch | 15:18 |
| zbr | that is why I want to merge it, as I know he is going away. i do not want to keep that job broken even one more hour. | 15:19 |
| zbr | nv code rots quickly :D | 15:19 |
| zbr | if we do not merge it, it will stink for miles when he is back :D | 15:19 |
| *** skramaja has quit IRC | 15:21 | |
| chandankumar | weshay|ruck, rlandy sshnaidm|bbl https://softwarefactory-project.io/r/#/c/17511/ nodepool: remove the cache-devstack element will affect our job | 15:22 |
| rfolco | zbr, https://review.rdoproject.org/r/#/c/25242/ would you revote please | 15:22 |
| rfolco | I'll rebase the following ones and update comments | 15:23 |
| rlandy | hmmm .... | 15:23 |
| chandankumar | rlandy, nothing found in our codebase may be we are safe there | 15:24 |
| rlandy | sec - just debugging on rhos-ops | 15:24 |
| chandankumar | weshay|ruck, marios|ruck from tomorrow we start filing bugs for centos-8 failures? and make it fix | 15:25 |
| chandankumar | *cix | 15:26 |
| *** irclogbot_1 has quit IRC | 15:27 | |
| rfolco | zbr, pls +w https://review.rdoproject.org/r/#/c/25242/ | 15:27 |
| *** irclogbot_2 has joined #oooq | 15:27 | |
| rfolco | if its ok | 15:27 |
| marios|ruck | chandankumar: k | 15:28 |
| zbr | rfolco: i am not +W when I know there are nv job ;) but watching it. | 15:30 |
| zbr | as soon, i see voted, i +W. as i have few other changes waiting to be rebased. | 15:30 |
| chandankumar | rlandy, let me know when you get free, I want to talk about parenting | 15:32 |
| *** rfolco has quit IRC | 15:32 | |
| chandankumar | one hour later will also work | 15:32 |
| rlandy | k - just tracking down ovb ... I think it's here ... https://softwarefactory-project.io/cgit/config/tree/nodepool/rdo-cloud.yaml | 15:33 |
| chandankumar | panda, need one help | 15:54 |
| chandankumar | panda, can we promote all promoted components to toci testing | 15:54 |
| chandankumar | ? | 15:55 |
| chandankumar | panda, reason https://logserver.rdoproject.org/97/24997/10/check/tripleo-centos-8-buildimage-overcloud-full/1e6a071/overcloud-full.log | 15:55 |
| panda | one help ? | 15:56 |
| *** panda sets mode: -o panda | 15:56 | |
| panda | chandankumar: I can give half help, where are my bitcoins ? | 15:56 |
| chandankumar | panda, you still not send the details | 15:56 |
| chandankumar | *sent | 15:56 |
| panda | rlandy: weshay|ruck manually promoting c8-master repo from promoted-components to tripleo-ci-testing | 15:57 |
| rlandy | do we need to? | 15:58 |
| rlandy | we did that yesterday | 15:58 |
| rlandy | if so, we need to push containers | 15:58 |
| * panda on hold | 15:59 | |
| rlandy | Im ok with it if we update conatiners | 15:59 |
| rlandy | otherwise testing is off | 15:59 |
| chandankumar | rlandy, in build images we donot need containers | 16:00 |
| chandankumar | rlandy, Cannot download python3-gnocchiclient-7.0.4-0.20191218114145.64814b9.el8.noarch.rpm: All mirrors were tried | 16:00 |
| chandankumar | rlandy, may be currently promoting all components I am not sure current testproject changes promotes all | 16:01 |
| chandankumar | weshay|ruck, rlandy do you know from where we set ceph | 16:02 |
| chandankumar | 2020-02-25 15:47:30.620489 | primary | TASK [standalone : update container ceph parameters] *************************** | 16:02 |
| chandankumar | 2020-02-25 15:47:30.686531 | primary | Tuesday 25 February 2020 15:47:30 +0000 (0:00:00.709) 0:06:37.154 ****** | 16:02 |
| chandankumar | 2020-02-25 15:47:31.347280 | primary | ok: [undercloud] => (item={'original': 'ceph_namespace', 'replace': 'ceph_namespace: docker.io/ceph'}) | 16:02 |
| chandankumar | 2020-02-25 15:47:31.831542 | primary | ok: [undercloud] => (item={'original': 'ceph_image', 'replace': 'ceph_image: daemon'}) | 16:02 |
| chandankumar | 2020-02-25 15:47:32.363679 | primary | ok: [undercloud] => (item={'original': 'ceph_tag', 'replace': 'ceph_tag: v4.0.8-stable-4.0-nautilus-centos-7-x86_64'}) | 16:02 |
| rlandy | chandankumar: a couple things ... | 16:02 |
| *** Trevor_V has joined #oooq | 16:03 | |
| rlandy | https://review.rdoproject.org/r/#/c/25064/ | 16:05 |
| rlandy | you can promote with that job | 16:05 |
| rlandy | chandankumar: ^^ it will update and then push updated containers | 16:05 |
| rlandy | chandankumar: does that work for you? | 16:05 |
| rlandy | wrt ceph ... | 16:05 |
| * panda canceled | 16:05 | |
| chandankumar | rlandy, if that works, I am ok | 16:06 |
| rlandy | that's how we promoted before | 16:06 |
| rlandy | chandankumar: besides it's free ... I hear panda charges :) | 16:06 |
| *** TrevorV has quit IRC | 16:07 | |
| rlandy | wrt - ceph - you can edit the ceph parameters in container params setup ... | 16:07 |
| rlandy | chandankumar: see how we do that in osp ... | 16:07 |
| rlandy | http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/config/release/rhos-16.yml#n78 | 16:08 |
| chandankumar | rlandy, ah I need to add that in release file | 16:12 |
| chandankumar | will take care of that tomorrow | 16:12 |
| chandankumar | currently watching sceanrio 01 job | 16:12 |
| chandankumar | and it failed | 16:12 |
| rlandy | chandankumar: ok - I rechecked ovb | 16:13 |
| rlandy | it's still queued | 16:13 |
| chandankumar | rlandy, yes, great | 16:13 |
| rlandy | which may be an issue :) | 16:13 |
| rlandy | idk - we will have to get those quotas sorted | 16:13 |
| chandankumar | running out of nodes? | 16:13 |
| rlandy | chandankumar: want to talk parenting? | 16:13 |
| chandankumar | rlandy, yes | 16:13 |
| rlandy | I assigned the label to another tenant | 16:13 |
| rlandy | that may not have nodes available | 16:14 |
| chandankumar | rlandy, https://meet.google.com/vhf-uogj-zfg?pli=1&authuser=0 | 16:15 |
| chandankumar | rlandy, https://review.rdoproject.org/r/#/c/25329/7/zuul.d/standalone-jobs.yaml | 16:17 |
| *** fmount has quit IRC | 16:23 | |
| *** fmount has joined #oooq | 16:24 | |
| *** rfolco has joined #oooq | 16:27 | |
| *** bogdando has quit IRC | 16:28 | |
| *** jaosorior has quit IRC | 16:28 | |
| rfolco | zbr, weshay|ruck thanks for reviewing | 16:31 |
| rfolco | more 2 to go | 16:31 |
| rfolco | https://review.rdoproject.org/r/#/c/25245/ and I am fixing https://review.rdoproject.org/r/#/c/25324/ | 16:31 |
| rfolco | zbr, weshay|ruck ^ this one is very tiny, good to merge ? | 16:31 |
| zbr | rfolco: weshay|ruck : https://review.rdoproject.org/r/#/c/24937/ READY | 16:32 |
| zbr | it brings the HTML report file into zuul ui, so we do not have to dig to find it. | 16:33 |
| rfolco | zbr, needs rebase | 16:33 |
| zbr | ouch, missed that by seconds. | 16:34 |
| weshay|ruck | zbr, wait.. zuul may just do it | 16:34 |
| weshay|ruck | zbr, rdo sf gerrit is weird | 16:35 |
| weshay|ruck | heh.. nvrmind | 16:35 |
| zbr | i hope everyone is seeing the speed of testing and merging stuff when we have tests | 16:36 |
| zbr | when we have unit/func-tests, we can make many small changes, easier to review, less risk merging them. | 16:36 |
| chandankumar | rlandy, weshay|ruck once ceph-ansible issues get cleared, I hope scenario 1 and 4 will be green, then I need to worry about scenario 2 | 16:37 |
| rlandy | ok | 16:37 |
| chandankumar | scenario 2 may be due to openstackclient version mismatch | 16:37 |
| weshay|ruck | jebus | 16:41 |
| marios|ruck | weshay|ruck: tried re-add sudo posted v10 @ https://review.opendev.org/#/c/708264/ fyi let's see what that does :/ | 16:42 |
| weshay|ruck | zbr, rfolco please review https://review.rdoproject.org/r/#/c/24687/ | 16:42 |
| weshay|ruck | marios|ruck, thank you | 16:42 |
| marios|ruck | weshay|ruck: np :/ did some digging there will try again tomorrow but that one needs to die already | 16:43 |
| weshay|ruck | zbr, that was pretty quick ;P | 16:44 |
| marios|ruck | weshay|ruck: getting ready to disappear in few etherpad/trello etc updated to current time | 16:44 |
| zbr | is not the fist time i see it | 16:44 |
| weshay|ruck | marios|ruck, k | 16:44 |
| weshay|ruck | zbr, k :) | 16:44 |
| zbr | also all these unitests give me more confidence | 16:45 |
| panda | THey are there exactly for this, they do part of the reviewer job. | 16:47 |
| *** marios|ruck is now known as marios|out | 16:53 | |
| rfolco | zbr, https://review.rdoproject.org/r/#/c/25245/ | 16:54 |
| *** tesseract has quit IRC | 16:54 | |
| chandankumar | rlandy, No server with a name or ID of 'dfdddfa8-0f61-4743-bfd1-3b64ad170b3f' exists. | 16:56 |
| chandankumar | rlandy, again failed | 16:57 |
| chandankumar | rlandy, we need sshnaidm|bbl help | 16:57 |
| rlandy | looking | 16:59 |
| rlandy | | 94a4707a-23c5-4fe5-b102-5f3ec7306e8b | upstream-centos-8-rdo-cloud-tripleo-0002400532 | ACTIVE | private=192.168.100.50, 38.145.32.252 | upstream-centos-8-1582609837 | ci.m1.nodepool | | 17:00 |
| rlandy | we got one there ... | 17:00 |
| rfolco | zbr, nm, need to rebase one patch before that one | 17:01 |
| *** marios|out has quit IRC | 17:02 | |
| rlandy | chandankumar: so in centos 7 jobs ... the first case works ... Find out UUID of instance with metadata | 17:04 |
| rlandy | 2020-02-25 13:16:57.312960 | TASK [ovb-manage : Find out UUID of instance with metadata URL] | 17:04 |
| rlandy | 2020-02-25 13:16:58.484276 | primary | b72cb055-7dc3-46b2-a656-b56440cee6a8 | 17:04 |
| rlandy | 2020-02-25 13:16:58.863203 | primary | ok: Runtime: 0:00:00.977776 | 17:04 |
| chandankumar | rlandy, that part is failing in centos 8 | 17:04 |
| *** udesale has quit IRC | 17:04 | |
| rlandy | yes - so it goes to the second part | 17:04 |
| rlandy | which may return a diff value | 17:04 |
| rlandy | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/ovb-manage/tasks/find_undercloud_uuid.yml | 17:04 |
| rlandy | mnt/config/openstack/latest/meta_data.json | 17:05 |
| rlandy | as opposed to http://169.254.169.254/openstack/latest/meta_data.json | 17:05 |
| rlandy | sshnaidm|bbl: ^^ opinion here pls | 17:05 |
| chandankumar | zbr, panda rfolco arxcruz weshay|ruck sshnaidm|bbl tomorrow rlandy and I will be making final decision on c8 parenting, looking forward your ideas | 17:07 |
| weshay|ruck | chandankumar, you will not be making a final decision alone my friend | 17:08 |
| weshay|ruck | chandankumar, s/I/We | 17:08 |
| chandankumar | weshay|ruck, we need to come on conclusion together, | 17:08 |
| weshay|ruck | :) | 17:08 |
| chandankumar | so that we can achieve our new child shaping | 17:08 |
| zbr | chandankumar: parenting which jobs? | 17:10 |
| zbr | which category of jobs | 17:10 |
| chandankumar | zbr, https://hackmd.io/4K_NU1PxSDiTYGecnAZNCA | 17:10 |
| chandankumar | arxcruz, sshnaidm|bbl panda rfolco more context here https://hackmd.io/4K_NU1PxSDiTYGecnAZNCA | 17:12 |
| panda | chandankumar: I am pro-choice. | 17:13 |
| chandankumar | amoralej, jpena ykarel|away need your views also https://hackmd.io/4K_NU1PxSDiTYGecnAZNCA s | 17:14 |
| rlandy | the rhel ovb jobs also use the first metadata one | 17:16 |
| rlandy | so that must be the right one | 17:16 |
| chandankumar | rlandy, weshay|ruck one odd query https://review.rdoproject.org/zuul/builds?pipeline=openstack-promote-component%20 | 17:19 |
| chandankumar | is this one expected? | 17:19 |
| chandankumar | it got executed yesterday | 17:19 |
| rlandy | chandankumar: yep | 17:20 |
| rlandy | executes once a day | 17:20 |
| chandankumar | ok | 17:20 |
| rfolco | zbr, panda weshay|ruck rlandy: rebased and added comments for !!null (actually I removed it from the role, just left the var reset in molecule) | 17:23 |
| rfolco | https://review.rdoproject.org/r/#/q/status:open+project:rdo-infra/ci-config+branch:master+topic:get-hash-molecule | 17:23 |
| chandankumar | panda, rfolco how can I make bulk promotion by modifying this config https://review.rdoproject.org/r/#/c/25330/ till we get full pipeline ready? | 17:23 |
| rfolco | please merge them if READY | 17:23 |
| chandankumar | bulk == all components | 17:24 |
| weshay|ruck | FYI.. after speaking to amoralej I will be removing rhel8 and a significant portion of the centos-7 jobs from the master pipeline | 17:25 |
| weshay|ruck | chandankumar, rlandy ^ | 17:25 |
| rlandy | ok | 17:26 |
| chandankumar | weshay|ruck, ok, looking forward | 17:26 |
| chandankumar | weshay|ruck, but we need to make c8 containers build permanent na? | 17:26 |
| chandankumar | before that | 17:26 |
| chandankumar | in periodic | 17:26 |
| weshay|ruck | everything is pinned.. so we need just enough to confirm tripleo has not broken itself | 17:26 |
| chandankumar | weshay|ruck, hard to say since all is pinned | 17:27 |
| weshay|ruck | centos-8 timing w/ merging patches is not the factor.. it's the pinning | 17:27 |
| weshay|ruck | chandankumar, aye | 17:27 |
| rfolco | zbr, chandankumar argh... too late on https://review.rdoproject.org/r/#/c/25330/? | 17:28 |
| rfolco | not sure where this is used | 17:30 |
| * chandankumar out will look tomorrrow | 17:30 | |
| rfolco | but it should be api_url: https://trunk.rdoproject.org/api-centos-master-uc | 17:30 |
| rfolco | api_url: https://trunk.rdoproject.org/api-centos8-master-uc | 17:30 |
| rfolco | the latter | 17:30 |
| rlandy | weshay|ruck: do you still have that handy centos 8 box around? | 17:32 |
| chandankumar | rfolco, zbr done | 17:32 |
| weshay|ruck | rlandy, have one locally and one in rdo-cloud | 17:32 |
| weshay|ruck | you can use either.. | 17:33 |
| chandankumar | see ya people tomorrow | 17:34 |
| rlandy | weshay|ruck: the one in rdocloud ... | 17:34 |
| rlandy | need to run this ... | 17:34 |
| chandankumar | rfolco, when you are returning back? | 17:34 |
| chandankumar | from holidays | 17:34 |
| rlandy | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/ovb-manage/tasks/find_undercloud_uuid.yml#L4 | 17:34 |
| rfolco | chandankumar, march 23 | 17:34 |
| rlandy | {{ ansible_python.executable }} -c 'import json, sys; print(json.load(sys.stdin)["uuid"])' | 17:34 |
| rlandy | it fails | 17:34 |
| chandankumar | rfolco, aye | 17:34 |
| rlandy | I need to know why | 17:34 |
| weshay|ruck | k.. getting | 17:35 |
| chandankumar | have a nice day & night ahead | 17:35 |
| *** chandankumar is now known as raukadah | 17:35 | |
| rlandy | rfolco: when is your last day? | 17:35 |
| rfolco | rlandy, tomorrow | 17:35 |
| raukadah | rfolco, you are not leaving us? | 17:35 |
| raukadah | rfolco, we love you, please come back soon | 17:36 |
| rfolco | folks I have 20 day vacations to take, just that. And this week is carnival... I should be off today, naked and drunk dancing in the street | 17:36 |
| rfolco | but I am here | 17:36 |
| rfolco | :) | 17:36 |
| raukadah | hehe | 17:36 |
| zbr | rfolco: weshay|ruck https://review.rdoproject.org/r/#/c/25159/ READY | 17:36 |
| rfolco | I can work on Thu too, to handoff work or something | 17:37 |
| rfolco | if needed | 17:37 |
| rfolco | I don't take ptos since may 2018 | 17:37 |
| rfolco | looooong time ago | 17:37 |
| rfolco | I lie. Jan 2019. | 17:38 |
| rfolco | anyway, need PTO. My body is waiting for it | 17:38 |
| raukadah | rlandy, weshay|ruck https://review.opendev.org/709039 -workdir option got merged, do we want to integrate with container build? | 17:38 |
| weshay|ruck | rlandy, what's ur pub key https://github.com/rlandy.keys | 17:39 |
| weshay|ruck | hrm.. github keys is not working? | 17:40 |
| rlandy | sent | 17:40 |
| weshay|ruck | raukadah, yes we need to... but it may default to tmp | 17:40 |
| weshay|ruck | in which case we'll pick it up for free in logs | 17:41 |
| rfolco | zbr, +2 | 17:41 |
| raukadah | rlandy, https://review.rdoproject.org/r/25330 last review no more bug | 17:43 |
| raukadah | +w it | 17:43 |
| rlandy | ha - works on the test box | 17:43 |
| rlandy | cool | 17:43 |
| rlandy | will add others to that | 17:44 |
| rlandy | weshay|ruck: it works fins on your test box | 17:44 |
| weshay|ruck | rlandy, what does? | 17:44 |
| raukadah | weshay|ruck, rlandy we need to work more tomorrow https://logserver.rdoproject.org/29/25329/8/check/periodic-tripleo-ci-centos-8-scenario001-standalone-master/a72e9ac/logs/delorean_logs/bd/54/bd54b1bd5611a1166ddcc8813ef7614168ad48d0_dev/rpmbuild.log.txt.gz | 17:44 |
| rlandy | weshay|ruck: the json command | 17:45 |
| raukadah | depends on build test packages doesnot work | 17:45 |
| raukadah | ykarel|away, jpena https://logserver.rdoproject.org/29/25329/8/check/periodic-tripleo-ci-centos-8-scenario001-standalone-master/a72e9ac/logs/delorean_logs/bd/54/bd54b1bd5611a1166ddcc8813ef7614168ad48d0_dev/rpmbuild.log.txt.gz | 17:45 |
| * rlandy waits for sshnaidm|bbl | 17:53 | |
| weshay|ruck | raukadah, wait.. build-test-packages is busted? | 17:54 |
| * weshay|ruck looks | 17:54 | |
| weshay|ruck | raukadah, ack. .see it | 17:55 |
| ykarel|away | raukadah, ack, hmm it would need fixes then | 17:55 |
| *** jpena is now known as jpena|off | 17:55 | |
| weshay|ruck | ykarel|away, raukadah I wish centos/rhel would get their shit together | 17:55 |
| ykarel|away | raukadah, https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/build-test-packages/tasks/main.yml#L145 | 17:56 |
| ykarel|away | weshay|ruck, could differ | 17:56 |
| ykarel|away | weshay|ruck, see https://github.com/softwarefactory-project/DLRN/tree/master/scripts | 17:56 |
| ykarel|away | centos.cfg, centos8.cfg and redhat.cfg | 17:56 |
| raukadah | weshay|ruck, ykarel|away and i will get rid of that tomorrow | 17:58 |
| *** sshnaidm|bbl is now known as sshnaidm | 18:04 | |
| rlandy | sshnaidm: hey ... | 18:04 |
| sshnaidm | rlandy, hi | 18:04 |
| rlandy | sshnaidm: we're testing centos 8 with ovb jobs ... | 18:04 |
| rlandy | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/ovb-manage/tasks/find_undercloud_uuid.yml#L4 fails out ... | 18:04 |
| rlandy | https://logserver.rdoproject.org/32/25332/6/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/718eb69/job-output.txt | 18:05 |
| rlandy | The job conyinues | 18:05 |
| weshay|ruck | ykarel|away, raukadah I'll post a change for build-test-packages.. get out of there | 18:05 |
| weshay|ruck | here | 18:05 |
| rlandy | continues and reports | 18:05 |
| weshay|ruck | for the day.. | 18:05 |
| weshay|ruck | will send a link | 18:05 |
| rlandy | from this task ... TASK [ovb-manage : Find out UUID of instance with metadata file] | 18:05 |
| sshnaidm | rlandy, Find out UUID of instance with metadata file] | 18:06 |
| sshnaidm | 2020-02-25 15:34:04.342780 | primary | f1abd005-98f1-4af6-9cc7-0b912d2af044 | 18:06 |
| sshnaidm | rlandy, ID could be fine in 2 places, the second worked.. | 18:06 |
| rlandy | right but that node is not found later ... | 18:07 |
| sshnaidm | rlandy, ok, need to look why | 18:07 |
| rlandy | getting other log ... | 18:07 |
| sshnaidm | rlandy, seems like wrong ID | 18:07 |
| rlandy | yeah | 18:07 |
| rlandy | so I thought that node was in the other tenant | 18:07 |
| ykarel|away | weshay|ruck, raukadah ack | 18:07 |
| * ykarel|away out | 18:08 | |
| sshnaidm | rlandy, yeah, maybe | 18:08 |
| sshnaidm | rlandy, where is the job definition? | 18:08 |
| rlandy | so I added the option to run upstream-centos-8 in the same tenant | 18:08 |
| rlandy | https://review.rdoproject.org/r/#/c/25332/ | 18:08 |
| rlandy | https://logserver.rdoproject.org/32/25332/6/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/718eb69/job-output.txt other log | 18:09 |
| rlandy | before added to tenant | 18:09 |
| rlandy | https://review.rdoproject.org/zuul/stream/ddc13dc67b074068a15f69ba1a8edea9?logfile=console.log | 18:10 |
| rlandy | one running now | 18:10 |
| sshnaidm | rlandy, ok, so it's like rhel8 problem we had | 18:10 |
| sshnaidm | when running node in different tenant | 18:10 |
| rlandy | sshnaidm: yep - so I suspected that ... see #rhos-ops | 18:11 |
| rlandy | what did you do to fix it? | 18:11 |
| sshnaidm | rlandy, defining node in the right tenant? | 18:11 |
| sshnaidm | nodeset I mean | 18:11 |
| rlandy | https://softwarefactory-project.io/cgit/config/tree/nodepool/rdo-cloud.yaml | 18:12 |
| rlandy | see ... | 18:12 |
| rlandy | https://softwarefactory-project.io/cgit/config/tree/nodepool/rdo-cloud.yaml#n526 | 18:12 |
| rlandy | well 539 | 18:12 |
| rlandy | added here as well ... | 18:13 |
| rlandy | https://softwarefactory-project.io/cgit/config/tree/nodepool/rdo-cloud.yaml#n356 | 18:13 |
| rlandy | it seems that the first way errors | 18:13 |
| rlandy | which should return the the right node | 18:14 |
| rlandy | the second way passes | 18:14 |
| rlandy | returning the wrong node | 18:14 |
| sshnaidm | rlandy, there are so many duplication, that I hardly understand what is going on.. | 18:15 |
| rlandy | let's start with rdo-infra/review.rdoproject.org-config/blob/master/roles/ovb-manage/tasks/find_undercloud_uuid.yml#L4 | 18:16 |
| sshnaidm | rlandy, metadata server could be up or down | 18:18 |
| sshnaidm | rlandy, that's why we have 2 ways | 18:18 |
| sshnaidm | rlandy, let's see a running job in real time | 18:21 |
| rlandy | so then we are back to the undercloud and the stack in two diff tenants | 18:21 |
| rlandy | 2020-02-25 18:05:14.367393 | TASK [ovb-manage : Attach instance to provision OVB network] | 18:21 |
| rlandy | 2020-02-25 18:05:17.059371 | primary | No server with a name or ID of '16c8de1f-92ad-49c5-9b52-0f910f76224c' exists. | 18:21 |
| rlandy | ssh - feel free to rekick | 18:21 |
| rlandy | rekicking https://review.rdoproject.org/r/#/c/25332/ | 18:21 |
| weshay|ruck | rlandy, sshnaidm fyi https://review.rdoproject.org/r/#/c/25355/ | 18:22 |
| rlandy | need to add criteria for other pipeline jobs ... | 18:23 |
| sshnaidm | rlandy, ok, I don't see any centos8 host running on rdo cloud tenant | 18:26 |
| sshnaidm | rlandy, all of them run on a different tenant | 18:26 |
| rlandy | other than https://softwarefactory-project.io/cgit/config/tree/nodepool/rdo-cloud.yaml, I am not sure where those nodes get asisgned | 18:30 |
| weshay|ruck | rlandy, sshnaidm so the issue raukadah and ykarel|away were hitting is that dlrn client is not using dnf on centos-8 | 18:33 |
| weshay|ruck | it's not a ci code issue, unless we preinstall yum on centos-8 | 18:33 |
| * weshay|ruck looks at dlrn code | 18:33 | |
| rlandy | weshay|ruck: in what job? | 18:34 |
| rlandy | lost in ovb atm | 18:34 |
| weshay|ruck | rlandy, continue ovb :) | 18:34 |
| * weshay|ruck just spitting out some details when you have time to absorb.. then think about it for a sec | 18:34 | |
| rlandy | ugh ... so many issues | 18:35 |
| rlandy | weshay|ruck: we must look at the release file review before EOD today will ping you | 18:35 |
| rlandy | I fixed the centos7 issue | 18:35 |
| weshay|ruck | :) | 18:35 |
| rlandy | and broke the linters /o\ | 18:35 |
| weshay|ruck | ha ha | 18:36 |
| weshay|ruck | that's what you get for not drinking w/ me | 18:36 |
| rlandy | you right - I deserved that | 18:37 |
| weshay|ruck | zbr, easy fix on rebase here.. was going to do it for you https://review.rdoproject.org/r/#/c/25165/5/zuul.d/layout.yaml | 18:52 |
| weshay|ruck | but.. not sure of one thing | 18:52 |
| *** amoralej is now known as amoralej|off | 18:53 | |
| zbr | weshay|ruck: any reson to be worried about https://review.opendev.org/#/c/709579/ ? | 19:13 |
| zbr | i kinda like the direction. | 19:13 |
| weshay|ruck | lolz | 19:15 |
| weshay|ruck | zbr, if they can preinstall a virt env.. and confirm all the deps.. wfm | 19:25 |
| weshay|ruck | zbr, I guess the question is how are they testing it | 19:25 |
| zbr | that is a WIP, slowly progressing but progressing | 19:25 |
| zbr | some of my patches merged and i didn't get any negative feedback so far. | 19:26 |
| zbr | but the move towards non-messing the original system, is clearly something desirable. | 19:26 |
| zbr | the fact that python3 will be available on any supported system, is opening lots of doors | 19:26 |
| zbr | including ditching the need for virtualenv | 19:27 |
| zbr | as we have venv instead, which is compatible enough. | 19:27 |
| *** sshnaidm has quit IRC | 19:28 | |
| *** sshnaidm has joined #oooq | 19:28 | |
| weshay|ruck | zbr, geez another rebase https://review.rdoproject.org/r/#/c/25165/ | 19:29 |
| weshay|ruck | rfolco, need any more reviews? | 19:29 |
| weshay|ruck | rlandy, sshnaidm looks like dlrn is only building packages on centos-7 | 19:30 |
| weshay|ruck | it's not updated for 8 | 19:30 |
| weshay|ruck | the mock is centos-7 | 19:30 |
| sshnaidm | weshay|ruck, nice | 19:31 |
| sshnaidm | weshay|ruck, no mock for 8? | 19:31 |
| *** holser has quit IRC | 19:31 | |
| rlandy | we added mock in our release files for centos 8 | 19:32 |
| rlandy | so yeah - not there by default | 19:32 |
| weshay|ruck | must be a config change | 19:33 |
| rfolco | weshay|ruck, zbr rlandy these 3 | 19:35 |
| rfolco | https://review.rdoproject.org/r/#/q/status:open+project:rdo-infra/ci-config+branch:master+topic:get-hash-molecule | 19:35 |
| rlandy | ok | 19:35 |
| rfolco | 1) fix legacy 2) get real 3) testcase | 19:36 |
| rfolco | this order | 19:36 |
| rfolco | ^ | 19:36 |
| rfolco | weshay|ruck, rlandy panda zbr | 19:36 |
| *** apetrich has quit IRC | 19:37 | |
| zbr | i am afraid is too late for me to press the +W | 19:37 |
| rlandy | sec ... fixing https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/config/CentOS-8/component/master.yaml | 19:37 |
| rlandy | wrong | 19:37 |
| rfolco | weshay|ruck, if you can w+ https://review.rdoproject.org/r/#/c/25244/ then https://review.rdoproject.org/r/#/c/25245/ | 19:38 |
| rfolco | just one will be missing in this series | 19:38 |
| rfolco | the testcase one https://review.rdoproject.org/r/#/c/25324/ | 19:38 |
| rlandy | rfolco: what is this file supposed to be doing? https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/config/CentOS-8/component/master.yaml | 19:42 |
| rlandy | weshay|ruck: ^^ which job should pick this up? | 19:43 |
| rlandy | promlted-components to tripleo-ci-testing? | 19:43 |
| weshay|ruck | rlandy, ya | 19:44 |
| rlandy | or component-ci-testing to promoted-components? | 19:44 |
| weshay|ruck | rlandy, well.. in the component promotion | 19:44 |
| weshay|ruck | oh wait | 19:44 |
| rlandy | that's not right | 19:44 |
| weshay|ruck | this is wrong.. | 19:44 |
| rlandy | yes | 19:44 |
| * rlandy is trying to fix it | 19:44 | |
| weshay|ruck | should component-ci-testing -> promoted-components | 19:44 |
| weshay|ruck | I swear | 19:44 |
| rlandy | pls don't | 19:44 |
| rfolco | ouch | 19:45 |
| rlandy | that goes to componentici-testing | 19:45 |
| rlandy | to be picked up by periodic-tripleo-centos-8-master-component-compute-promote-to-promoted-components | 19:46 |
| rlandy | correct??? | 19:46 |
| rlandy | rfolco: ^^ do you agree that periodic-tripleo-centos-8-master-component-compute-promote-to-promoted-components uses this file? | 19:46 |
| rfolco | rlandy, it must use a criteria file right? | 19:48 |
| rlandy | rfolco: does periodic-tripleo-centos-8-master-component-compute-promote-to-promoted-components use a job or some yaml somewhere? | 19:48 |
| * rlandy forgets | 19:48 | |
| rfolco | I need to revisit this, if it was me, I forgot it too | 19:49 |
| rlandy | https://github.com/rdo-infra/review.rdoproject.org-config/blob/1c724108394f3aa0e37f710b418c2d052b0bcdd4/zuul.d/tripleo-rdo-base.yaml#L288 | 19:50 |
| rlandy | ^^ job | 19:50 |
| rlandy | definitley goes | 19:50 |
| rlandy | promote_source: component-ci-testing | 19:50 |
| rlandy | promote_target: promoted-components | 19:50 |
| rfolco | tuns this playbooks/tripleo-ci-base-promote-hash/run.yaml | 19:51 |
| rlandy | tasks_from: check-promotion-criteria.yaml | 19:52 |
| rlandy | when: promote_target == 'promoted-components' | 19:52 |
| rlandy | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/promote-hash/tasks/check-promotion-criteria.yaml | 19:53 |
| rlandy | criteria_base_path: "{{ rdo_infra_ci_config }}/ci-scripts/dlrnapi_promoter/config" | 19:53 |
| rfolco | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/promote-hash/tasks/check-promotion-criteria.yaml#L33 | 19:53 |
| rfolco | yes that one | 19:54 |
| rfolco | brb | 19:54 |
| rlandy | so it is | 19:54 |
| rlandy | ok - fixing | 19:54 |
| rfolco | those values in the release file are not used for component promotion I think | 20:07 |
| rfolco | but they are wrong anyway | 20:07 |
| rlandy | https://review.rdoproject.org/r/25359 Fix criteria file to promote to promoted-components | 20:09 |
| rlandy | weshay|ruck: rfolco: ^^ | 20:09 |
| rfolco | rlandy, this also will fail https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/promote-hash/tasks/check-promotion-criteria.yaml#L59 | 20:09 |
| rfolco | rlandy, this should use consistent as source promote label | 20:10 |
| rfolco | line 81 too | 20:10 |
| rlandy | rfolco: that will be a problem | 20:10 |
| rlandy | in one file | 20:10 |
| rfolco | jeez | 20:10 |
| rlandy | might want to rethink this | 20:10 |
| rfolco | yep | 20:10 |
| rlandy | look at the file itself | 20:11 |
| weshay|ruck | what's the issue? | 20:11 |
| weshay|ruck | rfolco, consistent? | 20:11 |
| weshay|ruck | why? | 20:11 |
| weshay|ruck | no no | 20:11 |
| weshay|ruck | this is the file that the component promote job will check for criteria | 20:12 |
| weshay|ruck | consistent -> component-ci-testing doesn't need any criteria | 20:12 |
| weshay|ruck | and shouldn't use any | 20:12 |
| rlandy | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/roles/promote-hash/tasks/check-promotion-criteria.yaml#L59 | 20:13 |
| rlandy | wrong | 20:13 |
| rlandy | ugh | 20:13 |
| weshay|ruck | I'm not completely in context | 20:13 |
| weshay|ruck | oh I see what ur pointing out | 20:14 |
| *** jfrancoa has quit IRC | 20:14 | |
| rlandy | let's chat | 20:14 |
| weshay|ruck | rfolco, you wrote the doc on this no? | 20:14 |
| weshay|ruck | https://meet.google.com/zpq-jsuu-irm?authuser=1 | 20:14 |
| *** rfolco has quit IRC | 20:54 | |
| rlandy | weshay|ruck: this looks good now ... https://logserver.rdoproject.org/60/25360/1/check/periodic-tripleo-centos-8-master-component-compute-promote-to-promoted-components/718d8ac/ | 20:57 |
| weshay|ruck | very good | 20:59 |
| *** Trevor_V has quit IRC | 21:00 | |
| sshnaidm | weshay|ruck, promoter SUCCESS promoting centos7-rocky tripleo-ci-testing as current-tripleo | 21:41 |
| weshay|ruck | sshnaidm, shut the fuck up | 21:43 |
| weshay|ruck | NICE | 21:43 |
| * weshay|ruck looks | 21:43 | |
| weshay|ruck | sshnaidm++ | 21:45 |
| weshay|ruck | sshnaidm, nice work | 21:47 |
| sshnaidm | weshay|ruck, I configure rocky jobs to run on vexx then | 21:49 |
| sshnaidm | weshay|ruck, mean promotion ones | 21:49 |
| weshay|ruck | aye | 21:49 |
| weshay|ruck | sshnaidm, was that promotion from test jobs running in rdo or vexx? | 21:50 |
| weshay|ruck | either way.. good progress just curious | 21:50 |
| weshay|ruck | and updating status to program call | 21:51 |
| sshnaidm | weshay|ruck, on vexx, in patch: https://review.rdoproject.org/r/#/c/25299/4/zuul.yaml | 21:51 |
| weshay|ruck | nice.. rock on | 21:51 |
| weshay|ruck | sshnaidm, go to sleep will catch you tomorrow | 21:51 |
| sshnaidm | sure | 21:51 |
| *** rfolco has joined #oooq | 22:07 | |
| *** jmasud has quit IRC | 22:08 | |
| *** ysandeep is now known as ysandeep|afk | 22:20 | |
| *** ysandeep|afk is now known as ysandeep | 22:23 | |
| *** jmasud has joined #oooq | 22:28 | |
| *** jmasud has quit IRC | 22:35 | |
| *** jmasud has joined #oooq | 22:36 | |
| rlandy | hello OVB | 23:04 |
| *** jmasud has quit IRC | 23:14 | |
| *** jmasud has joined #oooq | 23:16 | |
| *** jmasud has quit IRC | 23:17 | |
| rlandy | what's the right way to get yum vs dnf? | 23:17 |
| *** jmasud has joined #oooq | 23:28 | |
| *** Goneri has quit IRC | 23:32 | |
| *** jmasud has quit IRC | 23:35 | |
| *** tosky has quit IRC | 23:52 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!