*** tosky has quit IRC | 00:11 | |
*** chem has joined #oooq | 00:33 | |
*** jmasud has quit IRC | 00:38 | |
*** jmasud has joined #oooq | 00:58 | |
*** rlandy|bbl is now known as rlandy | 02:31 | |
rlandy | weshay|ruck: thanks | 02:31 |
---|---|---|
*** irclogbot_3 has quit IRC | 02:52 | |
*** irclogbot_3 has joined #oooq | 02:54 | |
rlandy | chandankumar: 16.2 is looking good so far - may be able to promote there | 03:00 |
rlandy | chandankumar: pls review https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/778561 ... needed to get BM passing | 03:02 |
*** rlandy has quit IRC | 03:02 | |
*** jmasud has quit IRC | 03:33 | |
*** saneax has joined #oooq | 03:57 | |
*** jmasud has joined #oooq | 04:28 | |
*** ratailor has joined #oooq | 04:37 | |
*** ykarel has joined #oooq | 04:38 | |
*** ratailor_ has joined #oooq | 04:59 | |
*** ratailor__ has joined #oooq | 05:02 | |
*** ratailor has quit IRC | 05:03 | |
*** ratailor_ has quit IRC | 05:06 | |
*** ykarel has quit IRC | 05:50 | |
*** ykarel has joined #oooq | 05:53 | |
*** udesale has joined #oooq | 05:55 | |
*** marios has joined #oooq | 06:07 | |
*** ykarel_ has joined #oooq | 06:08 | |
*** ykarel has quit IRC | 06:10 | |
*** ykarel_ is now known as ykarel | 06:10 | |
*** slaweq has joined #oooq | 06:59 | |
*** jpodivin has joined #oooq | 07:52 | |
*** jmasud has quit IRC | 08:14 | |
*** jmasud has joined #oooq | 08:28 | |
bhagyashri|rover | arxcruz, how the containers are pushed to quay.io | 08:42 |
bhagyashri|rover | arxcruz, are they checking this hash https://trunk.rdoproject.org/centos7-stein/current-tripleo/delorean.repo before pushing the containers? | 08:44 |
*** jpena|off is now known as jpena | 08:54 | |
*** derekh has joined #oooq | 09:14 | |
marios | chandankumar: please votes when you have time https://review.opendev.org/q/ca603f39b6d612fd2950cd7d7eb84ae3e2cecff9 | 09:16 |
marios | and anyone else around please ^^^ cherrypick v/u/t | 09:16 |
*** tosky has joined #oooq | 09:23 | |
marios | thank you chandankumar | 09:42 |
akahat | ykarel, o/ | 09:44 |
akahat | ykarel, could you please hold node. review: https://review.rdoproject.org/r/#/c/32069/ , Job: tox-py36-ci-config | 09:45 |
akahat | ssh public key github.com/amolkahat.keys add any key | 09:45 |
akahat | thanks :) | 09:45 |
akahat | chandankumar, ^^ | 09:47 |
marios | sudo get me a coffee | 09:49 |
chandankumar | coffee command not found | 09:51 |
marios | :( /me gets up goes to kitchen | 09:51 |
chandankumar | https://xkcd.com/378/ | 09:53 |
marios | haha chandankumar :) | 09:54 |
chandankumar | akahat: ^^ for you | 09:55 |
chandankumar | jpena: hello, can you hold the node for tox-py36-ci-config https://review.rdoproject.org/r/#/c/32069/ and github.com/amolkahat.keys | 09:56 |
chandankumar | jpena: thanks! | 09:56 |
jpena | chandankumar: done, ssh zuul@38.102.83.20 | 10:00 |
chandankumar | akahat: ^^ | 10:01 |
chandankumar | jpena: thanks :-) | 10:01 |
akahat | chandankumar, jpena thanks :) | 10:01 |
ykarel | akahat, just back from lunch, but seems ur task is done :) | 10:03 |
*** jmasud has quit IRC | 10:05 | |
akahat | ykarel, yeah. :) | 10:05 |
*** holser has quit IRC | 10:21 | |
*** saneax has quit IRC | 10:36 | |
*** udesale has quit IRC | 10:59 | |
*** udesale has joined #oooq | 10:59 | |
bhagyashri|rover | arxcruz, around? | 11:13 |
arxcruz | bhagyashri|rover: yes | 11:13 |
arxcruz | sup | 11:13 |
arxcruz | bhagyashri|rover: omg, sorry, did not saw your message earlier | 11:13 |
arxcruz | bhagyashri|rover: wanna sync this ? | 11:13 |
bhagyashri|rover | yeah that would be great | 11:14 |
bhagyashri|rover | arxcruz, you free? | 11:14 |
arxcruz | bhagyashri|rover: yup | 11:14 |
bhagyashri|rover | ok | 11:14 |
bhagyashri|rover | https://meet.google.com/toq-qijq-oft | 11:16 |
bhagyashri|rover | arxcruz, ^ | 11:16 |
arxcruz | bhagyashri|rover: just a sec, it seems i'm having issues to connect | 11:16 |
bhagyashri|rover | ok | 11:16 |
*** ykarel_ has joined #oooq | 11:19 | |
*** ykarel has quit IRC | 11:22 | |
*** ykarel_ is now known as ykarel | 11:23 | |
*** holser has joined #oooq | 11:35 | |
*** holser has quit IRC | 11:37 | |
*** holser has joined #oooq | 11:38 | |
*** holser has quit IRC | 11:57 | |
*** holser has joined #oooq | 12:01 | |
chandankumar | steeping out for a bit | 12:03 |
*** ykarel_ has joined #oooq | 12:07 | |
*** ykarel has quit IRC | 12:09 | |
*** derekh has quit IRC | 12:13 | |
*** rlandy has joined #oooq | 12:33 | |
*** jpena is now known as jpena|lunch | 12:34 | |
*** ratailor__ has quit IRC | 12:36 | |
rlandy | chandankumar: hey | 12:38 |
rlandy | what happened with the promoter? | 12:39 |
chandankumar | rlandy: I not have kicked it yet | 12:41 |
chandankumar | rlandy: do you want to start? | 12:42 |
chandankumar | rlandy: does for rhos-16.2 no hashes are yet available? | 12:46 |
*** frenzy_friday has quit IRC | 12:46 | |
chandankumar | rlandy: http://10.0.11.190/promoter_logs/rhel8_rhos-16.2.log | 12:46 |
chandankumar | pipeline_integration-pcci-16.2_dlrn-rhel-8.4-virthost-3cont_2comp_3ceph-ipv4-geneve-ceph_rcj', 'periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal-rhos-16.2', 'pipeline_integration-pcci-16.2_dlrn-rhel-8.4-virthost-3cont_2comp_3ceph-ipv6-geneve-ceph_rcj'} | 12:47 |
chandankumar | these are missing jobs | 12:48 |
rlandy | chandankumar: let me check those two ... | 12:48 |
chandankumar | rlandy: internal promoter is on, so any new hash will be available it will automatically pick and promote it | 12:48 |
rlandy | chandankumar: https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/buildset/94afe34b7b3a46e1b939a10cf8257195 is a good buildset | 12:50 |
rlandy | the patch you w+'ed will fix bm here | 12:50 |
rlandy | fs001 is fine is scenario passed | 12:50 |
rlandy | let me check QE tests | 12:50 |
bhagyashri|rover | weshay|ruck, rlandy all periodic master jobs are passing | 12:51 |
rlandy | great | 12:51 |
bhagyashri|rover | weshay|ruck, on c8 promoter currently i just enabled the master promotion | 12:51 |
rlandy | https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/view/QE/view/OSP16.2/job/phase1-16.2_compact-director-rhel-8.4-virthost-1cont_1comp_1ceph-ipv4-geneve-ceph/ | 12:52 |
rlandy | chandankumar: idk - they are not 8.4 yet | 12:52 |
bhagyashri|rover | **all periodic c8 master job** | 12:52 |
chandankumar | rlandy: do we want to remove those jobs and promote it? | 12:52 |
chandankumar | not sure it will break the stufff | 12:52 |
rlandy | hold on - let's ask | 12:53 |
chandankumar | ok | 12:53 |
rlandy | chandankumar: there is a hash in test now but the last one could go if we changed the criteria | 12:54 |
rlandy | let's give attila a moment to respond then we can promote | 12:55 |
chandankumar | rlandy: sure | 12:55 |
rlandy | chandankumar: the same hash is running on the current line | 13:08 |
rlandy | weshay|ruck: ^^ are you ok with our promoting 16.2 removing the QE tests from criteria? | 13:08 |
weshay|ruck | rlandy, which hash? | 13:09 |
weshay|ruck | rlandy, chandankumar 16.2 infrared jobs are passing deployment, but failing here: http://rhos-ci-logs.lab.eng.tlv2.redhat.com/logs/rcj/pipeline_integration-pcci-16.2_dlrn-rhel-8.4-virthost-3cont_2comp_3ceph-ipv4-geneve-ceph/12/undercloud-0/home/stack/tempest-dir/tempest-results-sanity.1.xml.gz | 13:10 |
rlandy | 56b5a98c2ed5fb374f7323a6fc66cd70 | 13:10 |
weshay|ruck | chandankumar, making the case about sharing tempest is getting stronger | 13:11 |
weshay|ruck | rlandy, k.. /me looks sec | 13:11 |
rlandy | weshay|ruck: ^^ it's a good buildset | 13:11 |
chandankumar | weshay|ruck: awesome :-) | 13:11 |
weshay|ruck | repo_baseid: b651480887c76a18e5f538361f0ff824 | 13:11 |
rlandy | BM fix merged today | 13:11 |
rlandy | ? | 13:11 |
rlandy | repo_baseid: b651480887c76a18e5f538361f0ff824?? | 13:11 |
rlandy | 2021-03-05 00:13:31.720729 | TASK [get_hash : read md5] | 13:11 |
rlandy | 2021-03-04 19:13:32.462452 | primary | 56b5a98c2ed5fb374f7323a6fc66cd70 | 13:11 |
weshay|ruck | I'm just letting attila know | 13:12 |
rlandy | https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/buildset/94afe34b7b3a46e1b939a10cf8257195 | 13:14 |
rlandy | weshay|ruck: yep - I pinged him on openstack-pcci | 13:14 |
weshay|ruck | rlandy, promote | 13:14 |
rlandy | to tell him we wanted to try promote | 13:14 |
rlandy | chandankumar: cool - let's go for it | 13:14 |
chandankumar | let jump on promoter | 13:14 |
rlandy | chandankumar: is there a tmux? | 13:15 |
rlandy | I am on as centos now | 13:15 |
weshay|ruck | rlandy, su - promoter | 13:15 |
chandankumar | weshay|ruck: rlandy https://meet.google.com/mfr-bkwr-mjn?authuser=0&hl=en | 13:16 |
rlandy | ok | 13:16 |
*** frenzy_friday has joined #oooq | 13:16 | |
zbr | weshay|ruck: there is a fresh thread going on service-discuss@ related to (lack of) reviews, you may want to mention something. | 13:19 |
weshay|ruck | aye.. see it | 13:19 |
zbr | maybe some good things will come out of it | 13:20 |
zbr | i am sure there is no generic solution and approach may need to be different based on the project/group. | 13:20 |
rlandy | chandankumar: http://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp16-2/tripleo-ci-testing/ | 13:24 |
weshay|ruck | http://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp16-2/tripleo-ci-testing/versions.csv | 13:25 |
*** jpena|lunch is now known as jpena | 13:28 | |
arxcruz | jpena: is there an endpoint on dlrn that bring only the actual hash ? | 13:31 |
arxcruz | i tried https://trunk.rdoproject.org/api-centos8-master-uc/api/promotions?promote_name=current-tripleo for example, but it brings me per component | 13:32 |
jpena | arxcruz: the actual hash for what exactly? | 13:32 |
jpena | I mean | 13:32 |
arxcruz | jpena: for example, i want to check which hash i should copy from trunk.rdo and/or docker.io to quay.io | 13:32 |
jpena | for current-tripleo, we have one hash per component, yes, but if you want the aggregate_hash we will have to look in a different place | 13:32 |
arxcruz | jpena: okay, what about this aggregate_hash? do we have an api to bring it ? | 13:33 |
jpena | arxcruz:so https://trunk.rdoproject.org/api-centos8-master-uc/api/promotions?promote_name=current-tripleo&limit=1 will give you the latest promotion | 13:34 |
jpena | it contains aggregate_hash | 13:34 |
jpena | https://github.com/softwarefactory-project/DLRN/blob/master/doc/source/api.rst has the full API spec | 13:35 |
arxcruz | jpena: thanks, i wasn't sure about the terminology | 13:36 |
arxcruz | that's exactly what i wanted :) | 13:36 |
*** amoralej is now known as amoralej|lunch | 13:47 | |
rlandy | weshay|ruck: frenzy_friday: sent stream sync meeting invite | 14:00 |
frenzy_friday | rlandy, thanks | 14:03 |
frenzy_friday | There are some jobs which failed from ussuri and train integration lines. Checking why | 14:03 |
rlandy | frenzy_friday: do you need help there? | 14:08 |
frenzy_friday | rlandy, the same jobs failed in the integration line yesterday , lemme compare the failure and I'll ping you | 14:10 |
rlandy | ok | 14:19 |
chandankumar | rlandy: weshay|ruck fixed that error, now hitting with registry issue | 14:23 |
chandankumar | http://10.0.11.190/promoter_logs/rhel8_osp16-2.log | 14:23 |
*** amoralej|lunch is now known as amoralej | 14:24 | |
*** ykarel_ is now known as ykarel | 14:32 | |
*** jfrancoa has joined #oooq | 14:37 | |
*** jfrancoa has quit IRC | 14:42 | |
chandankumar | rlandy: hello, in downstream we have container names starting with redhat-binary ? | 14:45 |
chandankumar | rlandy: is it openstack- na? | 14:47 |
chandankumar | rlandy: http://10.0.11.190/promoter_logs/container-push/20210305-144056.log | 14:48 |
chandankumar | rlandy: container push started | 14:48 |
weshay|ruck | chandankumar, it should be really fast | 14:49 |
chandankumar | weshay|ruck: hopin in on call? | 14:49 |
weshay|ruck | which? | 14:49 |
weshay|ruck | chandankumar, ^ | 14:50 |
chandankumar | weshay|ruck: sorry, want to jump on the same gmeet | 14:51 |
chandankumar | weshay|ruck: https://meet.google.com/mfr-bkwr-mjn?authuser=0&hl=en | 14:51 |
frenzy_friday | rlandy, the errors dont seem like stream issues, I can see them in few of the past runs, but they dont occur always | 14:58 |
frenzy_friday | https://logserver.rdoproject.org/59/32159/4/check/periodic-tripleo-ci-centos-8-scenario010-ovn-provider-standalone-ussuri/cb5e7b2/logs/undercloud/var/log/extra/errors.txt.txt.gz , https://logserver.rdoproject.org/60/32160/6/check/periodic-tripleo-ci-centos-8-scenario010-ovn-provider-standalone-train/005550c/logs/undercloud/var/log/extra/errors.txt.txt.gz | 14:58 |
weshay|ruck | bhagyashri|rover, akahat is stein still blocked? | 15:07 |
bhagyashri|rover | weshay|ruck, want to chat with you | 15:08 |
weshay|ruck | k.. not avail atm.. can you irc? | 15:08 |
bhagyashri|rover | weshay|ruck, stein promotion is going on ... I had chat with arxcruz and we stopped the copy-quay and now i am trying to promote the stein with new promoter code | 15:09 |
bhagyashri|rover | i have new hash | 15:09 |
bhagyashri|rover | so i am checking ... is the new promoter code pushing container to quay.io or not | 15:11 |
bhagyashri|rover | weshay|ruck, http://10.0.111.180/promoter_logs/container-push/20210305-141846.log | 15:12 |
bhagyashri|rover | weshay|ruck, but i observed one thing that the all the periodic master jobs are passing still there is issue/failure to push the containers | 15:13 |
bhagyashri|rover | here is the master container push log http://10.0.148.74/promoter_logs/container-push/20210305-150057.log ---- Failing | 15:18 |
rlandy | weshay|ruck: https://review.opendev.org/c/openstack/tripleo-ci/+/771717 | 15:20 |
*** ksambor has quit IRC | 15:29 | |
*** ykarel has quit IRC | 15:37 | |
*** udesale has quit IRC | 15:43 | |
weshay|ruck | bhagyashri|rover, do you know why it's failing? | 15:51 |
rlandy | weshay|ruck: pls review before email goes out: http://pastebin.test.redhat.com/945014 | 15:58 |
chandankumar | rlandy: hello | 16:01 |
chandankumar | rlandy: for image push we need to make so many changes | 16:01 |
chandankumar | rlandy: the dir structure is totally different from upstream on image server | 16:02 |
weshay|ruck | rlandy, you may want to speak to the pre-migration testing to give folks some insight that we're not dropping this w/o validation | 16:03 |
rlandy | chandankumar: weshay|ruck: should we just promote the old way today and give you guys some time to work on this? | 16:03 |
weshay|ruck | fine by me | 16:04 |
rlandy | chandankumar: ok - take your time | 16:04 |
chandankumar | rlandy: I can promote the container via new way if ok? | 16:05 |
rlandy | chandankumar: hmmm ... might mix up the old way | 16:06 |
rlandy | let's juts stick to one at a time | 16:06 |
rlandy | if we promote today, you get a whole week to get this right | 16:06 |
rlandy | chandankumar: weshay|ruck: ^^ ok? I am logging on to the old instance to promote the old way | 16:07 |
chandankumar | rlandy: we can test the promoter logic for downstream this way | 16:09 |
chandankumar | rlandy: you can retag the images manually logging into the image server | 16:09 |
chandankumar | if ok? | 16:09 |
chandankumar | rlandy: anyway is fine | 16:11 |
rlandy | chandankumar: weshay|ruck: I am ok with it - if ou guys ca fux any falout | 16:11 |
rlandy | I am out next week - should be ok | 16:11 |
chandankumar | rlandy: go via old way | 16:11 |
rlandy | let me check the image scripts sec | 16:11 |
rlandy | chandankumar: hold on | 16:12 |
chandankumar | rlandy: I need to fix the imae script | 16:12 |
bhagyashri|rover | weshay|ruck, for master there is no space available | 16:12 |
bhagyashri|rover | weshay|ruck, 2021-03-05 15:35:49,693 p=3805059 u=promoter n=ansible | failed: [localhost] (item=zaqar-wsgi) => {"ansible_loop_var": "item", "changed": false, "item": "zaqar-wsgi", "msg": "Error pulling trunk.registry.rdoproject.org/tripleomaster/openstack-zaqar-wsgi - code: None message: failed to register layer: Error processing tar file(exit status 1): open | 16:12 |
weshay|ruck | bhagyashri|rover, did prune run? | 16:12 |
bhagyashri|rover | weshay|ruck, not checked | 16:13 |
weshay|ruck | bhagyashri|rover, run it by hand.. enable it in the script.. dlrn-promoter.sh.. restart | 16:13 |
bhagyashri|rover | weshay|ruck, ok | 16:14 |
weshay|ruck | bhagyashri|rover, make sure space is freed up before restarting | 16:14 |
rlandy | https://sf.hosted.upshift.rdu2.redhat.com/dockerfiles/promote_16_2.sh | 16:14 |
rlandy | chandankumar: ^^ | 16:14 |
rlandy | should be fine ... | 16:14 |
rlandy | you can use the new way to promote containers | 16:14 |
chandankumar | rlandy: ok doing that | 16:14 |
rlandy | we can promote images and dockerfiles afterwards | 16:14 |
rlandy | with scripts | 16:14 |
rlandy | let me know when conatiners are done | 16:15 |
chandankumar | rlandy: dlrn secret issue | 16:18 |
chandankumar | rlandy: promoter Exception while promoting hashes to API endpoint (401) UNAUTHORIZED: Unauthorized Access | 16:18 |
bhagyashri|rover | weshay|ruck, i see in pdlrn-promoter.sh this is commented | 16:19 |
bhagyashri|rover | i remember you commented that | 16:19 |
weshay|ruck | bhagyashri|rover, right.. uncomment, rerun | 16:19 |
weshay|ruck | rerun the command by hand | 16:19 |
rlandy | k | 16:19 |
weshay|ruck | restart the promoter | 16:19 |
bhagyashri|rover | weshay|ruck, sure | 16:19 |
bhagyashri|rover | weshay|ruck, done | 16:25 |
weshay|ruck | :) | 16:25 |
bhagyashri|rover | weshay|ruck, for stein | 16:27 |
bhagyashri|rover | http://10.0.111.180/promoter_logs/container-push/20210305-141846.log | 16:27 |
bhagyashri|rover | 2021-03-05 14:57:00,445 p=2937244 u=promoter n=ansible | failed: [localhost] (item=neutron-server-opendaylight) => {"ansible_loop_var": "item", "changed": true, "cmd": "echo -n \"Checking trunk.registry.rdoproject.org/tripleostein/centos-binary-neutron-server-opendaylight:ff6d3f7d5a8f34c470250caf68999a67454bd149_8d9f1861 ... \";\ndocker manifest inspect --insecure \"trunk.registry.rdoproject.org/tripleostein/centos-binary-neutr | 16:28 |
bhagyashri|rover | on-server-opendaylight:ff6d3f7d5a8f34c470250caf68999a67454bd149_8d9f1861\"\nif [[ \"$?\" == \"0\" ]]; then\n echo neutron-server-opendaylight >> /tmp/parsed_containers-centos-7-stein.txt;\n echo \"OK\";\nelse\n echo \"FAIL\";\n echo \"ERROR ========== centos-binary-neutron-server-opendaylight does not exists on registry, Please check the latest tripleo-ci-testing hash! ==========\";\n exit 1\nfi\n", "delta": | 16:28 |
bhagyashri|rover | "0:01:00.786110", "end": "2021-03-05 14:57:00.419095", "item": "neutron-server-opendaylight", "msg": "non-zero return code", "rc": 1, "start": "2021-03-05 14:55:59.632985", "stderr": "name unknown", "stderr_lines": ["name unknown"], "stdout": "Checking trunk.registry.rdoproject.org/tripleostein/centos-binary-neutron-server-opendaylight:ff6d3f7d5a8f34c470250caf68999a67454bd149_8d9f1861 ... FAIL\nERROR ========== centos-binary-neutr | 16:28 |
bhagyashri|rover | on-server-opendaylight does not exists on registry, Please check the latest tripleo-ci-testing hash! ==========", "stdout_lines": ["Checking trunk.registry.rdoproject.org/tripleostein/centos-binary-neutron-server-opendaylight:ff6d3f7d5a8f34c470250caf68999a67454bd149_8d9f1861 ... FAIL", "ERROR ========== centos-binary-neutron-server-opendaylight does not exists on registry, Please check the latest tripleo-ci-testing hash! | 16:28 |
bhagyashri|rover | =========="]} | 16:28 |
weshay|ruck | opendaylight should be skipped | 16:28 |
bhagyashri|rover | centos-binary-neutron-server-opendaylight container is not present in trunk registry | 16:28 |
chandankumar | rlandy: go via old way | 16:28 |
chandankumar | rlandy: there is an auth issue with dlrn api | 16:29 |
chandankumar | need to debug | 16:29 |
chandankumar | may be food for friday | 16:29 |
chandankumar | may be food for monday | 16:29 |
chandankumar | rlandy: weshay|ruck we also need to solve release name dot mess | 16:29 |
weshay|ruck | chandankumar, aye | 16:31 |
chandankumar | weshay|ruck: for downstream we need to keep a seperate promoter as we need to configue rh cert otherwise docker login does not work | 16:32 |
weshay|ruck | chandankumar, yes | 16:37 |
weshay|ruck | chandankumar, that was the plan | 16:37 |
*** jpodivin has quit IRC | 16:37 | |
bhagyashri|rover | weshay|ruck, yes opendaylight is skipped. but it's neutron-server-opendaylight that is not present on trunk registry | 16:38 |
weshay|ruck | bhagyashri|rover, anything opendaylight should be skipped | 16:38 |
* weshay|ruck gets | 16:38 | |
*** jmasud has joined #oooq | 16:38 | |
bhagyashri|rover | weshay|ruck, ok | 16:39 |
weshay|ruck | bhagyashri|rover, https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/build-containers/vars/main.yaml#L33 | 16:39 |
bhagyashri|rover | weshay|ruck, not sure why it's not getting skipped | 16:39 |
weshay|ruck | - neutron-server-opendaylight | 16:39 |
weshay|ruck | bhagyashri|rover, because it's not configured to | 16:40 |
weshay|ruck | bhagyashri|rover, get me the full list of containers.. if anything other than neutron-server-opendaylight is failing | 16:40 |
weshay|ruck | akahat, ^ | 16:40 |
bhagyashri|rover | weshay|ruck, ok got it , i see this https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/build-containers/vars/main.yaml#L33 before, but i was in consideration that opendaylight is separate container | 16:41 |
bhagyashri|rover | weshay|ruck, if you see here http://10.0.111.180/promoter_logs/container-push/20210305-141846.log that is the only container which is failing | 16:42 |
weshay|ruck | zbr, is ansible-test really molecule underneath or $new | 16:44 |
zbr | nope | 16:44 |
weshay|ruck | man.. we have a lot of job security | 16:45 |
zbr | both are different tools, with different targets. ansible-test for modules, molecule for playbooks/roles. | 16:45 |
zbr | with no plans for one to displace the other, yet. | 16:46 |
zbr | indeed | 16:46 |
weshay|ruck | zbr, https://images.app.goo.gl/chPrQE7X772uPw9A6 | 16:46 |
zbr | weshay|ruck: i am personally not happy with so many options, either. it is more complex than it appears. | 16:47 |
weshay|ruck | vunderful | 16:47 |
zbr | the only chance for them to merge will be if ansible-test gets extracted out core (as you can imagine there is no much drive on the other side for making this happen) | 16:48 |
weshay|ruck | so test is part of core | 16:49 |
weshay|ruck | vunderful | 16:49 |
zbr | yes, which means that even if someone adds features that molecule has, it will be a different ansible-test for each version of ansible | 16:49 |
zbr | so you will never get a missing feature needed to improve tested with an older but supported version of ansible (due to known support policy) | 16:50 |
zbr | I already talked with pdm about that, but no conclusions yet. | 16:50 |
zbr | weshay|ruck: on monday i will mostly unavailble, there is the Ansible Contributors Summit plus hospital appt, them already overlapping. | 16:52 |
weshay|ruck | k | 16:58 |
marios | weshay|ruck: looks like we might actually get that merged https://review.opendev.org/c/openstack/releases/+/774244 "any time now" ;) | 17:00 |
marios | weshay|ruck: at least we have 2 votes now if herve revotes but i can ping him monday might be late for him (I updated it for comments from the other reviewer a little while ago wiping herve vote) | 17:01 |
rlandy | chandankumar: no - I will promote manaually when you are done | 17:02 |
rlandy | https://e1eca528cc456b245ec6-0c809ad541effded46e0a56bdf657f92.ssl.cf2.rackcdn.com/778783/2/check/tripleo-build-containers-ubi-8/846e664/logs/index.html | 17:03 |
rlandy | weshay|ruck: frenzy_friday: ok - volume mounts work | 17:03 |
*** jmasud has quit IRC | 17:03 | |
*** marios is now known as marios|out | 17:09 | |
bhagyashri|rover | weshay|ruck, master promoted | 17:13 |
bhagyashri|rover | https://trunk.rdoproject.org/centos8-master/current-tripleo/delorean.repo.md5 | 17:14 |
bhagyashri|rover | rlandy, ^ | 17:16 |
weshay|ruck | bhagyashri|rover, nice | 17:17 |
bhagyashri|rover | weshay|ruck, rlandy if want me to stop the promotion for master c8 then i will make the changes on promoter server | 17:17 |
bhagyashri|rover | if you want * | 17:17 |
chandankumar | jpena: Hello | 17:19 |
jpena | hi chandankumar | 17:19 |
chandankumar | jpena: is there a way to check dlrnapi client is working fine? | 17:19 |
bhagyashri|rover | weshay|ruck, fyi for stein promotion i did some hack in the code (removed the neutron-server-opendaylight form container_list) | 17:19 |
bhagyashri|rover | weshay|ruck, i will push the patch to correct the name here https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/build-containers/vars/main.yaml#L33 | 17:20 |
jpena | chandankumar: what do you mean by "working fine"? You can always run a query against a known read-only endpoint and see if it returns a result | 17:20 |
chandankumar | jpena: http://10.0.11.190/promoter_logs/rhel8_osp16-2.log - promoter Exception while promoting hashes to API endpoint (401) UNAUTHORIZED: Unauthorized Access | 17:20 |
jpena | chandankumar: that is pointing to wrong credentials | 17:21 |
jpena | chandankumar: wait, are you promoting on a public server or inside the VPN? | 17:22 |
chandankumar | jpena: yes | 17:22 |
chandankumar | jpena: I am working on downstream promoter | 17:22 |
*** marios|out has quit IRC | 17:22 | |
chandankumar | jpena: inside the vpn | 17:23 |
chandankumar | talking to internal dlrn server | 17:23 |
*** mjturek has quit IRC | 17:23 | |
*** jmasud has joined #oooq | 17:24 | |
bhagyashri|rover | weshay|ruck, plz review when you have free time https://docs.google.com/document/d/1qJ04D0s7ybH4adTv-aXhZV9cHWFL6-LAtgZbp20GH9U/edit | 17:25 |
weshay|ruck | bhagyashri|rover, nice work on the master promotion!!! | 17:34 |
weshay|ruck | 0 gate fails | 17:34 |
weshay|ruck | http://dashboard-ci.tripleo.org/d/Z4vLSmOGk/cockpit?orgId=1 | 17:34 |
weshay|ruck | LOOKING GOOD PEOPLE! | 17:35 |
weshay|ruck | bhagyashri|rover, rlandy and I will turn off master promotions this afternoon | 17:35 |
weshay|ruck | bhagyashri|rover, do you know by chance if manifest_push worked on master? | 17:35 |
weshay|ruck | akahat, ^ | 17:35 |
weshay|ruck | or was that turned off | 17:35 |
* weshay|ruck looks | 17:35 | |
bhagyashri|rover | weshay|ruck, yes that was turned off | 17:36 |
weshay|ruck | ah.. turned off | 17:36 |
*** amoralej is now known as amoralej|off | 17:39 | |
rlandy | chandankumar: let me know if/when you want me to kick the old promotion or if you are still working | 17:51 |
chandankumar | rlandy: go ahead with old promoter | 17:51 |
chandankumar | rlandy: something wrong with creds | 17:52 |
rlandy | chandankumar: k - thanks | 17:52 |
rlandy | weshay|ruck: ^^ fyi - running old promoter for 16.2 | 17:52 |
rlandy | oy - what happened here? | 17:53 |
rlandy | did someone edit the old scripts? | 17:53 |
chandankumar | rlandy: I am just copied the secrets from there to new promoter | 17:54 |
rlandy | chandankumar: np - probably just saw your edits | 17:55 |
*** mjturek has joined #oooq | 17:55 | |
*** jpena is now known as jpena|off | 17:58 | |
rlandy | ok - 16.2 is promoting | 18:01 |
*** irclogbot_3 has quit IRC | 18:03 | |
*** irclogbot_0 has joined #oooq | 18:04 | |
chandankumar | rlandy: cool | 18:14 |
chandankumar | rlandy: I will try with rhos-17 | 18:14 |
chandankumar | rlandy: when you will be back from vacations ? | 18:14 |
chandankumar | rlandy: happy vacations in advance :-) | 18:14 |
*** irclogbot_0 has quit IRC | 18:24 | |
*** irclogbot_1 has joined #oooq | 18:27 | |
*** holser has quit IRC | 18:42 | |
rlandy | chandankumar: one week | 18:42 |
rlandy | thank you | 18:42 |
rlandy | I definitely need some time off :) | 18:42 |
*** holser has joined #oooq | 18:42 | |
chandankumar | rlandy: donot forgot to make pics :-) | 18:45 |
chandankumar | *take | 18:45 |
frenzy_friday | rlandy, weshay|ruck all the 4 job reruns from train and ussuri failed again | 18:45 |
frenzy_friday | https://review.rdoproject.org/r/#/c/32063/ | 18:46 |
rlandy | looking | 18:49 |
rlandy | 2021-03-05 17:19:36.091732 | primary | async task did not complete within the requested time - 5700s | 18:55 |
rlandy | frenzy_friday: ^^ had a timeout | 18:55 |
rlandy | 2021-03-05 17:23:29.767637 | primary | async task did not complete within the requested time - 5700s | 18:56 |
rlandy | all timing out | 18:56 |
frenzy_friday | yes, it is the same timeout since last 3 times | 18:56 |
frenzy_friday | ERROR ovsdbapp.backend.ovs_idl.idlutils [-] Unable to open stream to tcp:192.168.24.1:6641 to retrieve schema: Connection refused | 18:56 |
frenzy_friday | And Could not load 'glance.store.s3.Store': No module named 'boto3': ModuleNotFoundError: No module named 'boto3' | 18:58 |
frenzy_friday | unable to parse the registries configuration (/etc/containers/registries.conf): mixing sysregistry v1/v2 is not supported" | 18:58 |
rlandy | ERROR ovsdbapp.backend.ovs_idl.idlutils [-] Unable to open stream to tcp:192.168.24.1:6641 to retrieve schema: Connection refused | 19:04 |
rlandy | ^^ problem | 19:04 |
rlandy | ovn | 19:04 |
rlandy | frenzy_friday: there were a bunch of changes on octavia and train on 03/01 | 19:10 |
rlandy | I don;t think this is stream related | 19:10 |
rlandy | you can discuss with bhagyashri|rover and CIx | 19:10 |
frenzy_friday | rlandy, ok | 19:15 |
*** jmasud has quit IRC | 19:46 | |
rlandy | weshay|ruck: frenzy_friday: want to meet again? | 19:59 |
rlandy | merge release file change to integration? | 19:59 |
rlandy | two patches have merged | 19:59 |
rlandy | integration master line is still running | 20:00 |
*** jmasud has joined #oooq | 20:01 | |
*** slaweq has quit IRC | 20:17 | |
weshay|ruck | rlandy, ya.. I'm avail | 20:19 |
rlandy | weshay|ruck: ok - let's do this | 20:20 |
weshay|ruck | k | 20:21 |
rlandy | meet.google.com/fwn-mjix-xbh | 20:21 |
*** jmasud has quit IRC | 20:49 | |
*** jmasud has joined #oooq | 20:57 | |
*** jmasud has quit IRC | 21:14 | |
*** jmasud has joined #oooq | 21:57 | |
rlandy | weshay|ruck: logging out ... https://review.opendev.org/c/openstack/tripleo-quickstart/+/774911 not in yet - will check in saturday night | 22:19 |
*** rlandy has quit IRC | 22:19 | |
*** jmasud has quit IRC | 23:02 | |
*** jmasud has joined #oooq | 23:05 | |
*** jmasud has quit IRC | 23:30 | |
*** jmasud has joined #oooq | 23:37 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!