*** rlandy|ruck|bbl is now known as rlandy|ruck | 02:03 | |
*** rfolco has quit IRC | 02:09 | |
*** rlandy|ruck has quit IRC | 02:21 | |
*** yolanda has quit IRC | 03:02 | |
*** yolanda has joined #oooq | 03:03 | |
*** ykarel|away is now known as ykarel | 04:27 | |
*** ysandeep|away is now known as ysandeep | 04:40 | |
*** jtomasek has joined #oooq | 04:56 | |
*** jtomasek has quit IRC | 04:56 | |
*** jtomasek has joined #oooq | 04:57 | |
*** ratailor has joined #oooq | 05:12 | |
*** dsneddon has joined #oooq | 05:28 | |
*** udesale has joined #oooq | 05:40 | |
ysandeep | ykarel, is it mirr | 06:10 |
---|---|---|
ysandeep | mirror issue - https://74b83773945845894408-fddd31f569f44d98bd401bfd88253d97.ssl.cf2.rackcdn.com/737923/4/check/tripleo-ci-centos-7-containers-multinode-train/68062e2/logs/undercloud/home/zuul/undercloud_install.log | 06:10 |
ykarel | ysandeep, i think there is a bug for it | 06:11 |
ykarel | hmm related to registry mirror | 06:12 |
ysandeep | ykarel, thanks! checking RR notes to find the bug | 06:12 |
ykarel | i seen discussion on it last night, not sure if bug was created or not | 06:12 |
*** danpawlik is now known as dpawlik|EoD | 06:15 | |
ysandeep | ykarel, nothing in RR notes about bug | 06:17 |
ysandeep | soniya29|rover, is this issue known? https://74b83773945845894408-fddd31f569f44d98bd401bfd88253d97.ssl.cf2.rackcdn.com/737923/4/check/tripleo-ci-centos-7-containers-multinode-train/68062e2/logs/undercloud/home/zuul/undercloud_install.log | 06:17 |
ysandeep | I can recheck to confirm if it is consistent but just want to confirm if you have seen this with other jobs as well. | 06:19 |
ykarel | <rlandy|ruck> Client Error: Too Many Requests for url: http://mirror.regionone.rdo-cloud-tripleo.rdoproject.org:8082/v2/ceph/daemon/blobs/sha256:ea7eb661de71977e5d57c2d6935d5bca6496780665cc7537595b19f8d431b676"], "stdout": "", "stdout_lines": []} | 06:22 |
ykarel | ysandeep, in #oooq channel only | 06:22 |
ysandeep | ykarel, yeah ronelle must have faced this issue with other jobs | 06:24 |
*** saneax has joined #oooq | 06:27 | |
ysandeep | ykarel, Could you please add https://review.opendev.org/#/c/737975/ and https://review.opendev.org/#/c/737923/ to your review list, not urgent whenever you get free time. CI jobs failure looks unrelated to changes - will push recheck after some reviews. | 06:42 |
*** ysandeep is now known as ysandeep|afk | 07:04 | |
ykarel | ysandeep|afk, ack will check | 07:04 |
ysandeep|afk | ykarel, thanks! | 07:04 |
ykarel | release var shouldn't be needed though now | 07:06 |
ykarel | as all centos8 are component based | 07:06 |
*** ratailor has quit IRC | 07:19 | |
*** ratailor has joined #oooq | 07:19 | |
*** ysandeep|afk is now known as ysandeep | 07:23 | |
*** bhagyashris|afk is now known as bhagyashris | 07:27 | |
*** amoralej|off is now known as amoralej | 07:31 | |
*** jpena|off is now known as jpena | 07:31 | |
*** jtomasek has quit IRC | 07:32 | |
*** dtantsur|afk is now known as dtantsur | 07:33 | |
*** tosky has joined #oooq | 07:35 | |
*** jtomasek has joined #oooq | 07:35 | |
*** pojadhav is now known as pojadhav|lunch | 07:41 | |
ysandeep | ykarel, thanks! I agree with you, But I am not sure what was the motive behind the recent movement from OS to release in https://review.opendev.org/#/c/720776 .. probably i will check with weshay_pto once he is back | 07:55 |
ykarel | ysandeep, ack that time story was different, but good to confirm | 07:55 |
*** jtomasek has quit IRC | 08:10 | |
*** jtomasek has joined #oooq | 08:14 | |
ysandeep | chandankumar, Test patch https://review.opendev.org/#/c/736174/ failed while pull containers 401 unauthorized - https://d2952c05763cd0040d7f-6b2fbb83e342ba16a98bd56da886e807.ssl.cf2.rackcdn.com/736174/5/check/tripleo-ci-centos-8-containers-multinode-train/f2710f8/logs/undercloud/home/zuul/undercloud_install.log | 08:21 |
soniya29|rover | ysandeep, I haven't came across this isse | 08:21 |
soniya29|rover | s/isse/issue | 08:21 |
ysandeep | soniya29|rover, Thanks! we will a need bug if its hitting other jobs too, I will recheck my job and let you know if i hit it again. | 08:22 |
*** derekh has joined #oooq | 08:43 | |
*** ykarel is now known as ykarel|lunch | 08:48 | |
soniya29|rover | ysandeep, ack | 08:55 |
*** ysandeep is now known as ysandeep|lunch | 09:06 | |
*** udesale has quit IRC | 09:07 | |
*** pojadhav|lunch is now known as pojadhav | 09:10 | |
*** jfrancoa has joined #oooq | 09:13 | |
*** udesale has joined #oooq | 09:15 | |
*** ysandeep|lunch is now known as ysandeep | 09:22 | |
*** jfrancoa has quit IRC | 09:29 | |
*** jfrancoa has joined #oooq | 09:31 | |
*** ykarel|lunch is now known as ykarel | 09:55 | |
*** ccamacho has quit IRC | 10:42 | |
ysandeep | chandankumar, Hey o/ whenever you get some time - Looking for some pointers on c8 branchful job failure, deployment failed while pull containers - 401 unauthorized - https://d2952c05763cd0040d7f-6b2fbb83e342ba16a98bd56da886e807.ssl.cf2.rackcdn.com/736174/5/check/tripleo-ci-centos-8-containers-multinode-train/f2710f8/logs/undercloud/home/zuul/undercloud_install.log | 10:46 |
zbr | ykarel: chandankumar: please have a read on https://review.opendev.org/#/c/723603/ and put a +1 or -1 on it based on what you find better. | 11:15 |
chandankumar | ysandeep, not sure why it is giving unauthorized error | 11:20 |
ykarel | zbr, ack | 11:20 |
ykarel | looks like people have valid concerns there, will post recheck, want to see how it outputs | 11:21 |
zbr | the output side is already out, need to build it again. | 11:22 |
ysandeep | chandankumar, ack thanks! | 11:26 |
ykarel | ysandeep, is there already a train c8 promotion? | 11:26 |
ykarel | if not the jobs will fail | 11:27 |
ykarel | i don't see any image in https://hub.docker.com/u/tripleotraincentos8 | 11:27 |
ysandeep | chandankumar, promotion worked yesterday? | 11:27 |
ysandeep | chandankumar, grabbing your testpatch | 11:27 |
chandankumar | ykarel, https://review.rdoproject.org/r/28204 once this finishes, we might get an auto promotion | 11:28 |
ykarel | chandankumar, ack, ysandeep till then it should fail than | 11:29 |
ykarel | to get check job passing images should be available in https://hub.docker.com/u/tripleotraincentos8 | 11:30 |
ysandeep | ykarel, ack, query this job don't push container to https://hub.docker.com/u/tripleotraincentos8? - https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-centos-8-train-containers-build-push | 11:31 |
ykarel | ysandeep, ^^ push to rdo registry, to dockerup it pushed by promoter server | 11:31 |
ykarel | s/dockerup/dockerhub | 11:32 |
ysandeep | ykarel, Thank you so much, I will wait then | 11:32 |
*** jpena is now known as jpena|lunch | 11:33 | |
*** kopecmartin is now known as kopecmartin|pto | 11:37 | |
chandankumar | arxcruz, akahat soniya29|rover I am cancelling today's tempest meeting as weshay_pto and kopecmartin|pto is on pto | 11:42 |
soniya29|rover | chandankumar, ack | 11:42 |
akahat | chandankumar, okay | 11:52 |
arxcruz | chandankumar: ack | 12:11 |
*** rlandy has joined #oooq | 12:13 | |
*** rlandy is now known as rlandy|ruck | 12:13 | |
rlandy|ruck | panda: hello | 12:15 |
rlandy|ruck | soniya29|rover: hi - how are things? | 12:15 |
panda | rlandy|ruck: hi | 12:16 |
rlandy|ruck | panda: hey - been trying to reach you re: rdocloud promoter | 12:16 |
rlandy|ruck | panda: would you like to meet? | 12:16 |
soniya29|rover | rlandy|ruck, hello, things are good | 12:17 |
*** rfolco has joined #oooq | 12:18 | |
rlandy|ruck | soniya29|rover: ugh - we still have to get https://review.opendev.org/#/c/738025/ through | 12:18 |
soniya29|rover | rlandy|ruck, openstack-tox-pep8 is passing now for stable/train | 12:18 |
soniya29|rover | rlandy|ruck, https://trello.com/c/Ub0c2vyE/1567-cixlp1884989tripleociproa-openstack-tox-pep8-is-failing-when-run-on-tripleo-common-changes-stable-train | 12:18 |
rlandy|ruck | soniya29|rover: yep - look stable now - you can close out that bug | 12:19 |
soniya29|rover | rlandy|ruck, okay | 12:19 |
panda | rlandy|ruck: I took a look this morning. The promoter is up and running again. master ussuri and centos8-train are running. I see that this morning the container push failed, because apparently containers were not found in rdo registry | 12:19 |
rlandy|ruck | panda: I tried to disable update again | 12:20 |
panda | rlandy|ruck: I'm also increasing the number of latest hashes that we consider per release, as with the component, every single promotion takes at least 12 hashes | 12:20 |
rlandy|ruck | panda: soniya29|rover: https://meet.google.com/qsr-tsjz-iej - let's discuss in case this happens again | 12:22 |
soniya29|rover | rlandy|ruck, sure | 12:22 |
rlandy|ruck | I need to know confirm exact releases are expected on which promoters | 12:22 |
*** udesale has quit IRC | 12:29 | |
*** derekh has quit IRC | 12:32 | |
*** rlandy|ruck is now known as rlandy|ruck|mtg | 12:35 | |
*** jpena|lunch is now known as jpena | 12:44 | |
rlandy|ruck|mtg | soniya29|rover: https://etherpad.opendev.org/p/tripleo-ptg-victoria | 12:53 |
rlandy|ruck|mtg | label:openstack-discuss tripleo ptg | 12:56 |
rlandy|ruck|mtg | chandankumar: hey - can we chat about the cirros image? | 13:02 |
*** amoralej is now known as amoralej|lunch | 13:04 | |
chandankumar | rlandy|ruck|mtg, give me a min | 13:04 |
*** derekh has joined #oooq | 13:04 | |
chandankumar | rlandy|ruck|mtg, now, gmeet link | 13:04 |
rlandy|ruck|mtg | chandankumar: https://meet.google.com/mbr-neoo-bak | 13:05 |
soniya29|rover | rlandy|ruck|mtg, we need some more reviews on this patch:- https://review.opendev.org/#/c/737058/4 | 13:10 |
chandankumar | rlandy|ruck|mtg, https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario001-standalone-master/a4bcfd5/logs/undercloud/var/log/tempest/stestr_results.html.gz | 13:11 |
rlandy|ruck|mtg | chandankumar: https://bugs.launchpad.net/tripleo/+bug/1885279 | 13:14 |
openstack | Launchpad bug 1885279 in tripleo "Standalone tests on master are failing in tempest with cirros-0.5.1 image" [Critical,In progress] - Assigned to Ronelle Landy (rlandy) | 13:14 |
*** ykarel is now known as ykarel|afk | 13:14 | |
chandankumar | rlandy|ruck|mtg, https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario001-standalone-master/a4bcfd5/logs/undercloud/home/zuul/tempest/etc/profile.yaml.txt.gz | 13:15 |
*** dtantsur is now known as dtantsur|afk | 13:21 | |
chandankumar | rlandy|ruck|mtg, https://review.rdoproject.org/r/#/c/28204/ | 13:21 |
*** TrevorV has joined #oooq | 13:25 | |
*** pojadhav is now known as pojadhav|brb | 13:27 | |
rlandy|ruck|mtg | chandankumar: hey - taking this off infra for the moment | 13:39 |
chandankumar | rlandy|ruck|mtg, https://opendev.org/openstack/devstack/src/commit/a13ab8db2dbd959b5a1f52ac03d3fca07a19eb04/lib/tempest#L206 | 13:40 |
chandankumar | rlandy|ruck|mtg, openstack flavor create --id 42 --ram 128 --disk $disk --vcpus 1 --property hw_rng:allowed=True m1.nano | 13:40 |
chandankumar | rlandy|ruck|mtg, in tempestconf it is 64 | 13:41 |
rlandy|ruck|mtg | chandankumar: whatever change we make, we need to get it through gates | 13:41 |
rlandy|ruck|mtg | chandankumar: does tempestconf go through diff gates? | 13:41 |
chandankumar | rlandy|ruck|mtg, yes | 13:41 |
rlandy|ruck|mtg | look like we can get the revert through in the mean time | 13:41 |
chandankumar | let me prepare a patch | 13:42 |
rlandy|ruck|mtg | let's qualify the new cirros image more | 13:42 |
rlandy|ruck|mtg | before we create another gate disaster | 13:42 |
*** udesale has joined #oooq | 13:47 | |
*** amoralej|lunch is now known as amoralej | 13:47 | |
chandankumar | rlandy|ruck|mtg, https://review.opendev.org/#/c/738210/ | 13:50 |
*** rlandy|ruck|mtg is now known as rlandy|ruck | 13:54 | |
rlandy|ruck | chandankumar: k - cool - let's spin on that :) | 13:57 |
chandankumar | rfolco, around? | 14:32 |
rfolco | chandankumar, here | 14:32 |
chandankumar | rfolco, need help https://logserver.rdoproject.org/94/28194/11/check/periodic-tripleo-build-containers-ubi-8/d7e1429/job-output.txt | 14:32 |
chandankumar | rfolco, Retag and push image trunk.registry.rdoproject.org/testingmaster/openstack-neutron-metadata-agent-ovn:latest w/ _arch tag suffix] | 14:33 |
chandankumar | 2020-06-26 14:23:54.393062 | primary | Getting image source signatures | 14:33 |
chandankumar | 2020-06-26 14:23:54.393262 | primary | Error: Error copying image to the remote destination: Error trying to reuse blob sha256:f9327c1608ad0ae79b5f4a4c47eda907a980ea9640c70e6036811ea76d641249 at destination: Error checking whether a blob sha256:f9327c1608ad0ae79b5f4a4c47eda907a980ea9640c70e6036811ea76d641249 exists in trunk.registry.rdoproject.org/testingmaster/openstack-neutron-metadata-agent-ovn: unauthorized: authentication required | 14:33 |
rlandy|ruck | chandankumar: we have bigger problems ^^ | 14:35 |
*** pojadhav|brb is now known as pojadhav | 14:35 | |
chandankumar | rlandy|ruck, looking | 14:35 |
*** ratailor has quit IRC | 14:36 | |
*** ykarel|afk is now known as ykarel | 14:37 | |
chandankumar | rlandy|ruck, Image prepare failed: Modifying image 192.168.24.1:8787/tripleomaster/centos-binary-ovn-controller:8a49b1e69db255997a89e8527f7270e9 failed here | 14:38 |
rlandy|ruck | I know | 14:38 |
rlandy|ruck | pojadhav: hi - can you update the ussuri branch odftripleo-heat-templates to use the ipa template? | 14:40 |
chandankumar | rfolco, here is the job definition https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/tripleoci.yaml#L493 and triggered here https://review.rdoproject.org/r/#/c/28194/11/zuul.d/build-containers.yaml please have a look, may be I am missing something | 14:42 |
pojadhav | rlandy|ruck, yup | 14:42 |
rlandy|ruck | thanks | 14:43 |
rfolco | chandankumar, will do in a bit | 14:47 |
chandankumar | rfolco, aye thanks! | 14:55 |
rlandy|ruck | zbr: you around? | 14:59 |
rlandy|ruck | if so, we need your help | 14:59 |
chandankumar | rlandy|ruck, https://review.opendev.org/#/c/738025/ may be we can get it forced merged, minions are also tripleo-ci-centos-8-containers-undercloud-minion (3. attempt) | 15:00 |
pojadhav | rlandy|ruck, chandankumar : please have a look https://review.opendev.org/#/c/738224/ | 15:11 |
weshay_pto | rlandy|ruck, 2020-06-26 15:01:51.410940 | primary | "msg": "Depsolve Error occured: \n Problem: cannot install both libnghttp2-1.41.0-1.module_el8+9071+b2b61c14.x86_64 and libnghttp2-1.33.0-1.el8_0.1.x86_64\n - libnghttp2-1.33.0-1.el8_0.1.i686 has inferior architecture\n - cannot install the best update candidate for package libnghttp2-1.33.0-1.el8_0.1.x86_64\n - problem with installed package libnghttp2-1.33.0-1.el8_0.1.i686\n - | 15:11 |
weshay_pto | package libnghttp2-1.33.0-1.el8_0.1.x86_64 is filtered out by modular filtering", | 15:11 |
weshay_pto | 2020-06-26 15:01:51.411072 | primary | | 15:11 |
rlandy|ruck | chandankumar: how far are we from getting the tempconf patch in? | 15:26 |
rlandy|ruck | weshay_pto: https://review.opendev.org/#/c/738210/ | 15:28 |
rfolco | chandankumar, its your namespace I suppose | 15:28 |
rfolco | https://trunk.registry.rdoproject.org:8443/oapi/v1/namespaces/testingmaster/imagestreamtags/ | 15:28 |
weshay_pto | arxcruz, can you please have a look at https://review.opendev.org/#/c/738210/ | 15:30 |
arxcruz | weshay_pto: sure, need to update the tests as well, would you like me to do it, or chandankumar is already on it? | 15:32 |
weshay_pto | arxcruz, it's late in your day but later in his.. just extra eyes and review please | 15:37 |
*** jtomasek has quit IRC | 15:37 | |
rlandy|ruck | pojadhav: pls see comments on https://review.opendev.org/#/c/738224/ | 15:38 |
rlandy|ruck | thanks | 15:38 |
weshay_pto | arxcruz, it's failing tox and other tests.. and we probably should testproject the patch and run it a few more times.. apparently cirros 5.1 introduces some requirements 4x didn't have | 15:38 |
chandankumar | arxcruz, which test | 15:44 |
*** matbu has quit IRC | 15:46 | |
chandankumar | rlandy|ruck, arxcruz, weshay_pto fix tested https://review.opendev.org/#/c/738210/ | 15:48 |
weshay_pto | chandankumar, arxcruz ok.. hit that patch hard w/ additional upstream DNM patches please | 15:49 |
chandankumar | weshay_pto, rlandy|ruck arxcruz https://review.opendev.org/738229 dnm | 15:52 |
*** matbu has joined #oooq | 15:53 | |
chandankumar | rfolco, testingmaster is my namespace | 15:53 |
rlandy|ruck | chandankumar: thanks - we have a better chance of getting that through | 15:54 |
rfolco | chandankumar, try a manual push to this namespace with the same credentials used in the job | 15:59 |
chandankumar | rfolco, will do that | 15:59 |
rfolco | chandankumar, I don't see any other reasons to fail other than namespace | 16:00 |
weshay_pto | chandankumar, thanks | 16:00 |
chandankumar | rfolco, thanks! | 16:02 |
chandankumar | arxcruz, if all passes, please merge that one | 16:02 |
chandankumar | I am going offline | 16:02 |
*** ykarel is now known as ykarel|away | 16:04 | |
*** matbu has quit IRC | 16:11 | |
*** matbu has joined #oooq | 16:12 | |
weshay_pto | chandankumar, arxcruz is the cirros 4.x image already loaded in glance here? https://6b5c7688254ddf6bc600-1e37d93b1287908e0942eb2641078389.ssl.cf5.rackcdn.com/737774/2/gate/tripleo-ci-centos-8-scenario010-standalone/5e1471f/job-output.txt | 16:25 |
weshay_pto | 2020-06-26 15:55:40.731231 | primary | 2020-06-26 15:55:40.486 252527 ERROR tempest Details: b'409 Conflict\n\nImage status transition from active to saving is not allowed\n\n ' | 16:25 |
weshay_pto | perhaps python-tempestconf needs to check and handle that scenaro | 16:26 |
weshay_pto | scenario | 16:26 |
weshay_pto | rlandy|ruck, /me logs this bug | 16:27 |
weshay_pto | that scenario010 just hit | 16:27 |
weshay_pto | https://bugs.launchpad.net/tripleo/+bug/1885311 | 16:31 |
openstack | Launchpad bug 1885311 in tripleo "python-tempestconf: 409 Conflict Image status transition from active to saving is not allowed'" [Critical,Triaged] | 16:31 |
rlandy|ruck | weshay_pto: logging a new vexxhost OVB bug | 16:32 |
rlandy|ruck | https://bugs.launchpad.net/tripleo/+bug/1884518 - we get past that | 16:32 |
openstack | Launchpad bug 1884518 in tripleo "OVB metalsmith deployment fails: Failed to attach VIF ... to bare metal node, Node ... is locked by host undercloud" [Critical,Triaged] | 16:32 |
rlandy|ruck | 2020-06-26 15:46:34 | 2020-06-26 15:46:34.504293 | fa163e90-5f1c-ebc6-c73f-000000000064 | FATAL | AllNodesValidationConfig | overcloud-controller-2 | error={"changed": true, "msg": "non-zero return code", "rc": 1, "stderr": "Shared connection to 192.168.24.26 closed.\r\n", "stderr_lines": ["Shared connection to 192.168.24.26 closed."], "stdout": "Trying to ping default gateway 10.0.0.1...Ping to 10.0.0.1 failed. | 16:33 |
rlandy|ruck | Retrying...\r\nPing to 10.0.0.1 failed. Retrying...\r\nPing to 10.0.0.1 failed. Retrying...\r\nPing to 10.0.0.1 failed. Retrying...\r\nPing to 10.0.0.1 failed. Retrying...\r\nPing to 10.0.0.1 failed. Retrying...\r\nPing to 10.0.0.1 failed. Retrying...\r\nPing to 10.0.0.1 failed. Retrying...\r\nPing to 10.0.0.1 failed. Retrying...\r\nPing to 10.0.0.1 failed. Retrying...\r\nFAILURE\r\n10.0.0.1 is not pingable.\r\n", | 16:33 |
rlandy|ruck | "stdout_lines": ["Trying to ping default gateway 10.0.0.1...Ping to 10.0.0.1 failed. Retrying...", "Ping to 10.0.0.1 failed. Retrying...", "Ping to 10.0.0.1 failed. Retrying...", "Ping to 10.0.0.1 failed. Retrying...", "Ping to 10.0.0.1 failed. Retrying...", "Ping to 10.0.0.1 failed. Retrying...", "Ping to 10.0.0.1 failed. Retrying...", "Ping to 10.0.0.1 failed. Retrying...", "Ping to 10.0.0.1 failed. Retrying...", "Ping to | 16:33 |
rlandy|ruck | 10.0.0.1 failed. Retrying...", "FAILURE", "10.0.0.1 is not pingable."]} | 16:33 |
rlandy|ruck | 2020-06-26 15:46:34 | | 16:33 |
weshay_pto | anyone know what "CANCELLED" status in zuul means? | 16:35 |
weshay_pto | that's new to me | 16:35 |
weshay_pto | rlandy|ruck, ok.. all current gate failures accounted for.. /me digs into a little history | 16:35 |
rlandy|ruck | weshay_pto: yes .. | 16:40 |
*** amoralej is now known as amoralej|off | 16:40 | |
rlandy|ruck | if the job above in the gate fails, the job following has its tests cancelled | 16:40 |
*** jpena is now known as jpena|off | 16:42 | |
rlandy|ruck | weshay_pto: for the vexxhost failures ... https://bugs.launchpad.net/tripleo/+bug/1885314 | 16:46 |
openstack | Launchpad bug 1885314 in tripleo "OVB master job running on vexxhost show some nodes failing introspection step" [Critical,Triaged] | 16:46 |
rlandy|ruck | patch included | 16:46 |
rlandy|ruck | sagi w-1'ed it am | 16:46 |
rlandy|ruck | atm | 16:46 |
rlandy|ruck | we can test that | 16:46 |
*** derekh has quit IRC | 17:00 | |
rlandy|ruck | chandankumar: who would this bug go to? us or packaging? https://bugs.launchpad.net/tripleo/+bug/1885315 | 17:00 |
openstack | Launchpad bug 1885315 in tripleo "tripleo-buildimage-overcloud-full-centos-8 is failing on the update of libnghttp2 package" [Critical,Triaged] | 17:00 |
rlandy|ruck | weshay_pto: ^^ fyi - one legit retry_limit error | 17:01 |
weshay_pto | k.. isolating retries to a openvswitch bug | 17:01 |
weshay_pto | rlandy|ruck, https://review.rdoproject.org/r/#/c/28100/ | 17:06 |
weshay_pto | rlandy|ruck, I have a mtg next week to talk about deps as components | 17:07 |
rlandy|ruck | charming - more to watch | 17:07 |
rlandy|ruck | weshay_pto: what do you want to do about https://review.opendev.org/#/c/735659/? restore it? updating last of CIX cards: https://trello.com/c/ENhCL2zD/1551-cixlp1881642tripleociproa-ussuri-master-fs020-failing-on-testnetworkadvancedserverops | 17:12 |
rlandy|ruck | https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master/996d1f8/logs/undercloud/var/log/tempest/stestr_results.html.gz | 17:13 |
rlandy|ruck | ^^ two failures there | 17:13 |
rlandy|ruck | we could clear fs020 | 17:13 |
weshay_pto | fix the merge conflict.. jebus | 17:13 |
weshay_pto | why was that abandoned | 17:14 |
rlandy|ruck | Rafael Folco | 17:14 |
rlandy|ruck | Abandoned new ruck/rovers will decide what to do | 17:14 |
rlandy|ruck | weshay_pto: k - I'll fix that merge conflict | 17:15 |
chandankumar | rlandy|ruck, https://bugs.launchpad.net/tripleo/+bug/1885315 was looking at this libnghttp2-1.33.0-1.el8_0.1.i686 32 bit package from where it is coming | 17:18 |
openstack | Launchpad bug 1885315 in tripleo "tripleo-buildimage-overcloud-full-centos-8 is failing on the update of libnghttp2 package" [Critical,Triaged] | 17:18 |
chandankumar | need to dig that out | 17:18 |
weshay_pto | rlandy|ruck, added you to a mtg on monday re: 3rd party deps and the component pipeline | 17:21 |
rlandy|ruck | chandankumar: ok - just didn't know who to assign it to | 17:22 |
rlandy|ruck | weshay_pto: on training - could we move it earlier? | 17:22 |
rlandy|ruck | an hour earlier and I can attend for 30 mins | 17:23 |
weshay_pto | there will be follow ups | 17:23 |
rlandy|ruck | ok | 17:24 |
weshay_pto | rlandy|ruck, I have to relocate.. bbl today | 17:29 |
weshay_pto | pretty sure we're dealing w/ openvswitch issues | 17:29 |
rlandy|ruck | weshay_pto: sure - thanks for jumping in | 17:29 |
weshay_pto | 0/ | 17:29 |
weshay_pto | thank you | 17:29 |
rlandy|ruck | who is we? | 17:29 |
rlandy|ruck | royal we? | 17:29 |
weshay_pto | ya | 17:29 |
weshay_pto | lozl | 17:29 |
weshay_pto | the retries | 17:29 |
rlandy|ruck | who is fixing that? | 17:30 |
weshay_pto | no one today | 17:30 |
rlandy|ruck | we need to put in a patch? | 17:30 |
weshay_pto | not sure.. | 17:30 |
weshay_pto | will pick it up monday | 17:30 |
rlandy|ruck | ok - will watch | 17:30 |
*** udesale has quit IRC | 17:39 | |
*** dsneddon has quit IRC | 17:55 | |
pojadhav | rlandy|ruck, pls check https://review.opendev.org/#/c/738224/2 | 18:11 |
rlandy|ruck | 2020-06-26 17:47:21,536 19601 DEBUG urllib3.util.retry [ ] Incremented Retry for (url='/v2/tripleotrain/centos-binary-neutron-metadata-agent-ovn/blobs/sha256:8677c78a778099e0855e10ec5216db41ee347c7d787060308f96aee7aaea6e9f'): Retry(total=3, connect=None, read=None, | 18:14 |
rlandy|ruck | weshay_pto: ^^ another ovn conatiner fail | 18:14 |
rlandy|ruck | on a diff distro though | 18:14 |
*** matbu has quit IRC | 18:21 | |
*** matbu has joined #oooq | 18:33 | |
zbr | rlandy|ruck: still need my help? i just seen the msg. | 18:38 |
rlandy|ruck | zbr: we're looking into the retry_limit failures ... | 18:38 |
rlandy|ruck | weshay_pto thought you could help there ... | 18:38 |
rlandy|ruck | https://trello.com/c/g6p2hyYm/1569-cixlp1885286tripleociproa-increase-in-retrylimit-errors-in-zuulopenstackorg-is-preventing-jobs-from-passing-check-gate | 18:39 |
rlandy|ruck | zbr: ^^ | 18:39 |
rlandy|ruck | mostly alex and infra are working on it now | 18:39 |
rlandy|ruck | zbr: I am out on training next week so if there is no progress by then, you can have some fun on this one | 18:40 |
rlandy|ruck | right now, there is no clear resolution | 18:40 |
zbr | someone please correct me: failure in pre does not mean we failed to setup the node? like in failure to boot the node. | 18:42 |
zbr | i will watch on infra... | 18:42 |
rlandy|ruck | zbr: it's a long story | 18:48 |
rlandy|ruck | we're watching developments on openstack-infra | 18:48 |
zbr | yeah, sad that i am out of popcorn | 18:55 |
*** matbu has quit IRC | 19:07 | |
*** matbu has joined #oooq | 19:19 | |
*** jfrancoa has quit IRC | 19:22 | |
*** matbu has quit IRC | 19:25 | |
arxcruz | weshay_pto: checking, sorry didn't saw your message | 19:25 |
*** matbu has joined #oooq | 19:32 | |
*** TrevorV has quit IRC | 19:50 | |
arxcruz | weshay_pto: so i need some glance guy to check if is a valid error or not | 20:10 |
arxcruz | weshay_pto: https://6b5c7688254ddf6bc600-1e37d93b1287908e0942eb2641078389.ssl.cf5.rackcdn.com/737774/2/gate/tripleo-ci-centos-8-scenario010-standalone/5e1471f/logs/undercloud/var/log/containers/glance/api.log | 20:10 |
arxcruz | weshay_pto: it seems to be some random error because the first upload passes, and yes, it's using cirros 4.0 | 20:10 |
rlandy|ruck | ient Error: Too Many Requests for url: http://mirror.mtl01.inap.opendev.org:8082/v2/tripleomaster/centos-binary-cinder-api/blobs/sha256:ff11b65be4e7eda3808f0e94898e97619602e94e215a5627da1dd0d03e51b | 20:12 |
rlandy|ruck | more errors | 20:12 |
rlandy|ruck | ugh | 20:12 |
*** matbu has quit IRC | 21:07 | |
*** matbu has joined #oooq | 21:14 | |
*** chem has quit IRC | 21:18 | |
*** chem has joined #oooq | 21:19 | |
*** dsneddon has joined #oooq | 21:36 | |
*** chem has quit IRC | 21:48 | |
*** chem has joined #oooq | 21:54 | |
*** tosky has quit IRC | 23:00 | |
*** saneax has quit IRC | 23:05 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!