| *** ysandeep|out is now known as ysandeep | 03:45 | |
| *** soniya29 is now known as soniya29|ruck | 04:37 | |
| *** soniya29 is now known as soniya29|ruck | 05:29 | |
| *** amoralej|off is now known as amoralej | 06:19 | |
| *** soniya is now known as soniya|ruck | 06:45 | |
| *** jpena|off is now known as jpena | 07:42 | |
| chkumar|rover | rlandy|out: I synced regarding rr with soniya|ruck | 09:30 |
|---|---|---|
| chkumar|rover | rlandy|out: Currently CI is unblocked but we might hit https://bugs.launchpad.net/tripleo/+bug/1978929 this again tomorrow | 09:30 |
| bhagyashris | marios, thanks looks like issue resolved "freeze graph issue on sc010" | 09:37 |
| marios | bhagyashris: o/ yeah was the branches: | 09:38 |
| bhagyashris | yeah | 09:38 |
| bhagyashris | this is blocking my patch https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-9-content-provider&skip=0 | 09:38 |
| marios | bhagyashris: there is a c9 blocker chkumar|rover pinged earlier see https://bugs.launchpad.net/tripleo/+bug/1978929 | 09:41 |
| marios | maybe related | 09:41 |
| bhagyashris | yup | 09:43 |
| chkumar|rover | marios: bhagyashris you can recheck the patches now | 09:43 |
| bhagyashris | chkumar|rover, ack thanks | 09:44 |
| chkumar|rover | temprory unblocked the CI | 09:44 |
| chkumar|rover | for today | 09:44 |
| marios | thx chkumar|rover | 09:44 |
| Tengu | folks, the new openstack-selinux is now in the component-ci-testing content - or should be. | 10:23 |
| Tengu | get ready to test that nasty boy before it crashes CI again :) | 10:23 |
| Tengu | rpm -q --scripts -p https://trunk.rdoproject.org/centos9-master/component/common/component-ci-testing/openstack-selinux-0.8.32-0.20220615144412.d53c3f0.el9.noarch.rpm <- shows the "verify scriptlet (using /bin/sh):" block we need! | 10:24 |
| rlandy|out | chkumar|rover: thanks | 10:28 |
| rlandy|out | Tengu: hello | 10:30 |
| rlandy|out | thanks for heads up on common | 10:31 |
| rlandy|out | chkumar|rover: you still around? | 10:31 |
| rlandy|out | soniya|ruck: hi | 10:31 |
| soniya|ruck | rlandy|out, hello | 10:31 |
| *** rlandy|out is now known as rlandy | 10:32 | |
| chkumar|rover | rlandy: hello, yes | 10:32 |
| rlandy | chkumar|rover: soniya|ruck: let's sync quickly | 10:33 |
| chkumar|rover | will be around for one more hour | 10:33 |
| rlandy | https://meet.google.com/cnu-pdin-mhn?pli=1&authuser=0 | 10:33 |
| rlandy | https://logserver.rdoproject.org/60/39960/71/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-train/b0b500d/logs/undercloud/var/log/tempest/stestr_results.html.gz | 10:51 |
| chkumar|rover | rlandy: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/834352 | 10:56 |
| *** soniya is now known as soniya29|ruck | 11:00 | |
| rlandy | Tengu: "block we need" does that mean we need a blocker bug on this or it's what you wanted to see? | 11:02 |
| *** ysandeep is now known as ysandeep|afk | 11:08 | |
| *** dviroel|afk is now known as dviroel | 11:18 | |
| Tengu | rlandy: oh, no, not at all! "the verifyscript block" | 11:23 |
| Tengu | sorry. didn't want to trigger you on "block-er" | 11:24 |
| rlandy | Tengu: k, good! | 11:24 |
| frenzy_friday | dpawlik, rlandy Hey, I saw this card https://issues.redhat.com/browse/PLTSOCP-2958 - the downstream registry is going away/down. Do we already have a quay downtream registry? Anything I can help with? | 11:30 |
| rlandy | frenzy_friday: the downstream registry move is on hold | 11:31 |
| rlandy | as we don;t have an identified good new alternative | 11:31 |
| rlandy | we do need to move | 11:31 |
| rlandy | but they are keeping up the current one | 11:31 |
| rlandy | soniya: hello | 11:32 |
| soniya | rlandy, hello | 11:32 |
| rlandy | soniya: can you pls post the two patch to promote wallaby and train | 11:32 |
| soniya | rlandy, on it | 11:33 |
| jsanemet | hello | 11:35 |
| jsanemet | a question about zuul jobs | 11:35 |
| jsanemet | does anyone know how triple-o ci chooses the quickstart files it assigns to each zuul job? | 11:36 |
| jsanemet | I have been looking through the job definitions but could not see it | 11:36 |
| rlandy | jsanemet: hello - that's a very general question :) | 11:43 |
| rlandy | jsanemet: also - there are a lot of files in quickstart | 11:43 |
| rlandy | which ones are you interested in? | 11:44 |
| rlandy | jsanemet: https://docs.openstack.org/tripleo-docs/latest/ci/index.html is a better starting point | 11:44 |
| jsanemet | rlandy: hello | 11:45 |
| jsanemet | what I am trying to do it to get from the a zuul job to the files that are passed to quickstart during a build | 11:46 |
| jsanemet | for example, the featureset, scenario, nodes... | 11:46 |
| jsanemet | my idea, for instance, would be to be able to look into a zuul job and tell for example the topology that it will deploy on a build | 11:47 |
| *** soniya29 is now known as soniya29|ruck | 11:47 | |
| rlandy | jsanemet: as a general rule you can - but zuul jobs follow an inheritance - so not all the info would be in one single definition | 11:49 |
| jsanemet | and for such thing I would like to know the file under quickstart's nodes/ that it picks | 11:49 |
| rlandy | jsanemet: it's not as simple as all that | 11:51 |
| rlandy | the featureset is the closest to telling you the type of deploy you get | 11:51 |
| rlandy | the scenario tells you what services you have | 11:52 |
| rlandy | the nodeset - your node configuration | 11:52 |
| rlandy | that with the associated heat-template files and settings within deploy and/or standalone will give you what finally gets deployed | 11:52 |
| jsanemet | rlandy: exactly, and those are the files I am trying to get to from a zuul job | 11:54 |
| jsanemet | which ones does tripleo ci pick for each job | 11:56 |
| jsanemet | I can imagine that it is much more complicated than how I am putting it | 11:56 |
| rlandy | jsanemet: it is | 12:01 |
| rlandy | jsanemet: https://docs.openstack.org/tripleo-docs/latest/ci/standalone_scenario_jobs.html#how | 12:02 |
| rlandy | there are some how sections on a few sections in that doc | 12:03 |
| rlandy | that may give you some pointers | 12:03 |
| jsanemet | ok, I will take a look | 12:03 |
| jsanemet | thanks | 12:03 |
| *** soniya is now known as soniya29|ruck | 12:05 | |
| soniya29|ruck | rlandy, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43626 | 12:05 |
| rlandy | soniya29|ruck: thank you | 12:10 |
| *** amoralej is now known as amoralej|lunch | 12:18 | |
| *** ysandeep|afk is now known as ysandeep | 12:18 | |
| *** soniya is now known as soniya29|ruck | 12:39 | |
| bhagyashris | akahat, chkumar|rover rlandy soniya29|ruck | 13:01 |
| bhagyashris | scrum time | 13:01 |
| bhagyashris | ysandeep, ^ | 13:01 |
| *** rlandy is now known as rlandy|rover | 13:03 | |
| *** amoralej|lunch is now known as amoralej | 13:26 | |
| *** soniya is now known as soniya|ruck | 13:58 | |
| *** ysandeep is now known as ysandeep|afk | 14:08 | |
| rlandy|rover | pojadhav; bhagyashris: pls book a tc/pm/ua sync for tuesday - thank you | 14:35 |
| rlandy|rover | soniya29: ping | 14:37 |
| rlandy|rover | soniya29: you around?? | 14:37 |
| rlandy|rover | there is a tempest failure on c9 standalone | 14:37 |
| rlandy|rover | gate blocket | 14:37 |
| rlandy|rover | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_9ad/846152/1/check/tripleo-ci-centos-9-standalone/9ad5ddc/logs/undercloud/var/log/tempest/stestr_results.html | 14:37 |
| rlandy|rover | need a bug for this | 14:38 |
| soniya29 | rlandy|rover, yeah | 14:38 |
| rlandy|rover | https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-9-standalone&skip=0 | 14:38 |
| soniya29 | rlandy|rover, sure, i will file it | 14:38 |
| *** soniya29 is now known as soniya29|ruck | 14:38 | |
| rlandy|rover | soniya29: ^^ failing for the whole day | 14:38 |
| soniya29|ruck | rlandy|rover, ack | 14:39 |
| rlandy|rover | tempest.scenario.test_network_basic_ops.TestNetworkBasicOps | 14:39 |
| rlandy|rover | Details: Failed to attach network adapter device to 17d5f776-b73f-4aa1-a1c9-39f9d60c5364 | 14:39 |
| rlandy|rover | ykarel: ^^ you familiar with this? | 14:40 |
| ykarel | rlandy|rover, /me checks | 14:42 |
| pojadhav | rlandy|rover, ack | 14:43 |
| ykarel | rlandy|rover, doesn't look familiar | 14:43 |
| rlandy|rover | ykarel: ok - looking more - thanks | 14:43 |
| ykarel | rlandy|rover, but there was new push to c9s mirror, may be that caused it? | 14:43 |
| rlandy|rover | likely | 14:43 |
| rlandy|rover | comparing rpms versions | 14:43 |
| ykarel | rlandy|rover, https://bugzilla.redhat.com/show_bug.cgi?id=2092856 | 14:47 |
| rlandy|rover | thanks - reading | 14:48 |
| soniya29|ruck | rlandy|rover, https://bugs.launchpad.net/tripleo/+bug/1978969 | 14:50 |
| rlandy|rover | soniya29|ruck: thanks | 14:50 |
| gthiemonge | rlandy|rover: scenario010 is also affected by this issue | 14:51 |
| gthiemonge | https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d2a/820530/8/check/tripleo-ci-centos-9-scenario010-standalone/d2a1c9c/logs/undercloud/var/log/containers/nova/nova-api.log | 14:52 |
| rlandy|rover | gthiemonge: ack - ok | 14:52 |
| rlandy|rover | sending out mail to openstack-discuss | 14:52 |
| *** ysandeep|afk is now known as ysandeep | 14:57 | |
| *** amoralej is now known as amoralej|off | 15:04 | |
| pojadhav | rlandy|rover, bhagyashris, ysandeep, soniya29|ruck : created meet invite tc/pm/ua sync. feel free to change the meeting time which is suitable for all. | 15:06 |
| bhagyashris | pojadhav, thanks | 15:09 |
| ysandeep | pojadhav, the proposed time works for me, thanks! | 15:14 |
| soniya29|ruck | rlandy|rover, leaving for the day | 15:18 |
| rlandy|rover | ok | 15:18 |
| rlandy|rover | have a good night | 15:18 |
| soniya29|ruck | rlandy|rover, thanks :) | 15:18 |
| *** soniya29|ruck is now known as soniya29|out | 15:18 | |
| rlandy|rover | gthiemonge: hi - so on scenario010 I see ... | 15:22 |
| rlandy|rover | 2022-06-16 14:11:17.888 17 ERROR nova.api.openstack.wsgi libvirt.libvirtError: internal error: unable to execute QEMU command 'netdev_add': File descriptor named '(null)' has not been found | 15:22 |
| rlandy|rover | interestingly on the vanilla standalone | 15:22 |
| rlandy|rover | diff error | 15:22 |
| rlandy|rover | 2022-06-16 09:05:19.355 6 ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19525fed-c9d3-461f-a1d3-6da706e20711 could not be found. | 15:22 |
| gthiemonge | rlandy|rover: in octavia/worker.log http://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d2a/820530/8/check/tripleo-ci-centos-9-scenario010-standalone/d2a1c9c/logs/undercloud/var/log/containers/octavia/worker.log | 15:23 |
| gthiemonge | we also have ERROR octavia.network.drivers.neutron.allowed_address_pairs [-] Error plugging amphora (compute_id: 95f6f928-00b8-4111-8be0-0e606d538438) into port 1c2ead8e-33a6-467f-9be6-d2bc1d30cb56.: octavia.common.exceptions.ComputeUnknownException: Unknown exception from the compute driver: Failed to attach network adapter device to 95f6f928-00b8-4111-8be0-0e606d538438 (HTTP 500) | 15:23 |
| gthiemonge | so it looks really similar to the reported issue | 15:24 |
| johnsom | nova failure | 15:24 |
| rlandy|rover | yep | 15:26 |
| * dviroel_ lunch | 15:37 | |
| *** ysandeep is now known as ysandeep|out | 15:58 | |
| rlandy|rover | gthiemonge: testing a downgrade of libvirt | 16:04 |
| rlandy|rover | lunch - brb | 16:16 |
| * dviroel back | 16:21 | |
| *** jpena is now known as jpena|off | 16:44 | |
| rlandy|rover | dviroel: ha - here we go ... https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-9-standalone-on-multinode-ipa&skip=0 - "dnf downgrade openssl-3.0.1-5.el9 -y; | 17:09 |
| rlandy|rover | "Error: No packages marked for downgrade. | 17:09 |
| rlandy|rover | openssl.x86_64 1:3.0.1-33.el9 @baseos | 17:11 |
| rlandy|rover | openssl-devel.x86_64 1:3.0.1-33.el9 @appstream | 17:11 |
| rlandy|rover | openssl-libs.x86_64 1:3.0.1-33.el9 @baseos | 17:11 |
| * rlandy|rover tries to remove that | 17:11 | |
| rlandy|rover | dasm|off: dviroel: fyi https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/846125 | 17:13 |
| rlandy|rover | we may need to update or revert that | 17:14 |
| rlandy|rover | idk yet | 17:14 |
| dviroel | yeah, hope that works with newer versions now | 17:14 |
| rlandy|rover | everything is broken again :( | 17:17 |
| rlandy|rover | ceph, libvirt, ssl | 17:17 |
| rlandy|rover | lovely | 17:17 |
| dviroel | rlandy|rover: how is libvirt downgrade? | 18:50 |
| dviroel | oh, you just posted a testproject | 18:50 |
| rlandy|rover | dviroel: there are multiple gate blockers going on atm | 18:50 |
| rlandy|rover | pls join review time | 18:51 |
| dviroel | ack, | 18:51 |
| rlandy|rover | will discuss all of the above | 18:51 |
| dviroel | rlandy|rover: ceph fix depends on libvirt fix right | 18:51 |
| dviroel | maybe we need to force libvirt downgrade | 18:51 |
| rlandy|rover | it's a whole mess | 18:51 |
| dviroel | :( | 18:51 |
| rlandy|rover | plus openssl | 18:51 |
| rlandy|rover | not failing in promotion line | 18:52 |
| dviroel | ssl one is affecting only ipa ones, right? | 18:52 |
| dviroel | or no | 18:52 |
| rlandy|rover | yes | 18:57 |
| rlandy|rover | dviroel: rcastillo: dasm|off: review time | 19:01 |
| *** dviroel is now known as dviroel|biab | 21:07 | |
| rlandy|rover | dviroel|biab: looks like libvirt downgrade will work | 21:10 |
| dviroel|biab | \o/ | 21:27 |
| rlandy|rover | dviroel|biab: waiting for current version to vote | 21:29 |
| rlandy|rover | then updating with wallaby and promotion files | 21:29 |
| rlandy|rover | the will make ipa job depends-on | 21:29 |
| rlandy|rover | then will rebase ceph | 21:29 |
| dviroel|biab | ack - i can vote when ready | 21:30 |
| rlandy|rover | arxcruz: chkumar|rover: pojadhav: pls see notes in hackmd - multiple gate failures | 22:19 |
| rlandy|rover | https://bugs.launchpad.net/tripleo/+bug/1978969 | 22:20 |
| rlandy|rover | https://bugs.launchpad.net/tripleo/+bug/1978996 | 22:20 |
| rlandy|rover | with associated patches | 22:20 |
| rlandy|rover | testing container builds https://review.rdoproject.org/r/c/testproject/+/39960 | 22:27 |
| *** dviroel|biab is now known as dviroel | 23:07 | |
| *** dviroel is now known as dviroel|out | 23:16 | |
| *** rlandy|rover is now known as rlandy|out | 23:36 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!