| *** rlandy has quit IRC | 00:21 | |
| *** saneax has joined #oooq | 01:33 | |
| *** jmasud has quit IRC | 02:23 | |
| *** jmasud has joined #oooq | 02:28 | |
| *** pojadhav|away is now known as pojadhav|rover | 02:43 | |
| *** jmasud has quit IRC | 02:52 | |
| *** jmasud has joined #oooq | 02:59 | |
| *** skramaja has joined #oooq | 03:20 | |
| *** ykarel has joined #oooq | 04:18 | |
| *** ratailor has joined #oooq | 04:34 | |
| *** jmasud has quit IRC | 05:03 | |
| *** marios has joined #oooq | 05:05 | |
| *** jmasud has joined #oooq | 05:09 | |
| *** ratailor_ has joined #oooq | 05:13 | |
| *** ratailor has quit IRC | 05:15 | |
| *** udesale has joined #oooq | 05:33 | |
| *** jpodivin has joined #oooq | 05:50 | |
| *** ratailor__ has joined #oooq | 05:56 | |
| *** ratailor_ has quit IRC | 05:58 | |
| *** slaweq has joined #oooq | 06:16 | |
| pojadhav|rover | is https://review.rdoproject.org/ down ? | 06:30 |
|---|---|---|
| ykarel | i can access ^ | 06:40 |
| pojadhav|rover | ack.. i think then my network having some speed issues :) | 06:50 |
| pojadhav|rover | thanks | 06:50 |
| *** ysandeep|away is now known as ysandeep | 07:05 | |
| *** tosky has joined #oooq | 07:09 | |
| *** pojadhav|rover is now known as pojadhav|away | 07:15 | |
| ysandeep | pojadhav|away, akahat|ruck hey o/ are we monitoring periodic queen line? | 07:36 |
| akahat|ruck | ysandeep, yes. | 07:37 |
| ysandeep | Ovb jobs are failing from long for queens line: https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens&project=openstack/tripleo-ci , Do we have any existing bug for this? | 07:37 |
| akahat|ruck | ysandeep, looking | 07:38 |
| ysandeep | akahat|ruck, pojadhav|away thanks! actually rabi have filed a bug based on check jobs https://bugs.launchpad.net/tripleo/+bug/1928099 but job is failure from long with same error. So I just want to cross check if we had an existing bug for this failure.. | 07:40 |
| openstack | Launchpad bug 1928099 in tripleo "OVB queens jobs fail with Invalid node data: node #0: Unknown field ports" [High,In progress] - Assigned to Rabi Mishra (rabi) | 07:40 |
| akahat|ruck | ysandeep, ack | 07:41 |
| *** jmasud has quit IRC | 07:41 | |
| *** amoralej|off is now known as amoralej | 07:46 | |
| *** jpena|off is now known as jpena | 07:59 | |
| *** derekh has joined #oooq | 08:09 | |
| ysandeep | akahat|ruck, found any existing bug? | 08:10 |
| akahat|ruck | ysandeep, no.. I didn't found any bug. | 08:17 |
| zbr | morning! | 08:26 |
| akahat|ruck | afternoon!! | 08:27 |
| ysandeep | akahat|ruck, thanks! no worries, queens being not active so much can sometimes go out of radar. | 08:28 |
| ysandeep | Actually i was trying to sell that we can use periodic line to capture issues for old c7 branches instead of adding more coverage in upstream ci, but than rabi showed me a bug and same things was hitting in periodic for over a month and we have no bug for it :( | 08:28 |
| akahat|ruck | ysandeep, okay... once bug got fixed things might be good for queens. | 08:33 |
| akahat|ruck | :) | 08:33 |
| *** ysandeep is now known as ysandeep|lunch | 08:39 | |
| *** sshnaidm_ has joined #oooq | 08:48 | |
| *** sshnaidm has quit IRC | 08:50 | |
| *** udesale has quit IRC | 09:09 | |
| *** udesale has joined #oooq | 09:11 | |
| *** sshnaidm_ is now known as sshnaidm | 09:28 | |
| sshnaidm | chandankumar, hey, do you remember is blocking patch by zuul in github is configured in our side or on github side? | 09:29 |
| sshnaidm | chandankumar, I think podman patches are not blocked by our jobs.. | 09:30 |
| chandankumar | sshnaidm: yes, we have excluded it, as it was quite annoying for them, https://github.com/openshift/release/commit/c99554c4c98ccdcf5985baae669d51e30247fc74 | 09:31 |
| chandankumar | sshnaidm: if sf zuul app is installed on github project side, job will get triggered | 09:32 |
| chandankumar | there | 09:32 |
| chandankumar | and it will block the patch | 09:32 |
| chandankumar | on github side | 09:33 |
| sshnaidm | chandankumar, hmm.. interesting if it blocks on collection repo | 09:34 |
| sshnaidm | well, I think it's configured in github repo settings | 09:34 |
| chandankumar | yes | 09:43 |
| sshnaidm | chandankumar, somehow it passed w/o depends-on: https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/790681 | 09:53 |
| sshnaidm | need to understand why.. | 09:53 |
| chandankumar | https://opendev.org/openstack/tripleo-quickstart/src/branch/master/quickstart.sh#L532 | 09:55 |
| sshnaidm | chandankumar, hmm.. but we don't use it in CI or do we? | 09:57 |
| chandankumar | let me check the logs | 09:58 |
| chandankumar | sshnaidm: https://7114429c7841114b6ab2-a5faeab2c736b5ae3f187165e14e12eb.ssl.cf5.rackcdn.com/790681/1/check/tripleo-ci-centos-8-content-provider/9fe8778/job-output.txt | 10:10 |
| chandankumar | sshnaidm: 2021-05-11 12:48:44.570868 | primary | +(./quickstart.sh:532): main(): ANSIBLE_COLLECTIONS_PATHS='/home/zuul/workspace/.quickstart/share/ansible/collections:~/.ansible/collections:/usr/share/ansible/collections' | 10:10 |
| *** udesale has quit IRC | 10:16 | |
| sshnaidm | chandankumar, yeah, but this is only for subshell of quickstart | 10:24 |
| sshnaidm | chandankumar, I think I found: https://github.com/openstack/tripleo-ci/blob/master/roles/run-test/templates/toci_quickstart.sh.j2#L115 | 10:24 |
| sshnaidm | it's in /toci_quickstart.sh | 10:24 |
| chandankumar | it is in toci scripts | 10:24 |
| sshnaidm | we set it in a thousand places.. | 10:24 |
| sshnaidm | this is a mess | 10:24 |
| *** udesale has joined #oooq | 10:32 | |
| *** pojadhav|away is now known as pojadhav|rover | 10:39 | |
| soniya29 | arxcruz, kopecmartin, chandankumar, please edit/add today's tempest agenda:- https://hackmd.io/fIOKlEBHQfeTZjZmrUaEYQ | 10:46 |
| *** sshnaidm is now known as sshnaidm|afk | 10:46 | |
| marios | chandankumar: sshnaidm|afk: please add to your reviews when you next have time https://review.opendev.org/c/openstack/tripleo-repos/+/790679 | 10:50 |
| jpodivin | Does anyone know what could cause 255 ssh error on the undercloud install? It's pretty much standard mater deploy, I didn't really change anything. | 10:57 |
| *** jmasud has joined #oooq | 11:12 | |
| *** ysandeep|lunch is now known as ysandeep | 11:19 | |
| *** jpena is now known as jpena|lunch | 11:30 | |
| *** jmasud has quit IRC | 11:32 | |
| *** rlandy has joined #oooq | 11:45 | |
| rlandy | akahat|ruck: all ok for the program call? | 11:52 |
| akahat|ruck | rlandy, yes. | 11:52 |
| rlandy | will be on the call if needed | 11:52 |
| akahat|ruck | rlandy, sure thank you :) | 11:53 |
| weshay|ruck | zbr++ | 12:09 |
| *** sshnaidm|afk is now known as sshnaidm | 12:19 | |
| *** jpena|lunch is now known as jpena | 12:27 | |
| ysandeep | rlandy, for content-provider usage in rhos-release.. Do we want to add check jobs for all the standalone scenarios or just for ovb and multinode? | 12:28 |
| rlandy | ysandeep: let's start with one multinode and ovb | 12:29 |
| rlandy | ysandeep: if ovb is too unstable, go with all scenarios and multinode | 12:30 |
| ysandeep | ack o/ thanks! | 12:30 |
| weshay|ruck | fyi https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/790957 | 12:31 |
| weshay|ruck | chandankumar, howdy sir | 12:32 |
| chandankumar | weshay|ruck: I am good thanks, How are you? | 12:34 |
| chandankumar | weshay|ruck: all patches landed for c7 train | 12:34 |
| chandankumar | weshay|ruck: https://review.rdoproject.org/r/q/topic:%22remove_uneeded_tq_requirements%22+(status:open%20OR%20status:merged) | 12:34 |
| weshay|ruck | chandankumar, https://review.opendev.org/c/openstack/tripleo-quickstart/+/790701 | 12:34 |
| *** pojadhav|rover is now known as pojadhav|afk | 12:35 | |
| weshay|ruck | chandankumar, so we have a tripleo-operator-ansible rpm for c8 train? | 12:35 |
| chandankumar | weshay|ruck: I need to send a dummy patch to build it i think | 12:36 |
| weshay|ruck | chandankumar, rock | 12:36 |
| weshay|ruck | dummy it up | 12:36 |
| weshay|ruck | chandankumar, ahh.. this is how it's done https://review.rdoproject.org/r/c/config/+/33686 | 12:38 |
| weshay|ruck | maybe I've done that once before | 12:38 |
| * weshay|ruck notes | 12:38 | |
| chandankumar | weshay|ruck: it will create this train-rdo branch https://github.com/rdo-packages/tripleo-operator-ansible-distgit/blob/train-rdo/tripleo-operator-ansible.spec | 12:38 |
| weshay|ruck | akahat|ruck, point me at a testproject for standalone-upgrade before you leave today please | 12:39 |
| akahat|ruck | weshay|ruck, https://review.rdoproject.org/r/c/rdo-jobs/+/33574/3 | 12:39 |
| zbr | soniya29: should we talk about py39? | 12:42 |
| weshay|ruck | akahat|ruck, check ur work please https://review.rdoproject.org/zuul/status#33574 | 12:46 |
| akahat|ruck | weshay|ruck, sorry.. that was wrong link. https://review.rdoproject.org/zuul/status#33575 | 12:47 |
| akahat|ruck | https://review.rdoproject.org/r/c/testproject/+/33575 | 12:47 |
| *** amoralej is now known as amoralej|lunch | 12:55 | |
| *** ykarel_ has joined #oooq | 12:56 | |
| *** ykarel has quit IRC | 12:58 | |
| soniya29 | zbr, tempest meeting is there now...i will ping you | 13:00 |
| *** ykarel_ is now known as ykarel | 13:00 | |
| soniya29 | chandankumar, arxcruzm akahat|ruck, rlandy, tempest meeting? | 13:02 |
| akahat|ruck | arxcruz, ^^ | 13:02 |
| soniya29 | chandankumar, ^^ | 13:03 |
| zbr | okey | 13:04 |
| *** ratailor__ has quit IRC | 13:18 | |
| ysandeep | rlandy, left an email regarding 16.2 components.. when you have time.. | 13:18 |
| rlandy | ysandeep: ack - sorry - continuous meetings | 13:19 |
| rlandy | will check your math in my afternoon hours | 13:19 |
| ysandeep | rlandy, thanks! | 13:22 |
| weshay|ruck | ysandeep, https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/790996 | 13:22 |
| weshay|ruck | ysandeep, trying to get your patches in | 13:22 |
| ysandeep | weshay++ thanks! | 13:23 |
| akahat|ruck | weshay|ruck, https://bugs.launchpad.net/tripleo/+bug/1928228 | 13:25 |
| openstack | Launchpad bug 1928228 in tripleo "Network service is not getting started at overcloud deployment" [Critical,New] | 13:25 |
| akahat|ruck | weshay|ruck, since there are those two jobs which are blocking c8-train promotion, should i remove it from criteria? | 13:25 |
| weshay|ruck | ysandeep, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/33693 | 13:26 |
| weshay|ruck | akahat|ruck, self triage that bug please | 13:26 |
| akahat|ruck | okay | 13:27 |
| weshay|ruck | akahat|ruck, https://review.opendev.org/c/openstack/tripleo-image-elements/+/787797 | 13:28 |
| *** amoralej|lunch is now known as amoralej | 13:36 | |
| *** skramaja has quit IRC | 13:38 | |
| weshay|ruck | rlandy, ysandeep https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/790996 | 13:42 |
| ysandeep | weshay|ruck, ack lgtm +1 | 13:43 |
| weshay|ruck | ysandeep, so.. apevec is going to check on the nodepool quota to get us to 40 nodes | 14:11 |
| *** jlarriba has quit IRC | 14:11 | |
| ysandeep | weshay|ruck, awesome news, we really need that :) | 14:12 |
| ysandeep | #oooq fyi.. tomorrow is public holiday in India | 14:12 |
| weshay|ruck | aye .. enjoy the downtime all | 14:14 |
| *** ykarel_ has joined #oooq | 14:14 | |
| *** ykarel has quit IRC | 14:16 | |
| *** ykarel_ is now known as ykarel | 14:17 | |
| *** jlarriba has joined #oooq | 14:32 | |
| *** jlarriba has quit IRC | 14:34 | |
| *** jlarriba has joined #oooq | 14:35 | |
| *** saneax has quit IRC | 15:02 | |
| weshay|ruck | rlandy, https://miro.com/sso/login/ | 15:05 |
| weshay|ruck | zbr, can we catch up in depth tomorrow? | 15:12 |
| weshay|ruck | today just sucks | 15:12 |
| zbr | weshay|ruck: sure! i was about to ask you for that. I kinda feel the need to catch-up with... work ;) | 15:13 |
| *** jpodivin has quit IRC | 15:18 | |
| marios | weshay|ruck: o/ have you seen that one fyi https://bugs.launchpad.net/tripleo/+bug/1928190 blocks tripleoclient gate but only for changes to requirements.txt | 15:23 |
| openstack | Launchpad bug 1928190 in tripleo "requirements-check job fails due to the lack of tripleo-common in the global-requirements.txt" [Undecided,New] | 15:23 |
| marios | weshay|ruck: asking slagle about it now (I commented just now there comment #4) | 15:23 |
| weshay|ruck | marios, so slagle and alex were experimenting w/ that | 15:24 |
| weshay|ruck | alex was pretty sure there would be fall out | 15:25 |
| weshay|ruck | but they wanted to try it | 15:25 |
| weshay|ruck | marios, probably a revert while pinging alex and slagle w/ a fyi is the right thing to do | 15:25 |
| marios | weshay|ruck: k will hit the revert button if slagle doesn't respond in a bit before i go | 15:26 |
| -openstackstatus- NOTICE: Any builds with POST_FAILURE result and no available logs between 11:41 and 14:41 UTC today were related to an authentication endpoint problem in one of our providers and can be safely rechecked now | 15:30 | |
| weshay|ruck | zbr, https://meet.google.com/esh-njzp-zvh?authuser=1 | 15:31 |
| *** ysandeep is now known as ysandeep|dinner | 15:34 | |
| *** ykarel has quit IRC | 15:37 | |
| *** ysandeep|dinner is now known as ysandeep | 15:45 | |
| *** udesale has quit IRC | 15:47 | |
| *** jmasud has joined #oooq | 15:59 | |
| ysandeep | rlandy, weshay|ruck mtg with kieran | 16:02 |
| *** marios is now known as marios|out | 16:05 | |
| *** slaweq has quit IRC | 16:11 | |
| *** marios|out has quit IRC | 16:24 | |
| *** jmasud has quit IRC | 16:54 | |
| *** jpena is now known as jpena|off | 17:07 | |
| ysandeep | sshnaidm weshay|ruck rlandy chandankumar: please add in your review list https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/790598 , check queue will report soon. | 17:20 |
| ysandeep | to solve https://bugs.launchpad.net/tripleo/+bug/1926160 | 17:21 |
| openstack | Launchpad bug 1926160 in tripleo "Content-provider jobs not honoring build-containers exclude_containers list." [High,In progress] | 17:21 |
| *** jmasud has joined #oooq | 17:25 | |
| *** ysandeep is now known as ysandeep|away | 17:27 | |
| ysandeep|away | we can possibly promote 16.2 again in few hours.. current run is good so far | 17:28 |
| * ysandeep|away out | 17:28 | |
| *** amoralej is now known as amoralej|off | 17:34 | |
| weshay|ruck | rlandy, well now.. so ovb on train has been busted since 5/03 afaict.. this patch is working.. https://review.opendev.org/c/openstack/tripleo-image-elements/+/787797/3/elements/interface-names/install.d/71-clean-stale-interface | 17:46 |
| weshay|ruck | and I'm seeing a different error when the overcloud network devices come up | 17:46 |
| weshay|ruck | rlandy, question to you would be.. since 3rd party train is broken anyway.. should we promote c8-train integration and rev the tripleo component for train | 17:47 |
| weshay|ruck | or am I being careless | 17:48 |
| rlandy | one sec - looking at errors | 17:48 |
| rlandy | weshay|ruck: what order? | 17:53 |
| rlandy | promote w/o ovb and then rev tripleo component | 17:53 |
| weshay|ruck | https://logserver.rdoproject.org/openstack-periodic-integration-stable4/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-train/e6a3ce8/logs/overcloud-controller-0/var/log/extra/journal.txt.gz | 17:53 |
| rlandy | or rev triple component to promote? | 17:53 |
| weshay|ruck | May 12 09:00:13 overcloud-controller-0 network[10943]: Bringing up interface eth0: Error: Connection activation failed: No suitable device found for this connection (device lo not available because device is strictly unmanaged). | 17:53 |
| weshay|ruck | probably promoted c8 train tripleo component, and promote c8 train integration | 17:54 |
| weshay|ruck | in that order | 17:54 |
| rlandy | weshay|ruck; yep - promote tripleo component | 17:54 |
| rlandy | run ovb | 17:54 |
| weshay|ruck | and then I can fold back to wallaby | 17:54 |
| rlandy | then integration | 17:54 |
| rlandy | it's broken anyway | 17:55 |
| weshay|ruck | k.. it's failing the same way in tripleo component | 17:55 |
| weshay|ruck | think it's a new bug | 17:55 |
| weshay|ruck | but since the eggs are broken.. no harm in promoting | 17:55 |
| rlandy | so promting tripleo component should make little diff | 17:55 |
| rlandy | check jobs take consistent on tripleo anyways | 17:55 |
| rlandy | k- let's deal with one bug then | 17:56 |
| rlandy | weshay|ruck: 10 minutes for lunch - then will be on wallaby | 17:57 |
| weshay|ruck | np | 17:59 |
| weshay|ruck | ok.. train is promoting w/o ovb | 18:23 |
| * weshay|ruck back to wallaby | 18:23 | |
| weshay|ruck | actually going to doc this bug real quick | 18:24 |
| rlandy | need to submit rhel-9 nodeset | 18:24 |
| rlandy | then into wallaby | 18:24 |
| weshay|ruck | def.. need skip job regex | 18:40 |
| rlandy | weshay|ruck: which component are you working on? | 18:41 |
| * rlandy takes next one | 18:41 | |
| weshay|ruck | rlandy, I got {0} tempest.scenario.test_minimum_basic.TestMinimumBasicScenario.test_minimum_basic_scenario [411.906915s] ... FAILED | 18:41 |
| rlandy | that's bad | 18:41 |
| weshay|ruck | rlandy, for all wallaby standalone jobs | 18:41 |
| weshay|ruck | ya | 18:42 |
| rlandy | regular standalone | 18:42 |
| rlandy | not scenario | 18:42 |
| rlandy | tempest.lib.exceptions.TimeoutException: Request timed out | 18:44 |
| weshay|ruck | also taking hotplug_nic | 18:44 |
| rlandy | weshay|ruck: periodic-tripleo-ci-centos-8-standalone-wallaby passes | 18:45 |
| rlandy | promote? | 18:45 |
| *** jmasud has quit IRC | 18:46 | |
| rlandy | failing all component and passing integration | 18:46 |
| rlandy | periodic-tripleo-ci-centos-8-scenario001-standalone-common-wallaby passes | 18:47 |
| rlandy | not all | 18:47 |
| rlandy | weshay|ruck: what's stopping the wallaby promotion? | 18:48 |
| rlandy | clean up the lines? | 18:49 |
| weshay|ruck | rlandy, ok.. that should fix standalone basic job https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/791041 | 18:49 |
| weshay|ruck | rlandy, perhaps I should nuke all jobs | 18:51 |
| weshay|ruck | periodic-tripleo-ci-centos-8-multinode-1ctlr-featureset010-tripleo-wallaby | 18:51 |
| weshay|ruck | has the same errors as standalone | 18:51 |
| rlandy | just checking some jobs will run with this skiplist entry | 18:52 |
| rlandy | otherwise tempest will fail | 18:52 |
| rlandy | +2'ed | 18:54 |
| rlandy | guess it's ok with the integration line | 18:54 |
| weshay|ruck | this one is totally f'd https://logserver.rdoproject.org/openstack-component-tempest/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-full-tempest-tempest-wallaby/c469e0f/logs/undercloud/var/log/tempest/tempest_run.log.txt.gz | 18:58 |
| rlandy | weshay|ruck: I'm a bit out of context here - chat for 5 so I contribute what's useful | 18:59 |
| weshay|ruck | {3} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_port_security_macspoofing_port [583.972515s] ... FAILED | 18:59 |
| weshay|ruck | rlandy, ya | 18:59 |
| weshay|ruck | https://logserver.rdoproject.org/openstack-component-tempest/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-tempest-wallaby/5227d5f/logs/undercloud/var/log/tempest/tempest_run.log.txt.gz | 18:59 |
| weshay|ruck | should be skipped and it's not | 18:59 |
| weshay|ruck | rlandy, https://meet.google.com/omh-yzvo-qec?authuser=1 | 19:00 |
| *** jmasud has joined #oooq | 19:41 | |
| *** dviroel is now known as dviroel|away | 19:48 | |
| *** slaweq has joined #oooq | 19:48 | |
| *** derekh has quit IRC | 20:39 | |
| *** jmasud has quit IRC | 20:53 | |
| *** slaweq has quit IRC | 21:04 | |
| *** jmasud has joined #oooq | 21:39 | |
| *** jmasud has quit IRC | 22:00 | |
| *** rlandy is now known as rlandy|bbl | 22:01 | |
| *** derekh has joined #oooq | 22:02 | |
| *** jmasud has joined #oooq | 22:17 | |
| *** dviroel|away has quit IRC | 23:01 | |
| *** tosky has quit IRC | 23:01 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!