| *** tosky has quit IRC | 00:10 | |
| *** derekh has quit IRC | 00:20 | |
| *** udesale has quit IRC | 01:27 | |
| *** skramaja has joined #oooq | 03:29 | |
| *** jmasud has joined #oooq | 03:31 | |
| *** saneax has joined #oooq | 03:36 | |
| *** udesale has joined #oooq | 03:54 | |
| *** marios has joined #oooq | 05:01 | |
| *** ratailor has joined #oooq | 05:02 | |
| *** ykarel|away has joined #oooq | 05:03 | |
| *** ykarel|away is now known as ykarel | 05:07 | |
| *** jmasud has quit IRC | 05:08 | |
| *** jmasud has joined #oooq | 05:38 | |
| *** ykarel_ has joined #oooq | 05:49 | |
| *** ykarel has quit IRC | 05:49 | |
| chkumar|ruck | marios: Good morning, since rlandy is not around, can you take care of tripleo-repos personas for downstream CI? | 05:57 |
|---|---|---|
| chkumar|ruck | and let sshnaidm|off takes care of upstream. | 05:57 |
| marios | chkumar|ruck: morning. i am a bit busy today but will add to list might get to it later | 05:59 |
| chkumar|ruck | marios: sure, thanks :-) | 05:59 |
| *** ysandeep|away is now known as ysandeep | 05:59 | |
| *** slaweq has joined #oooq | 06:16 | |
| *** ykarel__ has joined #oooq | 06:29 | |
| *** ykarel_ has quit IRC | 06:31 | |
| *** jmasud has quit IRC | 07:37 | |
| *** jpodivin_ has joined #oooq | 07:42 | |
| *** jpodivin has quit IRC | 07:46 | |
| zbr|rover | o/ | 07:57 |
| bhagyashris | chkumar|ruck, marios ysandeep ykarel__ pojadhav please add in your review list https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/32787 https://review.rdoproject.org/r/c/config/+/32785 | 07:58 |
| *** ykarel__ is now known as ykarel | 07:59 | |
| ysandeep | bhagyashris, ack o/ | 07:59 |
| marios | will do bhagyashris | 08:01 |
| bhagyashris | thanks :) | 08:02 |
| *** tosky has joined #oooq | 08:11 | |
| *** arxcruz has quit IRC | 08:14 | |
| chkumar|ruck | haleyb: Hello, I have commented here https://review.rdoproject.org/r/c/testproject/+/32795 hope it answers your questions | 08:24 |
| chkumar|ruck | zbr|rover: Good morning, since this bug is fixed temproryly https://bugs.launchpad.net/tripleo/+bug/1921679 what other preventive action we can take to avoid in future? | 08:40 |
| openstack | Launchpad bug 1921679 in tripleo "openstack: 'undercloud install' is not an openstack command. See 'openstack --help'." [Critical,Triaged] | 08:40 |
| *** ratailor_ has joined #oooq | 08:42 | |
| *** ratailor has quit IRC | 08:44 | |
| zbr|rover | chkumar|ruck: being hit by new packages being uploaded to pypi is a very old issue, we will not be able to fix it this week | 08:48 |
| zbr|rover | but I would be glad to have a talk with two other team members on what we can do to address it | 08:48 |
| zbr|rover | imho, if we do it we are likely to get a huge improvement in how reliable are our jobs | 08:49 |
| chkumar|ruck | zbr|rover: may be a topic for retro board | 08:49 |
| zbr|rover | the irony is that it would involve a pip lock file similar to the constraints one that was dropped, so we fully control the versions. | 08:50 |
| zbr|rover | pip-tools is a very easy to use tool for detecting what needs to be upgraded, at least we can test the upgrades in isolation | 08:51 |
| zbr|rover | anyone interested about the subject? | 08:51 |
| chkumar|ruck | zbr|rover: marios https://review.rdoproject.org/r/c/config/+/32885 please add it to review queue, thanks! | 08:52 |
| zbr|rover | i can drive it, but i need two others to want to help me | 08:52 |
| chkumar|ruck | zbr|rover: let me create a card and we can add the discussion there | 08:52 |
| zbr|rover | by help i mean: join the discussion, read what i plan to write and tell me how wrong am i, i can do the investigations. | 08:53 |
| chkumar|ruck | zbr|rover: sure, please links the writeup here https://trello.com/c/6tFJcZQZ/1509-detect-the-mixing-of-rpm-and-pip-in-tripleo-ci-jobs thanks for looking into this. | 08:55 |
| chkumar|ruck | ysandeep: can you take a look at testproject review https://code.engineering.redhat.com/gerrit/#/c/233488/ https://sf.hosted.upshift.rdu2.redhat.com/logs/88/233488/1/check/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal-rhos-16.2/7b36212/job-output.txt - Could not find or access '/home/zuul/workspace/.quickstart/config/release/tripleo-ci/RedHat-8/rhos-16.2.yml' on the Ansible | 08:57 |
| chkumar|ruck | Controller. when free, thanks! | 08:57 |
| pojadhav | bhagyashris, ack | 09:03 |
| *** ratailor__ has joined #oooq | 09:27 | |
| *** ratailor_ has quit IRC | 09:30 | |
| *** derekh has joined #oooq | 09:32 | |
| ysandeep | chkumar|ruck, checking | 09:34 |
| ysandeep | chkumar|ruck, i think that's because its missing vars: force_periodic: true | 09:35 |
| ysandeep | i am updating your patchset | 09:35 |
| chkumar|ruck | ysandeep: thanks! | 09:43 |
| *** ykarel is now known as ykarel|lunch | 09:45 | |
| ysandeep | chkumar|ruck, could you please revote on https://review.opendev.org/c/openstack/tripleo-quickstart/+/782211 when you have time. | 09:46 |
| chkumar|ruck | ysandeep: done | 10:23 |
| ysandeep | chkumar|ruck, ++ thanks! | 10:23 |
| chkumar|ruck | ysandeep: can you cross verify rhos-17 and rhos-16.2 jobs for sc10 https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/783831 with reference to this review | 10:23 |
| ysandeep | chkumar|ruck, ack will do.. | 10:26 |
| *** arxcruz has joined #oooq | 10:30 | |
| arxcruz | shit, hate these disconnections and redirects to #openstack-unregistered | 10:31 |
| *** ratailor_ has joined #oooq | 10:33 | |
| *** ratailor__ has quit IRC | 10:36 | |
| marios | please add to your reviews https://review.opendev.org/q/topic:tripleo-ci-reduce-rocky thank you! | 10:43 |
| marios | REVIEWS NEEDED PLEASE THANK YOU ^^^ | 10:44 |
| *** ratailor_ has quit IRC | 10:51 | |
| *** ykarel|lunch is now known as ykarel | 10:52 | |
| zbr|rover | chkumar|ruck: marios: https://review.opendev.org/c/openstack/tripleo-image-elements/+/783642 - i only updated title based on marios comment, safe to +W | 10:59 |
| marios | zbr|rover: ack re-adding vote | 11:00 |
| zbr|rover | marios: imho, you could +W the rocky removals even with a single +2 | 11:01 |
| marios | zbr|rover: ack thanks but i'd rather get some more eyes first | 11:01 |
| marios | zbr|rover: not really in a rush for that... but depends how many more merge conflicts i get i guess ;) | 11:02 |
| zbr|rover | that is why i mentioned it, i am realistic about how long it will take for these changes to merge | 11:02 |
| *** ratailor_ has joined #oooq | 11:12 | |
| kopecmartin | zbr|rover: it seems this is killing downstream jobs, the query is too slow (several minutes) , can we put there a timeout? f.e. to kill the query if it takes more than a minute https://github.com/openstack/ansible-role-collect-logs/blob/master/roles/collect_logs/defaults/main.yml#L214 | 11:20 |
| zbr|rover | kopecmartin: lol, timeout during repolist :D | 11:24 |
| kopecmartin | zbr|rover: we're surprised too :D | 11:25 |
| zbr|rover | sure, just add timeout as it is using shell, also put a comment explaining why it was added. | 11:25 |
| zbr|rover | i hope timeout is always installed | 11:26 |
| kopecmartin | zbr|rover: what would be a reasonable timeout? | 11:26 |
| zbr|rover | imho 30s but you know better | 11:30 |
| zbr|rover | on my machine it too 1s to list repos | 11:31 |
| *** matbu has quit IRC | 11:41 | |
| *** ratailor__ has joined #oooq | 11:43 | |
| *** matbu has joined #oooq | 11:44 | |
| *** ratailor_ has quit IRC | 11:46 | |
| ysandeep | chkumar|ruck, fyi.. sc010 smoke test changes for downstream - https://code.engineering.redhat.com/gerrit/#/c/233534/ .. testing here https://code.engineering.redhat.com/gerrit/#/c/211643/ | 11:46 |
| chkumar|ruck | ysandeep: once passes let me know | 11:46 |
| ysandeep | chkumar|ruck, ack o/ | 11:46 |
| *** ysandeep is now known as ysandeep|afk | 11:50 | |
| * zbr|rover out for lunch | 11:56 | |
| *** matbu has quit IRC | 11:58 | |
| *** matbu has joined #oooq | 12:00 | |
| *** derekh has quit IRC | 12:18 | |
| *** derekh has joined #oooq | 12:20 | |
| *** derekh has quit IRC | 12:28 | |
| weshay|ruck | chkumar|ruck, did someone fix our tempest results rendering? or did they just start working | 12:36 |
| chkumar|ruck | weshay|ruck: sorry I am missing context or logs | 12:37 |
| marios | frenzy_friday: https://review.opendev.org/c/openstack/tripleo-ci/+/783638/3/scripts/emit_releases_file/test_release_name.py#62 | 12:38 |
| chkumar|ruck | weshay|ruck: https://review.rdoproject.org/r/c/config/+/32885 | 12:39 |
| weshay|ruck | chkumar|ruck, https://e88fada250d77d396ef5-a605dbf95134d478b50bec2dfa092555.ssl.cf1.rackcdn.com/710604/14/check/tripleo-ci-centos-8-containers-multinode/1468d03/logs/undercloud/var/log/tempest/stestr_results.html | 12:40 |
| weshay|ruck | the results file has not rendered properly in about two weeks | 12:40 |
| chkumar|ruck | weshay|ruck: ah, might be something got fixed automatically | 12:41 |
| weshay|ruck | chkumar|ruck, looks like it | 12:43 |
| weshay|ruck | chkumar|ruck, thanks for filling the ovb check gap there | 12:44 |
| chkumar|ruck | weshay|ruck: for train, do we care about fs020 jobs? | 12:44 |
| *** ysandeep|afk is now known as ysandeep | 12:45 | |
| weshay|ruck | chkumar|ruck, I usually just weigh the fs20 results against the standalone full scen/api results | 12:45 |
| weshay|ruck | chkumar|ruck, if it's a long running failure in just 20.. but always works in standalone.. we can perm skip w/o escalation | 12:45 |
| weshay|ruck | just note it | 12:45 |
| weshay|ruck | in the skip file | 12:45 |
| weshay|ruck | chkumar|ruck, I can also waive 020 for a promotion if needed | 12:46 |
| chkumar|ruck | weshay|ruck: also can you check the #sf-ops conversaton related to security group retry limit | 12:46 |
| weshay|ruck | chkumar|ruck, next promotion target should be c8-train | 12:46 |
| weshay|ruck | k | 12:46 |
| chkumar|ruck | weshay|ruck: wait donot promote today | 12:47 |
| weshay|ruck | just saying it's a target :) | 12:48 |
| chkumar|ruck | weshay|ruck: https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/783831 waiting for ysandeep testing then we can promote | 12:48 |
| chkumar|ruck | weshay|ruck: http://pastebin.test.redhat.com/951602 sf-ops conversation | 12:49 |
| * zbr|rover back | 12:54 | |
| kopecmartin | chkumar|ruck: hi, any issues upstream with tripleoclient / undercloud deploy fails .. ? i have a few jobs downstream which fail and no one knows why :D | 12:55 |
| *** ratailor__ has quit IRC | 12:56 | |
| chkumar|ruck | kopecmartin: that is fixed now | 12:56 |
| weshay|ruck | chkumar|ruck, so.. re: c8-train | 12:56 |
| chkumar|ruck | kopecmartin: https://bugs.launchpad.net/tripleo/+bug/1921679 if it is related to this | 12:57 |
| openstack | Launchpad bug 1921679 in tripleo "openstack: 'undercloud install' is not an openstack command. See 'openstack --help'." [Critical,Triaged] | 12:57 |
| * kopecmartin chekcing | 12:57 | |
| weshay|ruck | ah dam.. ya. this is the issue generally I *was* seeing | 12:57 |
| weshay|ruck | https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-train/b627c95/logs/undercloud/var/log/tempest/stestr_results.html.gz | 12:57 |
| weshay|ruck | chkumar|ruck, so.. {0} tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_cold_migration [419.560747s] ... FAILED | 12:58 |
| weshay|ruck | is not executed in standalone https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-train/b627c95/logs/undercloud/var/log/tempest/tempest_run.log.txt.gz | 12:58 |
| weshay|ruck | so it's not a good candidate to waive | 12:58 |
| weshay|ruck | that test requires two compute nodes | 12:58 |
| *** dpawlik6 is now known as dpawlik | 12:58 | |
| weshay|ruck | chkumar|ruck, however we can lp cix it.. and promote | 12:59 |
| chkumar|ruck | weshay|ruck: sure, go ahead | 12:59 |
| weshay|ruck | chkumar|ruck, k.. got it | 12:59 |
| weshay|ruck | {3} neutron_tempest_plugin.scenario.admin.test_floatingip.FloatingIpTestCasesAdmin.test_two_vms_fips [58.407967s] ... ok | 12:59 |
| weshay|ruck | passed in standalone | 12:59 |
| *** derekh has joined #oooq | 13:00 | |
| weshay|ruck | this too needs a cix tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_resize[compute,id-719eb59d-2f42-4b66-b8b1-bb1254473967,network,slow] | 13:01 |
| weshay|ruck | I'll get them both | 13:01 |
| * chkumar|ruck hate jira, I am trying to create an issue but I am not able to create it after hitting create button | 13:02 | |
| zbr|rover | chkumar|ruck: i had a worse experience with bz over the weekend, i lost my entire bug report. | 13:04 |
| bhagyashris | chkumar|ruck, you want me try | 13:12 |
| bhagyashris | to try | 13:12 |
| chkumar|ruck | bhagyashris: yes sure, http://paste.openstack.org/raw/804040/ | 13:14 |
| chkumar|ruck | and pass me the issue link once done | 13:15 |
| chkumar|ruck | bhagyashris: can we remove from sprint, we need to discuss on that | 13:23 |
| chkumar|ruck | then we can add it to sprint | 13:23 |
| chkumar|ruck | bhagyashris: thanks for adding that | 13:23 |
| bhagyashris | chkumar|ruck, sure | 13:23 |
| bhagyashris | arxcruz, zbr|rover , sshnaidm, rlandy, marios, ysandeep, bhagyashris, svyas, soniya29, pojadhav, akahat, weshay|ruck , chkumar|ruck , frenzy_friday | 13:24 |
| bhagyashris | Community Meeting IN 6 MINS | 13:24 |
| bhagyashris | https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg?both#2021-03-30-Community-call | 13:24 |
| arxcruz | ack | 13:24 |
| bhagyashris | feel free to add topics here ^ | 13:25 |
| bhagyashris | https://meet.google.com/bqx-xwht-wky?authuser=1 | 13:25 |
| frenzy_friday | marios, ysandeep thanks for the comments on emit release, tox is passing now | 13:27 |
| ysandeep | frenzy_friday great :) | 13:27 |
| marios | frenzy_friday: ack good | 13:29 |
| *** spotz has joined #oooq | 13:30 | |
| chkumar|ruck | zbr|rover: marios: sshnaidm|off weshay|ruck https://projects.engineering.redhat.com/browse/TRIPLEOCI-409 please groom or have thoughts on this card, some day when free :-) | 13:30 |
| *** skramaja has quit IRC | 13:43 | |
| ysandeep | chkumar|ruck, tempest failed for 16.2 sc010 - https://sf.hosted.upshift.rdu2.redhat.com/logs/43/211643/39/check/periodic-tripleo-ci-rhel-8-scenario010-standalone-rhos-16.2/2a0b8ad/job-output.txt | 13:47 |
| ysandeep | chkumar|ruck, you posted similiar failure for train - https://logserver.rdoproject.org/openstack-periodic-integration-stable3/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario010-standalone-train/27fb119/job-output.txt | 13:48 |
| chkumar|ruck | ysandeep: need to handle it other way then | 13:48 |
| *** ykarel is now known as ykarel|away | 13:50 | |
| bhagyashris | weshay|ruck, fyi we haven't pull this code https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/32007 yet on promoter servers | 13:53 |
| *** ykarel|away has quit IRC | 13:54 | |
| chkumar|ruck | ysandeep: now recheck the downstream patch | 13:56 |
| ysandeep | chkumar|ruck, i have also added tempest_test_whitelist job def .. We need to keep those changes right? | 13:59 |
| ysandeep | tempest_test_whitelist in* job def | 14:00 |
| chkumar|ruck | ysandeep: https://review.rdoproject.org/r/c/rdo-jobs/+/32279 is needed for downstream | 14:01 |
| ysandeep | yup.. similiar changes proposed here.. https://code.engineering.redhat.com/gerrit/#/c/233534/2 | 14:01 |
| chkumar|ruck | looks good | 14:02 |
| chkumar|ruck | ysandeep: let's rerun the testproject change | 14:02 |
| ysandeep | chkumar|ruck, ack but I didn't get what patchset 2 https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/783831/2/roles/validate-tempest/vars/tempest_skip.yml will change for downstream job.. | 14:03 |
| chkumar|ruck | ysandeep: this will skip that tests for that job only using running upstream not for all the jobs | 14:03 |
| chkumar|ruck | otherwise we will end up with no test regex found | 14:03 |
| ysandeep | rechecked, lets see how it goes | 14:04 |
| ysandeep | okay i think I got what you mean.. jobs: [] skips that test on all the jobs | 14:07 |
| chkumar|ruck | yes | 14:07 |
| chkumar|ruck | weshay|ruck: based on ysandeep testproject results take action on this https://review.opendev.org/c/openstack/openstack-tempest-skiplist/+/783831 | 14:11 |
| ysandeep | testproject running here https://code.engineering.redhat.com/gerrit/#/c/211643/ | 14:11 |
| chkumar|ruck | @tripleo-ci team, please grab your ptg tickets https://www.eventbrite.com/e/project-teams-gathering-april-2021-tickets-143360351671 if not done that. | 14:28 |
| *** jmasud has joined #oooq | 14:32 | |
| chkumar|ruck | weshay|ruck: podman deps line does not work as expected, rlandy and I was digging last time | 14:34 |
| marios | thanks chkumar|ruck :) 17:28 < chkumar|ruck> @tripleo-ci team, please grab your ptg tickets | 14:37 |
| *** tosky has quit IRC | 14:39 | |
| *** tosky has joined #oooq | 14:39 | |
| chkumar|ruck | weshay|ruck: logging out now, see ya tomorrow, please send emails or bug if seen, | 14:40 |
| weshay|ruck | chkumar|ruck, 0/ | 14:41 |
| *** ysandeep is now known as ysandeep|away | 14:56 | |
| * bhagyashris out | 14:56 | |
| weshay|ruck | chkumar|ruck, ok.. only fs020 removed to promote https://trunk.rdoproject.org/api-centos8-train/api/civotes_agg_detail.html?ref_hash=1f31123099db4f0e841425797ce34028 | 15:09 |
| weshay|ruck | chkumar|ruck, skip_list and bug entered | 15:09 |
| weshay|ruck | zbr|rover, can you report status tomorrow? I'll fill out the doc | 15:10 |
| *** jmasud has quit IRC | 15:10 | |
| zbr|rover | sure | 15:12 |
| weshay|ruck | zbr|rover, k.. we're all good :) status updated | 15:20 |
| weshay|ruck | thanks | 15:20 |
| ysandeep|away | weshay|ruck, marios chkumar|ruck - Please add pojadhav's patch https://review.rdoproject.org/r/c/rdo-jobs/+/32693 in your review list.. | 15:21 |
| marios | ysandeep|away: ack | 15:22 |
| weshay|ruck | zbr|rover, /me looking at ansible language 0.3.0 Sorin :) | 15:25 |
| weshay|ruck | very cool | 15:25 |
| weshay|ruck | zbr|rover, does that require snooty? | 15:31 |
| *** tosky has quit IRC | 15:36 | |
| zbr|rover | weshay|ruck: no. TBH, I have no idea where the snooty prompt appears from, it annoyed me too. I will try to dig that. | 15:38 |
| zbr|rover | i suspect a bug somewhere that makes vscode believe that extension is needed | 15:39 |
| *** marios is now known as marios|out | 16:17 | |
| *** udesale has quit IRC | 16:37 | |
| *** derekh has quit IRC | 17:00 | |
| *** tosky has joined #oooq | 17:03 | |
| weshay|ruck | bhagyashris, the issue I'm seeing is unrelated to https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/32007 | 17:03 |
| weshay|ruck | bhagyashris, akahat c8-train just promoted today http://10.0.148.74/promoter_logs/centos8_train.log | 17:04 |
| weshay|ruck | but no indication of that in the log | 17:04 |
| weshay|ruck | bhagyashris, akahat https://bugs.launchpad.net/tripleo/+bug/1921938 | 17:10 |
| openstack | Launchpad bug 1921938 in tripleo "ci: promoter server does not log a promotion" [Critical,Triaged] | 17:10 |
| akahat | weshay|ruck, looking in to it. | 17:10 |
| *** jmasud has joined #oooq | 17:26 | |
| *** jmasud has quit IRC | 17:35 | |
| *** ykarel|away has joined #oooq | 17:46 | |
| *** marios|out has quit IRC | 17:49 | |
| *** ykarel|away has quit IRC | 18:16 | |
| *** saneax has quit IRC | 18:45 | |
| sshnaidm|off | retry limits are everywhere.. | 19:17 |
| sshnaidm|off | https://089fe9d3f1a2e83d6027-579ffa891605f8b01745396aeb7b7fcc.ssl.cf1.rackcdn.com/783860/1/check/tripleo-ci-centos-8-content-provider-train/b40b1b6/job-output.txt | 19:18 |
| sshnaidm|off | infra fails | 19:18 |
| *** slaweq has quit IRC | 20:26 | |
| weshay|ruck | heh | 21:27 |
| weshay|ruck | ya.. they are upstream, rdo and internal | 21:27 |
| *** jmasud has joined #oooq | 21:53 | |
| *** jmasud has quit IRC | 21:59 | |
| *** jmasud has joined #oooq | 22:00 | |
| *** jmasud has quit IRC | 22:07 | |
| *** dpawlik has quit IRC | 22:37 | |
| *** holser has quit IRC | 22:42 | |
| *** amoralej|off has quit IRC | 22:42 | |
| *** openstackstatus has quit IRC | 22:42 | |
| *** dpawlik0 has joined #oooq | 22:42 | |
| *** openstack has joined #oooq | 22:43 | |
| *** ChanServ sets mode: +o openstack | 22:43 | |
| *** pojadhav has joined #oooq | 22:43 | |
| *** tosky has quit IRC | 23:14 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!