Monday, 2020-11-09

*** tosky has quit IRC00:41
*** skramaja has joined #oooq03:09
*** jmasud has joined #oooq03:13
*** jmasud has quit IRC03:24
*** jmasud has joined #oooq03:48
*** udesale has joined #oooq04:07
*** udesale_ has joined #oooq04:12
*** udesale has quit IRC04:15
*** jmasud has quit IRC04:39
*** jmasud has joined #oooq04:40
*** ykarel has joined #oooq04:46
*** ratailor has joined #oooq05:17
*** pojadhav|afk is now known as pojadhav05:20
*** skramaja has quit IRC06:06
*** saneax has joined #oooq06:20
*** ykarel_ has joined #oooq06:27
*** sanjayu_ has joined #oooq06:27
*** saneax has quit IRC06:28
*** marios has joined #oooq06:30
*** ykarel has quit IRC06:30
*** ysandeep|away is now known as ysandeep06:39
*** ysandeep is now known as ysandeep|ruck06:39
*** udesale__ has joined #oooq06:51
*** udesale_ has quit IRC06:54
*** udesale_ has joined #oooq07:24
*** udesale__ has quit IRC07:27
*** skramaja has joined #oooq07:31
chandankumarysandeep|ruck: hello07:33
chandankumarysandeep|ruck: seen this issue https://dae45d7d5687dfab611e-6ec9504d1ecc47a9ef6950d383ea355d.ssl.cf5.rackcdn.com/757836/12/check/tripleo-ci-centos-8-undercloud-upgrade-ussuri/a3b563e/logs/undercloud/home/zuul/undercloud_upgrade.log07:33
ysandeep|ruckchandankumar, i have not noticed this earlier, but seeing build history - looks like we have an issue - https://zuul.openstack.org/builds?job_name=tripleo-ci-centos-8-undercloud-upgrade-ussuri , i will write a bug for it and check further07:36
chandankumarysandeep|ruck: sure thanks :-)07:39
*** jmasud has quit IRC07:45
*** jmasud has joined #oooq07:46
*** udesale_ has quit IRC07:50
*** udesale_ has joined #oooq07:51
*** udesale__ has joined #oooq07:56
*** udesale_ has quit IRC07:59
*** jmasud has quit IRC08:02
*** sanjayu_ has quit IRC08:17
ysandeep|ruckchandankumar, sshnaidm_ fyi.. https://bugs.launchpad.net/tripleo/+bug/190349808:19
openstackLaunchpad bug 1903498 in tripleo "tripleo-ci-centos-8-undercloud-upgrade-ussuri is failing RuntimeError: Update extra packages failed: b'sudo: yum: command not found\n" [Critical,Triaged]08:19
ysandeep|ruckadding promotion-blocker as this job is voting in upstream08:19
*** saneax has joined #oooq08:20
chandankumarysandeep|ruck: thanks!08:20
*** ysandeep|ruck is now known as ysandeep|lunch08:21
*** apetrich has joined #oooq08:33
*** ykarel_ is now known as ykarel08:37
*** ysandeep|lunch is now known as ysandeep|ruck09:15
*** sshnaidm_ is now known as sshnaidm|rover09:24
sshnaidm|roverysandeep|ruck, ack, looking09:24
ysandeep|ruckthanks!09:28
sshnaidm|rovermaybe this broke https://review.opendev.org/#/c/75991209:33
*** derekh has joined #oooq09:37
matbuo/ hi folks, can i have a vote and eyes on this plz: https://review.opendev.org/#/c/756328/09:44
matbuykarel: can you revisit your vote on it plz ^   afaik the centos7 is fixed now09:45
matbuthx a lot09:45
ysandeep|rucksshnaidm|rover, Hi o/ I want sync with you when you have time.09:58
sshnaidm|roverysandeep|ruck, sure, let's sync09:59
ysandeep|rucksshnaidm|rover, meet.google.com/yrn-drdb-zxc09:59
ykarelmatbu, ack will check, ci.centos jobs are broken though, but can be fixed with installing some python3 packages10:16
chandankumarzbr: Hello, one more comment https://review.opendev.org/#/c/761764/410:18
zbrchandankumar: is good that we are working remotely my first reaction was to use some inappropriate language around licensing ;)10:23
*** udesale_ has joined #oooq10:51
*** udesale__ has quit IRC10:54
chandankumarmarios: sshnaidm|rover zbr https://review.opendev.org/#/q/topic:new-ci-job+owner:%22Chandan+Kumar+(raukadah)+%253Cchkumar%2540redhat.com%253E%22+branch:+stable/queens+status:open most of them needs +w basically10:55
marioschandankumar: ack added for next review run10:55
*** tosky has joined #oooq11:09
*** ratailor_ has joined #oooq11:20
*** ratailor_ has quit IRC11:22
*** ratailor has quit IRC11:22
*** ratailor_ has joined #oooq11:23
*** ratailor_ has quit IRC11:50
*** rfolco has joined #oooq12:04
*** holser has joined #oooq12:26
*** dtantsur|afk is now known as dtantsur12:32
*** rlandy has joined #oooq12:33
marioshttps://review.opendev.org/#/c/761892/12:37
mariosrlandy: chandankumar: rfolco: akahat: ^^12:37
mariossshnaidm|rover: why u -1 ? ^12:37
sshnaidm|rovermarios, because I don't understand yet how it worked before12:38
sshnaidm|rovermarios, seems like job always used dnf till tomorrow12:38
sshnaidm|rovermarios, any idea where could it broke yesterday?12:38
sshnaidm|rovermaybe c7/c8 issue, but still unclear what happened12:39
chandankumarhttps://review.opendev.org/#/q/4a07e16a5883fc72613e63a95da02332f75226fa12:39
mariossshnaidm|rover: ack we are discussing now on call12:40
mariossshnaidm|rover: adding comments12:40
mariossec12:40
sshnaidm|roverchandankumar, ack, now I see12:40
sshnaidm|roverso it should have been ported to train as well12:40
mariossshnaidm|rover: see commit message @ https://review.opendev.org/#/c/760635/3 for pointers/context about what we did there (original fix & recent update)12:44
rlandymarios: https://review.opendev.org/#/c/760405/12:46
rlandyhttps://review.opendev.org/#/c/760420/12:46
mariosrebase posted v6 https://review.opendev.org/759702 & v6 https://review.opendev.org/76032312:50
mariosrlandy: chandankumar: rfolco: akahat: ^^12:50
chandankumarweshay|ruck: https://bugs.launchpad.net/tripleo/+bug/190349812:50
openstackLaunchpad bug 1903498 in tripleo "tripleo-ci-centos-8-undercloud-upgrade-ussuri is failing RuntimeError: Update extra packages failed: b'sudo: yum: command not found\n" [Critical,Triaged]12:50
marios        * https://review.opendev.org/#/c/760426/712:52
rlandychandankumar: when you get time, pls review changes to rhos-release test https://code.engineering.redhat.com/gerrit/#/q/topic:rename-rhos-15-test+(status:open+OR+status:merged)12:57
rlandyplan is to get rid of the '15' test12:57
*** pojadhav is now known as pojadhav|brb12:58
weshay|ruckchandankumar, rlandy https://code.engineering.redhat.com/gerrit/#/c/216933/ fyi13:00
rlandyweshay|ruck: wow - are we ready to out those jobs in criteria?13:02
*** TrevorV has joined #oooq13:06
weshay|ruckrlandy, I think so.. https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/view/pipeline/13:12
weshay|ruckrlandy, I need to update monitoring for the components13:12
rlandyweshay|ruck: k - we can try13:12
*** pojadhav|brb is now known as pojadhav13:12
mariosrebase posted v6 https://review.opendev.org/759702 & v6 https://review.opendev.org/76032313:19
weshay|ruckysandeep|ruck, you have cix, just checking13:20
ysandeep|ruckweshay|ruck, yes i will join cix13:20
*** saneax has quit IRC13:38
weshay|ruckhttps://code.engineering.redhat.com/gerrit/#/c/216933/1/ci-scripts/dlrnapi_promoter/config/RedHat-8/component/rhos-16.2.yaml13:48
*** rh-jelabarre has joined #oooq13:54
*** Goneri has joined #oooq13:59
chandankumarbrb for an hour14:05
*** ykarel has quit IRC14:08
ysandeep|ruckweshay|ruck, These new jobs in 16.2 component criteria - Are trigger time of these jobs in sync with our pipelines?14:15
weshay|ruckysandeep|ruck, you want me to show you around how this works?14:16
ysandeep|ruckweshay|ruck, yes we have 1:1 tomorrow if you want to utilize that time14:16
weshay|ruckok.. fair enough.. let's do it tomorrow14:17
ysandeep|ruckthanks!14:17
*** ykarel has joined #oooq14:18
weshay|ruckysandeep|ruck, anything you need help w/ or want to hand off14:18
weshay|rucksshnaidm|rover, you good? need anything?14:19
sshnaidm|roverweshay|ruck, yeah, I'm good14:20
sshnaidm|roverweshay|ruck, all is calm14:20
weshay|ruck:)14:20
ysandeep|ruckweshay|ruck, I am good,  i was trying to fix fs039 with https://review.opendev.org/#/c/761863/3/roles/freeipa-setup/tasks/main.yml but last run failed because supplemental node don't have wget command, updating patchset to install wget first, i am okay for now14:22
weshay|ruck++ thanks14:22
weshay|ruckI waived it.. thansk for fixing.. I didn't want to hold the promotion on 3914:22
weshay|ruckI think sshnaidm|rover would agree14:23
sshnaidm|roverweshay|ruck,  why do we run 039 on master when we have standalone ipa?14:23
sshnaidm|roverseems like duplication for me14:23
ysandeep|ruckweshay|ruck, yes thanks for waving, sshnaidm|rover and me were discussing the same14:23
weshay|ruckthe sec team would disagree.. /me working that14:24
ysandeep|ruckweshay|ruck, i still see fs039 in criteria http://promoter.rdoproject.org/config/CentOS-8/master.ini14:45
weshay|ruckah.. ysandeep|ruck I'll check master.. I think I took it out for ussuri14:46
rlandymarios: you're rebasing the two victoria patches?14:50
mariosrlandy: yeah will do gimme few mins14:50
*** udesale has joined #oooq14:52
*** udesale_ has quit IRC14:55
ysandeep|ruckweshay|ruck, fyi.. we are 6 days behind master promotion, I was chasing master promotion - In last buildset following jobs failed - https://review.rdoproject.org/zuul/buildset/733591f5f34d4349bfad6163ed0a58ee14:55
ysandeep|ruckStatus:-14:55
ysandeep|ruck~~~14:55
ysandeep|ruckfs001 - timedout in last 2 run - rerunning with testproject https://review.rdoproject.org/r/#/c/28446/ , currently in queue14:55
ysandeep|ruckfs039 - https://launchpad.net/bugs/1902478 , trying to fix with https://review.opendev.org/#/c/761863/14:55
openstackLaunchpad bug 1902478 in tripleo "tripleo-ci-centos-8-standalone-on-multinode-ipa/tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039-master failing while configuring FreeIPA server with RuntimeError: CA configuration failed." [Critical,In progress] - Assigned to Sandeep Yadav (sandeepyadav93)14:55
ysandeep|ruckfs020 - https://bugs.launchpad.net/tripleo/+bug/1903033 - i think we need nova team's help here,  Not escalated as this job not in criteria - but we need to engage correct person here.14:55
openstackLaunchpad bug 1903033 in tripleo "periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master is failing while executing cold migration & resize tempest tests with Stderr: 'mkdir: cannot create directory ‘/var/lib/nova/instances/<uuid>’: Permission denied\n'" [Critical,Triaged]14:55
ysandeep|ruckmultinode-ipa-master - new issue, reported and escalated to cix today https://bugs.launchpad.net/tripleo/+bug/190350814:55
openstackLaunchpad bug 1903508 in tripleo "periodic-tripleo-ci-centos-8-standalone-on-multinode-ipa-master is failing on tempest test while spawning instance with Error - Cannot load certificate '/etc/pki/libvirt-vnc/server-cert.pem' & key '/etc/pki/libvirt-vnc/server-key.pem': Error while reading file."" [Critical,Triaged]14:55
ysandeep|ruck~~~14:55
weshay|ruck++14:55
*** saneax has joined #oooq14:56
mariosrlandy: incoming updates now14:59
rlandyweshay|ruck: sync'ing up https://review.rdoproject.org/r/#/c/30489/2/zuul.d/integration-pipeline-stein.yaml and check ...15:02
rlandy periodic-tripleo-ci-centos-7-undercloud-containers-stein still exists15:03
rlandyhttps://github.com/openstack/tripleo-ci/blob/master/zuul.d/undercloud-jobs.yaml#L132 - rocky only15:03
rlandywhich one should change?15:03
weshay|ruckrlandy, so periodic should match upstream.. upstream rulz15:05
weshay|ruckdoes that answer? /me looking at the review15:05
weshay|rucksshnaidm|rover, https://review.opendev.org/#/c/761384/15:06
weshay|ruckjob freeze15:07
sshnaidm|roverlooking15:08
rlandyweshay|ruck: so remove from periodic?15:08
weshay|ruckthanks15:08
weshay|ruckrlandy, ya.. or make non-criteria15:08
weshay|ruckeither is fine by me15:08
weshay|ruckideally we nuke them15:08
weshay|rucknobody cares about rocky and stein.. so imho NUKE15:09
rlandyweshay|ruck: k - let's leave it running for the moment - we will also have to change criteria on the promoter itself15:09
weshay|ruckrlandy, aye.. let's do that today15:09
rlandyweshay|ruck: you're out this afternoon?15:09
sshnaidm|roverweshay|ruck, it's because https://github.com/openstack/tripleo-ci/blob/master/zuul.d/base.yaml#L7815:10
*** pojadhav is now known as pojadhav|afk15:10
weshay|ruckrlandy, if these folks show today.. thus far.. no phone call15:11
rlandyweshay|ruck: k - we should probably work from criteria backwards ... so we don't nuke something in criteria .. pls pm me when you have time to tackle this15:16
weshay|ruckrlandy, aye15:18
*** ysandeep|ruck is now known as ysandeep|away15:25
weshay|ruckya.. was just rescheduled15:27
weshay|ruckno pto today15:27
weshay|ruckrlandy, will catch up w/ you in the afternoon15:28
rlandyok15:31
rlandymarios: sshnaidm|rover: https://review.opendev.org/#/c/759702/ updated per comments15:35
mariosrlandy: ack rebased that then https://review.opendev.org/#/c/760323/ thanks15:37
mariosrlandy: didn't wipe your vote15:37
mariosrlandy: and it means i can vote on /#/c/759702/ ;)15:38
mariosweshay|ruck: do you remember where/how i get meetbot to join tripleo for the meeting tomorrow?15:39
mariosor anyone else? ^^15:39
weshay|ruck#startmeeting tripleo15:41
openstackMeeting started Mon Nov  9 15:41:27 2020 UTC and is due to finish in 60 minutes.  The chair is weshay|ruck. Information about MeetBot at http://wiki.debian.org/MeetBot.15:41
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:41
*** openstack changes topic to " (Meeting topic: tripleo)"15:41
openstackThe meeting name has been set to 'tripleo'15:41
mariosweshay|ruck: :) thanks15:41
weshay|ruckhello meeting15:41
marioshello15:41
marios#endmeeting tripleo15:41
marios:(15:41
weshay|ruck#endmeeting tripleo15:42
*** openstack changes topic to "Docs: https://docs.openstack.org/tripleo-quickstart/latest/ || 3rd Apr Important promoter patch https://review.rdoproject.org/r/25931"15:42
openstackMeeting ended Mon Nov  9 15:42:00 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:42
openstackMinutes:        http://eavesdrop.openstack.org/meetings/tripleo/2020/tripleo.2020-11-09-15.41.html15:42
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2020/tripleo.2020-11-09-15.41.txt15:42
openstackLog:            http://eavesdrop.openstack.org/meetings/tripleo/2020/tripleo.2020-11-09-15.41.log.html15:42
marios(so it only listens to the one that starts it weshay|ruck ? )15:42
weshay|rucktry it15:42
marios#startmeeting tripleo15:42
openstackMeeting started Mon Nov  9 15:42:30 2020 UTC and is due to finish in 60 minutes.  The chair is marios. Information about MeetBot at http://wiki.debian.org/MeetBot.15:42
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:42
*** openstack changes topic to " (Meeting topic: tripleo)"15:42
openstackThe meeting name has been set to 'tripleo'15:42
mariossorry testing15:42
marios#endmeeting tripleo15:42
*** openstack changes topic to "Docs: https://docs.openstack.org/tripleo-quickstart/latest/ || 3rd Apr Important promoter patch https://review.rdoproject.org/r/25931"15:42
openstackMeeting ended Mon Nov  9 15:42:41 2020 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:42
openstackMinutes:        http://eavesdrop.openstack.org/meetings/tripleo/2020/tripleo.2020-11-09-15.42.html15:42
mariosk thanks15:42
weshay|ruck++15:42
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/tripleo/2020/tripleo.2020-11-09-15.42.txt15:42
openstackLog:            http://eavesdrop.openstack.org/meetings/tripleo/2020/tripleo.2020-11-09-15.42.log.html15:42
*** udesale has quit IRC15:51
*** udesale has joined #oooq15:52
*** skramaja has quit IRC15:57
*** udesale has quit IRC15:58
marios[tripleo] next meeting Tuesday Nov 10 @ 1400 UTC in #tripleo * http://lists.openstack.org/pipermail/openstack-discuss/2020-November/018535.html15:59
mariossshnaidm|rover: chandankumar: rfolco: akahat: weshay|ruck: when you get a chance please vote on https://review.opendev.org/#/c/760323/816:04
weshay|ruckFYI... /me working on monitoring today.. holla if you need something16:16
weshay|ruckrlandy, FYI.. this is the best I can do w/ the data in the db atm16:16
weshay|ruckhttp://tripleo-cockpit.usersys.redhat.com/d/KyHCwLHMk/rhos-16-2-full-component-pipeline?orgId=1&from=now-7d&to=now&fullscreen&panelId=48316:16
weshay|ruckthe result 0,1 needs to be flipped for jenkins jobs16:17
weshay|ruckysandeep|away, ^16:17
weshay|ruckduration needs to change as well16:17
* rlandy looks16:18
*** saneax has quit IRC16:23
weshay|ruckrlandy, fixing the things now16:27
rlandyok16:27
rlandyfinishing up rhos-release stuff16:27
*** marios is now known as marios|out16:47
*** marios|out has quit IRC16:50
*** saneax has joined #oooq16:58
*** dsneddon has joined #oooq17:02
*** ykarel has quit IRC17:04
*** jmasud has joined #oooq17:24
*** jmasud has quit IRC17:27
*** rlandy is now known as rlandy|biab17:29
*** saneax has quit IRC17:42
*** derekh has quit IRC18:00
weshay|ruckrlandy|biab, rfolco https://review.rdoproject.org/r/#/c/30816/18:07
*** dtantsur is now known as dtantsur|afk18:24
rfolcoweshay|ruck, +218:32
weshay|ruckdanka18:35
*** rlandy|biab is now known as rlandy18:38
rlandy rfolco: weshay|ruck: can one of you guys confirm that I got this file clause correct ( must not run against rhel-7 and puddles 10-13) https://code.engineering.redhat.com/gerrit/#/c/217375/2/zuul.d/rhos-release.yaml18:53
weshay|ruckrlandy, /me looks18:55
rlandyweshay|ruck: I didn't know if could use files and irrelevant-files together18:56
rlandywhich really would have helped here18:57
weshay|ruckrlandy, ya.. sec18:58
weshay|ruckstill looking18:58
weshay|ruckrlandy, add repos18:59
weshay|ruckto the files..18:59
weshay|ruckrlandy, also avail to go through stein / rocky19:00
rlandyweshay|ruck: 15 minutes? waiting for the other rhos-release job to kcik19:00
rlandykick19:00
weshay|ruckk19:01
weshay|ruckok.. http://tripleo-cockpit.usersys.redhat.com/d/KyHCwLHMk/rhos-16-2-full-component-pipeline?orgId=1&from=now-7d&to=now19:11
weshay|ruckgreen and red are flipped until new data comes in19:12
rlandyweshay|ruck: https://meet.google.com/inv-muob-meq19:12
rlandywhen you are ready19:12
rlandyhttps://review.rdoproject.org/r/#/c/30489/19:13
weshay|ruckk19:13
*** fuzzball81 has quit IRC19:19
*** fuzzball81 has joined #oooq19:19
*** fuzzball81 has quit IRC19:20
*** fuzzball81 has joined #oooq19:20
*** fuzzball81 has quit IRC19:21
weshay|ruckrlandy, http://dashboard-ci.tripleo.org/d/3-DYSmOGk/jobs-exploration?orgId=1&var-influxdb_filter=branch%7C%3D%7Cstable%2Frocky&var-influxdb_filter=job_name%7C%3D~%7C%2Ftripleo.*%2F19:23
*** fuzzball81 has joined #oooq19:24
*** fuzzball81 has quit IRC19:24
*** fuzzball81 has joined #oooq19:32
*** holser has quit IRC19:40
weshay|ruckrlandy, https://code.engineering.redhat.com/gerrit/#/c/216933/19:43
weshay|ruckrlandy, https://bugs.launchpad.net/tripleo/+bug/190358119:59
openstackLaunchpad bug 1903581 in tripleo "tripleo-ci-centos-8-scenario000-multinode-oooq-container-updates is pulling containers from docker.io" [Critical,Triaged]19:59
*** fuzzball81 has quit IRC20:07
*** tosky has quit IRC20:17
*** fuzzball81 has joined #oooq20:22
*** fuzzball81 has quit IRC20:25
*** tosky has joined #oooq20:28
*** fuzzball81 has joined #oooq20:36
*** fuzzball81 has quit IRC20:37
*** fuzzball81 has joined #oooq20:39
*** frenzy_friday has quit IRC20:42
rlandyweshay|ruck: https://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates - are we sure we want to get rid of this job?20:47
rlandyhttps://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates&branch=stable%2Frocky20:47
rlandy^^ branch only20:47
weshay|ruckrlandy, ask the upgrades squad if they would fix it if it breaks21:02
weshay|ruckprobably not21:02
*** fuzzball81 has quit IRC21:02
rlandyweshay|ruck: ie: as in they probably won't?21:03
rlandyweshay|ruck: well sceanrio009 has gone  https://review.opendev.org/76199721:04
rlandyit's the only place I see it21:04
weshay|ruckrlandy, ysandeep|away 16.2 dlrn api is boosted afaict21:05
weshay|ruckhttp://pastebin.test.redhat.com/91694321:05
rlandyagain???21:05
weshay|ruckrlandy, that happened before?21:05
rlandyweshay|ruck: well last time it lost digits off the hash21:06
*** fuzzball81 has joined #oooq21:06
weshay|ruckya21:06
weshay|ruckthis is diff21:06
*** rfolco has quit IRC21:28
*** jmasud has joined #oooq21:53
*** jmasud has quit IRC22:06
*** jmasud has joined #oooq22:09
*** jmasud has quit IRC22:30
*** jmasud has joined #oooq22:54
*** saneax has joined #oooq22:59
*** saneax has quit IRC23:02
*** jmasud has quit IRC23:07
*** jmasud has joined #oooq23:24
*** tosky has quit IRC23:33

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!