Thursday, 2021-04-01

*** jmasud has quit IRC00:21
*** jmasud has joined #oooq00:22
*** ysandeep|away is now known as ysandeep00:41
*** jmasud has quit IRC00:56
*** jmasud has joined #oooq01:29
weshay|rucksshnaidm, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/32950 sorry man01:34
weshay|ruckif you want to revert my stuff and merge your.. that's fine too01:35
*** jmasud has quit IRC03:05
*** jmasud has joined #oooq03:12
*** jmasud has quit IRC03:49
*** ykarel|away has joined #oooq03:50
*** ykarel|away is now known as ykarel03:54
*** ratailor has joined #oooq04:23
*** skramaja has joined #oooq04:30
*** ratailor_ has joined #oooq04:44
*** ratailor has quit IRC04:47
*** ratailor__ has joined #oooq05:10
*** jmasud has joined #oooq05:12
*** ratailor_ has quit IRC05:13
*** marios has joined #oooq05:25
*** udesale has joined #oooq05:58
*** saneax has joined #oooq06:16
*** jpodivin has joined #oooq06:27
zbr|rovermorning07:12
zbr|roverchkumar|ruck: did something happening with zuul over the night? i see a starting gate msg on https://review.opendev.org/c/openstack/tripleo-ansible/+/78413307:12
zbr|roverbut not result, and searching for the change in the queue does not display anything07:13
chkumar|ruckzbr|rover:  they restarted the zuul, things are coming back online07:13
zbr|roverso i need to recheck it07:13
chkumar|ruckyes07:22
*** ratailor has joined #oooq07:35
*** skramaja has quit IRC07:35
*** ratailor__ has quit IRC07:36
*** jmasud has quit IRC07:43
*** tosky has joined #oooq07:45
*** ykarel has quit IRC08:03
*** ykarel has joined #oooq08:05
*** derekh has joined #oooq08:23
*** ysandeep is now known as ysandeep|lunch08:27
*** ykarel is now known as ykarel|lunch08:58
marioszbr|rover: o/ hey do you know about that please? https://review.opendev.org/c/openstack/tripleo-quickstart/+/783044/4/ci-scripts/provision_centos_settings.yml#1 i see your name in the commit history from 2 years ago ;)09:17
* marios food biab09:20
zbr|rovermarios: no idea, nuke it.09:36
mariosk thanks zbr|rover let's see if weshay|ruck knows later09:43
zbr|rovermarios: have you grepped by this file name? if not found in place where missing file would give error I would remove. If not I would try to empty file.09:44
marioszbr|rover: yeah hound/codesearch gave me nothing09:49
chkumar|rucksshnaidm: marios weshay|ruck please have a look when free https://code.engineering.redhat.com/gerrit/#/c/233961/ thanks!10:03
chkumar|ruckysandeep|lunch: did you got the bug opened for ovb downstream issue?10:05
marioschkumar|ruck: ack10:05
*** ysandeep|lunch is now known as ysandeep10:05
*** ykarel|lunch is now known as ykarel10:10
ysandeepchkumar|ruck, we merged your patch to move to ovb2.0 after that we are not hitting that error anymore.10:11
chkumar|ruckysandeep: awesome10:18
zbr|rovermarios: chkumar|ruck sshnaidm: please comment on https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/783843 -- our downstream folks found a serious bottleneck related to repolist10:19
ysandeepchkumar|ruck, i noticed a new error in ovb downstream job.. will monitor more runs..10:19
ysandeephttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-component-baremetal/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal-baremetal-rhos-16.2/2d2886e/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz10:19
ysandeepbut we didn't face this in your test project patch ^^.. so may be unreleated to ovb2.010:20
marioszbr|rover: i already did earlier10:20
marioszbr|rover: but pavel said it is the wrong fix?10:20
marioszbr|rover: read the comments there10:20
marioszbr|rover: https://review.opendev.org/c/openstack/ansible-role-collect-logs/+/783843/1/roles/collect_logs/defaults/main.yml#b22310:21
zbr|roversshnaidm: why you still have -W on https://review.opendev.org/c/openstack/tripleo-ansible/+/778095/ ?10:50
zbr|roveryep, i know. i wanted your opinion, not a vote on that case.10:51
zbr|roveri don't think is a case of good/bad fix, each approach has it ups and downs.10:52
zbr|roverahh!10:52
zbr|roveri guess kopecmartin will rework the artcl patch based on pavel input. we will help them merge.10:53
kopecmartinzbr|rover: not sure if I'll get to it today though10:58
sshnaidmzbr|rover, I11:23
sshnaidmzbr|rover, going to update it11:23
*** ysandeep is now known as ysandeep|afk11:35
*** rlandy has joined #oooq11:42
zbr|roversshnaidm: i hope you seen my revert.11:58
sshnaidmzbr|rover, of ..?11:58
zbr|roverhttps://review.opendev.org/c/openstack/tripleo-ansible/+/784052/211:58
zbr|roverwe disabled the broken jobs at infra request, so you will need the revert in order to validate your fix.11:59
sshnaidmzbr|rover, k12:00
rlandyysandeep|afk: hi - where are we on the 17 to 8.4 stuff? where should I pick up?12:08
chkumar|ruckrlandy: welcome back12:10
rlandychkumar|ruck: hey!! thanks - what did I miss?12:10
chkumar|ruckrlandy: not much12:11
chkumar|ruckrlandy: we upgraded ovb downstream12:11
rlandychkumar|ruck: oh great - thank you12:11
chkumar|ruckrlandy: https://code.engineering.redhat.com/gerrit/#/c/233961/ and https://review.opendev.org/q/topic:%22fix_octavia_kvm%22+(status:open%20OR%20status:merged) when free, thanks!12:14
rlandychkumar|ruck: ^^reading through - may need some background info here ...12:16
rlandyrhel82?12:16
weshay|ruckchkumar|ruck, zbr|rover things back to normal?12:18
weshay|rucksee ur email12:18
weshay|ruckthanks12:18
rlandyweshay|ruck: hi - did things get sorted with the candidate instance?12:19
rlandydns has been a issue on vexxhost12:19
rlandyhave to remove the entries in /etc/resolv.conf and replace12:19
weshay|ruckrlandy, ya.. I did and chattr it12:20
rlandywill do that on next instance12:20
rlandythanks - not sure what changed - started to see that dns issue last week12:20
zbr|roverweshay|ruck: ouch, when i read the title this morning i was sure you were referring to our molecule job12:20
weshay|ruckzbr|rover, no dude.. ALL JOBS DOWN12:21
zbr|roveras the outcome was the same "retry limit"12:21
zbr|roverlet me guess.... is has to do with the "stream" model12:21
weshay|ruckzbr|rover, zuul12:22
*** bhagyashris has quit IRC12:28
*** bhagyashris has joined #oooq12:29
*** sanjayu_ has joined #oooq12:35
*** saneax has quit IRC12:36
*** ysandeep|afk is now known as ysandeep12:37
ysandeeprlandy, hey welcome back! baremetal h/w issue sorted.. 17 line still hitting deps issue so we were not able to promote.. weshay|ruck is working on creating a repoclosure job to deal early with deps issue12:38
rlandyysandeep: thanks - I am closing out old CIX's that are fixed - new one on gnocchi - logging that12:39
weshay|ruckrlandy, standdown from osp-17 please12:40
rlandyweshay|ruck: I am commenting on the fixed CIX cards12:41
zbr|roverweshay|ruck: i am going for lunch, lets sync when i am back?12:42
weshay|ruckzbr|rover, sure12:44
*** ratailor has quit IRC12:45
weshay|ruckzbr|rover, you can close the task in tripleo-ci re: zuul12:50
bhagyashrisakahat, arxcruz  pojadhav rlandy frenzy_friday ysandeep scrum meeting time13:01
pojadhavbhagyashris, joined13:01
*** sanjayu__ has joined #oooq13:06
*** sanjayu_ has quit IRC13:09
ysandeepmarios, rlandy, weshay|ruck https://review.rdoproject.org/r/c/config/+/32911 and https://review.rdoproject.org/r/c/rdo-jobs/+/32912 priority13:10
ysandeepfor wallaby ^ please add in your review list13:14
weshay|ruckchkumar|ruck, have you seen this? https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario001-standalone-master/9815483/logs/undercloud/var/log/containers/ceilometer/ceilometer-upgrade.log.txt.gz13:20
weshay|ruckchkumar|ruck, seeing issues w/ gnocchi upstream and downstream13:21
chkumar|ruckweshay|ruck: sc2 also hits the same13:21
chkumar|ruckin master13:21
chkumar|ruckI have not yet opened the bug13:21
chkumar|rucksc7 is hitting at tempest something nasty pyroute2 and nova13:22
weshay|ruckya13:22
*** derekh has quit IRC13:33
*** derekh has joined #oooq13:34
zbr|roveri am back13:35
*** derekh has quit IRC13:36
chkumar|ruckrlandy: sshnaidm weshay|ruck marios want to start the triple-repos call early? scrum just ended13:36
*** derekh has joined #oooq13:36
weshay|ruckchkumar|ruck, this is interesting13:37
weshay|ruck  Zuul52f198390eMerge "Fix gnocchi create resource error when missing flavor"2 months ago13:37
weshay|ruck  Zuul76d3d61cb2Merge "Using Iterable was deprecated in python 3.3"2 months ago13:37
weshay|ruck  liyi5d40f5e70aFix gnocchi create resource error when missing flavor 3 years ago13:37
weshay|ruckfix gnocchi create resource.. patch 3 years ago13:37
weshay|ruckmerged 2 months ago13:37
chkumar|ruckthen it is going to break13:38
chkumar|rucklot has changed13:38
rlandychkumar|ruck: ok by me13:38
sshnaidmchkumar|ruck, yeah, fine with me13:40
marioso/ chkumar|ruck13:43
mariosfine by me too13:44
chkumar|ruckmarios: weshay|ruck rlandy sshnaidm arxcruz akahat https://meet.google.com/ten-izvy-tjp?authuser=013:45
chkumar|rucktripleo repos call13:46
chkumar|ruckrlandy: we are waiting for you13:47
chkumar|ruckarxcruz: joining?13:48
zbr|roversshnaidm: if I understand correctly there are podman modules inside tripleo-ansible copied from the collection?14:20
sshnaidmzbr|rover, yes14:21
zbr|roverand we ended up having to backport fixes, i hope we can remove them soon and just use the collection.14:21
* ysandeep stepping out ~1 hr for some personal work14:30
*** ysandeep is now known as ysandeep|away14:30
*** sanjayu__ has quit IRC14:51
marioszuul.opendev down?14:57
chkumar|ruckweshay|ruck: zbr|rover logging out now, see ya on monday Have a nice weekend ahead :-)15:01
*** chkumar|ruck is now known as raukadah15:01
zbr|roversome to you!15:01
zbr|roverin fact see you on Tue!15:02
marioszbr|rover: do you know what's up with 17:57 < marios> zuul.opendev down?15:02
mariosProxy Error15:02
zbr|roveri am aware but i am not going to post it on #openinfra myself, i am sure they know it.15:03
marioszbr|rover: k thanks i meant more like if you know what the issue was/fix etc but thanks15:05
rlandypojadhav: bhagyashris: marios: going through the wallaby reviews now  - will merge what is mergeable15:13
rlandyweshay|ruck: ^^ fyi15:13
mariosraukadah: ack15:13
rlandyjob definition can go even if the job is failing15:13
mariosrlandy: ack even ;) sorry raukadah for noise15:13
zbr|rovermarios: there are some memory (leak) issues with zuul, that is why it was restarted yesterday and today again15:24
mariosthanks zbr|rover15:25
marioszbr|rover: saw fungi reply to weshay|ruck mail little while ago so guessed must be related15:25
zbr|roveris not clear if that will be last restart, i am trying to avoid pushing them, especially as I am unable to help.15:26
*** zbr|rover is now known as zbr15:29
pojadhavrlandy, ack15:30
*** jpodivin has quit IRC15:38
*** ykarel is now known as ykarel|away15:43
*** derekh has quit IRC15:45
*** ykarel|away has quit IRC15:53
*** jmasud has joined #oooq15:54
*** sshnaidm is now known as sshnaidm|afk16:20
*** marios is now known as marios|out16:31
*** ysandeep|away is now known as ysandeep16:41
ysandeepweshay|ruck hey, i have re-written cleanup script using openstacksdk (without unittest and sanity).. Before I start spending time on unittests/ code optimization..  Just want to check if I am missing any Important features apart from those documented here :- https://hackmd.io/uWo589BRQfWm6ZL0LaYlgQ?view16:54
rlandybhagyashris: re: https://review.rdoproject.org/r/c/config/+/32785 - you have a -1 there16:57
rlandymarios's comment was "ah needs rebase anyway so -1 for that (Merge Conflict)"16:58
rlandypassing now16:58
rlandycan we merge that after https://review.rdoproject.org/r/c/rdo-jobs/+/32751?16:58
weshay|ruckysandeep, k.. thanks .. will review17:01
rlandyweshay|ruck: raukadah: zbr: fyi ^^ if we merge the above it will move the line naming17:02
rlandybhagyashris: we can't merge one patch w/o the other17:03
*** udesale has quit IRC17:14
*** marios|out has quit IRC17:20
*** ysandeep is now known as ysandeep|away17:57
*** jmasud has quit IRC18:01
*** jmasud has joined #oooq18:10
*** ykarel|away has joined #oooq18:13
rlandypojadhav: merged https://review.rdoproject.org/r/c/rdo-jobs/+/3279418:16
rlandywe can remove the standard standalone jobs when the scenarios are available18:17
rlandybhagyashris: weshay|ruck: marios: guess we will merge the integration line moves on monday18:22
rlandystill -1 on those reviews18:22
*** ykarel|away has quit IRC18:25
rlandypojadhav: ^^ remaining patches need to be manually rebased18:48
frenzy_fridayHappy easter holidays everyone :) See you on tuesday19:15
rlandyfrenzy_friday: enjoy - see you tuesday19:17
*** slaweq_ has joined #oooq19:51
*** slaweq has quit IRC19:52
*** jmasud has quit IRC19:56
*** jmasud has joined #oooq20:24
*** holser has joined #oooq20:34
*** jmasud has quit IRC21:07
rlandyperiodic-tripleo-build-containers-ubi-8-internal-rhel-8-build-push-upload-rhos-17 SUCCESS21:16
rlandywow21:16
rlandyweshay|ruck: ^^ miracle21:16
*** jmasud has joined #oooq21:24
weshay|rucklook at that21:40
weshay|ruckseriously21:40
*** jmasud has quit IRC21:43
rlandyugh - I think I have to up the availablity of 8.4 nodes22:04
rlandyso slow22:04
*** jmasud has joined #oooq23:05
*** jmasud has quit IRC23:10
*** jmasud has joined #oooq23:13
*** jmasud has quit IRC23:15
*** tosky has quit IRC23:40
rlandyha - it's working! https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/stream/c9a4528a61ce4efc9fb082e1c270199b?logfile=console.log23:41
*** rlandy has quit IRC23:42
*** jmasud has joined #oooq23:57

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!