Friday, 2021-03-26

*** tosky has quit IRC00:26
*** bhagyashris has quit IRC01:39
*** jmasud has joined #oooq02:53
*** jmasud has quit IRC03:06
*** jmasud has joined #oooq03:09
*** udesale has joined #oooq03:35
*** jpodivin has joined #oooq03:56
*** jpodivin has quit IRC03:56
*** jpodivin has joined #oooq03:57
*** chandan_kumar has joined #oooq03:58
*** chandan_kumar is now known as chkumar|ruck03:58
*** ykarel has joined #oooq03:59
*** jmasud has quit IRC04:00
*** jmasud has joined #oooq04:01
*** ratailor has joined #oooq04:36
*** skramaja has joined #oooq05:07
*** jmasud has quit IRC05:12
*** skramaja has quit IRC05:55
*** skramaja has joined #oooq06:03
*** skramaja has quit IRC06:07
*** marios has joined #oooq06:09
*** skramaja has joined #oooq06:27
*** sanjayu_ has joined #oooq06:29
*** ksambor has joined #oooq07:01
*** dpawlik6 has joined #oooq07:22
*** amoralej has joined #oooq07:45
*** jbadiapa has joined #oooq07:48
ysandeepchkumar|ruck, fyi.. failure in master line.. https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master/dce2447/job-output.txt , plz ignore if you are already aware07:53
*** jmasud has joined #oooq08:00
*** jmasud has quit IRC08:01
chkumar|ruckysandeep: logging a bug08:04
ysandeepthanks!08:04
chkumar|ruckysandeep: https://bugs.launchpad.net/tripleo/+bug/192147008:08
openstackLaunchpad bug 1921470 in tripleo "error: can't find Rust compiler" [High,Triaged]08:08
*** ykarel is now known as ykarel|lunch08:09
chkumar|ruckzbr|rover: good morning, please have a look at  this bug https://bugs.launchpad.net/tripleo/+bug/1921470 adding to task board08:12
openstackLaunchpad bug 1921470 in tripleo "error: can't find Rust compiler" [High,Triaged]08:12
*** bhagyash- has joined #oooq08:31
*** bhagyash- is now known as bhagyashris08:32
*** bhagyashris has left #oooq08:33
*** bhagyashris has joined #oooq08:33
*** jpena|off is now known as jpena08:58
*** ykarel|lunch is now known as ykarel09:02
*** derekh has joined #oooq09:04
*** ysandeep is now known as ysandeep|lunch09:12
*** ysandeep|lunch is now known as ysandeep09:25
ysandeepchkumar|ruck, i think issue got cleared.. main line retriggered.. standalone passed the earlier failure step.. https://review.rdoproject.org/zuul/stream/e3d18041695745d6815b32ee997d2b2f?logfile=console.log09:28
chkumar|ruckmarios: https://review.opendev.org/c/openstack/tripleo-ci/+/782755/ please have a look at last comment not sure09:29
chkumar|ruckwhat is the failure there09:29
*** tosky has joined #oooq09:30
mariosthanks chkumar|ruck09:34
marioschkumar|ruck: maybe just recheck if we only see itonce09:35
mariosbrb09:35
*** ykarel_ has joined #oooq09:54
*** ykarel has quit IRC09:57
marioschkumar|ruck: cant find much in those logs09:58
marioschkumar|ruck: there aren't any container logs obv yet cos build fails09:58
marioschkumar|ruck: cant see something in /extra/errors etc09:58
marioschkumar|ruck: are we getting it in other places too?09:58
chkumar|ruckmarios: nope09:58
chkumar|ruckmarios: just in your patch09:58
chkumar|ruckmarios:  please recheck then09:58
marioschkumar|ruck: weird yeah i mean it is only touching zuul layout so should not be related afaics09:59
zbr|roverchkumar|ruck: marios: lets +W https://review.opendev.org/c/openstack/tripleo-heat-templates/+/783032 -- is first in a long thread for which I am going to use #dejunk hashtag.10:10
zbr|roverwtf is [Errno 13] Permission denied: '/var/cache/dnf/expired_repos.json'10:12
marioszbr|rover: ack will check it is at the top of th queue10:12
zbr|roveri am wondering how we ended up calling dnf config-manager as non root.10:13
zbr|roveri am wondering if the error from https://zuul.opendev.org/t/openstack/build/870db09cfaa14b8cb8a26dc436d9769a comes from https://opendev.org/openstack/tripleo-quickstart/src/branch/master/install-deps.sh#L24310:17
zbr|roverit makes no sense to me, i see "dnf config-manager " but not being directly called, I assume "yum-config-manager" now points to it, but at the same time it has a || true at the end.10:19
zbr|roverthat was a redh erring, that error is ignored anyway10:20
zbr|roverfor some reason I am unable to find the /home/zuul/standalone_deploy.log file10:23
chkumar|ruckysandeep: you mean rust cryptograpgy file?10:23
chkumar|ruckerror10:23
ysandeepchkumar|ruck, yes10:24
chkumar|ruckysandeep: please comment on the same with link so that we can close it https://bugs.launchpad.net/tripleo/+bug/192147010:25
openstackLaunchpad bug 1921470 in tripleo "error: can't find Rust compiler" [High,Triaged]10:25
ysandeepchkumar|ruck, ack, will comment once complete runs successfully10:26
chkumar|ruckzbr|rover: above job failure in standalone sc1 is aknown issue as is fixed now https://bugs.launchpad.net/tripleo/+bug/192141010:26
openstackLaunchpad bug 1921410 in tripleo "tripleo-ci-centos-8-scenario001-standalone broken with cephadm-16.1.0-4 " [Critical,Fix released] - Assigned to Francesco Pantano (fmount)10:26
zbr|roverchkumar|ruck: building cryptography is very resource intensive operation, usually we want to avoid having to do it.10:26
zbr|roverchkumar|ruck: re scenario 1, maybe you can help me understand where is the standalone_deploy.log file. I see the task that is supposed to produce it as failing but fail to find the file as being collected.10:28
chkumar|ruckzbr|rover: https://74017514f8e92733b9a4-8507e674ad9eed48586504f8f04bb11d.ssl.cf5.rackcdn.com/783066/2/check/tripleo-ci-centos-8-scenario001-standalone/870db09/logs/undercloud/home/zuul/standalone_deploy.log may be error part can be improved10:29
zbr|roverchkumar|ruck: damn, it was there but I was not to see it in the tree10:30
marioso/ please add to reviews: ussuri/train needs votes @  https://review.opendev.org/q/e9b7aaa5fc0bae143a04470b09684909672ca072 thank you!10:44
marioschkumar|ruck: thank you can you please re-add vote updated commit message https://review.opendev.org/c/openstack/tripleo-ansible/+/782945 sorry10:47
zbr|rover@oooq here is something i wanted to share with all of you https://review.opendev.org/c/openstack/tripleo-heat-templates/+/782999/5/common/deploy-steps-playbooks-common.yaml10:52
zbr|roveri am curious what you think about this interesting aspect of ansible10:52
zbr|roverand the funny bit that by default ansible does not have an empty host group10:53
chkumar|ruckstepping out for a bit11:07
marioszbr|rover: o/ :) so should i not bother reviewing that then https://review.opendev.org/c/openstack/tripleo-heat-templates/+/78303211:07
mariosseems unnecessary11:07
marioszbr|rover: i was getting ready to bounce on a bosu ball for 15 mins and stare at it11:07
mariosi guess i'll have to stare at something else :)11:07
zbr|rovermarios: please do, you have 3-4h to potentially block it.11:08
marioszbr|rover: please avoid self.merging. consider this your official warning. we will not tolerate such behaviour. on next offence you will be banished to the moon.11:09
marioszbr|rover: why did you consider it appropriate in this case please?11:09
zbr|roveri did +W because is was non production code and because the full dejunk chain is likely be long (8 or more only for master).11:09
* zbr|rover hopes to find more friends on the moon11:10
marioszbr|rover: what is the significance of 0.0.0 @ https://review.opendev.org/c/openstack/tripleo-heat-templates/+/783032/3/tox.ini11:20
*** rlandy has joined #oooq11:33
*** owalsh has quit IRC11:35
rlandyysandeep: hello11:37
rlandyysandeep: merged the rhos-release change - did it do damage?11:37
ysandeeprlandy, no looks good..11:38
rlandyysandeep: k - let's keep the meeting and I'll run you through the last of the 17 tp 8.4 patches11:41
ysandeeprlandy, ack11:42
*** udesale has quit IRC11:50
zbr|rovermarios: 0.0.0 happens to be the first release of https://pypi.org/project/tox-extra/ --- you can blame me for the funny version.11:51
zbr|roverthat plugin does only one thing: ensure exit code 1 if git reports dirty or untracked files after the run11:52
zbr|roverif the test run produces any new files, or alters source code, the final result will be made as an error, to avoid accidents.11:52
zbr|roverusually fixable by adding extra files to .gitignore11:52
zbr|rovermainly that plugin prevents regression for the fix it does to .gitignore11:53
marioszbr|rover: thanks sanity checking11:53
marioszbr|rover: please review when you have time by way of payment for my generosity in giving you a suspended sentence regarding your banishment to the moon: review https://review.opendev.org/c/openstack/tripleo-ci/+/78254911:54
marioszbr|rover: you're welcome11:54
mariosneeds review please no rush and its big so eyes appreciated thank you! https://review.opendev.org/c/openstack/tripleo-ci/+/78254911:54
zbr|roverdoing right now...11:54
*** owalsh has joined #oooq11:55
marioszbr|rover: no emergency deferred review also accepted11:55
zbr|rovermarios: out of curiosity does it makes sense to remove rocky from all the code? asking because i wonder if that would not make it harder to backport some changes on repos that do have branches.11:57
marioszbr|rover: rocky branches will be deleted11:59
zbr|roverok, that answers my question.11:59
zbr|rovermarios: you can now fully enjoy the principal rocky remover task! ;)12:01
zbr|roverTBH, I do enjoy CR that remove things far more than those that add.12:02
zbr|rovermarios: why you are not using the "Default draft" for reviews? we can now avoid "WIP" in titles as you can make them ready at any time w/o editing the message.12:04
zbr|roverOne https://review.opendev.org/settings/#EditPreferences page there is a checkbox: Set new changes to "work in progress" by default12:06
zbr|roverif you click it, any new change is by default marked a WIP (not ready for review)12:06
zbr|rovergit review can also change the state (wip on/of) if you want, but for new changes the web UI settings is used.12:07
ysandeepchkumar|ruck hey o/ for wallaby - fs001 ovb job is failing at overcloud deploy during baremetal provisioning, I wonder if you have noticed something similiar for master / master component line?12:07
ysandeephttps://logserver.rdoproject.org/58/28458/70/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-wallaby/c9cb1ca/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz12:07
chkumar|ruckysandeep: main line is still running12:10
chkumar|ruckysandeep: but will keep an eye12:10
ysandeepthanks, i just checked console of running ovb jobs.. all are in tempest steps.. My issue looks different then..12:13
*** jbadiapa has quit IRC12:14
*** udesale has joined #oooq12:21
*** beagles has joined #oooq12:26
ysandeepchkumar|ruck, https://bugs.launchpad.net/tripleo/+bug/1921501 fyi..12:27
openstackLaunchpad bug 1921501 in tripleo "Wallaby: ovb job are failing at overcloud deploy during baremetal provisioning, ERROR neutron.agent.dhcp.agent TypeError: Object of type 'ValueError' is not JSON serializable" [Critical,Triaged]12:27
ysandeepslaweq, ^^ if you get some free time, could you please give some pointers about https://bugs.launchpad.net/tripleo/+bug/192150112:27
*** ykarel_ is now known as ykarel12:28
*** jpena is now known as jpena|lunch12:31
*** arxcruz has joined #oooq12:39
*** ratailor has quit IRC12:44
*** udesale has quit IRC12:45
*** jbadiapa has joined #oooq12:53
rlandyysandeep: weshay|ruck: hey - you guy are added as reviewers the list of the 17 to 8.4 reviews - ] post promotion12:56
rlandyysandeep: weshay|ruck: wrt provider jobs, getting there,12:56
rlandyI need to do some edits on egtting the non-tripelo containers12:56
weshay|ruckbhagyashris, 2 min.. need to help my youngest son12:57
ysandeeprlandy, o/ yeah i have them.. will work with weshay|ruck to merge them.. once we get a 17 promotion12:57
rlandyysandeep: thank you  - see you thursday12:58
*** rlandy is now known as rlandy|PTO12:58
bhagyashrisweshay|ruck, ok np12:58
weshay|ruckI'm ready12:58
ysandeepbhagyashris, weshay|ruck rlandy|PTO frenzy_friday pojadhav https://review.rdoproject.org/r/c/rdo-jobs/+/32626 mvp is up for review.. we have bug for ovb.. all jobs passing except ovb13:02
pojadhavysandeep, ack13:03
*** gchamoul has joined #oooq13:03
ysandeepmarios, chkumar|ruck ykarel please add https://review.rdoproject.org/r/c/rdo-jobs/+/32626 in your review list..13:09
mariosack ysandeep13:16
chkumar|ruckbeagles: hello, please have a look at these failures https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario010-ovn-provider-standalone-victoria/500e748/logs/undercloud/var/log/tempest/tempest_run.log.txt.gz13:16
chkumar|ruckbeagles: here is all the errors from the node https://logserver.rdoproject.org/openstack-periodic-integration-stable1/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-scenario010-ovn-provider-standalone-victoria/500e748/logs/undercloud/var/log/extra/errors.txt.txt.gz13:16
*** jfrancoa has joined #oooq13:24
*** jpena|lunch is now known as jpena13:31
*** jbadiapa has quit IRC13:32
ykarelysandeep, ack13:33
*** jbadiapa has joined #oooq13:34
mariosneeds review please no rush and its big so eyes appreciated thank you! https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/782698  https://review.opendev.org/c/openstack/tripleo-ci/+/782549 please add to your queue13:36
*** frenzy_friday is now known as frenZfri|lunch13:36
zbr|roverchkumar|ruck: simple one, passed alex: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/783066/113:48
chkumar|ruckzbr|rover: I can +w later night, right zuul queue is very heavy13:49
chkumar|ruck22 hrs13:49
zbr|roverahh, ok. i just wanted to assure they endup in weekend queue.13:50
*** udesale has joined #oooq13:58
beagleschkumar|ruck: ack14:08
*** jfrancoa has quit IRC14:11
*** haleyb has joined #oooq14:16
*** jmasud has joined #oooq14:18
*** derekh has quit IRC14:20
*** frenZfri|lunch is now known as frenzy_friday14:21
chkumar|ruckweshay|ruck: hello14:23
chkumar|ruckweshay|ruck: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_cca/767070/8/gate/tripleo-ci-centos-8-standalone/cca5006/logs/undercloud/var/log/tempest/tempest_run.log14:24
chkumar|ruckweshay|ruck: I have seen this error in multiple release Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance14:24
chkumar|rucknot only in upstream as well as in RDO14:24
chkumar|ruckweshay|ruck: https://bugs.launchpad.net/tripleo/+bug/192149314:25
openstackLaunchpad bug 1921493 in tripleo "Tempest tests failing with Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance i" [High,Triaged]14:25
chkumar|ruckweshay|ruck: I am not sure it is a infra issue14:25
chkumar|ruckweshay|ruck: can you ask someone from compute team to take a look14:25
*** jmasud has quit IRC14:25
chkumar|ruckweshay|ruck: I have added alert in the bug not a promotion blocker14:25
*** amoralej is now known as amoralej|lunch14:26
haleybbeagles had mentioned a failure in the scenario 10 victoria job with the ovn-octavia-provider, seems it was missing a backport, hoping https://review.opendev.org/c/openstack/ovn-octavia-provider/+/783205 fixes it14:28
chkumar|ruckhaleyb: thanks :-) let me test it14:29
haleybchkumar|ruck: thanks, i just hadn't done any backports in a while so that branch might have been broken for a few weeks14:30
mariosneeds review please no rush and its big so eyes appreciated thank you! https://review.opendev.org/q/topic:tripleo-ci-reduce-rocky please add to your queue14:31
*** ysandeep is now known as ysandeep|dinner14:31
bhagyashrischkumar|ruck, ysandeep|dinner rlandy|PTO weshay|ruck marios pojadhav frenzy_friday please add in your review list https://review.rdoproject.org/r/c/config/+/32785 enable wallaby integration pipeline14:36
chkumar|ruckhaleyb: no problem, we can fix it together, testing here https://review.rdoproject.org/r/c/testproject/+/3279514:37
bhagyashrisand this one https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/32787 Add wallaby c8 integration promotion config14:37
mariosbhagyashris: ack14:37
chkumar|ruckweshay|ruck: zbr|rover https://twitter.com/raukadah/status/137545877624173773114:45
weshay|ruckheh14:45
chkumar|ruckit's a pretty long queue14:46
*** amoralej|lunch is now known as amoralej14:46
chkumar|ruckseeing after very long time14:46
*** saneax has quit IRC14:48
*** saneax has joined #oooq14:48
*** saneax has quit IRC14:52
*** udesale has quit IRC14:54
*** derekh has joined #oooq14:59
*** frenzy_friday has quit IRC15:01
*** frenzy_friday has joined #oooq15:01
chkumar|ruckweshay|ruck: if queue stabilize by your morning, please update the channel so that people can review their work on weekends.15:09
*** mjturek has joined #oooq15:13
pojadhavbhagyashris, ack15:13
*** ksambor has quit IRC15:16
*** sanjayu_ has quit IRC15:22
weshay|ruckchkumar|ruck, ya15:26
weshay|ruckchkumar|ruck, anything you need before you go have a weekend?15:27
chkumar|ruckweshay|ruck: we can keep an eye on zuul queue15:30
chkumar|rucknothing urgent15:30
chkumar|ruckweshay|ruck: please take some rest also :-)15:30
weshay|ruckchkumar|ruck, ya.. always do :) situation.. fubar'd but it's friday :)15:30
chkumar|ruckweshay|ruck: :-)15:34
chkumar|ruckzbr|rover: we made it mid sprint, take some rest man :-) See ya next week15:40
chkumar|ruckHappy Weekend @tripleo-ci :-)15:41
*** chkumar|ruck is now known as raukadah15:41
raukadahbhagyashris: akahat ykarel ysandeep|dinner pojadhav Have a safe holi :-)15:44
ykarelraukadah, same 2 u15:45
zbr|roverhttps://xkcd.com/303/ reminds me of our CI/CD15:47
zbr|roverweshay|ruck: please give https://review.opendev.org/c/openstack/tripleo-heat-templates/+/783032 a kick, to add it to the queue.15:49
zbr|roverweshay|ruck: fyi. the roadman for 2.12 is still open https://github.com/ansible/ansible/pull/74000/files -- not many issues to worry about, IMHO15:57
*** jmasud has joined #oooq16:20
*** ysandeep|dinner is now known as ysandeep16:24
ysandeepraukadah, same to you :)16:24
bhagyashrisraukadah, Happy Holi :)16:25
ysandeepweshay|ruck, bhagyashris you want to review and merge mini integration line today? https://review.rdoproject.org/r/c/rdo-jobs/+/32626 , If we can merge this and promote wallaby.. We can unblock pooja to start with component line..16:26
ysandeepweshay|ruck, fyi.. green run logs here http://paste.openstack.org/show/803964/16:28
bhagyashrisysandeep, i am ok with it16:28
ysandeepbhagyashris, ack o/ could you please add your vote on patch16:29
bhagyashrisysandeep, done16:30
ysandeepbhagyashris, ++ thanks! fyi.. https://review.opendev.org/c/openstack/tripleo-quickstart/+/782211 will be next in line to merge.. after getting first promotion..16:32
bhagyashrisysandeep, sure :)16:32
*** jpodivin has quit IRC16:34
*** ysandeep is now known as ysandeep|away16:37
* bhagyashris out16:37
* ysandeep|away out16:41
*** amoralej is now known as amoralej|off16:45
*** marios is now known as marios|out17:00
*** ykarel has quit IRC17:00
*** marios|out has quit IRC17:09
*** jmasud has quit IRC17:21
*** jmasud has joined #oooq17:33
*** jpena is now known as jpena|off17:56
*** slaweq has quit IRC17:58
*** rlandy|PTO has quit IRC18:02
*** slaweq has joined #oooq18:03
*** slaweq has quit IRC18:09
*** jmasud has quit IRC19:05
*** slaweq has joined #oooq19:43
*** jmasud has joined #oooq20:04
*** jmasud has quit IRC20:31
*** jmasud has joined #oooq20:42
*** derekh has quit IRC21:30
*** jmasud has quit IRC21:46
*** jmasud has joined #oooq22:01
*** jmasud has quit IRC22:22
*** jmasud has joined #oooq22:41
*** jbadiapa has quit IRC22:59
*** tosky has quit IRC23:39

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!