Friday, 2020-09-25

*** jmasud has quit IRC00:29
*** Goneri has quit IRC00:41
*** ysandeep|away is now known as ysandeep00:58
*** jmasud has joined #oooq01:41
*** jmasud has quit IRC01:43
*** udesale has joined #oooq03:20
*** udesale has quit IRC03:23
*** ratailor has joined #oooq03:51
*** ykarel|away has joined #oooq05:00
*** ykarel|away is now known as ykarel05:00
*** udesale has joined #oooq05:03
*** marios has joined #oooq05:06
*** zbr|pto has quit IRC05:07
*** ykarel_ has joined #oooq06:12
*** ykarel has quit IRC06:14
*** zbr has joined #oooq06:49
*** jtomasek has joined #oooq06:58
*** amoralej|off is now known as amoralej07:10
*** jtomasek_ has joined #oooq07:15
*** jtomasek has quit IRC07:17
*** jpena|off is now known as jpena07:22
*** ykarel__ has joined #oooq07:31
*** ykarel_ has quit IRC07:34
*** ykarel__ is now known as ykarel07:39
*** tosky has joined #oooq07:43
*** pojadhav is now known as pojadhav|lunch08:01
*** ykarel_ has joined #oooq08:11
*** ykarel has quit IRC08:12
*** derekh has joined #oooq08:23
ysandeepbhagyashri|rover, hi o/, have we seen something similiar in upstream, recently?08:23
ysandeephttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-component-cloudops/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-cloudops-rhos-17/02059c9/job-output.txt08:23
ysandeep~~~08:23
ysandeepERROR tempest urllib.error.URLError: <urlopen error [Errno 113] No route to host>08:23
ysandeep~~~08:23
ysandeepError in neutron server:-08:23
ysandeep~~~08:24
ysandeepERROR ovsdbapp.backend.ovs_idl.idlutils [-] Unable to open stream to tcp:192.168.24.1:6641 to retrieve schema: Connection refused08:24
ysandeep~~~08:24
bhagyashri|roverysandeep, yesterday i saw that but that was because or vexxhost problem08:25
bhagyashri|roveri mean image.rdoproject.org was down that's why we were getting no route to host08:25
ysandeepbhagyashri|rover, hmm thx, that's different then.. In my case ovn port 6641 is unreachable .. i will continue checking08:27
bhagyashri|roverlooks like same issue08:27
bhagyashri|roverok08:27
bhagyashri|roversome thing is down08:28
ysandeepbhagyashri|rover, Do you have one log url handy from yesterday.. i will compare08:28
bhagyashri|roverwill pass give me min08:29
bhagyashri|roverysandeep, https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_e5a/753807/1/gate/tripleo-ci-centos-8-scenario001-standalone/e5aeb74/job-output.txt08:32
holserhey marios08:35
holsercan you help me with https://review.opendev.org/#/c/752959/2/roles/run-test/tasks/main.yaml08:35
*** ykarel_ is now known as ykarel08:39
marioso/ holser i had a look earlier and added the comment in https://bugs.launchpad.net/tripleo/+bug/1897155/comments/1 - I suspect the issue comes from https://opendev.org/openstack/tripleo-ci/src/commit/820e3fe31e6988ae6070c319dbf8372ab1489a3b/roles/run-test/tasks/main.yaml#L43-L6208:43
openstackLaunchpad bug 1897155 in tripleo "Reproducer doesn't reproduce job" [Critical,Confirmed] - Assigned to Sergii Golovatiuk (sgolovatiuk)08:43
mariosholser: if you change in your environment that featureset-override.yaml it should work fine after that08:44
mariosholser: i.e. https://2302f195cca0bd2fbfcf-1aafb108750144ecd9565eaf1429d9e4.ssl.cf1.rackcdn.com/753807/1/check/tripleo-ci-centos-8-standalone-upgrade-ussuri/666dcd1/logs/reproducer-quickstart/featureset-override.yaml  remove the standalone_custom_env_files:08:44
holseryeah08:44
holserthat's what I think08:44
holsermarios thanks08:44
*** ysandeep is now known as ysandeep|lunch08:46
mariosholser: ack08:47
*** pojadhav|lunch is now known as pojadhav09:31
*** udesale_ has joined #oooq09:41
*** udesale has quit IRC09:44
*** ysandeep|lunch is now known as ysandeep10:05
*** saneax has joined #oooq10:09
holserhey marios10:14
holserhttps://opendev.org/openstack/tripleo-ci/src/commit/820e3fe31e6988ae6070c319dbf8372ab1489a3b/roles/run-test/tasks/main.yaml#L43-L5210:14
holserI can remove all that10:14
holserbut we use standalone_custom_env_files in different places10:15
holserso https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/standalone/templates/standalone.sh.j2#L9 won't work10:15
holserso I still think that the right way to do is https://review.opendev.org/#/c/752959/210:16
holserotherwise I will need to refactor a lot of your code10:17
holserthe problem is we mess up with standalone_environment_files in one places and standalone_custom_env_files in another one10:17
holserso we should either combine them to one env variable or allow override standalone_custom_env_files10:18
holserjust make sure the job returns a success result thus in many cases CI is broken just giving +1 to jobs10:19
*** apetrich has joined #oooq10:26
mariosholser: o/10:28
mariosholser: did it work for you as workaround to remove the files or still fails?10:28
mariosholser: ack i need to take a closer look can you put that on the bug? ^^^10:28
holsermarios bug is https://bugs.launchpad.net/tripleo/+bug/1897155/comments/110:32
openstackLaunchpad bug 1897155 in tripleo "Reproducer doesn't reproduce job" [Critical,Confirmed] - Assigned to Sergii Golovatiuk (sgolovatiuk)10:32
mariosholser: i would lean more towards fixing the variables, i.e. keep one of them10:32
holsermarios you may find it here - https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/standalone/templates/standalone.sh.j210:33
marios13:28 < marios> holser: did it work for you as workaround to remove the files or still fails?10:33
holsermarios no it didn't work10:34
mariosholser: ack10:34
holserbecause we generate wrong file10:34
holsermarios look here https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/standalone/templates/standalone.sh.j210:34
holserand same for upgrades10:34
holserthere are 2 solutions - first one is fast and straight forward10:35
holserhttps://review.opendev.org/#/c/752959/210:35
holseranother one is total refactor and use standalone_custom_env_files only instead of ( standalone_custom_env_files + standalone_custom_env_files )10:36
ykarelholser, what about 3rd, and fixing just the reproducer to exclude custom_env_files https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/create-zuul-based-reproducer/templates/launcher-playbook.yaml.j2#L110 to not include10:36
ykarelor 4th where if possible use job.featureset_override instead of reading from file, for that need to see if there is issue in doing that10:37
mariosykarel: problem is we need the featureset-override file but it is created with duplicates see https://2302f195cca0bd2fbfcf-1aafb108750144ecd9565eaf1429d9e4.ssl.cf1.rackcdn.com/753807/1/check/tripleo-ci-centos-8-standalone-upgrade-ussuri/666dcd1/logs/reproducer-quickstart/featureset-override.yaml10:37
mariosykarel: so we can't exclude it alltogether we still need it for standalone_environment_files10:37
ykarelyes that's what /me suggesting where we exclude custom env files from ^10:37
holsermarios dups are not problem as we include only standalone_custom_env_files from that yaml/dict10:38
holserykarel can you make a patch really quick10:38
holserI will test it10:38
ykarelholser, ok let me check, give me a few10:38
mariosholser: all i'm saying basically is we aren't seeing this in any other job, only for reproducer templates, which is why i'm against https://review.opendev.org/#/c/752959/ ... i think there must be a problem in the way we are generating the reproducer files but don't have time to dig rightnow10:39
mariosholser: i.e. as i said i agree https://bugs.launchpad.net/tripleo/+bug/1897155 is valid but not sure what the root issue/right fix is yet10:39
openstackLaunchpad bug 1897155 in tripleo "Reproducer doesn't reproduce job" [Critical,Confirmed] - Assigned to Sergii Golovatiuk (sgolovatiuk)10:39
*** dtantsur|afk is now known as dtantsur10:49
chandankumarbhagyashri|rover: marios: weshay|ruck I am taking half day sick leave due to cough & cold, see ya on monday!10:50
holsermarios I guess we need to merge my patch as it's not harmful10:50
holsermarios then when you have a time you'll refactor and make better patch10:50
holsermarios The best is the enemy of the good10:51
mariosholser: ;) ack we can consider this too sure .. for now can you apply your patch to local tripleo-ci checkout to unblock you?10:52
holserI can10:52
holserthat's what I do10:52
mariosholser: ack10:52
holsermarios just adding it to launcher-playbook.yaml as depends-on10:53
marioschandankumar: sorry i missed it in the conversation... feel better chandankumar have a good rest!10:55
ykarelholser, that file is being read as text, so need to convert that11:24
ykarelbut will post someting as a post task cleanup for the items11:24
*** jpena is now known as jpena|lunch11:27
ykarelholser, starting with https://review.opendev.org/754353, will post other review in some time, need to do some other work now11:28
holserykarel thanks11:28
bhagyashri|roverchandankumar, get well soon! take rest11:36
*** pojadhav is now known as pojadhav|brb11:47
*** rlandy has joined #oooq12:04
*** rfolco|ruck has joined #oooq12:05
ysandeeprlandy, \o/ rhos-release.virt.bos.redhat.com went down, when you settle down could you please review - https://code.engineering.redhat.com/gerrit/#/c/213117/, https://code.engineering.redhat.com/gerrit/#/c/213123/12:05
rlandysure - rekicking container builds12:07
rlandyysandeep: https://code.engineering.redhat.com/gerrit/#/c/213117/ - so idk here - both can go down :)12:12
rlandywe should install from the right source12:12
rlandyI see jason approved12:13
rlandychecking12:13
ysandeeprlandy, got that new path from reldel folks12:14
rlandyysandeep: ack - just checking12:14
rlandyysandeep: merged12:15
*** amoralej is now known as amoralej|lunch12:17
ysandeepthnx :)12:18
*** pojadhav|brb is now known as pojadhav12:27
*** jpena|lunch is now known as jpena12:31
rlandybhagyashri|rover: hi - is the openstack-tox-linters failure still an issue? can I recheck https://review.opendev.org/#/c/753856?12:31
bhagyashri|roverrlandy, all patches are  merged https://review.opendev.org/#/q/topic:linters-fix+(status:open+OR+status:merged)12:33
bhagyashri|roverlet me check12:33
*** jtomasek has joined #oooq12:33
rlandybhagyashri|rover: great - thanks12:33
*** ysandeep is now known as ysandeep|away12:34
bhagyashri|roverrlandy, ^ failure is before this patch got merged https://review.opendev.org/#/c/753760/512:35
bhagyashri|roverrlandy, you can recheck12:36
rlandydone - thanks12:36
*** jtomasek_ has quit IRC12:36
*** saneax has quit IRC12:42
rlandyrfolco|ruck: bhagyashri|rover: hoping https://review.opendev.org/#/c/753856 will resolve sporadic failures on the multinode-ipa job ...12:58
rlandywhen that goes though, I'm going to put up a patch to make multinode-ipa voting again12:59
rfolco|ruckrlandy, tell me the branch this is for and I will testproject this13:00
rfolco|ruckrlandy, aaah you already tested it13:00
bhagyashri|roverrlandy, thanks :)13:01
rlandyrfolco|ruck: master and ussuri13:01
rlandyboth DNM patch tested13:01
rfolco|ruckI see your test patches13:01
rfolco|ruckok thanks13:01
*** ykarel_ has joined #oooq13:03
*** ykarel has quit IRC13:05
*** ratailor has quit IRC13:06
*** ykarel_ is now known as ykarel13:07
*** amoralej|lunch is now known as amoralej13:14
*** TrevorV has joined #oooq13:21
*** TrevorV has quit IRC13:26
*** Goneri has joined #oooq13:41
*** TrevorV has joined #oooq13:45
* marios has sore throat since lunchtime13:54
mariosstarting to panic13:54
marios:/13:54
rlandymarios: oh no ...14:09
rlandyit's just allergies, really14:09
mariosrlandy: :/ hope so14:10
mariosrlandy: you know i'v googled 'rona symptoms sore throat' today a few times14:10
marios:D14:10
marios:( sorry it isn't at all funny it is a defense/nervous we shouldn't even joke about it14:11
rlandymarios: https://www.cdc.gov/coronavirus/2019-ncov/need-extra-precautions/people-with-seasonal-allergies-faqs.html14:12
mariosrlandy: thank you :)14:12
ykarelmarios, revised https://review.rdoproject.org/r/#/c/27934/, can u check now14:15
mariosykarel: ack adding to list for reviews14:15
ykarelmarios, ack wanted to check job results post it merges14:15
ykarelshouldn't harm but in case it does would need revert14:16
mariosykarel: ack14:22
*** ykarel_ has joined #oooq14:23
*** ykarel has quit IRC14:26
weshay|ruckmarios, no it's not rona.. that's what it feels like to be PTL14:38
* weshay|ruck runs14:38
mariosweshay|ruck: ;)14:38
weshay|ruck:)14:38
weshay|ruckmarios, if you need rest.. get out of here NOW14:38
mariosweshay|ruck: am ok for now thanks14:39
mariosalmost eod anyway14:39
mariosrfolco|ruck: confirmed "RuntimeError: No such playbook: /usr/share/ansible/tripleo-playbooks/cli-container-image-prepare.yaml " @ https://logserver.rdoproject.org/81/28081/83/check/mol-tripleo_common_integration/d3c8d5c/tox/reports.html fyi14:48
mariosrfolco|ruck: commented there https://review.rdoproject.org/r/#/c/28081/83//COMMIT_MSG@27 in case isn't clear what i mean ^^^14:49
rfolco|ruckmarios, so the error seen in the tox report is not clear... is it the missing playbook failure ?14:51
mariosrfolco|ruck: yes its exactly clear in the report14:52
mariosrfolco|ruck: grep this: "    2020-09-25 13:02:48.018 48372 ERROR tripleoclient.v1.container_image.TripleoImagePrepare [-] Exception occured while running the command: RuntimeError: No such playbook: /usr/share/ansible/tripleo-playbooks/cli-container-image-prepare.yaml14:52
mariosrfolco|ruck: from the report copy/paste ^^14:52
*** ykarel__ has joined #oooq14:52
mariosrfolco|ruck: wondering if it is an issue with the path. like pip installs to /usr/local instead of /usr/share or somesuch...14:53
mariosrfolco|ruck: :/14:53
rfolco|ruckah you mean, inside the venv the path is diff14:53
rfolco|ruckgotcha14:53
*** ykarel_ has quit IRC14:55
rfolco|ruckmarios, good findings indeed. Lets workaround this14:57
mariosrfolco|ruck: ack so i won't be updating that again today if you fancy a go please feel free15:00
rfolco|ruckmarios, ok will give it a try later today15:01
rfolco|ruckmarios, thanks for the updates15:01
sshnaidm|afkchandankumar, maybe we can merge https://review.opendev.org/#/c/752301/ before we do non-tripleo images?15:21
sshnaidm|afkchandankumar, it's difficult to manage 3 deps patches15:21
*** marios is now known as marios|afk15:49
*** ykarel__ is now known as ykarel16:07
*** ykarel is now known as ykarel|away16:13
*** apetrich has quit IRC16:13
*** amoralej is now known as amoralej|off16:14
*** apetrich has joined #oooq16:19
*** jpena is now known as jpena|off16:30
*** ykarel|away has quit IRC16:33
*** udesale_ has quit IRC16:54
*** marios|afk has quit IRC16:56
*** dtantsur is now known as dtantsur|afk16:58
*** TrevorV has quit IRC17:10
*** derekh has quit IRC17:18
rlandyweshay|ruck: have time to review repoquery script?18:18
weshay|ruckrlandy, aye.. and my connection should be decent18:19
rlandyweshay|ruck: meet.google.com/ypq-yrqb-ogd18:19
*** chem has quit IRC19:21
*** chem has joined #oooq19:23
*** rfolco|ruck has quit IRC20:58
rlandyweshay|ruck: woohoo ... repoquery  -q -a --nvr --latest-limit 1 - returns latest rpm21:49
*** apetrich has quit IRC21:49
rlandyno figuring out max required21:49
*** rlandy has quit IRC21:58
*** jtomasek has quit IRC21:58
*** tosky has quit IRC22:58
*** rfolco|ruck has joined #oooq23:02
*** rfolco|ruck has quit IRC23:29

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!