*** jmasud has quit IRC | 00:29 | |
*** Goneri has quit IRC | 00:41 | |
*** ysandeep|away is now known as ysandeep | 00:58 | |
*** jmasud has joined #oooq | 01:41 | |
*** jmasud has quit IRC | 01:43 | |
*** udesale has joined #oooq | 03:20 | |
*** udesale has quit IRC | 03:23 | |
*** ratailor has joined #oooq | 03:51 | |
*** ykarel|away has joined #oooq | 05:00 | |
*** ykarel|away is now known as ykarel | 05:00 | |
*** udesale has joined #oooq | 05:03 | |
*** marios has joined #oooq | 05:06 | |
*** zbr|pto has quit IRC | 05:07 | |
*** ykarel_ has joined #oooq | 06:12 | |
*** ykarel has quit IRC | 06:14 | |
*** zbr has joined #oooq | 06:49 | |
*** jtomasek has joined #oooq | 06:58 | |
*** amoralej|off is now known as amoralej | 07:10 | |
*** jtomasek_ has joined #oooq | 07:15 | |
*** jtomasek has quit IRC | 07:17 | |
*** jpena|off is now known as jpena | 07:22 | |
*** ykarel__ has joined #oooq | 07:31 | |
*** ykarel_ has quit IRC | 07:34 | |
*** ykarel__ is now known as ykarel | 07:39 | |
*** tosky has joined #oooq | 07:43 | |
*** pojadhav is now known as pojadhav|lunch | 08:01 | |
*** ykarel_ has joined #oooq | 08:11 | |
*** ykarel has quit IRC | 08:12 | |
*** derekh has joined #oooq | 08:23 | |
ysandeep | bhagyashri|rover, hi o/, have we seen something similiar in upstream, recently? | 08:23 |
---|---|---|
ysandeep | https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-component-cloudops/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-standalone-cloudops-rhos-17/02059c9/job-output.txt | 08:23 |
ysandeep | ~~~ | 08:23 |
ysandeep | ERROR tempest urllib.error.URLError: <urlopen error [Errno 113] No route to host> | 08:23 |
ysandeep | ~~~ | 08:23 |
ysandeep | Error in neutron server:- | 08:23 |
ysandeep | ~~~ | 08:24 |
ysandeep | ERROR ovsdbapp.backend.ovs_idl.idlutils [-] Unable to open stream to tcp:192.168.24.1:6641 to retrieve schema: Connection refused | 08:24 |
ysandeep | ~~~ | 08:24 |
bhagyashri|rover | ysandeep, yesterday i saw that but that was because or vexxhost problem | 08:25 |
bhagyashri|rover | i mean image.rdoproject.org was down that's why we were getting no route to host | 08:25 |
ysandeep | bhagyashri|rover, hmm thx, that's different then.. In my case ovn port 6641 is unreachable .. i will continue checking | 08:27 |
bhagyashri|rover | looks like same issue | 08:27 |
bhagyashri|rover | ok | 08:27 |
bhagyashri|rover | some thing is down | 08:28 |
ysandeep | bhagyashri|rover, Do you have one log url handy from yesterday.. i will compare | 08:28 |
bhagyashri|rover | will pass give me min | 08:29 |
bhagyashri|rover | ysandeep, https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_e5a/753807/1/gate/tripleo-ci-centos-8-scenario001-standalone/e5aeb74/job-output.txt | 08:32 |
holser | hey marios | 08:35 |
holser | can you help me with https://review.opendev.org/#/c/752959/2/roles/run-test/tasks/main.yaml | 08:35 |
*** ykarel_ is now known as ykarel | 08:39 | |
marios | o/ holser i had a look earlier and added the comment in https://bugs.launchpad.net/tripleo/+bug/1897155/comments/1 - I suspect the issue comes from https://opendev.org/openstack/tripleo-ci/src/commit/820e3fe31e6988ae6070c319dbf8372ab1489a3b/roles/run-test/tasks/main.yaml#L43-L62 | 08:43 |
openstack | Launchpad bug 1897155 in tripleo "Reproducer doesn't reproduce job" [Critical,Confirmed] - Assigned to Sergii Golovatiuk (sgolovatiuk) | 08:43 |
marios | holser: if you change in your environment that featureset-override.yaml it should work fine after that | 08:44 |
marios | holser: i.e. https://2302f195cca0bd2fbfcf-1aafb108750144ecd9565eaf1429d9e4.ssl.cf1.rackcdn.com/753807/1/check/tripleo-ci-centos-8-standalone-upgrade-ussuri/666dcd1/logs/reproducer-quickstart/featureset-override.yaml remove the standalone_custom_env_files: | 08:44 |
holser | yeah | 08:44 |
holser | that's what I think | 08:44 |
holser | marios thanks | 08:44 |
*** ysandeep is now known as ysandeep|lunch | 08:46 | |
marios | holser: ack | 08:47 |
*** pojadhav|lunch is now known as pojadhav | 09:31 | |
*** udesale_ has joined #oooq | 09:41 | |
*** udesale has quit IRC | 09:44 | |
*** ysandeep|lunch is now known as ysandeep | 10:05 | |
*** saneax has joined #oooq | 10:09 | |
holser | hey marios | 10:14 |
holser | https://opendev.org/openstack/tripleo-ci/src/commit/820e3fe31e6988ae6070c319dbf8372ab1489a3b/roles/run-test/tasks/main.yaml#L43-L52 | 10:14 |
holser | I can remove all that | 10:14 |
holser | but we use standalone_custom_env_files in different places | 10:15 |
holser | so https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/standalone/templates/standalone.sh.j2#L9 won't work | 10:15 |
holser | so I still think that the right way to do is https://review.opendev.org/#/c/752959/2 | 10:16 |
holser | otherwise I will need to refactor a lot of your code | 10:17 |
holser | the problem is we mess up with standalone_environment_files in one places and standalone_custom_env_files in another one | 10:17 |
holser | so we should either combine them to one env variable or allow override standalone_custom_env_files | 10:18 |
holser | just make sure the job returns a success result thus in many cases CI is broken just giving +1 to jobs | 10:19 |
*** apetrich has joined #oooq | 10:26 | |
marios | holser: o/ | 10:28 |
marios | holser: did it work for you as workaround to remove the files or still fails? | 10:28 |
marios | holser: ack i need to take a closer look can you put that on the bug? ^^^ | 10:28 |
holser | marios bug is https://bugs.launchpad.net/tripleo/+bug/1897155/comments/1 | 10:32 |
openstack | Launchpad bug 1897155 in tripleo "Reproducer doesn't reproduce job" [Critical,Confirmed] - Assigned to Sergii Golovatiuk (sgolovatiuk) | 10:32 |
marios | holser: i would lean more towards fixing the variables, i.e. keep one of them | 10:32 |
holser | marios you may find it here - https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/standalone/templates/standalone.sh.j2 | 10:33 |
marios | 13:28 < marios> holser: did it work for you as workaround to remove the files or still fails? | 10:33 |
holser | marios no it didn't work | 10:34 |
marios | holser: ack | 10:34 |
holser | because we generate wrong file | 10:34 |
holser | marios look here https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/standalone/templates/standalone.sh.j2 | 10:34 |
holser | and same for upgrades | 10:34 |
holser | there are 2 solutions - first one is fast and straight forward | 10:35 |
holser | https://review.opendev.org/#/c/752959/2 | 10:35 |
holser | another one is total refactor and use standalone_custom_env_files only instead of ( standalone_custom_env_files + standalone_custom_env_files ) | 10:36 |
ykarel | holser, what about 3rd, and fixing just the reproducer to exclude custom_env_files https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/create-zuul-based-reproducer/templates/launcher-playbook.yaml.j2#L110 to not include | 10:36 |
ykarel | or 4th where if possible use job.featureset_override instead of reading from file, for that need to see if there is issue in doing that | 10:37 |
marios | ykarel: problem is we need the featureset-override file but it is created with duplicates see https://2302f195cca0bd2fbfcf-1aafb108750144ecd9565eaf1429d9e4.ssl.cf1.rackcdn.com/753807/1/check/tripleo-ci-centos-8-standalone-upgrade-ussuri/666dcd1/logs/reproducer-quickstart/featureset-override.yaml | 10:37 |
marios | ykarel: so we can't exclude it alltogether we still need it for standalone_environment_files | 10:37 |
ykarel | yes that's what /me suggesting where we exclude custom env files from ^ | 10:37 |
holser | marios dups are not problem as we include only standalone_custom_env_files from that yaml/dict | 10:38 |
holser | ykarel can you make a patch really quick | 10:38 |
holser | I will test it | 10:38 |
ykarel | holser, ok let me check, give me a few | 10:38 |
marios | holser: all i'm saying basically is we aren't seeing this in any other job, only for reproducer templates, which is why i'm against https://review.opendev.org/#/c/752959/ ... i think there must be a problem in the way we are generating the reproducer files but don't have time to dig rightnow | 10:39 |
marios | holser: i.e. as i said i agree https://bugs.launchpad.net/tripleo/+bug/1897155 is valid but not sure what the root issue/right fix is yet | 10:39 |
openstack | Launchpad bug 1897155 in tripleo "Reproducer doesn't reproduce job" [Critical,Confirmed] - Assigned to Sergii Golovatiuk (sgolovatiuk) | 10:39 |
*** dtantsur|afk is now known as dtantsur | 10:49 | |
chandankumar | bhagyashri|rover: marios: weshay|ruck I am taking half day sick leave due to cough & cold, see ya on monday! | 10:50 |
holser | marios I guess we need to merge my patch as it's not harmful | 10:50 |
holser | marios then when you have a time you'll refactor and make better patch | 10:50 |
holser | marios The best is the enemy of the good | 10:51 |
marios | holser: ;) ack we can consider this too sure .. for now can you apply your patch to local tripleo-ci checkout to unblock you? | 10:52 |
holser | I can | 10:52 |
holser | that's what I do | 10:52 |
marios | holser: ack | 10:52 |
holser | marios just adding it to launcher-playbook.yaml as depends-on | 10:53 |
marios | chandankumar: sorry i missed it in the conversation... feel better chandankumar have a good rest! | 10:55 |
ykarel | holser, that file is being read as text, so need to convert that | 11:24 |
ykarel | but will post someting as a post task cleanup for the items | 11:24 |
*** jpena is now known as jpena|lunch | 11:27 | |
ykarel | holser, starting with https://review.opendev.org/754353, will post other review in some time, need to do some other work now | 11:28 |
holser | ykarel thanks | 11:28 |
bhagyashri|rover | chandankumar, get well soon! take rest | 11:36 |
*** pojadhav is now known as pojadhav|brb | 11:47 | |
*** rlandy has joined #oooq | 12:04 | |
*** rfolco|ruck has joined #oooq | 12:05 | |
ysandeep | rlandy, \o/ rhos-release.virt.bos.redhat.com went down, when you settle down could you please review - https://code.engineering.redhat.com/gerrit/#/c/213117/, https://code.engineering.redhat.com/gerrit/#/c/213123/ | 12:05 |
rlandy | sure - rekicking container builds | 12:07 |
rlandy | ysandeep: https://code.engineering.redhat.com/gerrit/#/c/213117/ - so idk here - both can go down :) | 12:12 |
rlandy | we should install from the right source | 12:12 |
rlandy | I see jason approved | 12:13 |
rlandy | checking | 12:13 |
ysandeep | rlandy, got that new path from reldel folks | 12:14 |
rlandy | ysandeep: ack - just checking | 12:14 |
rlandy | ysandeep: merged | 12:15 |
*** amoralej is now known as amoralej|lunch | 12:17 | |
ysandeep | thnx :) | 12:18 |
*** pojadhav|brb is now known as pojadhav | 12:27 | |
*** jpena|lunch is now known as jpena | 12:31 | |
rlandy | bhagyashri|rover: hi - is the openstack-tox-linters failure still an issue? can I recheck https://review.opendev.org/#/c/753856? | 12:31 |
bhagyashri|rover | rlandy, all patches are merged https://review.opendev.org/#/q/topic:linters-fix+(status:open+OR+status:merged) | 12:33 |
bhagyashri|rover | let me check | 12:33 |
*** jtomasek has joined #oooq | 12:33 | |
rlandy | bhagyashri|rover: great - thanks | 12:33 |
*** ysandeep is now known as ysandeep|away | 12:34 | |
bhagyashri|rover | rlandy, ^ failure is before this patch got merged https://review.opendev.org/#/c/753760/5 | 12:35 |
bhagyashri|rover | rlandy, you can recheck | 12:36 |
rlandy | done - thanks | 12:36 |
*** jtomasek_ has quit IRC | 12:36 | |
*** saneax has quit IRC | 12:42 | |
rlandy | rfolco|ruck: bhagyashri|rover: hoping https://review.opendev.org/#/c/753856 will resolve sporadic failures on the multinode-ipa job ... | 12:58 |
rlandy | when that goes though, I'm going to put up a patch to make multinode-ipa voting again | 12:59 |
rfolco|ruck | rlandy, tell me the branch this is for and I will testproject this | 13:00 |
rfolco|ruck | rlandy, aaah you already tested it | 13:00 |
bhagyashri|rover | rlandy, thanks :) | 13:01 |
rlandy | rfolco|ruck: master and ussuri | 13:01 |
rlandy | both DNM patch tested | 13:01 |
rfolco|ruck | I see your test patches | 13:01 |
rfolco|ruck | ok thanks | 13:01 |
*** ykarel_ has joined #oooq | 13:03 | |
*** ykarel has quit IRC | 13:05 | |
*** ratailor has quit IRC | 13:06 | |
*** ykarel_ is now known as ykarel | 13:07 | |
*** amoralej|lunch is now known as amoralej | 13:14 | |
*** TrevorV has joined #oooq | 13:21 | |
*** TrevorV has quit IRC | 13:26 | |
*** Goneri has joined #oooq | 13:41 | |
*** TrevorV has joined #oooq | 13:45 | |
* marios has sore throat since lunchtime | 13:54 | |
marios | starting to panic | 13:54 |
marios | :/ | 13:54 |
rlandy | marios: oh no ... | 14:09 |
rlandy | it's just allergies, really | 14:09 |
marios | rlandy: :/ hope so | 14:10 |
marios | rlandy: you know i'v googled 'rona symptoms sore throat' today a few times | 14:10 |
marios | :D | 14:10 |
marios | :( sorry it isn't at all funny it is a defense/nervous we shouldn't even joke about it | 14:11 |
rlandy | marios: https://www.cdc.gov/coronavirus/2019-ncov/need-extra-precautions/people-with-seasonal-allergies-faqs.html | 14:12 |
marios | rlandy: thank you :) | 14:12 |
ykarel | marios, revised https://review.rdoproject.org/r/#/c/27934/, can u check now | 14:15 |
marios | ykarel: ack adding to list for reviews | 14:15 |
ykarel | marios, ack wanted to check job results post it merges | 14:15 |
ykarel | shouldn't harm but in case it does would need revert | 14:16 |
marios | ykarel: ack | 14:22 |
*** ykarel_ has joined #oooq | 14:23 | |
*** ykarel has quit IRC | 14:26 | |
weshay|ruck | marios, no it's not rona.. that's what it feels like to be PTL | 14:38 |
* weshay|ruck runs | 14:38 | |
marios | weshay|ruck: ;) | 14:38 |
weshay|ruck | :) | 14:38 |
weshay|ruck | marios, if you need rest.. get out of here NOW | 14:38 |
marios | weshay|ruck: am ok for now thanks | 14:39 |
marios | almost eod anyway | 14:39 |
marios | rfolco|ruck: confirmed "RuntimeError: No such playbook: /usr/share/ansible/tripleo-playbooks/cli-container-image-prepare.yaml " @ https://logserver.rdoproject.org/81/28081/83/check/mol-tripleo_common_integration/d3c8d5c/tox/reports.html fyi | 14:48 |
marios | rfolco|ruck: commented there https://review.rdoproject.org/r/#/c/28081/83//COMMIT_MSG@27 in case isn't clear what i mean ^^^ | 14:49 |
rfolco|ruck | marios, so the error seen in the tox report is not clear... is it the missing playbook failure ? | 14:51 |
marios | rfolco|ruck: yes its exactly clear in the report | 14:52 |
marios | rfolco|ruck: grep this: " 2020-09-25 13:02:48.018 48372 ERROR tripleoclient.v1.container_image.TripleoImagePrepare [-] Exception occured while running the command: RuntimeError: No such playbook: /usr/share/ansible/tripleo-playbooks/cli-container-image-prepare.yaml | 14:52 |
marios | rfolco|ruck: from the report copy/paste ^^ | 14:52 |
*** ykarel__ has joined #oooq | 14:52 | |
marios | rfolco|ruck: wondering if it is an issue with the path. like pip installs to /usr/local instead of /usr/share or somesuch... | 14:53 |
marios | rfolco|ruck: :/ | 14:53 |
rfolco|ruck | ah you mean, inside the venv the path is diff | 14:53 |
rfolco|ruck | gotcha | 14:53 |
*** ykarel_ has quit IRC | 14:55 | |
rfolco|ruck | marios, good findings indeed. Lets workaround this | 14:57 |
marios | rfolco|ruck: ack so i won't be updating that again today if you fancy a go please feel free | 15:00 |
rfolco|ruck | marios, ok will give it a try later today | 15:01 |
rfolco|ruck | marios, thanks for the updates | 15:01 |
sshnaidm|afk | chandankumar, maybe we can merge https://review.opendev.org/#/c/752301/ before we do non-tripleo images? | 15:21 |
sshnaidm|afk | chandankumar, it's difficult to manage 3 deps patches | 15:21 |
*** marios is now known as marios|afk | 15:49 | |
*** ykarel__ is now known as ykarel | 16:07 | |
*** ykarel is now known as ykarel|away | 16:13 | |
*** apetrich has quit IRC | 16:13 | |
*** amoralej is now known as amoralej|off | 16:14 | |
*** apetrich has joined #oooq | 16:19 | |
*** jpena is now known as jpena|off | 16:30 | |
*** ykarel|away has quit IRC | 16:33 | |
*** udesale_ has quit IRC | 16:54 | |
*** marios|afk has quit IRC | 16:56 | |
*** dtantsur is now known as dtantsur|afk | 16:58 | |
*** TrevorV has quit IRC | 17:10 | |
*** derekh has quit IRC | 17:18 | |
rlandy | weshay|ruck: have time to review repoquery script? | 18:18 |
weshay|ruck | rlandy, aye.. and my connection should be decent | 18:19 |
rlandy | weshay|ruck: meet.google.com/ypq-yrqb-ogd | 18:19 |
*** chem has quit IRC | 19:21 | |
*** chem has joined #oooq | 19:23 | |
*** rfolco|ruck has quit IRC | 20:58 | |
rlandy | weshay|ruck: woohoo ... repoquery -q -a --nvr --latest-limit 1 - returns latest rpm | 21:49 |
*** apetrich has quit IRC | 21:49 | |
rlandy | no figuring out max required | 21:49 |
*** rlandy has quit IRC | 21:58 | |
*** jtomasek has quit IRC | 21:58 | |
*** tosky has quit IRC | 22:58 | |
*** rfolco|ruck has joined #oooq | 23:02 | |
*** rfolco|ruck has quit IRC | 23:29 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!