Friday, 2020-04-24

*** jmasud has quit IRC01:10
*** dsneddon has quit IRC01:21
*** jmasud has joined #oooq01:35
*** jmasud has quit IRC01:47
*** apetrich has quit IRC02:09
*** rlandy has quit IRC02:12
*** jmasud has joined #oooq03:26
*** jmasud has quit IRC04:05
*** jmasud has joined #oooq04:07
*** ysandeep|away is now known as ysandeep04:10
*** ykarel|away is now known as ykarel04:13
*** jmasud has quit IRC04:24
*** jmasud has joined #oooq04:42
*** ratailor has joined #oooq04:50
*** ysandeep is now known as ysandeep|brb04:58
*** jmasud has quit IRC05:15
*** jmasud has joined #oooq05:28
*** ysandeep|brb is now known as ysandeep05:29
*** dsneddon has joined #oooq05:42
*** dsneddon has quit IRC05:47
*** udesale has joined #oooq05:57
*** dpawlik has joined #oooq06:03
*** jfrancoa has joined #oooq06:05
*** marios has joined #oooq06:08
*** jmasud has quit IRC06:18
*** jmasud has joined #oooq06:19
*** yolanda has joined #oooq06:28
*** ccamacho has joined #oooq06:37
*** skramaja has joined #oooq06:57
*** jmasud has quit IRC07:01
*** apetrich has joined #oooq07:03
*** bogdando has joined #oooq07:05
*** jtomasek has joined #oooq07:06
*** matbu has quit IRC07:09
*** matbu has joined #oooq07:10
*** jmasud has joined #oooq07:12
*** jpena|off is now known as jpena07:20
mariosarxcruz: rebase https://review.rdoproject.org/r/#/c/26683/07:23
matbuhi folks, do you have more info about https://bugs.launchpad.net/tripleo/+bug/187453507:30
openstackLaunchpad bug 1874535 in tripleo "tripleo-validations; unable to discover unit tests, breaking the gate" [Critical,Triaged]07:30
matbu?07:31
matbumaybe jpena ?07:31
matbusshnaidm|afk: or07:31
marioso/ matbu panda|ruck is on duty this week07:31
mariosmatbu: checking the ruck|rover hackmd now07:31
matbumarios: o/ thw how are you ?07:32
mariosmatbu: so it didn't help ? https://review.opendev.org/#/c/722485/ 4 hours ago merged07:32
matbus/thw/thx/07:32
mariosmatbu: o/ hey man :D hows it going07:32
mariosmatbu: sorry didn't see somethign in the ruck|rover pad about that07:33
jpenamatbu: is this happening consistently on that review? I think I have seen the same behavior elsewhere, but it worked on a recheck (which is a shame)07:33
mariosmatbu: https://hackmd.io/1pY-KQB_QwOe-a-5oEXTRg panda|ruck can we add that to title07:33
*** tosky has joined #oooq07:33
matbujpena: yep i think we already see such kind of failure last week :/07:33
mariosmatbu: so you're still seeing that after the merge to disable validations?07:34
matbumarios: jpena well my concerns is why it didn't build correctly07:35
matbuit should not failed on unit test discovery07:35
matbuso i'm wondering if it's not an infra thing or ..07:35
matbui'll check the history there, but afaik there was no new change in that repo recently that could break something07:36
mariosmatbu: well unless there is some other breaking change upstream07:36
mariosmatbu: i am not in context with that bug though first time i read it07:36
mariosmatbu: maybe even in validations-common Tengu are you aware of that bug? https://bugs.launchpad.net/tripleo/+bug/187453507:37
openstackLaunchpad bug 1874535 in tripleo "tripleo-validations; unable to discover unit tests, breaking the gate" [Critical,Triaged]07:37
mariosTengu: https://review.opendev.org/#/c/722485/2/roles/build-test-packages/defaults/main.yml07:38
matbumarios: yep he is :D we were discussing about it few minutes ago and conclude .... we need CI folks help :D07:38
Tengumarios: yeah, got a ping yesterday from weshay|ruck :/07:38
mariosTengu: one of those happy ones :D07:38
marios:/ sorry07:38
Tenguyup.07:38
Tenguand I fail to understand why it's failing now, and why07:38
Tenguespecially since running 'tox -epy36' here is all green07:38
matbui will try to build it locally07:39
jpenahm, validations-common... aha, I knew I remembered something07:39
jpenahttps://trunk.rdoproject.org/centos8-ussuri/component/tripleo/99/05/99050941f49a8752c8b2a7f75af12039f21c1afe_26f41efa/rpmbuild.log07:39
mariosTengu: so why don't you post the revert for that anyway so its ready.. looks like panda|ruck and akahat|ruck are not aware of it yet07:39
marioslets give them some time to investigate07:39
jpenamatbu: ^^ so it happened a couple days ago in the trunk.rdo builder. It was just for one commit, the next ones worked fine07:39
mariosmatbu: Tengu: ack on the green local... so i see now what matbu meant by 'infra' issue might be version of something used07:39
Tenguand I can't use my lab right now, already running things for another topic -.-'07:39
jpenaI suspect there's something triggering the issue at random07:39
Tengujpena: "at random". you know how to whisper soft words to my ears -.-'07:40
* jpena hates heisenbugs, too07:40
Tengu:)07:40
Tenguschrodinbug?07:41
*** jtomasek has quit IRC07:41
matbujpena: hmm weird07:41
jpenaactually yes, wrong scientist07:41
Tenguhehe07:41
mariosTengu: jpena: best part about those is once you've fixed it you still have no idea if you fixed it cos schrodinbug07:41
mariosyou just wait and see and hope for the best :D07:42
Tengumarios: exactly. a bug in a closed box.07:42
mariosTengu: it both is and isn't fixed07:42
mariosall the time07:42
Tenguuntil you can open that fscking box07:42
Tenguanyway, it was apparently failing on a regular basis since those packages were dropped.07:43
mariosme staring at the trace07:43
Tenguso it's maybe not THAT schroedinbug-ish07:43
Tengu(yeah, oe, because รถ in German)07:44
matbujpena: maybe it's related tot he last commit (victoria unit tests) https://github.com/openstack/validations-common/commits/master07:44
matbu?07:44
mariosTengu: ? https://github.com/openstack/validations-common/commit/327e7a9b5625dd433b0b1e1d86b704eee05fdbfd07:45
Tengumarios: so we can propose the revert of the deactivation and, then, add a depends-on the thing we think is the solution, right?07:45
jpenamatbu: the issue in RDO Trunk happened with commit 99050941f49a8752c8b2a7f75af12039f21c1afe07:45
mariosTengu: that would cause a zuul fail i think i.e. if that template is missing or something or you mean something else07:45
mariosTengu: yes that sounds right07:45
Tenguhttps://review.opendev.org/72262607:46
Tengufeel free to edit its commit message to add any needed depends-on, matbu :)07:46
Tengubut please keep the -w in place so that nobody will cry ;)07:47
mariosTengu: how can it already be in merge conflict wtf07:47
marioso_O07:47
Tenguwhaattt07:47
* marios goes back to bed07:47
mariosexception07:47
*** ccamacho has quit IRC07:47
matbumarios: :D07:47
Tengulemme do the revert manually.07:48
*** ccamacho has joined #oooq07:48
Tenguoh.07:48
Tenguok.07:48
* marios goes back to reviews07:49
mariosping if there is somethign i can do/review etc07:49
Tenguso at first the patch did more than just listing those packages07:49
matbumarios: s/reviews/bed/ ? :D07:50
* marios can do code reviews in bed07:50
marioswhats the problem07:50
Tenguhehe07:50
Tengusleep reviews?07:50
Tenguuncoffeeinated reviews07:50
Tenguschroedinview07:51
Tengu:D07:51
Tenguanyway. the patch is now OK, no more merge conflict. still -w in order to lock it down.07:51
Tengumarios: where are those template supposed to be located btw?07:52
Tenguso that we can ensure we actually have this openstacp-python3-victoria-jobs07:52
matbujpena: so this commit is breaking "sometimes" or every build ?07:52
jpenamatbu: sometimes07:52
matbuerf07:52
jpenahttps://trunk.rdoproject.org/api-centos8-ussuri/api/report.html?package=validations-common07:52
Tenguo_O07:53
Tenguit was apparently failing enough to lock the gate though07:53
mariosTengu: in some zuul.d directory07:53
mariosTengu: upstream i'd have to look for it07:53
Tengumarios: supposed to be in the project itself, or in some other repos?07:53
mariosTengu: could come from another repo that is included in the zuul job07:54
matbui'm going to add a comment to the LP07:54
Tengu"yay"07:54
mariosTengu: hold on hound should tell us07:54
marioshttps://opendev.org/openstack/openstack-zuul-jobs/src/branch/master/zuul.d/project-templates.yaml07:54
mariosTengu: ^07:54
*** bogdando has quit IRC07:54
Tenguhttps://opendev.org/openstack/openstack-zuul-jobs/src/branch/master/zuul.d/project-templates.yaml#L45707:55
Tenguso it's defined.07:55
jpenaoh!07:55
jpenaI found something07:55
Tengujpena: share, share!07:55
mariosTengu: yea its used in lots of places http://codesearch.openstack.org/?q=openstack-python3-victoria-jobs07:55
jpenathe issue was reproduced outside the DLRN build environment, too07:55
matbujpena: great !07:55
jpenahttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_183/719598/3/gate/openstack-tox-py36/183a9aa/job-output.txt07:55
* matbu cross fingers07:56
*** jtomasek has joined #oooq07:56
Tenguhmm07:56
mariosnow going back to reviews07:56
matbujpena: this is the same trace back that is in the LP07:57
* Tengu goes back to bed^Wwork07:57
jpenaright07:57
*** ysandeep is now known as ysandeep|lunch07:57
jpenabut it's happening on a normal tox-py36 job07:57
jpenaon ubuntu07:57
Tenguubuntu....07:57
* Tengu prepares the flamethrower07:57
chandankumarpanda|ruck: akahat|ruck we are updating ansible version https://review.rdoproject.org/r/#/c/25914/ for ussuri07:58
Tengu.... and now podman is failing on my laptop. pfffff.08:03
jpenaTengu: I recently had an issue with podman after an upgrade, is it complaining about some semaphore/mutexes?08:05
Tengulimits.08:05
Tengujust dropped ~/.config/container directory08:05
Tenguand cleaned the local storage as well.08:05
Tengulovely podman -.-.08:05
Tengunow: ERROR: Could not open requirements file: [Errno 2] No such file or directory: ' https://opendev.org/openstack/requirements/raw/branch/master/upper-constraints.txt'08:06
jpenaright, that's what happened to me. Removing an old config file somewhere under .config/container worked08:06
Tenguso I can't run tox in my ubuntu:bionic container for #reason. great.08:08
*** gchamoul has joined #oooq08:14
*** dtantsur|afk is now known as dtantsur08:17
jpenaTengu: if it helps reproduce, I've been running "tox -epy36" on a fresh git checkout on my laptop (fedora 31), and it failed once after 100 attempts08:19
matbujpena: 100 attempts :'(08:22
Tengu-.-08:25
Tenguhave to jump on some mtg08:25
gchamouljpena: just checking all the configuration files which could put us on a lead08:34
*** derekh has joined #oooq08:37
*** bogdando has joined #oooq09:01
*** ykarel is now known as ykarel|lunch09:05
*** ysandeep|lunch is now known as ysandeep09:08
*** dtantsur is now known as dtantsur|brb09:15
*** jtomasek has quit IRC09:20
*** jmasud has quit IRC09:27
*** jmasud has joined #oooq09:39
*** jmasud has quit IRC09:51
panda|ruckmarios: in containers build, is there a way to access more detailed logs ? like for example, if a container fails on dnf install step, is there a way to get logs on dnf command ?09:54
mariospanda|ruck: yea look in logs/09:54
mariospanda|ruck: buildah builds09:55
marioshttps://sf.hosted.upshift.rdu2.redhat.com/logs/58/196858/71/check/periodic-tripleo-build-containers-rhel-8-master/4998724/logs/buildah-builds/kolla-builds/882b52ca-6f90-4859-aac9-d6a9918d9cfe/docker/09:55
mariospanda|ruck: eg ^09:55
mariospanda|ruck: inside each is the build log09:55
panda|ruckmarios: ah thanks https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-8-master-containers-build-push/36c9a4a/logs/buildah-builds/kolla-builds/39d7c573-c3fc-4796-91ab-eac4a0646b0d/docker/openvswitch/openvswitch-base/openvswitch-base-build.log09:56
panda|rucknetwork hiccup probably09:56
mariospanda|ruck: ack09:56
mariospanda|ruck: have you seen that yet/anywhere else 2020-04-24 09:28:52 | sed: -e expression #1, char 47: unterminated `s' command10:07
marioshttps://logserver.rdoproject.org/76/26676/3/check/tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset039/9b3b503/logs/undercloud/home/zuul/ipa_prep.sh.log.txt.gz10:07
mariospanda|ruck: probably not if its ipa specific ...10:08
mariospanda|ruck: new thing now happening in the check job which was green until yesterday https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset03910:08
panda|ruckmarios: no, akahat|ruck have you seen that ? ^10:08
mariospanda|ruck: ah hold on i think i was looking at a testproject result10:09
mariospanda|ruck: so might be something in their patch10:09
mariospanda|ruck: never mind... looks like i was ... both fails there are from testproject10:09
marioshttps://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-8-ovb-3ctlr_1comp_1supp-featureset03910:09
panda|ruckmarios: that's what I was lookign for, but the patch is in zuul layout10:09
* marios nervous around fs39 10:10
mariospanda|ruck: yeah but has 3 depends on10:10
mariospanda|ruck: and i was going crazy, looking in hound/grep for some task, which in fact is only now being added there https://review.opendev.org/#/c/721615/10:10
panda|ruckmarios: yeah, stop looking at check jobs :)10:12
mariospanda|ruck: it's fs39... cursed i tell ya10:13
*** jbadiapa has joined #oooq10:23
*** jmasud has joined #oooq10:27
panda|ruckarxcruz: what's the status of tempest component jobs  ? are they stable ? do I have to report bugs ?10:29
arxcruzpanda|ruck: sorry, what do you mean ?10:30
panda|ruckarxcruz: jobs in the tempest component pipeline are failing, and I wanted to understand if they are supposed to be stable10:30
arxcruzpanda|ruck: sorry, i wasn't monitoring these jobs, do you have a link ?10:31
arxcruzto the failure10:31
panda|ruckarxcruz: same failure as others, IP allocation problem10:32
*** ykarel|lunch is now known as ykarel10:32
arxcruzpanda|ruck: can i have a look ?10:33
panda|ruckarxcruz: no10:33
arxcruzok10:33
panda|ruckarxcruz: it's mine, MINE10:33
panda|ruckarxcruz: my tempessssssssst10:33
arxcruzlol10:33
panda|ruckarxcruz: https://logserver.rdoproject.org/openstack-component-tempest/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-tempest-master/d4dab46/logs/undercloud/var/log/tempest/stestr_results.html.gz10:34
arxcruzkopecmartin: do you have any idea? I believe it's concurrency10:35
panda|ruckarxcruz: there's a CIX bug open for that error10:35
kopecmartinthere was a bug already with a similar issue i think10:36
kopecmartinlet me find it10:36
arxcruzi believe it's because concurrency and the component have small amount of ip to be allocated10:36
arxcruzmaybe add more ip availability10:36
kopecmartinhttps://bugs.launchpad.net/tripleo/+bug/1852770/10:37
openstackLaunchpad bug 1852770 in tripleo "No more IP addresses available on network, neutron_tempest_plugin.scenario.test_security_groups.NetworkSecGroupTest" [High,In progress] - Assigned to wes hayutin (weshayutin)10:37
kopecmartincheck the comment #810:37
arxcruzkopecmartin: panda|ruck https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/playbooks/tempest.yml#L4610:46
arxcruzmaybe if we increase the ip allocation here...10:46
chandankumararxcruz: https://opendev.org/openstack/openstack-ansible-os_tempest/src/branch/master/defaults/main.yml#L13910:47
chandankumarif we check default one10:47
chandankumarthey have 5010:47
arxcruzchandankumar: the default is ommited10:47
arxcruzand we are setting to 20 in our side10:47
chandankumararxcruz: I mean in example10:48
arxcruzchandankumar: yeah, maybe we should increase ours...10:48
chandankumararxcruz: yes10:48
arxcruzlet me work on that10:48
chandankumarcool, thanks!10:48
arxcruzchandankumar: panda|ruck: https://review.rdoproject.org/r/2677510:55
arxcruzthe test project10:55
arxcruzand https://review.opendev.org/722662  the patch for increase ip allocation10:55
Tengugchamoul, matbu anything new?10:55
gchamoulcan't reproduce locally, with and without tox ...10:56
Tengumeh...10:56
gchamoultrying to get a python3.6 locally10:56
Tengu'k. will give some more test to the podman +ubuntu:bionic now.10:57
gchamoulbecause when I run things, I use python3.710:57
TenguI have a small free time right now before new bunch of meetings.10:57
chandankumararxcruz: if it passes, it can mark it closes bug10:58
gchamoulnever see that behaviour locally before, only one time in the gate and it didn't worry myself.... Mistake!10:59
arxcruzchandankumar: yeah, I believe even if it passes, it's better to keep as it is for a few runs to make sure10:59
chandankumararxcruz: akahat|ruck kopecmartin soniya29 https://hackmd.io/fIOKlEBHQfeTZjZmrUaEYQ?view please add or edit it11:06
Tengumeh... for some reasons I'm unable to run the tox command in an ubuntu:bionic container.11:07
gchamoulTengu: just need virtualenv11:08
Tengugchamoul: yeah well, I love having an env as close as possible to what is used ;).11:08
Tengubut since I also happen to have a 3.6 venv...11:09
gchamoulTengu: to me it's not a tox issue11:09
Tengusource ../venv-3.6/bin/activate11:09
Tengugchamoul: at least it's something in the python part called by tox. I would find really funky having a broken mirror with wrong version for one of the dependency of the unit tests11:12
Tenguthat would explain the randomness.11:12
*** dtantsur|brb is now known as dtantsur11:14
*** jmasud has quit IRC11:18
*** jtomasek has joined #oooq11:21
*** jpena is now known as jpena|lunch11:28
*** jtomasek has quit IRC11:28
weshay|ruckakahat|ruck, panda|ruck give me a couple min please.. I'll be there in a few11:28
akahat|ruckweshay|ruck, okay11:29
*** pojadhav is now known as pojadhav|brb11:37
weshay|ruckakahat|ruck, http://dashboard-ci.tripleo.org/d/Z_UNB29Wz/third-party-dependency-check?orgId=111:43
kopecmartinchandankumar: does the issue mean we need to edit spec file and tune the dependencies? https://review.rdoproject.org/r/#/c/26769/11:46
chandankumarkopecmartin: I think yes, rdo-train spec file, before we updated it to 23.011:47
chandankumaryou will get the patch11:47
chandankumar*check the rdo-train11:47
chandankumarkopecmartin: https://github.com/rdo-packages/tempest-distgit/commit/1ea2cc50c46fe2783649c003c6bc7fd005e2bd2f11:49
chandankumarkopecmartin: just cherry pick this one11:49
chandankumarand make sure it is available for stein11:49
chandankumarcheck in deps.yaml file11:49
kopecmartinchandankumar: thanks, i'm on it11:49
chandankumarbetter it is tagged or not for stein11:49
weshay|ruckpanda|ruck, akahat|ruck https://review.opendev.org/#/c/72266211:50
panda|ruckmarios: chandankumar review.enqueue_async(https://review.rdoproject.org/r/26694)11:54
mariospanda|ruck: created ticket 123315511s111:57
panda|ruckmarios: ACK.11:57
mariospanda|ruck: RST11:58
panda|ruckmarios: TIME_WAIT11:59
weshay|ruckpanda|ruck, akahat|ruck https://github.com/rdo-infra/ci-config/tree/master/ci-scripts/infra-setup/roles/rrcockpit12:00
weshay|ruckpanda|ruck, akahat|ruck https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/rrcockpit/files/development_script.sh12:01
kopecmartinchandankumar: according to pypi, the dep is part of sphinxcontrib-svg2pdfconverter package which is not in requirements for stein https://github.com/openstack/requirements/tree/stable/stein12:02
kopecmartinchandankumar: what in that case?12:03
weshay|ruckysandeep, https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic-master&job_name=periodic-tripleo-ci-centos-8-scenario012-standalone-master%0912:10
zbrweshay|ruck: panda|ruck chandankumar: please take another look at https://review.opendev.org/#/c/722402 -- check comments and see if new set looks good.12:10
weshay|ruckysandeep, https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/config/CentOS-8/master.ini#L2712:11
zbrit still keeps one multinode, 3 standalones, but it does skip them on gate, mainly because these jobs are not really testing the role12:11
zbrincluding a role with ignore_errors is making almost impossible to fail due to the role itself.12:12
weshay|ruckysandeep, http://dashboard-ci.tripleo.org/d/wb8HBhrWk/cockpit?orgId=1&var-launchpad_tags=alert&var-releases=master&var-promotion_names=current-tripleo&var-promotion_names=current-tripleo-rdo&var-influxdb_filter=job_name%7C%3D%7Ctripleo-ci-centos-8-scenario012-standalone12:12
chandankumarzbr: one minute comment12:15
zbrchandankumar: so to run 1+2+10 ?12:16
chandankumarzbr: yes12:16
chandankumarkopecmartin: better we can disbale doc adding a comment about this package12:17
chandankumarkopecmartin: %global with_doc 012:17
kopecmartinchandankumar: makes sense, thanks12:20
zbrchandankumar: done! btw, later I plan to add some code to verify.yml to validate that we produced desired files, much more useful than running a full integration and relying on reviewer to manually inspect the collection directory.12:20
*** ratailor has quit IRC12:21
panda|ruckzbr: +112:25
panda|ruckzbr: a passing job is not a passing test.12:26
*** pojadhav|brb is now known as pojadhav12:26
chandankumarpanda|ruck: commented https://review.rdoproject.org/r/#/c/26694/12:29
rf0lc0chandankumar, pls see my comment on https://review.rdoproject.org/r/#/c/26708/ and see if that changes your vote :)12:29
panda|ruckchandankumar: ah, thanks.12:30
*** rlandy has joined #oooq12:31
*** jtomasek has joined #oooq12:33
chandankumarweshay|ruck: https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master12:34
*** rlandy is now known as rlandy|mtg12:35
*** jpena|lunch is now known as jpena12:38
rf0lc0marios, I'll take the other 2 promoter tests to fix (staging-*) as I feel responsible for the mess. If you have time, please help me with the upstream branching :)12:41
mariosrf0lc0: i am doing that12:41
rf0lc0will talk to panda|ruck about the promoter tests that I broke12:41
rf0lc0marios, nice thanks12:41
mariosrf0lc0: i am trying to make sense of what needs -ussuri will post something today anyway12:41
marioshttps://tree.taiga.io/project/tripleo-ci-board/task/1665 rf0lc012:42
rf0lc0c00l12:42
chandankumarweshay|ruck: arxcruz https://9c98041cc87eb70d9be4-b5689cdf1183af9fcadbc91f7ef3081b.ssl.cf2.rackcdn.com/717995/6/check/tripleo-ci-centos-8-scenario012-standalone/464f8c5/logs/undercloud/var/log/tempest/stestr_results.html12:43
panda|ruckrf0lc0: YOU WHAT ???12:43
panda|ruckrf0lc0: ship you neck here so I can strangle you in socially distancing.12:43
rf0lc0panda|ruck, as long as spray alcohol 70% before, I am fine.12:44
panda|ruckchandankumar: marios review.enqueue_async(https://review.opendev.org/722677)12:46
panda|ruckmarios: can you offer a REST API for this, it's getting difficult to maintain as RPC12:46
mariospanda|ruck: i'll think about it your feedback is very valuable to us12:47
chandankumarrf0lc0: free for few mins?12:53
rf0lc0chandankumar, yes wanna chat?12:54
chandankumarrf0lc0: yes12:54
rf0lc0chandankumar, gimme a min to switrch rooms12:55
chandankumarrf0lc0: aye12:55
*** jtomasek has quit IRC12:58
rf0lc0chandankumar, https://meet.google.com/oiv-geho-mai?authuser=112:59
*** Goneri has joined #oooq13:08
*** ykarel is now known as ykarel|afk13:14
weshay|ruckysandeep, rlandy|mtg https://docs.google.com/document/d/1XxTxgXGdWntjURJBVP2n9ZZ_By8NqRmkbtY3VWcUUcQ/edit13:15
chandankumarrf0lc0:  thanks :-)13:15
*** pojadhav is now known as pojadhav|away13:18
rf0lc0chandankumar, thank you. I just did not understand the next step. after enabling promote to component-ci-testing, what is the next step?13:18
*** skramaja has quit IRC13:20
*** amoralej is now known as amoralej|lunch13:25
chandankumarrf0lc0: http://paste.openstack.org/show/792659/ is clear?13:26
chandankumarregarding ussuri-testing pipeline13:26
chandankumarrf0lc0:  then we can add https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/config/CentOS-8/component/master.yaml which will create toci testing repo13:27
chandankumarthen we can start working on integation pipeline13:28
rf0lc0chandankumar, right, in other words, first time the pipeline runs, we get consistent, pin to component-ci-testing, and promote to promoted-components. Without any real job to verify if its good or not. We just pick consistent. Because we don't have the artefacts like containers to run these validation jobs in component pipeline.13:30
rf0lc0chandankumar, is this statement above true ?13:30
rf0lc0first component promotion will be a lie13:31
ysandeeprlandy|mtg, thank you :) :)13:34
*** rlandy|mtg is now known as rlandy13:34
rlandyysandeep: sure - happy someone else is working on bm now13:34
*** TrevorV has joined #oooq13:38
rf0lc0chandankumar, zzzzzzzzz13:47
rf0lc0chandankumar, 40413:47
chandankumarrf0lc0:  20013:48
chandankumarrf0lc0: yes, correct13:48
rf0lc0\o/13:48
*** ysandeep is now known as ysandeep|afk13:50
arxcruzpanda|ruck: https://logserver.rdoproject.org/75/26775/1/check/periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-tempest-master/7e14525/logs/stackviz/#/testrepository.subunit/timeline13:54
arxcruzpanda|ruck: seems to be working13:54
*** udesale_ has joined #oooq13:54
*** ratailor has joined #oooq13:56
*** udesale has quit IRC13:57
*** ykarel|afk is now known as ykarel14:07
panda|ruckarxcruz: lately all the errors in tempest appear to be intermittent, so I would wait for it not to appear again in the future14:10
*** pojadhav|away is now known as pojadhav14:12
*** amoralej|lunch is now known as amoralej14:15
*** udesale_ has quit IRC14:19
chandankumarrlandy: https://review.opendev.org/#/c/722402/ merge it14:47
rlandydone14:48
chandankumarrlandy: thanks !14:49
mariosrf0lc0: did you get a chance to see containers... i commented on your https://code.engineering.redhat.com/gerrit/#/c/196858/71/playbooks/tripleo-buildcontainers/pre_rhel8.yaml@50  ... then i added the -u -r 8.2 and basically it brings us on par with the 'all repos' case commented https://code.engineering.redhat.com/gerrit/#/c/196858/72/playbooks/tripleo-buildcontainers/pre_rhel8.yaml ... so we are still14:51
marioswaiting on the trunk-candidate looks like14:51
mariosrlandy: ^^^14:51
mariosrf0lc0: sorry was meant for rlandy14:51
mariosrlandy: did you get a chance to see containers... i commented on your https://code.engineering.redhat.com/gerrit/#/c/196858/71/playbooks/tripleo-buildcontainers/pre_rhel8.yaml@50  ... then i added the -u -r 8.2 and basically it brings us on par with the 'all repos' case commented https://code.engineering.redhat.com/gerrit/#/c/196858/72/playbooks/tripleo-buildcontainers/pre_rhel8.yaml ... so we are still14:51
marioswaiting on the trunk-candidate looks like14:51
* marios spams the channel 14:51
rf0lc0marios, I made a wtf face :)14:52
rlandymarios: when I checked yesterday, yes14:52
rlandywe can ping lon and ask14:52
mariosrlandy: yeah same today i mean earlier when i looked14:52
mariosrlandy: but as per https://code.engineering.redhat.com/gerrit/#/c/196858/72/playbooks/tripleo-buildcontainers/pre_rhel8.yaml with containers repo & 8.2 stuff it gets us to 'same' result14:52
mariosrlandy: hopefully candidate will give us the rest14:52
mariosrlandy: we can wait till Monday and then just merge this then14:52
rlandymarios: we got a response on the ticket to say the action was done so I was expecting an update today14:53
mariosrlandy: k well if you get a hold of Lon in your timezone maybe it will be done done by Monday morning i can check it/update14:53
rlandymarios: ack14:54
*** ratailor has quit IRC15:04
*** dpawlik has quit IRC15:10
panda|ruckweshay|ruck: would be a problem to open a bug on the promoter for the error ? I have  apossible root cause, a workaround and more permanent fix, but I need to keep track of what I'm doing15:20
weshay|ruckpanda|ruck, it's fine to open a bug15:21
panda|ruckweshay|ruck: ok15:21
zbrartcl reviews needed on https://review.opendev.org/#/c/721844/ https://review.opendev.org/#/c/721607/15:37
* marios shutdown 15:45
weshay|ruckmarios, helpdesk take care of you?15:46
mariosweshay|ruck: not sure that's what i was asking today but don't worry not urgent/problem let's see will ask again if isn't resolved by next week thanks for asking weshay|ruck15:46
weshay|ruckcool15:48
*** ysandeep|afk is now known as ysandeep|away15:49
*** marios has quit IRC16:05
zbrpanda|ruck: weshay|ruck chandankumar rlandy : please revote on https://review.opendev.org/#/c/722402/ -- i applied wes request.16:05
zbrwe can discuss on monday meeting about challenging that invoked policy16:06
weshay|ruckzbr, is there a specific need for         - tripleo-ci-centos-8-scenario010-ovn-provider-standalone16:07
weshay|ruck ?16:07
weshay|ruckor randomly picked16:07
zbrweshay|ruck: not randomly, we have one task specific to it.16:07
weshay|ruckk16:07
zbrmartin added one ovn specific task, so it would be useful to keep, at least until we find a way to mock-test it.16:08
*** bogdando has quit IRC16:26
*** dtantsur is now known as dtantsur|afk16:29
zbrweshay|ruck: it will be fun to re-add the votes on this change because the gerrit group change already merged but is waiting for deployment for ~1h, not sure when it will apply16:30
zbrwhen it does, you will lose access on that two repos, until i add the groups back. i will check again in an hour.16:31
*** ykarel is now known as ykarel|away16:33
*** jmasud has joined #oooq16:34
*** pojadhav is now known as pojadhav|away16:41
*** jpena is now known as jpena|off16:48
*** jmasud has quit IRC16:53
*** derekh has quit IRC17:00
*** jmasud has joined #oooq17:00
*** jmasud has quit IRC17:12
*** rlandy is now known as rlandy|brb17:14
chandankumarweshay|ruck: zbr rlandy|brb rf0lc0 panda|ruck arxcruz https://twitter.com/pyconindia/status/1253732245635952643/photo/117:47
rf0lc0chandankumar, cool17:48
weshay|ruck+117:52
*** amoralej is now known as amoralej|off17:53
weshay|ruckrlandy|brb, I think this would continue to work w/ internal builds.. please review https://review.opendev.org/#/c/718433/18:06
*** yolanda has quit IRC18:11
*** rlandy|brb is now known as rlandy18:12
rlandyweshay|ruck: hi - how do we usually get the ip of the undercloud node? host.primray.ansible_host?18:25
rlandyprimary18:25
weshay|ruckrlandy, hrm.. I can look18:59
rlandyundercloud_ip gives 127.0.0.2 :(19:01
rlandytrying ipv419:01
weshay|ruckrlandy, give me a link to one your ipa jobs19:03
rf0lc0weshay|ruck, you know why this did not merge ? https://review.rdoproject.org/r/#/c/26708/19:07
rlandyweshay|ruck: rechecking using  downstream zuul https://code.engineering.redhat.com/gerrit/#/c/195798/419:16
rlandyquicker than upstream19:16
weshay|ruckrf0lc0, you got it in the gate now19:16
rlandylast job took the 192 address19:17
rlandyI need it to take te public one I think19:17
rf0lc0weshay|ruck, yeah depends on patch merged after w+ on that one19:17
weshay|ruckrlandy, what's the cidr you are hoping to find?19:18
weshay|ruckfirst three octets?19:18
weshay|ruckrlandy, /me suggests working it backwards https://sf.hosted.upshift.rdu2.redhat.com/logs/98/195798/4/check/tripleo-ci-centos-8-standalone-on-multinode-ipa-internal/86e29d1/logs/undercloud/var/log/extra/dump_variables_vars.json19:19
rf0lc0weshay|ruck, need your fast and furious brain19:19
rf0lc0weshay|ruck, https://review.rdoproject.org/r/#/c/26800/5/zuul.d/integration-pipeline.yaml19:19
rlandy"10.0.109.19:19
rlandyI think the default will do it19:19
weshay|ruckk.. so that is subnode_119:20
rf0lc0weshay|ruck, can I run these mini pipeline jobs on testproject to speed up container builds and try enabling component jobs ?19:20
weshay|ruckI can trigger the integration line for you19:20
weshay|ruckrf0lc0, don't bother w/ a testproject19:21
rf0lc0weshay|ruck, let it run on periodic and wait for the containers ? and meanwhile I prepare the rest of ussuri jobs ?19:21
weshay|ruckrf0lc0, looking at ur review19:22
rf0lc0weshay|ruck, ok... the plan is to run on openstack-periodic-master pipeline, then we move to latest-release with all the other jobs19:22
weshay|ruckrf0lc0, keep working it.. comments19:23
rf0lc0thank you19:23
weshay|ruckrlandy, for me to help.. we probably need to chat19:24
weshay|ruckrlandy, I suspect ur looking for how the ctrl-plane ip is picked in tq?19:24
weshay|ruckbut not sure19:24
weshay|ruckand which variable it's associated with19:25
weshay|ruckrlandy, this bit? https://opendev.org/openstack/tripleo-quickstart/src/branch/master/roles/common/defaults/main.yml#L141-L15619:25
rlandyweshay|ruck: sec - trying one last option19:26
*** jjoyce has quit IRC19:27
*** jfrancoa has quit IRC19:27
rlandyweshay|ruck: ok - can chat now to explain19:28
rf0lc0weshay|ruck, this one ? periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-master:19:28
*** fuzzball81 has joined #oooq19:28
weshay|ruckyes.. that is featureset00119:28
weshay|ruckrlandy, k19:29
weshay|ruckrlandy, https://meet.google.com/gnn-pryg-qdu?authuser=119:30
weshay|ruckrlandy, https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/general_config/featureset039.yml#L21619:53
weshay|ruckrlandy, https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/config/environments/rdocloud.yml#L21-L2319:55
weshay|ruckrf0lc0, ready for review /merge?20:18
rf0lc0weshay|ruck, should be, waiting for zuul +120:18
-openstackstatus- NOTICE: The Zuul project gating service is reporting new patches in merge conflict erroneously due to a configuration error, fix in progress20:19
rf0lc0weshay|ruck, wait20:19
weshay|ruckrf0lc0, double check where you are putting the nodedef20:20
rf0lc0let me check diff on nodeset: upstream-centos-8-vexxhost vs20:20
rf0lc0exactly20:20
weshay|ruckk20:20
rf0lc0weshay|ruck, ready20:25
weshay|ruckk20:25
*** TrevorV has quit IRC20:29
*** holser has quit IRC20:29
weshay|ruckrf0lc0, hey.. jump on meet20:32
rf0lc0weshay|ruck, ok20:32
*** jbadiapa has quit IRC20:32
weshay|ruckrf0lc0, https://meet.google.com/jfh-sokm-hzq?authuser=120:32
*** fuzzball81 is now known as jjoyce20:35
*** jmasud has joined #oooq20:39
*** holser has joined #oooq20:40
*** holser has quit IRC20:42
*** jmasud has quit IRC20:43
*** ccamacho has quit IRC20:51
*** jmasud has joined #oooq21:06
*** jmasud has quit IRC21:09
*** jmasud has joined #oooq21:13
*** jmasud has quit IRC21:14
*** dsneddon has joined #oooq21:24
*** jmasud has joined #oooq21:28
rf0lc0weshay|ruck, shutdown sequence, please see the ussuri progress/task stream on https://hackmd.io/n7eBGiPVR4yoFbz9o-V2bQ?both, taiga is also updated21:29
rf0lc0tchau21:30
rf0lc0adios21:30
rf0lc0ciao21:30
*** jmasud has quit IRC21:31
*** rf0lc0 has quit IRC21:36
*** holser has joined #oooq21:36
*** holser has quit IRC21:58
rlandyweshay|ruck: looking better ... https://sf.hosted.upshift.rdu2.redhat.com/logs/98/195798/5/check/tripleo-ci-centos-8-standalone-on-multinode-ipa-internal/3187313/logs/undercloud/home/zuul/standalone_deploy.log22:22
rlandygets to standalone deploy step22:22
rlandy322:22
*** rlandy has quit IRC22:48
*** rf0lc0 has joined #oooq22:55
-openstackstatus- NOTICE: the This Zuul outage was taken as an opportunity to perform an impromptu maintenance for changing our service deployment model; any merge failures received from Zuul between 19:40 and 20:20 UTC were likely in error and those changes should be rechecked; any patches uploaded between 20:55 and 22:45 UTC were missed entirely by Zuul and should also be rechecked to get fresh test results22:56
*** jmasud has joined #oooq23:01
*** tosky has quit IRC23:14
*** chem has quit IRC23:20
*** chem has joined #oooq23:22
*** jmasud has quit IRC23:27
*** rf0lc0 has quit IRC23:30
*** jmasud has joined #oooq23:53

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!