Friday, 2020-01-17

*** rfolco has joined #oooq02:57
*** rfolco has quit IRC03:02
*** apetrich has quit IRC03:13
*** brault has quit IRC03:27
*** brault has joined #oooq03:29
*** rlandy has quit IRC04:06
*** raukadah is now known as chandankumar04:46
*** udesale has joined #oooq04:49
*** ykarel|afk is now known as ykarel04:50
*** surpatil has joined #oooq05:48
*** soniya29 has joined #oooq05:49
*** udesale has quit IRC05:56
*** udesale has joined #oooq05:56
*** soniya29 has quit IRC06:00
*** marios has joined #oooq06:05
*** saneax has joined #oooq06:06
*** ratailor has joined #oooq06:23
*** saneax has quit IRC06:28
*** SurajPatil has joined #oooq06:36
*** SurajPatil has quit IRC06:37
*** surpatil has quit IRC06:40
*** soniya29 has joined #oooq06:42
*** surpatil has joined #oooq06:49
*** jaosorior has joined #oooq06:51
*** jfrancoa has joined #oooq06:52
*** chem_ has joined #oooq07:13
*** chem has quit IRC07:18
*** jrist has quit IRC07:19
*** mjturek has quit IRC07:19
*** EmilienM has quit IRC07:19
*** rnoriega_ has quit IRC07:19
*** migi has quit IRC07:19
*** openstackstatus has quit IRC07:20
*** saneax has joined #oooq07:29
mariosweshay_: o/ see comments there please https://review.opendev.org/#/c/702932/1 it failed to merge on the gate jobs but i -2 to block it for now for the conversation thanks07:29
mariosmatbu: fyi ^07:38
*** ykarel is now known as ykarel|lunch07:45
*** brault has quit IRC07:56
*** jrist has joined #oooq08:05
*** mjturek has joined #oooq08:05
*** EmilienM has joined #oooq08:05
*** migi has joined #oooq08:05
*** rnoriega_ has joined #oooq08:05
*** tesseract has joined #oooq08:16
matbumarios: looking08:26
*** holser has joined #oooq08:27
*** tosky has joined #oooq08:29
*** holser has quit IRC08:31
*** ykarel|lunch is now known as ykarel08:31
*** holser has joined #oooq08:32
*** dmellado has quit IRC08:34
*** dmellado has joined #oooq08:35
*** ccamacho has joined #oooq08:35
*** amoralej|off is now known as amoralej08:40
*** jpena|off is now known as jpena08:48
*** bogdando has joined #oooq09:06
ykarelchandankumar, https://bugs.launchpad.net/tripleo/+bug/1860016 is also affecting master09:13
openstackLaunchpad bug 1860016 in tripleo "periodic-tripleo-ci-centos-7-standalone-train is not executing tempest, no results" [Critical,In progress] - Assigned to chandan kumar (chkumar246)09:13
ykarelhttp://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-standalone-master/60b1ce9/logs/undercloud/home/zuul/tempest/etc/tempest_whitelist.txt.gz09:14
chandankumarykarel, on it09:23
ykarelack09:26
chandankumarykarel, https://review.rdoproject.org/r/2459409:26
ykarelchandankumar, hmm i saw that, fix should be same for both releases09:27
ykarelseems it still failing ur patch09:27
chandankumarykarel, it is working https://review.rdoproject.org/zuul/stream/16bf44566404444cbf711a46418b902b?logfile=console.log09:27
ykarelchandankumar, ack i just saw zuul -1 on review09:28
*** chem_ has quit IRC09:36
*** derekh has joined #oooq09:36
*** chem_ has joined #oooq09:37
soniya29mkopec: Its weird, Even if we set wait_until='ACTIVE', we can see status in 'SAVING' state. Here is the log_file. https://eefbeb35d1dc91371ee5-a40b9478ae1bd073dc32f331038fe6d7.ssl.cf2.rackcdn.com/702808/3/check/tempest-full-train-py3/82516f1/controller/logs/tempest_log.txt09:43
kopecmartinsoniya29: well, yeah, in this particular test would pass anyway , but the problem seems to be that from time to time the backend is faster and the image goes almost directly to ACTIVE which results in no messages with SAVING state and thus the wait condition in the test is never true09:45
*** apetrich has joined #oooq09:47
soniya29kopecmartin: There are messages with 'SAVING' state as we can see in log file, but the wait condition in the test moves too quickly to 'ACTIVE' state.09:50
soniya29kopecmartin: I think we need to think about the testcase again, since the proposed solution is breaking the significance of the testcase somewhere.09:51
kopecmartinsoniya29: agree, let's see what other reviewers think and bring it up in the next qa meeting09:52
chandankumarkopecmartin, soniya29 I would suggest copy the discussion from here and paste on the review itself, it will be easier other reviewers to follow up.09:53
soniya29chandankumar, Done!09:54
soniya29kopecmartin, yeah, we can discuss this topic in QA meeting09:55
*** dtantsur|afk is now known as dtantsur10:06
marioszbr|rover: for rdo-tox-molecule, poking there a bit as it blocks me on https://review.rdoproject.org/r/#/c/2455210:13
marioszbr|rover: currently getting a f28 vm so i can tox molecule there but10:14
marioszbr|rover: wdyt about chandankumar comment, do we need python-devel@ requirements there: https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/tox.ini#L4810:14
marioszbr|rover: otherwise any other suggestions about what ismissing there10:15
marioszbr|rover: (logs here for example http://logs.rdoproject.org/52/24552/2/check/rdo-tox-molecule/895e026/job-output.txt10:15
zbr|rovermarios: sure, the c81 release messed this week.10:18
chandankumarmarios, sorry does the tox-molecule does not got fixed?10:18
*** ratailor has quit IRC10:18
*** ratailor has joined #oooq10:18
zbr|roverout of curiosity what got broken o f28 that we cannot use it anymore?10:18
marioszbr|rover: well it is failing last night for example didn't recheck today https://review.rdoproject.org/r/#/c/24552/10:19
chandankumarmarios, rlandy fixed thatr, https://review.rdoproject.org/r/#/c/24581/10:19
marioschandankumar: ^10:19
marioschandankumar: ah i didn't see that looking10:19
chandankumarmarios, rechecked right now10:19
chandankumarlet's see10:19
marioschandankumar: ack ok thanks for pointer glad i asked before proceeding ;)10:19
chandankumarmarios, :-)10:20
marioschandankumar: i mean this f28 base i launched on rdo cloud didn't have git installed... ;) so i was just starting10:20
zbr|rovermarios: can you try something while i try to make centos-8 working for molecule job? try a newer fedora image for the same job.10:25
marioszbr|rover: but you mean update the nodepool node? or what10:29
zbr|rovermarios: yeah, try to switch the node.10:29
*** jaosorior has quit IRC10:29
zbr|roveror wait, in ~1h i should fix centos job, unless I find another bug, which I doubt as locally works fine.10:30
marioszbr|rover: sure, i was going to say i'd look into it if it turns out https://review.rdoproject.org/r/#/c/24581 doesn't fix it for now10:31
*** ykarel is now known as ykarel|afk10:31
zbr|roverif you are curious, here is the hack i need to apply for us https://github.com/ansible/ansible-zuul-jobs/pull/311/files10:31
mariosack thanks zbr|rover chandankumar10:32
zbr|rovertiming was awful this week, i was already working to move molecule CI to zuul, so it would have run on our platforms.10:35
zbr|roveralso found two major bugs i latest ansible-lint....10:36
zbr|rovermarios: or we can use ubuntu for molecule, like upstream, works fine ;)10:37
*** apetrich has quit IRC10:38
*** apetrich has joined #oooq10:40
zbr|rovermarios: you want fix for rdo-jobs itself or any instance of rdo-tox-molecule?10:43
zbr|roverbecause it is nasty....10:43
*** ratailor has quit IRC10:44
marioszbr|rover: not rdo-jobs but config repo but yeah start with the 'easy one' i guess zbr|rover not sure what to say i don't have much info about it10:45
chandankumarsoniya29, kopecmartin surpatil https://hackmd.io/fIOKlEBHQfeTZjZmrUaEYQ?view#2020-01-17 agenda for today's meeting please add or remove10:46
*** fmount|afk is now known as fmount10:47
marioschandankumar: do you know if tempest_test_blacklist can take .* like neutron_tempest_plugin.*.api ?10:52
marioschandankumar: maybe i'll try it and find out ;)10:52
chandankumarmarios, I think it will work10:52
marioschandankumar: ack thanks lets see10:52
chandankumarmarios, never tried that10:52
zbr|roversorry but I am dropping the hat... we rely on 3 key fixes in zuul-jobs, and ianw seems to work against us.10:52
zbr|roverhttps://review.opendev.org/#/c/690057/10:52
marioschandankumar: sorry for noise i should have just tried it typing before thinking10:52
zbr|roverbit ironic as ianw is redhat, and he came when I mostly convinced the others from infra about the logic.10:58
zbr|roveri guess the workaround is to start to mess our images and add symlink to pip executable... WTH I would say.10:59
*** bhagyashris has joined #oooq11:01
*** soniya29 has quit IRC11:01
chandankumarrelocating to weworks11:04
*** ratailor has joined #oooq11:09
*** bhagyashris has quit IRC11:12
*** epoojad1 has joined #oooq11:14
*** bhagyashris has joined #oooq11:15
jfrancoazbr|rover: hey, are you aware of this issue https://bugs.launchpad.net/tripleo/+bug/1860112 ?11:19
openstackLaunchpad bug 1860112 in tripleo "[Train] standalone-upgrade failing due to ovn_north/south_db_init not starting_" [High,New]11:19
jfrancoazbr|rover: it doesn't let any patch in train to gate11:19
*** epoojad1 has quit IRC11:26
*** soniya29 has joined #oooq11:27
*** surpatil has quit IRC11:33
zbr|rovermy firefox started to frash every few minutes, and when I was finally be able to find their bug, i discover an ugly eality, "Retired" appears near the engineer name that was working on it....11:34
zbr|roverwe al read the news11:34
marios:(11:35
zbr|rovermarios: did you how cool is their bugzilla and the crash reporting? check https://bugzilla.mozilla.org/show_bug.cgi?id=157676711:37
openstackMozilla bug 1576767 in Graphics: Layers "[10.15] Crash in [@ libsystem_kernel.dylib@0x744e] in mozilla::gl::GLContextCGL::SwapBuffers()" [Critical,New] - Assigned to mstange11:37
zbr|roveri did not know that bugzilla can be cool11:38
zbr|roverclick on the crash data section to see the graph11:38
zbr|roverprobably 5% of these crashes are from my machine :D11:38
zbr|rovermarios: got progress with mo' but now fails on Prove that general sudo access is actually revoked.11:43
zbr|roveri am looking at the role and I do not understand why we have to enforce it11:45
zbr|roverhttps://opendev.org/zuul/zuul-jobs/src/branch/master/roles/revoke-sudo/tasks/main.yaml is broken on centos-8 as it fails to remove sudo11:51
zbr|roverin fact it reports success in removing sudo but fails at last task, verification11:52
zbr|roverany ideas?11:52
marioszbr|rover: sorry not sure what you're referring to with 13:43 < zbr|rover> marios: got progress with mo' but now fails on Prove that general sudo access is actually revoked.11:54
marios(unrelated) apparently ' in bash comments isn't appreciated by jinja/yaml/ansible https://review.opendev.org/#/c/701937/8/roles/build-containers/tasks/apply_patch.yaml11:55
mariosnot only linting failed but also the rhel8 job for same reason apparently http://logs.rdoproject.org/37/701937/8/openstack-check/tripleo-build-containers-rhel-8-train-branch/803878f/job-output.txt11:55
jfrancoamarios: hey, do you know if there is any CIX about this https://bugs.launchpad.net/tripleo/+bug/1860112 ? it's breaking the gates https://review.opendev.org/#/c/702594/11:55
openstackLaunchpad bug 1860112 in tripleo "[Train] standalone-upgrade failing due to ovn_north/south_db_init not starting_" [High,New]11:55
mariosjfrancoa: o/ zbr|rover is the one you seek ^11:55
mariosjfrancoa: (but checking)11:56
jfrancoamarios: merci11:56
mariosjfrancoa: it needs tags11:56
mariosjfrancoa: add alert11:56
mariosjfrancoa: it should get created on the cix board then11:57
jfrancoamarios: didn't know what to put in there, so I left it empty11:57
mariosby magic11:57
mariosjfrancoa: k doing11:57
jfrancoamarios: what's the needed tag? so I can add it next time?11:57
mariosjfrancoa: alert should do it i think11:58
mariosweshay_: ^^^ do we need something else for cix cards to be created?11:58
jfrancoamarios: ohh, ok..I get it. thanks a lo!11:58
mariosjfrancoa: i think promotion-blocker also does it but that doesn't apply in this case11:59
*** ykarel|afk is now known as ykarel11:59
mariosjfrancoa: a and critical too i believe11:59
*** sshnaidm|afk is now known as sshnaidm|off12:00
mariosjfrancoa: (the voodoo that does that belongs to weshay_ i don't think i've ever seen it... hence the guessing)12:00
mariosjfrancoa: i mean there is some script that weshay_ has which creates the cix cards with trello api12:00
mariosjfrancoa: so i updated to critical too12:00
jfrancoamarios: I put critical in first place, but I didn't know if that would ring loud alarms..so I left it in high12:00
jfrancoamarios: thank you12:01
mariosnp12:01
mariosjfrancoa: next time harrass the person with |ruck |rover in the name12:01
mariosthat way i can see it and run out for lunch or something ;)12:01
jfrancoamarios: sorry for stealing your time, I appreciate for the help12:02
jfrancoamarios: beer_counter++12:03
mariosjfrancoa: haha np jfrancoa i'm joking12:03
mariosjfrancoa: but zbr|rover that is a gate blocker http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-standalone-upgrade-train12:03
mariosjfrancoa: i thought matbu patch should fix it https://review.opendev.org/#/c/701920/12:05
mariosjfrancoa: yeah didn't merge yet12:05
mariosk12:05
jfrancoamarios: oh..so maybe it's a duplicate what I opened12:07
jfrancoamarios: I'll ping matbu to confirm if it's the same issue..12:07
mariosjfrancoa: ack12:07
*** zbr|rover is now known as zbr|drover12:09
*** ratailor has quit IRC12:09
*** dsneddon has quit IRC12:12
*** rfolco has joined #oooq12:27
*** akahat has joined #oooq12:32
weshay|ruck0/12:34
weshay|ruckjfrancoa, I posted a change https://review.opendev.org/#/c/702932/1/zuul.d/standalone-jobs.yaml12:35
weshay|ruckoof got -212:36
* weshay|ruck looks12:36
weshay|ruckmarios, let's catch up for 512:36
weshay|ruckwhen you have a sec12:36
jfrancoaweshay|ruck: yep, I think matbu's patch should fix it..i'm waiting for his confirmation that my lp is a duplicate12:37
weshay|ruckmarios, 5 min https://meet.google.com/dky-qvpr-sex?authuser=112:38
weshay|ruckmarios, two topics.. that standalone-upgrade jobs and container builds12:39
weshay|ruckjfrancoa, it has a -1 https://review.opendev.org/#/c/701970/12:41
jfrancoaweshay|ruck: this one https://review.opendev.org/#/c/701920/12:41
*** dmellado has quit IRC12:41
jfrancoaweshay|ruck: you can see that in the last execution the standalone-upgrade and standalone-upgrade-train passed12:42
jfrancoaso it should be the fix12:42
mariosweshay|ruck: o/12:43
mariosweshay|ruck: sec plugging in headphones12:43
weshay|ruckjfrancoa, marios hrm.. well do you have any tables or chairs I bring to a chat w/ Alex12:43
weshay|ruckso he can flip them?12:43
weshay|ruckjk12:43
weshay|ruck:)12:43
jfrancoahahaha12:44
*** dmellado has joined #oooq12:44
*** udesale_ has joined #oooq12:45
*** jpena is now known as jpena|lunch12:46
*** marios is now known as marios|call12:48
*** dsneddon has joined #oooq12:48
*** udesale has quit IRC12:48
*** ykarel is now known as ykarel|afk12:50
marios|callcommented at https://review.rdoproject.org/r/#/c/24552/ fixed by https://review.rdoproject.org/r/#/c/24581/12:55
marios|callweshay|ruck: ^12:55
weshay|ruckzbr|drover, hey :) morning.. any updates on getting https://review.rdoproject.org/r/#/c/24552/ rdo-tox working?12:56
*** dsneddon has quit IRC12:56
zbr|droverweshay|ruck: WIP, but is not easy.12:58
*** marios|call is now known as marios12:58
chandankumarzbr|drover, may be make it non voting for sometime?12:58
zbr|droverand not because of molecule, just because centos-8 image is too new and upstream roles are not working with it.12:58
zbr|droverbut i am working on them, but i cannot speedup zuul-roles changes12:59
zbr|droveri think you remember when I said we need to start adding tests for these upstream, ~2 months ago, well we didn't, today we pay the price.12:59
zbr|droverbroken roles: ensure-tox (fixed), install-docker (review), revoke-sudo (wip)13:00
migizbr|drover: are you using python2 on centos-8?13:01
zbr|drovermigi: no13:01
zbr|drovernot even installing it13:01
migizbr|drover: ah because the rdo-tox was trying to build install https://pypi.org/project/subprocess32/13:02
zbr|droverweshay|ruck: we need to merge https://review.opendev.org/#/c/703053/13:04
*** dsneddon has joined #oooq13:06
*** rlandy has joined #oooq13:11
weshay|ruckkopecmartin, https://6a1b272cc9fdc94ecfa2-32020f0f04a5301099a327cbdf93a4db.ssl.cf5.rackcdn.com/701920/1/check/tripleo-ci-centos-7-containers-multinode/8beff75/logs/quickstart_files/log-size.txt13:15
weshay|ruckchandankumar, 3013:18
weshay|ruckhttps://bugs.launchpad.net/tripleo/+bug/185883013:18
openstackLaunchpad bug 1858830 in tripleo "gz upstream logs are no longer viewable, they download only" [Critical,Triaged] - Assigned to Sorin Sbarnea (ssbarnea)13:18
weshay|ruckchandankumar, http://dashboard-ci.tripleo.org/d/cockpit/cockpit?orgId=1&fullscreen&panelId=32213:23
zbr|droverweshay|ruck: good news https://review.rdoproject.org/r/#/c/24584/  PASSED, now we need to merge two upstream patches.13:25
weshay|ruckkopecmartin, https://review.opendev.org/#/c/703038/13:30
*** derekh has quit IRC13:32
chandankumarweshay|ruck, https://review.rdoproject.org/r/#/c/24519/13:38
*** jpena|lunch is now known as jpena13:39
*** epoojad1 has joined #oooq13:41
weshay|ruckjfrancoa, can we get standalone-upgrade running against the tripleo-upgrade repo please?13:42
*** soniya29 has quit IRC13:47
zbr|droverweshay|ruck: marios others interested about fixing rdo-tox-molecule, now I rely on you to review both upstream patches https://review.opendev.org/#/c/703065/13:49
zbr|droveri need a break now, and lunch13:49
*** ykarel|afk is now known as ykarel13:51
weshay|ruckjfrancoa, matbu fyi https://review.opendev.org/70308213:55
jfrancoaweshay|ruck: sure! I though we were already running it...thanks for the patch13:55
weshay|ruckjfrancoa, it was defined.. but not matching any tripleo-upgrade files.. I think13:56
weshay|ruckseems to trigger now appropriately13:56
weshay|ruckrfolco, morning :)13:57
weshay|ruckif marios can hand on for 30-40 min.. I can sync w/ you both for a few.. re: containers build this morning13:57
weshay|ruckif he can't .. you guys should chat w/o me13:58
weshay|ruckrfolco, I have all the playbooks running locally and trying to build images now.. on a centos-8 box but I need ur help I think w/ the registry settings or base image13:58
mariosweshay|ruck: rfolco: o/13:58
rfolcoweshay|ruck, I am creating a new instance, need more disk space14:00
*** derekh has joined #oooq14:02
weshay|ruckzbr|drover, https://meet.google.com/ovb-ozfw-kip?authuser=114:03
*** epoojad1 has quit IRC14:06
*** saneax has quit IRC14:06
weshay|ruckzbr|drover,14:06
weshay|ruckzbr|drover,14:06
*** amoralej is now known as amoralej|lunch14:26
zbr|droverweshay|ruck: i am now back, ok?14:30
weshay|ruckmarios, rfolco ok.. /me ready14:49
weshay|ruckmarios, rfolco did I miss the opportunity?14:49
weshay|ruckzbr|drover, :)14:49
rfolcosttill waiting marios14:49
rfolcoto respond14:50
mariosrfolco: ?14:50
weshay|ruckhello14:50
rfolco:)14:50
zbr|droverweshay|ruck: i added cards.14:50
weshay|ruckhttps://meet.google.com/hgt-iwct-cuz?authuser=114:50
marios15:58 < marios> weshay|ruck: rfolco: o/14:50
mariosrfolco: i didn't see somethign after that ^ what should i respond to14:50
mariosis there an invite /me checks inbox14:50
weshay|ruckrfolco, marios https://meet.google.com/hgt-iwct-cuz?authuser=114:51
weshay|ruckoh14:51
weshay|rucknothing on my cal atm14:51
mariosweshay|ruck: joining now14:52
*** marios is now known as marios|call14:57
*** ratailor has joined #oooq15:04
*** zbr|drover has quit IRC15:08
*** ksambor has quit IRC15:09
*** ratailor_ has joined #oooq15:09
*** ratailor has quit IRC15:11
*** amoralej|lunch is now known as amoralej15:12
*** ratailor_ has quit IRC15:15
*** zbr has joined #oooq15:16
*** zbr is now known as zbr|drover15:16
marios|callweshay|ruck: https://github.com/rdo-infra/review.rdoproject.org-config/blob/a8baf7a199ee484892251daed8eaacb70aee2e8c/zuul.d/tripleoci.yaml#L32915:23
*** ratailor has joined #oooq15:29
*** ratailor has quit IRC15:29
*** udesale_ has quit IRC16:01
*** udesale has joined #oooq16:03
marios|callhttps://review.opendev.org/#/c/701937/9/roles/build-containers/tasks/pre.yaml16:05
marios|callhttps://review.opendev.org/#/c/701937/9/roles/build-containers/tasks/main.yaml16:06
*** udesale has quit IRC16:10
weshay|ruckmarios|call, https://review.opendev.org/#/c/702993/16:15
marios|callack weshay|ruck16:15
*** marios|call is now known as marios16:18
chandankumarweshay|ruck, EmilienM can I create a fs020 job with latest podman and one plain standalone job to run in openstack-regular pipeline?16:20
chandankumarlatest == rpm from libpod master16:21
zbr|droverykarel: does your -1 on https://review.opendev.org/#/c/685689/ still stands?16:27
*** marios is now known as marios|out16:28
weshay|ruckrfolco, heh.. internet went down16:30
ykarelzbr|drover, i think yes, u got my comments?16:30
ykarel6 Dec, too old16:30
zbr|droverykarel: that is why I asked.16:30
rfolcoweshay|ruck, can rejoin after lunch if you like16:31
weshay|ruckrfolco, no worries16:31
weshay|ruckthink we're good.. I may ping from time to time16:31
weshay|ruckrfolco, let's keep finding rpm issues16:31
weshay|ruckand logging them16:31
ykarelzbr|drover, so it's valid, but if u can answer my doubts, i can revisit it16:31
zbr|droverykarel: mainly i no longer care about it, but i want to make a decision: merge or abandon.16:31
ykarelzbr|drover, i would say it's transient issue, but a valid one16:32
chandankumartosky, kopecmartin please have a look https://review.opendev.org/#/c/703038/16:32
ykarelso it worth a fix16:32
*** marios|out has quit IRC16:33
*** udesale has joined #oooq16:37
*** ykarel is now known as ykarel|away16:37
weshay|ruckrfolco, \0/ base is building16:43
weshay|ruckrfolco, btw.. the place to fix issues w/ repos is here:16:46
weshay|ruckhttps://opendev.org/openstack/tripleo-repos16:46
weshay|rucknot in ci16:46
chandankumarweshay|ruck, we are good with nova less stuff pythonconf issues +w thanks to tosky and kopecmartin16:48
weshay|ruckrock on :)16:48
zbr|droverykarel|away: sorry but I do not have time to chaise an ipotetic issue, https://review.opendev.org/#/c/685689/ is fixing an issue, and passing CI tests. is a clear improvement.16:50
zbr|droveri would prefer to workflow it than let it linger even more16:50
chandankumarrlandy, rfolco you used fs override with fs020 jobs? I am going to do more interesting adventures with third party deps, to bring more curse early16:50
rlandychandankumar: ??16:51
rlandywhat curse?16:51
chandankumarcurse == finding issues early16:51
rlandyI override fs020?16:51
chandankumarfrom master third party deps16:51
chandankumarrlandy, yes16:51
chandankumarrlandy, you did?16:52
rlandychandankumar: I'm out of context here, pls link16:52
chandankumarrlandy, want to include this part in fs020 job definition https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/podman.yaml#L5516:53
chandankumari hope it works there16:53
ykarel|awayzbr|drover, not sure u read my comments, passing CI tests can not be a criteria in this case which is a transient issue16:53
chandankumarso that we can find what third party master branch is breaking tripleo in openstack regular pipeline16:53
rlandychandankumar: I'm being an idiot here ... but go ahead and put in a review - then it will make more sense to me16:55
chandankumarrlandy, coming soon16:55
rlandysorry - knee deep in standalone install by hand16:55
rlandyone day - still going16:55
*** dtantsur is now known as dtantsur|afk16:58
zbr|droverweshay|ruck: please takeover conversation on rdo, i am too tired to explain myself.16:59
*** udesale has quit IRC17:00
*** bogdando has quit IRC17:02
weshay|ruckrfolco, https://review.opendev.org/703125 fyi.. ha for centos-817:02
rfolcoweshay|ruck, which makes some sense17:03
rfolcoha, ha repo...17:03
*** jfrancoa has quit IRC17:04
chandankumarweshay|ruck, rfolco rlandy https://review.rdoproject.org/r/#/c/24601/ this is what i was talking, now see the fun17:05
chandankumarmake sense?17:06
*** epoojad1 has joined #oooq17:07
rlandychandankumar: left comment17:08
rlandyare these jobs only run in periodic fashion?17:08
chandankumarrlandy, it will work in check also17:09
rlandychandankumar: ok - just checking your parenting17:09
chandankumarrlandy, for periodic we need to enforce force_periodic: true17:09
chandankumarotherwise not worl17:09
chandankumar*work17:09
chandankumarlet's see where it break17:09
rlandywoohoo ... Deployment successful!17:17
chandankumarsee ya #tripleo-ci people on monday, Have a nice weekend ahead :-)17:17
rlandyfinally a standalone deployment17:17
rlandyby hand17:17
chandankumarrlandy, sweet :-)17:17
rlandychandankumar: bye - have a good weekend17:17
chandankumarrlandy, with two nics?17:17
rlandychandankumar: ack17:17
rlandychandankumar: on rdocloud vm17:18
chandankumarrlandy, awesome17:18
rlandychandankumar: any reviews you want us to watch/merge?17:18
chandankumarrlandy, if it passes https://review.rdoproject.org/r/#/c/24594/ then merge this  https://review.opendev.org/#/c/703014/17:19
chandankumarthat's it17:19
chandankumarrlandy, and then https://review.opendev.org/703038 this, let's make steve happy this weekend17:20
chandankumar^^ one dependson workflowed already17:20
chandankumarthat's it17:20
chandankumarsee ya17:20
*** chandankumar is now known as raukadah17:20
rlandyk - looking17:21
*** tosky has quit IRC17:21
*** holser has quit IRC17:23
*** holser has joined #oooq17:29
*** holser has quit IRC17:29
raukadahweshay|ruck, rlandy rfolco is this known http://logs.rdoproject.org/01/24601/1/check/tripleo-podman-integration-centos-7-fs020-master/1c8cde6/job-output.txt17:30
raukadahweshay|ruck, rlandy "cmd": "os-net-config -c /home/zuul/eth2.conf -v",17:30
raukadahrlandy, https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/playbooks/ovb-setup.yml#L20 something related to ovb17:32
rlandyyeah - looking at that17:32
rlandybeen there for two years17:32
rlandymay be your node config17:33
raukadahmay be never executed17:33
raukadahrlandy, I am inheriting fs020 periodic job nodes17:33
raukadahlet me use forceperiodic there17:33
rlandywon;t matter17:34
rlandylet's run again - just to be sure it's reproducible17:34
weshay|ruck?17:35
raukadahrlandy, updated with force_periodic and see17:35
weshay|ruckthat would be in just about every job17:35
weshay|ruck2020-01-17 17:19:25.567046 | primary |     "cmd": "os-net-config -c /home/zuul/eth2.conf -v",17:35
rlandyhttp://logs.rdoproject.org/39/24339/8/check/periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-master/391285f/job-output.txt seems ok17:35
raukadahI am not sure podman deps secrewing, but podman will not install that time17:36
rlandyraukadah: very possible17:37
raukadahweshay|ruck, rlandy let's hope for a successful fs020 deployment from that so that we donot create cix17:37
rlandyraukadah: go - go ... we will watch it17:37
rlandywe should compare versions of os-net-config17:38
rlandylunch - brb17:38
raukadahsee ya weshay|ruck rlandy :-)17:41
weshay|ruckraukadah++17:41
raukadahweshay|ruck, we need to bring karma bot from fedora17:41
raukadahfedora karma bot adds cookies17:42
*** jpena is now known as jpena|off17:45
*** derekh has quit IRC18:00
*** amoralej is now known as amoralej|off18:12
*** epoojad1 has quit IRC18:28
weshay|ruckrlandy, https://review.opendev.org/#/c/703082/18:44
weshay|ruckrfolco, something is up w/ the centos mirrors18:44
weshay|ruckmaybe everyone is pulling centos8 but we're getting rate limited18:45
rfolcoweshay|ruck, still trying to get to the end of build, skipping failed ones18:46
rlandythink we have a deps clash here18:50
rlandyraukadah: ^^18:50
rlandyneed to find which one18:50
rlandyadditional rpm dracut-config-generic18:50
raukadahrlandy, weshay|ruck based on this https://review.rdoproject.org/r/#/c/24594/ it worked with https://review.opendev.org/#/c/703014/ and with results http://logs.rdoproject.org/94/24594/2/check/periodic-tripleo-ci-centos-7-standalone-train/6aec9f4/logs/stestr_results.html18:50
raukadahplease merge it and relase train so that it leaves on time18:51
raukadahrlandy, interesting18:51
rlandylooking back18:52
raukadahmore fun is about to come18:52
rlandylooking at clashes between podman deps and os-net-config18:54
raukadahrlandy, looking forward for comments, I will be more happy to break tripleo deployment to findout tripleo podman breakge so that we can fix together18:59
weshay|ruckdear lord tripleo-centos-highavailability                                                                                                                                135 kB/s | 7.6 kB     00:0018:59
weshay|ruckError: Failed to synchronize cache for repo 'tripleo-centos-highavailability'18:59
raukadahweshay|ruck, may be https://review.rdoproject.org/etherpad/p/centos8-containers will help19:01
raukadahweshay|ruck, or may be https://hackmd.io/dSagCbocQ4KSVEZR1uf8Tw ykarel|away comments19:01
weshay|ruckthink I just fixed it19:02
raukadahcool sir19:02
raukadahweshay|ruck, centos 8 is seems to be interesting19:03
raukadahmore breakage more fun19:03
weshay|ruckraukadah, you are in the right job19:07
raukadahweshay|ruck, we have zbr|drover like friends with us so no need to worrry :-019:10
rlandyraukadah: just busy connecting standalone and tls deployments19:11
rlandywill look more at podman later19:11
raukadahweshay|ruck, why we use 1cntlr and 1 compute for standalone deployment? does one cntlr does not work?19:12
zbr|droverwe can make a contest, to see who delivers first: working deployments on c8 or working tox jobs on c8 ;)19:13
weshay|ruckraukadah, where do you see that?19:13
weshay|ruckstandalone works fine on one node19:13
weshay|ruckbut what you are saying is ringing a bell19:13
weshay|ruckre: zuul config19:13
weshay|ruckheh.. component in master broke tripleo-repos unit tests19:15
weshay|ruckthe names of repos19:15
raukadahweshay|ruck, http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-standalone-master/f404370/job-output.txt and https://github.com/openstack/tripleo-ci/blob/master/toci-quickstart/config/testenv/multinode.yml19:17
raukadahweshay|ruck, I need to look how this multinode works with standalone may be food for next day19:17
weshay|ruckraukadah, iirc.. we use the multinode node set but pull one node..19:18
raukadahweshay|ruck, does tripleo repos got support for centos 8? I forgot to mention to marios and rfolco19:18
weshay|ruckthis was to keep the extra networking in place iirc19:19
raukadahweshay|ruck, does the same config available in quickstart node config?19:19
weshay|ruckraukadah, the qs nodes are already on the same network.. so it's not needed and it's a diff path19:20
weshay|ruckAND19:20
weshay|ruckto further complicate it.. the standalone deployment does not work.. w/ quickstart.sh19:20
weshay|ruckbut I think I told you that already19:21
weshay|ruckwe can get it to work.. I have.. but patches never got +2'd19:21
raukadahweshay|ruck, yes but needs fixes19:21
raukadahweshay|ruck, patch link19:21
weshay|ruckrfolco, ok.. I have ops tools and ha repos in my latest patches19:21
weshay|ruckalthough tripleo-repos installs from pip and not src19:22
weshay|ruckso that could be an issue19:22
weshay|ruckraukadah, you want my ancient patches?19:22
rfolcoops tools from where19:22
weshay|ruck719:22
rfolcok19:22
raukadahweshay|ruck, we can update that ancient patch19:22
weshay|ruckoh lord19:22
rfolcoand ha is just a matter of enabling its repo19:22
weshay|ruckthis is not a good use of time19:22
weshay|ruckatm19:22
weshay|ruckimho19:22
weshay|ruckmaybe when we're together19:23
raukadahwe use gerrit, everyone has power to make it working19:23
weshay|ruckwe can knock it out19:23
weshay|ruckoh boy19:23
weshay|ruckit's going to take me a while to find those19:23
raukadahnothing is ancient unless we make it present weshay|ruck19:23
weshay|ruckraukadah, is a robot19:23
weshay|ruckraukadah, what is your purpose19:24
weshay|ruckraukadah, mr robot..19:24
weshay|ruckto bring up a standalone?19:24
raukadahhehe19:24
raukadahweshay|ruck, yes19:24
raukadahweshay|ruck, just one controller and run scenario 00019:24
weshay|ruckraukadah, https://gitlab.cee.redhat.com/whayutin/ansible-kvm-vm19:24
raukadahtime to sleep, need to rome somewhere tomorrow19:25
raukadahwill look into that19:25
*** tesseract has quit IRC19:32
rfolcoretesting w/ ... yum-config-manager --enable "HighAvailability"19:39
*** tosky has joined #oooq19:41
weshay|ruckSO SLOW19:51
weshay|ruckstupid centos19:51
*** openstackstatus has joined #oooq20:00
*** ChanServ sets mode: +v openstackstatus20:00
*** jtomasek has quit IRC20:03
weshay|ruckrfolco, confirmed.. building containers at home brings down my home network20:20
*** rlandy has quit IRC21:36

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!