Thursday, 2020-07-30

*** rfolco has quit IRC00:29
*** ykarel has joined #oooq01:50
*** apetrich has quit IRC02:14
*** ykarel has quit IRC02:18
*** sanjayu__ has joined #oooq02:22
*** Goneri has quit IRC02:46
*** ratailor has joined #oooq05:11
*** udesale has joined #oooq05:13
*** chandankumar is now known as chkumar|ruck05:37
*** ykarel has joined #oooq05:38
*** ysandeep|away is now known as ysandeep05:51
*** marios has joined #oooq06:13
*** marios is now known as marios|ruck06:13
*** marios|ruck is now known as marios|rover06:13
marios|roverchkumar|ruck: o/06:13
*** chkumar|ruck is now known as chkumar|rover06:13
marios|roverchkumar|ruck: let's sync in a bit?06:14
marios|roverchkumar|rover: heh i just changed my name after i saw yours06:14
marios|roverchkumar|rover: we can do half each swap after 1.5 weeks?06:14
chkumar|rovermarios|rover: let's sync06:14
marios|roverchkumar|rover: want to start as ruck or rover06:14
marios|roverchkumar|rover: gimme few mins06:14
marios|roverchkumar|rover: just getting setup06:14
chkumar|rovermarios|rover: sure, let me know when ready06:14
marios|roverchkumar|rover: half passed ok?06:14
marios|roverchkumar|rover: 15 mins06:14
chkumar|rovermarios|rover: yes works for me06:14
marios|roverzbr: around?06:14
*** akahat is now known as akahat|PTO06:30
marios|roverchkumar|rover: https://meet.google.com/wzo-ipzk-yaj whenever you're ready06:30
*** tosky has joined #oooq06:32
*** marios|rover is now known as marios|ruck06:34
marios|ruckysandeep: zbr: around?06:35
ysandeepmarios|ruck, o/ Hey06:36
marios|ruckysandeep: are you available to join us for quick sync please?06:36
ysandeepmarios|ruck, yes but I also see wes have set a meeting for RR sync06:37
marios|ruckysandeep: yeah but its in the afternoon06:37
marios|ruckysandeep: me and chkumar|rover are doing a quick sync now06:37
marios|ruckysandeep: especially wanted to know if there are any bugs against the blocked promotions06:37
ysandeepmarios|ruck, sure i can join06:37
marios|ruckysandeep: like master is 1 week old06:37
chkumar|rovermarios|ruck: https://bugs.launchpad.net/tripleo/+bug/188560206:38
openstackLaunchpad bug 1885602 in tripleo "Octavia component: failing tempest, Details: {'faultcode': 'Client', 'faultstring': 'Policy does not allow this request to be performed.'," [Critical,Fix released] - Assigned to Brent Eagles (beagles)06:38
marios|ruckchkumar|rover: yeah it is 1 month old though06:39
marios|ruckysandeep: 09:30 < marios|rover> chkumar|rover: https://meet.google.com/wzo-ipzk-yaj whenever you're ready06:39
*** amoralej|off is now known as amoralej06:55
chkumar|rovermarios|ruck: https://hackmd.io/QnprH9-yRTi6uWlEfaahoQ?view under on-going issues, can we keep the filed bug or issues release wise ?07:04
marios|ruckchkumar|rover: sure do whatever you like07:05
marios|ruckchkumar|rover: i am planning on using the 'today'/'yesterday' system07:05
chkumar|rovermarios|ruck: that is also fine07:05
marios|ruckchkumar|rover: otherwise i find it impossible to read the hackmd07:05
*** ysandeep is now known as ysandeep|lunch07:08
*** bhagyashris is now known as bhagyashris|lunc07:28
*** pojadhav is now known as pojadhav|lunch07:37
*** ysandeep|lunch is now known as ysandeep07:46
*** bogdando has joined #oooq07:50
*** apetrich has joined #oooq07:50
*** jbadiapa has joined #oooq07:55
*** jpena|off is now known as jpena07:56
marios|ruckchkumar|rover: can you get onto the promoters?07:59
marios|ruckchkumar|rover: i want to check the current status of the criteria07:59
marios|ruckchkumar|rover: e.g. in logs says missing jobs [u'periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master07:59
marios|ruckchkumar|rover: but https://github.com/rdo-infra/ci-config/blob/722d298ca4baee00f79ad91968d9fd3ff801fbb6/ci-scripts/dlrnapi_promoter/config/CentOS-8/master.ini#L4007:59
marios|ruckchkumar|rover: it isn't in the criteria ^^^07:59
chkumar|rovermarios|ruck: does tmate still active?08:00
marios|ruckchkumar|rover: no idea08:00
chkumar|roverysandeep: ^^08:00
marios|ruckchkumar|rover: checking08:00
marios|ruckchkumar|rover: no08:00
marios|ruckchkumar|rover: we need access anyway08:00
chkumar|rovermarios|ruck: yes08:00
marios|ruckchkumar|rover: so right now can't do much about that08:00
chkumar|roveryup08:01
marios|ruckchkumar|rover: but this is a big mess wrt manual changes on there08:01
*** ykarel_ has joined #oooq08:01
marios|ruckchkumar|rover: especially the criteria08:01
chkumar|roveryup08:01
ysandeepchkumar|rover, tmux not active08:03
*** ykarel has quit IRC08:03
*** ykarel_ is now known as ykarel08:13
marios|ruckchkumar|rover: fyi new bug https://bugs.launchpad.net/tripleo/+bug/1889524 baremetal component fs1 ironic issue08:29
openstackLaunchpad bug 1889524 in tripleo "periodic centos8 ovb featureset 1 baremetal master fails ironic unexpected keyword argument 'hash_function " [Critical,Triaged]08:29
chkumar|rovermarios|ruck: adding to my queue08:34
*** derekh has joined #oooq08:39
chkumar|rovermarios|ruck: we need common component promotion to tripleo-ci-testing will fix the above issue08:44
ysandeeppojadhav|lunch, hey o/ , added a comment here https://review.opendev.org/#/c/742879/1/zuul.d/layout.yaml , I think think some of update/upgrade jobs here will trigger on train branch..08:47
ysandeepI  think some of update/upgrade jobs here will **not** trigger on train branch..08:48
marios|ruckchkumar|rover: looking08:49
marios|ruckchkumar|rover: network component is in pretty bad shape- 2 weeks old now no promotion... filed a new one for that tempest issue https://bugs.launchpad.net/tripleo/+bug/188952908:50
openstackLaunchpad bug 1889529 in tripleo "periodic centos8 scenario10 network component standalone master timeout tempest conflicting state" [Critical,Triaged]08:50
marios|ruckchkumar|rover: nice quick find :) https://bugs.launchpad.net/tripleo/+bug/1889524/comments/108:51
openstackLaunchpad bug 1889524 in tripleo "periodic centos8 ovb featureset 1 baremetal master fails ironic unexpected keyword argument 'hash_function " [Critical,Triaged] - Assigned to chandan kumar (chkumar246)08:51
marios|ruckchkumar|rover: well tripleo component looks pretty green so that's good for ^08:52
marios|ruckchkumar|rover: hmm but that patch merged 9 days ago08:52
marios|ruckchkumar|rover: and there have been promotions08:52
marios|ruckfor tripleo component08:52
marios|ruckchkumar|rover: ah *common* not tripleo08:53
chkumar|rovermarios|ruck: yes08:53
marios|ruckchkumar|rover: well the latest fail there is one-off so didn't file a bug for it yet https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-scenario001-standalone-common-master08:53
marios|ruckchkumar|rover: but also common has promoted yesterday/27th etc08:54
marios|ruckchkumar|rover: will comment on bug08:54
chkumar|rovermarios|ruck: sorry, python3-tooz is available in tripleo-ci-testing repo https://trunk.rdoproject.org/centos8-master/component/common/tripleo-ci-testing/08:57
chkumar|roverwe need master promotion to clear that08:57
arxcruzchkumar|rover: marios|ruck is this a known issue https://33b99a016672983cc6e0-f789711051b6c1b650cb1c234d7d09c0.ssl.cf5.rackcdn.com/743721/3/check/tripleo-ci-centos-7-containers-multinode-train/5401e36/job-output.txt ?09:00
marios|ruckarxcruz: yes09:01
marios|ruckhttps://bugs.launchpad.net/tripleo/+bug/1889357 arxcruz09:01
openstackLaunchpad bug 1889357 in tripleo "Centos7 Check/Gate jobs failing with UnicodeDecodeError: 'ascii' codec can't decode byte 0xc5 in position 2: ordinal not in range(128)" [Critical,In progress] - Assigned to wes hayutin (weshayutin)09:01
chkumar|roverarxcruz: it got fixed by https://review.opendev.org/#/c/743691/09:01
arxcruzchkumar|rover: ty09:02
chkumar|roveryou can safely recheck your patches09:02
marios|ruckarxcruz: you're welcome09:02
marios|ruckarxcruz: invoice in the post09:02
*** dtantsur|afk is now known as dtantsur09:03
arxcruzmarios|ruck: i'll pay in beers :)09:03
chkumar|rovermarios|ruck: let me sync all the promoting criteria in ci-config from promoter missing jobs09:04
marios|ruckchkumar|rover: ack09:04
*** jfrancoa has joined #oooq09:06
*** ysandeep is now known as ysandeep|afk09:13
holsermarios|ruck sshnaidm|afk ykarel can yoiu merge https://review.rdoproject.org/r/#/c/28779/09:17
holserI need it to debug one problem on ussuri09:18
chkumar|rovermarios|ruck: https://bugs.launchpad.net/tripleo/+bug/1889529 is a duplicate of https://bugs.launchpad.net/tripleo/+bug/188560209:18
openstackLaunchpad bug 1889529 in tripleo "periodic centos8 scenario10 network component standalone master timeout tempest conflicting state" [Critical,Triaged]09:18
openstackLaunchpad bug 1885602 in tripleo "Octavia component: failing tempest, Details: {'faultcode': 'Client', 'faultstring': 'Policy does not allow this request to be performed.'," [Critical,Fix released] - Assigned to Brent Eagles (beagles)09:18
chkumar|rovermarios|ruck: sorry it is a different error09:19
sshnaidm|afkholser, done09:20
*** sshnaidm|afk is now known as sshnaidm09:20
ykarelholser, btw i tihnk u can create the branches directly in reproducer gerrit to test09:21
ykareli had used that in past09:21
holserI can hack local copy09:21
holserthat09:21
holsers correct09:21
ykarelholser, btw which job u trying to reproduce?09:22
ykarelthere was a bug related to dlrn_hash_tag, u might hit in some job09:23
holserykarel https://bugs.launchpad.net/tripleo/+bug/188841109:23
openstackLaunchpad bug 1888411 in tripleo "ussuri centos8 undercloud upgrades job failing DBConnectionError - mysql" [Critical,Triaged] - Assigned to Sergii Golovatiuk (sgolovatiuk)09:23
holserykarel in current case - https://review.opendev.org/#/c/739457/1309:23
ykarelholser, ack this don't have that issue09:23
odyssey4memorning arxcruz - do we need to port https://review.opendev.org/#/c/743573/ back to some stable branches, or is oooq using the master branch?09:23
holserykarel https://zuul.opendev.org/t/openstack/build/56202b8f89e341cb97ff34584e9496b109:24
holserodyssey4me oooq is branchless09:24
arxcruzodyssey4me: using master branch09:24
odyssey4meholser: yep, I'm aware of that - but my concern was whether it uses stable branches from other roles09:24
holserAhhh09:25
odyssey4mearxcruz: ok cool, thanks for confirming - hopefully that solves the last issue :)09:25
marios|ruckchkumar|rover: yes there are two that i thought were related https://bugs.launchpad.net/tripleo/+bug/1887790 https://bugs.launchpad.net/tripleo/+bug/1885602 Policy does not allow this request to be performed09:33
openstackLaunchpad bug 1885602 in tripleo "duplicate for #1887790 Octavia component: failing tempest, Details: {'faultcode': 'Client', 'faultstring': 'Policy does not allow this request to be performed.'," [Critical,Fix released] - Assigned to Brent Eagles (beagles)09:33
openstackLaunchpad bug 1885602 in tripleo "Octavia component: failing tempest, Details: {'faultcode': 'Client', 'faultstring': 'Policy does not allow this request to be performed.'," [Critical,Fix released] - Assigned to Brent Eagles (beagles)09:33
marios|ruckchkumar|rover: but i think they are different (actually they are duplicates of each other but different to the one i filed earlier)09:33
*** bhagyashris|lunc is now known as bhagyashris09:37
*** ysandeep|afk is now known as ysandeep09:39
marios|ruckchkumar|rover: should i review or you working there https://review.rdoproject.org/r/#/c/28624/09:43
chkumar|rovermarios|ruck: yes please review09:47
ysandeeppanda, hey o/ Can you please share the tar - as we discussed yesterday.09:50
jfrancoachkumar|rover: hey, have you seen (or are you aware of) this failure in (stable/train) CI jobs: http://pastebin.test.redhat.com/889107 ?09:52
chkumar|roverjfrancoa: yes it got fixed now, if it is coming on centos-7 based job09:53
chkumar|roveryou can safely recheck09:53
marios|ruckchkumar|rover: is that right? https://review.rdoproject.org/r/#/c/28624/34/ci-scripts/dlrnapi_promoter/stage_containers.py09:53
jfrancoachkumar|rover: cool, thanks!09:53
marios|ruckchkumar|rover: line 21909:54
chkumar|rovermarios|ruck: yes, that is the correct format09:54
marios|ruckchkumar|rover: are we writing the file twice or am i reading it wrong09:54
chkumar|rovermarios|ruck: sorry I need to use a different object09:54
marios|ruckchkumar|rover: so -1 is corrent?09:55
marios|ruckcorrect?09:55
chkumar|rovermarios|ruck: yes09:55
chkumar|rovermarios|ruck: I got the solution09:55
marios|ruckchkumar|rover: k thanks i was questioning my sanity :D09:55
*** dtantsur is now known as dtantsur|brb10:23
chkumar|rovermarios|ruck: for ussuri promoter criteria config, it is ok10:31
marios|ruckchkumar|rover: you mean you got on the promoters?10:36
marios|ruckchkumar|rover: how did you check we can't get on them10:36
chkumar|rovermarios|ruck: I am checking from the missing jobs from the promoter logs10:36
marios|ruckchkumar|rover: but missing jobs are already in the criteria (at least in the git repo) but the problem was we don't know what is going on in the promoter themselves10:37
marios|ruckchkumar|rover: so you're trying to match what is missing with the git repo i.e. make it the same?10:37
marios|ruckchkumar|rover: k commented add fs20 too then? https://review.rdoproject.org/r/#/c/28785/10:39
chkumar|rovermarios|ruck: ok, sure10:40
chkumar|rovermarios|ruck: missing job is from criteria defined in the promoter, that is what I am trying to match with CI config//criteria.10:42
marios|ruckchkumar|rover: ack yeah got it now.. you are trying to make the repo same as what they manually changed in the promoters, which shows up in missing jobs10:44
*** ysandeep is now known as ysandeep|adk11:02
*** ysandeep|adk is now known as ysandeep|afk11:02
*** sshnaidm_ has joined #oooq11:27
*** sshnaidm has quit IRC11:27
*** jpena is now known as jpena|lunch11:29
*** sshnaidm_ is now known as sshnaidm11:30
arxcruzmarios|ruck: chkumar|rover ykarel https://review.opendev.org/#/c/743721/11:33
arxcruzthis is a promotion blocker11:34
arxcruzmarios|ruck: let me know if you are satisfied with my comments there11:34
*** ysandeep|afk is now known as ysandeep11:36
marios|ruckarxcruz: see comment https://review.opendev.org/#/c/743721/3/playbooks/tempest.yml@2811:37
*** ykarel has quit IRC11:38
*** ykarel has joined #oooq11:39
arxcruzmarios|ruck: oh, sorry, i missunderstood your question, replied there :)11:40
marios|ruckarxcruz: thanks revoted11:42
weshay|ruckmarios|ruck, chkumar|rover aye.. wait for the sync re: promotions11:51
marios|ruckweshay|ruck: ack11:51
*** Tengu has quit IRC11:53
*** udesale_ has joined #oooq11:54
*** Tengu has joined #oooq11:55
arxcruzmarios|ruck: thanks, I can rest in peace now, this was hunting me in my nightmares11:56
marios|ruck:)11:57
*** udesale has quit IRC11:57
weshay|ruckmarios|ruck, chkumar|rover https://review.rdoproject.org/zuul/buildset/ee9b1bac38af4148a704c018e6572dab looks pretty good11:57
weshay|ruckchkumar|rover, this again .. we've had bugs on NetSecGroup previously.. maybe we reopen and skip https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-full-tempest-scenario-master/883e204/logs/undercloud/var/log/tempest/stestr_results.html.gz11:58
* chkumar|rover checks11:59
marios|ruckweshay|ruck: chkumar|rover: same on fs 20 https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-ovb-1ctlr_2comp-featureset020-master/2dc0d42/logs/undercloud/var/log/tempest/stestr_results.html.gz12:01
marios|ruckand fs20 2nd time failed today... apparently it is in criteria (not in the repo, but on the promoter itself looks like)12:01
marios|ruckweshay|ruck: chkumar|rover: filing bug12:02
chkumar|roverok12:02
*** rfolco has joined #oooq12:02
marios|ruckweshay|ruck: chkumar|rover: might be same as https://bugs.launchpad.net/tripleo/+bug/1889529 ?12:04
openstackLaunchpad bug 1889529 in tripleo "periodic centos8 scenario10 network component standalone master timeout tempest conflicting state" [Critical,Triaged]12:04
marios|rucktempest.lib.exceptions.Conflict: Conflict with state of target resource12:04
marios|ruckDetails: {'type': 'IpAddressGenerationFailure', 'message': 'No more IP addresses available on network 2309d220-59b5-445f-8157-ab962046518b.', 'detail': ''}12:04
marios|ruckchkumar|rover: will file it anyway we mark later if so12:04
*** amoralej is now known as amoralej|lunch12:05
marios|ruckchkumar|rover: weshay|ruck: https://bugs.launchpad.net/tripleo/+bug/188955312:08
openstackLaunchpad bug 1889553 in tripleo "centos8 periodic master jobs failing tempest 'no more ip addresses' " [Critical,Triaged]12:08
chkumar|roverok12:08
weshay|ruckarxcruz, ^ was working that issue12:09
arxcruzweshay|ruck: marios|ruck the original bug is this https://bugs.launchpad.net/tripleo/+bug/188851112:12
openstackLaunchpad bug 1888511 in tripleo "Some tempest tests are failing with floating ip quota" [Undecided,Triaged]12:12
arxcruzweshay|ruck: as I asked, need someone from network checking that, it's well explained on the bug12:13
arxcruzweshay|ruck: http://eavesdrop.openstack.org/irclogs/%23oooq/%23oooq.2020-07-22.log.html#t2020-07-22T13:30:0012:14
marios|ruckweshay|ruck: arxcruz: chkumar|rover: marked duplicate for now12:15
chkumar|roverok thanks!12:20
*** jmasud has quit IRC12:21
*** derekh has quit IRC12:23
marios|rucke12:29
marios|ruckweshay|ruck: chkumar|rover: no meet on the invite https://meet.google.com/ubw-gphq-hio12:30
ysandeepweshay|ruck, gmeet link for RR sync12:30
ysandeepMissing in calendar12:30
weshay|ruckmarios|ruck, ysandeep chkumar|rover zbr https://meet.google.com/yed-qkfj-hjm12:31
marios|ruckweshay|ruck: ok, joining yours then12:31
*** jpena|lunch is now known as jpena12:32
weshay|ruckhttps://hackmd.io/ermQSlQ-Q-mDtZkNN2oihQ12:39
weshay|ruckmarios|ruck, chkumar|rover http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2020-07-28.log.html#t2020-07-28T16:12:4012:39
weshay|ruckhttp://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2020-07-29.log.html#t2020-07-29T18:16:3612:40
marios|ruckhttps://bugs.launchpad.net/tripleo/+bug/188952912:43
openstackLaunchpad bug 1889529 in tripleo "periodic centos8 scenario10 network component standalone master timeout tempest conflicting state" [Critical,Triaged]12:43
marios|ruckweshay|ruck: chkumar|rover: ^12:43
bhagyashrisysandeep, what do you think if we keep upgrade job as is, i mean to say keep running upgrade jobs on c7 just for coverage because right now we dont have (c8 train upgrade jobs) --> https://review.opendev.org/#/c/742879/12:48
ysandeepI agree to keep c7 upgrade job, lets also discuss with others in team mtg12:49
*** dtantsur|brb is now known as dtantsur12:53
chkumar|rovermarios|ruck: I am adding the tests to skip list12:55
weshay|ruckmarios|ruck, http://promoter.rdoproject.org/CURRENT_CRITERIA/13:00
rfolcoarxcruz, rfolco, zbr, sshnaidm, rlandy, marios, ysandeep, bhagyashris, soniya29, pojadhav, akahat, weshay, chandankumar13:00
rfolcoping planning13:01
rfolcohttps://meet.google.com/tbr-rgjz-cjc?authuser=113:01
rfolcohttps://hackmd.io/IhMCTNMBSF6xtqiEd9Z0Kw#2020-07-09-Unified-Sprint-31-Planning13:01
rfolcoarxcruz, rfolco, zbr, sshnaidm, rlandy, marios, ysandeep, bhagyashris, soniya29, pojadhav, akahat, weshay, chandankuma13:02
rfolcolast call13:02
rfolcowe are departing13:02
weshay|ruckpojadhav|lunch, mtg13:03
weshay|ruckzbr, mtg13:03
weshay|ruckpojadhav|lunch, unping :)13:04
weshay|ruckpojadhav|lunch, take as much time as you need13:04
*** amoralej|lunch is now known as amoralej13:05
*** ratailor has quit IRC13:07
*** sshnaidm is now known as sshnaidm|mtg13:08
*** derekh has joined #oooq13:11
chkumar|rovermarios|ruck: weshay|ruck arxcruz https://review.opendev.org/#/c/743968/13:16
chkumar|roverskop list13:16
chkumar|rover*skip list13:17
weshay|ruckbhagyashris, https://review.rdoproject.org/r/#/c/28614/13:34
chkumar|roverkopecmartin: https://review.opendev.org/#/c/743968/ quick merge13:35
*** TrevorV has joined #oooq13:38
marios|ruck chkumar|rover: i commented i see different tests from today13:40
marios|ruckchkumar|rover: but kopecmartin hit +A13:40
marios|ruckchkumar|rover: https://review.opendev.org/#/c/743968/1/roles/validate-tempest/vars/tempest_skip.yml13:40
kopecmartinmarios|ruck: i took back +w13:41
chkumar|rovermarios|ruck: I have taken it from fs02013:42
chkumar|rovermarios|ruck: let me go back and edit13:42
marios|ruckchkumar|rover: ack yeah they are differetn... same trace but different set of tests?13:48
marios|ruckthanks kopecmartin13:49
kopecmartinmarios|ruck: no, thank you!13:52
*** Goneri has joined #oooq13:52
chkumar|roverarxcruz: marios|ruck kopecmartin https://review.opendev.org/743968 now good to go13:54
arxcruzchkumar|rover: kopecmartin in the future, we need to add a validation if the test is duplicated on the skiplist14:00
kopecmartinarxcruz: +114:02
weshay|ruckrfolco, akahat, arxcruz bhagyashris, 50% sandeep, sorin, marios|ruck14:12
weshay|ruckrfolco, ^14:13
*** chem has joined #oooq14:13
*** bogdando has quit IRC14:20
chkumar|roverweshay|ruck: https://review.opendev.org/#/c/743968/ +w14:31
*** ykarel is now known as ykarel|away14:32
weshay|ruckchkumar|rover++14:33
*** bhagyashris is now known as bhagyashris|away14:47
ysandeepbhagyashris On https://review.opendev.org/#/c/742587 - do we really need Depends-On: https://review.opendev.org/#/c/743455/, Depends-On: https://review.opendev.org/#/c/743959/.. I think we should do opposite - first remove from layout14:47
ysandeepbhagyashris|away, ^^14:47
ysandeepbhagyashris|away, will catch up with you tommorow, good night o/14:48
weshay|ruckrfolco, ok.. the board should be read-only for everyone except you and me14:49
rfolcoweshay|ruck, you made it?14:49
weshay|ruckyup14:50
weshay|ruckrfolco, haven't tested14:50
rfolcoweshay|ruck, thanks14:51
marios|ruckweshay|ruck: you starting a meet?14:59
weshay|ruckmarios|ruck, pm15:00
marios|ruckack15:00
*** ykarel|away has quit IRC15:02
*** panda has quit IRC15:21
ysandeepweshay|ruck, when free - do you know any reason we are still running c7 jobs against puppet-tripleo master - https://github.com/openstack/puppet-tripleo/blob/master/zuul.d/layout.yaml15:25
weshay|ruckysandeep, this job? https://github.com/openstack/puppet-tripleo/blob/master/zuul.d/layout.yaml#L1115:27
ysandeepyes15:27
ysandeepi noticed this when porting things from c7 to c8 for train15:28
weshay|ruckysandeep, ya.. let's update... it doesn't run often https://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-scenario007-multinode-oooq-container&project=openstack%2Fpuppet-tripleo15:28
ysandeepweshay|ruck, on it15:28
weshay|ruckysandeep, thanks!  and the coverage is pretty solid.. looking at https://review.opendev.org/#/c/731816/15:29
weshay|ruckysandeep, just an oversight.. thanks for catching it15:29
ysandeepweshay|ruck also for train - as here we only have 1 job tripleo-ci-centos-7-scenario007-multinode-oooq-container in puppet tripleo(train branch) - we agreed to not remove this job for c7 coverage.. As its a only jobs here What to do here 1) Do nothing here 2) port this alone c7 job to c8 3) add c8 job in addition?15:29
ysandeepfor ussuri and master - I am clear on porting them to c8, as we don't need c7 coverage there15:30
weshay|ruckysandeep++15:32
weshay|ruckchkumar|rover, arxcruz nice job on the jobs for the skip list15:33
weshay|ruckMERGE FAST15:33
weshay|ruck!15:33
arxcruzyup, 5-7 minutes15:34
weshay|ruckarxcruz, so did my question about the functional tests make sense15:36
weshay|ruckfrom yesterday15:36
arxcruzso, you want to deploy ooo and run the functional tests from openstackclient for example right ?15:36
weshay|ruckya.. more wondering about it.. then asking for anything15:36
arxcruzchkumar|rover: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_bb2/740662/8/check/tripleo-ci-centos-7-containers-multinode-queens/bb2cd48/job-output.txt it's failing on network geneve, i remember you were the one who make the settings15:37
arxcruzweshay|ruck: did we have a case that it breaks ooo ?15:37
arxcruzi need to check what those tests do15:37
weshay|ruckarxcruz, re: functional tests.. no.. just fielding some questins from other dfg's15:38
weshay|ruckarxcruz, I wonder if that functional suite would be interesting to run along side the ansible module ci sshnaidm|mtg15:38
weshay|ruckarxcruz, but here's my specific question...15:39
*** sshnaidm|mtg is now known as sshnaidm15:39
arxcruzweshay|ruck: let me check the code first, if it uses the restapi, it's the same as tempest15:39
arxcruzso i don't see a reason to run it15:39
weshay|ruckarxcruz, running tox from the src from the python-openstackclient rpm15:39
weshay|ruckarxcruz, doesn't tempest use it's own client?15:39
arxcruzweshay|ruck: yes, but at the end, it calls the restapi15:40
weshay|ruckarxcruz, right.. so server side errors would be found, but not client15:41
arxcruzthe client is tested in tempest15:42
arxcruzi mean, the tempest client15:42
chkumar|roverarxcruz:  - tripleo-ci-centos-7-containers-multinode-queens https://zuul.opendev.org/t/openstack/build/9a9425546717400280c7e50d598edef9 : SUCCESS in 2h 04m 43s is apssing na15:44
chkumar|rover?15:44
*** artom has joined #oooq15:44
weshay|ruckarxcruz, artom and I were discussing it yesterday15:44
weshay|ruckartom, may have examples of where things break but could be caught w/ the functional tests15:45
weshay|ruckartom, and you are saying the functional tests would fail where tempest would not fail right?15:45
weshay|rucklike in just the client code15:45
artomweshay|ruck, well, tempest doesn't make sense in the context of osc15:45
artomTempest does its own requests with python requests or whatever, completely independently of any clients.15:46
weshay|ruckaye15:46
chkumar|roverarxcruz: got it15:46
arxcruzyup, tempest uses restapi15:46
chkumar|roverarxcruz: let me get a the solution15:46
arxcruzchkumar|rover: i think we should have flat for queens ?15:46
artomSo if we want to have confidence that osc actually works against real openstack APIs, functional testing is the way to do15:46
artomarxcruz, in the upstream gate they have devstack functional jobs that do just that - deploy a devstack cloud and run osc against it15:47
arxcruzok15:47
artomarxcruz, in OSP to my knowledge we have nothing of the sort15:47
artomBut... Michal is on PTO, I'd like to confirm with him first15:48
arxcruzartom: the api tempest uses, is the api available in the $project15:48
artomarxcruz, well, tempest only tests Nova, Neutron and Cinder (I think?)15:48
artomMostly Nova15:48
weshay|ruckchkumar|rover, marios|ruck fyi.. ussuri tried to promote and failed15:48
artomOther projects have their own tempest plugins15:48
arxcruzartom: we have tempest tests for all the projects15:48
weshay|ruckI'll watch the rerun15:48
arxcruzwith plugins15:49
marios|ruckweshay|ruck: thanks15:49
* marios|ruck getting ready to go 15:49
artomarxcruz, right, but via plugins.15:49
chkumar|roverarxcruz: https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/general_config/featureset030.yml#L11415:49
arxcruzartom: yes15:49
artomarxcruz, and tempest tests the server-side APIs15:49
chkumar|roverarxcruz: put all the stuff of fs030 for stein and queens15:49
chkumar|roverit will work15:49
artomarxcruz, osc functional testing is to make sure osc does requests correctly, and handles responses correctly15:49
chkumar|roverovn works from train onwards15:49
chkumar|roverearlier it was ovs only15:50
chkumar|roverarxcruz: add those conditional in tempest.yaml playbook15:50
arxcruzartom: okay, i need to take a look in osc15:50
arxcruzchkumar|rover: yup15:50
arxcruzthanks15:50
*** marios|ruck has quit IRC15:52
artomarxcruz, the code exists, the jobs exist in their devstack form upstream15:52
artomarxcruz, the gap is that no one actually owns osc within RH, so if we do backports, our confidence level is diminished15:52
artomBecause of that lack of functional testing15:52
arxcruzartom: i don't see a problem for that15:52
weshay|ruckchkumar|rover, need review on https://review.opendev.org/#/c/744006/15:52
weshay|ruckeasy one15:52
arxcruzi mean, doesn't hurt tot est15:52
arxcruzto test*15:52
artomarxcruz, you don't see a problem with testing, or with not testing?15:53
weshay|ruckartom, and I'm fairly certain migi has this already15:53
weshay|ruckso when he's back from pto.. perhaps we can ask15:53
artomweshay|ruck, yeah, we (Compute) do a tech call on Monday, he'll be back and I'll bring this up then15:53
weshay|ruck+115:53
weshay|ruckartom, if he has internal zuul job.. which I'm not sure if still does.. we can just run it clients component15:54
weshay|ruckif not we'll work w/ him on building it15:54
weshay|ruckpossibly15:54
weshay|ruck :)15:54
artomI do like your strategically vague commitments ;)15:54
weshay|ruckbut should be easy.. so why not15:54
weshay|ruckartom, we have a lot of jobs to watch15:55
arxcruzartom: i don't see a problem test it15:55
artomweshay|ruck, yep, totally get it, it was tongue in cheek15:55
weshay|ruckaye.. np15:55
artomFew people will just welcome more work with open arms :)15:55
arxcruzartom: mostly people say why, i say why not15:55
weshay|ruckand sshnaidm should consider it as well I think.. may help for debug when an openstack ansible module test fails15:56
artomweshay|ruck, doesn't openstack-ansible use sdk and not osc?15:56
weshay|ruckartom, it does use the sdk15:56
artomarxcruz, "more work" is why not :) I'm the first to try to convince my DFG to close BZs as quickly as possible if it's justified :P15:57
weshay|ruckbut I was thinking of that test as a second opinion on the $call it's making15:57
weshay|rucknot sure it's a good idea.. but thinking about it15:57
artomweshay|ruck, I guess the sdk is less of a problem because to my knowledge 1. we don't backport anything, so any upstream functional testing is fine and 2. our customers don't actually use it15:58
*** jmasud has joined #oooq15:58
weshay|ruckartom, it's used.. :)15:59
artomAh, via openstack-ansible I guess15:59
weshay|ruckat least in the deployment.. and customers are asking for it15:59
artomWhich ooo calls15:59
artomBut... then it's being tested that way15:59
artomWe tend to notice quickly when deployments don't finish ;)15:59
weshay|ruckonly after a long lunch16:03
ysandeepbhagyashris|away, I am updating commit msg of https://review.opendev.org/#/c/744007/1 , this is a branchless project - seems porting c7 to c8 jobs was missed earlier for this repo16:09
bhagyashris|awayysandeep, opps16:10
ysandeepbhagyashris|away, done16:11
bhagyashris|awayok16:11
bhagyashris|awaythanks16:11
ysandeep:) my pleasure16:12
bhagyashris|awayysandeep, degarding depends on stuff you were point me ... regarding that i will take look tomorrow16:12
bhagyashris|awayregarding *16:12
ysandeepbhagyashris|away, sure.. good night o/16:13
*** udesale_ has quit IRC16:13
bhagyashris|awayGood night !16:13
arxcruzweshay|ruck: https://bugs.launchpad.net/tripleo/+bug/1888244 should be fixed now16:17
openstackLaunchpad bug 1888244 in tripleo "jobs are failing in ci.centos when installing tempest-skiplist - The task includes an option with an undefined variable. The error was: 'zuul' is undefined" [Critical,In progress] - Assigned to Arx Cruz (arxcruz)16:17
*** ysandeep is now known as ysandeep|away16:17
arxcruzI had yatin's blessing, it was passing locally on my box as well, I hope ci centos doesn't have some weird configuration16:17
arxcruzodyssey4me: hey man, it worked, I'm getting an error now in something different, but it worked16:18
arxcruzodyssey4me: regarding the openstacksdk16:18
*** amoralej is now known as amoralej|off16:22
odyssey4mearxcruz: excellent :) that's a nice, clean way of getting the newer sdk16:23
arxcruzodyssey4me: btw, i didn't care to check for the clouds.yml because stein and queens don't create it at all :)16:24
arxcruzand also i wanted to see the results and not wait for 6 more hours16:24
odyssey4mearxcruz: yeah, it's just a misleading task name then16:24
arxcruzi still need to tweak some stuff though, so i'll update it16:25
*** dtantsur is now known as dtantsur|afk16:25
weshay|ruckarxcruz, k.. thanks /me retriggers16:25
weshay|ruckhere we go https://review.opendev.org/#/c/738375/16:36
weshay|ruckplease review https://review.opendev.org/#/q/topic:c7-to-c8-train+(status:open+OR+status:merged)16:37
chkumar|roversee ya tomorrow people16:42
weshay|ruckchkumar|rover, 0/16:48
weshay|ruckthanks16:48
*** derekh has quit IRC16:50
*** rlandy has joined #oooq17:02
*** jpena is now known as jpena|off17:04
rlandyweshay|ruck: hi - did panda say anything about the internal promoter?17:06
weshay|ruckrlandy, he said phooooy.. jk17:07
weshay|ruckrlandy, didn't talk to him17:07
weshay|ruckrlandy, thought you had an access issue17:08
rlandyweshay|ruck: no - I just thought he was going to update the internal promoter code17:08
weshay|ruckrlandy, can you help me w/ some reviews please? https://review.opendev.org/#/q/topic:c7-to-c8-train+(status:open+OR+status:merged)17:08
weshay|ruckrfolco, ^17:08
rlandyweshay|ruck: yeah ... he17:08
rlandypanda's here tomorrow, right?17:08
rlandyor I need someone to sit with me while we update and cherry pick17:09
weshay|ruckdon't know17:09
rlandyweshay|ruck: if not, you're it17:09
rlandytomorrow afternoon17:09
rlandywe will never clear the component pipeline17:09
rlandyor promoter anything 16.2 without it17:09
weshay|ruckrlandy, we will manually promote if needed17:09
weshay|ruckinternal should be easy.. can do it now if you want17:10
rlandyweshay|ruck: not good enough17:10
weshay|ruckrlandy, k17:10
rlandywe need to relink all images, dockerfiles17:10
weshay|ruckk.. that's a ln -s17:10
weshay|ruckma od17:10
weshay|ruckrlandy, done it before17:10
rlandyweshay|ruck: tomorrow we can make a decision ... but I would prefer to try get the changes into the internal promoter17:11
weshay|ruckrlandy, fyi.. updated your patch re: dep-pipeline17:11
weshay|ruckminor change17:11
rlandyotherwise we will live here forever17:11
weshay|ruckrlandy, k17:11
weshay|ruckrlandy, I'm out of context w/ when panda said he'd be available17:11
* rlandy gets off soap box and looks at reviews17:11
weshay|ruckrlandy, I can ping him if needed17:11
weshay|ruckrlandy, we talked about the promoter a lot in the planning mtg17:12
weshay|ruckI can update you if you want17:12
rlandyweshay|ruck: np - will try catch him tomorrow - I probably misunderstood17:12
rlandyweshay|ruck: where is the sprint planning now? jira? taiga?17:12
weshay|ruckjira17:12
weshay|rucklet's chat.. I'll catch you up17:13
weshay|ruckhttps://meet.google.com/xci-wsjb-zdm17:13
rlandyok17:13
rlandyweshay|ruck: https://review.rdoproject.org/r/#/c/21683/17:17
*** ysandeep|away is now known as ysandeep17:19
weshay|ruckhttp://promoter.rdoproject.org/centos8_ussuri.log17:52
weshay|ruckrlandy, ^17:52
*** sanjayu__ has quit IRC17:53
rfolcorlandy, I created a sub-task for your user story TRIPLEOCI-6518:25
rfolcoso we track work on sub-tasks, not directly in the user story18:26
rlandyrfolco: I moved TRIPLEOCI-68 - was that the wrong one?18:26
rfolcorlandy, no, you had moved 65 :) its not a big deal, but lets track work on sub-tasks instead so we see them in the same view18:27
rlandyrfolco: sorry - can we move it back18:27
rfolcorlandy, Its ok now, we have the sub-task created and its in progress column18:28
rlandyrfolco: apologies - newbie here18:28
*** ysandeep is now known as ysandeep|away18:28
rfolcorlandy, nah, you're good.18:28
rfolcorlandy, thx18:29
rlandyrfolco: so I18:29
rlandy'm supposed to track on hackMD?18:30
rlandyand just link on this card?18:30
rfolcorlandy, you have at least to create a sub-task and track progress on that sub-task (under a user story, which links to an epic)18:30
rlandyok18:30
rfolcorlandy, how often you update and how much its up to you18:31
rfolcorlandy, if you want to add a link only to hackmd in the description, thats also good18:31
rfolcobut the task needs to be there so we track everything on the same board18:31
rfolcothe sub-task*18:31
rfolcoonly create a task if it is not under any user story... otherwise create a sub-task under the user story18:32
weshay|ruckrlandy, you recall the issue I mentioned in https://review.opendev.org/#/c/741633/718:47
rlandyreading18:47
rlandyweshay|ruck: yeah - you have a comment there18:48
rlandyThere have been issues w/ pulling the dlrn hash from mirrors. This is error prone and causes jobs to pull the wrong content.18:48
weshay|ruckrlandy, ya.. promoter was out of space.. worked on master this time19:03
weshay|ruckhttps://trunk.rdoproject.org/centos8-master/19:03
rlandygreat19:03
weshay|ruckussuri is next19:03
weshay|ruckchkumar|rover, ^ fyi19:04
rlandyweshay|ruck: voted on https://review.opendev.org/#/q/topic:c7-to-c8-train+(status:open+OR+status:merged)19:10
weshay|ruckrlandy, thanks19:12
weshay|ruckrlandy, https://review.opendev.org/#/c/743759/20:01
rlandyweshay|ruck: looks good20:02
*** jfrancoa has quit IRC20:05
rlandyweshay|ruck: ok - think we have it now ... search for 'rdo-jobs/playbooks/dependency/get-dependency-repo-content.yaml' on the consoles on both jobs on testproject21683,5020:07
rlandyone is the cr job - no new content20:07
rlandythe second is extras (fake job) with content20:08
rlandyas long as the log collects20:08
rlandyweshay|ruck: now we need to add to container updates20:08
weshay|ruckaye20:10
weshay|ruckrlandy, actually .. we may not20:11
weshay|ruckrlandy, we don't update containers w/ any baseos changes20:11
weshay|ruckhowever.. it may be a good idea to do it in these jobs20:11
rlandyweshay|ruck: is that true for all dependencies?20:11
rlandywe can switch update on the repo itself20:12
weshay|ruckrlandy, so let's chat for a sec20:12
rlandy          update_container: true20:12
rlandyone sec - let me check that20:12
weshay|ruckhttps://meet.google.com/mde-wmoy-gbp20:12
weshay|ruckrlandy, https://review.opendev.org/#/q/topic:dos_docker.io+(status:open+OR+status:merged)20:19
weshay|ruckrlandy, job.build_container_images20:19
weshay|ruckrlandy, http://codesearch.openstack.org/?q=build_container_images&i=nope&files=&repos=20:20
weshay|ruckrlandy, arxcruz latest patch failed20:28
* weshay|ruck checking it20:28
rlandyweshay|ruck: ci.centos?20:28
weshay|ruckI think it's because the python interp is not in the python ansible modules20:28
weshay|ruckand it's trying /bin/python20:28
weshay|ruckrlandy, ya.. in ci.centos20:28
rlandy... /o\20:28
rlandyweshay|ruck: worth to skip that job in criteria for the moment?20:30
rlandywhich: no virtualenv in (/sbin:/bin:/usr/sbin:/usr/bin:/usr/local/bin/)20:34
rlandyweshay|ruck: ^^ that error?20:34
*** TrevorV has quit IRC20:50
weshay|ruckrlandy, well.. we could try merging that patch20:53
rlandyweshay|ruck: can you link patch?21:17
rlandyhttps://logserver.rdoproject.org/83/21683/50/check/periodic-tripleo-ci-centos-8-standalone-centos8extras-master/4d4eaed/logs/undercloud/home/zuul/21:18
rlandyhmmm ... and no repoquery list21:18
rlandyweshay|ruck: so we collect out of /home/zuul or home/zuul/workspace?21:19
rlandyk - one more time with container builds21:34
*** chem has quit IRC21:38
*** sshnaidm is now known as sshnaidm|afk21:42
weshay|ruckrlandy, home/zuul21:59
rlandyweshay|ruck: ok - that was the mistake22:08
rlandycorrected in the change running now22:08
rlandyhttps://review.rdoproject.org/zuul/stream/bf42a225e9fc426f8d72ad89a2f9a7c7?logfile=console.log building containers22:10
rlandyweshay|ruck: https://review.rdoproject.org/r/#/c/21683/ - all three obs23:08
rlandyjobs23:08
weshay|rucknice23:08
rlandygot the repoquery list now23:08
* weshay|ruck looks23:08
rlandylet's just check the containers use the new repo23:09
rlandyhttps://review.rdoproject.org/r/#/c/28775/ - job definitions23:09
rlandyweshay|ruck: want me to add an ovb job with image build?23:10
* rlandy adds that next23:10
weshay|ruckrlandy, not tonight.. well.. I guess we just need to add something to the undercloud install role in tqe to import build_containers23:11
weshay|rucklike what's done for standalone eh? and test_project w/ deps23:11
weshay|ruckrlandy, go after that tomorrow23:11
weshay|ruckit's really late23:11
weshay|ruckthese jobs look perfect23:11
rlandyweshay|ruck: I got two hours to kill on the fast23:11
weshay|ruckha..23:11
weshay|ruckthen program away23:11
weshay|ruckrlandy, /me trying to build a little python client to abandon old patches23:12
weshay|ruckholy crap my gerrit is ughly23:12
rlandyweshay|ruck: wow - now I have to build the repoquery module23:12
rlandyfeeling left out23:12
* rlandy goes to shop - back in a bit23:12
*** rlandy is now known as rlandy|biab23:13
weshay|ruck:)23:13
*** tosky has quit IRC23:14
*** jbadiapa has quit IRC23:24
weshay|ruckrlandy|biab, when you get back.. hook /me w/ a +2 on vex -> rdo please https://review.rdoproject.org/r/#/c/28704/23:26
*** artom has quit IRC23:32
*** artom has joined #oooq23:40
arxcruzweshay|ruck: rlandy|biab it requires the python-virtualenv package, wondering why is not being installed... :/ i'll write a patch for that23:41
weshay|ruckarxcruz, 0/23:42
weshay|ruckis it like 2am there?23:42
weshay|ruckarxcruz, python-virtualenv should be on the system w/ tq23:43
weshay|ruckarxcruz, you see my patch?23:43
weshay|ruckam I totally off base?23:43
arxcruzweshay|ruck: not on overcloud23:43
arxcruzweshay|ruck: i haven't let me check23:43
weshay|ruckwhat?23:43
weshay|ruckarxcruz, wtf are we doing on the overcloud?23:43
arxcruzsorry, undercloud23:44
arxcruzso, os_tempest runs on undercloud23:44
arxcruzos_tempest do some calls to python_venv_build that requires python-virtualenv23:44
weshay|ruckarxcruz, k.. ya.. there is no python-virtualenv there23:45
arxcruzjesus, this bug is haunt me23:45
weshay|rucklolz23:45
arxcruzweshay|ruck: I'll install the python-virtualenv in the tempest playbook before run os_tempest23:45
weshay|ruckarxcruz, http://paste.openstack.org/show/796481/23:47
weshay|ruckarxcruz, qq.. json from gerrit.. any guess what time format this is?  'createdOn': 1595889723,23:48
weshay|ruckepoch?23:48
weshay|ruckya..23:50
weshay|ruck>>> datetime.datetime.fromtimestamp(1596150278)23:50
weshay|ruckarxcruz, go to sleep :)23:50
weshay|ruckor atleast have a beer while you type23:50
arxcruzweshay|ruck: https://review.opendev.org/#/c/744084/23:55
arxcruzdone23:56
arxcruzi'll ping the people on osa tomorrow morning23:56
weshay|ruckarxcruz, and not having any path in the modules is ok?23:56
weshay|ruckwhy no #!/usr/bin/python23:56
arxcruzweshay|ruck: yes, it works we don't call the module directly23:57
weshay|ruckk23:57

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!