Tuesday, 2020-04-21

*** dmsimard1 has joined #oooq00:50
*** dmsimard has quit IRC00:51
*** dmsimard1 is now known as dmsimard00:52
*** jmasud has quit IRC00:55
*** jmasud has joined #oooq00:55
*** jmasud has quit IRC01:01
*** rlandy has quit IRC01:47
*** apetrich has quit IRC02:09
*** jmasud has joined #oooq03:44
*** matbu has quit IRC03:50
*** jmasud has quit IRC04:16
*** ysandeep|afk is now known as ysandeep04:20
*** skramaja has joined #oooq04:43
*** ykarel|away is now known as ykarel04:45
*** ratailor has joined #oooq04:50
*** jmasud has joined #oooq04:59
*** udesale has joined #oooq05:10
*** ykarel is now known as ykarel|afk05:16
*** ratailor_ has joined #oooq05:19
*** ratailor has quit IRC05:21
*** udesale_ has joined #oooq05:21
*** udesale has quit IRC05:24
*** ykarel|afk is now known as ykarel05:33
*** marios has joined #oooq05:38
*** jmasud has quit IRC05:42
*** bogdando has joined #oooq05:48
*** jfrancoa has joined #oooq05:58
*** jmasud has joined #oooq05:59
*** ratailor_ has quit IRC06:02
*** ratailor has joined #oooq06:02
*** saneax has joined #oooq06:03
*** ratailor has quit IRC06:04
*** ratailor has joined #oooq06:05
*** dpawlik has joined #oooq06:08
*** jtomasek has joined #oooq06:09
*** jtomasek has quit IRC06:10
*** jtomasek has joined #oooq06:11
*** udesale_ has quit IRC06:14
*** Goneri has quit IRC06:18
akahat|ruckchandankumar, ping06:23
akahat|ruckysandeep, ping06:27
ysandeepakahat|ruck, pong06:28
akahat|ruckysandeep, i found one job failure, it's because keystone is not up. job log: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_e8f/720052/1/gate/tripleo-ci-centos-7-undercloud-containers/e8fb859/logs/06:29
akahat|ruckysandeep, my first guess is it is because mariadb server: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_e8f/720052/1/gate/tripleo-ci-centos-7-undercloud-containers/e8fb859/logs/undercloud/var/log/containers/mysql/mariadb.log06:29
akahat|ruckand it is caused by: https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/general_config/featureset027.yml#L20 (invalid hostname)06:30
*** dsneddon has quit IRC06:32
mariossshnaidm|afk: o/ sorry didn't get to them on time https://review.opendev.org/718374 https://review.opendev.org/71838806:33
ysandeepakahat|ruck, hmmm.. i remember bug: https://bugs.launchpad.net/tripleo/+bug/1873535 was opened on same lines(invalid hostname)06:34
openstackLaunchpad bug 1873535 in tripleo "inventory in CI has 'underclou' instead of 'undercloud'" [Medium,Triaged]06:34
chandankumarysandeep: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_e8f/720052/1/gate/tripleo-ci-centos-7-undercloud-containers/e8fb859/logs/undercloud/etc/hosts06:34
akahat|ruckysandeep, okay. cool. I mean bug it is known issue.06:36
ysandeepakahat|ruck, but i don't see a patch there.. so we need to fix that06:36
*** udesale has joined #oooq06:37
akahat|ruckysandeep, would you like to take this?06:38
ysandeepakahat|ruck, if you need help then I can take this one, if you are comfortable then go ahead.06:42
akahat|ruckysandeep, yes. please. today CI's mood is not good...06:43
*** udesale has quit IRC06:43
ysandeepakahat|ruck, ack06:44
*** matbu has joined #oooq07:02
*** apetrich has joined #oooq07:04
*** jmasud has quit IRC07:08
*** jmasud has joined #oooq07:09
*** yolanda has joined #oooq07:13
*** jmasud has quit IRC07:16
*** jmasud has joined #oooq07:20
*** amoralej|off is now known as amoralej07:36
*** jmasud has quit IRC07:43
*** tosky has joined #oooq07:44
*** jmasud has joined #oooq07:44
*** ccamacho has joined #oooq07:47
*** jpena|off is now known as jpena07:57
*** bogdando has quit IRC07:59
*** udesale has joined #oooq08:16
*** ysandeep is now known as ysandeep|lunch08:17
*** jmasud has quit IRC08:19
*** udesale_ has joined #oooq08:22
*** udesale has quit IRC08:22
*** udesale has joined #oooq08:22
apetricharxcruz, Just to let you know that lunch is going to be moqueca.08:42
* apetrich is really nice* person08:42
apetrich*not nice at all :)08:42
*** skramaja has quit IRC08:43
arxcruzapetrich: i hate you08:43
*** skramaja has joined #oooq08:48
*** dtantsur|afk is now known as dtantsur09:00
mariosjpena: o/ when you have a few mins can you please check comments at https://code.engineering.redhat.com/gerrit/#/c/196858/62/playbooks/tripleo-buildcontainers/pre_rhel8.yaml@31 about the repos .. me and rlandy working here ... maybe we can get on the phone with ronelle later today or tomorrow after you check there... otherwise we can discuss on the review too09:14
*** ykarel is now known as ykarel|lunch09:14
* jpena chekcs09:14
jpenand even checks09:14
mariosjpena: am trying out the latest updates to those repos now (especially tripleo-ci-testing) as commented at line 40... (i.e. i did that in v64 of the patch currently running)09:15
mariosjpena: thanks09:15
jpenamarios: I've added some comments to the review. Happy to have a quick call if you need more details09:23
mariosjpena: thanks reading now... lets see what happens with latest repos and will reach out again.. maybe best to do it at tiem that rlandy is also around09:24
jpenaperfect09:24
mariosjpena: thanks for checking there09:24
panda|ruckjpena: is there any problem with rdo registry at the moment ? a build job failed to push some containers and I wanted to understand if it's just a hiccup09:27
panda|ruckjpena: 2020-04-21 08:51:46.500359 | primary | Error: Error copying image to the remote destination: Error writing blob: Patch09:27
panda|ruckhttps://trunk.registry.rdoproject.org/v2/tripleomaster/centos-binary-nova-compute/blobs/uploads/8032198b-a747-4ad3-a333-c0ea4bab234a?_state=mpyeW6a9U6WevBybrPVWeB4GxhRbfKS2Gq9gvOQRbFh7Ik5hbWUiOiJ0cmlwbGVvbWFzdGVyL2NlbnRvcy1iaW5hcnktbm92YS1jb21wdXRlIiwiVVVJRCI6IjgwMzIxOThiLWE3NDctNGFkMy1hMzMzLWMwZWE0YmFiMjM0YSIsIk9mZnNldCI6MCwiU3RhcnRlZEF0IjoiMjAyMC0wNC0yMVQwODo1MTozOS4zNjA0NTIxMDdaIn0%3D: write tcp09:27
panda|ruck10.0.0.3:49426->38.102.83.107:443: write: connection reset by peer09:27
jpenapanda|ruck: I'm checking logs, everything looks normal so far09:32
panda|ruckjpena: yeah, probably just a hiccup. Thanks for checking.09:33
*** ysandeep|lunch is now known as ysandeep09:39
*** sshnaidm|afk is now known as sshnaidm09:54
*** jbadiapa has joined #oooq10:12
*** ykarel|lunch is now known as ykarel10:20
*** bogdando has joined #oooq10:32
panda|ruckysandeep: need any help with train gate failures ?10:41
ysandeeppanda|ruck, i think that was a transient issue, only one patch failed https://review.opendev.org/#/c/720052/ (posted recheck there), build history is good http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-7-undercloud-containers .. Reopened an old Lp where sometimes we hit this race condition: https://bugs.launchpad.net/tripleo/+bug/1820576/comments/1310:44
openstackLaunchpad bug 1820576 in tripleo "master: Standalone002 job fails, keystone container didn't start because could not bind to address 192.168.24.1:35357" [Medium,Triaged]10:44
*** Tengu has quit IRC10:48
*** Tengu has joined #oooq10:50
*** ysandeep is now known as ysandeep|afk11:01
*** udesale has quit IRC11:09
*** derekh has joined #oooq11:15
*** ysandeep|afk is now known as ysandeep11:32
*** jpena is now known as jpena|lunch11:35
panda|ruckysandeep: I see it happening again11:44
panda|ruckysandeep: on patch https://review.opendev.org/#/c/719766/11:44
panda|ruckand this blocks tripleo-ci master too, not just a train branh11:44
chandankumarrfolco: morning11:45
chandankumarrfolco: https://review.rdoproject.org/r/26673 and https://review.rdoproject.org/r/#/c/26657/11:45
ysandeeppanda|ruck, Same error - keystone container didn't start because could not bind to address 192.168.24.1:35357 ?11:51
panda|ruckysandeep: I don't know, collect logs timed out ...11:57
ysandeeppanda|ruck, :( yes no log, but I don't think its related, because ^^ patch failed on TASK [overcloud-deploy : Deploy the overcloud].. Keystone one was failing on undercloud deploy itself.11:59
chandankumarsshnaidm: Hello12:00
sshnaidmchandankumar, hi12:00
chandankumarsshnaidm: please +w it https://review.opendev.org/#/c/720575/12:01
chandankumarsshnaidm: one more question how to use the default vars of one role in another role when called with in that role12:01
chandankumarsshnaidm: for example here https://review.opendev.org/#/c/719453/9/roles/build-images/tasks/main.yml@2512:02
sshnaidmchandankumar, not sure I understand the problem12:03
sshnaidmchandankumar, what variable for example?12:03
chandankumarsshnaidm: I added oooci-image build role related var here https://review.opendev.org/#/c/719453/9/roles/build-images/defaults/main.yml@3312:04
chandankumarsshnaidm: and I wanted to consume here https://review.opendev.org/#/c/719453/8/roles/build-images/tasks/main.yml@3812:05
chandankumarbut it is not getting overridden12:05
chandankumaris it possible to reuse those vars12:05
sshnaidmchandankumar, I think nested role defaults are more prioritized12:06
*** ratailor has quit IRC12:06
sshnaidmchandankumar, need to check to be sure 100%12:06
chandankumarsshnaidm: ok, thanks works for me12:09
sshnaidmchandankumar, you can leave it in defaults, just to pass it as "vars:  myvar: {{ myvar }}" etc12:10
chandankumarsure, I will update after current run12:10
sshnaidmchandankumar, 719453 depends on failed patch, no need to +w it now12:11
chandankumarsshnaidm: https://review.opendev.org/#/c/720575/ this one12:11
sshnaidmchandankumar, ack12:11
*** dsneddon has joined #oooq12:13
*** soniya29 is now known as soniya29|afk12:15
*** rlandy has joined #oooq12:17
*** dsneddon has quit IRC12:18
sshnaidmchandankumar, commented12:19
*** Goneri has joined #oooq12:23
weshay|ruckpanda|ruck, akahat|ruck you guys doing ok?12:29
*** dtantsur is now known as dtantsur|brb12:30
rlandymarios: hey ... reading through the response wrt repos12:31
rlandymarios: not clear to me we have a solution12:32
marioso/ rlandy ack.. yeah currently running it again with consistent after latest comments12:32
rlandytripleo-ci-testing is behind consistent12:32
mariosrlandy: no we don't... the 'progress' so far is that the ovs conflict is real, i.e. its there even when we don't include the upstream deloreans12:32
panda|ruckweshay|ruck: still missing master, container build fails, we are hitting 10 gates failure but we don't have a pattern.12:33
rlandymarios: but we get a whole lot of failure without all your inclusions12:33
mariosrlandy: conflicts for ovs, and also mistral-common... and missin packages sahara/mlnx12:33
*** derekh has quit IRC12:33
rlandymarios: so - we should start bz'ing these?12:33
rlandyie: legit packing problems12:33
mariosrlandy: yeah... that was with tripleo-ci-testing so latest is consistent... lets see what happens with the current run (https://code.engineering.redhat.com/gerrit/#/c/196858/64/playbooks/tripleo-buildcontainers/pre_rhel8.yaml@38)12:33
mariosrlandy: latest *run* i mean12:33
rlandyok12:34
*** jpena|lunch is now known as jpena12:35
mariosrlandy: just failed... waiting fo the report to see damage https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/stream/6ae191d6444c481e9d543922f25cd631?logfile=console.log12:36
chandankumarrfolco: let me know when around? I am also thinking to move componet consistent to toci testing jobs to rdo-jobs in a seperate file12:36
*** derekh has joined #oooq12:41
panda|ruckweshay|ruck: also, you've asked for it, you've got it. https://review.rdoproject.org/r/2665412:42
panda|ruckchandankumar: rfolco is on Holiday today12:43
panda|ruckchandankumar: he's going to remove all his teeth, it seems12:43
chandankumarpanda|ruck: thanks, oh no12:49
arxcruzchandankumar: it's holiday today in brazil, i don't think rfolco is around12:50
chandankumararxcruz: thanks!12:53
rlandypojadhav: hello12:53
pojadhavrlandy, hi12:54
pojadhavrlandy, we can sync up now12:54
rlandypojadhav: unless you want to watch the all hands - but let's start12:55
panda|ruckarxcruz: so, are they going to remove his teeth anyway, or only if they catch him ?12:55
panda|ruckarxcruz: how does it work ?12:55
rlandypojadhav: https://meet.google.com/xhq-msfd-aqj12:55
arxcruzpanda|ruck: this is an alias because his profession was remove teeth12:56
panda|ruckarxcruz: it's like "the purge" or something ?12:56
panda|ruckarxcruz: oh. you people are no fun.12:56
arxcruzpanda|ruck: he was part of a organization to make brazil free from the crown (portugal)12:57
arxcruzbut it was about to blow up, and he was the poor one, all the others were noble12:57
arxcruzso they said he was the head of the revolution12:57
arxcruzsad history tbh12:57
*** jbadiapa has quit IRC13:00
*** soniya29|afk is now known as soniya2913:07
*** ykarel is now known as ykarel|afk13:08
weshay|ruckpanda|ruck, akahat|ruck ya.. so master and train gates are running at 97+% pass13:09
weshay|ruckstein is 100% so we're ok on the gate13:09
weshay|ruckI'll watch that in my day for you guys to allow you to focus on component + integration lines13:09
akahat|ruckweshay|ruck, o/, that's great. :)13:10
mariosrlandy: jpena: same with consistent fyi added link https://code.engineering.redhat.com/gerrit/#/c/196858/64/playbooks/tripleo-buildcontainers/pre_rhel8.yaml@3813:10
mariosrlandy: i guess you and i should sync at some point after these calls... and decide next steps re bugs13:10
weshay|rucklooking good here as well https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-8-ovb-1ctlr_1comp-featureset001&job_name=tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset00113:10
rlandymarios: yep - on call with pojadhav - will ping you later13:10
weshay|ruckpanda|ruck, https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035  I think 35 is ready to be promotion criteria13:12
panda|ruckweshay|ruck: ok13:12
weshay|ruckpanda|ruck, I also updated http://dashboard-ci.tripleo.org/d/3sUHfh9Wz/jobs-exploration?orgId=113:13
weshay|ruckto show job voting status.. yes/no13:13
weshay|ruckand the pipeline it's in13:14
weshay|ruckpanda|ruck, so that can assist in determining if a job is not configured correctly13:14
*** holser has quit IRC13:21
soniya29arxcruz: Can we use flatten-dict in tempest-skiplist?13:28
arxcruzsoniya29: you mean zbr flatten-dict code?13:29
soniya29arxcruz: https://pypi.org/project/flatten-dict/ to flatten the nested dictionary.13:30
zbrlet me guess, is a question regarding how to make it easy to merge the default skiplist with a new one?13:30
zbris is not hard to converts dicts to list in ansible, only nesting and extra logic can cause issues.13:31
zbri doubt we need a custom filter/module to make the skiplist etensible, let me know if you want me to help.13:31
soniya29zbr: its just that we want the skiplist to be in flattened dictionary using python13:32
zbrsoniya29: post a link to current implementation so I get more context13:32
soniya29zbr: here is the link - https://paste.centos.org/view/0a9ea9cb, but this works for only one level of nested dictionary and we have more level in the hierarchy of tempest-skiplist13:37
zbrmy mistake, i was curious about an example of input / output, and where is that running.13:39
zbrwe need to be careful about adding new python package dependencies as they impose extra issues, especially in ansible context.13:40
zbrsometimes pure python can prove to generate less headaches, but if we already have a reqs.txt, adding new deps should be ok.13:41
akahat|ruckchandankumar, ping13:44
ysandeepweshay|ruck, panda|ruck i created a patch to Update master promotion criteria with OVB fs035 https://review.rdoproject.org/r/#/c/26407/ couple of days back13:44
chandankumarakahat|ruck: pong13:45
akahat|ruckchandankumar, are you free right now.. need to discuss some things about overcloud images.13:45
panda|ruckchandankumar: also, can you remove the -2 from https://review.rdoproject.org/r/#/c/26407/  ?13:45
chandankumarakahat|ruck: may be in another 15 mins13:45
akahat|ruckchandankumar, okay. cool13:45
chandankumarpanda|ruck: https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-master job does not seems to be healthy13:46
rlandyysandeep: hey - didn't forget about you :)13:46
panda|ruckweshay|ruck: ^13:46
rlandyysandeep: just trying to clear the tls work a bit - will book a meeting re: baremetal13:46
ysandeeprlandy, o/ thank you :)13:48
weshay|ruckanyone here want to take over this blueprint? https://blueprints.launchpad.net/tripleo/+spec/ironic-overcloud-ci13:52
ysandeepweshay|ruck, o/13:54
weshay|ruckhey13:54
ysandeepi am up for this BP13:54
weshay|ruckysandeep, ok.. please ping dhiggins on irc and make sure that's ok13:55
weshay|ruckthanks for volunteering13:55
ysandeepweshay|ruck, where can i find him?13:56
weshay|ruckysandeep, email may be best :)13:57
weshay|ruckactually.. don't see him13:57
weshay|ruckpanda|ruck, is derek still on openstack?13:57
ysandeepweshay|ruck, ack o/13:57
ysandeepchandankumar, panda|ruck periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset035-master was running good last week, but currently seems like hitting bug: https://bugs.launchpad.net/tripleo/+bug/1873770 which other ovb jobs are facing as well.13:59
openstackLaunchpad bug 1873770 in tripleo "OVB fs001 in centos8 master fails to push certificates contents to controllers" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami)13:59
*** jbadiapa has joined #oooq13:59
rlandymarios: you still around after the all-hands?14:02
mariosrlandy: sure we can do brief sync then np14:03
rlandycool14:03
*** amoralej is now known as amoralej|lunch14:08
*** TrevorV has joined #oooq14:15
panda|ruckweshay|ruck: yes, he is.14:17
panda|ruckysandeep: you can contact me for status, I was the one first taking a look at this, and derekh for next steps.14:18
ysandeeppanda|ruck, thanks! you saved me.. I was just writing a mail to him.14:19
chandankumararxcruz: Hello14:19
arxcruzchandankumar: hey14:20
chandankumararxcruz: can you take care of common tempest planning, I need to prepare for thursday training14:20
arxcruzchandankumar: i just saw weshay|ruck email14:20
ysandeeppanda|ruck, ack I will sync up with you tomorrow if you get some free time.. today seems busy with mtgs.14:21
weshay|ruckchandankumar, if it's too much all at once.. push the training out a week14:21
arxcruzis it the openstack-tempest-skiplist, infrared + os_tempest ?14:21
chandankumarweshay|ruck: I donot have access to calender, please go for ti14:21
chandankumararxcruz: yes14:21
panda|ruckysandeep: we can meet in the mornings14:22
arxcruzchandankumar: yes what? lol14:22
chandankumararxcruz:  tripleo_common_path: "{{ tripleo_common_path }}"14:22
chandankumartripleo_elements_path: "{{ tripleo_elements_path }}"14:22
chandankumarsorry14:22
ysandeeppanda|ruck, thank you :)14:22
arxcruzchandankumar: ?14:22
chandankumararxcruz: yes, openstack-temepst-skiplist, infrared + os_tempest14:22
*** ykarel|afk is now known as ykarel14:22
arxcruzok, I'll work on that tomorrow14:23
chandankumararxcruz: cool, thanks :-)14:23
derekhysandeep: I havn't been looking at tripleo in a long time but iirc we got that ironic overcloud job working and then it broke around the time it was switched to a standalone job (there was also some networking changes that were related to the breakage I think)14:25
derekhysandeep: I can bring it up at our next team meeting to see who is best to help it along14:25
ysandeepderekh, o/ thank you :) by any chance do you recall what was the job name? I can take a look in the meantime.14:26
derekhysandeep: lemme see if I can find out14:27
zbrwho is the organizer of community Mtg? because it still has the bj url in the title and the meet one in body....14:29
zbrcan we have it fixed?14:29
ysandeepzbr, i think marios is running today's call in rfolco place14:30
mariosyeah we start straight after tripleo ysandeep14:30
derekhysandeep: I think  tripleo-ci-centos-7-scenario012-multinode-oooq-container -> tripleo-ci-centos-7-scenario012-standalone14:30
rlandymarios: awaiting you on community meeting14:32
akahat|ruckarxcruz, rfolco, zbr, panda, sshnaidm, rlandy, marios, ysandeep, bhagyashris, soniya29, pojadhav, akahat, weshay, chandankumar14:32
akahat|ruckcommunity call ^^14:32
ysandeepderekh, ack thank you, I will take a look. please let me know who is the best person to help along after you sync up with your team.14:34
derekhysandeep: will do14:35
ysandeepderekh++ :)14:35
*** marios is now known as marios|call14:35
*** dtantsur|brb is now known as dtantsur14:47
*** dmellado has quit IRC14:49
*** skramaja has quit IRC14:55
*** amoralej|lunch is now known as amoralej14:59
pojadhavhttps://hackmd.io/IhMCTNMBSF6xtqiEd9Z0Kw15:01
pojadhavysandeep, ^^15:01
ysandeeppojadhav, thanks..15:01
pojadhavysandeep, :)15:01
ysandeeppanda|ruck, thank you so much for the presentation :) It was very informative15:02
panda|ruckysandeep: thank you for listening15:02
*** matbu has quit IRC15:12
*** dmellado has joined #oooq15:17
*** yolanda has quit IRC15:21
*** dmellado has quit IRC15:35
*** dmellado has joined #oooq15:37
*** bogdando has quit IRC15:38
marios|callrlandy: o/15:39
marios|callrlandy: when are you free for sync15:39
*** ysandeep is now known as ysandeep|away15:40
rlandymarios|call: in 515:40
*** ykarel is now known as ykarel|away15:40
marios|callrlandy: ack15:40
*** udesale_ has quit IRC15:41
marios|callrlandy: let me know when15:46
rlandymarios|call: sorry - just needed some tea :) - back15:49
marios|callrlandy: np ... joining community call now15:49
rlandyk15:49
marios|callrlandy: (i.e. lets use that ^15:49
rlandymarios|call: I'll rejoin15:50
marios|callrlandy: ack15:50
*** yolanda has joined #oooq15:52
*** jmasud has joined #oooq15:55
*** holser has joined #oooq16:00
arxcruzyay, no german class today \o/16:09
weshay|ruckraleigh vpn is terrible16:10
weshay|ruckarxcruz, you want to chat tempest planning or are you good?16:10
*** jmasud has quit IRC16:12
*** marios|call is now known as marios16:24
* marios shutdown 16:24
*** jmasud has joined #oooq16:25
*** marios has quit IRC16:35
*** jmasud has quit IRC16:37
*** jmasud has joined #oooq16:37
*** jmasud has quit IRC16:38
*** jmasud has joined #oooq16:38
*** jmasud has quit IRC16:39
*** holser has quit IRC16:39
*** jmasud has joined #oooq16:40
*** holser has joined #oooq16:40
*** jmasud has quit IRC16:40
*** jmasud has joined #oooq16:41
rlandyhmmm ...16:42
rlandy    DEBUG:tripleo_common.image.image_uploader:Token parameters: params {'service': 'registry.docker.io', 'scope': 'repository:tripleomaster/centos-binary-cinder-scheduler:pull'}16:42
rlandy    DEBUG:urllib3.connectionpool:Starting new HTTPS connection (1): auth.docker.io:44316:42
rlandyif I am hitting auth issues - what did I miss?16:42
rlandypanda|ruck: ^^?16:43
rlandytripleo_container_image_prepare - standalone16:44
rlandysomewhere I missed an auth step16:44
*** derekh has quit IRC16:48
arxcruzweshay|ruck: sorry, didn't saw your message, i would like to know exactly what you want me to talk16:55
arxcruzif that's ok16:55
weshay|ruckarxcruz, ya.. let's chat for a minute if oyu are avail16:57
rlandyrfolco: other container people?16:58
rlandy^^ what would  I have messed up to get a EBUG urllib3.connectionpool [  ] http://192.168.24.1:8787 "GET /v2/ HTTP/1.1" 404 20116:58
rlandylocal registry16:59
rlandyalso not nameserver related16:59
*** dtantsur is now known as dtantsur|afk16:59
*** jbadiapa has quit IRC17:02
*** jpena is now known as jpena|off17:13
weshay|ruckkopecmartin, https://review.opendev.org/#/c/717061/17:25
weshay|ruckkopecmartin, please see my comments17:26
*** yolanda has quit IRC17:33
arxcruzweshay|ruck: sure, when you're available17:36
weshay|ruckarxcruz, hey17:36
weshay|ruckhttps://meet.google.com/xoe-yoxn-scq?authuser=117:36
*** dsneddon has joined #oooq17:45
weshay|ruckarxcruz, https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/logs/jenkins-phase2-15_director-rhel-8.1-virthost-1cont_1comp-ipv4-geneve-lvm-ssl-28/undercloud-0/home/stack/tempest-dir/tempest.log.txt.gz17:47
*** jtomasek has quit IRC17:51
*** jtomasek has joined #oooq17:52
arxcruzweshay|ruck: https://rhos-ci-jenkins.lab.eng.tlv2.redhat.com/logs/jenkins-phase2-15_director-rhel-8.1-virthost-1cont_1comp-ipv4-geneve-lvm-ssl-28/infrared/ir-commands.log17:52
arxcruzweshay|ruck: https://github.com/redhat-openstack/infrared/blob/master/plugins/tempest/plugin.spec17:52
weshay|ruckarxcruz, https://rhos-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/QE/view/OSP15/job/phase2-15_director-rhel-8.1-virthost-1cont_1comp-ipv4-geneve-lvm-ssl/28/artifact/.sh/07-tempest.log17:53
arxcruzweshay|ruck: https://github.com/redhat-openstack/infrared/blob/ed3c50b85cf905a7450d9abfee7f017ede020c3f/plugins/tempest/tasks/configure/run.yml17:55
*** hamzy__ has quit IRC17:59
arxcruzweshay|ruck: 2020-04-21 09:41:10.273 | TASK [Run tempest configuration tool] ******************************************18:00
arxcruzweshay|ruck: https://github.com/openstack/openstack-ansible-os_tempest/search?q=octavia&unscoped_q=octavia18:03
*** jmasud has quit IRC18:08
*** amoralej is now known as amoralej|off18:10
*** jmasud has joined #oooq18:17
rlandyweshay|ruck: hey - have time to chat re: tls work?18:19
weshay|ruckrlandy, yup18:20
weshay|ruckrlandy, https://meet.google.com/mhr-xkdf-egu?authuser=118:20
weshay|ruckrlandy, https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_72f/720275/5/gate/tripleo-ci-centos-8-scenario007-standalone/72f6670/logs/undercloud/var/log/extra/network.txt18:37
weshay|ruck-A INPUT -p tcp -m tcp --dport 8787 -m comment --comment "155 docker-registry ipv4" -m conntrack --ctstate NEW -j ACCEPT18:37
*** saneax has quit IRC18:38
*** jmasud has quit IRC18:39
*** matbu has joined #oooq18:41
*** jmasud has joined #oooq18:41
weshay|ruckrlandy,  "DEPLOY_CONTROL_VIP": null,18:46
weshay|ruckhttp://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_72f/720275/5/gate/tripleo-ci-centos-8-scenario007-standalone/72f6670/logs/undercloud/etc/httpd/conf.d/image-serve.conf18:48
weshay|ruckrlandy, ^18:48
*** saneax has joined #oooq18:49
*** ccamacho has quit IRC19:34
weshay|ruckrlandy, ping.. when you have a sec.. I need a second opinion and eyes19:45
rlandyweshay|ruck: k - link?19:45
weshay|ruckrlandy, https://review.rdoproject.org/r/#/c/26510/7/zuul.yaml19:46
weshay|ruckhttps://logserver.rdoproject.org/10/26510/7/check/periodic-tripleo-ci-centos-8-standalone-tripleo-train/406b740/logs/undercloud/var/log/extra/repolist.txt.gz19:46
weshay|ruckrlandy, in a train job..19:46
weshay|ruckRepo-id      : tripleo19:46
weshay|ruckRepo-name    : tripleo19:46
weshay|ruckRepo-revision: 158740898119:46
weshay|ruckRepo-updated : Mon 20 Apr 2020 06:56:21 PM UTC19:46
weshay|ruckRepo-pkgs    : 30319:46
weshay|ruckRepo-size    : 37 M19:46
weshay|ruckRepo-baseurl : https://trunk.rdoproject.org/centos8-master/component/tripleo/component-ci-testing19:46
weshay|ruckRepo-expire  : 172,800 second(s) (last: Tue 21 Apr 2020 04:55:45 PM UTC)19:47
weshay|ruckRepo-filename: /etc/yum.repos.d/tripleo-component.repo19:47
weshay|ruckTotal packages: 12,26319:47
weshay|ruckis getting added19:47
rlandyha19:47
weshay|ruckhttps://logserver.rdoproject.org/10/26510/7/check/periodic-tripleo-ci-centos-8-standalone-tripleo-train/406b740/logs/undercloud/home/zuul/repo_setup.sh.txt.gz19:47
weshay|ruckhttps://review.opendev.org/#/c/717850/1319:47
weshay|ruckis the release config19:47
weshay|ruckrlandy, I think the repos should only be coming from the release files19:49
weshay|ruckbut I feel crazy atm19:49
rlandyweshay|ruck: k - looking through19:49
weshay|ruck--extra-vars @/home/zuul/workspace/.quickstart/config/release/tripleo-ci/CentOS-8/promotion-testing-hash-train.yml19:50
rlandylet's look if component-ci-testing is in a master periodic job19:51
weshay|ruckrlandy, the parenting may be the issue?19:51
rlandyweshay|ruck: so component-tripleo19:52
weshay|ruckya19:52
rlandycomponent-ci-testing19:52
weshay|ruckya19:52
*** jmasud has quit IRC19:52
rlandywould be the hash before we promote19:52
weshay|ruckya19:53
weshay|ruckpromote_source: tripleo-ci-testing19:53
weshay|ruckhttps://review.opendev.org/#/c/717850/13/config/release/tripleo-ci/CentOS-8/promotion-testing-hash-train.yml19:53
rlandywe should run component-ci-testing to tripleo-ci-testing19:53
weshay|ruckhow would component-ci-testing get in there19:53
weshay|ruckI suspect all of these get-hash roles19:54
weshay|ruckbased on distro version19:54
rlandyyeah - me too :)19:54
rlandyjust comparing19:54
weshay|ruckbut dam if I know where..19:54
weshay|ruckI just duplicated a patch to weed it out19:54
rlandy periodic-tripleo-ci-centos-8-standalone-tripleo-master doesn't exist19:54
weshay|ruckrlandy, https://codesearch.rdoproject.org/?q=periodic-tripleo-ci-centos-8-standalone-tripleo-master&i=nope&files=&repos=19:55
weshay|ruckrlandy, I wonder if this is the issue https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/standalone-jobs.yaml#L92219:56
rlandyweshay|ruck: that's the component job19:56
rlandyoh19:56
weshay|ruckwhat's the parent of that one19:56
weshay|ruckprobably in config19:56
rlandyweshay|ruck; do you want a component or an integration job?19:57
rlandycomponent job wouldn't use periodic release file19:57
weshay|ruckrlandy, integration19:57
weshay|ruckor check19:57
weshay|ruckjust something to test centos-8 train19:57
rlandyweshay|ruck: so try parent off of periodic-tripleo-ci-centos-8-standalone-master19:58
rlandyrather than  periodic-tripleo-ci-centos-8-standalone-tripleo-master19:58
rlandyweshay|ruck: ^^ see the difference?19:58
weshay|ruckOH fak19:59
rlandyone is the integration job - one is the tripleo component job19:59
rlandyNOT AT ALL confusing ?!19:59
weshay|ruckman.. it was right in front of my eyes20:00
weshay|ruckbut.. those are things that always get me20:01
weshay|ruckrlandy, that was ur handy dandy repo injection trick20:01
rlandyweshay|ruck: np - I owed you debug help20:01
weshay|ruckyou showed me20:01
*** jmasud has joined #oooq20:01
rlandyweshay|ruck: yep20:01
weshay|ruckrlandy, when you have a sec.. point me at that code20:02
* weshay|ruck wants to see if I can add a comment20:02
rlandyweshay|ruck: https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/standalone-jobs.yaml#L83420:03
rlandyhttps://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/standalone-jobs.yaml#L831 ... defaults to master20:03
rlandyunless you overwrite it20:04
weshay|ruckrlandy, I forget things easily so I want to add a comment to the repo20:10
rlandyok20:11
weshay|ruckrlandy, thanks for the eyes.. :)20:11
*** holser has quit IRC20:12
*** TrevorV has quit IRC20:12
rlandyweshay|ruck: fyi ... documenting what osp containers buid with what repos in https://hackmd.io/A0acqhtaQ_KButNw2bgAdQ ... marios and I will discuss missing deps with jpens tomorrow20:28
sshnaidmweshay|ruck, replied in https://review.opendev.org/#/c/717604/20:29
weshay|ruckaye20:30
weshay|rucksshnaidm, ok.. fair enough.. no jinja20:32
weshay|ruck:)20:32
sshnaidmyeah, it's not a template20:32
weshay|ruckzuul.d/layout in that repo need to be updated20:39
*** jmasud has quit IRC20:46
*** jfrancoa has quit IRC20:46
rlandytime for some air ... brb20:51
*** rlandy is now known as rlandy|brb20:51
*** jmasud has joined #oooq21:16
*** rlandy|brb is now known as rlandy21:19
*** saneax has quit IRC21:24
rlandyweshay|ruck: hmmm ... [Tue Apr 21 21:04:04.388195 2020] [core:error] [pid 27758:tid 140509607901440] (EAI 2)Name or service not known: AH00547: Could not resolve host name overcloud.ctlplane.ooo.test -- ignoring!21:24
rlandygoing to have to change that naming21:25
rlandyhttps://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_82a/706288/17/check/tripleo-ci-centos-8-standalone-on-multinode-ipa/82af683/logs/undercloud/var/log/tripleo-container-image-prepare.log21:25
*** holser has joined #oooq21:33
*** dpawlik has quit IRC21:34
*** chem has quit IRC21:45
*** chem has joined #oooq21:47
*** jmasud has quit IRC22:09
*** holser has quit IRC22:11
*** jmasud has joined #oooq22:13
rlandyugh!22:52
*** tosky has quit IRC23:03
rlandyweshay|ruck: around?23:11
*** jmasud has quit IRC23:24

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!