| *** saneax has joined #oooq | 00:23 | |
| *** saneax has quit IRC | 01:03 | |
| *** rfolco has quit IRC | 01:41 | |
| *** Vorrtex has quit IRC | 01:55 | |
| *** apetrich has quit IRC | 02:10 | |
| *** ykarel|away has joined #oooq | 02:25 | |
| *** hamzy_ has quit IRC | 03:06 | |
| *** rlandy|bbl has quit IRC | 03:12 | |
| *** saneax has joined #oooq | 03:28 | |
| *** saneax has quit IRC | 03:33 | |
| *** ykarel|away has quit IRC | 03:53 | |
| *** gkadam has joined #oooq | 03:59 | |
| *** udesale has joined #oooq | 04:07 | |
| *** ykarel|away has joined #oooq | 04:08 | |
| *** ykarel|away is now known as ykarel | 04:09 | |
| *** surpatil has joined #oooq | 04:29 | |
| *** jtomasek has joined #oooq | 04:38 | |
| *** skramaja has joined #oooq | 04:41 | |
| *** pierreprinetti has joined #oooq | 04:58 | |
| *** pierreprinetti has quit IRC | 04:59 | |
| *** ratailor has joined #oooq | 05:04 | |
| *** marios has joined #oooq | 05:17 | |
| *** jtomasek has quit IRC | 05:29 | |
| *** raukadah is now known as chandankumar | 05:34 | |
| *** surpatil has quit IRC | 05:43 | |
| *** soniya29 has joined #oooq | 05:56 | |
| *** surpatil has joined #oooq | 05:57 | |
| *** saneax has joined #oooq | 06:02 | |
| *** jfrancoa has joined #oooq | 06:13 | |
| *** dtantsur|afk is now known as dtantsur | 06:15 | |
| *** jfrancoa has quit IRC | 06:20 | |
| *** kopecmartin|off is now known as kopecmartin | 06:26 | |
| *** jfrancoa has joined #oooq | 06:33 | |
| *** bogdando has joined #oooq | 06:52 | |
| *** akahat has joined #oooq | 06:57 | |
| *** surpatil is now known as surpatil|brb | 06:59 | |
| *** tesseract has joined #oooq | 07:05 | |
| *** apetrich has joined #oooq | 07:24 | |
| *** surpatil|brb has quit IRC | 07:29 | |
| *** jpena|off is now known as jpena | 07:33 | |
| *** gkadam has quit IRC | 07:34 | |
| *** surpatil|brb has joined #oooq | 07:37 | |
| *** apetrich has quit IRC | 07:39 | |
| *** ykarel is now known as ykarel|lunch | 07:39 | |
| *** apetrich has joined #oooq | 07:40 | |
| *** apetrich has quit IRC | 07:45 | |
| zbr | morning! can we merge https://review.opendev.org/#/c/679409/ ? | 07:48 |
|---|---|---|
| *** apetrich has joined #oooq | 07:52 | |
| *** holser has joined #oooq | 07:53 | |
| zbr | arxcruz: ping me when you are ready for a molecular experiment | 07:54 |
| *** jtomasek has joined #oooq | 08:06 | |
| arxcruz | zbr: ack | 08:23 |
| *** panda|rover has quit IRC | 08:23 | |
| arxcruz | sshnaidm|afk: i'm getting this: | 08:23 |
| arxcruz | 2019-09-09 16:07:21 | 2019-09-09 16:07:04Z [overcloud.Controller.1.Controller]: CREATE_FAILED ResourceInError: resources.Controller: Went to status ERROR due to "Message: Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance 8c2be614-9f6a-4c75-b5fe-67faa3902b01., Code: 500" | 08:23 |
| arxcruz | any idea ? | 08:23 |
| arxcruz | ovb job | 08:24 |
| *** panda has joined #oooq | 08:24 | |
| *** derekh has joined #oooq | 08:33 | |
| *** soniya29 has quit IRC | 08:34 | |
| *** sshnaidm|afk is now known as sshnaidm|ruck | 08:37 | |
| sshnaidm|ruck | arxcruz, where? | 08:38 |
| arxcruz | sshnaidm|ruck: http://logs.rdoproject.org/00/673400/23/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/909edb4/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 08:42 |
| arxcruz | it's on a check job, but it's consistent :/ | 08:42 |
| arxcruz | and the change doesn't affect it | 08:42 |
| *** surpatil|brb has quit IRC | 08:43 | |
| *** surpatil has joined #oooq | 08:44 | |
| chandankumar | marios: https://review.opendev.org/#/c/681179/ | 08:44 |
| chandankumar | marios: left nitpick | 08:44 |
| sshnaidm|ruck | arxcruz, controller is not created from first time, but it's created later, look at Stack CREATE completed successfully | 08:44 |
| arxcruz | sshnaidm|ruck: you're right | 08:45 |
| arxcruz | sshnaidm|ruck: but it's failing the deployment and i don't know why | 08:46 |
| arxcruz | sshnaidm|ruck: nevermind, it's timeout | 08:46 |
| arxcruz | i'll try to run the reproducer | 08:46 |
| marios | chandankumar: ack thanks | 08:50 |
| chandankumar | sshnaidm|ruck: Hello | 08:54 |
| sshnaidm|ruck | chandankumar, hi | 08:55 |
| chandankumar | sshnaidm|ruck: https://review.opendev.org/#/c/655423/59/roles/validate-tobiko/tasks/tobiko-results.yml@26 does it need to be handled on collect-logs side or use sudo permission there? | 08:55 |
| sshnaidm|ruck | arxcruz, yeah, many ovb jobs fail with timeout now, known issue.. | 08:55 |
| sshnaidm|ruck | chandankumar, this directory is created in collect-logs with become, user can't write to /var/log | 08:57 |
| sshnaidm|ruck | chandankumar, not sure why this in "extras", why not in "working_dir"? | 08:58 |
| sshnaidm|ruck | chandankumar, like we have tempest.html there | 08:58 |
| chandankumar | sshnaidm|ruck: ok, we need to dump the logs in working_dir and add a task in collect logs to copy there? | 08:58 |
| sshnaidm|ruck | chandankumar, it's not logs, I see one html file | 08:59 |
| sshnaidm|ruck | {{ tobiko_log_file }}.html | 08:59 |
| sshnaidm|ruck | chandankumar, it's same format as tempest.html | 08:59 |
| sshnaidm|ruck | chandankumar, maybe we can even add stackviz there.. in future | 09:00 |
| chandankumar | sshnaidm|ruck: https://github.com/openstack/ansible-role-collect-logs/blob/67821d2c4992d129a0b59cbfefab08358f547577/tasks/publish.yml#L89 | 09:00 |
| *** ykarel|lunch is now known as ykarel| | 09:01 | |
| *** ykarel| is now known as ykarel | 09:01 | |
| chandankumar | sshnaidm|ruck: thanks, commented on the review | 09:02 |
| sshnaidm|ruck | chandankumar, I think collect-logs will automatically copy all html files from working_dir | 09:02 |
| chandankumar | sshnaidm|ruck: nope https://github.com/openstack/ansible-role-collect-logs/blob/67821d2c4992d129a0b59cbfefab08358f547577/tasks/publish.yml#L86 | 09:04 |
| sshnaidm|ruck | chandankumar, well, or not: https://github.com/openstack/tripleo-ci/blob/master/toci-quickstart/config/collect-logs.yml#L22-L28 | 09:04 |
| chandankumar | we are explicitly coping | 09:04 |
| sshnaidm|ruck | chandankumar, undercloud/home/stack/tempest/tempest - it's not for CI \ | 09:05 |
| chandankumar | *copyinh | 09:05 |
| chandankumar | sshnaidm|ruck: oh ok | 09:05 |
| sshnaidm|ruck | chandankumar, this publish.yaml looks awful.. need to rewrite it completely | 09:08 |
| chandankumar | sshnaidm|ruck: ok, will create a user story for that | 09:09 |
| chandankumar | kopecmartin: ^^ | 09:09 |
| sshnaidm|ruck | chandankumar, "/home/stack" doesn't exist in CI, so it always fails | 09:10 |
| sshnaidm|ruck | and "|| true" there to hide it... awful | 09:10 |
| *** jaosorior has joined #oooq | 09:11 | |
| *** rfolco has joined #oooq | 09:14 | |
| sshnaidm|ruck | marios, hi, answered on https://review.opendev.org/#/c/681048/ | 09:17 |
| marios | sshnaidm|ruck: thx revoted | 09:19 |
| *** soniya29 has joined #oooq | 09:22 | |
| sshnaidm|ruck | bogdando, hi, can you please explain why it's needed? https://review.rdoproject.org/r/#/c/22154/ | 09:29 |
| bogdando | sshnaidm|ruck: zuul places comments on the patches if configs are wrong | 09:30 |
| sshnaidm|ruck | bogdando, right (sometimes) | 09:30 |
| bogdando | :) | 09:30 |
| sshnaidm|ruck | bogdando, but what is this change for? | 09:31 |
| bogdando | debugging experience improving | 09:31 |
| bogdando | say you want to amend the patch submitted for testing | 09:31 |
| bogdando | and using os_autohold_node=false | 09:31 |
| bogdando | to retry the job and see if it doesn't start for a reason | 09:32 |
| bogdando | so no need to grep scheduler logs and search if it says something about broken zuul config | 09:32 |
| bogdando | it will post it on the patch | 09:32 |
| sshnaidm|ruck | bogdando, yeah, but I don't understand how this patch is related to that | 09:34 |
| bogdando | w/o it, no comments provided | 09:34 |
| sshnaidm|ruck | bogdando, you create zuul.yaml a little before it's created by script | 09:34 |
| bogdando | by zuul in the patch | 09:34 |
| bogdando | I commit it | 09:34 |
| bogdando | it needs to be commited | 09:34 |
| bogdando | then we submit the zuul.yaml under test | 09:34 |
| bogdando | and now zuul can post comments onto it | 09:35 |
| sshnaidm|ruck | bogdando, so you mean zuul.yaml should present in the repo yet before any change? | 09:35 |
| bogdando | yes | 09:35 |
| bogdando | with empty check jobs | 09:36 |
| bogdando | like p[ | 09:36 |
| bogdando | [] | 09:36 |
| sshnaidm|ruck | bogdando, well, this is very not obvious :) | 09:36 |
| bogdando | just that Paul recommended, and it worked for me :) | 09:36 |
| bogdando | not the job tho, just comments on failed configs :( | 09:36 |
| marios | https://www.theregister.co.uk/2019/09/09/the_end_of_python_2_2020/ zbr :D | 09:37 |
| sshnaidm|ruck | bogdando, great, I think it worth a few more words in commit, because it's something from internal knowledge of zuul devs | 09:37 |
| bogdando | will do | 09:38 |
| sshnaidm|ruck | bogdando, thanks for explanation, good to know such things | 09:38 |
| sshnaidm|ruck | bogdando, and for your reproducer improvements :) | 09:38 |
| bogdando | sshnaidm|ruck: currently I'm trying to fix the same issue rlandy had in the past http://eavesdrop.openstack.org/irclogs/%23zuul/%23zuul.2018-12-06.log.html#t2018-12-06T15:32:11 | 09:43 |
| bogdando | https://review.opendev.org/681182 | 09:43 |
| bogdando | that patch seems did not that I expected, may be I need better dance with that delegate_facts... like in the set_facts itself?.. | 09:43 |
| bogdando | reading https://medium.com/opsops/perfecting-fact-gathering-in-ansible-d367b45cbda6 and it looks confusing | 09:44 |
| sshnaidm|ruck | bogdando, hmm.. but there are no facts in this task, it's just command task | 09:47 |
| sshnaidm|ruck | bogdando, btw, don't you need to set also gate jobs=[] in https://review.rdoproject.org/r/#/c/22154/ ? | 09:54 |
| sshnaidm|ruck | or it's enough to have check | 09:55 |
| sshnaidm|ruck | chandankumar, wrt https://review.opendev.org/#/c/655423/59/roles/validate-tobiko/tasks/tobiko-results.yml - html is not in the list | 10:03 |
| sshnaidm|ruck | chandankumar, so it's not taken by collect logs automatically, we can add tobiko files to collect-logs config though | 10:04 |
| chandankumar | sshnaidm|ruck: ok | 10:04 |
| *** udesale has quit IRC | 10:09 | |
| *** surpatil has quit IRC | 10:09 | |
| *** apetrich has quit IRC | 10:10 | |
| kopecmartin | what is the new link for grafana dashboard cockpit thing? the one i have bookmarked is no longer valid it seems | 10:10 |
| *** surpatil has joined #oooq | 10:10 | |
| *** udesale has joined #oooq | 10:10 | |
| sshnaidm|ruck | kopecmartin, use http://cockpit-ci.tripleo.org it always points to current dashboard | 10:17 |
| sshnaidm|ruck | kopecmartin, or dashboard-ci.tripleo.org and then choose the board | 10:18 |
| kopecmartin | sshnaidm|ruck: cool, thanks | 10:18 |
| sshnaidm|ruck | folks, please review sova patch https://review.opendev.org/#/c/678630/ | 10:20 |
| chandankumar | arxcruz: I think you know this person akahat :-) | 10:38 |
| chandankumar | sshnaidm|ruck: does someone looking at ansible time out issue during overcloud deploy? | 10:56 |
| sshnaidm|ruck | chandankumar, in ovb jobs? | 10:57 |
| chandankumar | sshnaidm|ruck: yes in ovb, fs039 | 10:57 |
| sshnaidm|ruck | chandankumar, I suspect it's because of 10 days w/o master promotion, so maybe ok when we promote | 10:57 |
| chandankumar | sshnaidm|ruck: ok | 10:57 |
| sshnaidm|ruck | chandankumar, and I hope we do it today | 10:58 |
| *** jpena is now known as jpena|lunch | 10:59 | |
| *** udesale has quit IRC | 11:14 | |
| bogdando | sshnaidm|ruck: reproducer only checks, does not merge | 11:16 |
| bogdando | at least for the first execution | 11:16 |
| bogdando | so we don't need gate configs prolly | 11:16 |
| sshnaidm|ruck | bogdando, ack.. fixing CI for reproducer now, to let these patches in | 11:21 |
| arxcruz | chandankumar: ? | 11:28 |
| *** ykarel is now known as ykarel|afk | 11:50 | |
| zbr | sshnaidm|ruck: are we now good with https://review.opendev.org/#/c/679409/ ? | 11:52 |
| sshnaidm|ruck | zbr, let me finish with master promotion please | 11:53 |
| zbr | sshnaidm|ruck: so I guess we are very close to it | 11:53 |
| sshnaidm|ruck | zbr, and it should be tested better than previous one, when we hit problems with rhel8 | 11:53 |
| sshnaidm|ruck | zbr, do you have a patch that removes all "hostvars" configs? | 11:55 |
| zbr | nope | 11:56 |
| sshnaidm|ruck | zbr, good to have it, it was the reason why we move to 2.8 actually | 11:57 |
| zbr | i would say that consistency is a better reason / not having to wonder why some code behaves differently... | 11:58 |
| sshnaidm|ruck | zbr, so are you going to prepare this patch? | 12:03 |
| zbr | sshnaidm|ruck: plan too, after i close bj | 12:04 |
| weshay | morning | 12:07 |
| *** jpena|lunch is now known as jpena | 12:10 | |
| *** apetrich has joined #oooq | 12:12 | |
| sshnaidm|ruck | weshay, hi, I don't know if to make it promotion-blocker bug: https://bugs.launchpad.net/tripleo/+bug/1843422 | 12:20 |
| openstack | Launchpad bug 1843422 in tripleo "OVB featureset039 all-TLS job fails in master" [Critical,Triaged] | 12:20 |
| sshnaidm|ruck | weshay, it hardly works in master, I removed it temporarly from master criteria | 12:21 |
| weshay | sshnaidm|ruck agree master is foobar'd . Let's get in touch w/ harry and see how they want to proceed | 12:22 |
| weshay | sshnaidm|ruck can we double check that featureset is close to fs001 | 12:22 |
| *** rlandy has joined #oooq | 12:23 | |
| sshnaidm|ruck | weshay, yeah, will check | 12:23 |
| rfolco | marios, panda rlandy: I just realized that our sync mtg conflicts with bug triage one | 12:29 |
| rlandy | rfolco: we need to sync | 12:29 |
| marios | rfolco: ok.. so lets take it up on the community call then... | 12:29 |
| marios | rlandy: ? | 12:29 |
| marios | and take it from there | 12:29 |
| rlandy | ok - I just don;t want to ditch the meeting altogether | 12:30 |
| marios | rlandy: ack but not sure what else to do ... meeting is meant to start now | 12:30 |
| rlandy | marios: ack - that's fine | 12:30 |
| rfolco | go without me, will catch up with you guys later | 12:30 |
| marios | rfolco: panda rlandy lets sync @ community meeting then and continue from there | 12:31 |
| rlandy | marios: thanks for the vm setup instructions | 12:31 |
| * marios really needs to talk about the manifests, too | 12:31 | |
| marios | rlandy: ack thanks panda for walking me through it | 12:31 |
| rlandy | at least I have a working env now | 12:31 |
| rlandy | py 36 test worry me though | 12:31 |
| rlandy | fedora | 12:31 |
| rfolco | chandankumar, weshay: are we going to do bug triage now? | 12:32 |
| rfolco | I'm happy to do it offline if you can't | 12:32 |
| *** apetrich has quit IRC | 12:33 | |
| *** surpatil has quit IRC | 12:33 | |
| weshay | chandankumar rfolco ya | 12:34 |
| * weshay joins | 12:34 | |
| panda | marios: can I see those instructions ? | 12:34 |
| *** soniya29 has quit IRC | 12:34 | |
| marios | panda: its bash history rlandy do you have the link i gave yesterday? | 12:34 |
| marios | panda: not instructions | 12:35 |
| panda | marios: ok then maybe I have it already | 12:35 |
| rlandy | marios: http://pastebin.test.redhat.com/794626 | 12:36 |
| weshay | chandankumar join our bug scrub | 12:36 |
| weshay | chandankumar also you see I still have a bug there in rc.local | 12:36 |
| weshay | but the box is up :) | 12:36 |
| chandankumar | weshay: but earlier the labs dir was empty | 12:37 |
| weshay | chandankumar ya.. the image was not updated | 12:37 |
| weshay | chandankumar goal.. is to have the labs and rpms preinstalled w/ that customize script | 12:37 |
| chandankumar | weshay: ok | 12:38 |
| chandankumar | weshay: we also need to pre install wget there | 12:38 |
| *** derekh has quit IRC | 12:43 | |
| *** derekh has joined #oooq | 12:43 | |
| weshay | chandankumar ah ya.. I have that | 12:44 |
| sshnaidm|ruck | weshay, +w please https://review.opendev.org/#/c/681048/ | 12:45 |
| *** aakarsh|3 has quit IRC | 12:46 | |
| sshnaidm|ruck | arxcruz, chandankumar can you please take a look at https://bugs.launchpad.net/tripleo/+bug/1843259 ? | 12:54 |
| openstack | Launchpad bug 1843259 in tripleo "Periodic rocky fs020 job fails tempest tests tempest.scenario.test_security_groups_basic_ops.TestSecurityGroupsBasicOps.test_cross_tenant_traffic and tempest.scenario.test_security_groups_basic_ops.TestSecurityGroupsBasicOps.test_multiple_security_groups " [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 12:54 |
| arxcruz | sshnaidm|ruck: i saw it yesterday, yeah, it seems to be a real one, need to talk with someone from keystone i guess ? | 12:55 |
| sshnaidm|ruck | arxcruz, keystone.. which dfg is it? <-- weshay ? | 12:55 |
| arxcruz | sshnaidm|ruck: not sure if keystone, the issue is, that the two vm's are able to ping each other, and should not, that's the issue with the test | 12:56 |
| arxcruz | so, there's no security, or security is not working properly | 12:56 |
| sshnaidm|ruck | arxcruz, mmm.. it's networking then | 12:56 |
| *** Goneri has joined #oooq | 12:57 | |
| *** udesale has joined #oooq | 12:57 | |
| *** hamzy_ has joined #oooq | 12:59 | |
| weshay | sshnaidm|ruck keystone is security | 13:00 |
| weshay | harry | 13:00 |
| sshnaidm|ruck | rfolco, are you doing bug triage? | 13:03 |
| rfolco | sshnaidm|ruck, yes | 13:03 |
| panda | where do we do community call ? | 13:03 |
| sshnaidm|ruck | Tripleo CI community meeting - https://bluejeans.com/5878458097 (NEW*) | 13:07 |
| *** ykarel|afk is now known as ykarel | 13:10 | |
| weshay | zbr check out doug hellman's email on rh-openstack-dev | 13:20 |
| weshay | zbr let me know what you think about that | 13:20 |
| *** aakarsh|3 has joined #oooq | 13:21 | |
| sshnaidm|ruck | rfolco, https://bugs.launchpad.net/tripleo/+bug/1841941 is not promotion blocker | 13:22 |
| openstack | Launchpad bug 1841941 in tripleo "Cannot run scenario4 on rhel8 due to missing pcs required by manila" [Critical,Triaged] | 13:22 |
| *** skramaja has quit IRC | 13:23 | |
| weshay | sshnaidm|ruck it's on the cix board.. so either way.. we're good on that bug | 13:24 |
| zbr | weshay: i agree with him. as you probably observed I got enough of waiting for it and I find outselves put in a very bad situation | 13:24 |
| zbr | as in make in work without having a base | 13:24 |
| *** aakarsh|2 has joined #oooq | 13:24 | |
| *** ratailor has quit IRC | 13:25 | |
| zbr | all that fedora28 work... | 13:25 |
| zbr | weshay: if I would be on a decision making position I would say: yes, we will start working on that when the requirement is available (at least a pre-release) | 13:26 |
| *** aakarsh|3 has quit IRC | 13:27 | |
| sshnaidm|ruck | zbr, weshay centos7 supports some python3, epel contains even python-3.6 for it | 13:31 |
| zbr | sshnaidm|ruck: weshay re py3 and centos, please read https://bugs.centos.org/view.php?id=16389 | 13:32 |
| zbr | without selinux, py3 on c7 is *useless* AFAIK. | 13:33 |
| zbr | and they do not want to fix it (maybe some extra peer pressure could make them change their mind?) | 13:33 |
| rfolco | sshnaidm|ruck, can remove if is not right. | 13:35 |
| sshnaidm|ruck | rfolco, I don't think we need it, script may duplicate it in CIX board | 13:35 |
| *** Vorrtex has joined #oooq | 13:47 | |
| *** gouthamr has left #oooq | 13:50 | |
| *** jtomasek has quit IRC | 14:00 | |
| *** jtomasek has joined #oooq | 14:01 | |
| *** aakarsh|3 has joined #oooq | 14:02 | |
| *** aakarsh|2 has quit IRC | 14:05 | |
| weshay | sshnaidm|ruck it checks the board before adding | 14:14 |
| weshay | sshnaidm|ruck re: the script | 14:14 |
| weshay | perhaps I need to add the new column | 14:14 |
| weshay | will check that | 14:14 |
| sshnaidm|ruck | weshay, ok | 14:14 |
| *** surpatil has joined #oooq | 14:14 | |
| zbr | panda: rlandy : i added some fixes on https://review.rdoproject.org/r/#/c/21895/ -- but tests are still failing, please have a look. | 14:23 |
| rlandy | zbr: ack - on the same issue | 14:23 |
| rlandy | the missing http+docker://localhost/v1.35...tion/tripleomaster/hello-world:cc26d47faedf3643237cfb494d001d1add50267c/json | 14:24 |
| rlandy | at least it's consistent | 14:24 |
| zbr | i will look on the molecule result now, clearly it should produce a valid results.html, it does not and I will fix that. | 14:25 |
| *** dtantsur is now known as dtantsur|afk | 14:25 | |
| panda | maybe ti's better that we create the staging containers directly | 14:27 |
| panda | zbr: rlandy that happens beacuase the staging environment needs the staging containers to handle. Maybe the step to pull them is missing, and at this point it may be better if we create them locally and then mangle them, one less weak point | 14:30 |
| rlandy | zbr: why did you remove all those deps? | 14:32 |
| rlandy | panda: should we pull them? | 14:32 |
| rlandy | isn't that the real test? | 14:33 |
| zbr | rlandy: unittests and molecule tests have different requirements. we do not want to combine them. | 14:34 |
| panda | rlandy: the promoter logic will pull them, but to put them there in the first place, we can create them locally. | 14:34 |
| rlandy | panda: create them in https://review.rdoproject.org/r/#/c/21895/27/ci-scripts/infra-setup/roles/promoter/tasks/setup_staging.yaml? | 14:35 |
| rlandy | or in https://review.rdoproject.org/r/#/c/21895/27/ci-scripts/dlrnapi_promoter/tests/staging-setup/test_staging_environment.py? | 14:36 |
| panda | rlandy: in stagig_setup.yaml or in the staging_setup.py, whatever is easier. We just need a file, a Dockerfile and the docker build command. see https://github.com/openstack/ansible-role-container-registry/blob/master/molecule/login/playbook.yml#L153 | 14:37 |
| *** Vorrtex has quit IRC | 14:37 | |
| *** ykarel is now known as ykarel|afk | 14:42 | |
| rlandy | zbr: where do we put the molecule requirements then? | 14:42 |
| rlandy | we still need the molecule tests to pass | 14:42 |
| chandankumar | weshay: I will take a look at the stuff tomorrow | 14:50 |
| *** akahat has quit IRC | 14:52 | |
| rlandy | panda: http://pastebin.test.redhat.com/795973 | 14:56 |
| rlandy | ^^ like this? | 14:57 |
| rlandy | I can't read the full path to see where it expects the file | 14:57 |
| *** udesale has quit IRC | 15:00 | |
| *** udesale has joined #oooq | 15:00 | |
| zbr | rlandy: panda: i see that you are doing something fishy: trying to run docker in a unittest job, which do not have docker installed on them. | 15:05 |
| zbr | on rdo tox-py* are running as containers, so no chance of installing docker on them. | 15:05 |
| zbr | on the other hand rdo-tox-molecule job does have a docker setup on it. | 15:05 |
| arxcruz | sshnaidm|ruck: i'm having problems with the reproducer | 15:05 |
| arxcruz | it's on ansible-role-tripleo-ci-reproducer : Wait for job to start | 15:05 |
| arxcruz | and then timeout | 15:06 |
| arxcruz | i'm using rdo-cloud | 15:06 |
| rlandy | zbr: we need to separate molecule and the py tests | 15:06 |
| sshnaidm|ruck | arxcruz, is it first run? | 15:06 |
| rlandy | I am running the molecule tests on my test vm | 15:06 |
| rlandy | do you want access to that? | 15:06 |
| arxcruz | sshnaidm|ruck: i tried a few times, now i remove all docker stuff, reboot the machine, and trying again | 15:06 |
| rlandy | also installed docker-ce there | 15:07 |
| rlandy | so it's different | 15:07 |
| sshnaidm|ruck | arxcruz, just wait 15-20 min and come back checking if tenant is ready: http://localhost:9000/t/tripleo-ci-reproducer/status | 15:07 |
| sshnaidm|ruck | arxcruz, it takes some more time that planned.. | 15:07 |
| *** surpatil has quit IRC | 15:08 | |
| sshnaidm|ruck | arxcruz, it takes 1.2 glass of beer time | 15:08 |
| panda | zbr: rlandy the stating environment python script is tested with tox -epy*, it's python | 15:08 |
| zbr | rlandy: i already did the split. | 15:08 |
| zbr | panda: maybe you can explain http://logs.rdoproject.org/95/21895/29/check/tox-py27/47c461b/tox/reports.html | 15:09 |
| zbr | this code is not molecule, but it tries to use docker. | 15:09 |
| zbr | afaik i am done with fixing the way jobs are triggered, all report real code errors now. | 15:10 |
| panda | zbr: it's the staging environment preparation, we are preparing containers to be availabe to the promotion process | 15:10 |
| zbr | panda: are you trying to run docker commands? you cannot do this in a unittest job. | 15:10 |
| panda | rlandy: line 23 of your paste, for now it should be ok, but you need to remove the :v1.35 at the end | 15:10 |
| panda | zbr: not even in a functional test ? :( do I have to mock docker ? | 15:11 |
| zbr | panda: mock for unit, or move this test to run in molecule job, and be sure is not run as unit. | 15:11 |
| panda | zbr: yes, probably the test should be self contained on a single repo | 15:11 |
| zbr | panda: here is a hint: add @pytest.mark.webtest before the test to assure it will be run by molecule job instead of tox-py* ones. | 15:12 |
| zbr | sorry: @pytest.mark.molecule | 15:12 |
| panda | zbr: there's nothing molecule related there | 15:13 |
| weshay | sshnaidm|ruck you have a sec to review what fs001 rhel8 is running against | 15:13 |
| zbr | is the fact that you need docker, and you do not have docker. | 15:13 |
| weshay | it's not running often enough in check afaict | 15:13 |
| panda | zbr: do we really need to run this on molecule ? also, docker on docker again | 15:13 |
| weshay | sshnaidm|ruck https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001 | 15:13 |
| weshay | should at least be running against ci related changes | 15:13 |
| zbr | you need to run it on a machine that has docker, unittests do not have. | 15:13 |
| arxcruz | sshnaidm|ruck: http://paste.openstack.org/show/774839/ | 15:14 |
| *** saneax has quit IRC | 15:14 | |
| arxcruz | sshnaidm|ruck: so, i need to rerun again in a few minutes ? | 15:14 |
| panda | zbr: I need a more comprehensive explanation | 15:14 |
| zbr | panda: if you prefer you can even add @pytest.mark.docker -- but be sure you change tox.ini command to add: -m "not docker" for py* envs. | 15:14 |
| zbr | let me grab a coffee, 3min | 15:15 |
| panda | zbr: why can't the unit tests run docker. Also, I'm testing the classes there, not the single methods. It's more functional than unit | 15:15 |
| rlandy | sec - call | 15:15 |
| weshay | sshnaidm|ruck sorry to bug you.. have a sec? | 15:15 |
| sshnaidm|ruck | weshay, yep | 15:16 |
| weshay | sshnaidm|ruck ok.. blue | 15:16 |
| sshnaidm|ruck | arxcruz, just. wait. | 15:17 |
| rlandy | panda: thanks - I'll add that change as soon as zbr tells us he is done | 15:18 |
| panda | rlandy: zbr needs to explain what we need to change in the testing and why ... | 15:19 |
| rlandy | panda: zbr: should we meet? would that be quicker? | 15:19 |
| zbr | https://bluejeans.com/2655417928 | 15:22 |
| panda | rlandy: meeting is quicker, just waiting for zbr to caffeinate himself. | 15:22 |
| zbr | to-read: http://doc.pytest.org/en/latest/example/markers.html | 15:23 |
| zbr | rlandy: ^ please join | 15:23 |
| *** holser has quit IRC | 15:34 | |
| *** holser has joined #oooq | 15:39 | |
| *** apetrich has joined #oooq | 15:41 | |
| *** ykarel|afk is now known as ykarel|away | 15:42 | |
| *** surpatil has joined #oooq | 15:43 | |
| *** ykarel|away has quit IRC | 15:47 | |
| * marios almost out | 15:50 | |
| *** holser has quit IRC | 16:00 | |
| *** marios is now known as marios|out | 16:03 | |
| weshay | marios|out always makes me so nervous when he says that | 16:04 |
| *** ykarel|away has joined #oooq | 16:06 | |
| *** tesseract has quit IRC | 16:06 | |
| *** jfrancoa has quit IRC | 16:07 | |
| *** aakarsh|2 has joined #oooq | 16:10 | |
| sshnaidm|ruck | rlandy, don't we have injection of dlrn_hash to jobs with tripleo-repos? just in case.. | 16:11 |
| rlandy | sshnaidm|ruck: not sure I understand the question ... | 16:12 |
| rlandy | are you asking me if we do have injection? | 16:12 |
| rlandy | you can specify the hash as a var | 16:12 |
| sshnaidm|ruck | rlandy, like dlrn_hash_tag with featureset_overrides, but for jobs with tripleo-repos like building jobs | 16:12 |
| *** aakarsh|3 has quit IRC | 16:13 | |
| sshnaidm|ruck | rlandy, because dlrn_hash_tag will work only with jobs that uses repo-setup role | 16:13 |
| rlandy | yeah | 16:13 |
| rlandy | we can use that override code elsewhere | 16:13 |
| rlandy | the var should always default | 16:13 |
| sshnaidm|ruck | rlandy, it does not work with jobs using tripleo-repos role | 16:14 |
| rlandy | sshnaidm|ruck: k - if you want to create a bug, I'll look at it | 16:14 |
| chandankumar | panda: how is the jobs working on centos 7.7 in fs021? | 16:15 |
| *** kopecmartin is now known as kopecmartin|off | 16:16 | |
| rlandy | zbr: http://logs.rdoproject.org/95/21895/33/check/tox-py27/412fc1f/tox/reports.html | 16:17 |
| *** marios|out has quit IRC | 16:18 | |
| panda | chandankumar: did not check in fs021, but centos7.7 is working in all the environments. | 16:18 |
| chandankumar | panda: https://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset021-master/84b1a81/job-output.txt.gz | 16:18 |
| chandankumar | from this one stuff looks good to me | 16:18 |
| panda | chandankumar: and here we have the rest https://review.opendev.org/618780 | 16:19 |
| rlandy | zbr: http://pastebin.test.redhat.com/796016 | 16:20 |
| weshay | panda++ | 16:21 |
| chandankumar | panda: thanks :-) | 16:23 |
| panda | chandankumar: this is testing both centos7.7. during deployment and even before quickstart is started. there's an additional task there that updates the node to centos7.7 before anything else. | 16:28 |
| chandankumar | panda: oh, great :-) | 16:29 |
| * chandankumar is talking cr too much, now people are talking on infra channel also | 16:29 | |
| *** jpena is now known as jpena|off | 16:39 | |
| *** derekh has quit IRC | 16:44 | |
| *** ykarel|away has quit IRC | 16:54 | |
| rlandy | TASK [Staged promotion run] **************************************************** | 16:56 |
| rlandy | ERROR! Could not find specified file in role: tasks/promotion_run | 16:56 |
| rlandy | ignore_errors did not fix that | 16:56 |
| rlandy | panda: hmmm ^^ can you put a block rescue within an always | 16:58 |
| panda | rlandy: mmmhh, nested blocks | 17:01 |
| panda | rlandy: that task should not belong to the always branch | 17:01 |
| panda | rlandy: should not be part of the cleanup | 17:02 |
| rlandy | panda: ok - so I am looking for where that call is | 17:02 |
| rlandy | in staging_environment.py teardown | 17:02 |
| rlandy | python {{ ci_config_remote_src_dir }}/ci-scripts/dlrnapi_promoter/tests/staging-setup/staging_environment.py teardown --env-id 12345 | 17:03 |
| *** brault has joined #oooq | 17:03 | |
| rlandy | all I see that is executed | 17:03 |
| *** ykarel|away has joined #oooq | 17:03 | |
| panda | rlandy: ok, so your goal is to not fail the playbook when https://review.rdoproject.org/r/#/c/21895/33/ci-scripts/infra-setup/roles/promoter/molecule/default/playbook.yml@104 fails | 17:05 |
| rlandy | ah | 17:06 |
| *** gouthamr has joined #oooq | 17:06 | |
| panda | rlandy: that's where the ignore_errors (or block:..rescue:) is needed | 17:06 |
| rlandy | I am not sure that will work - but let's try | 17:07 |
| panda | rlandy: the staging preparation passes successfully because i'm not testing that the containers are uploaded successfully | 17:07 |
| rlandy | panda: k - trying the rescue but here | 17:07 |
| rlandy | bit | 17:07 |
| panda | so technically for the playbook, that part passes | 17:07 |
| *** brault has quit IRC | 17:08 | |
| panda | rlandy: I don't see why it shouldn't work but if it still doesn't comment that part and move on | 17:09 |
| rlandy | k - testing out - few minutes | 17:09 |
| *** udesale has quit IRC | 17:12 | |
| *** brault has joined #oooq | 17:22 | |
| *** brault has quit IRC | 17:27 | |
| *** jtomasek has quit IRC | 17:37 | |
| *** surpatil has quit IRC | 17:47 | |
| rlandy | stderr: 'usermod: group ''993'' does not exist' | 18:15 |
| rlandy | panda: zbr: hmm ... we're not better off | 18:15 |
| rlandy | ^^ | 18:15 |
| rlandy | and still missing image | 18:15 |
| panda | rlandy: usermod -g should work with groud ids | 18:22 |
| panda | rlandy: instead of -G | 18:23 |
| rlandy | panda:looking at marios notes he had -a -G | 18:24 |
| rlandy | oh nvm that was a name | 18:24 |
| rlandy | correcting | 18:25 |
| panda | rlandy: on second thought | 18:29 |
| panda | rlandy: if a group does not have a name it probably doesn't exist | 18:29 |
| panda | rlandy: and you can't add user to it | 18:29 |
| panda | rlandy: so maybe it's better to add this group to the system | 18:29 |
| rlandy | sudo usermod -a -G <name> {{ promoter_user }}" | 18:30 |
| rlandy | E requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http+docker://localhost/v1.35/distribution/tripleomaster/hello-world:cc26d47faedf3643237cfb494d001d1add50267c/json | 18:32 |
| rlandy | well we are back with that | 18:32 |
| rlandy | gid seemed to work | 18:32 |
| rlandy | need to be there | 18:34 |
| *** saneax has joined #oooq | 18:35 | |
| panda | rlandy: mh,pytest didn't skip the test there then | 18:36 |
| rlandy | maybe we didn;t save that condition | 18:36 |
| panda | adding @pytest.mark.docker should have been enough | 18:37 |
| rlandy | stderr: 'usermod: group ''993'' does not exist' | 18:37 |
| rlandy | so gid did not work | 18:37 |
| panda | rlandy: yep, you need to be sure the group exists first | 18:37 |
| rlandy | creating | 18:38 |
| *** ykarel|away has quit IRC | 18:39 | |
| rlandy | panda: is the group name docker? | 18:46 |
| rlandy | is that set somewhere? | 18:46 |
| rlandy | ie: via variable? | 18:46 |
| zbr | panda: i am afraid we may need to add -m "not docker" to pytest. | 18:47 |
| zbr | if i remember well the inclusion is implicit for markers. | 18:47 |
| rlandy | zbr - will try that | 18:50 |
| rlandy | editing the tests anyways | 18:50 |
| panda | zbr: rlandy yes tested with tox, we need to add -m "not molecule and not docker" | 18:53 |
| zbr | yeah, until I find a better way lets do that. i am also out, too late. | 18:53 |
| panda | rlandy: docker group name, yes | 18:53 |
| panda | zbr: there's no better way | 18:53 |
| panda | there is only zuul | 18:54 |
| *** panda is now known as panda|rover|off | 18:54 | |
| panda|rover|off | zbr: we should register markers .. | 19:00 |
| zbr | panda|rover|off: is there life after zuul? | 19:00 |
| zbr | time to netfix for me | 19:00 |
| *** holser has joined #oooq | 19:03 | |
| *** aakarsh|3 has joined #oooq | 19:05 | |
| *** aakarsh|2 has quit IRC | 19:07 | |
| *** saneax has quit IRC | 19:08 | |
| rlandy | rdo-infra/ci-config | 19:10 |
| rlandy | 21895,36 | 19:10 |
| rlandy | 3 min | 19:10 |
| rlandy | 6 min | 19:10 |
| rlandy | tox-linterssuccess | 19:10 |
| rlandy | tripleo-ci-promotion-stagingsuccess (non-voting) | 19:10 |
| rlandy | rdo-tox-molecule | 19:10 |
| rlandy | (non-voting) | 19:10 |
| rlandy | tox-jjbsuccess | 19:11 |
| rlandy | tox-py27success | 19:11 |
| rlandy | tox-py36 | 19:11 |
| rlandy | getting there | 19:11 |
| rlandy | panda|rover|off: zbr: ^^ | 19:11 |
| *** panda|rover|off has quit IRC | 19:37 | |
| *** panda has joined #oooq | 19:38 | |
| sshnaidm|ruck | please vote https://review.opendev.org/#/c/681302/ | 19:46 |
| *** aakarsh|2 has joined #oooq | 19:46 | |
| *** aakarsh|3 has quit IRC | 19:49 | |
| rfolco | weshay, https://tree.taiga.io/project/tripleo-ci-board/task/1245 has the design w/ the drawings, please review. | 19:53 |
| weshay | thanks | 19:57 |
| weshay | ! | 19:57 |
| weshay | rfolco these are nice man | 20:00 |
| weshay | rfolco what tool are you using to make these? | 20:00 |
| rfolco | weshay, draw.io, links are in the task for the source, all saved in our multi-arch folder in google drive | 20:04 |
| weshay | nice man | 20:12 |
| *** aakarsh|2 has quit IRC | 20:19 | |
| *** Goneri has quit IRC | 21:00 | |
| rlandy | weshay: hey there | 21:06 |
| rlandy | weshay: remember this error: http://logs.rdoproject.org/95/21895/39/check/rdo-tox-molecule/f603bf8/tox/reports.html | 21:06 |
| rlandy | [31m[1mE ImportError: No module named mock[0m | 21:07 |
| *** holser has quit IRC | 21:15 | |
| *** holser has joined #oooq | 21:24 | |
| *** sshnaidm|ruck is now known as sshnaidm|afk | 21:33 | |
| weshay | rlandy ya | 21:36 |
| * weshay looks | 21:36 | |
| rlandy | weshay: nvm - fixed that error | 21:36 |
| weshay | heh k | 21:36 |
| rlandy | got one error left to getting the staging stuff to mergable | 21:37 |
| weshay | nice.. even the python3.6? | 21:38 |
| rlandy | weshay: https://review.rdoproject.org/r/#/c/21895/ | 21:40 |
| rlandy | check it out | 21:40 |
| rlandy | greeeeeeennnnnnnnn | 21:40 |
| rlandy | weshay: pls also check the design on https://tree.taiga.io/project/tripleo-ci-board/us/1211?milestone=238595 | 21:42 |
| rlandy | for anything missing | 21:43 |
| rlandy | rfolco: what's the situation with running the service as a script? | 21:43 |
| rlandy | ^^ we are ready to start developing python tests | 21:43 |
| rlandy | zbr: panda: if you're both happy with the changes on https://review.rdoproject.org/r/#/c/21895/, we can change the message and merge | 21:46 |
| rlandy | whatever - changing commit message so we are ready | 21:49 |
| *** panda has quit IRC | 22:26 | |
| *** panda has joined #oooq | 22:28 | |
| *** brault has joined #oooq | 22:43 | |
| *** holser has quit IRC | 22:46 | |
| *** holser has joined #oooq | 22:47 | |
| *** brault has quit IRC | 22:59 | |
| *** holser has quit IRC | 23:04 | |
| *** holser has joined #oooq | 23:05 | |
| *** holser has quit IRC | 23:09 | |
| rfolco | rlandy, still working on it. I'll try to get something for tomorrow | 23:55 |
| *** aakarsh|2 has joined #oooq | 23:58 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!