*** rlandy|afk is now known as rlandy | 00:22 | |
*** jmasud has quit IRC | 00:54 | |
*** jmasud has joined #oooq | 00:56 | |
*** Goneri has quit IRC | 02:00 | |
*** ysandeep|away is now known as ysandeep|rover | 02:02 | |
ysandeep|rover | weshay_, o/ | 02:10 |
---|---|---|
weshay_ | ysandeep|rover, hey | 02:10 |
weshay_ | ysandeep|rover, ovb is fixed | 02:10 |
weshay_ | was rdo cloud | 02:10 |
weshay_ | weee | 02:10 |
ysandeep|rover | weshay_, routing issue as we suspected? | 02:11 |
weshay_ | not sure if scenario001 is totally fixed .. it passed in promotion jobs.. so I bypassed the criteria and got master promoted | 02:11 |
weshay_ | ysandeep|rover, not sure.. they haven't said yet.. :( | 02:11 |
weshay_ | ysandeep|rover, so we're good on promotions http://rhos-release.virt.bos.redhat.com:3030/rhosp | 02:12 |
weshay_ | ysandeep|rover, I have a lot of ptl work to do this week.. it's m3 | 02:12 |
ysandeep|rover | weshay_, no worries.. I will try to put an extra eye monitoring the queues. | 02:13 |
weshay_ | ysandeep|rover, k.. cool and be on the look out for improvements etc.. downtime is a good time to improve this stuff | 02:14 |
weshay_ | ysandeep|rover, this would have blocked that collectd puppet issue https://review.opendev.org/#/c/717760/ | 02:15 |
ysandeep|rover | weshay_, yes just saw your email about this.. added myself as an observer on this gerrit | 02:16 |
weshay_ | ysandeep|rover, also creating centos-8 train containers and jobs to unblock EmilienM | 02:16 |
weshay_ | https://review.opendev.org/#/c/717850/ | 02:16 |
ysandeep|rover | looking | 02:17 |
weshay_ | I lost my login for my znc bouncer lolz | 02:17 |
weshay_ | DOH | 02:18 |
weshay_ | heh.. well.. molecule is working lolz https://80b696ebd10ce1a8679e-b5788ff47e43c8b1d4d7bc79b7243ed8.ssl.cf2.rackcdn.com/717850/1/check/openstack-tox-molecule/aa0bb20/tox/reports.html | 02:18 |
weshay_ | ysandeep|rover, looks like we need to build the overcloud-images as well.. to make the tests happy | 02:19 |
weshay_ | I have not updated the hackmd much today | 02:19 |
weshay_ | ysandeep|rover, was hoping you could xfer the ownership of the standalone hackmd you created to rh-openstack-ci | 02:20 |
weshay_ | in documentation | 02:20 |
ysandeep|rover | weshay_, done that already, yesterday | 02:20 |
rlandy | ysandeep|rover: oh wow - is it morning now for you? | 02:20 |
ysandeep|rover | rlandy, yes 7:50 in the morning :) | 02:21 |
rlandy | lol - I'm still trying to close out monday's work | 02:21 |
weshay_ | howdy rlandy :) | 02:21 |
rlandy | weshay_: hey | 02:21 |
rlandy | one review for you ... based off yours ... https://review.opendev.org/#/c/717895/ | 02:22 |
weshay_ | ah very nice | 02:22 |
rlandy | still need the pre before marios wakes up | 02:22 |
* weshay_ looks | 02:22 | |
weshay_ | rlandy, looks good | 02:23 |
rlandy | weshay_: we'll need a few internal vars | 02:23 |
weshay_ | aye | 02:24 |
rlandy | adding that to job def | 02:24 |
ysandeep|rover | weshay_, failed to validate https://images.rdoproject.org/centos8/train/rdo_trunk/tripleo-ci-testing/ironic-python-agent.tar .. https://images.rdoproject.org/centos8/ only master here | 02:25 |
weshay_ | ysandeep|rover, ya.. we haven't built any of those | 02:25 |
weshay_ | so now we have the ol' chicken and egg problem | 02:26 |
weshay_ | meh | 02:26 |
ysandeep|rover | weshay_, :) okay | 02:26 |
weshay_ | I'll build and push overcloud images tomorow.. | 02:26 |
weshay_ | if you want to give it a go w/ chandankumar his head is all in overcloud-images atm I think | 02:26 |
ysandeep|rover | weshay_, ack o/ i will keep an eye to know how to do that | 02:26 |
ysandeep|rover | weshay_, so requirement is we need overcloud-images for centos8 train branch.. right? | 02:28 |
ysandeep|rover | will check if i can find some old review and take chandan to put them up before your morning :) | 02:30 |
weshay_ | ysandeep|rover, essentially parent off the centos-8 master job for overcloud-full and overcloud-ipa | 02:34 |
weshay_ | you can put up the zuul change.. and then run a test project w/o damaging anything... | 02:34 |
weshay_ | not sure if the image server will allow the job to create the dir structure.. | 02:34 |
weshay_ | you'll need infra or myself to do that bit | 02:34 |
weshay_ | http://images.rdoproject.org/centos8/ | 02:35 |
weshay_ | might be good to see how that all works | 02:35 |
ysandeep|rover | Regarding parent off centos-8 master job for overcloud-full and overcloud-ipa - Just want to confirm - we need new jobs for centos8 train branch? | 02:38 |
ysandeep|rover | weshay_, ^^ | 02:41 |
weshay_ | ya.. we have centos-7... side project is centos-8 atm | 02:41 |
ysandeep|rover | weshay_, thank you | 02:42 |
*** hamzy has quit IRC | 02:46 | |
*** hamzy has joined #oooq | 02:46 | |
*** ysandeep|rover is now known as ysandeep|afk | 03:13 | |
*** rlandy has quit IRC | 03:37 | |
*** ysandeep|afk is now known as ysandeep|rover | 04:18 | |
*** ykarel|away is now known as ykarel | 04:20 | |
*** jmasud has quit IRC | 04:54 | |
*** jmasud has joined #oooq | 04:55 | |
*** ratailor has joined #oooq | 05:00 | |
*** marios has joined #oooq | 05:16 | |
*** saneax has joined #oooq | 05:20 | |
chandankumar | ysandeep|rover, weshay_ i will take care of that | 05:21 |
ysandeep|rover | chandankumar, thanks! | 05:22 |
weshay_ | chandankumar, ysandeep|rover we need to spot check these https://review.rdoproject.org/zuul/builds?pipeline=openstack-promote-component%20 | 05:22 |
weshay_ | make sure the right thing is happening | 05:23 |
weshay_ | see #rdo | 05:23 |
weshay_ | 0/ | 05:23 |
weshay_ | take care guys and thank you | 05:23 |
marios | weshay_: o_O what are you doing still up ?! | 05:23 |
ysandeep|rover | weshay_, good night ..zzzzz... | 05:23 |
*** udesale has joined #oooq | 05:41 | |
*** udesale has quit IRC | 06:09 | |
*** udesale has joined #oooq | 06:13 | |
*** bogdando has joined #oooq | 06:26 | |
*** dpawlik has joined #oooq | 06:30 | |
*** ratailor has quit IRC | 06:40 | |
*** ratailor has joined #oooq | 06:47 | |
*** amoralej|off is now known as amoralej | 07:03 | |
*** apetrich has quit IRC | 07:24 | |
*** tosky has joined #oooq | 07:24 | |
zbr | o/ | 07:27 |
zbr | https://review.opendev.org/#/c/717723/ really needs review as is sprint work and blocking other work. | 07:28 |
zbr | also https://review.opendev.org/#/q/topic:ensure+(status:open+OR+status:merged) about migration to ensure | 07:39 |
*** ysandeep|rover is now known as ysandeep|lunch | 07:44 | |
chandankumar | ysandeep|lunch, Hello | 07:45 |
chandankumar | ysandeep|lunch, regarding overcloud build image, we need images for train? | 07:45 |
*** apetrich has joined #oooq | 07:47 | |
*** pojadhav is now known as pojadhav|lunch | 07:49 | |
*** jschlueter has quit IRC | 08:03 | |
*** jschlueter has joined #oooq | 08:05 | |
ysandeep|lunch | chandankumar, yes | 08:23 |
*** jfrancoa has joined #oooq | 08:30 | |
*** ccamacho has joined #oooq | 08:36 | |
*** derekh has joined #oooq | 08:38 | |
*** holser has joined #oooq | 08:39 | |
*** skramaja has joined #oooq | 08:42 | |
*** holser has quit IRC | 08:42 | |
*** holser has joined #oooq | 08:42 | |
*** ysandeep|lunch is now known as ysandeep|rover | 08:44 | |
*** ykarel is now known as ykarel|lunch | 08:48 | |
sshnaidm|afk | zbr, where is the example of zuul failure with filter? | 08:57 |
*** sshnaidm|afk is now known as sshnaidm | 08:57 | |
zbr | sshnaidm: no idea, arxcruz should know better, he reported the issue, but i got confirmed from infra that we cannot use filters with zuul. | 08:58 |
zbr | due to security issues, as filters run on controller | 08:58 |
zbr | always | 08:58 |
arxcruz | sec | 08:58 |
zbr | but modules are ok | 08:58 |
sshnaidm | zbr, ok, but where is the report? | 08:58 |
arxcruz | sshnaidm: https://review.opendev.org/#/c/702676/ | 08:59 |
arxcruz | ERROR Ansible plugin dir /var/lib/zuul/builds/cb344fc5b915483c95e10201a5945da3/ansible/pre_playbook_1/role_1/ansible-role-collect-logs/filter_plugins found adjacent to playbook /var/lib/zuul/builds/cb344fc5b915483c95e10201a5945da3/ansible/pre_playbook_1/role_1/ansible-role-collect-logs in non-trusted repo. in 2m 01s | 08:59 |
sshnaidm | zbr, seems like a huge overhead for a such task, maybe to try use current jinja/ansible filters? | 08:59 |
zbr | that is a good question, irc logs for sure but that is a really bad place to document bugs. | 08:59 |
sshnaidm | arxcruz, ack | 08:59 |
zbr | sshnaidm: you are invited! but we warned, there are daemons around jinaja2 | 09:00 |
sshnaidm | zbr, btw, we run a nested ansible, why should we care? | 09:00 |
zbr | few months back I tried to implement it in pure jinja2, and after two days, I decided that it does not worth the efforth | 09:00 |
sshnaidm | oh, it's openstack-ansible role.. | 09:01 |
zbr | i like jinja2 (maybe more than most of the people from the team), but it has its own limitations | 09:01 |
*** dtantsur|afk is now known as dtantsur | 09:01 | |
sshnaidm | zbr, can you please paste input and desired output of such filter? I'll look | 09:01 |
sshnaidm | zbr, filters are fine, but module? it's kind of too far | 09:01 |
sshnaidm | what's next, a special repository | 09:02 |
zbr | the desired output can be found in the molecule validation code, it does check for output there. | 09:02 |
sshnaidm | zbr, thanks, but can you please link to it specifically? | 09:02 |
zbr | sshnaidm: that was my first guess, but once you find more about filters/plugins/modules differences, you realise that modules are the least-problematic ones. | 09:03 |
zbr | my original desire was to add unittests to the module, instead of using molecule to test it, but I had no time. in fact the module itself documents the expected format! | 09:04 |
zbr | is in the doc section of the module | 09:04 |
sshnaidm | zbr, can you paste link to input and output? | 09:04 |
sshnaidm | arxcruz, so openstack-ansible doesn't run collect-logs in nested ansible, right? | 09:04 |
arxcruz | sshnaidm: it doesn't run at all, this is just an attempt to replace their collect-logs script with our role | 09:05 |
sshnaidm | arxcruz, in that case I think this filter issue is their smallest problem | 09:05 |
sshnaidm | arxcruz, we have references to localhost and copying files to it, w/o nested it will try to run on the executor and fail | 09:06 |
arxcruz | sshnaidm: i see | 09:06 |
sshnaidm | arxcruz, so I don't think it's a small amount of work.. | 09:06 |
arxcruz | sshnaidm: :( | 09:06 |
sshnaidm | arxcruz, but will be fun | 09:07 |
sshnaidm | don't be sad | 09:07 |
arxcruz | lol | 09:09 |
*** pojadhav|lunch is now known as pojadhav | 09:12 | |
sshnaidm | zbr, so, do you have input/ouput for a filter? | 09:12 |
chandankumar | ysandeep|rover, do you know why we need centos-8 based train images? | 09:16 |
sshnaidm | arxcruz, tbh, I'd try firstly to run this role in zuul in our repos, not in openstack-ansible | 09:17 |
sshnaidm | much easier | 09:17 |
chandankumar | ykarel|lunch, i got it | 09:18 |
ysandeep|rover | weshay_, I am not entirely sure but I guess someone requested it .. wes mentioned "he is creating centos-8 train containers and jobs to unblock EmilienM" | 09:19 |
chandankumar | ykarel|lunch, https://review.rdoproject.org/r/26285 | 09:19 |
ysandeep|rover | chandankumar, I am not entirely sure but I guess someone requested it .. wes mentioned "he is creating centos-8 train containers and jobs to unblock EmilienM" | 09:19 |
panda | chandankumar: ysandeep|rover ok if I promote back d189b188525ce9f703b8829c5c9995c2 for centos8/master ? | 09:22 |
chandankumar | ykarel|lunch, ^^ | 09:23 |
panda | chandankumar: he proposed it, he's ok with it | 09:23 |
chandankumar | panda, ok then go ahead | 09:23 |
panda | chandankumar: but maybe you knew why wes forced the promotion waiving OVB jobs ... | 09:24 |
chandankumar | panda, I have no idea | 09:24 |
ysandeep|rover | panda, i have some idea | 09:24 |
panda | ysandeep|rover: beware, ideas are dangerous | 09:24 |
panda | ysandeep|rover: don't go around saying you have some. | 09:25 |
ysandeep|rover | wes noticed some of the multinode jobs were timing out, he mentioned this happens when the content in upstream gets old and requires a lot of yum updates | 09:25 |
panda | ysandeep|rover: so we needed promotion at all costs to fix multinode | 09:26 |
panda | ysandeep|rover: ykarel|lunch so either we lose OVB jobs or we lose multinode jobs. | 09:26 |
panda | oh joy. | 09:26 |
ysandeep|rover | he did submit a change.. i think it was https://review.rdoproject.org/r/#/c/26281/.. the promotion-server did not pull the change.. so he edited it by hand.. i mean promote | 09:26 |
panda | ysandeep|rover: yep, automatic code updates are disabled .... | 09:26 |
panda | ysandeep|rover: you're confirming everything I thought | 09:27 |
ysandeep|rover | panda, i am glad i confirmed your thoughts | 09:28 |
panda | ysandeep|rover: I'm glad you're glad | 09:28 |
ysandeep|rover | hahaha | 09:28 |
chandankumar | ysandeep|rover, https://review.rdoproject.org/r/#/c/26287/ will build c8 images for train | 09:34 |
ysandeep|rover | chandankumar, thank you! | 09:35 |
zbr | panda: if you can have another look at tox ugfrade one it would be great https://review.opendev.org/#/c/690057/ | 09:37 |
panda | zbr: I'm ugfrade I won't have time. | 09:38 |
*** ykarel|lunch is now known as ykarel | 09:41 | |
sshnaidm | zbr, sorry, I need to ask you again - any chance you have input and output example for your filter/module? | 09:41 |
panda | zbr: done | 09:42 |
zbr | sshnaidm: clearly you did not read the CR because both input and output examples are there: https://review.opendev.org/#/c/717723/4/library/flatten_nested_dict.py | 09:44 |
sshnaidm | zbr, I did, and this didn't work | 09:45 |
sshnaidm | zbr, I think there is incorrect example, that's why I'm asking | 09:45 |
ykarel | panda, ysandeep|rover /me not aware about multinode timeouts, i just see http://zuul.openstack.org/builds?job_name=tripleo-ci-centos-8-containers-multinode and from here i see jobs with older hash too finished before 2.5 hrs | 10:02 |
ykarel | and also not always container updates cause of timeout | 10:02 |
*** ykarel is now known as ykarel|meeting | 10:02 | |
ykarel|meeting | me ok to wait for wes so he can confirm | 10:02 |
chandankumar | marios, Hello | 10:31 |
chandankumar | marios, for internal container build, you have written playbook for downloading internal dlrn repos? If yes, I wanted to reuse it | 10:32 |
marios | chandankumar: not yet but we will do | 10:32 |
marios | chandankumar: there are some notes though on hackmd (rlandy scripts) | 10:33 |
chandankumar | marios, checking | 10:33 |
marios | chandankumar: https://hackmd.io/6gE-LZYMSzmoP3IFt7puKg#script-for-local-clone-and-copy | 10:33 |
chandankumar | marios, thanks! | 10:36 |
*** ykarel|meeting is now known as ykarel | 10:37 | |
marios | sshnaidm: i banged my head trying to get that to work https://review.opendev.org/#/c/716639/6/roles/tripleo_overcloud_roles_generate/tasks/main.yml@11 ... i made it a list but for some reason my local env refused to pickup the change ( | join(' ')) ... not sure if there is some weird cache issue going on | 10:39 |
marios | sshnaidm: i updated it anyway posted v8 just now https://review.opendev.org/#/c/716639/ lets see if it passes in ci | 10:39 |
marios | sshnaidm: should do, afaics but let me know if you can spot issue thanks | 10:39 |
sshnaidm | marios, what is the error you got? | 10:40 |
marios | sshnaidm: like it completely ignored what I put into the tasks/main... i made it like {{ tripleo_overcloud_roles_generate_roles | join(' ') }} but it ignores the join in the cmd_output it just spits out "_generate_roles_cmd": " echo overcloud roles generate --roles-path /foo --output-file /home/m/molecule_roles_test.yml --skip-validate [u'Compute', u'Controller']" | 10:42 |
marios | sshnaidm: will be easier to see once it runs in ci i'll harrass you again later ;) | 10:42 |
sshnaidm | marios, look at this as an example: https://github.com/openstack/tripleo-operator-ansible/blob/master/roles/tripleo_overcloud_node_introspect/molecule/default/converge.yml#L19-L31 | 10:45 |
sshnaidm | marios, in assert blocks should be strings without variables, it's a final command | 10:45 |
marios | sshnaidm: yeah i saw that also more like node delete does same.. problem isn't the match ... i used that for example https://review.opendev.org/#/c/716639/9/roles/tripleo_overcloud_roles_generate/molecule/default/converge.yml@79 | 10:46 |
chandankumar | kopecmartin, can you take care of this https://review.rdoproject.org/r/#/c/26289/? | 10:46 |
chandankumar | marios, we have added http://osp-trunk.hosted.upshift.rdu2.redhat.com/rhel8-osp17/tripleo-ci-testing/ toci testing dir on internal dlrn server | 10:47 |
marios | sshnaidm: http://paste.openstack.org/raw/791723/ | 10:47 |
marios | sshnaidm: the problem is the *generated* command i.e. its ignoring the join in tasks/main not the assert match | 10:47 |
marios | sshnaidm: (scroll to bottom of fpaste for error) | 10:48 |
sshnaidm | marios, well, I'd start from tests change, we shouldn't test if jinja works correctly, the final goal is to see a whole command and check that it's what we expect | 10:48 |
marios | sshnaidm: k thanks waiting for the ci run and will revisit | 10:51 |
sshnaidm | marios, commented: https://review.opendev.org/#/c/716639/ | 11:04 |
marios | sshnaidm: thanks playing with it trying to get it to work | 11:05 |
marios | sshnaidm: even though i said i'd switch it sucked me back in :/ | 11:05 |
marios | :D | 11:05 |
chandankumar | marios, https://review.opendev.org/715397 os_tempest is supported for train release | 11:09 |
marios | chandankumar: for fs39? | 11:11 |
chandankumar | marios, yes | 11:11 |
marios | chandankumar: this is centos8 fs39 though... didn't test fs39 centos7/train | 11:12 |
chandankumar | marios, ah, ok, got it | 11:12 |
marios | chandankumar: as in my work/testing was all for centos8... i can change it to include ^^ but not sure it will work ok there didn't test that | 11:12 |
chandankumar | marios, we can deal train one in different patch | 11:13 |
marios | chandankumar: ack added note there will have a look in a bit | 11:13 |
zbr | panda: does the https://review.opendev.org/#/c/690057/16/test-playbooks/ensure-tox.yaml looks better? | 11:27 |
zbr | found 3 bugs in one ansible task :p | 11:27 |
*** ysandeep|rover is now known as ysandeep|afk | 11:29 | |
*** blueDuckRandom has joined #oooq | 11:40 | |
*** ysandeep|afk is now known as ysandeep|rover | 11:56 | |
*** sshnaidm is now known as sshnaidm|afk | 11:58 | |
kopecmartin | chandankumar: what is that? seems like hacking package is missing, but i have no idea why and where , i'm not a packager | 12:01 |
weshay_ | 0/ | 12:01 |
chandankumar | kopecmartin, ok looking | 12:01 |
weshay_ | ysandeep|rover, ykarel chandankumar anything to hand off? | 12:02 |
weshay_ | https://hackmd.io/XMd_vskSTdGZl7ruZ1UckA | 12:03 |
weshay_ | reading through | 12:03 |
weshay_ | ykarel, wondering if there is any news re: the old python3-openstackclient package | 12:03 |
weshay_ | soniya29, good evening | 12:03 |
ykarel | weshay_, false promotion | 12:03 |
soniya29 | weshay_: good evening. Meeting? | 12:03 |
weshay_ | ykarel, need more details | 12:03 |
ykarel | with adjusting criteria without ovb | 12:04 |
weshay_ | soniya29, one sec | 12:04 |
ykarel | weshay_, https://review.rdoproject.org/r/#/c/26281/2/ci-scripts/dlrnapi_promoter/config/CentOS-8/master.ini | 12:04 |
weshay_ | ykarel, that's not a false promotion | 12:04 |
ykarel | weshay_, promoted wrong hash where ovb failed and repos were outdated https://trunk.rdoproject.org/api-centos8-master-uc/api/civotes_agg_detail.html?ref_hash=1c419f50bd835a5dd09338469b59b0c7 | 12:04 |
weshay_ | hrm... | 12:05 |
*** amoralej is now known as amoralej|lunch | 12:06 | |
weshay_ | ykarel, k.. I'll look at this w/ panda | 12:06 |
ysandeep|rover | weshay_, Got 2 new issues. determined one, checking other.. details in RR notes | 12:07 |
ykarel | weshay_, ack | 12:07 |
weshay_ | ykarel, the promoter should take latest aggregated hash and promote that one | 12:07 |
ykarel | weshay_, yes and that hash has issues, | 12:07 |
ykarel | delorean.repo is wrong there | 12:07 |
weshay_ | ykarel, more detail on the wrong delorean.repo | 12:08 |
ykarel | not consistant with promoted contents | 12:08 |
weshay_ | soniya29, if your mic is not working.. pm in irc | 12:08 |
ykarel | weshay_, see https://trunk.rdoproject.org/centos8-master/component/clients/promoted-components/delorean.repo vs dlrnapi --url https://trunk-centos8.rdoproject.org/api-centos8-master-uc promotion-get --promote-name promoted-components --component clients --limit 1 for small example, this for other componets went to tripleo-ci-testing and then to current-tripleo | 12:09 |
*** blueDuckRandom has quit IRC | 12:12 | |
weshay_ | panda, will need about 1/2 hour of your time today | 12:13 |
panda | weshay_: sure | 12:14 |
weshay_ | ykarel, panda looks like this is not working https://logserver.rdoproject.org/openstack-promote-component/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-8-master-component-clients-promote-to-promoted-components/a119a9c/job-output.txt | 12:14 |
panda | zbr: code doesn't even exist without tests. | 12:14 |
ykarel | weshay_, likely because that hash is already promoted | 12:15 |
weshay_ | ykarel, hrm | 12:16 |
*** beagles_afk is now known as beagles | 12:17 | |
marios | sshnaidm|afk: weird... v11 is green in zuul but locally still fails... /me shrug https://review.opendev.org/#/c/716639/ | 12:20 |
marios | sshnaidm|afk: thanks for looking there ^ | 12:20 |
*** rfolco has joined #oooq | 12:20 | |
*** rlandy has joined #oooq | 12:24 | |
panda | marios: can I see a log of the local failure ? | 12:24 |
marios | panda: let me get fpaste for latest run sec | 12:25 |
marios | panda: http://paste.openstack.org/raw/791731/ | 12:26 |
chandankumar | arxcruz, can we use tripleo community meeting for tempest skip schema review? | 12:34 |
chandankumar | zbr, sshnaidm|afk regarding ansible install, we can clone the ansible in ceph rpm build job and run make rpm there and put in ceph repo itself and install it | 12:35 |
weshay_ | panda, you have some time now? | 12:37 |
panda | weshay_: yes | 12:39 |
chandankumar | weshay_, when you are free, I want to discuss about centos-8 train image build | 12:39 |
weshay_ | panda, ykarel https://meet.google.com/yjn-rwds-isr?authuser=1 | 12:39 |
weshay_ | ykarel, if you have time.. going to discuss the issues w/ promotions | 12:39 |
ykarel | weshay_, sure joining | 12:40 |
weshay_ | panda, https://opendev.org/openstack/python-openstackclient/commits/branch/master | 12:54 |
weshay_ | ykarel, panda https://review.rdoproject.org/r/#/c/25767/ | 12:58 |
weshay_ | ykarel, ssh promoter.rdoproject.org | 13:00 |
marios | rlandy: chandankumar: weshay_: o/ joining ? | 13:01 |
rlandy | marios: sorry - joining | 13:02 |
*** udesale_ has joined #oooq | 13:03 | |
*** udesale has quit IRC | 13:05 | |
jfrancoa | ysandeep|rover: hi! just wondering if this issue is being tracked or not https://504a6afcff55c8f91b0c-2937bb652abe1e5f0c19a6a7c68db9e1.ssl.cf5.rackcdn.com/717861/3/check/tripleo-ci-centos-8-scenario001-standalone/3b7ad91/logs/undercloud/var/log/containers/stdouts/container-puppet-collectd.log , I think I've found the source of the problem and will submit a fix, but I would like to know if I need to open a LP bug first | 13:09 |
ysandeep|rover | jfrancoa, we temporary fixed this yesterday.. let me find the lp | 13:10 |
jfrancoa | ysandeep|rover: great, thanks! that would be awesome (I did a quicksearch in LP but didn't find it) | 13:10 |
ysandeep|rover | jfrancoa, https://bugs.launchpad.net/tripleo/+bug/1871086 | 13:10 |
openstack | Launchpad bug 1871086 in tripleo "tripleo-ci-centos-8-scenario001-standalone jobs failing with Container(s) with bad ExitCode: [''container-puppet-collectd'']" [Critical,In progress] - Assigned to wes hayutin (weshayutin) | 13:10 |
*** ratailor has quit IRC | 13:11 | |
jfrancoa | ysandeep|rover: thanks a lot! | 13:12 |
ysandeep|rover | jfrancoa, my pleasure, for now we pinned puppet-collectd to a previous good hash , proposed a pull request in puppet-collectd to fix the issue(make it compatible) and hardening our ci jobs so that these non tested puppet-* project codes don't gets in unnoticed. | 13:15 |
marios | https://code.engineering.redhat.com/gerrit/gitweb?p=dist-git-manifests.git;a=blob_plain;f=combined-images.xml;hb=refs/heads/rhos-17.0-rhel-8 | 13:17 |
ysandeep|rover | jfrancoa, please push a patch if you know a different way to fix this. | 13:23 |
*** Goneri has joined #oooq | 13:23 | |
*** sshnaidm|afk is now known as sshnaidm | 13:27 | |
rfolco | tripleo ci community meeting starting in 2 min | 13:28 |
rfolco | ping | 13:28 |
rfolco | arxcruz, rfolco, zbr, panda, sshnaidm, rlandy, marios, ysandeep, bhagyashris, soniya29, pojadhav, akahat, weshay, chandankumar | 13:28 |
rfolco | https://meet.google.com/bqx-xwht-wky?authuser=1 | 13:28 |
soniya29 | rfolco, i am there | 13:28 |
bhagyashris | rfolco, me too | 13:28 |
rfolco | I see, I copy/paste the entire ping list :) | 13:28 |
jfrancoa | ysandeep|rover: I found the issue in the template, but if there are plans to rever the puppet-collectd patch, then it doesn't make sense to change it | 13:29 |
marios | rlandy: lets sync here... i'll try get the job definition out at least and you can continue to work on the pre and i'll take it when you leave... out tomorrow? or thursday | 13:30 |
ysandeep|rover | ykarel, weshay_ ^^ what do you think? | 13:30 |
*** amoralej|lunch is now known as amoralej | 13:30 | |
rlandy | marios: hey - I'm out from tomorrow | 13:31 |
marios | rlandy: ack | 13:31 |
rlandy | marios: you're welcome to take over the review | 13:31 |
rlandy | marios: all the reviews :) | 13:31 |
rlandy | marios: I just left out one comment | 13:31 |
marios | rlandy: ok will do tomorrow anyway | 13:31 |
rlandy | to copy back the macros | 13:31 |
rlandy | so I'll add that and it's all yours | 13:31 |
rlandy | I need to finish tls | 13:32 |
marios | rlandy: k | 13:32 |
chandankumar | weshay_, ysandeep|rover https://hackmd.io/OAoW3fJkR72u5n-MTTBRzA?view#Deploy-standalone-using-tripleo-operator-ansible | 13:33 |
ysandeep|rover | jfrancoa, Can you please point what was the issue in template? | 13:38 |
jfrancoa | ysandeep|rover: https://github.com/openstack/tripleo-heat-templates/blob/198c1f890dec38c31126d607a64059f3da9adc87/deployment/metrics/collectd-container-puppet.yaml#L262 the default is taking a string, when the puppet change made from this port option an integer. So removing the quotes should help | 13:40 |
ysandeep|rover | ykarel, weshay_ fyi.. whenever you are free ^^ we can unpin puppet-collectd if we fix above.. | 13:43 |
ykarel | ysandeep|rover, puppet-collectd is backward uncompatible, so quotes work with old puppet-collectd, and integer works with new puppet-collectd, this is what i understood the issue till now | 13:45 |
ysandeep|rover | yes correct.. | 13:47 |
rlandy | pojadhav: hi - I have some work to do on those reviews ... the role has moved to this repo https://opendev.org/x/tripleo-ipa/ | 14:02 |
rlandy | I am not sure how late you want to stay | 14:02 |
rlandy | pojadhav: I am out tomorrow to Friday but I can leave you email on where to pick up | 14:03 |
rlandy | chandankumar: sorry - didn't get to your review yesterday - will look today | 14:03 |
pojadhav | rlandy, sure | 14:03 |
rlandy | marios: k - I updated the notes on the pre review - all yours | 14:04 |
rlandy | send you info to log on to my test instance | 14:04 |
chandankumar | rlandy, no problem | 14:04 |
marios | ack thanks rlandy | 14:05 |
*** TrevorV has joined #oooq | 14:16 | |
rlandy | weshay_: hey - can I help with https://etherpad.openstack.org/p/tripleo-component-promotion-pipeline? ptg topic | 14:30 |
weshay_ | aye | 14:30 |
*** ysandeep|rover is now known as ysandeep|away | 14:33 | |
*** skramaja has quit IRC | 14:46 | |
*** skramaja has joined #oooq | 14:46 | |
*** bogdando has quit IRC | 14:49 | |
*** skramaja has quit IRC | 14:51 | |
weshay_ | anybody need anything? | 14:54 |
* dpawlik thinking about new car | 14:57 | |
marios | :D dpawlik | 14:57 |
dpawlik | marios, you should write your wishes right now. Maybe weshay_ will help to make it true! | 14:58 |
* weshay_ calls oprash | 14:58 | |
weshay_ | oprah | 14:58 |
weshay_ | YOU GET A NEW CAR | 14:58 |
rlandy | dpawlik has high ambitions ... atm I just want to go to the grocery store without a face mask | 15:02 |
dpawlik | rlandy, you can always take a car and eat in mc donald :D | 15:04 |
dpawlik | rlandy, without the mask | 15:04 |
dpawlik | via mc drive | 15:05 |
*** sshnaidm is now known as sshnaidm|afk | 15:07 | |
*** sshnaidm|afk is now known as sshnaid | 15:27 | |
*** sshnaid is now known as sshnaidm | 15:27 | |
weshay_ | panda, are the changes we discussed still a good idea in your opinion? re: https://review.rdoproject.org/r/#/c/26294/ | 15:31 |
weshay_ | panda, few more minutes of your time please when you have it | 15:40 |
panda | weshay_: here's the thing. We are not restricting the criteria for a hash to be promoted, we are widening them. Hashes will get promote if they never promoted OR they don't correspond to the latest promoted-component. This is as a workaround to an assumption that was recently broken with the packages. The broader criteria work in this case, but we may have some other cases where this doesn't work. I got | 15:41 |
panda | familiar with the code a bit. There's no chance I could put satisfactory tests on this, so I can implement and merge, then we'll need to keep an eye on everything to see if something is breaking, and it may happen tomorrow of in one month. Without tests we are not covered against situations like this. | 15:41 |
weshay_ | panda, let's chat.. this is a little too complicated imhjo for irc | 15:41 |
weshay_ | panda, https://meet.google.com/ahs-soew-cpd?authuser=1 | 15:42 |
weshay_ | ykarel, are we sure consistent is clear of bad rsync artifacts? | 15:46 |
weshay_ | seemed like it was | 15:46 |
ykarel | weshay_, yes current consistent are good wrt rsync issue | 15:47 |
weshay_ | ykarel, k | 15:48 |
marios | rlandy: see https://review.opendev.org/#/c/717895/2/roles/build-containers/templates/kolla-build.conf.j2 sound right? (I am going to add that to the job vars working on it now) | 15:52 |
rlandy | looking | 15:52 |
rlandy | marios: there is a redhat paste link with the vars | 15:53 |
rlandy | marios: but you can choose it to be anything | 15:53 |
marios | rlandy: ah yes http://pastebin.test.redhat.com/852586 it was one of those 30000 tabs | 15:53 |
rlandy | marios: np - it's on the hackmd - although that doc is also rather long these days | 15:54 |
marios | rlandy: but wrt namespace specifically ... not tripleo{{ osp_branch }} but more like rhosp... actually it doesnt matter we aren't pushing them anywhere come to think about it | 15:55 |
marios | rlandy: its all local build | 15:55 |
marios | rlandy: so tripleo{{ osp_branch }} should work fine too as long as it build ok i.e. rhosp isn't expected by those dockerfiles | 15:55 |
rlandy | marios: will check back in on sunday if you want changes reviewed ... wrt naming for eventual push weshay_ needs to confirm that with reldel | 15:55 |
marios | rlandy: k | 15:56 |
marios | rlandy: enjoy your time out | 15:56 |
rlandy | right now, pick your poison | 15:56 |
marios | rlandy: are you out of isolation yet? or are they still passing you things at the end of a long stick :D | 15:56 |
rlandy | marios: thanks - sorry for dumping these reviews, need to get TLS in some sort of working shape | 15:56 |
rlandy | marios; yep - out of isolation - I took may maiden voyage to the grocery store last night | 15:57 |
marios | rlandy: no apologies i have also been working on this stuff as you know :) ... was planning on working the pre today anyway as we discussed earlier | 15:57 |
marios | rlandy: was it everything you imagined it would be ?! 18:57 < rlandy> marios; yep - out of isolation - I took may maiden voyage to the grocery store last night | 15:57 |
marios | rlandy: i am going to request permission to go for a run in a bit... i am so excited ! | 15:57 |
rlandy | marios: it was weird - shelves were pretty sparse | 15:57 |
marios | :( | 15:58 |
rlandy | marios: as in - no lettuce | 15:58 |
rlandy | but you can still get 100+ varieties of breakfast cereal | 15:59 |
*** dpawlik has quit IRC | 16:00 | |
rlandy | marios: and the doctor's office sent out a message that they put an open tent in the garden - so you can now see the doctor w/o fear of getting corona - in full view of the neighbors | 16:01 |
rlandy | strange times | 16:01 |
weshay_ | rfolco, where is the hackmd for the get_hash rework? | 16:01 |
rfolco | https://hackmd.io/06K4wRKaT42axGljoDKtjQ | 16:02 |
weshay_ | rfolco, I need to add some notes | 16:02 |
weshay_ | rfolco, please move it to the org | 16:02 |
rfolco | weshay_, I transfered ownership already, but it does now show up | 16:02 |
rfolco | probably because I created as personal gmail | 16:03 |
weshay_ | rfolco, add me as an admin | 16:03 |
rfolco | weshay_, you are admin | 16:03 |
marios | rlandy: :( | 16:03 |
weshay_ | rfolco, nope | 16:03 |
weshay_ | I am | 16:03 |
weshay_ | ok | 16:03 |
weshay_ | I see it now | 16:03 |
*** sshnaidm is now known as sshnaidm|afk | 16:03 | |
weshay_ | rfolco, ok.. scrape it.. add a new one | 16:04 |
weshay_ | I'll do it | 16:04 |
rfolco | weshay_, yeah better to create a new one and remove that one | 16:04 |
weshay_ | rfolco, k.. archive.. or delete this one https://hackmd.io/06K4wRKaT42axGljoDKtjQ?both | 16:05 |
weshay_ | thanks | 16:05 |
rfolco | weshay_, do you have the new one? | 16:07 |
weshay_ | rfolco, https://hackmd.io/team/rh-openstack-ci?nav=overview | 16:07 |
*** udesale_ has quit IRC | 16:08 | |
*** dtantsur is now known as dtantsur|afk | 16:08 | |
*** ykarel is now known as ykarel|away | 16:10 | |
marios | rlandy: just posting skeleton ... added the required-projects for now... will pickup tomorrow and try to wire it up with the pre and the tripleo-ci role review https://code.engineering.redhat.com/gerrit/#/c/196858/1/zuul.d/tripleo-build-containers.yaml | 16:18 |
marios | rlandy: bit of a maintenance issue... we'll need to keep the required-projects there ^^ updated | 16:20 |
rlandy | marios; ack - commenting | 16:20 |
marios | rlandy: or we do some automation like tristan did at https://code.engineering.redhat.com/gerrit/#/c/196441/7/resources/osp-containers.dhall | 16:20 |
rlandy | we need to do what chandankumar did in his review | 16:20 |
rlandy | checkout out the right branch | 16:20 |
rlandy | rest looks good - will add link | 16:20 |
marios | rlandy: ack will check it tomorrow and continue | 16:20 |
marios | rlandy: thanks | 16:20 |
marios | rlandy: have a good break | 16:20 |
rlandy | marios: thanks - stay safe | 16:21 |
marios | u2 rlandy | 16:21 |
weshay_ | rlandy, where are the tls hackmd notes? | 16:24 |
rlandy | weshay_: ade's notes? https://docs.google.com/document/d/1oTnB-x9V6OOOEWFPOxbzgCfy6_lL6oFlQVwKtffC1V4/edit?ts=5dde5c67# | 16:24 |
weshay_ | rlandy, hrm.. should I move that to a hackmd? | 16:25 |
rlandy | weshay_: why bother? | 16:25 |
rlandy | we have other work to do than move formats around | 16:25 |
*** marios is now known as marios|out | 16:28 | |
*** marios|out has quit IRC | 16:30 | |
*** jbadiapa has quit IRC | 16:57 | |
*** amoralej is now known as amoralej|off | 17:28 | |
chandankumar | weshay_, do you have min to talk about train image build? | 17:51 |
*** holser has quit IRC | 17:52 | |
weshay_ | chandankumar, I do | 17:55 |
weshay_ | https://meet.google.com/czg-hptr-njx?authuser=1 | 17:56 |
chandankumar | weshay_, https://logserver.rdoproject.org/87/26287/1/check/periodic-tripleo-centos-8-buildimage-overcloud-full-train/262f590/job-output.txt | 17:59 |
*** holser has joined #oooq | 18:00 | |
*** holser has quit IRC | 18:02 | |
chandankumar | weshay_, https://review.opendev.org/#/c/717043/ | 18:04 |
chandankumar | weshay_, https://code.engineering.redhat.com/gerrit/196373 | 18:04 |
chandankumar | weshay_, https://hackmd.io/OAoW3fJkR72u5n-MTTBRzA?view#Deploy-standalone-using-tripleo-operator-ansible | 18:09 |
*** holser has joined #oooq | 18:13 | |
*** ccamacho has quit IRC | 18:40 | |
rlandy | weshay_: https://review.rdoproject.org/r/26304 Add x/tripleo-api and a repo in RDO | 18:56 |
rlandy | rdo jobs are erroring out | 18:56 |
rlandy | per https://review.opendev.org/#/c/706288/ | 18:57 |
weshay_ | rlandy, https://review.rdoproject.org/r/#/c/26294/ | 18:59 |
weshay_ | worst nightmare come tru | 18:59 |
weshay_ | will explain later | 19:00 |
rlandy | looking | 19:01 |
rlandy | oh dear ... https://bugs.launchpad.net/tripleo/+bug/1871010 | 19:03 |
openstack | Launchpad bug 1871010 in tripleo " Problem: package python3-tripleoclient-13.1.1-0.20200404091914.624a61f.el8.noarch requires validations-common" [Critical,Triaged] | 19:03 |
rlandy | weshay_: better now? | 19:03 |
rlandy | that the fix merged? | 19:03 |
weshay_ | no | 19:11 |
rlandy | need help? | 19:11 |
weshay_ | no.. :) | 19:11 |
weshay_ | thank oyu | 19:11 |
zbr | rlandy: weshay_ : please wf https://review.opendev.org/#/q/topic:ensure+(status:open+OR+status:merged) | 19:15 |
*** saneax has quit IRC | 19:15 | |
rlandy | looks ok to me | 19:17 |
rlandy | weshay_: any objection to calling these roles directly https://opendev.org/x/tripleo-ipa/src/branch/master/tripleo_ipa/roles - rather than creating our own per https://review.opendev.org/#/c/706373/ | 19:21 |
rlandy | this linter commenting is so neat ... https://review.opendev.org/#/c/706373/31/roles/ipa-multinode/defaults/main.yml | 19:21 |
weshay_ | sec in a call | 19:23 |
*** derekh has quit IRC | 19:39 | |
weshay_ | rlandy, back | 20:09 |
weshay_ | rlandy, FYI.. I just got access to zuul to trigger pipelines | 20:09 |
rlandy | weshay_: for which zuul? | 20:10 |
weshay_ | so rlandy instead of test project jobs.. let me know if / when you need that | 20:10 |
*** jfrancoa has quit IRC | 20:10 | |
rlandy | not at the moment but could be interesting for rerunning components | 20:10 |
weshay_ | rlandy, if their roles work now | 20:10 |
weshay_ | that's fine | 20:10 |
weshay_ | aye.. I just triggered openstack-component-common | 20:11 |
rlandy | it seems that there have been changes in the IPA work ... | 20:11 |
rlandy | https://opendev.org/x/tripleo-ipa/src/branch/master/tripleo_ipa/roles | 20:11 |
weshay_ | ya.. ade has been very busy | 20:11 |
weshay_ | ya.. we approved that role about 1.5 months ago | 20:11 |
rlandy | I'm trying to set up enough so that pooja can continues | 20:11 |
weshay_ | perfecto | 20:11 |
rlandy | question is ... | 20:12 |
rlandy | what to do about the roles they have | 20:12 |
rlandy | https://opendev.org/x/tripleo-ipa/src/branch/master/tripleo_ipa/roles | 20:12 |
rlandy | we have out own version of those roles in https://review.opendev.org/#/c/706373/ | 20:12 |
weshay_ | rlandy, seems like a good reason to setup a 1/2 sync w/ ade and talk about tea | 20:12 |
rlandy | tea? | 20:13 |
*** derekh has joined #oooq | 20:13 | |
rlandy | as in rooibos | 20:13 |
weshay_ | :) | 20:13 |
weshay_ | ya.. 1/2 next week at this point | 20:13 |
weshay_ | ur out thrs, friday | 20:13 |
rlandy | and most of tomorrow | 20:13 |
rlandy | I will meet with pooja though | 20:13 |
*** derekh has quit IRC | 20:14 | |
rlandy | so probably tuesday morning | 20:14 |
weshay_ | sounds perfect | 20:14 |
rlandy | weshay_: did we get an info on the container reg when we are ready to push? | 20:15 |
weshay_ | no not yet.. but I expect another 2-3 weeks of work in that job | 20:16 |
rlandy | k | 20:17 |
*** TrevorV has quit IRC | 20:55 | |
*** rlandy is now known as rlandy|biab | 21:10 | |
*** holser has quit IRC | 21:47 | |
*** rlandy|biab is now known as rlandy | 21:54 | |
*** jmasud has quit IRC | 22:30 | |
*** jmasud has joined #oooq | 22:32 | |
*** saneax has joined #oooq | 22:56 | |
*** tosky has quit IRC | 23:26 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!