| *** dsneddon has quit IRC | 00:22 | |
| *** dsneddon has joined #oooq | 00:28 | |
| *** dsneddon has quit IRC | 00:34 | |
| *** dsneddon has joined #oooq | 00:46 | |
| *** altlogbot_1 has quit IRC | 01:30 | |
| *** altlogbot_0 has joined #oooq | 01:31 | |
| *** rfolco has quit IRC | 03:19 | |
| *** dsneddon has quit IRC | 03:23 | |
| *** dsneddon has joined #oooq | 03:40 | |
| *** dsneddon has quit IRC | 03:45 | |
| *** dsneddon has joined #oooq | 03:49 | |
| *** ykarel|away has joined #oooq | 03:49 | |
| *** ykarel|away is now known as ykarel | 03:53 | |
| *** skramaja has joined #oooq | 03:53 | |
| *** ykarel has quit IRC | 04:05 | |
| *** udesale has joined #oooq | 04:10 | |
| *** raukadah is now known as chandankumar | 04:35 | |
| *** ykarel has joined #oooq | 04:38 | |
| *** dsneddon has quit IRC | 04:41 | |
| *** dsneddon has joined #oooq | 04:48 | |
| *** dsneddon has quit IRC | 04:53 | |
| *** ccamacho has quit IRC | 05:06 | |
| *** ratailor has joined #oooq | 05:17 | |
| *** dsneddon has joined #oooq | 05:29 | |
| *** dsneddon has quit IRC | 05:34 | |
| *** ratailor has quit IRC | 05:38 | |
| *** ykarel_ has joined #oooq | 05:39 | |
| *** ykarel has quit IRC | 05:40 | |
| *** ykarel_ has quit IRC | 05:42 | |
| *** ratailor has joined #oooq | 05:45 | |
| *** ykarel has joined #oooq | 05:46 | |
| *** udesale has quit IRC | 05:48 | |
| *** ccamacho has joined #oooq | 05:53 | |
| *** dsneddon has joined #oooq | 06:04 | |
| *** udesale has joined #oooq | 06:06 | |
| *** dsneddon has quit IRC | 06:09 | |
| *** udesale has quit IRC | 06:09 | |
| *** udesale has joined #oooq | 06:10 | |
| *** marios has joined #oooq | 06:11 | |
| *** ykarel is now known as ykarel|meetig | 06:16 | |
| *** ykarel|meetig is now known as ykarel|meeting | 06:16 | |
| *** jfrancoa has joined #oooq | 06:28 | |
| *** ccamacho has quit IRC | 06:29 | |
| *** ccamacho has joined #oooq | 06:29 | |
| *** sanjayu_ has joined #oooq | 06:31 | |
| *** dsneddon has joined #oooq | 06:40 | |
| *** udesale has quit IRC | 06:40 | |
| chandankumar | amoralej|off: the RHEL-8 nodepool py3 issue got fixed last night | 06:42 |
|---|---|---|
| chandankumar | amoralej|off: thanks :-) | 06:42 |
| chandankumar | sshnaidm|afk: Good morning | 06:43 |
| sshnaidm|afk | chandankumar, hello | 06:43 |
| chandankumar | sshnaidm|afk: please have a look at https://review.opendev.org/#/c/669057/ RHEL-8 release file contents | 06:43 |
| chandankumar | sshnaidm|afk: currently blocked on docker_registry_host | 06:43 |
| chandankumar | i used trunk.registry.rdoproject.org | 06:44 |
| chandankumar | docker.io does not work | 06:44 |
| sshnaidm|afk | chandankumar, right, we didn't publish containers in docker.io iirc | 06:45 |
| chandankumar | and rest of the params are ok? | 06:46 |
| *** dsneddon has quit IRC | 06:49 | |
| *** holser_ has joined #oooq | 06:56 | |
| chandankumar | sshnaidm|afk: one more help https://review.opendev.org/#/c/669641/ please have a look at dib changes | 06:56 |
| chandankumar | sshnaidm|afk: http://logs.openstack.org/41/669641/2/check/dib-functests-trusty-python2/9c8baaa/job-output.txt.gz is timing out | 06:57 |
| *** holser_ has quit IRC | 06:59 | |
| sshnaidm|afk | chandankumar, not familiar with that job, better ask DIB cores, I don't see errors from first view there.. | 07:02 |
| *** slaweq has joined #oooq | 07:03 | |
| chandankumar | sshnaidm|afk: sure, thanks for looking into it. | 07:03 |
| chandankumar | sshnaidm|afk: https://review.rdoproject.org/r/#/c/21270/ regarding RHEL-8 standalone job, will I create two base jobs (normal and ovb) where will be put the hack for ansible python interpreter? | 07:05 |
| sshnaidm|afk | chandankumar, do we still need it? | 07:08 |
| sshnaidm|afk | chandankumar, if so - better to create a "base" rhel8 job with this hack, and then to inherit standalone and ovb from it | 07:08 |
| sshnaidm|afk | chandankumar, better to make it upstream, then we can inherit from it in any of our zuul systems | 07:09 |
| chandankumar | sshnaidm|afk: you mean in tripleo-ci repo? | 07:09 |
| sshnaidm|afk | chandankumar, yes | 07:09 |
| chandankumar | sshnaidm|afk: will do that | 07:09 |
| sshnaidm|afk | chandankumar, or maybe to try ansible 2.8, this should be resolved there | 07:09 |
| sshnaidm|afk | chandankumar, just curios, try to depend on this: https://review.opendev.org/#/c/667219/ maybe we don't need then to set ansible interpreter | 07:11 |
| chandankumar | sshnaidm|afk: sure | 07:13 |
| chandankumar | sshnaidm|afk: https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/ci-scripts/tripleo-upstream/dlrnapi_venv.sh#L3 | 07:13 |
| chandankumar | sshnaidm|afk: why we use system site packages here | 07:14 |
| chandankumar | sshnaidm|afk: we can create a seperate virtualenv for the dlrn_api | 07:14 |
| sshnaidm|afk | chandankumar, idk, maybe it was reason for that, maybe panda knows | 07:15 |
| *** dsneddon has joined #oooq | 07:22 | |
| zbr | panda: i cannot install openstack-tripleo-common on rhel8 because nothing provides buildah and skopeo | 07:22 |
| chandankumar | sshnaidm|afk: still hitting the same issue https://logs.rdoproject.org/70/21270/23/check/periodic-tripleo-ci-rhel-8-standalone-master/2e24810/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz#_2019-07-09_07_16_00_039 | 07:23 |
| *** udesale has joined #oooq | 07:24 | |
| chandankumar | sshnaidm|afk: from standalone logs https://logs.rdoproject.org/70/21270/23/check/periodic-tripleo-ci-rhel-8-standalone-master/2e24810/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz#_2019-07-09_07_18_50 | 07:24 |
| chandankumar | sshnaidm|afk: it is showing You don't have permission to access /v2/tripleomaster/centos-binary-cinder-api/manifests/current-tripleo-updated-20190709030403\\non this server | 07:24 |
| chandankumar | sshnaidm|afk: do we need to inject some secrets there | 07:25 |
| *** tosky has joined #oooq | 07:28 | |
| zbr | does anyone know where I can file bugs related to ubi8 images? | 07:30 |
| sshnaidm|afk | chandankumar, I think "no permissions" appears where there is no such image | 07:34 |
| sshnaidm|afk | chandankumar, we don't need secrets when connecting from rdo cloud | 07:34 |
| sshnaidm|afk | chandankumar, btw, in your job post failure: + sudo pip install dlrnapi-client | 07:34 |
| sshnaidm|afk | sudo: pip: command not found | 07:34 |
| sshnaidm|afk | maybe pip3 | 07:34 |
| sshnaidm|afk | zbr, bugzilla? | 07:35 |
| zbr | panda: can you please have a look at https://review.opendev.org/#/c/669343/9 ? as it adds rhel-8 testing to molecule role. | 07:43 |
| *** amoralej|off is now known as amoralej | 07:43 | |
| zbr | i had to implement few tricks, that is why i want you to look. | 07:44 |
| zbr | one issue that we had was that depends-on was not working with tripleo-repos, so i made some changes to make it use local copy when found. | 07:45 |
| *** ratailor_ has joined #oooq | 07:50 | |
| *** ykarel_ has joined #oooq | 07:50 | |
| *** ratailor has quit IRC | 07:52 | |
| *** ykarel_ is now known as ykarel | 07:52 | |
| *** ykarel|meeting has quit IRC | 07:52 | |
| *** ykarel is now known as ykarel|lunch | 07:53 | |
| *** bogdando has joined #oooq | 07:53 | |
| *** gkadam has joined #oooq | 07:55 | |
| *** gkadam has quit IRC | 07:55 | |
| *** dtantsur|afk is now known as dtantsur | 07:57 | |
| *** holser_ has joined #oooq | 08:14 | |
| *** panda has quit IRC | 08:22 | |
| *** panda has joined #oooq | 08:24 | |
| *** holser__ has joined #oooq | 08:33 | |
| *** holser_ has quit IRC | 08:35 | |
| *** holser__ has quit IRC | 08:35 | |
| *** holser_ has joined #oooq | 08:35 | |
| *** holser_ has quit IRC | 08:39 | |
| *** holser__ has joined #oooq | 08:39 | |
| *** ykarel|lunch is now known as ykarel | 08:42 | |
| *** holser__ has quit IRC | 08:43 | |
| *** holser_ has joined #oooq | 08:44 | |
| sshnaidm|afk | zbr, add tripleo-repos here: https://github.com/openstack/tripleo-ci/blob/master/zuul.d/base.yaml#L26 and it'll solve dependency problem | 08:54 |
| *** sshnaidm|afk is now known as sshnaidm|ruck | 08:54 | |
| sshnaidm|ruck | zbr, let's not clone repos in the job | 08:54 |
| zbr | sshnaidm|ruck: really? have you checked what tripleo-repos role does? https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/tripleo-repos/tasks/main.yml#L35 | 09:00 |
| zbr | this role is cloning by default, from git. my new change enables it to use zuul clone instead of doing the clone | 09:02 |
| *** chem has joined #oooq | 09:05 | |
| *** ratailor has joined #oooq | 09:16 | |
| *** ratailor_ has quit IRC | 09:18 | |
| sshnaidm|ruck | zbr, not sure I understand, where is it cloned exactly? | 09:22 |
| zbr | sshnaidm|ruck: oops, wrong link, check https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/tripleo-repos/tasks/main.yml#L34 -- pip does clone it because name is a git+ url! | 09:23 |
| sshnaidm|ruck | zbr, does it clone tripleo-repos from git+https://... ? | 09:24 |
| zbr | yeah, read the readme, the default value is such one | 09:24 |
| sshnaidm|ruck | zbr, why?? it should be taken from zuul_src or whenever we have it | 09:24 |
| zbr | sshnaidm|ruck: read https://opendev.org/openstack/tripleo-ci/src/branch/master/roles/tripleo-repos/defaults/main.yml#L3 | 09:25 |
| sshnaidm|ruck | zbr, yeah, I'm talking about that - why? | 09:25 |
| zbr | it makes sense not to rely on zuul existence when writing an ansible role. | 09:26 |
| sshnaidm|ruck | zbr, we definitely have to rely on zuul existence in our ci jobs | 09:26 |
| sshnaidm|ruck | zbr, in CI it should be taken from zuul sources | 09:27 |
| zbr | while we can add code to detect zuul variables, no role should make such assumptions as it will render them useless outside zuul. | 09:27 |
| sshnaidm|ruck | zbr, we can clone it in non-Ci runs | 09:27 |
| sshnaidm|ruck | zbr, no, completely don't agree | 09:27 |
| sshnaidm|ruck | zbr, we *must* use cloned repos by zuul, it allows us to use depends-on in patches | 09:28 |
| sshnaidm|ruck | zbr, that's why we don't clone in jobs, but use "required_projects" | 09:28 |
| sshnaidm|ruck | zbr, it lets zuul to deal with all it should deal, dependencies, rebases, etc | 09:28 |
| sshnaidm|ruck | zbr, for non-CI runs we can use repo URLs of course | 09:29 |
| zbr | I am not sure what we are not agreeing about,... | 09:30 |
| zbr | bj to clarify easier? | 09:30 |
| zbr | https://bluejeans.com/2655417928 | 09:31 |
| zbr | btw, the two changes about removal of deprecate --centos-mirror param passed: https://review.opendev.org/#/q/topic:centos-mirror+(status:open+OR+status:merged) | 09:33 |
| zbr | panda: ^ | 09:33 |
| *** dsneddon has quit IRC | 09:41 | |
| *** bogdando has quit IRC | 09:47 | |
| zbr | sshnaidm|ruck: thanks. few mins of bj sorted lots of questions. | 09:54 |
| sshnaidm|ruck | zbr, sure, np | 09:55 |
| zbr | another question is if we want to also remove f28 platform when we all rhel8, or maybe we want to keep it some time in parallel | 09:55 |
| *** ratailor_ has joined #oooq | 09:58 | |
| arxcruz|rover | chandankumar panda are we switching? | 09:58 |
| arxcruz|rover | sorry, i mean, are we postponing the meeting? | 09:58 |
| panda | arxcruz|rover: yes | 10:00 |
| arxcruz|rover | panda ok | 10:00 |
| *** derekh has joined #oooq | 10:00 | |
| *** ratailor has quit IRC | 10:00 | |
| zbr | sshnaidm|ruck: another r8 issues: trying to install openstack-tripleo-heat-templates: nothing provides python3-PyYAML | 10:15 |
| sshnaidm|ruck | zbr, seems like this should be in base-os repos | 10:16 |
| sshnaidm|ruck | zbr, but this is question for #rdo | 10:16 |
| zbr | looking now, if not baseos, maybe our deps. but in one of them it must be. | 10:16 |
| *** dsneddon has joined #oooq | 10:17 | |
| chandankumar | sshnaidm|ruck: regarding pip failure rlandry is working on that | 10:26 |
| *** udesale has quit IRC | 10:34 | |
| *** dsneddon has quit IRC | 10:37 | |
| zbr | not sure who is in change of rhel/rhos packages because i got no feedback on rdo. maybe I should raise bugzilla tickets | 10:38 |
| chandankumar | zbr: does the job enables rhel-8 trunk repos? | 10:44 |
| chandankumar | marios: sshnaidm|ruck https://review.opendev.org/#/q/topic:overcloud_cloudyaml+(status:open+OR+status:merged) now overcloud cloud yaml packages ready | 10:45 |
| zbr | chandankumar: nope, only delorean, os15-deps and ubi ones. | 10:47 |
| chandankumar | zbr: we need to replace osp15-deps with https://trunk.rdoproject.org/rhel8-master/dep | 10:49 |
| chandankumar | if it is a upstream job | 10:49 |
| zbr | chandankumar: so if can point me to a r8 repository that does have python3-pypyaml rpms, i would be really happy. | 10:51 |
| arxcruz|rover | sshnaidm|ruck where do we configure 3rd party jobs for tq[e] ? | 10:52 |
| chandankumar | zbr: sorry it is not there https://trunk.rdoproject.org/rhel8-master/deps/latest/Packages/ | 10:53 |
| zbr | added https://bugzilla.redhat.com/show_bug.cgi?id=1728218 | 10:56 |
| openstack | bugzilla.redhat.com bug 1728218 in python36 "ubi8:python-36 image is missing python3-pypyaml rpm" [Urgent,New] - Assigned to python-maint | 10:56 |
| marios | biab | 10:57 |
| *** marios has quit IRC | 10:57 | |
| arxcruz|rover | panda chandankumar which bj ? | 11:00 |
| panda | arxcruz|rover: chandankumar my bj | 11:00 |
| *** amoralej is now known as amoralej|lunch | 11:01 | |
| arxcruz|rover | panda which is... | 11:02 |
| panda | arxcruz|rover: chandankumar 3492508669 | 11:03 |
| panda | arxcruz|rover: I suggesd a small text file with all the IDs by user | 11:03 |
| chandankumar | panda: joined | 11:03 |
| *** ykarel is now known as ykarel|afk | 11:10 | |
| *** dsneddon has joined #oooq | 11:10 | |
| *** bogdando has joined #oooq | 11:10 | |
| sshnaidm|ruck | arxcruz|rover, here https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/tripleo.yaml#L395 | 11:11 |
| arxcruz|rover | slaweq ^ | 11:11 |
| *** tesseract has joined #oooq | 11:11 | |
| arxcruz|rover | slaweq maybe you need to create a project: opendev.org/neutron | 11:11 |
| *** marios has joined #oooq | 11:13 | |
| *** tesseract has quit IRC | 11:13 | |
| *** tesseract has joined #oooq | 11:15 | |
| *** dsneddon has quit IRC | 11:15 | |
| *** altlogbot_0 has quit IRC | 11:19 | |
| *** irclogbot_1 has quit IRC | 11:19 | |
| *** altlogbot_0 has joined #oooq | 11:19 | |
| *** zbr is now known as zbr|lunch | 11:22 | |
| *** tesseract has quit IRC | 11:23 | |
| *** apetrich has joined #oooq | 11:25 | |
| *** altlogbot_0 has quit IRC | 11:25 | |
| sshnaidm|ruck | arxcruz|rover, for what? we have it https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/projects.yaml#L105 | 11:35 |
| sshnaidm|ruck | arxcruz|rover, tell me when you're available for grafana class | 11:35 |
| arxcruz|rover | sshnaidm|ruck, finishing here a meeting with panda and we are good to go :) | 11:36 |
| arxcruz|rover | slaweq, so, you just need to add the job you want to run on https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/projects.yaml#L105 | 11:36 |
| *** jjoyce has quit IRC | 11:39 | |
| *** jjoyce has joined #oooq | 11:40 | |
| slaweq | arxcruz|rover: sshnaidm|ruck thx a lot | 11:42 |
| slaweq | I will try | 11:42 |
| *** ratailor_ has quit IRC | 11:45 | |
| *** dsneddon has joined #oooq | 11:46 | |
| *** holser_ is now known as holser|lunch_wal | 11:49 | |
| *** dsneddon has quit IRC | 11:51 | |
| *** ykarel|afk has quit IRC | 11:53 | |
| *** udesale has joined #oooq | 11:55 | |
| *** altlogbot_1 has joined #oooq | 11:58 | |
| *** dsneddon has joined #oooq | 11:58 | |
| *** zbr|lunch is now known as zbr | 11:59 | |
| *** altlogbot_1 has quit IRC | 11:59 | |
| *** irclogbot_3 has joined #oooq | 11:59 | |
| *** altlogbot_3 has joined #oooq | 12:01 | |
| weshay_PTO | hey guys | 12:01 |
| *** weshay_PTO is now known as weshay | 12:01 | |
| *** altlogbot_3 has quit IRC | 12:05 | |
| *** irclogbot_3 has quit IRC | 12:05 | |
| sshnaidm|ruck | weshay, hola | 12:05 |
| sshnaidm|ruck | weshay, welcome back | 12:05 |
| *** altlogbot_0 has joined #oooq | 12:07 | |
| *** dsneddon has quit IRC | 12:07 | |
| weshay | thanks.. | 12:07 |
| weshay | in an interview atm | 12:08 |
| *** ykarel|afk has joined #oooq | 12:08 | |
| arxcruz|rover | sshnaidm|ruck http://logs.rdoproject.org/openstack-regular/opendev.org/openstack/tripleo-ci/master/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/8264ddb/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz do you think this is an concurrency issue, or shall I open a bug ? | 12:08 |
| arxcruz|rover | just fail | 12:08 |
| sshnaidm|ruck | arxcruz|rover, I'm debugging now a similar issue, so worth to open a bug I think | 12:10 |
| ykarel|afk | sshnaidm|ruck, arxcruz|rover ^^ is already known | 12:10 |
| arxcruz|rover | sshnaidm|ruck ack | 12:10 |
| ykarel|afk | [/etc/sysconfig/network-scripts/ifup-eth] Error, some other host (5E:C7:0F:D6:6B:C4) already uses address 172.18.0.69.", | 12:10 |
| *** altlogbot_0 has quit IRC | 12:11 | |
| arxcruz|rover | ykarel|afk do we have a lp ? | 12:11 |
| ykarel|afk | arxcruz|rover, yes | 12:11 |
| ykarel|afk | panda, was working on it | 12:11 |
| sshnaidm|ruck | arxcruz|rover, yeah, it's in progress by panda | 12:11 |
| arxcruz|rover | ykarel|afk sshnaidm|ruck okay | 12:11 |
| arxcruz|rover | panda when you have time, let me know the lp on this ^ | 12:12 |
| arxcruz|rover | to add on the ruckrover | 12:12 |
| ykarel|afk | it's on CIX in CIX Failing job | 12:13 |
| panda | arxcruz|rover: it's a nightmare, not a bug | 12:13 |
| chandankumar | weshay: welcome back :-) | 12:15 |
| chandankumar | weshay: please have a look on this basically on docker pieces https://review.opendev.org/#/c/669057/ | 12:15 |
| arxcruz|rover | weshay, welcome back boss, miss you :* | 12:20 |
| * chandankumar will be 10 mins late for bug traige | 12:21 | |
| *** rlandy has joined #oooq | 12:24 | |
| marios | rlandy: panda chandankumar zbr sent a invite for tomorrow for a rhel8 sync fyi | 12:26 |
| rlandy | marios: not today? | 12:26 |
| marios | rlandy: well ideally today but thought its too late to organise a call last/minute | 12:26 |
| marios | rlandy: and we don't have scrum tomorrow so i thought it works better | 12:26 |
| marios | rlandy: we can still catch up on community/after depending if there are topics? | 12:27 |
| rlandy | marios: ack -ok | 12:27 |
| rlandy | chandankumar: hi ... | 12:28 |
| rlandy | chandankumar: I'm going to abandon https://review.opendev.org/#/c/668989/ | 12:30 |
| rlandy | chandankumar: docker_registry_host change ... shoudl be w/o https | 12:33 |
| rlandy | weshay: hey ...welcome back | 12:33 |
| *** amoralej|lunch is now known as amoralej | 12:34 | |
| chandankumar | rlandy: ok | 12:36 |
| chandankumar | rlandy: one more thing I noticed today | 12:36 |
| chandankumar | rlandy: https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/ci-scripts/tripleo-upstream/dlrnapi_venv.sh#L3 | 12:36 |
| chandankumar | rlandy: this needs to be without system side packages | 12:37 |
| chandankumar | install all stuff with --user flag | 12:37 |
| chandankumar | rlandy: regarding rhel-8 release file neither docker.io nor trunk.r.o.o is working | 12:38 |
| zbr | weshay: welcome back! | 12:38 |
| sshnaidm|ruck | arxcruz|rover, we are promoting master \o/ | 12:38 |
| arxcruz|rover | \o/ | 12:39 |
| rlandy | chandankumar: yeah so I saw the system_site_packages issue | 12:40 |
| rlandy | kind of felt it may bring down the world if we changed it | 12:40 |
| * rlandy looks at that agina | 12:40 | |
| rlandy | again | 12:40 |
| rlandy | chandankumar: the failure thought is actually here ... https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/ci-scripts/tripleo-upstream/dlrnapi_report.sh#L7 | 12:41 |
| chandankumar | rlandy: yes, that need to be fixed it needs to be pip install --user dlrnapi-client then we do not even need venv also | 12:42 |
| chandankumar | if all pip packages are installed with --user flag | 12:42 |
| rlandy | chandankumar: the problem with changing that file is that it's config :( | 12:43 |
| chandankumar | rlandy: is it possible to move that file to ci-config repo? | 12:43 |
| rlandy | chandankumar: I am not sure why they install again | 12:43 |
| rlandy | chandankumar: no - because it relies on secrets | 12:43 |
| rlandy | to report | 12:43 |
| chandankumar | rlandy: ok | 12:43 |
| rlandy | chandankumar: so we could merge it, try it and revert | 12:44 |
| rlandy | we have done that before | 12:44 |
| *** dsneddon has joined #oooq | 12:44 | |
| * rlandy gets | 12:44 | |
| arxcruz|rover | sshnaidm|ruck i'm free for grafana class now | 12:45 |
| zbr | i am trying to convince dnf module to only download packages and to ignore missing deps, but it does not want to do that. | 12:46 |
| chandankumar | rlandy: regarding py3 ansible python intepreter, we need to try sshnaidm|ruck patch of ansible 2.8 and see what happens there | 12:48 |
| rlandy | hmmm... | 12:48 |
| rlandy | we don;t report as root | 12:48 |
| rlandy | chandankumar: https://review.rdoproject.org/r/21409 Install dlrnapi-client, shyaml with --user for dlrn reporting | 12:49 |
| rlandy | chandankumar: we can merge/revert if sshnaidm|ruck/arxcruz|rover don't mind | 12:49 |
| chandankumar | rlandy: yes let's do it and see what happens | 12:50 |
| sshnaidm|ruck | arxcruz|rover, I have 1:1 soon, you can start meanwhile: go to https://github.com/rdo-infra/ci-config/tree/master/ci-scripts/infra-setup/roles/rrcockpit/files and run docker-compose up -d | 12:50 |
| arxcruz|rover | sshnaidm|ruck yeah, creating a vm to do that, silverblue have only podman | 12:50 |
| rlandy | chandankumar: oen sec | 12:50 |
| rlandy | one | 12:50 |
| rlandy | sshnaidm|ruck: ^^ fyi | 12:51 |
| arxcruz|rover | sshnaidm|ruck there's a meeting after that | 12:51 |
| rlandy | we may break something | 12:51 |
| arxcruz|rover | it seems now is official | 12:51 |
| rlandy | we will revert it | 12:51 |
| sshnaidm|ruck | arxcruz|rover, hmm.. I think you can still install docker | 12:51 |
| sshnaidm|ruck | rlandy, what is it..? | 12:51 |
| arxcruz|rover | sshnaidm|ruck docer was removed for moby or something like that, i was reading today | 12:52 |
| rlandy | sshnaidm|ruck: https://review.rdoproject.org/r/21409 | 12:52 |
| sshnaidm|ruck | arxcruz|rover, you can install docker-ce | 12:53 |
| *** altlogbot_1 has joined #oooq | 12:53 | |
| sshnaidm|ruck | rlandy, ack | 12:54 |
| rlandy | chandankumar: k - let's go4it | 12:54 |
| chandankumar | rlandy: done | 12:54 |
| rlandy | chandankumar: we need to fix the release file back | 12:55 |
| chandankumar | rlandy: I have updated the patch | 12:55 |
| rlandy | and update the test review to remove the review I abandoned | 12:55 |
| chandankumar | rlandy: both done | 12:55 |
| rlandy | chandankumar: cool - let's try | 12:55 |
| chandankumar | rlandy: currently CI is running wihtout dlrn fix | 12:55 |
| rlandy | here's hoping :) | 12:55 |
| rlandy | chandankumar: one day this will pass :) | 12:56 |
| chandankumar | rlandy: https://review.rdoproject.org/zuul/stream/c2323247b4dd4982a409a783fa6c2d71?logfile=console.log | 12:56 |
| chandankumar | rlandy: yes , It will for sure :-) | 12:56 |
| rlandy | w/o dlrn fix? | 12:56 |
| *** altlogbot_1 has quit IRC | 12:57 | |
| chandankumar | rlandy: https://review.rdoproject.org/r/#/c/21409/ without this fix | 12:57 |
| rlandy | chandankumar: I am not sure I understand ... which CI is running w/o dlrn fix? you mean the promotions? | 12:58 |
| chandankumar | rlandy: I have updated the review https://review.opendev.org/#/c/668989/ | 12:59 |
| weshay | ok... | 13:00 |
| weshay | chandankumar we have some nice candidates :) | 13:00 |
| sshnaidm|ruck | weshay, do we have 1:1? | 13:00 |
| chandankumar | sorry I wanted to say CI = RHEL-8 standalone job is running now | 13:00 |
| weshay | arxcruz|rover sshnaidm|ruck need anything from me? | 13:00 |
| arxcruz|rover | weshay beer? | 13:00 |
| sshnaidm|ruck | weshay, nothing special, but need to know where is your escalation script | 13:01 |
| weshay | sending now | 13:01 |
| weshay | lolz k | 13:01 |
| sshnaidm|ruck | weshay, seems like it doesn't escalate | 13:01 |
| weshay | sshnaidm|ruck make sure the bugs in question are triaged properly | 13:01 |
| rlandy | ok | 13:01 |
| * weshay checks it | 13:01 | |
| weshay | marios so I saw some comment about the rhui repos and container building | 13:01 |
| sshnaidm|ruck | weshay, so, do we have 1:1 today or no? | 13:01 |
| weshay | getting the rhui rpms on the containers.. did you get that worked out? | 13:02 |
| *** dsneddon has quit IRC | 13:02 | |
| *** sanjayu_ has quit IRC | 13:02 | |
| chandankumar | weshay: :-) | 13:02 |
| weshay | panda ping.. can we chat today? | 13:03 |
| weshay | sshnaidm|ruck I'm in | 13:03 |
| chandankumar | rlandy: https://review.rdoproject.org/zuul/stream/b9a47dc1d56041308cd2903442229622?logfile=console.log | 13:05 |
| marios | weshay: o/ hi which comment/on the task? | 13:06 |
| marios | weshay: folco owns container builds fyi | 13:07 |
| marios | weshay: we can sync a bit in community in 20? don't know if folco is around today | 13:07 |
| marios | weshay: but the taiga should be up to date at least we went over those yesterday in scrum | 13:07 |
| weshay | k.. thanks | 13:07 |
| *** holser|lunch_wal is now known as holser_ | 13:08 | |
| *** rlandy_ has joined #oooq | 13:09 | |
| *** skramaja has quit IRC | 13:09 | |
| *** rlandy_ has quit IRC | 13:09 | |
| *** jfrancoa has quit IRC | 13:11 | |
| weshay | sshnaidm|ruck arxcruz|rover https://github.com/weshayutin/tripleo-critical-bugs | 13:17 |
| weshay | panda please join my blue | 13:18 |
| arxcruz|rover | weshay, is it running where? i believe the job or whatever it runs stopped | 13:18 |
| weshay | ya.. talking to sshnaidm|ruck about it now | 13:18 |
| weshay | sshnaidm|ruck arxcruz|rover pick a server in our infra tenant.. and I'll get it setup there | 13:18 |
| *** vinaykns has joined #oooq | 13:20 | |
| rlandy | chandankumar, one other thing I did in the release file that we will have to reverse - I set the dlrn_hash to tripleo-current - not to pick up an actual hash | 13:20 |
| rlandy | as a usual periodic job would | 13:20 |
| rlandy | because those hashes weren't always there | 13:20 |
| rlandy | ie: rhel platform hash with centos7 containers | 13:21 |
| sshnaidm|ruck | zbr, would you like to tell about molecule jobs in ci call now? | 13:27 |
| sshnaidm|ruck | zbr, where are they from, how they run and how to debug them | 13:27 |
| chandankumar | rlandy: will update once current zuul job finishes | 13:28 |
| rlandy | chandankumar: no, sorry, that was just an fyi - we have to keep it as is while we are using centos7 containers | 13:28 |
| chandankumar | rlandy: ok | 13:29 |
| zbr | i would prefer to delay it till next week, too many moving things at the moment. | 13:29 |
| chandankumar | rlandy: we need this file also promotion-testing-hash-master.yml then for periodic jobs? | 13:30 |
| rlandy | chandankumar: ack - but no point with no containers atm | 13:30 |
| zbr | like trying to enable rhel8 for them while at the same time trying to fix how others are (ab)using it. | 13:30 |
| rlandy | also - that file will only pick up if we run in periodic pipeline | 13:30 |
| rlandy | right now we are running in check | 13:30 |
| rlandy | unless you use the hack I keep for running periodic in check | 13:31 |
| chandankumar | rlandy: ok | 13:31 |
| marios | community call ? | 13:31 |
| weshay | joining | 13:31 |
| weshay | rlandy can you join? | 13:33 |
| rlandy | yep - joining | 13:34 |
| marios | panda: joiningn? ^ | 13:34 |
| *** dsneddon has joined #oooq | 13:35 | |
| weshay | zbr you around? | 13:35 |
| chandankumar | weshay: marios https://logs.rdoproject.org/70/21270/25/check/periodic-tripleo-ci-rhel-8-standalone-master/b9a47dc/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz#_2019-07-09_13_33_01_730 | 13:40 |
| *** slaweq has quit IRC | 13:43 | |
| zbr | yep | 13:44 |
| *** slaweq has joined #oooq | 13:49 | |
| sshnaidm|ruck | chandankumar, "No subuid ranges found for user "zuul" in /etc/subuid", maybe you need to use "sudo podman" | 13:51 |
| chandankumar | sshnaidm|ruck: https://review.opendev.org/#/c/669487/7/roles/build-containers/tasks/main.yaml@135 docker is used | 13:52 |
| chandankumar | sshnaidm|ruck: will I switched to podman here? | 13:52 |
| sshnaidm|ruck | chandankumar, saw this error here: http://logs.rdoproject.org/95/21295/16/check/tripleo-build-containers-rhel-8-master/f67ec11/job-output.txt.gz | 13:53 |
| chandankumar | sshnaidm|ruck: yes | 13:53 |
| sshnaidm|ruck | chandankumar, oops, it's for folco | 13:53 |
| sshnaidm|ruck | this error is weird, rhel8 should have all subuids in place.. | 13:54 |
| *** dsneddon has quit IRC | 13:58 | |
| chandankumar | sshnaidm|ruck: I have copied thee workaround from here https://github.com/containers/libpod/issues/1182#issuecomment-408876210 | 13:59 |
| sshnaidm|ruck | chandankumar, then need to do the same for subgids | 14:01 |
| sshnaidm|ruck | chandankumar, https://github.com/containers/libpod/blob/master/docs/podman.1.md#rootless-mode | 14:02 |
| rlandy | chandankumar: weird ... 2019-07-09 13:36:02.695089 | TASK [Report to DLRN] | 14:07 |
| rlandy | 2019-07-09 13:36:07.738824 | Timeout exception waiting for the logger. Please check connectivity to [38.145.34.156:19885] | 14:07 |
| rlandy | 2019-07-09 13:36:07.742392 | primary | ERROR | 14:07 |
| *** aakarsh has quit IRC | 14:10 | |
| chandankumar | rlandy: can you pass me the hack where we remove the port from docker_registry_host in downstream I grepped in tripleo-environments code | 14:16 |
| weshay | panda join up | 14:16 |
| rlandy | chandankumar: yeah - looking - one sec | 14:17 |
| weshay | panda I'm in.. but 1 sec | 14:17 |
| rlandy | chandankumar: hmmm ... I don't see it here ... http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/config/release/rhos-15.yml#n70 | 14:21 |
| rlandy | there are all the container settings | 14:21 |
| rlandy | there is one more place | 14:21 |
| *** sabedevops has joined #oooq | 14:22 | |
| rlandy | docker_registry_host: brew-pulp-docker01.web.prod.ext.phx2.redhat.com:8888 | 14:22 |
| *** sabedevops has quit IRC | 14:22 | |
| *** Vorrtex has joined #oooq | 14:22 | |
| rlandy | weshay: ^^ I am totally blanking on removing the port in osp ... | 14:24 |
| rlandy | do you remember where? | 14:24 |
| rlandy | http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/config/release/rhos-15.yml#n70 | 14:24 |
| rlandy | ^^ are the release settings | 14:24 |
| weshay | rlandy I think in the defaults | 14:26 |
| weshay | rlandy few min.. tlaking to panda | 14:26 |
| *** jfrancoa has joined #oooq | 14:28 | |
| *** dsneddon has joined #oooq | 14:29 | |
| weshay | rlandy /me looks for the review | 14:38 |
| sshnaidm|ruck | rlandy, take a look please: https://review.rdoproject.org/r/#/c/21412/ | 14:39 |
| sshnaidm|ruck | arxcruz|rover, ^^ | 14:41 |
| sshnaidm|ruck | when stack is in create_failed it's not deleted in job and this fulfill our tenant quickly | 14:41 |
| arxcruz|rover | sshnaidm|ruck, yup, make sense | 14:42 |
| rlandy | sshnaidm|ruck: let's try it | 14:44 |
| rlandy | I have my doubts that it will always work | 14:44 |
| rlandy | sshnaidm|ruck: ^^ | 14:44 |
| sshnaidm|ruck | rlandy, at least we'll try | 14:45 |
| rlandy | sshnaidm|ruck: really depends on why the create failed | 14:45 |
| sshnaidm|ruck | rlandy, now we just leave create_failed stacks as is | 14:45 |
| rlandy | sshnaidm|ruck: try it ... let's see | 14:45 |
| rlandy | sshnaidm|ruck: ack the cleanup script shoudl take care of that | 14:45 |
| rlandy | but let's see | 14:45 |
| sshnaidm|ruck | rlandy, yeah, but it can't remove all quickly | 14:46 |
| rlandy | sshnaidm|ruck: yeah - go4it | 14:46 |
| *** dsneddon has quit IRC | 14:51 | |
| *** ykarel|afk is now known as ykarel | 14:52 | |
| rlandy | chandankumar: sorry weshay and I are still looking | 14:55 |
| chandankumar | ack | 14:55 |
| *** altlogbot_3 has joined #oooq | 14:55 | |
| weshay | yup.. I think either steve or emilien put in a fix as well.. on top of a change either rlandy and I had that we abandoned | 14:55 |
| rlandy | I remember something | 14:56 |
| *** fmount has joined #oooq | 14:56 | |
| rlandy | but if Emilien put in a patch, it should work here? | 14:56 |
| rlandy | chandankumar: we have another issue | 14:57 |
| *** altlogbot_3 has quit IRC | 14:57 | |
| rlandy | dlrn failure to connect | 14:57 |
| rlandy | seen that one? | 14:57 |
| rlandy | checking the container prep file | 14:58 |
| rlandy | maybe it's there | 14:58 |
| chandankumar | rlandy: yes | 14:59 |
| chandankumar | rlandy: poked nicholad regarding dlrn reporting | 15:00 |
| rlandy | chandankumar: ack - thanks | 15:01 |
| rlandy | maybe kforde | 15:01 |
| rlandy | rdocloud | 15:01 |
| weshay | chandankumar paste me the trace of the failure for the standalone job | 15:04 |
| chandankumar | weshay: https://logs.rdoproject.org/70/21270/25/check/periodic-tripleo-ci-rhel-8-standalone-master/b9a47dc/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz#_2019-07-09_13_32_52_462 | 15:04 |
| *** chem has quit IRC | 15:05 | |
| *** dsneddon has joined #oooq | 15:07 | |
| weshay | chandankumar this is related https://bugs.launchpad.net/tripleo/+bug/1819632 | 15:08 |
| openstack | Launchpad bug 1819632 in tripleo "[gate] Error pulling image: invalid character '<' parsing 404 response" [Medium,Triaged] - Assigned to Emilien Macchi (emilienm) | 15:08 |
| rlandy | "error pulling image \"192.168.24.1:8787/tripleomaster/centos-binary-swift-proxy-server:current-tripleo-updated-20190709091858\": unable to pull 192.168.24.1:8787/tripleomaster/centos-binary-swift-proxy-server:current-tripleo-updated-20190709091858: unable to pull image: Error determining manifest MIME type for docker://192.168.24.1:8787/tripleomaster/centos-binary-swift-proxy-server:current-tripleo-updated-20190709091858: | 15:10 |
| rlandy | Error reading manifest current-tripleo-updated-20190709091858 in 192.168.24.1:8787/tripleomaster/centos-binary-swift-proxy-server: error parsing HTTP 403 response body: invalid character '<' looking for beginning of value: \"<!DOCTYPE HTML PUBLIC \\\"-//IETF//DTD HTML 2.0//EN\\\">\\n<html><head>\\n<title>403 Forbidden</title>\\n</head><body>\\n<h1>Forbidden</h1>\\n<p>You don't have permission to access /v2/tripleomaster/centos-bin | 15:10 |
| weshay | chandankumar https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/standalone/templates/standalone_config.yaml.j2#L12 | 15:10 |
| rlandy | ary-swift-proxy-server/manifests/current-tripleo-updated-20190709091858\\non this server.<br />\\nServer unable to read htaccess file, denying access to be safe</p>\\n</body></html>\\n\"", | 15:10 |
| rlandy | DockerInsecureRegistryAddress | 15:10 |
| rlandy | replaced by | 15:10 |
| weshay | rlandy chandankumar I think we should put up a review to make 8787 optional | 15:10 |
| rlandy | weshay: I think we need to override undercloud_docker_insecure_registries: "{{ docker_registry_host }}" | 15:11 |
| *** altlogbot_3 has joined #oooq | 15:11 | |
| rlandy | chandankumar: ^^ | 15:12 |
| *** dsneddon has quit IRC | 15:12 | |
| chandankumar | rlandy: updating release file | 15:12 |
| rlandy | let's try that | 15:12 |
| rlandy | chandankumar: because it's pulling local registry | 15:13 |
| rlandy | 192.168.24.1:8787 | 15:13 |
| rlandy | idk if it will help | 15:13 |
| weshay | chandankumar rlandy so am I reading this wrong? | 15:14 |
| weshay | https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/standalone/templates/standalone_config.yaml.j2#L12 | 15:14 |
| rlandy | weshay: yep | 15:15 |
| rlandy | getting overrides | 15:15 |
| rlandy | maybe I'm wrong | 15:15 |
| rlandy | hold on | 15:15 |
| *** altlogbot_3 has quit IRC | 15:16 | |
| rlandy | no that's wrong | 15:18 |
| weshay | rlandy chandankumar it could be that on RHEL we have an older version of podman | 15:18 |
| rlandy | {% if standalone_container_prep_updates is defined and standalone_container_prep_updates %} | 15:18 |
| weshay | rlandy which is why we're only seeing this on rhel 8 | 15:19 |
| rlandy | maybe we don't do that in osp | 15:19 |
| weshay | I think we have a newer version of podman in centos7 | 15:19 |
| chandankumar | weshay: podman-1.0.0-2.git921f98f.module+el8+2785+ff8a053f.x86_64 | 15:19 |
| chandankumar | in RHEL-8 | 15:20 |
| rlandy | weshay: you going to prod chain meeting? | 15:20 |
| weshay | podman-1.2-2.git3bd528e.el7 | 15:20 |
| weshay | rlandy ya | 15:20 |
| rlandy | weshay: ok - will be there as well - we need to chat about presentation for meetup | 15:21 |
| rlandy | weshay: chandankumar: ok - here we go ... https://sf.hosted.upshift.rdu2.redhat.com/logs/periodic/code.engineering.redhat.com/openstack/tripleo-ci-internal-jobs/master/tripleo-ci-rhel-8-standalone-rhos-15/ea9b40c/logs/undercloud/home/zuul/standalone_parameters.yaml.txt.gz | 15:22 |
| rlandy | DockerInsecureRegistryAddress: | 15:22 |
| rlandy | - 192.168.24.1 | 15:22 |
| rlandy | weshay: ^^ you are right - no port | 15:22 |
| weshay | https://review.opendev.org/669891 /me speculating | 15:23 |
| weshay | chandankumar rlandy pretty sure we have a packaging bug here... that we may be able to work around | 15:23 |
| weshay | chandankumar we want to chat w/ jpena alfreado etc.. to ensure the rhel8 version of podman is == to what we are using on centos-7 in rdo | 15:24 |
| rlandy | weshay: chandankumar; I don;t want to make more work/debugging by using centos7 containers | 15:24 |
| rlandy | it was just a try to see if it would work | 15:24 |
| weshay | rlandy imho we focus on getting the containers built and uploaded w/ auth | 15:25 |
| rlandy | weshay: ack | 15:25 |
| weshay | chandankumar also making sure rhel8 deps and centos7 deps are equal for podman/buildah etc | 15:25 |
| rlandy | but your patch may still work | 15:25 |
| sshnaidm|ruck | rlandy, 2019-07-09 14:35:55.716483 | primary | /home/zuul/src/review.rdoproject.org/config/ci-scripts/tripleo-upstream/dlrnapi_report.sh: line 8: dlrnapi: command not found | 15:26 |
| rlandy | chandankumar: let's try this https://review.opendev.org/#/c/669891/ - will setting override in release file | 15:26 |
| sshnaidm|ruck | rlandy, you need to tweak PATH if you use --user | 15:26 |
| rlandy | sshnaidm|ruck: ok - putting up patch ... | 15:26 |
| chandankumar | rlandy: poked amoralej regarding podman version | 15:27 |
| rlandy | https://review.opendev.org/#/c/668994/3/roles/run-test/templates/toci_gate_test.sh.j2 | 15:27 |
| rlandy | like here | 15:27 |
| sshnaidm|ruck | rlandy, btw, why does it try to install it twice? http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset010-master/bf66516/job-output.txt.gz | 15:28 |
| chandankumar | rlandy: updated the standalone review | 15:28 |
| sshnaidm|ruck | source /home/zuul/workspace/hash_info.sh is executed twice for some reason.. | 15:29 |
| chandankumar | rlandy: https://logs.rdoproject.org/70/21270/25/check/periodic-tripleo-ci-rhel-8-standalone-master/b9a47dc/ara-report/result/50e34115-f0aa-480e-b63b-c2b8db07e8c9/ | 15:29 |
| chandankumar | rlandy: it shpuld be pip3 | 15:29 |
| weshay | zbr want to chat? | 15:29 |
| rlandy | chandankumar: sshnaidm|ruck: https://review.rdoproject.org/r/21414 Add dir to $PATH for --user pip install - just checking if python_cmd is available then | 15:31 |
| chandankumar | rlandy: we need to use pip3 i think for rhel-8 | 15:31 |
| arxcruz|rover | brb ~1hr | 15:32 |
| chandankumar | rlandy: I am logging out, will pick up tomororw | 15:32 |
| chandankumar | rlandy: feel free to drop the notes | 15:32 |
| rlandy | chandankumar: k - will work on this | 15:32 |
| *** chandankumar is now known as raukadah | 15:32 | |
| *** hamzy has quit IRC | 15:33 | |
| rlandy | sshnaidm|ruck, we can revert the change to keep your jobs going | 15:34 |
| rlandy | and rethink what we need here | 15:34 |
| * marios almost out | 15:36 | |
| rlandy | zbr: you around? | 15:38 |
| weshay | sshnaidm|ruck arxcruz|rover not sure who is on this week.. but please help this along https://review.rdoproject.org/r/#/c/21413/1/zuul.d/tripleo.yaml | 15:38 |
| rlandy | sshnaidm|ruck: I thin it installs twice because the reporting should run standalone | 15:39 |
| rlandy | ie: as a script in itself | 15:39 |
| weshay | rlandy prod chain call is canceled, let's chat when you have time | 15:40 |
| *** vinaykns has quit IRC | 15:41 | |
| sshnaidm|ruck | weshay, not sure we have capacity in rdo cloud to run these jobs every patch in neutron | 15:41 |
| rlandy | weshay: ack - what to chat now or later this afternoon - either is fine for me | 15:41 |
| *** altlogbot_1 has joined #oooq | 15:41 | |
| *** dsneddon has joined #oooq | 15:42 | |
| rlandy | sshnaidm|ruck: zbr: idk if this will work ... https://review.rdoproject.org/r/#/c/21414/3/ci-scripts/tripleo-upstream/dlrnapi_report.sh | 15:42 |
| sshnaidm|ruck | rlandy, what do you mean should run standalone? | 15:42 |
| rlandy | ie: if python_cmd is defined there | 15:42 |
| rlandy | run without the install in pre | 15:42 |
| sshnaidm|ruck | rlandy, I don't think it's defined somewhere, why not pip? | 15:43 |
| rlandy | sshnaidm|ruck: we'd need to do the test for pip pr pip3 | 15:43 |
| rlandy | or | 15:44 |
| *** vinaykns has joined #oooq | 15:44 | |
| *** derekh has quit IRC | 15:44 | |
| sshnaidm|ruck | rlandy, that's ok | 15:44 |
| rlandy | you mean to check | 15:44 |
| rlandy | ok - updating patch | 15:44 |
| *** marios is now known as marios|out | 15:45 | |
| *** altlogbot_1 has quit IRC | 15:46 | |
| zbr | weshay: i am back now. | 15:46 |
| weshay | zbr hey hey | 15:47 |
| weshay | so let's chat about the rhel 8 ubi | 15:47 |
| zbr | weshay: i joined your bj | 15:48 |
| *** dsneddon has quit IRC | 15:49 | |
| rlandy | sshnaidm|ruck: raukadah: zbr: how about this? https://review.rdoproject.org/r/#/c/21414/ | 15:56 |
| rlandy | workable now? | 15:56 |
| sshnaidm|ruck | rlandy, let's try | 15:58 |
| *** marios|out has quit IRC | 15:59 | |
| rlandy | sshnaidm|ruck: k - if this still breaks we can revert | 15:59 |
| *** hamzy has joined #oooq | 16:02 | |
| rlandy | sshnaidm|ruck: w+ | 16:04 |
| rlandy | here's hoping | 16:04 |
| *** dsneddon has joined #oooq | 16:06 | |
| *** altlogbot_2 has joined #oooq | 16:07 | |
| *** altlogbot_2 has quit IRC | 16:12 | |
| *** ykarel is now known as ykarel|away | 16:14 | |
| *** dsneddon has quit IRC | 16:15 | |
| *** altlogbot_2 has joined #oooq | 16:19 | |
| weshay | sshnaidm|ruck arxcruz|rover the escalation script is failing on | 16:21 |
| weshay | httplib2.SSLHandshakeError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:618) | 16:21 |
| weshay | looking into it | 16:21 |
| rlandy | weshay: ha ... https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/standalone/tasks/main.yml#L114 | 16:21 |
| rlandy | - osp_release is defined | 16:21 |
| rlandy | ^^need to remove thath | 16:21 |
| weshay | rlandy ah | 16:22 |
| weshay | rlandy++ | 16:22 |
| *** altlogbot_2 has quit IRC | 16:23 | |
| *** irclogbot_3 has joined #oooq | 16:23 | |
| rlandy | raukadah: ^^ finally :) | 16:24 |
| zbr | rlandy: i found issue on https://review.rdoproject.org/r/#/c/21414/ | 16:24 |
| weshay | rlandy I wonder if we want to check the os_distribution | 16:24 |
| weshay | rlandy instead of osp_release.. it's not the osp_release as much as stein / train run on rhel 8 | 16:25 |
| rlandy | zbr: k - will fix - let's just see if it break current | 16:25 |
| zbr | shortly $USER is not safe to use, as is not always defined, 2nd: adding .local/bin to PATH must be done at the top, not bottom. See https://fedoraproject.org/wiki/Changes/UserPathPrioritization | 16:26 |
| rlandy | weshay: you mean any rhel install | 16:27 |
| zbr | it was my first and only Fedora proposal :D | 16:27 |
| weshay | rlandy no.. rhel 7 uses docker | 16:27 |
| *** irclogbot_3 has quit IRC | 16:27 | |
| weshay | rlandy really if the os is rhel and 8+ | 16:27 |
| rlandy | k - lunch quickly ... will fix in a few | 16:27 |
| weshay | rlandy or we can check if buildah/podman are installed could be an option too | 16:28 |
| rlandy | weshay: ack - will put up patch in a bit | 16:28 |
| raukadah | weshay: regarding podman, in RHEL-8 it is handled differently | 16:29 |
| weshay | raukadah ya.. :( | 16:29 |
| zbr | weshay: maybe offtopic but considering how it would be possible for a user to upgrade RHOS while upgrading RHEL at the same time? | 16:29 |
| weshay | raukadah I think rlandy's patch will unblock you | 16:29 |
| raukadah | weshay: cool, thanks :-) | 16:30 |
| *** jfrancoa has quit IRC | 16:30 | |
| zbr | rlandy: can you please send me the link to the rhel8 image already prepared with rhui? | 16:31 |
| rlandy | zbr: nodepool? | 16:32 |
| rlandy | the nodeset? | 16:32 |
| zbr | rlandy: nope, container | 16:32 |
| raukadah | zbr: it is not yet ready, rfolco has putted some notes regarding that | 16:32 |
| rlandy | hmmm ... I don't have that ... we have instructions to add rhui | 16:33 |
| rlandy | pretty simple | 16:33 |
| rlandy | zbr: https://docs.google.com/document/d/1qynC51Dj_68J4ajTySg7HEA9Hb-_nIrXEnAQXe5JUcM/edit | 16:33 |
| zbr | rlandy: not simple, because I cannot add these instructions at runtime, i need it pushed somewhere where I can pull from. | 16:33 |
| zbr | yep, doable in 3 ansible tasks, just that I cannot create a PR with them :p | 16:34 |
| *** dtantsur is now known as dtantsur|afk | 16:34 | |
| zbr | rlandy: and you say that the base used for that is the ubi8 one? i will do the tasks myself. | 16:35 |
| *** ccamacho has quit IRC | 16:38 | |
| *** aakarsh has joined #oooq | 16:41 | |
| *** dsneddon has joined #oooq | 16:42 | |
| rlandy | abr: ack - rfoloc has those notes | 16:53 |
| rlandy | rfolco | 16:53 |
| rlandy | zbr: ^^ | 16:54 |
| arxcruz|rover | weshay try export export PYTHONWARNINGS='ignore:Certificate has no, ignore:A true SSLContext object is not available' | 16:55 |
| arxcruz|rover | weshay and CURL_CA_BUNDLE="" | 16:56 |
| rlandy | raukadah: sshnaidm|ruck: dlrn reporting looks ok I think .. http://logs.rdoproject.org/70/21270/26/check/periodic-tripleo-ci-rhel-8-standalone-master/4f225ec/job-output.txt.gz | 16:56 |
| rlandy | sshnaidm|ruck: if you see errors on your side, let me know | 16:57 |
| rlandy | zbr has some comments so will need to adjust anyways | 16:57 |
| sshnaidm|ruck | rlandy, ack, will check later | 16:57 |
| *** sshnaidm|ruck is now known as sshnaidm|afk | 16:57 | |
| *** altlogbot_1 has joined #oooq | 16:59 | |
| *** udesale has quit IRC | 17:00 | |
| *** ykarel|away has quit IRC | 17:00 | |
| *** altlogbot_1 has quit IRC | 17:05 | |
| *** irclogbot_1 has joined #oooq | 17:09 | |
| *** chem has joined #oooq | 17:11 | |
| *** irclogbot_1 has quit IRC | 17:13 | |
| *** bogdando has quit IRC | 17:30 | |
| *** holser_ has quit IRC | 17:30 | |
| *** amoralej is now known as amoralej|off | 17:30 | |
| *** tesseract has joined #oooq | 17:40 | |
| *** dtrainor__ has joined #oooq | 17:41 | |
| *** dtrainor_ has quit IRC | 17:43 | |
| *** sanjayu_ has joined #oooq | 17:45 | |
| *** hamzy has quit IRC | 17:47 | |
| *** dsneddon has quit IRC | 17:48 | |
| *** hamzy has joined #oooq | 17:52 | |
| *** dsneddon has joined #oooq | 17:53 | |
| *** dsneddon has quit IRC | 17:57 | |
| rlandy | weshay: please ping me when you want to meet - any time this afternoon is fine | 17:58 |
| weshay | rlandy ready now | 17:58 |
| rlandy | k - | 17:58 |
| raukadah | rlandy: weshay https://review.opendev.org/667323 is good to go | 18:00 |
| rlandy | joining | 18:01 |
| raukadah | tested here https://review.opendev.org/#/c/667390/ | 18:01 |
| *** dsneddon has joined #oooq | 18:01 | |
| *** dsneddon has quit IRC | 18:05 | |
| weshay | rlandy https://docs.google.com/document/d/1ySHfOi6vP_KCexlIJXaodsnGiYXgy6GN0Bz2fZUSTSo/edit#heading=h.87dlrd1np24r | 18:13 |
| *** dsneddon has joined #oooq | 18:19 | |
| *** irclogbot_0 has joined #oooq | 18:35 | |
| *** tesseract has quit IRC | 18:39 | |
| *** irclogbot_0 has quit IRC | 18:39 | |
| *** panda has quit IRC | 18:43 | |
| *** hamzy has quit IRC | 18:49 | |
| *** hamzy has joined #oooq | 18:49 | |
| *** dtrainor__ has quit IRC | 18:52 | |
| *** rlandy has quit IRC | 18:56 | |
| *** rlandy has joined #oooq | 19:00 | |
| rlandy | weshay: k - bluejeans sharing fixed | 19:01 |
| weshay | :) | 19:01 |
| rlandy | and sound keys | 19:10 |
| rlandy | getting there | 19:10 |
| *** panda has joined #oooq | 19:19 | |
| *** sanjayu_ has quit IRC | 19:23 | |
| *** Vorrtex has quit IRC | 20:02 | |
| zbr | weshay: rlandy: i will need help with https://review.opendev.org/#/c/669932/1 -- that was the result of talks with infra | 20:03 |
| zbr | we needed a tripleo-repos added to required-projects but it was not ok to add it to openstack-tox-molecule. | 20:03 |
| rlandy | looking | 20:03 |
| zbr | so now we have a tripleo-tox-molecule which is almost identical with openstack-tox-molecule, only diff: it has our own required-projects | 20:04 |
| rlandy | zbr: there are some unique settings here | 20:06 |
| rlandy | can you comment to explain? | 20:06 |
| zbr | there are already 3 lines explaining the resoning for required-projects. | 20:07 |
| zbr | about data, yep I was too lazy, i should have call it molecule_dict maybe? | 20:07 |
| zbr | i doubt we need to document yaml anchors but good names would be a good idea. | 20:08 |
| weshay | rlandy this is a pid one job? periodic-tripleo-ci-centos-7-ha_lab_andromeda-baremetal_3ctlr_2comp-featureset001-master | 20:11 |
| rlandy | zbr: just what that data is in the same would be helpful | 20:11 |
| rlandy | weshay: because it was created by lucas? | 20:11 |
| weshay | aye | 20:11 |
| rlandy | esoteric question | 20:12 |
| weshay | rlandy sorry.. is it a pidone job? | 20:12 |
| zbr | weshay: can I order 12k of these? https://images-na.ssl-images-amazon.com/images/I/717iyAdhFaL._SL1500_.jpg | 20:12 |
| weshay | meaning was is created by lucas | 20:12 |
| weshay | zbr do your best w/ links, comments | 20:12 |
| weshay | zbr not asking for perfection | 20:12 |
| rlandy | weshay: ack - in a sense that it uses theor hw | 20:12 |
| rlandy | their | 20:12 |
| rlandy | weshay: I have a fix for our master jobs | 20:12 |
| rlandy | need longer deploy time | 20:12 |
| rlandy | adding now | 20:12 |
| rlandy | k | 20:17 |
| *** irclogbot_1 has joined #oooq | 20:24 | |
| *** irclogbot_1 has quit IRC | 20:27 | |
| rlandy | weshay: the ovb rhel-8 job should just run on branches: master? or branches: "^.*$" | 20:28 |
| rlandy | two ovb jobs defined | 20:28 |
| weshay | rlandy follow the pattern for the centos jobs | 20:29 |
| *** dsneddon has quit IRC | 20:29 | |
| weshay | we'll want both 3rd party check and periodic | 20:29 |
| rlandy | https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/ovb-jobs.yaml#L22 | 20:30 |
| rlandy | I'll start with master | 20:30 |
| rlandy | hmmmm ... http://logs.rdoproject.org/70/21270/27/check/periodic-tripleo-ci-rhel-8-standalone-master/e504eb2/logs/undercloud/home/zuul/repo_setup.log.txt.gz | 20:32 |
| rlandy | 2019-07-09 16:25:57 | You can remove cached packages by executing 'dnf clean packages'. | 20:32 |
| rlandy | 2019-07-09 16:25:57 | Error: Transaction check error: | 20:32 |
| rlandy | 2019-07-09 16:25:57 | package tzdata-2019b-1.el8.noarch is already installed | 20:32 |
| rlandy | 2019-07-09 16:25:57 | package python3-inotify-0.9.6-13.1.el8ost.noarch is already installed | 20:32 |
| rlandy | 2019-07-09 16:25:57 | package python3-decorator-4.2.1-2.1.el8ost.noarch is already installed | 20:32 |
| rlandy | 2019-07-09 16:25:57 | package python3-babel-2.5.1-5.el8.noarch is already installed | 20:32 |
| rlandy | ^^ new? | 20:32 |
| *** hamzy has quit IRC | 20:37 | |
| weshay | hrm | 20:38 |
| weshay | rlandy perhaps the node pool image did not clean up the yum transactions.. | 20:39 |
| weshay | when it was built | 20:39 |
| weshay | rlandy in that initial install package script that we have... we should should def run yum clean all | 20:39 |
| * weshay gets | 20:39 | |
| *** dtrainor has joined #oooq | 20:40 | |
| weshay | rlandy perhaps we hardcode a yum clean all here https://github.com/openstack/tripleo-quickstart/blob/master/roles/repo-setup/templates/repo_setup.sh.j2#L117 | 20:41 |
| weshay | er.. wrong line | 20:42 |
| weshay | rlandy you can probably fix that in the release file too | 20:42 |
| weshay | maybe line 115 | 20:42 |
| weshay | so before repo_cmd_after | 20:43 |
| weshay | we always force a yum clean all | 20:43 |
| zbr | weshay: let me know if now it looks ok, https://review.opendev.org/#/c/669932/3/zuul.d/ansible.yaml | 20:47 |
| weshay | zbr paste me a link so I can read about zuul anchors | 20:49 |
| zbr | sure https://lmgtfy.com/?q=yaml+anchors | 20:51 |
| zbr | it has nothing to do with zuul, yaml feature | 20:51 |
| zbr | almost any yaml parser supports them, they work with ansible, molecule, zuul, <name-it>. | 20:52 |
| weshay | zbr sure.. I just don't know how to read your change w/o knowing the above | 20:52 |
| weshay | I suspect neither does rlandy | 20:52 |
| rlandy | weshay: we have it in the release file | 20:52 |
| rlandy | ack | 20:53 |
| rlandy | weshay: this looks better ... https://review.rdoproject.org/zuul/stream/73a9cf15fea8474dbfa79161daebc4c2?logfile=console.log | 20:53 |
| weshay | rlandy hrm.. perhaps the image is fubar'd | 20:53 |
| rlandy | maybe a hotch | 20:53 |
| rlandy | hitch | 20:53 |
| rlandy | going ok now | 20:53 |
| zbr | it is true that is not the most obvious syntax, and I could avoid it in this case, the benefit being small. | 20:53 |
| weshay | zbr where is the molecule anchor defined? | 20:53 |
| zbr | read http://blogs.perl.org/users/tinita/2019/05/reusing-data-with-yaml-anchors-aliases-and-merge-keys.html | 20:54 |
| zbr | this one should be clean | 20:54 |
| weshay | zbr get on the phone w/ me | 20:54 |
| zbr | joined | 20:55 |
| *** aakarsh has quit IRC | 20:58 | |
| *** irclogbot_3 has joined #oooq | 21:14 | |
| weshay | rlandy hrm | 21:17 |
| weshay | Server unable to read htaccess file, denying access to be safe</p>\n</body></html>\n" | 21:17 |
| weshay | that is new I think | 21:18 |
| rlandy | weshay: which log are you looking at? | 21:18 |
| weshay | http://logs.rdoproject.org/70/21270/27/check/periodic-tripleo-ci-rhel-8-standalone-master/73a9cf1/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz | 21:18 |
| rlandy | oh standalone | 21:18 |
| rlandy | yeah I was just looking at that | 21:18 |
| rlandy | maybe we need some secret? | 21:18 |
| rlandy | comparing with http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-standalone-master/a7965fb/logs/undercloud/home/zuul/containers-prepare-parameters.yaml.txt.gz | 21:19 |
| rlandy | weshay: ^^ they look the same | 21:19 |
| rlandy | I have tried doccker.io and truck,registry.... | 21:19 |
| rlandy | idk atm | 21:19 |
| *** irclogbot_3 has quit IRC | 21:19 | |
| weshay | rlandy I would guess that buildah is different on centos7 / rhel8 | 21:19 |
| rlandy | weshay: ok - so maybe it's time to stop this 'hack' route | 21:20 |
| rlandy | weshay: I wanted to fix dlrn reporting | 21:20 |
| rlandy | which is working now | 21:20 |
| weshay | nice | 21:20 |
| rlandy | weshay: I will leave notes for chandan | 21:20 |
| rlandy | weshay: working on ovb jobs now | 21:20 |
| rlandy | weshay: to start, since we have no images, setting build_image to be true | 21:21 |
| weshay | rlandy I think there are some custom options for rhel8 | 21:22 |
| weshay | it's not going to wrk | 21:22 |
| weshay | work | 21:22 |
| rlandy | yep - I figure it will break | 21:23 |
| rlandy | bit we have to start somewhere | 21:23 |
| rlandy | but | 21:24 |
| weshay | rlandy we should start getting hand offs from the folks owning the image and container builds | 21:24 |
| weshay | and push it when they are not on | 21:24 |
| *** aakarsh has joined #oooq | 21:30 | |
| *** chem has quit IRC | 21:36 | |
| *** irclogbot_0 has joined #oooq | 21:38 | |
| *** irclogbot_0 has quit IRC | 21:43 | |
| *** irclogbot_0 has joined #oooq | 21:54 | |
| *** altlogbot_2 has joined #oooq | 21:54 | |
| *** altlogbot_2 has quit IRC | 21:55 | |
| *** irclogbot_0 has quit IRC | 21:59 | |
| *** tosky has quit IRC | 22:18 | |
| rlandy | weshay: https://github.com/openstack/tripleo-quickstart-extras/blob/master/releasenotes/source/conf.py#L136 | 22:20 |
| rlandy | interesting | 22:20 |
| rlandy | permission on the local registry | 22:20 |
| rlandy | Error reading manifest current-tripleo in 192.168.24.1:8787/tripleomaster/centos-binary-rsyslog-base: | 22:22 |
| rlandy | change on the image itself? | 22:22 |
| rlandy | or the node | 22:22 |
| * rlandy tries | 22:22 | |
| *** altlogbot_3 has joined #oooq | 22:44 | |
| *** altlogbot_3 has quit IRC | 22:49 | |
| *** slaweq has quit IRC | 22:54 | |
| *** hamzy has joined #oooq | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
