*** ratailor has joined #oooq | 04:34 | |
*** ykarel has joined #oooq | 04:49 | |
*** skramaja has joined #oooq | 05:13 | |
*** saneax has joined #oooq | 05:26 | |
*** apetrich has joined #oooq | 05:42 | |
*** marios has joined #oooq | 05:45 | |
*** marios is now known as marios|ruck | 05:45 | |
*** ysandeep|away is now known as ysandeep | 06:06 | |
*** tosky has joined #oooq | 07:42 | |
marios|ruck | ykarel: o/ hey man can you check https://bugs.launchpad.net/tripleo/+bug/1891000/comments/5 when you next have some time... perhaps we need even newer version? | 07:52 |
---|---|---|
openstack | Launchpad bug 1891000 in tripleo "master network component failing tempest - neutron containers unexpected keyword argument 'libc'" [Critical,In progress] - Assigned to yatin (yatinkarel) | 07:52 |
ykarel | marios|ruck, looking | 07:56 |
*** jpena|off is now known as jpena | 07:57 | |
ykarel | marios|ruck, isn't there a recent promotion? | 07:58 |
ykarel | containers don't have right version https://logserver.rdoproject.org/openstack-component-network/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-network-master/6ab8093/logs/undercloud/var/log/extra/podman/containers/ovn_metadata_agent/podman_info.log.txt.gz | 07:59 |
ykarel | looks like there is no promotion from last 3 days | 08:00 |
ykarel | current-tripleo is old | 08:01 |
marios|ruck | ykarel: ah that makes more sense now ok thanks | 08:01 |
*** ysandeep is now known as ysandeep|lunch | 09:20 | |
*** ysandeep|lunch is now known as ysandeep | 09:35 | |
marios|ruck | omnom nom lunch | 10:03 |
marios|ruck | very quiet around here must be summer | 10:03 |
marios|ruck | everyone at the beach? | 10:03 |
marios|ruck | cool | 10:26 |
marios|ruck | story | 10:26 |
marios|ruck | bro | 10:26 |
zbr | marios|ruck: yeah, i go tired of walking back and forth to get a new margarita | 10:26 |
marios|ruck | lol | 10:26 |
*** jmasud has quit IRC | 10:31 | |
*** jmasud has joined #oooq | 10:33 | |
*** yolanda has quit IRC | 10:42 | |
*** ykarel_ has joined #oooq | 10:43 | |
zbr | marios|ruck: joke aside, i seen the same level of activity on almost all channels | 10:44 |
zbr | until end of month, I do not have high hopes | 10:44 |
*** ykarel has quit IRC | 10:45 | |
*** yolanda has joined #oooq | 10:46 | |
*** apetrich has quit IRC | 11:11 | |
*** yolanda has quit IRC | 11:13 | |
*** yolanda has joined #oooq | 11:20 | |
*** apetrich has joined #oooq | 11:23 | |
*** jpena is now known as jpena|lunch | 11:37 | |
*** ykarel_ is now known as ykarel | 11:55 | |
*** rfolco has joined #oooq | 12:05 | |
arxcruz | marios|ruck: too hot to even think here in Berlim | 12:13 |
*** rlandy has joined #oooq | 12:21 | |
akahat | odyssey4me, o/ | 12:22 |
akahat | odyssey4me, whenever you have time please take a look: https://review.opendev.org/#/q/status:open+branch:master+topic:baremetal_resources | 12:22 |
rlandy | marios|ruck: hey | 12:26 |
rlandy | marios|ruck: how goes it today? | 12:26 |
odyssey4me | akahat: some feedback in https://review.opendev.org/#/c/720705/24 - otherwise looks sensible enough and now it comes down to trial and error in testing I guess | 12:29 |
marios|ruck | rlandy: o/ hey a couple transient/no bug issues in the integration pipelines today noted in hackmd. otherwise we have quite a list of ongoing issues | 12:30 |
marios|ruck | rlandy: rlandy: no new bugs yet today | 12:30 |
rlandy | marios|ruck: idk if you saw the rocky issue come up again ... https://bugs.launchpad.net/tripleo/+bug/1891372 | 12:31 |
openstack | Launchpad bug 1891372 in tripleo "rocky periodic jobs are failing with " Error: image tripleorocky/centos-binary-tempest:9801dc7461cbd6cbd73868e72e74d21d586c6708_fbb4de96-updated-20200812131025 not found"" [Critical,Triaged] | 12:31 |
marios|ruck | rlandy: i saw the one you filed for rocky yesterday i poked a bit... i saw two different types of problem the one you reported in https://bugs.launchpad.net/tripleo/+bug/1891372 for missing container image but then there was another like execution: [Errno 2] No such file or directory: '/home/zuul/tempest' | 12:31 |
akahat | odyssey4me, okay. i'll fix the review comments. | 12:31 |
akahat | odyssey4me, https://review.opendev.org/#/c/720705/24/tasks/tempest_ironic_resources.yml@58 i need block here.. i need to pass evnrionment variable there. | 12:31 |
rlandy | marios|ruck: yeah - in the tempest logs we see the error in the bug | 12:31 |
rlandy | same issue | 12:32 |
rlandy | seen it in a few check jobs as well | 12:32 |
odyssey4me | akahat: you can pass an environment variable to any task, no need for a block | 12:32 |
marios|ruck | rlandy: i see... ok sync on scrum in half hour? (or we can stay on after ) | 12:32 |
marios|ruck | rlandy: otherwise see hackmd anyway in meantime | 12:32 |
odyssey4me | akahat: see https://docs.ansible.com/ansible/latest/user_guide/playbooks_environment.html - no block required | 12:33 |
odyssey4me | akahat: the environment key work can be used on any playbook, task or block | 12:33 |
odyssey4me | *word | 12:33 |
* akahat looking.. | 12:34 | |
rlandy | marios|ruck: ack - chat at scrum | 12:34 |
akahat | odyssey4me, simple example why i used block there: http://paste.openstack.org/show/796813/ | 12:46 |
odyssey4me | akahat: oh really? that's news to me - ok, then use the block - thank you for your patience | 12:47 |
akahat | odyssey4me, okay. thanks :) I'll fix the other comments. | 12:48 |
rfolco | arxcruz, a few questions on https://review.rdoproject.org/r/#/c/28956/ | 12:49 |
rfolco | arxcruz, pls take a look | 12:49 |
*** jpena|lunch is now known as jpena | 12:50 | |
*** TrevorV has joined #oooq | 12:57 | |
*** ratailor has quit IRC | 13:14 | |
*** skramaja has quit IRC | 13:32 | |
rlandy | marios|ruck: https://review.rdoproject.org/r/#/c/28705/ | 13:38 |
marios|ruck | arxcruz: o/ hey do you have any idea about https://bugs.launchpad.net/tripleo/+bug/1891372 2020-08-12 13:48:51 | Error: image tripleorocky/centos-binary-tempest:9801dc7461cbd6cbd73868e72e74d21d586c6708_fbb4de96-updated-20200812130906 not found | 13:51 |
openstack | Launchpad bug 1891372 in tripleo "rocky periodic jobs are failing with " Error: image tripleorocky/centos-binary-tempest:9801dc7461cbd6cbd73868e72e74d21d586c6708_fbb4de96-updated-20200812131025 not found"" [Critical,Triaged] | 13:51 |
marios|ruck | https://irssi.org/ ysandeep | 13:53 |
ysandeep | marios|ruck, hexchat | 13:53 |
rlandy | ysandeep: hey - did you want to chat before the weekend? | 13:58 |
ysandeep | rlandy, sure | 13:58 |
rlandy | ysandeep: k - give me a few - will ping | 13:58 |
*** ykarel has quit IRC | 13:59 | |
*** ykarel has joined #oooq | 13:59 | |
*** ykarel_ has joined #oooq | 14:03 | |
*** ykarel has quit IRC | 14:05 | |
rlandy | ysandeep: meet.google.com/typ-vjpe-fgz | 14:16 |
arxcruz | marios|ruck: no | 14:19 |
arxcruz | rlandy: sorry, i saw your question yesterday only this morning | 14:19 |
arxcruz | marios|ruck: chandan should know, he is the one who handle with these containers | 14:19 |
rlandy | arxcruz: sorry - in meeting with discussing with marios|ruck | 14:20 |
arxcruz | marios|ruck: rlandy basically, we should not be running rocky with validate-tempest | 14:27 |
arxcruz | should use os_tempest, and it seems i'm going to need to create the clouds.yaml to rocky as well | 14:28 |
marios|ruck | arxcruz: any idea why/how we started using that? | 14:29 |
*** ykarel__ has joined #oooq | 14:30 | |
*** ykarel_ has quit IRC | 14:32 | |
arxcruz | ykarel__: do you know if the centos-binary-tempest image is still being built ? | 14:34 |
arxcruz | it should be | 14:34 |
arxcruz | marios|ruck: well, we always run with validate-tempest before os_tempest, I was migrating the stein and queens job to os_tempest, what we can do right now is not run tempest with container, i think there is an option for that | 14:34 |
ykarel__ | arxcruz, it should be building, for which release you looking for | 14:35 |
*** ykarel__ is now known as ykarel | 14:35 | |
arxcruz | ykarel: rocky | 14:36 |
arxcruz | ykarel: https://bugs.launchpad.net/tripleo/+bug/1891372 | 14:36 |
openstack | Launchpad bug 1891372 in tripleo "rocky periodic jobs are failing with " Error: image tripleorocky/centos-binary-tempest:9801dc7461cbd6cbd73868e72e74d21d586c6708_fbb4de96-updated-20200812131025 not found"" [Critical,Triaged] | 14:36 |
arxcruz | marios|ruck: are you still in meeting with rlandy ? | 14:37 |
ykarel | ack looking | 14:38 |
arxcruz | marios|ruck: https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset001.yml#L213 change here to packages should fix the problem temporarly | 14:38 |
ykarel | arxcruz, that image exist in rdo registry skopeo inspect docker://trunk.registry.rdoproject.org/tripleorocky/centos-binary-tempest:9801dc7461cbd6cbd73868e72e74d21d586c6708_fbb4de96 | 14:41 |
ykarel | so means it's build | 14:41 |
ykarel | possibly it's not pushed to docker.io due to some issue | 14:41 |
ykarel | there were recently couple of changes in promotion process which hit some other releases, may be same case is for rocky | 14:42 |
arxcruz | marios|ruck: ^ | 14:43 |
arxcruz | rlandy: ^ | 14:43 |
rlandy | k - will look after meeting | 14:44 |
*** rlandy is now known as rlandy|mtg | 14:44 | |
marios|ruck | arxcruz: thanks will check in bit | 14:44 |
marios|ruck | arxcruz: could you please put a comment in the bug with some of those pointers/ |^^^^ pretty please with cherries | 14:44 |
marios|ruck | and thank you very much arxcruz | 14:45 |
marios|ruck | ;) | 14:45 |
ykarel | arxcruz, sorry i noticed now jobs failing in periodic so not related to docker.io | 14:54 |
ykarel | arxcruz, so image is build fine, but job is using wrong container image for tempest | 14:59 |
ykarel | https://logserver.rdoproject.org/openstack-periodic-integration-stable4-5/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-undercloud-containers-rocky/90516c5/logs/undercloud/var/log/extra/docker/docker_allinfo.log.txt.gz | 15:00 |
*** rlandy|mtg is now known as rlandy | 15:15 | |
rlandy | arxcruz: marios|ruck: sorry - reading back | 15:15 |
rlandy | marios|ruck: do we need to fix rocky container push? | 15:17 |
marios|ruck | rlandy: rlandy: what's wrong with it? https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-centos-7-rocky-containers-build-push | 15:19 |
rlandy | marios|ruck: it won't run again for a while, right? | 15:21 |
rlandy | we could rerun broken jobs if the container exists now | 15:21 |
ykarel | rlandy, see last 3 statements, container exists but job using wrong container images so just rerunning will not help | 15:23 |
*** ysandeep is now known as ysandeep|away | 15:35 | |
sshnaidm | rlandy, hi, which mirrors do we use in ds jobs? | 15:49 |
rlandy | sshnaidm: mirror_locn: afs-mirror.sf.hosted.upshift.rdu2.redhat.com | 15:52 |
sshnaidm | rlandy, ack | 15:52 |
sshnaidm | rlandy, please take a look: https://review.rdoproject.org/r/#/c/28959/ | 15:53 |
sshnaidm | rlandy, how does resolving internal cloud api work now? We have use internal dns for that | 15:53 |
sshnaidm | rlandy, but I have 127.0.0.1 only as a nameserver when hosts starts up | 15:54 |
rlandy | sshnaidm: yes - we have two nameserver we use | 15:54 |
sshnaidm | rlandy, do you inject these dns somewhere? | 15:54 |
rlandy | sshnaidm: yep - settings files | 15:54 |
sshnaidm | rlandy, before ovb manage role starts? | 15:55 |
rlandy | sshnaidm: see tripleo-environments/config/environments/ovb-internal.yml | 15:58 |
rlandy | we add that to toci-quickstart/config/testenv/ovb-internal.yml | 15:58 |
rlandy | see playbooks/setup-rhel-ovb.yaml in tripleo-ci-internal-jobs | 15:58 |
sshnaidm | rlandy, yeah, but I mean steps before quickstart, when creating ovb stack | 16:00 |
rlandy | oh ... getting | 16:00 |
rlandy | see the job definition ... periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal in zuul.d/ovb.yaml in tripleo-ci-internal-jobs | 16:02 |
rlandy | we added that because stack delete was failing | 16:02 |
rlandy | sshnaidm: if you are running on the internal cloud, 127.0.0.1 should resolve internal | 16:04 |
marios|ruck | rlandy: sorry - got distracted locally... reading back | 16:10 |
rlandy | marios|ruck: np - nothing really to see | 16:10 |
marios|ruck | rlandy: so re-running rocky won' help ? re-reading the bug | 16:11 |
rlandy | marios|ruck: see yatins comment | 16:11 |
*** jpena is now known as jpena|off | 16:12 | |
marios|ruck | rlandy: i see so that's what you meant about fixing the job | 16:16 |
rlandy | marios|ruck: ack | 16:17 |
marios|ruck | rlandy: and is there is rocky | 16:18 |
marios|ruck | rlandy: https://github.com/openstack/tripleo-common/blob/bea923b855c68cc5ffff553604c3f4d32f2960be/container-images/overcloud_containers.yaml.j2#L891 | 16:19 |
marios|ruck | rlandy: gonna dig there furhter monday... | 16:20 |
marios|ruck | have a good recharge day folks | 16:20 |
rlandy | marios|ruck: you too | 16:22 |
rlandy | see you monday | 16:22 |
*** rlandy is now known as rlandy|ruck | 16:22 | |
*** TrevorV has quit IRC | 16:26 | |
*** marios|ruck is now known as marios|out | 16:26 | |
*** ykarel is now known as ykarel|away | 16:42 | |
*** tosky has quit IRC | 16:43 | |
*** marios|out has quit IRC | 16:44 | |
*** jfrancoa has quit IRC | 16:54 | |
*** ykarel|away has quit IRC | 17:10 | |
*** tosky has joined #oooq | 20:10 | |
*** rfolco has quit IRC | 20:51 | |
*** saneax has quit IRC | 21:18 | |
*** rlandy|ruck has quit IRC | 21:50 | |
*** rfolco has joined #oooq | 22:12 | |
*** tosky has quit IRC | 23:09 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!