Thursday, 2020-08-13

*** ratailor has joined #oooq04:34
*** ykarel has joined #oooq04:49
*** skramaja has joined #oooq05:13
*** saneax has joined #oooq05:26
*** apetrich has joined #oooq05:42
*** marios has joined #oooq05:45
*** marios is now known as marios|ruck05:45
*** ysandeep|away is now known as ysandeep06:06
*** tosky has joined #oooq07:42
marios|ruckykarel: o/ hey man can you check https://bugs.launchpad.net/tripleo/+bug/1891000/comments/5 when you next have some time... perhaps we need even newer version?07:52
openstackLaunchpad bug 1891000 in tripleo "master network component failing tempest - neutron containers unexpected keyword argument 'libc'" [Critical,In progress] - Assigned to yatin (yatinkarel)07:52
ykarelmarios|ruck, looking07:56
*** jpena|off is now known as jpena07:57
ykarelmarios|ruck, isn't there a recent promotion?07:58
ykarelcontainers don't have right version https://logserver.rdoproject.org/openstack-component-network/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-8-standalone-network-master/6ab8093/logs/undercloud/var/log/extra/podman/containers/ovn_metadata_agent/podman_info.log.txt.gz07:59
ykarellooks like there is no promotion from last 3 days08:00
ykarelcurrent-tripleo is old08:01
marios|ruckykarel: ah that makes more sense now ok thanks08:01
*** ysandeep is now known as ysandeep|lunch09:20
*** ysandeep|lunch is now known as ysandeep09:35
marios|ruckomnom nom lunch10:03
marios|ruckvery quiet around here must be summer10:03
marios|ruckeveryone at the beach?10:03
marios|ruckcool10:26
marios|ruckstory10:26
marios|ruckbro10:26
zbrmarios|ruck: yeah, i go tired of walking back and forth to get a new margarita10:26
marios|rucklol10:26
*** jmasud has quit IRC10:31
*** jmasud has joined #oooq10:33
*** yolanda has quit IRC10:42
*** ykarel_ has joined #oooq10:43
zbrmarios|ruck: joke aside, i seen the same level of activity on almost all channels10:44
zbruntil end of month, I do not have high hopes10:44
*** ykarel has quit IRC10:45
*** yolanda has joined #oooq10:46
*** apetrich has quit IRC11:11
*** yolanda has quit IRC11:13
*** yolanda has joined #oooq11:20
*** apetrich has joined #oooq11:23
*** jpena is now known as jpena|lunch11:37
*** ykarel_ is now known as ykarel11:55
*** rfolco has joined #oooq12:05
arxcruzmarios|ruck: too hot to even think here in Berlim12:13
*** rlandy has joined #oooq12:21
akahatodyssey4me, o/12:22
akahatodyssey4me, whenever you have time please take a look: https://review.opendev.org/#/q/status:open+branch:master+topic:baremetal_resources12:22
rlandymarios|ruck: hey12:26
rlandymarios|ruck: how goes it today?12:26
odyssey4meakahat: some feedback in https://review.opendev.org/#/c/720705/24 - otherwise looks sensible enough and now it comes down to trial and error in testing I guess12:29
marios|ruckrlandy: o/ hey a couple transient/no bug issues in the integration pipelines today noted in hackmd. otherwise we have quite a list of ongoing issues12:30
marios|ruckrlandy: rlandy: no new bugs yet today12:30
rlandymarios|ruck: idk if you saw the rocky issue come up again ... https://bugs.launchpad.net/tripleo/+bug/189137212:31
openstackLaunchpad bug 1891372 in tripleo "rocky periodic jobs are failing with " Error: image tripleorocky/centos-binary-tempest:9801dc7461cbd6cbd73868e72e74d21d586c6708_fbb4de96-updated-20200812131025 not found"" [Critical,Triaged]12:31
marios|ruckrlandy: i saw the one you filed for rocky yesterday i poked a bit... i saw two different types of problem the one you reported in https://bugs.launchpad.net/tripleo/+bug/1891372 for missing container image but then there was another like execution: [Errno 2] No such file or directory: '/home/zuul/tempest'12:31
akahatodyssey4me, okay. i'll fix the review comments.12:31
akahatodyssey4me, https://review.opendev.org/#/c/720705/24/tasks/tempest_ironic_resources.yml@58 i need block here.. i need to pass evnrionment variable there.12:31
rlandymarios|ruck: yeah - in the tempest logs we see the error in the bug12:31
rlandysame issue12:32
rlandyseen it in a few check jobs as well12:32
odyssey4meakahat: you can pass an environment variable to any task, no need for a block12:32
marios|ruckrlandy: i see... ok sync on scrum in half hour? (or we can stay on after )12:32
marios|ruckrlandy: otherwise see hackmd anyway in meantime12:32
odyssey4meakahat: see https://docs.ansible.com/ansible/latest/user_guide/playbooks_environment.html - no block required12:33
odyssey4meakahat: the environment key work can be used on any playbook, task or block12:33
odyssey4me*word12:33
* akahat looking..12:34
rlandymarios|ruck: ack - chat at scrum12:34
akahatodyssey4me, simple example why i used block there: http://paste.openstack.org/show/796813/12:46
odyssey4meakahat: oh really? that's news to me - ok, then use the block - thank you for your patience12:47
akahatodyssey4me, okay. thanks :) I'll fix the other comments.12:48
rfolcoarxcruz, a few questions on https://review.rdoproject.org/r/#/c/28956/12:49
rfolcoarxcruz, pls take a look12:49
*** jpena|lunch is now known as jpena12:50
*** TrevorV has joined #oooq12:57
*** ratailor has quit IRC13:14
*** skramaja has quit IRC13:32
rlandymarios|ruck: https://review.rdoproject.org/r/#/c/28705/13:38
marios|ruckarxcruz: o/ hey do you have any idea about https://bugs.launchpad.net/tripleo/+bug/1891372 2020-08-12 13:48:51 | Error: image tripleorocky/centos-binary-tempest:9801dc7461cbd6cbd73868e72e74d21d586c6708_fbb4de96-updated-20200812130906 not found13:51
openstackLaunchpad bug 1891372 in tripleo "rocky periodic jobs are failing with " Error: image tripleorocky/centos-binary-tempest:9801dc7461cbd6cbd73868e72e74d21d586c6708_fbb4de96-updated-20200812131025 not found"" [Critical,Triaged]13:51
marios|ruckhttps://irssi.org/ ysandeep13:53
ysandeepmarios|ruck, hexchat13:53
rlandyysandeep: hey - did you want to chat before the weekend?13:58
ysandeeprlandy, sure13:58
rlandyysandeep: k - give me a few - will ping13:58
*** ykarel has quit IRC13:59
*** ykarel has joined #oooq13:59
*** ykarel_ has joined #oooq14:03
*** ykarel has quit IRC14:05
rlandyysandeep: meet.google.com/typ-vjpe-fgz14:16
arxcruzmarios|ruck: no14:19
arxcruzrlandy: sorry, i saw your question yesterday only this morning14:19
arxcruzmarios|ruck: chandan should know, he is the one who handle with these containers14:19
rlandyarxcruz: sorry  - in meeting with discussing with marios|ruck14:20
arxcruzmarios|ruck: rlandy basically, we should not be running rocky with validate-tempest14:27
arxcruzshould use os_tempest, and it seems i'm going to need to create the clouds.yaml to rocky as well14:28
marios|ruckarxcruz: any idea why/how we started using that?14:29
*** ykarel__ has joined #oooq14:30
*** ykarel_ has quit IRC14:32
arxcruzykarel__: do you know if the centos-binary-tempest image is still being built ?14:34
arxcruzit should be14:34
arxcruzmarios|ruck: well, we always run with validate-tempest before os_tempest, I was migrating the stein and queens job to os_tempest, what we can do right now is not run tempest with container, i think there is an option for that14:34
ykarel__arxcruz, it should be building, for which release you looking for14:35
*** ykarel__ is now known as ykarel14:35
arxcruzykarel: rocky14:36
arxcruzykarel: https://bugs.launchpad.net/tripleo/+bug/189137214:36
openstackLaunchpad bug 1891372 in tripleo "rocky periodic jobs are failing with " Error: image tripleorocky/centos-binary-tempest:9801dc7461cbd6cbd73868e72e74d21d586c6708_fbb4de96-updated-20200812131025 not found"" [Critical,Triaged]14:36
arxcruzmarios|ruck: are you still in meeting with rlandy ?14:37
ykarelack looking14:38
arxcruzmarios|ruck: https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset001.yml#L213 change here to packages should fix the problem temporarly14:38
ykarelarxcruz, that image exist in rdo registry skopeo inspect docker://trunk.registry.rdoproject.org/tripleorocky/centos-binary-tempest:9801dc7461cbd6cbd73868e72e74d21d586c6708_fbb4de9614:41
ykarelso means it's build14:41
ykarelpossibly it's not pushed to docker.io due to some issue14:41
ykarelthere were recently couple of changes in promotion process which hit some other releases, may be same case is for rocky14:42
arxcruzmarios|ruck: ^14:43
arxcruzrlandy: ^14:43
rlandyk - will look after meeting14:44
*** rlandy is now known as rlandy|mtg14:44
marios|ruckarxcruz: thanks will check in bit14:44
marios|ruckarxcruz: could you please put a comment in the bug with some of those pointers/ |^^^^ pretty please with cherries14:44
marios|ruckand thank you very much arxcruz14:45
marios|ruck;)14:45
ykarelarxcruz, sorry i noticed now jobs failing in periodic so not related to docker.io14:54
ykarelarxcruz, so image is build fine, but job is using wrong container image for tempest14:59
ykarelhttps://logserver.rdoproject.org/openstack-periodic-integration-stable4-5/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-undercloud-containers-rocky/90516c5/logs/undercloud/var/log/extra/docker/docker_allinfo.log.txt.gz15:00
*** rlandy|mtg is now known as rlandy15:15
rlandyarxcruz: marios|ruck: sorry - reading back15:15
rlandymarios|ruck: do we need to fix rocky container push?15:17
marios|ruckrlandy: rlandy: what's wrong with it? https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-centos-7-rocky-containers-build-push15:19
rlandymarios|ruck: it won't run again for a while, right?15:21
rlandywe could rerun broken jobs if the container exists now15:21
ykarelrlandy, see last 3 statements, container exists but job using wrong container images so just rerunning will not help15:23
*** ysandeep is now known as ysandeep|away15:35
sshnaidmrlandy, hi, which mirrors do we use in ds jobs?15:49
rlandysshnaidm:  mirror_locn: afs-mirror.sf.hosted.upshift.rdu2.redhat.com15:52
sshnaidmrlandy, ack15:52
sshnaidmrlandy, please take a look: https://review.rdoproject.org/r/#/c/28959/15:53
sshnaidmrlandy, how does resolving internal cloud api work now? We have use internal dns for that15:53
sshnaidmrlandy, but I have 127.0.0.1 only as a nameserver when hosts starts up15:54
rlandysshnaidm: yes - we have two nameserver we use15:54
sshnaidmrlandy, do you inject these dns somewhere?15:54
rlandysshnaidm: yep - settings files15:54
sshnaidmrlandy, before ovb manage role starts?15:55
rlandysshnaidm: see tripleo-environments/config/environments/ovb-internal.yml15:58
rlandywe add that to toci-quickstart/config/testenv/ovb-internal.yml15:58
rlandysee playbooks/setup-rhel-ovb.yaml in tripleo-ci-internal-jobs15:58
sshnaidmrlandy, yeah, but I mean steps before quickstart, when creating ovb stack16:00
rlandyoh ... getting16:00
rlandysee the job definition ... periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal in  zuul.d/ovb.yaml in tripleo-ci-internal-jobs16:02
rlandywe added that because stack delete was failing16:02
rlandysshnaidm: if you are running on the internal cloud, 127.0.0.1 should resolve internal16:04
marios|ruckrlandy: sorry - got distracted locally... reading back16:10
rlandymarios|ruck: np - nothing really to see16:10
marios|ruckrlandy: so re-running rocky won' help ? re-reading the bug16:11
rlandymarios|ruck: see yatins comment16:11
*** jpena is now known as jpena|off16:12
marios|ruckrlandy: i see so that's what you meant about fixing the job16:16
rlandymarios|ruck: ack16:17
marios|ruckrlandy: and is there is rocky16:18
marios|ruckrlandy: https://github.com/openstack/tripleo-common/blob/bea923b855c68cc5ffff553604c3f4d32f2960be/container-images/overcloud_containers.yaml.j2#L89116:19
marios|ruckrlandy: gonna dig there furhter monday...16:20
marios|ruckhave a good recharge day folks16:20
rlandymarios|ruck: you too16:22
rlandysee you monday16:22
*** rlandy is now known as rlandy|ruck16:22
*** TrevorV has quit IRC16:26
*** marios|ruck is now known as marios|out16:26
*** ykarel is now known as ykarel|away16:42
*** tosky has quit IRC16:43
*** marios|out has quit IRC16:44
*** jfrancoa has quit IRC16:54
*** ykarel|away has quit IRC17:10
*** tosky has joined #oooq20:10
*** rfolco has quit IRC20:51
*** saneax has quit IRC21:18
*** rlandy|ruck has quit IRC21:50
*** rfolco has joined #oooq22:12
*** tosky has quit IRC23:09

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!