Tuesday, 2020-06-16

*** rlandy|bbl is now known as rlandy00:01
ysandeepinstrospection failed on enve :(00:04
*** jmasud has quit IRC00:09
rlandyweshay|ruck: hey - still around?00:16
rlandyysandeep: yep - you need that dep for dlrn00:17
rlandyysandeep: I'm hitting an error with introspection that looks to be related to an older version00:17
rlandygoing to try tripleo-ci-testing00:17
ysandeeprlandy, older version of which package?00:17
rlandyironic00:18
rlandyhttps://bugzilla.redhat.com/show_bug.cgi?id=181388900:18
openstackbugzilla.redhat.com bug 1813889 in ipmitool "osp16.1, rhel8.2: ipmitool commands via vbmc (virtualbmc) take too long and cause overcloud introspection to fail" [Urgent,Closed: currentrelease] - Assigned to vdolezal00:18
rlandysomething similar to ^^00:18
rlandyhttps://sf.hosted.upshift.rdu2.redhat.com/logs/52/201352/15/check/periodic-tripleo-ci-rhel-8-bm_envE-3ctlr_1comp-featureset001-baremetal-rhos-17/c887451/logs/undercloud/var/log/extra/errors.txt.txt00:19
rlandyFailed to set boot device to PXE: Failed to set boot device for node 6fbb4653-64ad-4c52-8294-3f2852c2d9d4:00:19
ysandeeprlandy, reading bz and errors00:20
ysandeepBz seems related to vbmc not ilo00:24
*** Goneri has quit IRC00:28
ysandeeprlandy, to me bz seems unrelated as this is vbmc but no harm in trying latest packages.. I faced some introspection issue initially on envA and I noticed dhcp packets were not reaching the baremetal machines, deleting overcloud bridge connections and recreating worked at that time..00:35
*** holser_ has joined #oooq01:03
*** holser has quit IRC01:05
*** saneax has quit IRC01:09
*** rlandy has quit IRC01:24
*** jmasud has joined #oooq01:48
*** jmasud has quit IRC01:51
*** rfolco|rover has quit IRC01:58
*** ysandeep is now known as ysandeep|away02:03
*** apetrich has quit IRC02:41
*** pojadhav|dinner is now known as pojadhav|ruck02:47
*** jmasud has joined #oooq03:35
*** ysandeep|away is now known as ysandeep04:17
*** jmasud has quit IRC04:28
*** ykarel|away is now known as ykarel04:28
*** ratailor has joined #oooq04:42
*** skramaja has joined #oooq04:44
*** saneax has joined #oooq04:44
*** jmasud has joined #oooq05:11
*** udesale has joined #oooq05:44
*** pojadhav|ruck is now known as pojadhav|away05:58
*** marios has joined #oooq06:04
*** pojadhav|away is now known as pojadhav|ruck06:21
*** jfrancoa has joined #oooq06:49
*** jbadiapa has quit IRC07:01
*** jbadiapa has joined #oooq07:08
*** ccamacho has joined #oooq07:16
arxcruzmarios: https://review.rdoproject.org/r/#/c/28101/ i did some tweaks in the files, now the python code will only be triggered when some python file is touched07:26
mariosarxcruz: ack i'll check thanks07:27
*** tosky has joined #oooq07:31
*** amoralej|off is now known as amoralej07:35
*** dtantsur|afk is now known as dtantsur07:41
*** jpena|off is now known as jpena07:56
*** jmasud has quit IRC07:59
*** ykarel is now known as ykarel|lunch08:08
*** ysandeep is now known as ysandeep|lunch08:46
*** ykarel|lunch is now known as ykarel08:57
*** apetrich has joined #oooq09:41
*** ysandeep|lunch is now known as ysandeep10:05
chandankumarpojadhav|ruck, https://bugs.launchpad.net/tripleo/+bug/1883687 fyi10:17
openstackLaunchpad bug 1883687 in tripleo "test_traffic_ops octavia tempest tests are failing with Connection to the 192.168.24.149 via SSH timed out." [High,Triaged]10:17
*** dmellado has quit IRC10:18
*** derekh has joined #oooq10:25
pandamarios: zbr I'd like you to review the promoter stuff, there are 5 reviews that are passing tests and could be merged. If you need context I'm available whenever you want to meet, IRC, postcards. Just name it, and I'll do it.10:27
mariospanda: ack10:27
zbrpanda: ack, in which order?10:34
pandazbr: marios I'll send en email with the order, and the tasks they refer to.10:35
marioszbr: you can see the order in gerrit UI via related reviews on the top right hand side10:38
*** dmellado has joined #oooq10:41
pandamarios: zbr mail sent, Task have some details, and there's a link to the config engine design10:45
*** sshnaidm is now known as sshnaidm|afk10:45
*** chem has quit IRC11:04
*** chem has joined #oooq11:07
zbri will look right after lunch11:09
pojadhav|ruckchandankumar, ack11:13
*** udesale_ has joined #oooq11:20
*** udesale has quit IRC11:22
*** jpena is now known as jpena|lunch11:32
*** pojadhav|ruck is now known as pojadhav|brb11:33
*** sshnaidm|afk is now known as sshnaidm11:40
*** rlandy has joined #oooq11:46
rlandypanda: hi  ... we need to promote some hash11:47
rlandycurrent-tripleo is super old11:47
pandarlandy: so I can waive those jobs ?11:47
rlandypanda: so looking back ...11:48
rlandyhttps://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-rhos-17/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-rhel-8-rhos-17-promote-promoted-components-to-tripleo-ci-testing-internal/dedf800/job-output.txt11:49
rlandythat pipeline run looks pretty good11:49
rlandy 56d0572b34a0767b082f85a4224ff3ed11:50
weshay|ruckpojadhav|brb, fyi https://bugs.launchpad.net/tripleo/+bug/188369911:50
openstackLaunchpad bug 1883699 in tripleo "sudo dnf update -y --exclude '*openvswitch*', fails on providers and dpdk w/ " [Critical,Triaged]11:50
rlandypanda: multinode-ipa and tempest is fine to be missing11:51
rlandymultinode-ipa was fixed yesterday11:51
rlandypanda: I need to look at why the images are missing11:51
rlandywe need those11:51
rlandy870c5a56daf082fcd4f2c3eab151bf7911:52
pandarlandy: for aggregate 870c5 I have these missing jobs missing jobs ['periodic-tripleo-rhel-8-buildimage-overcloud-full-master', 'periodic-tripleo-ci-rhel-8-standalone-on-multinode-ipa-rhos-17', 'periodic-tripleo-rhel-8-buildimage-ironic-python-agent-master', 'periodic-tripleo-ci-rhel-8-scenario002-standalone-rhos-17', 'periodic-tripleo-ci-rhel-8-standalone-full-tempest-api-rhos-17']11:52
rlandypanda" then we must not be reporting correctly on images11:53
rlandy2020-06-12 20:23:57.069246 | primary | {11:55
rlandy2020-06-12 20:23:57.069330 | primary |   "aggregate_hash": "870c5a56daf082fcd4f2c3eab151bf79",11:55
rlandy2020-06-12 20:23:57.069340 | primary |   "commit_hash": null,11:55
rlandy2020-06-12 20:23:57.069347 | primary |   "component": null,11:55
rlandy2020-06-12 20:23:57.069376 | primary |   "distro_hash": null,11:55
rlandy2020-06-12 20:23:57.069390 | primary |   "in_progress": false,11:55
rlandy2020-06-12 20:23:57.069397 | primary |   "job_id": "periodic-tripleo-rhel-8-buildimage-ironic-python-agent-rhos-17",11:55
rlandy2020-06-12 20:23:57.069405 | primary |   "notes": "",11:55
rlandy2020-06-12 20:23:57.069414 | primary |   "success": true,11:55
rlandy2020-06-12 20:23:57.069420 | primary |   "timestamp": 1592007835,11:55
rlandy2020-06-12 20:23:57.069450 | primary |   "url": "https://sf.hosted.upshift.rdu2.redhat.com/logs/openstack-periodic-rhos-17/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-rhel-8-buildimage-ironic-python-agent-rhos-17/38b8bfe"11:55
rlandypanda: ^^ why is that job missing? passed11:55
rlandyand reproted11:55
rlandyreported11:55
rlandypanda: ah11:56
rlandymaster11:56
rlandythe criteria are wrong11:56
pandaindeed it says everything passed http://osp-trunk.hosted.upshift.rdu2.redhat.com/api-rhel8-osp17/api/civotes_agg_detail.html?ref_hash=870c5a56daf082fcd4f2c3eab151bf7911:56
akahatdtantsur, hi, did you got chance to look in to the failures of BaremetalMultitenancy test failures?11:56
rlandypanda: it's looking for master11:56
rlandy'periodic-tripleo-rhel-8-buildimage-overcloud-full-master'11:56
pandarlandy: I'm using https://code.engineering.redhat.com/gerrit/gitweb?p=tripleo-environments.git;a=blob;f=ci-scripts/dlrnapi_promoter/config/RedHat-8/rhos-17.ini;h=128983b823d471d534e9759b2fafd3c7ae6e36e7;hb=HEAD11:57
pandarlandy: as criteria11:57
rlandypanda: that needs to be updated11:57
rlandypanda: one sec - will put in a patch11:58
pandarlandy: ok, I'll waive all other and start the promotion11:58
rlandypanda: how old is  56d0572b34a0767b082f85a4224ff3ed?11:58
pandarlandy: I see everything passed anyway11:58
pandarlandy: 14th June11:59
rlandyand 870c5a56daf082fcd4f2c3eab151bf79?11:59
*** rfolco|rover has joined #oooq11:59
pandarlandy: 13th11:59
rlandy 56d0572b34a0767b082f85a4224ff3ed it is then11:59
pandarlandy: ok12:00
dtantsurakahat: hi, no, not yet. as an aside, please avoid sending requests to one person to avoid them from blocking you12:02
soniya29arxcruz, I have created a new patch to test the https://review.opendev.org/#/c/720434/.12:03
pandarlandy: ok, pushing images, I'll keep you posted.12:03
rlandypanda:  https://code.engineering.redhat.com/gerrit/203333 Update image build jobs to use rhos-1712:04
akahatdtantsur, ok.12:04
pandarlandy: thanks12:04
arxcruzsoniya29: where?12:04
rlandypanda: I assume you mean overcloud images right?12:04
rlandyno container push12:04
pandarlandy: container ...12:04
rlandypanda: push to where?12:04
rlandythey don;t go anywhere12:04
soniya29arxcruz, here - https://review.opendev.org/#/c/735588/12:05
rlandythey are already in the only registry they should be in12:05
arxcruzsoniya29: it should be in the same patch, not a different one12:05
rlandypanda: ?12:05
rlandypls don't push osp containers to docker12:06
arxcruzsoniya29: plus, without a depends-on, i don't think it will work12:06
pandarlandy: maybe it's pulling an pushing from the same source12:06
pandarlandy: let me chec12:06
rlandypanda: can we skip that?12:06
rlandywaste of your time12:06
soniya29arxcruz, will be it okay if i add 'depends-on' on test patch12:06
rlandycriteria updated12:07
pandarlandy: not that particular part, either we skip completely the container_push, so also no current-tripleo tags will be there, or we do everything.12:07
arxcruzsoniya29: probably yes, but why? why not tests in the same patch?12:08
pandarlandy: when we'll have the container push in python we can be more selective ...12:08
arxcruzsoniya29: doing that means, we need to merge the first patch to then test it12:08
pandarlandy: I'll try to skip the container push for now.12:08
arxcruzit should test at the same time it will be merged12:08
rlandypanda: ok - np - as long as those containers don't go anywhere else12:09
soniya29arxcruz, so what should i do in such case?12:11
*** amoralej is now known as amoralej|lunch12:14
cgoncalvesweshay|ruck, rlandy: hey! can we revert https://review.opendev.org/#/c/732464/ ?12:15
rlandysshnaidm: seen this error before in OVB? 'Device tap4b218291-cb cannot be used as it has no MAC address'12:16
sshnaidmrlandy, not yet12:16
sshnaidmrlandy, link?12:16
rlandycgoncalves: not passing much - was there a recent fix that went through? ... https://zuul.openstack.org/builds?job_name=tripleo-ci-centos-8-scenario010-standalone12:17
*** pojadhav|brb is now known as pojadhav|ruck12:17
rlandysshnaidm: the last run on OSP: https://sf.hosted.upshift.rdu2.redhat.com/logs/36/200436/15/check/tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-internal/5b9b22e/logs/undercloud/var/log/extra/errors.txt.txt.gz12:18
cgoncalvesrlandy, per https://bugs.launchpad.net/tripleo/+bug/1881584/comments/5 patch https://review.rdoproject.org/r/#/c/28069/ (merged) should be the fix12:18
openstackLaunchpad bug 1881584 in tripleo "SC10 train periodic job failing on LoadBalancerScenarioTest consistently" [Critical,Triaged]12:18
soniya29arxcruz, shall i abandon the test patch?12:18
weshay|ruckcgoncalves, chandankumar https://review.opendev.org/#/c/735891/ rlandy12:18
arxcruzsoniya29: abandon the test patch and add it in the original one12:19
arxcruzpretty easy12:19
rlandycgoncalves: weshay|ruck: great - +2 on that revert12:19
cgoncalvesweshay|ruck, yo da man!12:19
soniya29arxcrux, okay12:19
rlandysshnaidm: we still land up with node that never get to manageable12:20
rlandywill try the run again today12:20
sshnaidmrlandy, I see them in manageable in logs12:20
rfolco|roverpojadhav|ruck, what's up with gate ?12:20
rfolco|roverpojadhav|ruck, do we have a bug ?12:20
sshnaidmrlandy, need to figure out how to wait for them to become manageable on slow environments12:20
pojadhav|ruckrfolco|rover, nope12:21
rlandysshnaidm: is that an overrideable parameter?12:21
sshnaidmrlandy, there is no such, need to introduce one12:21
rfolco|roverpojadhav|ruck, ah some of the failures are openvswitch related12:24
rfolco|rovermaybe this one https://bugs.launchpad.net/tripleo/+bug/188369912:24
openstackLaunchpad bug 1883699 in tripleo "sudo dnf update -y --exclude '*openvswitch*', fails on providers and dpdk w/ " [Critical,Triaged]12:24
pojadhav|ruckrfolco|rover, yeah.. me too saw that12:24
rlandysshnaidm: k - if you have a patch we can try it out12:25
pojadhav|ruckrfolco|rover, okay12:25
rfolco|roverpojadhav|ruck, not sure about the puppet config ones12:25
sshnaidmrlandy, will look into it12:25
rfolco|roverweshay|ruck, I see your bug on openvswitch, thanks for opening it. Do we have one for puppet issues ?12:25
rlandysshnaidm: thanks12:26
weshay|ruckpojadhav|ruck, and chandan are working the designate problem12:26
weshay|ruckhttps://review.opendev.org/#/c/735890/12:26
pojadhav|ruck2020-06-16 01:11:01 |   - cannot install both dpdk-19.11-4.el8.x86_64 and dpdk-18.11.2-3.el8.x86_6412:27
pojadhav|ruck2020-06-16 01:11:01 |   - cannot install the best update candidate for package dpdk-18.11.2-3.el8.x86_6412:27
pojadhav|ruck2020-06-16 01:11:01 |   - problem with installed package openvswitch-2.12.0-1.el8.x86_6412:27
pojadhav|ruck2020-06-16 01:11:01 | (try to add '--allowerasing' to command line to replace conflicting packages or '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages)12:27
mariosrfolco|rover: pojadhav|ruck: fyi https://review.opendev.org/735810 posted that earlier fixes failing train/rocky/stein image build/centos712:27
rfolco|roverI am referring to this one https://f9d06b48ff2b1ce24c3c-b3869638ca0e789681d1d8be6be680b6.ssl.cf2.rackcdn.com/735659/1/gate/tripleo-ci-centos-8-containers-multinode/2c2bea8/logs/undercloud/home/zuul/undercloud_install.log12:27
rfolco|roverweshay|ruck, ^12:27
weshay|ruckpojadhav|ruck, see my bug12:27
pojadhav|ruckweshay|ruck, okay12:27
mariosrfolco|rover: pojadhav|ruck: (see commit message for info, but is result of [1] https://review.opendev.org/734428 )12:28
mariosrfolco|rover: pojadhav|ruck: seems to fix the problem (I needed to post that because it was blocking me in https://review.opendev.org/#/c/730763/17 so i rebase that onto https://review.opendev.org/#/c/735810/ ... so it needs to merge first)12:28
mariosrfolco|rover: pojadhav|ruck: i did not file a bug for that up to you if we need it12:29
mariosrfolco|rover: pojadhav|ruck: should be done with https://review.opendev.org/#/c/735810/12:29
rfolco|rovermarios, where the issue was observed12:29
mariosrfolco|rover: seen in test https://review.opendev.org/#/c/733515/ and also in https://review.opendev.org/#/c/730763/ this morning12:30
mariosrfolco|rover: e.g. there https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_3c2/730763/16/check/tripleo-build-containers-centos-7-buildah-train/3c2c182/ from https://review.opendev.org/#/c/730763/ v16 (before i rebased)12:30
chandankumarplease donot recheck your patches for master till it lands https://review.opendev.org/73589012:31
*** derekh has quit IRC12:34
*** jpena|lunch is now known as jpena12:37
*** derekh has joined #oooq12:39
mariossshnaidm: trying that https://review.opendev.org/#/c/733818/18/roles/oooci-build-images/defaults/main.yaml see if it installs it12:46
*** ratailor has quit IRC12:47
mariossshnaidm: hmm might not work ... we don't source the venv it happens in the build image template...12:48
sshnaidmyou can use file://{{ openstack_git_root }} instead of git+http, btw12:49
pandarlandy: promoted images, promoted dlrn. Containers untouched. Can you confirm ?12:49
rlandypanda: checking12:50
mariossshnaidm: yeah i wanted to see if it will work first and i can clone with required-projects and install it from local but i think anyway adding it there won't help12:50
sshnaidmmarios, yeah, I don't think it will work so, but we can run ansible in shell task12:50
mariossshnaidm: comment at https://review.opendev.org/#/c/733818/18/roles/oooci-build-images/defaults/main.yaml12:50
rlandycurrent-tripleo/        2020-06-14 00:39   - images look good12:50
rlandypanda: dlrn is not correct12:51
*** ysandeep is now known as ysandeep|afk12:51
rlandyunless there is some lag on the mirror12:51
rlandylorean.repo2020-05-26 10:22 4.2K12:51
rlandydelorean12:52
pandarlandy: yeah, it failed ...12:52
pandarlandy: retrying12:52
rlandythanks12:52
sshnaidmmarios, actually we can try something else, in task of operator set ANSIBLE_LIBRARY to plugins directory of tripleo-operators12:53
sshnaidmmarios, with setting operators in zuul-roles, like it was in previous patch12:54
sshnaidmmarios, but idk if it works12:54
sshnaidmmarios, no, you can ignore it12:55
mariossshnaidm: let me poke a bit12:57
pandarlandy: could you check again ?12:57
rlandy01521ede31d5a2565ad4e9182a6b9e1512:57
rlandy^^ that's not right?12:58
panda%#&*@#(*!(*!!!12:58
pandano it's not ...12:58
pandarlandy: that's the previous12:59
pandarlandy: and should have been promoted to previous12:59
pandarlandy: where are you looking ?13:00
rlandypanda: posted in pvt13:02
rlandyinternal dlrn stuff13:02
pandarlandy: not seeing any message ...13:03
*** Goneri has joined #oooq13:03
rlandypanda: sorry - would help if I actually pasted the message13:03
pandarlandy: I see it's dated 16th - today13:04
rlandypanda: ack - but it's the wrong hash13:04
rlandyor you promoted the latest hash?13:04
pandarlandy: I see 56d0572b34a0767b082f85a4224ff3ed which is the one we agreed, maybe browser cache problem ?13:05
rlandypanda: ok - tried another window - I see it now13:06
panda\o/13:06
rlandythank you13:06
pandarlandy: going to approve you patch a put an additiona patch on top13:06
zbrweshay|ruck: i am not feeling very well, we will have to postpone my er presentation (bit of fever)13:07
rlandypanda: the criteria - merged already13:07
pandarlandy: ok, then I'll post my patch only13:07
rlandygreat -13:08
rlandypanda; I know tempest is broken - looking into that13:08
zbrpanda: marios: re promoter: i want to isolate promoter jobs from the jobs.yaml to make it easier to manage, see https://review.rdoproject.org/r/#/c/28109/13:08
zbrthis will allow to duplicate the file for centos-8 jobs. makes sense?13:09
zbrthe jobs.yaml was becoming very confusing due to having jobs with differnt purpose13:09
rlandypanda: do you have W+ rights there?13:11
rlandyif not, I'll merge that13:11
pandarlandy: I do13:11
pandarlandy: self merge ?13:11
rlandypanda: I +2'ed13:12
pandarlandy: ok13:12
rlandyand yes - downstream we live on eth edge13:12
*** amoralej|lunch is now known as amoralej13:12
rlandygo ahead and knock yourself out13:12
arxcruzmarios: is the yaml anchor works inside another anchor ?13:22
mariosarxcruz: not sure... should do... did you try it and it failed?13:23
arxcruzmarios:  no but i'll try13:27
*** ysandeep|afk is now known as ysandeep13:27
rfolco|rovercommunity mtg https://meet.google.com/bqx-xwht-wky?authuser=113:30
chandankumarweshay|ruck, https://softwarefactory-project.io/r/#/c/18585/13:31
weshay|ruckzbr, join the community call13:38
*** TrevorV has joined #oooq13:41
soniya29arxcruz, done!13:43
arxcruzsoniya29++13:43
rfolco|roverarxcruz, my cirros experiment here https://review.rdoproject.org/r/#/c/27878/, see the 2 depends-on13:53
*** Goneri has quit IRC14:00
*** sanjayu_ has joined #oooq14:10
*** dmellado_ has joined #oooq14:12
*** Goneri has joined #oooq14:14
*** zbr_ has joined #oooq14:15
*** saneax has quit IRC14:16
*** dmellado has quit IRC14:16
*** zbr has quit IRC14:16
*** dmellado_ is now known as dmellado14:16
*** zbr_ is now known as zbr14:16
*** dsneddon has quit IRC14:18
*** holser_ has quit IRC14:18
*** dsneddon has joined #oooq14:18
*** pojadhav|ruck is now known as pojadhav|brb14:21
*** holser has joined #oooq14:22
weshay|ruckarxcruz, chandankumar can I speak w/ you guys for 5 min?14:23
arxcruzweshay|ruck: yes14:23
weshay|ruckhttps://meet.google.com/tpw-zftp-iqs14:24
ysandeeprlandy, o/ hey I have send you an email on testing envA with https://review.opendev.org/#/c/729415 with some details14:24
rlandyysandeep: cool - reading through that14:25
weshay|ruckarxcruz, chandankumar https://meet.google.com/tpw-zftp-iqs14:26
rlandyysandeep: ok - so your patch doesn't include the firewalld pieces and mine doesn't create the connection ...14:28
rlandywe should work then on one combined patch14:28
rlandyysandeep: also we have two diff naming scheme so we need to choose one and both use it14:28
rlandyany one is fine by me14:28
ysandeeprlandy, one query - do we really need that libvirt zones ports to be open?14:29
rlandyysandeep: let's chat for a few and sort out what we need to close this out14:29
ysandeeprlandy, sure14:29
ysandeepjust 2 mins14:29
ysandeepbrb14:29
rlandyysandeep: https://meet.google.com/rmi-jtwb-jyb when you get back14:30
ysandeeprlandy, joined14:32
ysandeeprlandy, http://pastebin.test.redhat.com/87568014:34
*** skramaja has quit IRC14:50
chandankumarweshay|ruck, still in call?14:53
chandankumari was away14:54
*** pojadhav|brb is now known as pojadhav|ruck15:11
akahat]15:15
*** ykarel is now known as ykarel|away15:23
rlandymarios: hi15:40
rlandymarios: should upload come after dlrn reporting or before?15:40
rlandyif current job it uploads after dlrn reporting15:40
rlandyI would think that is the same in image build/upload15:41
mariosrlandy: o/ so currently its before reporting15:41
mariosrlandy: i mean for image upload etc15:41
mariosrlandy: but is there a problem making it so?15:41
mariosi mean you prefer to have it the other way around?15:41
rlandyugh - then I have this in the wrong order15:41
rlandymarsio: no - you are right15:42
rlandyhttps://sf.hosted.upshift.rdu2.redhat.com/logs/69/203269/4/check/periodic-tripleo-build-containers-ubi-8-internal-rhel-8-build-push-upload-rhos-17/511c839/job-output.txt15:42
rlandyreports success and then fails upload15:43
* rlandy changes15:43
rlandymarios: no - actually it does upload before15:43
rlandyand fails yet still reports success15:43
mariosrlandy:  14     post-run:$15:44
rlandy2020-06-15 18:24:04.432812 | primary | + ls '*.tar'15:44
rlandy2020-06-15 18:24:04.436709 | primary | ls: cannot access '*.tar': No such file or directory15:44
marios 15       - playbooks/tripleo-ci-periodic-base/upload-images.yaml$15:44
marios 16       - playbooks/dlrn/post-dlrn.yaml$15:44
mariosrlandy: in internal-config i had to sanity check :D15:44
rlandysorry - making us all crazy here15:44
mariosnp at all rlandy15:45
*** ysandeep is now known as ysandeep|brb15:51
weshay|ruckrfolco|rover, train promoted by itself :)15:59
*** jmasud has joined #oooq16:06
*** marios is now known as marios|out16:10
*** dtantsur is now known as dtantsur|afk16:14
*** marios|out has quit IRC16:16
rfolco|roverweshay|ruck, yes scen10 and fs020 started passing now16:18
* weshay|ruck looking at queens16:18
*** ysandeep|brb is now known as ysandeep16:23
ysandeeprlandy, fyi.. updated https://review.opendev.org/#/c/734654/16:25
rlandyysandeep: thanks - will look in a bit16:26
rlandyweshay|ruck: when you have a moment, pls see rhos-release discussion on internal16:27
*** jmasud has quit IRC16:28
*** ysandeep is now known as ysandeep|away16:30
*** jmasud has joined #oooq16:30
-openstackstatus- NOTICE: Zuul is being restarted for an urgent configuration change and may be offline for 15-30 minutes. Patches uploaded or approved during that time will need to be rechecked.16:37
*** derekh has quit IRC17:00
*** amoralej is now known as amoralej|off17:08
*** udesale_ has quit IRC17:18
*** jpena is now known as jpena|off17:34
*** holser has quit IRC17:46
*** holser has joined #oooq17:47
weshay|ruckrlandy, https://review.rdoproject.org/r/#/c/28045/17:56
rlandyweshay|ruck: great that train isready17:57
weshay|ruckrlandy, I have to run some promotions so we have something to start w/17:57
weshay|ruckoh.. need to talk to panda as well17:58
weshay|ruckre: the registry namespace17:58
rlandyweshay|ruck: some fun and games with rhos-release17:58
weshay|ruckI saw17:58
weshay|ruckreally should be one command...17:58
weshay|ruckbut meh17:58
rlandyweshay|ruck: I'm trying to work with it18:03
rlandyone of those stupid commands everwhere18:04
-openstackstatus- NOTICE: Zuul is back online; changes uploaded or approved between 16:40 and 18:00 will need to be rechecked.18:06
*** holser has quit IRC18:07
*** holser has joined #oooq18:07
weshay|ruckit's been a fun two days of infra18:09
*** tosky_ has joined #oooq18:26
*** tosky has quit IRC18:28
*** tosky_ is now known as tosky18:38
chandankumarrlandy, does rhos-release ceph mock issue sorted18:39
chandankumarrlandy, for mock we need to use rcm repo18:40
chandankumari spoke with alan today about that18:40
*** jmasud has quit IRC18:41
rlandychandankumar: I am trying out a few suggestions18:55
rlandyweshay|ruck: rfolco|rover: are you seeing any issues with shyaml?19:26
rlandywe're getting a timeout on the local mirros19:26
rlandymirror19:26
rlandyit's always something19:27
rlandyseriously??19:34
weshay|rucksec19:38
rfolco|roverrlandy, not aware, what kind of job you see this19:41
weshay|ruckrlandy, have a link?19:46
*** rfolco|rover is now known as rfolco|rover|brb19:56
*** jmasud has joined #oooq20:08
rlandyweshay|ruck: https://sf.hosted.upshift.rdu2.redhat.com/logs/40/189440/56/check/periodic-tripleo-ci-rhel-8-standalone-rhos-17/2e5cae0/job-output.txt20:10
rlandylatest is failing on dlrn-client20:10
rlandy + /usr/bin/pip3 install --user dlrnapi-client shyaml20:11
weshay|rucklooks like a network issue20:12
* weshay|ruck checks my rhel box20:12
weshay|ruckright? Connection to afs-mirror.sf.hosted.upshift.rdu2.redhat.com timed out. (connect timeout=60.0)')'20:14
weshay|ruckrlandy, perhaps we move shyaml to bindep20:15
rlandyweshay|ruck: the tenant config was updated - I'm rechecking20:16
rlandyweshay|ruck: rfolco|rover|brb: https://review.rdoproject.org/r/28114 Add option for osp_relase when writing out the hash20:16
*** jmasud has quit IRC20:18
rlandyweshay|ruck: now I think I understand what it's like to be you - running after infra issues every single day20:20
weshay|rucklolz20:20
weshay|ruckrlandy, again something to emphasize at prod-chain calls re:16.220:21
weshay|ruckinternal infra needs to up the game20:21
*** rfolco|rover|brb is now known as rfolco|rover20:25
*** jfrancoa has quit IRC20:44
*** TrevorV has quit IRC20:51
rlandyweshay|ruck: jjoyce gets three gold stars ... rhos_release_args: "ceph-4 -r 8.2" works now20:56
rlandywe are finally free of compose20:56
weshay|ruckwoot20:56
weshay|rucknice20:56
rlandyfree at last ... free at last ....20:56
*** jmasud has joined #oooq21:00
rlandychandankumar: ^^21:04
rlandywe got it now ...21:04
*** jmasud has quit IRC21:05
*** jmasud has joined #oooq21:16
*** rfolco|rover has quit IRC21:18
*** jmasud has quit IRC21:23
*** holser has quit IRC21:24
*** jmasud has joined #oooq21:35
chandankumarrlandy, awesome good to hear that21:52
rlandychandankumar: https://code.engineering.redhat.com/gerrit/#/c/200707/21:52
chandankumarrlandy, can we add some jobs against tripleo-env repo?21:53
rlandyyep21:53
chandankumarwill prepare patch tomorrow21:53
rlandychandankumar: running in testproject now21:53
rlandyhttps://code.engineering.redhat.com/gerrit/#/c/189440/21:53
chandankumarwill take a look soon21:53
*** ccamacho has quit IRC21:54
rlandychandankumar: I am not sure why osp-trunk-deps was deleted in the pervious patch21:54
rlandyI removed that21:54
rlandymerged https://review.rdoproject.org/r/#/c/28114/21:55
*** dtantsur|afk has quit IRC22:04
*** irclogbot_0 has quit IRC22:07
*** irclogbot_3 has joined #oooq22:12
*** rlandy is now known as rlandy|bbl22:16
*** holser has joined #oooq22:31
*** cgoncalves has quit IRC22:33
*** bhagyashris has quit IRC22:33
*** baha has quit IRC22:33
*** ysandeep|away has quit IRC22:33
*** tristanC has quit IRC22:33
*** amoralej|off has quit IRC22:33
*** irclogbot_3 has quit IRC22:33
*** gchamoul has quit IRC22:33
*** johnsom has quit IRC22:33
*** owalsh has quit IRC22:33
*** dpawlik6 has quit IRC22:33
*** akahat has quit IRC22:33
*** chem has quit IRC22:33
*** jbadiapa has quit IRC22:33
*** holser has quit IRC22:33
*** Goneri has quit IRC22:33
*** dmellado has quit IRC22:33
*** Tengu has quit IRC22:33
*** matbu has quit IRC22:33
*** jschlueter has quit IRC22:33
*** jmasud has quit IRC22:33
*** sanjayu_ has quit IRC22:33
*** yolanda has quit IRC22:33
*** fuzzball81 has quit IRC22:33
*** panda has quit IRC22:33
*** arxcruz has quit IRC22:33
*** kopecmartin has quit IRC22:33
*** rlandy|bbl has quit IRC22:33
*** beagles has quit IRC22:33
*** jrist has quit IRC22:33
*** ChanServ has quit IRC22:33
*** odyssey4me has quit IRC22:33
*** sshnaidm has quit IRC22:33
*** radez has quit IRC22:33
*** soniya29 has quit IRC22:33
*** dsneddon has quit IRC22:33
*** zbr has quit IRC22:33
*** ykarel|away has quit IRC22:33
*** tosky has quit IRC22:33
*** whoami-rajat has quit IRC22:33
*** weshay|ruck has quit IRC22:33
*** apetrich has quit IRC22:33
*** jtomasek has quit IRC22:33
*** pojadhav|ruck has quit IRC22:33
*** jpena|off has quit IRC22:33
*** ykarel|away has joined #oooq22:37
*** zbr has joined #oooq22:37
*** dsneddon has joined #oooq22:37
*** tristanC has joined #oooq22:37
*** ysandeep|away has joined #oooq22:37
*** kopecmartin has joined #oooq22:37
*** arxcruz has joined #oooq22:37
*** panda has joined #oooq22:37
*** fuzzball81 has joined #oooq22:37
*** yolanda has joined #oooq22:37
*** sanjayu_ has joined #oooq22:37
*** jmasud has joined #oooq22:37
*** matbu has joined #oooq22:37
*** Tengu has joined #oooq22:37
*** dmellado has joined #oooq22:37
*** Goneri has joined #oooq22:37
*** holser has joined #oooq22:37
*** johnsom has joined #oooq22:37
*** gchamoul has joined #oooq22:37
*** irclogbot_3 has joined #oooq22:37
*** jschlueter has joined #oooq22:37
*** dpawlik6 has joined #oooq22:37
*** owalsh has joined #oooq22:37
*** jpena|off has joined #oooq22:37
*** pojadhav|ruck has joined #oooq22:37
*** jtomasek has joined #oooq22:37
*** apetrich has joined #oooq22:37
*** amoralej|off has joined #oooq22:37
*** ChanServ has joined #oooq22:37
*** cgoncalves has joined #oooq22:37
*** bhagyashris has joined #oooq22:37
*** baha has joined #oooq22:37
*** tepper.freenode.net sets mode: +o ChanServ22:37
*** sshnaidm has joined #oooq22:38
*** radez has joined #oooq22:38
*** soniya29 has joined #oooq22:38
*** chem has joined #oooq22:38
*** jbadiapa has joined #oooq22:38
*** odyssey4me has joined #oooq22:38
*** rlandy|bbl has joined #oooq22:38
*** beagles has joined #oooq22:38
*** jrist has joined #oooq22:38
*** akahat has joined #oooq22:39
*** holser has quit IRC22:39
*** tosky has joined #oooq22:40
*** whoami-rajat has joined #oooq22:42
*** weshay|ruck has joined #oooq22:42
*** holser has joined #oooq22:44
*** jmasud has quit IRC22:59
*** chem has quit IRC23:07
*** chem has joined #oooq23:09
*** Goneri has quit IRC23:24
*** rlandy|bbl is now known as rlandy23:35
*** tosky has quit IRC23:50

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!