| *** saneax has quit IRC | 00:12 | |
| *** brault has joined #oooq | 00:15 | |
| *** apetrich has quit IRC | 02:09 | |
| *** brault has quit IRC | 02:29 | |
| *** brault has joined #oooq | 02:30 | |
| *** aakarsh has quit IRC | 03:44 | |
| *** udesale has joined #oooq | 04:00 | |
| *** ykarel has joined #oooq | 04:13 | |
| *** dsneddon has quit IRC | 04:16 | |
| *** dsneddon has joined #oooq | 04:45 | |
| *** brault has quit IRC | 04:47 | |
| *** brault has joined #oooq | 04:48 | |
| *** skramaja has joined #oooq | 05:02 | |
| *** dsneddon has quit IRC | 05:17 | |
| *** marios|rover has joined #oooq | 05:25 | |
| *** brault has quit IRC | 05:32 | |
| *** brault has joined #oooq | 05:32 | |
| *** dsneddon has joined #oooq | 05:48 | |
| *** jtomasek has quit IRC | 05:50 | |
| *** saneax has joined #oooq | 05:50 | |
| *** dsneddon has quit IRC | 05:52 | |
| *** jaosorior has joined #oooq | 06:04 | |
| *** ratailor has joined #oooq | 06:08 | |
| *** jfrancoa has joined #oooq | 06:19 | |
| *** surpatil has joined #oooq | 06:21 | |
| *** dsneddon has joined #oooq | 06:27 | |
| *** holser has joined #oooq | 06:28 | |
| *** dsneddon has quit IRC | 06:31 | |
| *** akahat has joined #oooq | 06:44 | |
| *** holser has quit IRC | 06:52 | |
| *** holser has joined #oooq | 06:53 | |
| *** jaosorior has quit IRC | 06:57 | |
| *** tesseract has joined #oooq | 06:59 | |
| *** kopecmartin|off is now known as kopecmartin | 07:02 | |
| *** ykarel is now known as ykarel|lunch | 07:04 | |
| *** dsneddon has joined #oooq | 07:07 | |
| *** ccamacho has joined #oooq | 07:08 | |
| *** ccamacho has quit IRC | 07:09 | |
| *** ccamacho has joined #oooq | 07:09 | |
| *** dsneddon has quit IRC | 07:12 | |
| *** tosky has joined #oooq | 07:12 | |
| *** jpena|off is now known as jpena | 07:13 | |
| *** dsneddon has joined #oooq | 07:16 | |
| *** dsneddon has quit IRC | 07:21 | |
| *** zbr has joined #oooq | 07:33 | |
| zbr | hello! | 07:38 |
|---|---|---|
| *** apetrich has joined #oooq | 07:43 | |
| *** zbr has quit IRC | 07:44 | |
| *** dsneddon has joined #oooq | 07:54 | |
| *** zbr has joined #oooq | 08:02 | |
| *** recheck has joined #oooq | 08:04 | |
| *** arxcruz|rover is now known as arxcruz | 08:11 | |
| arxcruz | zbr: it's a beautifull day when you are not RR :D | 08:12 |
| zbr | yeah! just got back last night, this morning i found out that my main servers was offline, unknown reason. | 08:12 |
| arxcruz | zbr: didn't pay the bill ? :P | 08:13 |
| arxcruz | btw, i'm off today, visa renew | 08:13 |
| arxcruz | but Angela Merkel will not send a message for me :P | 08:13 |
| *** holser__ has joined #oooq | 08:17 | |
| zbr | probably she is busy showing the finger to boris | 08:17 |
| zbr | it seems that panda|off ... :( | 08:18 |
| *** holser has quit IRC | 08:18 | |
| *** derekh has joined #oooq | 08:31 | |
| *** jtomasek has joined #oooq | 08:32 | |
| *** dsneddon has quit IRC | 08:43 | |
| *** akahat has quit IRC | 08:44 | |
| *** bhagyashris has joined #oooq | 08:47 | |
| *** akahat has joined #oooq | 08:50 | |
| *** dtantsur|afk is now known as dtantsur | 09:01 | |
| *** dsneddon has joined #oooq | 09:17 | |
| *** holser has joined #oooq | 09:18 | |
| *** holser__ has quit IRC | 09:19 | |
| Tengu | hello there! quick headups for a feature request: https://bugs.launchpad.net/tripleo/+bug/1847579 :) | 09:21 |
| openstack | Launchpad bug 1847579 in tripleo "[CI] implement statsd "ping" within CI runs" [Medium,Triaged] | 09:21 |
| *** bhagyashris has quit IRC | 09:22 | |
| *** soniya29 has joined #oooq | 09:25 | |
| *** ykarel|lunch is now known as ykarel | 09:26 | |
| *** chem_ is now known as chem|tmux | 09:27 | |
| chandankumar | Tengu: we collectd dstat in standalone and multinode deployment | 09:28 |
| Tengu | chandankumar: that one? https://linux.die.net/man/1/dstat | 09:29 |
| Tengu | if so, it's not really the same thing | 09:29 |
| chandankumar | Tengu: yes | 09:30 |
| chandankumar | you are correct. we will look into that | 09:30 |
| Tengu | lemme know if you want some more info :) | 09:31 |
| Tengu | should have added the link to statsd project -.-'. Lemme add that. | 09:31 |
| Tengu | link added :). | 09:32 |
| *** udesale has quit IRC | 09:52 | |
| *** udesale has joined #oooq | 09:53 | |
| *** ykarel is now known as ykarel|afk | 09:54 | |
| *** udesale has quit IRC | 10:00 | |
| *** udesale has joined #oooq | 10:01 | |
| *** dsneddon has quit IRC | 10:01 | |
| *** ratailor_ has joined #oooq | 10:01 | |
| *** ratailor has quit IRC | 10:04 | |
| marios|rover | chandankumar: arxcruz aware of somethign changing like 2 days ago to break tempest there https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-standalone-full-tempest-master | 10:26 |
| marios|rover | https://bugs.launchpad.net/tripleo/+bug/1847585 | 10:26 |
| openstack | Launchpad bug 1847585 in tripleo "periodic-tripleo-ci-centos-7-standalone-full-tempest-master timeout on tempest tests "Failed to establish authenticated ssh connection to cirros@192.168.24.107"" [Critical,New] | 10:26 |
| chandankumar | marios|rover: checking | 10:32 |
| chandankumar | marios|rover: currently full tempest was timing out | 10:32 |
| *** skramaja_ has joined #oooq | 10:33 | |
| *** skramaja has quit IRC | 10:33 | |
| *** dsneddon has joined #oooq | 10:36 | |
| chandankumar | marios|rover: last night wes increased the job time https://review.rdoproject.org/r/23042 | 10:36 |
| marios|rover | chandankumar: not sure if its about that there are ssh errors in the logs | 10:36 |
| *** ratailor_ has quit IRC | 10:57 | |
| *** ratailor_ has joined #oooq | 10:58 | |
| *** skramaja_ has quit IRC | 10:58 | |
| * marios|rover biab | 11:00 | |
| *** marios|rover has quit IRC | 11:00 | |
| *** ratailor_ has quit IRC | 11:03 | |
| *** jpena is now known as jpena|lunch | 11:04 | |
| *** udesale has quit IRC | 11:09 | |
| *** dsneddon has quit IRC | 11:20 | |
| *** sanjayu_ has joined #oooq | 11:31 | |
| *** ykarel|afk is now known as ykarel | 11:32 | |
| *** sanjayu__ has joined #oooq | 11:33 | |
| *** saneax has quit IRC | 11:34 | |
| *** sanjayu_ has quit IRC | 11:36 | |
| *** dsneddon has joined #oooq | 11:45 | |
| *** weshay|ruck is now known as weshay | 11:48 | |
| *** jpena|lunch is now known as jpena | 11:58 | |
| *** chem|tmux is now known as chem|lunch | 12:00 | |
| *** marios has joined #oooq | 12:02 | |
| *** marios is now known as marios|rover | 12:02 | |
| *** rfolco has joined #oooq | 12:05 | |
| chandankumar | marios|rover: it seems to be different issue, the reason ssh timedout seen in the bug description, it tries to retry multiple times and ssh successful happend | 12:05 |
| chandankumar | *happens if there is a failure in ssh then it will throw traceback | 12:06 |
| marios|rover | chandankumar: k i see some failed ping too like 2019-10-09 15:51:42.219 81452 ERROR tempest.lib.common.utils.linux.remote_client [-] (TestNetworkBasicOps:test_connectivity_between_vms_on_different_networks) Executing command on 192.168.24.112 failed. Error: Command 'set -eu -o pipefail; PATH=$PATH:/sbin:/usr/sbin; ping -c1 -w1 -s56 10.100.0.19' failed, exit status: 1, stderr: | 12:06 |
| *** rfolco is now known as rfolco|ruck | 12:07 | |
| weshay | rfolco|ruck, fyi pushed an update https://review.opendev.org/#/c/687665/ | 12:08 |
| rfolco|ruck | weshay, cool, thx | 12:09 |
| weshay | zbr, welcome back.. can you please check if centos-8 has qcows or if anything can be done there please | 12:10 |
| weshay | chandankumar, so.. you succussfully recreated | 12:10 |
| weshay | chandankumar, I was attempting to start an instance on the overcloud but ran out of time yesterday, holiday for me | 12:11 |
| weshay | something was up w/ the keystone server maybe.. w/ keys | 12:11 |
| weshay | chandankumar, was on the tmux | 12:11 |
| weshay | not sure.. could have just been me, was rushing | 12:11 |
| weshay | marios|rover, rfolco|ruck want to sync? | 12:12 |
| chandankumar | weshay: I have not digged into that | 12:12 |
| chandankumar | weshay: does any one from security dfg looking into that? | 12:12 |
| weshay | chandankumar, not into the latest failure.. but yes.. there is a cix card on that job | 12:13 |
| chandankumar | weshay: need to reproduce full tempest timeout | 12:13 |
| marios|rover | weshay: sure | 12:13 |
| rfolco|ruck | weshay, yes | 12:14 |
| rfolco|ruck | give me 5 min, will get a coffee | 12:14 |
| weshay | chandankumar, I bumped the timeout, to 4hrs.. are they still timing out? | 12:14 |
| chandankumar | weshay: yes | 12:15 |
| marios|rover | weshay: i filed a new one promotion blocker on that full tempest job | 12:15 |
| *** rlandy has joined #oooq | 12:15 | |
| weshay | marios|rover, k | 12:15 |
| marios|rover | weshay: https://bugs.launchpad.net/tripleo/+bug/1847585 | 12:15 |
| openstack | Launchpad bug 1847585 in tripleo "periodic-tripleo-ci-centos-7-standalone-full-tempest-master timeout on tempest tests "Failed to establish authenticated ssh connection to cirros@192.168.24.107"" [Critical,New] | 12:15 |
| chandankumar | weshay: https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-standalone-full-tempest-master | 12:15 |
| weshay | chandankumar, probably just a bunch of failing tests | 12:18 |
| weshay | marios|rover, should be easy to recreate | 12:18 |
| rfolco|ruck | weshay, marios|rover ready to sync | 12:18 |
| weshay | k | 12:18 |
| weshay | rfolco|ruck, marios|rover https://meet.google.com/nqb-vfii-xuf | 12:19 |
| chandankumar | arxcruz: around? | 12:19 |
| rlandy | marios|rover: rfolco|ruck: hmmm ... I guess neither of you guys are carrying on with promoter :( | 12:21 |
| rfolco|ruck | rlandy, weshay said we'll decide this on planning mtg | 12:21 |
| * rlandy has a bad feeling it's coming my way | 12:22 | |
| *** chem|lunch is now known as chem | 12:22 | |
| zbr | weshay: hi! yep, looking into the imgs... | 12:22 |
| *** Goneri has joined #oooq | 12:24 | |
| *** derekh has quit IRC | 12:24 | |
| marios|rover | rlandy: in sync call with weshay right now | 12:32 |
| marios|rover | rlandy: but i'm not on that no :/ | 12:32 |
| *** sanjayu_ has joined #oooq | 12:32 | |
| *** jaosorior has joined #oooq | 12:34 | |
| *** sanjayu__ has quit IRC | 12:35 | |
| weshay | marios|rover, rfolco|ruck https://review.rdoproject.org/r/#/c/22878/3/.zuul.yaml | 12:36 |
| weshay | marios|rover, rfolco|ruck https://code.engineering.redhat.com/gerrit/#/c/182922/ | 12:38 |
| marios|rover | panda|off: weshay rlandy merge etherpad update please https://review.rdoproject.org/r/23050 | 12:39 |
| rlandy | marios|rover: looking into tox failure | 12:40 |
| rlandy | http://logs.rdoproject.org/50/23050/1/check/rdo-tox-molecule/a6de77f/tox/reports.html | 12:40 |
| rlandy | ha - promoter | 12:41 |
| rlandy | marios|rover: I'm going to recheck on that to see if it's consistent | 12:42 |
| marios|rover | rlandy: ack sorry hadn't noticed... shouldn't be related to the change sure recheck | 12:42 |
| weshay | marios|rover, rfolco|ruck https://github.com/sshnaidm/jcomparison | 12:45 |
| *** dsneddon has quit IRC | 12:50 | |
| rlandy | marios|rover - failure is consistent - let me see if I can fix - I know you're busy | 12:52 |
| *** skramaja has joined #oooq | 12:52 | |
| *** udesale has joined #oooq | 12:55 | |
| *** dtantsur is now known as dtantsur|afk | 12:57 | |
| marios|rover | weshay: https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/rrcockpit/README.md | 12:58 |
| rfolco|ruck | planning mtg starts now | 13:00 |
| rfolco|ruck | https://etherpad.openstack.org/p/tripleo-ci-squad-meeting | 13:00 |
| rfolco|ruck | https://meet.google.com/tbr-rgjz-cjc | 13:00 |
| rfolco|ruck | ping marios, sshnaidm, weshay, panda, rlandy, arxcruz, rfolco, chandankumar, zbr, kopecmartin | 13:01 |
| chandankumar | rfolco|ruck: joining | 13:08 |
| weshay | chandankumar, so you just add "registry_login_enabled: false" to your gerrit change on the new reproducer and it works? | 13:11 |
| *** dsneddon has joined #oooq | 13:11 | |
| *** soniya29 has quit IRC | 13:12 | |
| rfolco|ruck | chandankumar, https://hackmd.io/IhMCTNMBSF6xtqiEd9Z0Kw?both | 13:16 |
| *** dsneddon has quit IRC | 13:16 | |
| *** aakarsh has joined #oooq | 13:27 | |
| *** skramaja has quit IRC | 13:30 | |
| *** dsneddon has joined #oooq | 13:52 | |
| *** tosky has quit IRC | 13:55 | |
| *** ccamacho has quit IRC | 13:56 | |
| *** ccamacho has joined #oooq | 13:56 | |
| *** surpatil has quit IRC | 14:00 | |
| *** akahat has quit IRC | 14:02 | |
| marios|rover | rfolco|ruck: fyi https://review.rdoproject.org/r/23066 testproject for periodic-tripleo-rhel-8-master-containers-build-push | 14:05 |
| marios|rover | rfolco|ruck: i added push_containers: false for now though | 14:05 |
| marios|rover | rfolco|ruck: so we can see if it works/logs etc | 14:05 |
| rfolco|ruck | marios|rover, push_containers_podman needs to be true to retag rhel8 containers | 14:06 |
| marios|rover | rfolco|ruck: ack thx adding | 14:07 |
| rfolco|ruck | marios|rover, don't know if you can test without pushing.... if you turn it off, retag won't run.... | 14:08 |
| marios|rover | rfolco|ruck: but wil that actually push? | 14:08 |
| marios|rover | rfolco|ruck: right so if we do it will push. | 14:08 |
| rfolco|ruck | marios|rover, need to look at the logic in the role... how push_containers and push_containers_podman control the push switch | 14:09 |
| marios|rover | rfolco|ruck: so is there value in seeing it run as is (yeah ack i see it) to make sure the job works as expected | 14:10 |
| marios|rover | rfolco|ruck: then post v2 with the podman true | 14:10 |
| rfolco|ruck | marios|rover, ok I suspect kolla push in config will control it, which is containers_push var, not sure if podman var affects it somwhoe | 14:10 |
| rfolco|ruck | domesow | 14:10 |
| rfolco|ruck | somehow | 14:11 |
| rfolco|ruck | :) | 14:11 |
| *** aakarsh has quit IRC | 14:18 | |
| *** amoralej|off is now known as amoralej | 14:23 | |
| *** jpena is now known as jpena|off | 14:39 | |
| panda|off | I got disconnected | 14:40 |
| *** chandankumar is now known as raukadah | 14:43 | |
| raukadah | Happy weekend :-) | 14:43 |
| panda|off | getting disconnections again. | 14:44 |
| *** aakarsh has joined #oooq | 14:51 | |
| marios|rover | weshay: testproject for periodic rhel8 container-build-push https://review.rdoproject.org/r/23066 | 14:58 |
| marios|rover | rfolco|ruck: 15 mins and we sync ? me running out of day | 14:59 |
| rfolco|ruck | marios|rover, need 20-30 | 15:00 |
| marios|rover | rfolco|ruck: ack, sending invite for 30 mins from now | 15:00 |
| rfolco|ruck | marios|rover, ok if we sync tomorrow morning, I can watch testproject today if you prefer | 15:00 |
| rfolco|ruck | marios|rover, ok | 15:00 |
| marios|rover | rfolco|ruck: lets do quick call anyway | 15:01 |
| marios|rover | rfolco|ruck: i miss you already | 15:01 |
| marios|rover | rfolco|ruck: oh | 15:02 |
| marios|rover | rfolco|ruck: you mean you prefer not to talk today? | 15:02 |
| marios|rover | rfolco|ruck: sure... but the promoter.. will you continue that ? | 15:02 |
| weshay | marios|rover, k.. the hash was not specified.. but it does look like this run of rhel8 in the periodic-master pipeline will pass | 15:02 |
| marios|rover | weshay: ack added comment syncing with rfolco|ruck about that as my day ends at some point in the next hour | 15:04 |
| weshay | marios|rover, qq re: 2019-10-08 20:19:40 | TASK [Debug output for task: Run puppet host configuration for step 1] ********* | 15:04 |
| weshay | in http://logs.rdoproject.org/19/687419/4/openstack-check/tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001/b7138c0/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 15:04 |
| *** Vorrtex has joined #oooq | 15:04 | |
| weshay | I see 2019-10-08 20:19:40 | "<13>Oct 9 00:19:19 puppet-user: error: Could not connect to cluster (is it running?)", | 15:04 |
| weshay | and other warnings.. | 15:04 |
| weshay | hard to tell for me if that is significant to this bug | 15:05 |
| weshay | rlandy, fyi.. your wget issue in bm should be fixed https://bugs.launchpad.net/bugs/1847344 | 15:07 |
| openstack | Launchpad bug 1847344 in tripleo "replace wget w/ curl in tripleo-quickstart codebase" [Critical,Fix released] - Assigned to Arx Cruz (arxcruz) | 15:07 |
| rlandy | weshay: ack - thank you for picking that up | 15:08 |
| *** ykarel is now known as ykarel|afk | 15:11 | |
| weshay | marios|rover, rfolco|ruck fyi https://review.opendev.org/#/c/687932/1/config/environments/ci_centos_libvirt.yml stein times out in ci.centos | 15:13 |
| rlandy | https://review.rdoproject.org/zuul/builds?job_name=rdo-tox-molecule been failing for a while | 15:24 |
| rfolco|ruck | marios|rover, joining | 15:29 |
| *** zbr has quit IRC | 15:29 | |
| marios|rover | rfolco|ruck: coming | 15:30 |
| rfolco|ruck | ack marios|rover | 15:31 |
| *** zbr has joined #oooq | 15:31 | |
| *** holser has quit IRC | 15:35 | |
| *** sanjayu_ has quit IRC | 15:37 | |
| *** jtomasek has quit IRC | 15:41 | |
| *** ykarel|afk is now known as ykarel | 15:41 | |
| marios|rover | rfolco|ruck: https://review.rdoproject.org/r/#/c/23066/ | 15:45 |
| *** Goneri has quit IRC | 15:51 | |
| rlandy | zbr: any thoughts on https://review.rdoproject.org/r/#/c/23050/ - rdo-tox molecule failures | 15:54 |
| rlandy | fails to install different pieces | 15:55 |
| *** jaosorior has quit IRC | 15:55 | |
| rlandy | ruck/rovers need this review in | 15:55 |
| rlandy | failure is not consistent | 15:55 |
| rlandy | https://review.rdoproject.org/zuul/builds?job_name=rdo-tox-molecule | 15:55 |
| rlandy | zbr: ^^ | 15:55 |
| zbr | rlandy: based on logs docker failed to install, see http://logs.rdoproject.org/50/23050/1/check/rdo-tox-molecule/9f1bd8e/job-output.txt | 15:55 |
| rlandy | marios|rover: ^^ fyi | 15:55 |
| rlandy | zbr: yes - I read the log | 15:56 |
| rlandy | zbr: my question is on the non-consistent nature | 15:56 |
| rlandy | it's running on f28 | 15:56 |
| rlandy | is that a permanent choice? | 15:56 |
| rlandy | it got passed the docker install on previous runs | 15:57 |
| zbr | nothing is permanent, but for the moment it should stay like this (f28). | 15:57 |
| marios|rover | rlandy: ack /me almost out will check tomorrow | 15:57 |
| zbr | but inconsistent on this is not something acceptable, we need to see why | 15:57 |
| rlandy | zbr: ack - the previous runs failed on starting the httpd service | 15:59 |
| rlandy | so for the same change, we have inconsistent failures | 15:59 |
| zbr | apparently we had only 3 occurences: https://review.rdoproject.org/analytics/app/kibana#/discover?_a=(columns:!(_source),index:AWsldLLQ-cMPWrFD-N_t,interval:auto,query:(query_string:(analyze_wildcard:!t,query:'message:%22No%20package%20docker-ce%20available%22')),sort:!('@timestamp',desc))&_g=(refreshInterval:(display:Off,pause:!f,value:0),time:(from:now-7d,mode:quick,to:now)) | 15:59 |
| * weshay getting | 16:01 | |
| weshay | TASK [promoter : Start and enable Apache] ************************************** | 16:01 |
| weshay | fatal: [centos7]: FAILED! => changed=false | 16:01 |
| weshay | cmd: /usr/bin/systemctl | 16:01 |
| weshay | msg: 'Failed to list units: Connection timed out' | 16:01 |
| weshay | rc: 1 | 16:01 |
| zbr | all failures only on this change so far | 16:01 |
| weshay | stderr: |- | 16:01 |
| weshay | Failed to list units: Connection timed out | 16:01 |
| weshay | stderr_lines: <omitted> | 16:01 |
| weshay | stdout: '' | 16:01 |
| weshay | stdout_lines: <omitted> | 16:01 |
| weshay | 16:01 | |
| rlandy | yep plus docker install failures | 16:01 |
| rlandy | all which have nothing to do with the change made | 16:01 |
| rlandy | the retry limit show hides that it hit that install problem multiple times | 16:03 |
| zbr | is it normal not to see anything collected? | 16:03 |
| *** marios|rover has quit IRC | 16:03 | |
| rlandy | nothing changed in the repo since | 16:03 |
| zbr | i suspect networking issue, but also that zuul gives us does not help much in investigating, better to ask on #rdo i think | 16:03 |
| weshay | can that test be moved to nv? | 16:05 |
| weshay | rlandy, easy review https://review.opendev.org/#/c/687932/ | 16:06 |
| zbr | rlandy: unless something recent was modified on install docker role itself, which is upstream. | 16:06 |
| rlandy | weshay: if we can't get a pass today, let's move it to non-voting and I'll add it o my list of jobs to make voting again for promoter | 16:07 |
| rlandy | zbr: I didn;t see anything | 16:07 |
| weshay | k | 16:07 |
| rlandy | but will keep looking | 16:07 |
| rlandy | I wonder if port 80 is not overused | 16:08 |
| rlandy | in the first failure case | 16:08 |
| rlandy | we had that for 8000 and the dlrn api | 16:08 |
| * rlandy rechecks again | 16:09 | |
| zbr | rlandy: is clearly recent based on https://review.rdoproject.org/zuul/builds?job_name=rdo-tox-molecule | 16:10 |
| rlandy | zbr: ack | 16:11 |
| rlandy | the other failure further down are legit | 16:12 |
| rlandy | I checked those | 16:12 |
| *** udesale has quit IRC | 16:19 | |
| *** jpena|off is now known as jpena | 16:19 | |
| *** Goneri has joined #oooq | 16:22 | |
| recheck | [gh-pytest-molecule] 1.2.1rc1 → https://github.com/pycontribs/pytest-molecule/releases/tag/1.2.1rc1 | 16:27 |
| *** kopecmartin is now known as kopecmartin|off | 16:31 | |
| rlandy | nice try - no dice | 16:32 |
| weshay | rfolco|ruck, curious.. why container_registry_docker_disable_iptables: true | 16:33 |
| rfolco|ruck | weshay, where? I do not recall this bit | 16:34 |
| *** Goneri has quit IRC | 16:34 | |
| weshay | rfolco|ruck, testproject review | 16:37 |
| * weshay updated | 16:37 | |
| weshay | rfolco|ruck, did marios have any comments on the rhel8 ovb issue? | 16:37 |
| *** ccamacho has quit IRC | 16:39 | |
| rfolco|ruck | weshay, I think he did not have time to dig into the issue | 16:43 |
| rfolco|ruck | weshay, how do I specify hash in the testproject patch ? | 16:43 |
| rfolco|ruck | weshay, I'll change it in a bit as soon as I find what is the hash var | 16:50 |
| *** chem is now known as chem|eod | 16:52 | |
| weshay | rfolco|ruck, I think rhel8 passed on what is now tripleo-ci-testing so it doesn't matter | 16:52 |
| rfolco|ruck | weshay, but need to set push_containers_podman var anyway | 16:53 |
| weshay | I did | 16:54 |
| weshay | oh.. wait.. | 16:54 |
| weshay | why? | 16:54 |
| weshay | should be set by that job | 16:54 |
| weshay | it should just run as it does in periodic | 16:54 |
| rfolco|ruck | weshay, thats the problem, the job does not set it | 16:59 |
| rfolco|ruck | the base job does not https://github.com/rdo-infra/review.rdoproject.org-config/blob/d073c807501b73ccff3d26a90b435e68dc218297/zuul.d/tripleoci.yaml#L123 | 17:00 |
| rfolco|ruck | weshay, ah nm | 17:00 |
| rfolco|ruck | forget about it | 17:00 |
| rfolco|ruck | https://github.com/rdo-infra/review.rdoproject.org-config/blob/d073c807501b73ccff3d26a90b435e68dc218297/zuul.d/tripleoci.yaml#L204 | 17:00 |
| rfolco|ruck | ok ok | 17:00 |
| rfolco|ruck | lets watch for results then | 17:01 |
| rfolco|ruck | weshay, question: why don't we try centos promotion meanwhile ? | 17:01 |
| weshay | rfolco|ruck, is there one avail? | 17:01 |
| *** bogdando has quit IRC | 17:01 | |
| weshay | would make it easier to see if we merged https://review.rdoproject.org/r/#/c/22892/ | 17:01 |
| *** jfrancoa has quit IRC | 17:02 | |
| rfolco|ruck | weshay, I do not follow... we are running manually the dlrnapi call in the new promoter for rhel8.... why it needs to be rhel8? | 17:03 |
| *** epoojad1 has joined #oooq | 17:04 | |
| weshay | rfolco|ruck, ya.. but the criteria for a prmotion needs to be avail | 17:05 |
| weshay | and passed | 17:05 |
| weshay | rfolco|ruck, there may be another branch avail for a promotion | 17:06 |
| weshay | rfolco|ruck, want to check queens centos7? | 17:06 |
| weshay | rfolco|ruck, join me on the new-promoter | 17:06 |
| rfolco|ruck | ok | 17:06 |
| weshay | rfolco|ruck, it's in the infra doc | 17:07 |
| rfolco|ruck | oops | 17:07 |
| rfolco|ruck | ok | 17:07 |
| *** jfrancoa has joined #oooq | 17:08 | |
| *** rlandy is now known as rlandy|brb | 17:08 | |
| rfolco|ruck | weshay, production one is there, not the new one | 17:09 |
| rfolco|ruck | in infra-docs I mean | 17:09 |
| weshay | yes it is | 17:09 |
| weshay | rfolco|ruck, see: PANDA | 17:10 |
| rfolco|ruck | ok very intuitive | 17:10 |
| weshay | rfolco|ruck, you were on the call | 17:11 |
| *** ykarel is now known as ykarel|away | 17:11 | |
| rfolco|ruck | weshay, physically maybe | 17:12 |
| rfolco|ruck | :/ | 17:12 |
| rfolco|ruck | I see green jobs for master, whats missing weshay ? | 17:15 |
| rfolco|ruck | in periodic pipeline I mean | 17:15 |
| weshay | rfolco|ruck, I'm not going to put upstream CentOS master at risk | 17:15 |
| rfolco|ruck | I see | 17:16 |
| weshay | rfolco|ruck, hold until I get back | 17:16 |
| * rfolco|ruck holds breath | 17:16 | |
| *** Goneri has joined #oooq | 17:27 | |
| *** epoojad1 has quit IRC | 17:27 | |
| zbr | rlandy|brb: sortly rdo-tox-molecule is back green, after having ~2h downtime due to download.docker.com being improperly configured (403). | 17:32 |
| zbr | sometimes is just a matter of doing a "recheck" later :D | 17:33 |
| *** ykarel|away has quit IRC | 17:35 | |
| *** Goneri has quit IRC | 17:41 | |
| *** rlandy|brb is now known as rlandy | 17:45 | |
| rlandy | zbr: awesome - thanks | 17:45 |
| rlandy | perfect - now can make other jobs voting :) | 17:46 |
| *** jpena is now known as jpena|off | 17:57 | |
| *** ccamacho has joined #oooq | 18:02 | |
| *** amoralej is now known as amoralej|off | 18:08 | |
| rfolco|ruck | rlandy, I cannot reproduce error on tox-molecule job | 18:14 |
| rfolco|ruck | :( | 18:14 |
| rlandy | rfolco|ruck: fixed | 18:14 |
| rlandy | see zbr's comment above | 18:14 |
| rfolco|ruck | rlandy, did you? | 18:14 |
| rfolco|ruck | aaaaaaaaaaaah | 18:14 |
| rlandy | I did nothing | 18:14 |
| rfolco|ruck | ok | 18:15 |
| rfolco|ruck | good | 18:15 |
| rfolco|ruck | :) | 18:15 |
| rlandy | rfolco|ruck: but I am making the other jobs voting - so we will see how that goes | 18:15 |
| rlandy | rfolco|ruck: did I miss any jobs here: https://tree.taiga.io/project/tripleo-ci-board/task/1326?kanban-status=1447275? | 18:17 |
| rlandy | where is the tripleo common one? | 18:17 |
| rfolco|ruck | molecule-tripleo-common | 18:18 |
| rfolco|ruck | :) | 18:18 |
| rlandy | ah ok | 18:18 |
| rfolco|ruck | all there | 18:18 |
| rlandy | thanks | 18:22 |
| rlandy | here we go now | 18:22 |
| *** ykarel|away has joined #oooq | 18:23 | |
| rlandy | rfolco|ruck: weshay: https://review.rdoproject.org/r/#/c/23074/ - fyi ... if this passes, are you ok with having all promoter test voting now? | 18:32 |
| rlandy | I'll spin on the job a few times to ensure it's stable | 18:33 |
| rlandy | weshay: pls remind me - when is bootcamp? I know you need two envs. You want them set to deploy ops 16? | 18:35 |
| * rlandy starts with getting osp 16 standalone to pass | 18:35 | |
| rlandy | downstream I go | 18:36 |
| raukadah | rlandy: please share the notes with the team on setting up on bootcamp machines | 18:36 |
| rlandy | raukadah: sure - I just need the exact requirements | 18:36 |
| rlandy | raukadah: wait - are on a plane??? | 18:36 |
| raukadah | rlandy: :-) | 18:36 |
| rlandy | did you miss the flight? | 18:37 |
| raukadah | rlandy: nope landed at the airport killing my time | 18:37 |
| rlandy | also - when is this bootcamp party?? | 18:37 |
| raukadah | rlandy: It is from 22nd Oct onwards | 18:37 |
| raukadah | rlandy: you are joining the party? | 18:38 |
| rlandy | raukadah: negative | 18:38 |
| raukadah | rlandy: :-( | 18:38 |
| rlandy | wow - 22 ... ok we got work to do | 18:38 |
| raukadah | weshay: can we invite rlandy to pune party? | 18:38 |
| rlandy | raukadah: not weshay's fault - have a religious holiday on 22 - can't be there in time | 18:40 |
| raukadah | rlandy: pune party is still in planning phase | 18:40 |
| rlandy | ok | 18:40 |
| rlandy | alright - let me get the party props ready | 18:40 |
| * raukadah wants to invite the whole tripleo ci team to my marriage party soon, but all needs to wear travel cost a fund of 1 week celebration soon | 18:41 | |
| rlandy | raukadah: hey - congrats - send us photos | 18:43 |
| raukadah | rlandy: search for bride still going on, will update the status during scrum | 18:44 |
| raukadah | rlandy: it would be great to having a picture with the whole team | 18:44 |
| raukadah | with bride | 18:44 |
| *** Goneri has joined #oooq | 18:44 | |
| rlandy | :) | 18:45 |
| * raukadah looks at panda|off | 18:45 | |
| * raukadah missed rfolco|ruck | 18:46 | |
| rfolco|ruck | raukadah, next time buddy :) | 18:46 |
| raukadah | rfolco|ruck: hhe | 18:46 |
| raukadah | rfolco|ruck: we will meet soon for sure, if weshay agrees for our get together | 18:47 |
| raukadah | rfolco|ruck: weshay rlandy zbr https://www.facebook.com/photo.php?fbid=170046754181322&set=a.127803681738963&type=3&theater openstack engineers at Pune | 18:49 |
| raukadah | scrapped from today's party | 18:49 |
| rfolco|ruck | raukadah, ok I'm following you now on fb | 18:51 |
| raukadah | rfolco|ruck: :-) | 18:51 |
| *** ykarel|away has quit IRC | 19:00 | |
| rlandy | rfolco|ruck: https://review.rdoproject.org/r/#/c/23074/ passed twice - whenever you guys (ruck/rover) want to merge | 19:02 |
| rfolco|ruck | rlandy, +2 lets wait another core to 2+ | 19:03 |
| rfolco|ruck | w+ | 19:03 |
| rlandy | rfolco|ruck: let's let marios weigh in | 19:03 |
| rfolco|ruck | rlandy, can a testproject review auth to registry and push containers? https://review.rdoproject.org/r/#/c/23066/ -- Error initiating layer upload to /v2/tripleomaster/rhel-binary-base/blobs/uploads/ in trunk.registry.rdoproject.org: unauthorized: authentication required | 19:08 |
| *** aakarsh has quit IRC | 19:19 | |
| rfolco|ruck | mmmmh | 19:20 |
| rfolco|ruck | login is skipped for redhat coz it uses podman | 19:20 |
| rfolco|ruck | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/tripleo-ci-periodic-base/containers-push-registry-login.yaml#L10 | 19:20 |
| rlandy | looking | 19:21 |
| rlandy | rfolco|ruck: what do mean by auth? | 19:21 |
| rlandy | review auth | 19:21 |
| rlandy | you have a dep change on tripleo-ci | 19:22 |
| rfolco|ruck | authenticate... the problem is: for centos we use docker_login, then push | 19:22 |
| rlandy | that will work | 19:22 |
| rlandy | that is fine | 19:22 |
| rfolco|ruck | for rhel8 we use podman, so the retag is not pushing | 19:22 |
| rfolco|ruck | I need to know how to make the retag for rhel8 then | 19:22 |
| rlandy | what you can't do is tets config stuff | 19:22 |
| rlandy | so if you added a key, testproject woudl not help you | 19:23 |
| rlandy | is that key in config? | 19:23 |
| rlandy | if so, .. | 19:24 |
| rlandy | you can create a job that parents off the job in config | 19:24 |
| rlandy | where the key is | 19:24 |
| *** jfrancoa has quit IRC | 19:25 | |
| rfolco|ruck | rlandy, the push is atomic (kolla) and its working fine.... | 19:25 |
| rlandy | then you should be ok | 19:26 |
| rfolco|ruck | rlandy, the retag/push task isn't coz I need to use the right podman command I suppose | 19:26 |
| rlandy | ack - I think you're from the auth case | 19:26 |
| rfolco|ruck | coz podman does not support token | 19:26 |
| rfolco|ruck | rlandy, do you have an example on how to use podman push w/ credentials/secret in one single cmd line ? | 19:29 |
| rfolco|ruck | ideally reusing zuul secrets | 19:29 |
| rlandy | https://github.com/containers/libpod/blob/master/docs/podman-push.1.md uses a file | 19:31 |
| rlandy | if you need zuul secrets you need config | 19:31 |
| rlandy | in such a case you can't test per review | 19:31 |
| rfolco|ruck | rlandy, let me try something thx | 19:32 |
| *** Goneri has quit IRC | 19:40 | |
| weshay | back | 19:42 |
| rfolco|ruck | weshay, bad news | 19:46 |
| rfolco|ruck | weshay, retag won't work | 19:47 |
| rfolco|ruck | coz | 19:47 |
| rfolco|ruck | https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/tripleo-ci-periodic-base/containers-push-registry-login.yaml#L10 | 19:47 |
| rfolco|ruck | we skip docker_login for podman | 19:47 |
| rfolco|ruck | unauthorized: authentication required | 19:48 |
| *** aakarsh has joined #oooq | 19:48 | |
| rfolco|ruck | http://logs.rdoproject.org/66/23066/2/check/periodic-tripleo-rhel-8-master-containers-build-push/8387b7f/job-output.txt | 19:48 |
| rfolco|ruck | weshay, ^ | 19:48 |
| weshay | k.. /me looks | 19:48 |
| weshay | rfolco|ruck, it won't work generally or just in the testproject run? | 19:48 |
| rfolco|ruck | weshay, podman does not support tokens, so we need to find a solution for pushing w/ podman cmd line that authenticates using zuul secrets | 19:49 |
| rfolco|ruck | weshay, won't work generally | 19:49 |
| weshay | rfolco|ruck, hrm.. ok.. so couple things | 19:50 |
| weshay | 1. let's get this written up in a way that the rdo infra folks will understand | 19:50 |
| weshay | sounds like we can not turn anonymous access off until that is resolved | 19:50 |
| weshay | 2. if we think we can merge your change.. let's do that.. or we can turn login off on the testproject job and rerun | 19:51 |
| *** aakarsh has quit IRC | 19:51 | |
| rfolco|ruck | weshay, its running retag task now, but failing. | 19:52 |
| rfolco|ruck | weshay, not sure how this helps | 19:52 |
| rfolco|ruck | it does not fix our problem right? so I can file a bug for it | 19:52 |
| weshay | rfolco|ruck, we can push w/o login right? | 19:52 |
| weshay | https://review.rdoproject.org/r/#/c/23066/2..3/.zuul.yaml | 19:52 |
| weshay | rfolco|ruck, ya.. file a bug it will be good to have | 19:52 |
| rfolco|ruck | weshay, what will happen w/ force_login_enabled | 19:53 |
| *** holser has joined #oooq | 20:00 | |
| rlandy | rfolco|ruck (as TC): starting rhos-16 work - do you want this tracked somewhere or I just carry on and do my thing? | 20:07 |
| rlandy | weshay: ^^ fyi ... https://code.engineering.redhat.com/gerrit/179007 and https://code.engineering.redhat.com/gerrit/#/c/183136/ | 20:08 |
| weshay | k.. looking | 20:08 |
| rlandy | no rush | 20:09 |
| rlandy | just fyi | 20:09 |
| rlandy | reconfiguring env C | 20:09 |
| weshay | rlandy++ | 20:10 |
| weshay | rfolco|ruck, rlandy just tested this.. check my last comment https://review.rdoproject.org/r/#/c/22892/ | 20:10 |
| rlandy | if it's tested - I trust you :) | 20:12 |
| rlandy | logs look good | 20:14 |
| rlandy | weshay: ok I'll w+ | 20:14 |
| rlandy | oh wait | 20:15 |
| rlandy | red job | 20:15 |
| weshay | red job? | 20:15 |
| rfolco|ruck | tox-molecule | 20:15 |
| rfolco|ruck | I thought the issue was gone | 20:16 |
| rlandy | AssertionError: Pattern not found- promoter SUCCESS promoting tripleo\-ci\-staging as tripleo\-ci\-staging\-promoted | 20:16 |
| weshay | rfolco|ruck, it is https://review.rdoproject.org/r/#/c/22892/ | 20:16 |
| rlandy | weshay: I'm checking that | 20:16 |
| weshay | rlandy, the latest run is green | 20:17 |
| weshay | except for promotion-staging | 20:17 |
| rlandy | tripleo-ci-promotion-stagingFAILURE in 7m 46s (non-voting) | 20:17 |
| weshay | oh should that be green? | 20:17 |
| rlandy | that should be green | 20:17 |
| rlandy | promoter SUCCESS \0/ promoting | 20:18 |
| rlandy | weshay: you just changed the text | 20:18 |
| weshay | rlandy, oh ya. .I changed that.. | 20:18 |
| weshay | lolz | 20:18 |
| weshay | hrm | 20:18 |
| rlandy | the test needs to be updated | 20:18 |
| * weshay changes back | 20:18 | |
| rlandy | weshay; it's fine - we just need to change the test | 20:18 |
| rlandy | and the test data | 20:18 |
| * rlandy gets | 20:18 | |
| *** Goneri has joined #oooq | 20:19 | |
| weshay | rlandy, let's just change it back.. no need to rock the boat | 20:19 |
| weshay | rlandy, I'll do it | 20:19 |
| rlandy | https://github.com/rdo-infra/ci-config/blob/6660e6d9327b51c72d5dea689925dbbf3bb0625d/ci-scripts/dlrnapi_promoter/tests/staging-setup/test_promoter_test.py#L56 | 20:19 |
| rlandy | weshay: ^^ it's that | 20:19 |
| rlandy | up to you | 20:19 |
| weshay | rlandy, ya.. /me is afraid.. \0/ will parse incorrectly in a test | 20:20 |
| rlandy | https://github.com/rdo-infra/ci-config/blob/6660e6d9327b51c72d5dea689925dbbf3bb0625d/ci-scripts/dlrnapi_promoter/tests/staging-setup/promoter_test.py#L197 | 20:20 |
| weshay | rlandy, however we should have the branch in that messagge | 20:20 |
| weshay | follow up patch | 20:20 |
| rlandy | weshay: ok- then we need to change all three files | 20:21 |
| rlandy | which is fine | 20:21 |
| weshay | another time | 20:21 |
| weshay | rlandy, I also added the distro for clarity | 20:22 |
| weshay | ha ha | 20:22 |
| rlandy | weshay: it's now one of those 'be careful what you wish for' situations. we wanted testing ... | 20:23 |
| rlandy | it's fine to change stuff as long as we update the tests | 20:24 |
| weshay | k | 20:24 |
| *** Vorrtex has quit IRC | 20:25 | |
| rlandy | weshay: speaking of which - those will be voting so as soon as https://review.rdoproject.org/r/#/c/23074/ merges | 20:25 |
| weshay | rlandy, k.. I'll get the tests passing w/ the improved syntax | 20:28 |
| weshay | w/o \0/ | 20:28 |
| rlandy | \0/ | 20:29 |
| rlandy | thanks | 20:29 |
| rlandy | those tests need to vote | 20:29 |
| rlandy | as soon as marios sees the review we should w+ that | 20:30 |
| rlandy | rfolco|ruck: ^^ | 20:30 |
| rlandy | to avoid exactly this | 20:30 |
| rfolco|ruck | :) | 20:30 |
| rlandy | 2019-10-10 20:24:19.424912 | primary | TASK [overcloud-prep-images : Prepare the overcloud images for deploy] ********* | 20:33 |
| rlandy | oh dear HP | 20:33 |
| rlandy | weshay: ^^ so that's the other HP env - going to have to do some investigation there | 20:34 |
| rlandy | for bootcamp - take C and A | 20:34 |
| rlandy | or B | 20:34 |
| rlandy | may be B - it's stable | 20:34 |
| weshay | rlandy, we'll want/need something reliable for the one week | 20:34 |
| weshay | probably really just a day | 20:34 |
| rlandy | it's fine | 20:34 |
| rlandy | you could really have them all for a couple days | 20:35 |
| rlandy | getting C up and running now | 20:35 |
| rlandy | and then I'll see what cooks with HP | 20:35 |
| weshay | rfolco|ruck, hrm.. ok.. I recall this issue now | 20:36 |
| weshay | rfolco|ruck, panda|off and I were talking about it a while ago | 20:36 |
| weshay | rfolco|ruck, I want to say.. we authed w/ docker and pushed w/ buildah.. but I don't really remember at this point | 20:39 |
| rfolco|ruck | weshay, I am checking if things changed since | 20:41 |
| weshay | k | 20:41 |
| rfolco|ruck | weshay, what I still don't understand is why buildah builds/pushes (in kolla) but then my post task does not push... | 20:42 |
| *** tesseract has quit IRC | 20:53 | |
| weshay | rfolco|ruck, link? | 20:53 |
| weshay | to the post tasks | 20:53 |
| rfolco|ruck | sec | 20:53 |
| rfolco|ruck | post task is here https://github.com/openstack/tripleo-ci/blob/master/roles/build-containers/tasks/tag.yaml#L8 | 20:54 |
| rfolco|ruck | login skipped is here https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/playbooks/tripleo-ci-periodic-base/containers-push-registry-login.yaml#L10 | 20:54 |
| rfolco|ruck | tested here http://logs.rdoproject.org/66/23066/3/check/periodic-tripleo-rhel-8-master-containers-build-push/cc3a95d/job-output.txt | 20:55 |
| rfolco|ruck | build-containers : Tag w/ arch suffix and push image: trunk.registry.rdoproject.org/tripleomaster/rhel-binary-base] | 20:56 |
| rfolco|ruck | so if I am not wrong, before that, when kolla calls buildah, it builds and pushes to registry | 20:56 |
| rfolco|ruck | so the push works somehow... I'd like to understand how coz the docker_login was skipped | 20:57 |
| rfolco|ruck | 2019-10-10 20:03:13.808171 | LOOP [Login to RDO registry] | 20:57 |
| rfolco|ruck | 2019-10-10 20:03:13.860107 | primary | skipping: Conditional result was False | 20:57 |
| weshay | ya.. we can still push w/o auth atm | 20:58 |
| rfolco|ruck | we can? so why this --> Error writing blob: Error initiating layer upload to /v2/tripleomaster/rhel-binary-base/blobs/uploads/ in trunk.registry.rdoproject.org: unauthorized: authentication required | 20:59 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/36/183136/2/check/tripleo-ci-rhel-8-standalone-rhos-16/c77b595/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 21:04 |
| rlandy | oh well - I guess not too bad for a first attempt | 21:04 |
| rfolco|ruck | weshay, ah nevermind... http://logs.rdoproject.org/66/23066/3/check/periodic-tripleo-rhel-8-master-containers-build-push/cc3a95d/conf/kolla-build.conf.txt.gz | 21:07 |
| rfolco|ruck | push=false | 21:07 |
| weshay | noticed that too | 21:08 |
| rfolco|ruck | this is not true https://github.com/rdo-infra/review.rdoproject.org-config/blob/master/zuul.d/tripleoci.yaml#L202 | 21:11 |
| *** rfolco|ruck has quit IRC | 21:13 | |
| *** holser__ has joined #oooq | 21:13 | |
| rlandy | weshay: do you have access to the registry where osp containers are uploaded? | 21:14 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/36/183136/2/check/tripleo-ci-rhel-8-standalone-rhos-16/c77b595/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 21:14 |
| rlandy | ^^ to debug this mess | 21:14 |
| weshay | rlandy, no I don't | 21:15 |
| * weshay looks | 21:15 | |
| weshay | rlandy, can probably ask jjoyce | 21:16 |
| weshay | long log | 21:16 |
| rlandy | weshay: I know | 21:16 |
| rlandy | I am not even sure where the error is | 21:16 |
| * rlandy asks | 21:16 | |
| rlandy | Error running playbook in directory: /tmp/tripleo-modify-image-playbook-mk511oz5", "2019-10-10 20:45:50 23164 INFO tripleo_common.image.image_uploader [ ] imagename: registry-proxy.engineering.redhat.com/rh-osbs/rhosp16-openstack-placement-api:20191007.1", "2019-10-10 20:45:50 23164 ERROR | 21:17 |
| *** holser has quit IRC | 21:17 | |
| weshay | rlandy, tripleo_common.image.exception.ImageUploaderException: Modifying image 192.168.24.1:8787/rh-osbs/rhosp16-openstack-cinder-scheduler:20191007.1 failed | 21:18 |
| weshay | https://sf.hosted.upshift.rdu2.redhat.com/logs/36/183136/2/check/tripleo-ci-rhel-8-standalone-rhos-16/c77b595/logs/undercloud/var/log/tripleo-container-image-prepare.log.txt.gz | 21:18 |
| rlandy | yep - just looking there | 21:18 |
| rlandy | wow - verbose | 21:18 |
| jjoyce | rlandy weshay: Internally or externally? | 21:18 |
| rlandy | jjoyce: osp-16 | 21:18 |
| rlandy | so internally | 21:19 |
| weshay | rlandy, | 21:19 |
| weshay | Problem: cannot install both python3-numpy-1:1.15.1-2.2.el8ost.x86_64 and python3-numpy-1:1.14.3-9.el8.x86_64 | 21:19 |
| weshay | - package python3-numpy-f2py-1:1.14.3-9.el8.x86_64 requires python3-numpy = 1:1.14.3-9.el8, but none of the providers can be installed | 21:19 |
| weshay | - cannot install the best update candidate for package python3-numpy-1:1.14.3-9.el8.x86_64 | 21:19 |
| weshay | - problem with installed package python3-numpy-f2py-1:1.14.3-9.el8.x86_64 | 21:19 |
| jjoyce | rlandy: Yes, you should have access to them. | 21:19 |
| weshay | rlandy, you hit a yum install/update error on the container-modify image | 21:19 |
| weshay | rlandy, other osp jobs don't run this | 21:20 |
| rlandy | container-modify image? | 21:20 |
| weshay | everyone's favority https://github.com/openstack/ansible-role-tripleo-modify-image | 21:20 |
| weshay | rlandy, I think if ur not running against a change.. you can turn that off | 21:20 |
| weshay | rlandy, update_repo: "rhelosp-16.0-trunk,rhelosp-ceph-4.0-mon-pending,rhelosp-ceph-4.0-tools-pending" | 21:21 |
| rlandy | so I won;t have the numpy problem | 21:21 |
| weshay | https://sf.hosted.upshift.rdu2.redhat.com/logs/36/183136/2/check/tripleo-ci-rhel-8-standalone-rhos-16/c77b595/logs/undercloud/home/zuul/containers-prepare-parameters.yaml.txt.gz | 21:21 |
| rlandy | who named that?? | 21:21 |
| weshay | num py | 21:21 |
| weshay | :) | 21:21 |
| weshay | numpy | 21:21 |
| rlandy | oh | 21:21 |
| weshay | numpy dumpy sat on a wall | 21:21 |
| rlandy | exactly | 21:22 |
| weshay | numpy dumpy had a great fall | 21:22 |
| jjoyce | sci py scipu | 21:22 |
| jjoyce | scipy | 21:22 |
| rlandy | like the peanut butter | 21:22 |
| jjoyce | weshay: The circular dependency with some of the rpms is great when building those. | 21:22 |
| jjoyce | rlandy: ;-) | 21:22 |
| weshay | rlandy, I recommend turning it off for now in osp jobs.. | 21:28 |
| weshay | rlandy, at least for 16 | 21:28 |
| rlandy | weshay: ack - looking for that switch | 21:28 |
| rlandy | I think we changed the repos to turn it off in 15? | 21:28 |
| rlandy | or minimized the repos? | 21:29 |
| weshay | rlandy, ya.. double check that | 21:32 |
| weshay | rlandy, but if it's periodic, it's not needed at all | 21:33 |
| rlandy | weshay: ah update_containers | 21:37 |
| rlandy | it's false by default | 21:38 |
| weshay | rlandy, ya.. the release file | 21:40 |
| rlandy | standalone_container_prep_updates | 21:41 |
| rlandy | weshay: can't turn that all off | 21:41 |
| rlandy | standalone_container_prep_updates and standalone_container_prep_update_repo | 21:43 |
| rlandy | removed the trunk repo update | 21:57 |
| weshay | rlandy, all you need to change is.. | 21:57 |
| * weshay gets | 21:57 | |
| rlandy | standalone_container_prep_update_repo: >- | 21:58 |
| rlandy | rhelosp-ceph-4.0-mon-pending,rhelosp-ceph-4.0-tools-pending | 21:58 |
| rlandy | # rhelosp-16.0-trunk,rhelosp-ceph-4.0-mon-pending,rhelosp-ceph-4.0-tools-pending | 21:58 |
| weshay | hrm.. my memory does not serv.. | 21:59 |
| weshay | but if you remove all the repos.. it will not update :) | 21:59 |
| weshay | it will skip | 21:59 |
| weshay | the role will still run which is fine | 22:00 |
| *** jbadiapa has quit IRC | 22:02 | |
| weshay | rlandy, https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/standalone/tasks/main.yml#L83 | 22:02 |
| weshay | there it is | 22:02 |
| rlandy | weshay: can't do | 22:02 |
| rlandy | we need some of that | 22:02 |
| rlandy | I removed the troublesome repo | 22:02 |
| weshay | what do we need? | 22:03 |
| weshay | rlandy, we shouldn't need anything in https://opendev.org/openstack/tripleo-quickstart-extras/src/branch/master/roles/standalone/tasks/main.yml#L81-L112 | 22:03 |
| rlandy | weshay: ok - if this run fails, I'll remove it all | 22:04 |
| weshay | rlandy, pretty bad perf regression :( | 22:17 |
| weshay | timeout w/ 120min | 22:17 |
| rlandy | weshay: yep - I know | 22:18 |
| rlandy | pity there is no performance team | 22:18 |
| rlandy | weshay: which platform - ovb? | 22:19 |
| weshay | rlandy, I think it's in general | 22:20 |
| weshay | you have a sec to look at something w/ me? | 22:20 |
| weshay | rlandy, pretty sure it's tripleo-container-image-prepare | 22:21 |
| rlandy | weshay: I wish - got to go to other job tonight | 22:21 |
| weshay | rlandy, ok.. no biggie | 22:22 |
| rlandy | weshay: I hget back around 10pm EST if you are around then | 22:22 |
| weshay | no no.. chat w/ you tomorrow | 22:22 |
| rlandy | weshay: ack ok - sorry | 22:22 |
| *** rlandy is now known as rlandy|bbl | 22:23 | |
| *** holser__ has quit IRC | 22:27 | |
| *** ccamacho has quit IRC | 23:10 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!