| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, (3 more messages) | 00:27 |
|---|---|---|
| *** saneax has joined #oooq | 01:09 | |
| *** rlandy|bbl is now known as rlandy | 01:58 | |
| *** gouthamr has quit IRC | 02:10 | |
| *** gouthamr has joined #oooq | 02:12 | |
| *** dsneddon has quit IRC | 02:22 | |
| *** raukadah is now known as chandankumar | 02:27 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, (3 more messages) | 02:27 |
| *** dsneddon has joined #oooq | 02:48 | |
| *** ykarel|away has joined #oooq | 02:52 | |
| *** apetrich has quit IRC | 03:14 | |
| *** saneax has quit IRC | 03:33 | |
| *** saneax has joined #oooq | 03:56 | |
| *** udesale has joined #oooq | 04:05 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo- (3 more messages) | 04:27 |
| *** ykarel|away has quit IRC | 04:58 | |
| *** ykarel|away has joined #oooq | 05:13 | |
| *** ykarel|away is now known as ykarel | 05:58 | |
| *** jbadiapa has quit IRC | 06:07 | |
| ykarel | chandankumar, arxcruz can you guys take care of tempest plugins cleanup today, we would like to start testing for RC builds soon | 06:15 |
| ykarel | mainly those are left see https://review.rdoproject.org/etherpad/p/stein-release-preparation Line 54 | 06:16 |
| ykarel | it should not take much time | 06:16 |
| chandankumar | ykarel: prioritize which is needed first | 06:17 |
| ykarel | chandankumar, i would say branch all together, and from build we need keystone and neutron plugin first of all | 06:18 |
| ykarel | https://review.rdoproject.org/r/#/c/19678/ and https://review.rdoproject.org/r/#/c/19658/ are blocked by ^^ | 06:18 |
| chandankumar | ykarel: ok on it | 06:19 |
| ykarel | Thanks | 06:19 |
| *** ccamacho has quit IRC | 06:23 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo- (3 more messages) | 06:27 |
| *** ratailor has joined #oooq | 06:50 | |
| *** quiquell|off is now known as quiquell | 06:56 | |
| quiquell | Good morning | 06:56 |
| *** skramaja has quit IRC | 07:02 | |
| *** chandankumar has quit IRC | 07:06 | |
| *** chandankumar has joined #oooq | 07:08 | |
| *** jbadiapa has joined #oooq | 07:14 | |
| *** skramaja has joined #oooq | 07:16 | |
| *** jfrancoa has joined #oooq | 07:25 | |
| *** ykarel is now known as ykarel|lunch | 07:26 | |
| *** holser_ has joined #oooq | 07:41 | |
| *** apetrich has joined #oooq | 07:49 | |
| *** kopecmartin|off is now known as kopecmartin | 07:52 | |
| *** tosky has joined #oooq | 08:04 | |
| *** ccamacho has joined #oooq | 08:05 | |
| *** amoralej|lunch is now known as amoralej | 08:14 | |
| zbr | morning! please help wf https://review.openstack.org/#/c/648070/ -- stein release config depends on this one. | 08:17 |
| quiquell | zbr: o/ have you reparent the stein one ? | 08:20 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo- (3 more messages) | 08:27 |
| *** jpena|off is now known as jpena | 08:39 | |
| *** ykarel|lunch is now known as ykarel | 08:40 | |
| *** sshnaidm|bbl is now known as sshnaidm|rover | 08:40 | |
| quiquell | zbr: ping | 08:48 |
| *** bogdando has joined #oooq | 08:49 | |
| *** d0ugal has joined #oooq | 08:57 | |
| quiquell | marios_|ruck, zbr, sshnaidm|rover: " TASK [Run image build]" for stein containres \o/ | 08:59 |
| quiquell | It's tripleo-ci-testing I will try to manually set at current-tripleo | 08:59 |
| marios_|ruck | quiquell: nice | 09:00 |
| quiquell | I have also manually promote current-tripleo and tripleo-ci-testing at DLRN | 09:00 |
| quiquell | marios_|ruck: the new containers-build-push jobs does not need the release files, is that correct ? | 09:07 |
| marios_|ruck | quiquell: which release files do you mean | 09:08 |
| quiquell | marios_|ruck: https://github.com/openstack/tripleo-quickstart/tree/master/config/release/tripleo-ci/CentOS-7 | 09:08 |
| marios_|ruck | quiquell: no i mean there is no under/over cloud there | 09:09 |
| quiquell | ack | 09:09 |
| quiquell | zbr: can you reparent https://review.openstack.org/#/c/643963/ please ? | 09:10 |
| quiquell | zbr: also add the refactoring to the taiga task https://tree.taiga.io/project/tripleo-ci-board/task/886?kanban-status=1447276 | 09:10 |
| quiquell | zbr: have just workflowed https://review.openstack.org/#/c/648070 | 09:11 |
| quiquell | sshnaidm|rover: ^ | 09:11 |
| quiquell | zbr: have just create a task with the refactor of release files https://tree.taiga.io/project/tripleo-ci-board/task/921?kanban-status=1538166 | 09:16 |
| quiquell | zbr: have reparent the stein release file review https://review.openstack.org/#/c/643963/ | 09:25 |
| *** derekh has joined #oooq | 09:37 | |
| sshnaidm|rover | marios_|ruck, ykarel I think we can promote now while excluding 020, all master jobs pass, only 020 didn't finish yet, and it also failed in previous time | 09:37 |
| ykarel | sshnaidm|rover, +1 | 09:38 |
| marios_|ruck | sshnaidm|rover: is it still tempest? | 09:39 |
| marios_|ruck | sshnaidm|rover: have logs? | 09:39 |
| marios_|ruck | sshnaidm|rover: https://bugs.launchpad.net/tripleo/+bug/1821690 was about fs 20 | 09:39 |
| openstack | Launchpad bug 1821690 in tripleo "periodic-ovb-1ctlr_1comp-featureset020-master fails tempest test_auto_allocate_network tempest.api.compute.images.test_images" [High,Triaged] - Assigned to Arx Cruz (arxcruz) | 09:39 |
| marios_|ruck | sshnaidm|rover: ah it timed out | 09:40 |
| marios_|ruck | sshnaidm|rover: i mean looking at https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master | 09:40 |
| sshnaidm|rover | marios_|ruck, will look, but arxcruz has a patch to exclude failing job there | 09:40 |
| marios | sshnaidm|rover: yeah it merged | 09:41 |
| sshnaidm|rover | quiquell, so, how is that running? https://review.rdoproject.org/r/#/c/19796/ | 09:47 |
| sshnaidm|rover | quiquell, does it work as expected? | 09:47 |
| * marios_|ruck school run biab | 09:48 | |
| quiquell | sshnaidm|rover: Yep, it's building now from tripleo-ci-testing | 09:48 |
| quiquell | sshnaidm|rover: I will have to promote the containres to current-tripleo | 09:48 |
| quiquell | sshnaidm|rover: I was not able to override the buildcontainres-tag | 09:49 |
| quiquell | sshnaidm|rover: we neeed this for that https://review.rdoproject.org/r/#/c/19803/ | 09:49 |
| quiquell | sshnaidm|rover: I have directly remove the push: false so it will push containres | 09:50 |
| arxcruz | sshnaidm|rover: marios_|ruck do you guys need something from my side? I mean, besides to check the test_auto_allocate_network ? | 09:51 |
| sshnaidm|rover | quiquell, did you check that it's right hash there? | 09:52 |
| sshnaidm|rover | arxcruz, no, that's fine, I see your patch is merged | 09:53 |
| quiquell | sshnaidm|rover: 2019-03-28 09:16:58.947228 | primary | + FULL_HASH=fbb797b891c6f2530b18ee904a93c35b9e7490c1_2c625b49 | 09:54 |
| quiquell | sshnaidm|rover: is the one that they manually link to current-tripleo at RDO repos | 09:54 |
| quiquell | sshnaidm|rover: I have also update DLRN with it to tripleo-ci-testing and current-tripleo | 09:55 |
| quiquell | sshnaidm|rover: it was missing at DLRN | 09:55 |
| *** dtantsur|afk is now known as dtantsur | 09:59 | |
| quiquell | sshnaidm|rover: this is onlye to run containersbuilds for rocky at check ? https://review.openstack.org/#/c/647719/ | 10:03 |
| quiquell | sshnaidm|rover: commented https://review.openstack.org/#/c/647719 | 10:05 |
| sshnaidm|rover | quiquell, yeah, replied | 10:11 |
| chandankumar | arxcruz: kopecmartin please have a look when free https://tree.taiga.io/project/tripleo-ci-board/task/898?kanban-status=1447274 | 10:13 |
| quiquell | ack | 10:13 |
| quiquell | +2 | 10:13 |
| zbr | quiquell: doing the rebase now | 10:19 |
| quiquell | zbr: have already do it | 10:19 |
| ykarel | tosky, i see 3.23.0 in requirements.txt | 10:19 |
| quiquell | zbr: want to test it | 10:19 |
| quiquell | zbr: check that I didn't do anything wrong | 10:19 |
| quiquell | zbr: update your review so you don't overwrite the patchset | 10:19 |
| quiquell | zbr: I mean your local review | 10:19 |
| tosky | ykarel: is that an answer for #rdo? :) | 10:21 |
| ykarel | tosky, yes | 10:21 |
| tosky | ykarel: so it matches my comment | 10:22 |
| ykarel | tosky, 3.22 vs 3.23.0 | 10:23 |
| ykarel | https://review.rdoproject.org/r/#/c/19804/ | 10:23 |
| tosky | oh | 10:24 |
| tosky | ok, off-by-one | 10:24 |
| zbr | quiquell: your update look perfect, checked it. | 10:27 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo- (3 more messages) | 10:28 |
| quiquell | zbr: cool, also we have to do same refactoring at the periodic jobs release files | 10:28 |
| *** saneax has quit IRC | 10:28 | |
| zbr | quiquell: exactly, i was just waiting to do stein, and planning to do the rest after. | 10:28 |
| quiquell | zbr: ok perfect | 10:29 |
| quiquell | zbr: testing stein release file right now | 10:29 |
| zbr | quiquell: i talked with wes last week and the plan is to find a way to stack/inherit them in order to minimize what we define in each release file. | 10:30 |
| quiquell | zbr: let's just merge stein release files and then refactor it | 10:31 |
| quiquell | zbr: do you remember where is the RDO container registry console ? | 10:31 |
| zbr | http://console.registry.rdoproject.org/ ? | 10:32 |
| zbr | quiquell: i had another improvement made last week by the release work will likely made me rebase it, but if you can get a look before it would be great: https://review.openstack.org/#/c/645351/ | 10:35 |
| zbr | i guess this patch explains why we need to refactor how we load release configs, such fix should not need to touch this number of files. | 10:36 |
| quiquell | zbr, sshnaidm|rover, marios_|ruck: habemus stein containers | 10:45 |
| quiquell | skopeo inspect docker://trunk.registry.rdoproject.org/tripleostein/centos-binary-openvswitch-base:fbb797b891c6f2530b18ee904a93c35b9e7490c1_2c625b49 | 10:45 |
| zbr | quiquell++ | 10:45 |
| hubbot1 | zbr: quiquell's karma is now 23 | 10:45 |
| marios_|ruck | quiquell: nice | 10:46 |
| quiquell | marios_|ruck: apart from Alex who else was missing it ? | 10:46 |
| quiquell | and us of course | 10:46 |
| marios_|ruck | quiquell: not aware of someone else apart from alex asking yesterday | 10:46 |
| quiquell | ack | 10:47 |
| quiquell | Ok let's continue with the stein enchilada | 10:47 |
| marios_|ruck | arxcruz: for https://bugs.launchpad.net/tripleo/+bug/1821690 see comment #8 do we need to reach out to nova folks? | 10:48 |
| openstack | Launchpad bug 1821690 in tripleo "periodic-ovb-1ctlr_1comp-featureset020-master fails tempest test_auto_allocate_network tempest.api.compute.images.test_images" [High,Triaged] - Assigned to Arx Cruz (arxcruz) | 10:48 |
| quiquell | marios_|ruck: let's +2 the stein release file https://review.openstack.org/#/c/643963 | 10:48 |
| marios_|ruck | arxcruz: as in we skip the test, but don't think we can close the bug yet with just skipping. unless we just won't support that micro versions | 10:48 |
| quiquell | ahh wait we need to promote this | 10:50 |
| quiquell | now | 10:50 |
| quiquell | so it's a docker hub I think | 10:50 |
| zbr | @oooq i need some early feedback on https://etherpad.openstack.org/p/tripleo-release-config-refactor | 10:51 |
| zbr | i want to hear ideas before doing work on that. | 10:51 |
| sshnaidm|rover | zbr, and what is the problem with current release configs? | 10:56 |
| arxcruz | marios_|ruck: let me check if I can reproduce it and see what's going on there | 10:57 |
| sshnaidm|rover | zbr, I think it's better to start from this | 10:57 |
| zbr | sshnaidm|rover: valid question, accepting answer by example? see https://review.openstack.org/#/c/643963/13 | 10:57 |
| marios_|ruck | arxcruz: ok | 10:58 |
| zbr | sshnaidm|rover: but i can also work on building a better motivation on that. | 10:58 |
| sshnaidm|rover | zbr, well, I don't see a problem there, anyway we'll need to add config files, so better to describe what exactly is problem | 10:58 |
| sshnaidm|rover | zbr, copying with sed "s/rocky/stein/" once a half year is not extremely difficult | 10:59 |
| quiquell | manual promoting containers now | 11:00 |
| sshnaidm|rover | zbr, also you try to hack configs, but I'd look at repo-setup role - how we can improve it and simplify these configs | 11:01 |
| *** udesale has quit IRC | 11:01 | |
| ykarel | quiquell, promoting untested containers? | 11:01 |
| zbr | sshnaidm|rover: yeah, the problem is that once you have a bugfix you rarely fix it in all supported releases, mainly due to lack of time. the bug is still there, and will need extra work to fix in all, touching multiple files. | 11:01 |
| quiquell | ykarel: we don't have the stein jobs there | 11:01 |
| quiquell | ykarel: is chicken egg | 11:01 |
| sshnaidm|rover | zbr, how is all this related to release configs | 11:01 |
| ykarel | quiquell, why not working on stein jobs first | 11:02 |
| quiquell | ykarel: we need images first | 11:02 |
| sshnaidm|rover | quiquell, images are created in stein jobs | 11:02 |
| ykarel | promotion jobs will build images, test those, then promote, then enable upstream job | 11:02 |
| ykarel | zbr, looks like you are not using master release files in your stein patch | 11:03 |
| arxcruz | marios_|ruck: sshnaidm|rover have you guys know this error? http://logs.rdoproject.org/99/648099/1/openstack-check/tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/605e23d/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gzhttp://logs.rdoproject.org/99/648099/1/openstack-check/tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/605e23d/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 11:03 |
| arxcruz | ops | 11:03 |
| arxcruz | http://logs.rdoproject.org/99/648099/1/openstack-check/tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/605e23d/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 11:03 |
| sshnaidm|rover | quiquell, agree with ykarel, if it's not so urgent let's wait for jobs | 11:03 |
| ykarel | zbr, i thought you will be using it | 11:03 |
| quiquell | sshnaidm|rover, ykarel ack | 11:03 |
| arxcruz | sshnaidm|rover: marios_|ruck it's not happening on periodic, but it's failing constantly when we run this job in tqe | 11:03 |
| ykarel | zbr, context: https://review.openstack.org/#/c/648070/ and https://review.openstack.org/#/c/643963/13 | 11:03 |
| quiquell | they are at RDO we can following with RDO jobs | 11:03 |
| sshnaidm|rover | arxcruz, yeah, seems like this should be fixed in https://review.openstack.org/#/c/648353/ | 11:04 |
| sshnaidm|rover | arxcruz, depend on that patch | 11:04 |
| marios_|ruck | arxcruz: sshnaidm|rover looks like new tempest issue in queens looking now will file bug in a bit http://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens/7f712d9/logs/undercloud/home/zuul/tempest.log.txt.gz | 11:05 |
| ykarel | marios_|ruck, other jobs are also affected with ^^ | 11:06 |
| sshnaidm|rover | wow, tempest is screwed there.. | 11:06 |
| quiquell | ykarel, sshnaidm|rover, marios_|ruck: So first I merge the RDO jobs here https://review.rdoproject.org/r/#/c/19451/ ? | 11:06 |
| marios_|ruck | ykarel: ack just seen it gimme link if you have one please | 11:06 |
| ykarel | marios_|ruck, https://trunk-primary.rdoproject.org/api-centos-queens/api/civotes_detail.html?commit_hash=034e6dd56ca5b92bb09e2330ab2a3e9d95650383&distro_hash=12a513b03da0ce49c9d084109631196f86fa8ed1 | 11:07 |
| ykarel | see atleast 16,17 | 11:07 |
| marios_|ruck | ykarel: thanks | 11:07 |
| ykarel | others i didn't checked | 11:07 |
| ykarel | quiquell, more important is the stein release file patch | 11:08 |
| ykarel | as that will be required for those jobs | 11:08 |
| quiquell | We are into it already | 11:08 |
| quiquell | I am going to workflow the jobs while the other is merging | 11:08 |
| ykarel | quiquell, but looks like zbr needs more change | 11:08 |
| sshnaidm|rover | quiquell, maybe need to add override-checkout in all of them | 11:08 |
| quiquell | sshnaidm|rover: well, that can be a follow up, since is good to have at the other releases too | 11:09 |
| zbr | ykarel: i am not sure what is wrong there. can we do a bj session? | 11:09 |
| sshnaidm|rover | quiquell, ok | 11:09 |
| ykarel | zbr, context: https://review.openstack.org/#/c/648070/ and https://review.openstack.org/#/c/643963/13 | 11:09 |
| ykarel | Improve master release config reusability | 11:10 |
| zbr | https://bluejeans.com/2655417928 to sync about stein release files, anyone | 11:10 |
| quiquell | ykarel: do I remove my +w at the refactor ? | 11:10 |
| arxcruz | marios_|ruck: jesus man, give me a break :P | 11:12 |
| marios_|ruck | arxcruz: no | 11:13 |
| arxcruz | marios_|ruck: assign it to kopecmartin | 11:13 |
| arxcruz | kopecmartin: ^ | 11:13 |
| marios_|ruck | arxcruz: k | 11:13 |
| marios_|ruck | arxcruz: which one though | 11:13 |
| arxcruz | it's on tempestconf | 11:13 |
| arxcruz | marios_|ruck: http://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-queens/7f712d9/logs/undercloud/home/zuul/tempest.log.txt.gz | 11:13 |
| marios_|ruck | arxcruz: the new one or the | 11:13 |
| marios_|ruck | arxcruz: k the new one i will once i file it | 11:14 |
| marios_|ruck | chandankumar: arxcruz: kopecmartin https://bugs.launchpad.net/tripleo/+bug/1822080 | 11:25 |
| openstack | Launchpad bug 1822080 in tripleo "periodic centos-7-ovb-1ctlr_1comp-featureset020-queens failing tempest "Endpoint not found"" [Critical,Triaged] - Assigned to Martin Kopec (mkopec) | 11:25 |
| marios_|ruck | sshnaidm|rover: ^ | 11:25 |
| sshnaidm|rover | marios_|ruck, ack | 11:26 |
| arxcruz | marios_|ruck: sshnaidm|rover https://review.openstack.org/#/c/643267/ +w ? | 11:27 |
| chandankumar | did we removed something from telemetry side in queens in tht? | 11:27 |
| sshnaidm|rover | chandankumar, better to ask on #tripleo | 11:28 |
| sshnaidm|rover | arxcruz, why not set tempest: container in featureset 052? | 11:29 |
| sshnaidm|rover | marios_|ruck, ^^ | 11:30 |
| marios_|ruck | arxcruz: sshnaidm|rover just +2 it | 11:30 |
| marios_|ruck | sshnaidm|rover: you have a +2 there | 11:30 |
| sshnaidm|rover | marios_|ruck, yeah, but now I | 11:30 |
| sshnaidm|rover | I'm in doubts :) | 11:30 |
| marios_|ruck | sshnaidm|rover: k i removed the +w please revote and comment | 11:30 |
| marios_|ruck | sshnaidm|rover: i guess | 11:30 |
| quiquell | ykarel: for stein now we have to add standalone periodics I suppose | 11:31 |
| marios_|ruck | sshnaidm|rover: the point is to have it on one job | 11:31 |
| marios_|ruck | sshnaidm|rover: for now | 11:31 |
| marios_|ruck | sshnaidm|rover: but fw052 would add it for all the standalones | 11:31 |
| quiquell | like master | 11:31 |
| marios_|ruck | arxcruz: ^ | 11:31 |
| ykarel | quiquell, those not created yet? | 11:31 |
| zbr | sshnaidm|rover: i remember you did some work on not having release name in delorean repo filename,right? i guess this also applies for delorean-deps too? if I understood correctly we should only see delorean(-deps).repo filenames | 11:31 |
| ykarel | missed? or intentional? | 11:31 |
| quiquell | ykarel: nop it was just duping rocky, but standalone is not at rocky | 11:31 |
| sshnaidm|rover | marios_|ruck, fair enough | 11:31 |
| ykarel | quiquell, we need almost same jobs as master i think | 11:32 |
| arxcruz | sshnaidm|rover: marios_|ruck because in that way, all standalone would run containerized | 11:32 |
| ykarel | as stein cut from it | 11:32 |
| quiquell | ykarel: agree let me add a patch | 11:32 |
| arxcruz | and we need also to tesst non container | 11:32 |
| ykarel | quiquell, ack | 11:32 |
| marios_|ruck | arxcruz: yeah i commented with this just now | 11:32 |
| marios_|ruck | arxcruz: sshnaidm|rover so wf it? | 11:32 |
| arxcruz | plus, os_tempest jobs will start to pop up soon | 11:32 |
| arxcruz | baby steps | 11:32 |
| sshnaidm|rover | marios_|ruck, yeah, I dit | 11:33 |
| marios_|ruck | arxcruz: you mean baby steps like walking in zig zag and crashing into all the things? | 11:33 |
| marios_|ruck | like that? | 11:33 |
| marios_|ruck | ;) | 11:33 |
| arxcruz | marios_|ruck: yup | 11:33 |
| marios_|ruck | sshnaidm|rover: ack | 11:33 |
| sshnaidm|rover | baby of t-rex steps | 11:34 |
| quiquell | jeje | 11:35 |
| arxcruz | thanks :) | 11:35 |
| marios_|ruck | arxcruz: does not mean we like you though just to be clear | 11:35 |
| marios_|ruck | k | 11:35 |
| arxcruz | marios_|ruck: same here :) | 11:36 |
| quiquell | ykarel: jobs like this rdoinfo-tripleo-master-testing-centos-7-standalone-featureset052 | 11:36 |
| arxcruz | just being polite :P | 11:36 |
| quiquell | ykarel: do we have to do something else at rdoinfro to support stein ? | 11:37 |
| marios_|ruck | quiquell: :D malaka | 11:37 |
| marios_|ruck | err sorry arxcruz ^ | 11:37 |
| marios_|ruck | quiquell: was not meant for you | 11:37 |
| marios_|ruck | :/ | 11:37 |
| quiquell | marios_|ruck: malaka=arx | 11:37 |
| ykarel | quiquell, not those, we can take care for those jobs once promotion jobs are ready | 11:37 |
| marios_|ruck | k i'll stop now | 11:37 |
| ykarel | quiquell, because we rely on promoted content | 11:37 |
| arxcruz | hehehehehe | 11:38 |
| arxcruz | marios_|ruck: goint to a greek restaurant now, what do you sugest to order? | 11:38 |
| marios_|ruck | arxcruz: nice dont know man maybe a nice mousakka or get some souvlaki what do they have there | 11:39 |
| arxcruz | ok | 11:40 |
| marios_|ruck | sshnaidm|rover: did rocky promote? | 11:42 |
| ykarel | yes it did promote today morning | 11:43 |
| ykarel | phase1 should promote soon | 11:43 |
| zbr | in fact, while looking back in config files it seems that the release based delorean repo were introduced after ocata, not sure why because afaik i only see use for a single repo at a time, one without release in its filename (or even repo name). | 11:43 |
| marios_|ruck | ykarel: cool i was looking in http://rhos-release.virt.bos.redhat.com:3030/rhosp so sshnaidm|rover we definitely have grafana issue | 11:43 |
| marios_|ruck | sshnaidm|rover: i mean with the reporting for promotion | 11:43 |
| ykarel | phase1 also promoted \o/ | 11:44 |
| marios_|ruck | ykarel: nice | 11:44 |
| marios_|ruck | so rocky and pike promoted ? | 11:44 |
| quiquell | ykarel: standalone jobs https://review.rdoproject.org/r/#/c/19810/ | 11:44 |
| ykarel | marios_|ruck, yes pike promoted, as phase 1 is running | 11:45 |
| marios_|ruck | ykarel: thanks | 11:45 |
| ykarel | master should promote soon, so only queens lacking now | 11:45 |
| marios_|ruck | ykarel: ack | 11:46 |
| ykarel | quiquell, ack | 11:46 |
| marios_|ruck | sshnaidm|rover: nice the -push job for rocky works :D | 11:46 |
| quiquell | argg we need the fedora28 containers too :-/ | 11:46 |
| ykarel | promoion job should build those | 11:47 |
| quiquell | ykarel: yes but the job is not in place | 11:47 |
| ykarel | :( why | 11:47 |
| quiquell | we are into it :-/ | 11:47 |
| ykarel | quiquell, i would be good to start with jobs checklist when planning | 11:48 |
| ykarel | so nothing is missed | 11:48 |
| *** jtomasek has joined #oooq | 11:51 | |
| quiquell | ykarel: f28 stein build containers job https://review.rdoproject.org/r/#/c/19811/1/zuul.d/tripleoci.yaml | 11:52 |
| quiquell | ykarel: is config we need to merge it | 11:52 |
| ykarel | quiquell, nodeset seems wrong | 11:54 |
| ykarel | should be single-upstream-fedora-28-node | 11:54 |
| quiquell | ye | 11:54 |
| quiquell | ok, fixed | 11:55 |
| *** jpena is now known as jpena|lunch | 11:56 | |
| weshay_pto | morning everyone :) | 11:59 |
| *** weshay_pto is now known as weshay | 11:59 | |
| weshay | we are well ahead of schedule I see, nice work http://rhos-release.virt.bos.redhat.com:3030/rhosp | 11:59 |
| weshay | marios_|ruck sshnaidm|rover anything I can help you with? | 12:00 |
| weshay | ha.. board is changing as I'm watching it | 12:00 |
| *** jtomasek has quit IRC | 12:00 | |
| quiquell | weshay: welcome back | 12:00 |
| weshay | hello married man | 12:00 |
| quiquell | I am super senior now | 12:01 |
| weshay | lol | 12:01 |
| *** holser_ is now known as holser|lunch | 12:01 | |
| quiquell | ykarel: I have also add the periodic-tripleo-centos-7-stein-promote-consistent-to-tripleo-ci-testing there | 12:03 |
| quiquell | ykarel: https://review.rdoproject.org/r/19811 | 12:03 |
| marios_|ruck | weshay: o/ welcome back | 12:03 |
| sshnaidm|rover | weshay, I think we got it all covered | 12:03 |
| marios_|ruck | weshay: we should be ok ish now | 12:04 |
| marios_|ruck | weshay: see status in https://etherpad.openstack.org/p/ruckroversprint7 | 12:04 |
| ykarel | quiquell, is that last, now i doubt others jobs might also be missed | 12:04 |
| quiquell | ykarel: I think so | 12:05 |
| ykarel | codesearch.rdoproject down | 12:05 |
| ykarel | came up now | 12:06 |
| marios_|ruck | weshay: one thing is the scripts that normally file the prod chain cards seem to be mia i've been filing them manually | 12:06 |
| quiquell | ykarel: you can se the jobs we have for stein running here https://review.rdoproject.org/r/#/c/19809/ | 12:07 |
| marios_|ruck | weshay: i wanted to catchup with you about that i was told they're "weshay scripts" don't know where/what etc | 12:07 |
| ykarel | quiquell, i see already a patch for container job:- https://review.rdoproject.org/r/#/c/19405/14/zuul.d/tripleoci.yaml | 12:08 |
| ykarel | looks like something went out of sync | 12:08 |
| quiquell | ykarel: damn we have a chicking egg thing | 12:08 |
| quiquell | ykarel: to run periodics we need this https://review.openstack.org/#/c/647419/ | 12:08 |
| quiquell | ykarel: but this is not going to merge since we just have the containers at RDO registry | 12:09 |
| weshay | ah marios_|ruck sorry.. I'll check it | 12:09 |
| weshay | maybe move it | 12:09 |
| quiquell | ykarel: periodics fails at stein like this http://logs.rdoproject.org/09/19809/4/check/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset010-stein/4bf8219/job-output.txt.gz | 12:09 |
| rfolco | quiquell, can you update me on stein containers pls? | 12:09 |
| quiquell | rfolco: blue ? | 12:09 |
| weshay | marios_|ruck did master and rocky really promote? | 12:09 |
| rfolco | quiquell, sure | 12:09 |
| quiquell | rfolco: going to yours | 12:10 |
| marios_|ruck | weshay: oh .. master must have _just_ happened a little while ago and rocky yeah apparently. its the first promotion with the new -push job for the containers | 12:10 |
| marios_|ruck | weshay: but what you mean like did i check promoter logs? no | 12:10 |
| marios_|ruck | should i? | 12:10 |
| *** trown|outtypewww is now known as trown | 12:11 | |
| ykarel | quiquell, didn't get the cannot merge part | 12:11 |
| ykarel | and how related to containers at RDO registry | 12:11 |
| quiquell | ykarel: ahh brain fart, they are non-voting is the linting the one tha fails | 12:11 |
| quiquell | ykarel: nah we are ok | 12:11 |
| ykarel | ack | 12:12 |
| weshay | marios_|ruck meh.. promoter logs look ok | 12:12 |
| marios_|ruck | weshay: you just being cautious or are you suspicious for some particular reason | 12:12 |
| weshay | the board was all crazy when I logged in | 12:12 |
| weshay | http://rhos-release.virt.bos.redhat.com:3030/rhosp | 12:12 |
| weshay | consistent was 1000 days | 12:13 |
| weshay | on all releases | 12:13 |
| marios_|ruck | weshay: yeah so especially the rocky we were waitin for many days... master last promoted 23rd well you did that one | 12:13 |
| weshay | aye | 12:13 |
| weshay | and cockpit hasn't registered the promotion http://dashboard-ci.tripleo.org/d/cEEjGFFmz/cockpit?orgId=1&panelId=110&fullscreen | 12:13 |
| weshay | so was just double checking | 12:14 |
| marios_|ruck | weshay: no i thnk it has a problem grafana cc sshnaidm|rover he is aware already | 12:14 |
| sshnaidm|rover | marios_|ruck, weshay yeah, will look today | 12:14 |
| weshay | https://review.rdoproject.org/zuul/builds?pipeline=openstack-periodic | 12:14 |
| weshay | looks good | 12:14 |
| quiquell | rfolco: so override-checkout was not right | 12:19 |
| rfolco | quiquell, hmm, but we don't have stein branch yet | 12:19 |
| quiquell | rfolco: well at tripleo projects | 12:19 |
| quiquell | rfolco: other projects have it | 12:19 |
| quiquell | rfolco: but it will fallback to master in case it does not exists | 12:20 |
| weshay | marios_|ruck sshnaidm|rover the bugs tagged as promotion blocker must have a target milestone set to get escalated by my script | 12:20 |
| quiquell | rfolco: so no problem using override-checkout: stable/stein | 12:20 |
| marios_|ruck | weshay: ah ok yeah i probably wasnt setting that | 12:20 |
| rfolco | quiquell, ok, so you ran the testproject patch, built the containers and it pushed ? | 12:20 |
| quiquell | rfolco: yep | 12:20 |
| quiquell | rfolco: at RDO registry | 12:20 |
| rfolco | from tripleo-cuurrent...? | 12:21 |
| rfolco | now we need from tripleo-ci-testing ? | 12:21 |
| quiquell | rfolco: now the plan is to put in place testing jobs to test them before doing a manual promotion | 12:21 |
| sshnaidm|rover | marios_|ruck, I removed prom-blocker from https://bugs.launchpad.net/tripleo/+bug/1821690 | 12:21 |
| openstack | Launchpad bug 1821690 in tripleo "periodic-ovb-1ctlr_1comp-featureset020-master fails tempest test_auto_allocate_network tempest.api.compute.images.test_images" [High,Triaged] - Assigned to Arx Cruz (arxcruz) | 12:21 |
| sshnaidm|rover | marios_|ruck, we have these tests skipped already | 12:21 |
| rfolco | quiquell, why need a manual promotion? | 12:21 |
| quiquell | rfolco: that's not needed I have manully promote to tripleo-ci-testing with dlrnapi cmd | 12:21 |
| quiquell | rfolco: but good to have the job though | 12:21 |
| weshay | marios_|ruck sshnaidm|rover thanks for keeping the lights on at the shop :) we're approaching a green board again | 12:21 |
| marios_|ruck | sshnaidm|rover: k | 12:21 |
| quiquell | rfolco: we can put in place the promoter stein.ini and all | 12:22 |
| quiquell | rfolco: but if all the jobs are ok we can manually promote too | 12:22 |
| rfolco | quiquell, all this work I have already done in the other tasks | 12:22 |
| sshnaidm|rover | weshay, it should be green already, we have master promoted right now | 12:22 |
| weshay | sshnaidm|rover ya.. but rdo phase 1 is running master atm | 12:22 |
| sshnaidm|rover | weshay, yeah, triggered it | 12:22 |
| *** ratailor has quit IRC | 12:22 | |
| rfolco | quiquell, by manual... what do you need ? | 12:23 |
| sshnaidm|rover | marios_|ruck, can you revote please? https://review.openstack.org/#/c/647719/ | 12:23 |
| quiquell | rfolco: there is a manual script to push containers | 12:23 |
| quiquell | rfolco: at ci-config | 12:23 |
| quiquell | rfolco: so about jobs I have merge your review https://review.rdoproject.org/r/#/c/19451/ | 12:24 |
| quiquell | rfolco: so we have most of the periodic jobs for stein | 12:24 |
| quiquell | rfolco: then I realize the standalone jobs were missing | 12:24 |
| quiquell | rfolco: didn't found a review with them so I created one | 12:24 |
| weshay | rfolco oh ya.. did we get stein containers pushed since I've been gone | 12:25 |
| quiquell | rfolco: periodic standalone jobs -> https://review.rdoproject.org/r/#/c/19810/ | 12:25 |
| marios_|ruck | sshnaidm|rover: yes looking | 12:26 |
| rfolco | weshay, yes, we did it w/ testproject... just trying to understand why we need a manual promotion w/ quiquell | 12:26 |
| quiquell | rfolco: to emulate consistent-to-tripleo-ci-testing job | 12:27 |
| weshay | testproject? | 12:27 |
| weshay | oh | 12:27 |
| quiquell | weshay: containers need to be build | 12:27 |
| rfolco | weshay, created a stein build containers job and pushed it to rdo registry w/ the job in check on testproject | 12:27 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo- (3 more messages) | 12:28 |
| rfolco | quiquell, dammn the patch you merged had standalone in commit msg... did I forget them? | 12:28 |
| weshay | rfolco k.. we still want docker.io populated though https://hub.docker.com/u/tripleostein | 12:28 |
| weshay | so we can poke at upstream jobs as well | 12:28 |
| quiquell | rfolco: I forgot to check too :-( they were a copy from rocky but there is no standalone from rocky | 12:28 |
| quiquell | rfolco: just realized after meger, quick trigger I have | 12:29 |
| rfolco | quiquell, ok good thanks for doing it | 12:29 |
| quiquell | weshay: RDO registry | 12:29 |
| quiquell | weshay: ykarel told us that better run periodic stein jobs to ensure the containers are ok and then promote the containers | 12:29 |
| weshay | quiquell ykarel there are no stein jobs yet upstream.. pushing upstream is harmless | 12:30 |
| quiquell | rfolco: no problem just helping with the stein thing | 12:30 |
| weshay | get the containers in docker.io please | 12:30 |
| quiquell | weshay: ok will do then | 12:30 |
| quiquell | sshnaidm|rover, ykarel: ^ | 12:30 |
| weshay | quiquell I am not suggesting we are " " promoting stein | 12:30 |
| weshay | we are prepping | 12:30 |
| ykarel | weshay, if there are no stein jobs, what will use those containers? | 12:31 |
| weshay | ykarel a test job :P | 12:31 |
| ykarel | :) | 12:31 |
| quiquell | rfolco: want a tmate with manual push ? | 12:31 |
| rfolco | quiquell, yes please | 12:31 |
| weshay | zbr I'm in | 12:31 |
| weshay | quiquell what hash? | 12:31 |
| sshnaidm|rover | weshay, please take a look https://review.openstack.org/#/c/648103/ | 12:31 |
| weshay | make sure it's the known good stein hash | 12:32 |
| *** d0ugal has quit IRC | 12:32 | |
| quiquell | weshay: fbb797b891c6f2530b18ee904a93c35b9e7490c1_2c625b49 | 12:32 |
| quiquell | weshay: the one that was current-tripleo pointing there there were a link done at RDO repos | 12:33 |
| *** jtomasek has joined #oooq | 12:33 | |
| rfolco | quiquell, I'll rebase my reviews now... one of them have the promote to tripleo-ci-testing job.... so pls review my patches w/ topic oooq/branching | 12:33 |
| quiquell | rfolco: RDO ? | 12:33 |
| rfolco | quiquell, yes | 12:34 |
| quiquell | ack | 12:34 |
| rfolco | config | 12:34 |
| weshay | quiquell correct +2 | 12:34 |
| quiquell | Let me check I am not duplicating stuff | 12:34 |
| ykarel | weshay, quiquell, overcloud images should also be needed for upstream, in fact stein release file needed for anything to work | 12:34 |
| rfolco | quiquell, how do we know this is good hash ? | 12:34 |
| ykarel | for ovb upstream jobs, b | 12:34 |
| quiquell | ykarel: I think weshay uploaded the images | 12:34 |
| ykarel | okk | 12:35 |
| weshay | rfolco we know :) | 12:35 |
| weshay | rfolco try it :) | 12:35 |
| quiquell | rfolco: https://trunk.rdoproject.org/centos7-stein/current-tripleo/delorean.repo | 12:35 |
| quiquell | rfolco: RDO guys created the currrent-tripleo link to the latest consistent at the momoent | 12:35 |
| *** rlandy has joined #oooq | 12:36 | |
| quiquell | rfolco: ok done | 12:38 |
| rfolco | quiquell, ok is there a chance the latest consistent hash not to be good ? | 12:39 |
| quiquell | rfolco: sure it is, that's why ykarel and sshnaidm|rover want to run the RDO periodic jobs | 12:39 |
| quiquell | rfolco: but we are not going to break anything since there is no one using stein containers yet | 12:40 |
| quiquell | weshay: is that right ? although Alex asked for them | 12:40 |
| *** d0ugal has joined #oooq | 12:42 | |
| rfolco | quiquell, created https://tree.taiga.io/project/tripleo-ci-board/task/924 for the manual push | 12:42 |
| quiquell | rfolco: ack | 12:43 |
| quiquell | rfolco: I am going to merge this https://review.rdoproject.org/r/#/c/19811/ | 12:43 |
| rfolco | quiquell, I had another patch for this | 12:44 |
| rfolco | It was under Ready-For-Review since 2nd day of sprint | 12:44 |
| rfolco | :( | 12:44 |
| quiquell | rfolco: ack, let's just use yours | 12:45 |
| quiquell | rfolco: Let me comment on them | 12:45 |
| rfolco | quiquell, nah you get 2+ on this | 12:45 |
| rfolco | quiquell, go with yours I rebase mine | 12:45 |
| quiquell | rfolco: ok will merge | 12:45 |
| rfolco | quiquell, ok | 12:45 |
| quiquell | rfolco: do you have for the consistent-to-tripleo-ci-testing ? | 12:45 |
| *** jtomasek has quit IRC | 12:46 | |
| *** zul has joined #oooq | 12:46 | |
| quiquell | rfolco: we will have to do another testproject run for the f28 stuff | 12:47 |
| quiquell | rfolco: I mean f28 containers | 12:47 |
| rfolco | quiquell, maybe I lost the consistent jobs in one of my 200 rebases I had during the past week | 12:49 |
| rfolco | quiquell, go with yours and I rebase all my patches again | 12:49 |
| rfolco | quiquell, I can help with f28 containers | 12:49 |
| *** udesale has joined #oooq | 12:50 | |
| quiquell | rfolco: ok f28 containers job and consistent-tripleo-ci-testing merged | 12:50 |
| quiquell | rfolco: merging standalone jobs now | 12:50 |
| *** aakarsh has quit IRC | 12:51 | |
| quiquell | rfolco: standalone jobs merged too | 12:52 |
| quiquell | rfolco: you can rebase now | 12:53 |
| quiquell | rfolco: btw I am testing the jobs here https://review.rdoproject.org/r/#/c/19809/ | 12:53 |
| rfolco | quiquell, thanks, will rebase. Can I prepapre f28 testproject one ? | 12:53 |
| quiquell | rfolco: yep | 12:53 |
| quiquell | rfolco: we have to manually promote tripleo-ci-testing though | 12:54 |
| quiquell | rfolco: before running containers-build-push | 12:54 |
| quiquell | rfolco: on f28 | 12:54 |
| rfolco | k | 12:54 |
| quiquell | rfolco: well the job is ther now maybe we can put an small pipeline at your testproject review | 12:54 |
| quiquell | rfolco: so the job promote consistent and then call containers-build-push | 12:54 |
| rfolco | quiquell, yes I was wondering why still need a manual one | 12:55 |
| quiquell | rfolco: there where no consistent-to-tripleo-ci-testing job | 12:55 |
| quiquell | rfolco: but now there are, just call it at the testproject review | 12:55 |
| quiquell | rfolco: and add a dependency to it | 12:55 |
| quiquell | rfolco: like the pipelines | 12:56 |
| rfolco | quiquell, ok | 12:56 |
| quiquell | rfolco: we are near to have the pipeline, going to review your work now | 12:57 |
| rfolco | quiquell, need a rebase, hold one | 12:57 |
| rfolco | on | 12:57 |
| quiquell | ahh that's right | 12:58 |
| quiquell | rfolco: we will need this https://tree.taiga.io/project/tripleo-ci-board/task/537?kanban-status=1447276 | 13:01 |
| quiquell | rfolco: to push f28 containers to docker hub | 13:02 |
| rfolco | quiquell, ok will check in a bit, how far we are from merging? | 13:02 |
| quiquell | rfolco: the reviews at that taiga task ? | 13:03 |
| quiquell | rfolco: don't know | 13:03 |
| rfolco | quiquell, yes panda's review | 13:03 |
| quiquell | rfolco: first time I see this | 13:03 |
| quiquell | rfolco: he sais it was tested though | 13:03 |
| kopecmartin | arxcruz, what am i supposed to do with this? https://bugs.launchpad.net/tripleo/+bug/1822080 | 13:04 |
| openstack | Launchpad bug 1822080 in tripleo "periodic centos-7-ovb-1ctlr_1comp-featureset020-queens failing tempest "Endpoint not found"" [Critical,Triaged] - Assigned to Martin Kopec (mkopec) | 13:04 |
| quiquell | rlandy: do you know the state of this ? https://review.rdoproject.org/r/#/c/19335/ | 13:05 |
| quiquell | marios_|ruck: ^ ¿ | 13:05 |
| quiquell | ? | 13:05 |
| rlandy | quiquell: not since I last reviewed that for panda | 13:06 |
| marios_|ruck | quiquell: same ^ looksl ike it didn't get any attention | 13:06 |
| *** jtomasek has joined #oooq | 13:06 | |
| quiquell | ack | 13:06 |
| *** jtomasek has quit IRC | 13:08 | |
| *** vinaykns has joined #oooq | 13:09 | |
| arxcruz | kopecmartin: fix it :D | 13:12 |
| arxcruz | kopecmartin: the failure is on tempestconf some endpoint on queens | 13:12 |
| quiquell | rlandy: Have try to test sshnaidm|rover selinux fix at BM here https://code.engineering.redhat.com/gerrit/#/c/166438/ | 13:12 |
| kopecmartin | arxcruz, no clue how, it's a tripleo ci job which is failing, we don't know yet if there is a bug in tempestconf | 13:12 |
| quiquell | rlandy: is recheck working ? | 13:12 |
| *** jtomasek has joined #oooq | 13:12 | |
| rfolco | quiquell, https://review.rdoproject.org/r/#/q/status:open+project:config+branch:master+topic:oooq/branching | 13:14 |
| quiquell | rfolco: centos7 containers pushed to docker hub, but I see failed=1 :-/ | 13:14 |
| rlandy | quiquell: not sure what you mean by 'have to try' | 13:15 |
| rfolco | quiquell, maybe the same we put in --exclude for rocky last time ? | 13:15 |
| *** jpena|lunch is now known as jpena | 13:16 | |
| quiquell | rlandy: Was testing the review at BM there | 13:16 |
| quiquell | rlandy: have relaunch both BM jobs though | 13:16 |
| quiquell | rfolco: humm could be | 13:16 |
| rlandy | quiquell: so - it won;t make a diff because I modified the bm configs already | 13:16 |
| rlandy | though we can remove that modification to test this | 13:17 |
| rlandy | it will work though | 13:17 |
| quiquell | rlandy: so we don't need https://review.openstack.org/#/c/648353/ for BM ? | 13:17 |
| rlandy | quiquell: the master job won't get that far though | 13:17 |
| quiquell | rlandy: ack | 13:18 |
| *** amoralej is now known as amoralej|lunch | 13:18 | |
| rlandy | quiquell: we seem to have failed on getting the md5 | 13:18 |
| rlandy | I don;t know why yet | 13:18 |
| quiquell | rlandy: that was temporally | 13:18 |
| quiquell | rlandy: md5 was there | 13:18 |
| rlandy | quiquell: both master and rocky failed on that | 13:18 |
| quiquell | rlandy: well now that I think of | 13:19 |
| quiquell | rlandy: the -upload job runs after containres-build :-/ | 13:19 |
| quiquell | rlandy: maybe we have to monitor -upload job instead of containres-build ? | 13:19 |
| rlandy | quiquell: I want to discuss this at the meeting | 13:19 |
| quiquell | rlandy: ack | 13:19 |
| rlandy | ie: which images we should be using in general | 13:19 |
| rlandy | there is MAJOR confusion here | 13:20 |
| rlandy | quiquell: but ack - we would have to monitor the upload job | 13:20 |
| rlandy | if we want to use the same images as OVB | 13:20 |
| rlandy | which is probably required | 13:20 |
| quiquell | rlandy: well... now I don't know at the end periodics are not using those either | 13:20 |
| quiquell | rlandy: since -upload job runs in parallel with the others | 13:20 |
| rlandy | quiquell: can we depend on two jobs? | 13:21 |
| quiquell | rlandy: let's first as you say decide what images to use, then all if possible | 13:21 |
| rlandy | quiquell: or chain them | 13:21 |
| rlandy | run the check job for images only after container check passes | 13:21 |
| quiquell | rlandy: but wait | 13:22 |
| rlandy | quiquell: seriously - did nothing this sprint but run after master/rocky failures :( | 13:22 |
| quiquell | rlandy: that's huge thing though | 13:22 |
| * rlandy is still running | 13:22 | |
| rlandy | quiquell: let's hash this out at meeting | 13:22 |
| quiquell | ok lunch time | 13:22 |
| ykarel | rlandy, is the discussion related to the patch to use tripleo-ci-testing images for promotion jobs? | 13:23 |
| *** quiquell is now known as quiquell|lunch | 13:23 | |
| ykarel | i think i posted some comment | 13:23 |
| rlandy | ykarel: ack | 13:23 |
| * rlandy looks for comment | 13:23 | |
| *** derekh has quit IRC | 13:24 | |
| rlandy | ykarel: it seems we were using the tripleo-ci-testing images anyways in OVB jobs | 13:25 |
| ykarel | rlandy, yes because of ovb-rdocloud override | 13:25 |
| rlandy | but we should get this tag right for all jobs | 13:25 |
| ykarel | rlandy, use case? | 13:25 |
| rlandy | baremetal periodic | 13:25 |
| rlandy | uses a virt undercloud | 13:26 |
| ykarel | rlandy, baremetal periodic needs to reuse the images pushed by ovb periodic? | 13:27 |
| ykarel | or they build,push,use there own | 13:27 |
| rlandy | ykarel: no they do not build images | 13:27 |
| ykarel | rlandy, 002-upload job runs there? | 13:28 |
| ykarel | ^^ job builds,pushes images | 13:28 |
| rlandy | ykarel: the plan is to trigger baremetal jobs from the same pipeline - but there is only one upload job | 13:28 |
| rlandy | 002 | 13:28 |
| rlandy | that is not duplicated | 13:29 |
| rlandy | ykarel: I am bringing https://review.openstack.org/#/c/648170/ to discuss at meeting today ( feel free to join) as we nee to be clear on this order | 13:30 |
| rlandy | what images are used where and what dependencies we want | 13:30 |
| ykarel | rlandy, ack will see if i can attend | 13:30 |
| ykarel | btw what time | 13:30 |
| rlandy | ykarel: the original instruction I was given was to match baremetal to OVB as closely as possible | 13:30 |
| rlandy | 2pm UTC | 13:31 |
| rlandy | in 30 mins | 13:31 |
| marios_|ruck | arxcruz: chandankumar kopecmartin for https://bugs.launchpad.net/tripleo/+bug/1822080 any ideas? been staring at the error trying to make sense of it http://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-queens/7cba8f8/logs/undercloud/home/zuul/tempest.log.txt.gz - so tempest tries to discover the service endpoints? and it can'tfind o | 13:31 |
| openstack | Launchpad bug 1822080 in tripleo "periodic centos-7-ovb-1ctlr_1comp-featureset020-queens failing tempest "Endpoint not found"" [Critical,Triaged] - Assigned to Martin Kopec (mkopec) | 13:31 |
| ykarel | rlandy, ack | 13:31 |
| kopecmartin | marios_|ruck, maybe recent change in tempest? what tempest does it use? it's not master one | 13:33 |
| marios_|ruck | kopecmartin: this is a queens job | 13:34 |
| marios_|ruck | kopecmartin: is that bit relevant {u'endpoints': [], u'type': u'metering', u'id': u'3a36d5e0ea564a21a74d7998f8b5c21e', u'name': u'ceilometer'} i.e. empty endpoint for ceilo? | 13:34 |
| marios_|ruck | kopecmartin: (me staring at http://logs.rdoproject.org/openstack-periodic-24hr/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-queens/7cba8f8/logs/undercloud/home/zuul/tempest.log.txt.gz ) | 13:34 |
| *** Vorrtex has joined #oooq | 13:36 | |
| kopecmartin | marios_|ruck, no, it's related to cinder, not ceilometer, python-tempestconf fails when it's trying to discover if cinder-backup service is on , that's all i can say from the logs | 13:38 |
| *** udesale has quit IRC | 13:41 | |
| marios_|ruck | kopecmartin: ok can i ask you write a comment ont he bug please thats more than i was able to get from them :D i mean even if its obvious for you | 13:41 |
| marios_|ruck | kopecmartin: it is helpful that we can start narrowing it thanks | 13:41 |
| *** udesale has joined #oooq | 13:41 | |
| *** holser|lunch is now known as holser_ | 13:45 | |
| marios_|ruck | kopecmartin: i pasted our chat anyway for now | 13:47 |
| rlandy | quiquell|lunch: ugh - and we still need https://review.openstack.org/#/c/647947/ | 13:53 |
| ykarel | marios_|ruck, seems queens job failing post https://review.openstack.org/#/c/644550/1 | 13:53 |
| rlandy | since my other fix for ntp restart was ditched | 13:54 |
| rlandy | master deploy will fail there otherwise | 13:54 |
| ykarel | marios_|ruck, 016,017 job failed in that patch, | 13:54 |
| ykarel | the patch merged 3 days ago, i think queens failing since then, so good to check | 13:55 |
| marios_|ruck | ykarel: nice thanks that sounds righ given kopecmartin comment about cinder | 13:55 |
| *** quiquell|lunch is now known as quiquell | 13:57 | |
| quiquell | rlandy: so we need a promotion to have that | 13:58 |
| rlandy | quiquell: right | 13:58 |
| rlandy | depends-on? | 13:58 |
| rlandy | quiquell: or use my old patch | 13:59 |
| quiquell | rlandy: humm should work at check at least | 13:59 |
| rlandy | quiquell: yeah - there are a bunch of fixes flying around | 13:59 |
| rlandy | quiquell: also I increased the job time to match ovb | 13:59 |
| rlandy | so me don't timeout | 13:59 |
| rlandy | we | 13:59 |
| quiquell | rlandy: I see we have promotions at master maybe we are lucky | 14:00 |
| rfolco | ping scrum | 14:01 |
| rfolco | : marios, quiquell, sshnaidm, weshay, panda, rlandy, arxcruz, mwhahaha, rfolco, chkumar, ssbarnea, kopecmartin | 14:01 |
| *** derekh has joined #oooq | 14:04 | |
| quiquell | rlandy: chrony fix is at current | 14:06 |
| rlandy | quiquell: https://review.openstack.org/#/c/647947/ incurrebt - good | 14:06 |
| rlandy | current | 14:07 |
| rlandy | quiquell: k - so maybe we will get somewhere | 14:10 |
| *** jtomasek has quit IRC | 14:20 | |
| *** amoralej|lunch is now known as amoralej | 14:23 | |
| *** aakarsh has joined #oooq | 14:24 | |
| *** jtomasek has joined #oooq | 14:26 | |
| *** aakarsh|2 has joined #oooq | 14:26 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo- (3 more messages) | 14:28 |
| zbr | rlandy: sshnaidm|rover : i think we should help rfolco on https://review.rdoproject.org/r/#/c/19572/ -- LGTM | 14:30 |
| *** aakarsh has quit IRC | 14:30 | |
| sshnaidm|rover | zbr, please mute | 15:03 |
| rlandy | quiquell: going to add image build to bm | 15:04 |
| zbr | rfolco: one question on https://review.rdoproject.org/r/#/c/19572/12/zuul.d/tripleoci.yaml | 15:05 |
| rfolco | zbr, tripleo-ci-testing is what we want, isn't it ? I don't get the point | 15:08 |
| rfolco | quiquell, ^ | 15:08 |
| rlandy | rfolco: https://review.rdoproject.org/r/#/c/19406/ needs rebase and marios has -1 | 15:08 |
| quiquell | rlandy: ack | 15:08 |
| rfolco | rlandy, marios -1 was for the rebase which I did | 15:09 |
| quiquell | rlandy: I suppose is just a mater of parenting the right thing | 15:09 |
| quiquell | rfolco: what do you mean ? | 15:09 |
| rlandy | quiquell: no - need to add call build role | 15:09 |
| rlandy | like ovb | 15:09 |
| rfolco | quiquell, zbr question on https://review.rdoproject.org/r/#/c/19572/12/zuul.d/tripleoci.yaml | 15:09 |
| rlandy | rfolco: pls rebase and I'll merge | 15:10 |
| rfolco | quiquell, tripleo-ci-testing is required there | 15:10 |
| rlandy | pike stays? | 15:10 |
| rlandy | rfolco: ^^? | 15:10 |
| *** hamzy has quit IRC | 15:10 | |
| quiquell | rlandy: why are we adding push_tag ? it was not ther e | 15:10 |
| rfolco | rlandy, wes told no touch on pike jobs last time | 15:10 |
| quiquell | rfolco: the only thing that we push is the hash | 15:10 |
| quiquell | rfolco: we are not tagging containers | 15:11 |
| rfolco | dammn I see | 15:11 |
| rfolco | zbr, quiquell sorry I'll remove it | 15:11 |
| quiquell | rfolco: no problem | 15:12 |
| quiquell | rfolco: I am trying to repush now | 15:12 |
| rfolco | this is probably a leftovers from 100 rebases this week | 15:12 |
| rfolco | quiquell, did you change anything ? | 15:12 |
| quiquell | rfolco: yep looks like, let's merge this stuff I am going to merge the stein.ini from promter | 15:12 |
| chandankumar | sshnaidm|rover: quiquell simple patch https://review.rdoproject.org/r/#/c/19355/ sitting from long time | 15:13 |
| quiquell | chandankumar: +w | 15:13 |
| chandankumar | quiquell: thanks! | 15:14 |
| rlandy | rfolco: https://review.rdoproject.org/r/#/c/19481/ merging this - will promote in cron | 15:14 |
| rlandy | ok? | 15:14 |
| marios_|ruck | rfolco: removing thanks | 15:14 |
| chandankumar | arxcruz: https://review.openstack.org/#/c/648373/ will I convert this DNM patch into a proper patch if it is ok? | 15:15 |
| rfolco | merge rain, merge rain!! | 15:15 |
| rfolco | my version of purple rain | 15:15 |
| quiquell | rfolco: address rlandy comment and I will merge https://review.rdoproject.org/r/#/c/19481/ | 15:16 |
| arxcruz | chandankumar: checking | 15:17 |
| rfolco | rlandy, quiquell so need to remove that block or not ? | 15:17 |
| quiquell | rfolco: we don't have phase2 anymore | 15:17 |
| rlandy | quiquell: rfolco: not a big deal | 15:17 |
| rlandy | I'll merge and put in a patch to remove that everywhere | 15:17 |
| chandankumar | arxcruz: it will replace tempest extra config part | 15:17 |
| rfolco | cool | 15:17 |
| arxcruz | chandankumar: no taiga ? | 15:17 |
| rfolco | thanks rlandy | 15:17 |
| chandankumar | arxcruz: na | 15:17 |
| quiquell | rfolco: then let's merge this | 15:17 |
| chandankumar | arxcruz: i have created one | 15:18 |
| quiquell | ok rlandy merged | 15:18 |
| ykarel | quiquell, wait | 15:18 |
| quiquell | ykarel: what | 15:18 |
| ykarel | seems that follow old config | 15:18 |
| ykarel | at first look atleast log file is old | 15:18 |
| chandankumar | arxcruz: https://tree.taiga.io/project/tripleo-ci-board/task/925 | 15:18 |
| ykarel | didn't looked much yet | 15:18 |
| arxcruz | chandankumar: is this related to --profile ? | 15:18 |
| sshnaidm|rover | arxcruz, we need to fix it: https://github.com/rdo-infra/rdo-jobs/commit/0500a6efe10d863ec995e34eb823f1d36c8fe745 | 15:18 |
| chandankumar | arxcruz: yes | 15:18 |
| quiquell | ykarel: we can fix it later | 15:18 |
| arxcruz | chandankumar: there's a card already created right ? | 15:18 |
| ykarel | quiquell, ok but take care | 15:19 |
| quiquell | ykarel: this is WIP, sure we will | 15:19 |
| quiquell | ykarel: thanks | 15:19 |
| sshnaidm|rover | arxcruz, 020 master job is duplicate of 020, also no need to set "release" in any of those jobs, it's for periodic only | 15:19 |
| *** jtomasek has quit IRC | 15:19 | |
| chandankumar | arxcruz: you mean this one https://tree.taiga.io/project/tripleo-ci-board/task/902 ? | 15:19 |
| arxcruz | chandankumar: https://tree.taiga.io/project/tripleo-ci-board/task/902?kanban-status=1447274 | 15:19 |
| arxcruz | chandankumar: yes | 15:19 |
| chandankumar | arxcruz: so we have two reviews one on os_tempest and another on tripleo-ci | 15:20 |
| *** jtomasek has joined #oooq | 15:20 | |
| chandankumar | I will close first card with os_tempest review and reuse the second one fro triple ci? | 15:20 |
| arxcruz | chandankumar: i don't know | 15:20 |
| arxcruz | sshnaidm|rover: when i wrote it panda told me i had to | 15:20 |
| chandankumar | arxcruz: I will deal with that tomorrow | 15:21 |
| rfolco | quiquell, zbr rlandy sshnaidm|rover marios_|ruck: updated/rebased all 4 patches on config: https://review.rdoproject.org/r/#/q/status:open+project:config+branch:master+topic:oooq/branching | 15:21 |
| arxcruz | sshnaidm|rover: sorry, he told me to use the branch-override, the release one i just follow the other job | 15:21 |
| arxcruz | sshnaidm|rover: i'll fix it | 15:21 |
| rlandy | rfolco: pls see zuul error on https://review.rdoproject.org/r/#/c/19406/ | 15:21 |
| rlandy | https://review.rdoproject.org/r/#/c/19405/17/zuul.d/tripleoci.yaml | 15:22 |
| rlandy | ^^ complaining about that line | 15:22 |
| rlandy | rfolco: rebase on master | 15:23 |
| zbr | rfolco: please avoid duplication on https://review.rdoproject.org/r/#/c/19572/ (1st in queue) see comment. | 15:24 |
| zbr | rfolco: sshnaidm|rover remarked it and I fully agree with him, no need to duplicate all these options. | 15:25 |
| rfolco | zbr, that's the intent, I create a totally new job w/ duplication without -master | 15:25 |
| rfolco | zbr, in the following patch I just reparent and remove duplication | 15:25 |
| rfolco | zbr, sshnaidm|rover suggested me to do this way, in small steps, first define the new job, then reparent and removed dups | 15:26 |
| rlandy | quiquell: still failing :( ... https://sf.hosted.upshift.rdu2.redhat.com/logs/38/166438/2/check/periodic-tripleo-ci-centos-7-bm_envD-3ctlr_1comp-featureset001-master/e69cea4/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 15:26 |
| sshnaidm|rover | rfolco, ok, fine with me | 15:27 |
| rlandy | will look at it after I add job build | 15:27 |
| quiquell | rfolco: re pulling/pushing containers from different machine | 15:27 |
| sshnaidm|rover | rfolco, actually you can even test them when definitions are merged | 15:27 |
| quiquell | rlandy: is different error | 15:28 |
| rfolco | doing it atomically would be less safe yes | 15:28 |
| zbr | rfolco: i do not want to slow you down, but find hard to deal with so some many layers. i find hard to support introduction of bug and fixing it later when it can be avoided in the first place :D | 15:28 |
| rfolco | there is no bug introduced here | 15:29 |
| *** ykarel is now known as ykarel|away | 15:29 | |
| rfolco | config dup is temporary until next patch, on same topic | 15:29 |
| quiquell | rlandy: looks like error running haproxy_bundle docker image | 15:29 |
| rlandy | quiquell: will have to compare with that running in OVB | 15:31 |
| rlandy | quiquell: I'll work on it - I know you have other tasks | 15:31 |
| quiquell | rlandy: ack | 15:32 |
| quiquell | rlandy: at least is beyond the other issue with images | 15:32 |
| sshnaidm|rover | zbr, we define new job, test it, remove dup - this is the safe workflow | 15:32 |
| quiquell | zbr: stein release file merged | 15:33 |
| *** hamzy has joined #oooq | 15:35 | |
| quiquell | rfolco: commented https://review.rdoproject.org/r/#/c/19405/ | 15:36 |
| *** aakarsh|2 is now known as aakarsh | 15:37 | |
| *** quiquell is now known as quiquell|off | 15:37 | |
| rfolco | rlandy, quiquell|off sshnaidm|rover zbr: so now https://review.rdoproject.org/r/#/c/19406/ (moce rocky to 24h pipeline) is rebased on master and can be merged | 15:42 |
| rfolco | please review... working on the other patches | 15:42 |
| rlandy | rfolco: ack - merging | 15:42 |
| *** ykarel|away has quit IRC | 15:43 | |
| chandankumar | arxcruz: can we get a doc patch also for this review https://review.openstack.org/#/c/648110/3 | 15:46 |
| chandankumar | ? | 15:46 |
| chandankumar | in tripleo-docs | 15:46 |
| rlandy | weshay: pls vote ... required for rhos-14 job https://review.openstack.org/#/c/648238/ | 15:50 |
| sshnaidm|rover | chandankumar, arxcruz what is this repo for? https://github.com/openstack/ansible-role-tripleo-tempest | 15:52 |
| chandankumar | sshnaidm|rover: no idea, someone created bunch of repo with reponame ansible-role-tripleo | 15:53 |
| chandankumar | which are not consumed | 15:53 |
| sshnaidm|rover | chandankumar, yeah, interesting.. | 15:53 |
| chandankumar | anywhere | 15:53 |
| chandankumar | we have ansible-role-k8s I think also | 15:53 |
| chandankumar | in openstack namespace | 15:53 |
| chandankumar | https://github.com/openstack/?utf8=%E2%9C%93&q=ansible-role-k8s&type=&language= | 15:54 |
| arxcruz | sshnaidm|rover: chandankumar i just notice today these repos... | 16:00 |
| *** udesale has quit IRC | 16:01 | |
| chandankumar | arxcruz: sshnaidm|rover I think we need to check with Alex & weshay in order to what to do with these repos and how to avoid in future | 16:01 |
| *** jbadiapa has quit IRC | 16:02 | |
| marios_|ruck | kopecmartin: do you know someone we can point to for https://bugs.launchpad.net/tripleo/+bug/1822080 from tempestconf side. Looking at the patch https://review.openstack.org/#/c/644550/1/puppet/services/cinder-api.yaml looks like the error is kinda right... the endpoint is still being setup but no configured (so the service is still in the catalog) but not sure yet | 16:03 |
| openstack | Launchpad bug 1822080 in tripleo "periodic centos-7-ovb-1ctlr_1comp-featureset020-queens failing tempest "Endpoint not found"" [Critical,Triaged] - Assigned to Martin Kopec (mkopec) | 16:03 |
| marios_|ruck | kopecmartin: no actually it isn't there anymore ignore that. they replace v1 with v3. i was confused by alan commit message ("It is the user's responsibility for removing them. " existing v1 entries) | 16:04 |
| marios_|ruck | kopecmartin: so still question stands why it explodes | 16:04 |
| kopecmartin | marios_|ruck, why the patch makes cinder not to configure the endpoint? cinder::keystone::auth::configure_endpoint: false | 16:05 |
| kopecmartin | oh | 16:06 |
| kopecmartin | let me read the commit message first | 16:06 |
| marios_|ruck | kopecmartin: ah so it is v1 ... like they keep it there, set it to v3 things (name) and not configure it | 16:06 |
| marios_|ruck | kopecmartin: they used to have CinderPublic, CinderV2Public CInderV3Public. | 16:07 |
| marios_|ruck | kopecmartin: now only have V2 and v3 | 16:07 |
| *** holser_ has quit IRC | 16:09 | |
| chandankumar | see ya tomorrow guys | 16:12 |
| *** chandankumar is now known as raukadah | 16:13 | |
| *** jtomasek has quit IRC | 16:13 | |
| kopecmartin | marios_|ruck, I'm not a puppet master, but "cinder::keystone::auth::configure_endpoint: false" doesn't mention any "v1" ... it more seems that it disables all endpoints (v1,v2,v3) and that's strange | 16:15 |
| marios_|ruck | kopecmartin: i think that#s specific to the v1 (the others have their own url ) well i don't know what the configure_endpoint does w/out looking at that module, but from the commit message it seems that they use that to suppress v1 | 16:17 |
| marios_|ruck | kopecmartin: i am looking in the logs at that bit {u'url': u'http://192.168.24.23:8776/v3/5553fc5af6cf45c094b522ea43d19acd', u'interface': u'internal', u'region': u'regionOne', u'region_id': u'regionOne', u'id': u'f46cc8de58044525bdd9d1328ad7f135'}], u'type': u'volumev3', u'id': u'afe393ef8e8d4eb68b178650525dfd2c', u'name': u'cinderv3'} | 16:17 |
| marios_|ruck | kopecmartin: its the bit generated by that volumev3 etc https://review.openstack.org/#/c/644550/1/puppet/services/cinder-api.yaml | 16:18 |
| rfolco | zbr, sshnaidm|rover rlandy weshay marios_|ruck please review https://review.rdoproject.org/r/#/q/status:open+project:config+branch:master+topic:oooq/branching - the order is: 19572 -> 19573 -> 19405 | 16:18 |
| rfolco | lunch brb | 16:18 |
| marios_|ruck | rfolco: ack added for tomorrow reviews | 16:18 |
| marios_|ruck | kopecmartin: ok i'll try ping alan bishop to check for now anyway | 16:19 |
| kopecmartin | marios_|ruck, please do, tempest is complaining about a missing endpoint and they turned off one .. that's pretty weird coincidence | 16:21 |
| marios_|ruck | kopecmartin: https://review.openstack.org/#/c/636456/3/manifests/keystone/auth.pp | 16:21 |
| marios_|ruck | kopecmartin: the configure_endpoint thing is v1 specific looks like (line 42 there) fyi | 16:21 |
| marios_|ruck | kopecmartin: ack will do | 16:21 |
| marios_|ruck | kopecmartin: oh yeah , i mean i'm pretty sure its to do with this patch. i am just not sure if it is now a tempest bug or if we are doing somethign weird | 16:21 |
| zbr | weshay: should I abandon https://review.rdoproject.org/r/#/c/19155/ ? | 16:23 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo- (3 more messages) | 16:28 |
| sshnaidm|rover | rlandy, seems like https://review.openstack.org/#/c/648353/ doesn't help | 16:34 |
| sshnaidm|rover | rlandy, however I see it sets selinux to permissive: http://logs.rdoproject.org/53/648353/2/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/92b5bc1/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 16:35 |
| sshnaidm|rover | Tengu, ^^ | 16:35 |
| rlandy | sshnaidm|rover: looking at errors | 16:35 |
| rlandy | tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053 passes | 16:35 |
| sshnaidm|rover | "state": "permissive" | 16:36 |
| rlandy | error: Could not connect to cluster (is it running?)", | 16:36 |
| sshnaidm|rover | yeah | 16:37 |
| sshnaidm|rover | rlandy, weird, because with your patch it worked.. | 16:37 |
| sshnaidm|rover | Tengu, rlandy is something wrong here? http://logs.rdoproject.org/53/648353/2/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/92b5bc1/logs/undercloud/home/zuul/overcloud-selinux-config.yaml.txt.gz | 16:38 |
| rlandy | sshnaidm|rover: sec - let me look through this carefully | 16:39 |
| rlandy | sshnaidm|rover: usually two spaces not four https://logs.rdoproject.org/53/648353/2/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/92b5bc1/logs/undercloud/home/zuul/overcloud-selinux-config.yaml.txt.gz | 16:39 |
| rlandy | not sure if that makes a diff | 16:39 |
| sshnaidm|rover | rlandy, yeah, but let's try | 16:40 |
| rlandy | https://review.openstack.org/#/c/648195/1/test-environments/worker-config.yaml | 16:40 |
| rlandy | compare | 16:40 |
| rlandy | sshnaidm|rover: no my patch still had one error: https://logs.rdoproject.org/95/648195/1/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/491d839/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2019-03-27_20_30_04 | 16:41 |
| rlandy | 035 worked here | 16:41 |
| *** bogdando has quit IRC | 16:41 | |
| rlandy | but 001 still failed | 16:41 |
| rlandy | https://review.openstack.org/#/c/648248/ | 16:42 |
| rlandy | that got a clean pass | 16:42 |
| rlandy | sshnaidm|rover: maybe it's random | 16:43 |
| rlandy | or inconsistent at best | 16:43 |
| sshnaidm|rover | rlandy, maybe it's part of problem | 16:44 |
| rlandy | sshnaidm|rover: well we set the state but maybe we restart and it changes? | 16:45 |
| sshnaidm|rover | rlandy, hmm, maybe even vice versa - we change config, but not setting it.. | 16:48 |
| sshnaidm|rover | rlandy, how can we know the state? | 16:48 |
| rlandy | sshnaidm|rover: on bm - yo can get on the box and test it | 16:48 |
| rlandy | for ovb - reproducer? | 16:48 |
| rlandy | sshnaidm|rover: we have a bm env with your change | 16:49 |
| rlandy | getting | 16:49 |
| *** jtomasek has joined #oooq | 16:49 | |
| rlandy | https://code.engineering.redhat.com/gerrit/#/c/166438/ | 16:49 |
| rlandy | sshnaidm|rover: will tmate you in | 16:49 |
| sshnaidm|rover | rlandy, cool | 16:50 |
| *** skramaja has quit IRC | 16:51 | |
| marios_|ruck | sshnaidm|rover: me getting ready to go in few mins need something? | 16:53 |
| sshnaidm|rover | marios_|ruck, I think we're good | 16:53 |
| marios_|ruck | sshnaidm|rover: for that queens promotion blocker pinged abishop to check (some progress today we at least have some understanding where it comes from) | 16:53 |
| marios_|ruck | sshnaidm|rover: lets see if he has some ideas on the bug | 16:53 |
| sshnaidm|rover | marios_|ruck, ok, cool | 16:53 |
| marios_|ruck | sshnaidm|rover: see you monday | 16:54 |
| sshnaidm|rover | marios_|ruck, tomorrow you're with weshay | 16:54 |
| marios_|ruck | sshnaidm|rover: gonna miss you man | 16:54 |
| sshnaidm|rover | marios_|ruck, se ya | 16:54 |
| *** holser_ has joined #oooq | 16:59 | |
| *** trown is now known as trown|lunch | 17:07 | |
| weshay | sorry was distracted there for a bit, anyone need anything? | 17:11 |
| rfolco | reviews | 17:17 |
| rfolco | I could be stealing, kidnapping, killing... I am just begging for reviews... | 17:17 |
| rfolco | arxcruz ^ | 17:18 |
| raukadah | weshay: how to get rid of these repos https://github.com/openstack?utf8=%E2%9C%93&q=ansible-role-tripleo&type=&language= which are unused in TripleO team? | 17:18 |
| rfolco | https://review.rdoproject.org/r/#/q/status:open+project:config+branch:master+topic:oooq/branching | 17:18 |
| weshay | raukadah not sure I understand the question yet | 17:19 |
| raukadah | weshay: we have bunch of repos created with ansible-role-tripleo-* under tripleo project which are not used and just sitting on github/openstack | 17:20 |
| weshay | what makes you think they are not used? | 17:20 |
| raukadah | it cames from this from this repo https://github.com/openstack/ansible-role-tripleo-tempest repo | 17:20 |
| raukadah | weshay: I have not seen in rdo packages so asked | 17:21 |
| weshay | ya.. raukadah so.. I think the appropriate thing to do would be to ask in the #tripleo meeting on tuesday what is the current plan for these repos and ansible integration | 17:22 |
| weshay | I think there are still plans but maybe not people to continue to push that forward | 17:23 |
| weshay | not sure tbh | 17:23 |
| raukadah | weshay: yes, sure, I will put an agenda for that | 17:23 |
| *** ccamacho has quit IRC | 17:23 | |
| raukadah | now we have new scope also to reuse osa developed roles | 17:23 |
| raukadah | to avoid maintaince | 17:23 |
| raukadah | weshay: thanks! | 17:24 |
| *** holser_ has quit IRC | 17:38 | |
| zbr | weshay: the f28 missing dnf plugin bug I was telling you about earlier https://review.openstack.org/#/c/648158/ | 17:45 |
| weshay | I see the changes posted to #tripleo :) | 17:45 |
| zbr | weshay: damn, i need to start using aliases ;) | 17:45 |
| weshay | lolz | 17:50 |
| *** jfrancoa has quit IRC | 17:53 | |
| *** jbadiapa has joined #oooq | 17:54 | |
| *** ykarel|away has joined #oooq | 17:54 | |
| *** derekh has quit IRC | 18:02 | |
| *** trown|lunch is now known as trown | 18:06 | |
| *** dtantsur is now known as dtantsur|afk | 18:08 | |
| *** jpena is now known as jpena|off | 18:08 | |
| *** kopecmartin is now known as kopecmartin|off | 18:11 | |
| rlandy | weshay: fetching/building images is a more complicated when you need an image for the undercloud | 18:12 |
| rlandy | and overcloud becomes undercloud | 18:12 |
| weshay | rlandy ? | 18:12 |
| weshay | let's chat | 18:13 |
| *** amoralej is now known as amoralej|off | 18:16 | |
| weshay | rlandy https://github.com/openstack/tripleo-quickstart/blob/master/config/environments/baseos_centos_libvirt.yml | 18:21 |
| Tengu | sshnaidm|rover rlandy you still face an issue with selinux being enforced instead of permissive? | 18:24 |
| rlandy | Tengu: apparently we do | 18:25 |
| rlandy | patch is not always working | 18:25 |
| rlandy | we get come failures and not others | 18:25 |
| zbr | weshay: rlandy : required by upcoming migration https://review.openstack.org/#/c/647196/ | 18:25 |
| *** fultonj has quit IRC | 18:25 | |
| Tengu | hmm. that's weird... | 18:25 |
| zbr | git protocol is not going to be usable for long, if you see similar changes wf them. | 18:25 |
| Tengu | selinux management isn't a random thing :/. you shouldn't face failures, unless the setting isn't taken. | 18:26 |
| zbr | rlandy: weshay same: https://review.openstack.org/#/c/647190/1 | 18:26 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo- (3 more messages) | 18:28 |
| *** quiquell|off is now known as quiquell | 18:28 | |
| quiquell | rfolco, zbr, weshayÂ: tripleostein containers ready at dockerhub | 18:29 |
| rfolco | quiquell, what you did this time? so I can do the same for f28 ? | 18:29 |
| quiquell | rfolco: fist time I did it in the promoter and I think some images was not correctly pull | 18:30 |
| quiquell | rfolco: I have just do it now at another machine | 18:30 |
| quiquell | rfolco: make sure docker images are clean | 18:30 |
| quiquell | rfolco: more tomorrow | 18:30 |
| rfolco | quiquell, cool.. thx | 18:30 |
| quiquell | rfolco: you are welcome, we have now everything to start to spin upstream jobs | 18:30 |
| *** quiquell is now known as quiquell|off | 18:30 | |
| *** jtomasek has quit IRC | 18:33 | |
| *** jtomasek has joined #oooq | 18:34 | |
| *** fultonj has joined #oooq | 18:35 | |
| *** jtomasek has quit IRC | 18:35 | |
| rfolco | rlandy, should we change this setting? see https://review.openstack.org/#/c/648206/1/doc/source/ci/baremetal_jobs.rst@226 | 18:42 |
| rfolco | rlandy: pxe_ipmitool --> ipmi | 18:43 |
| *** ykarel|away has quit IRC | 19:05 | |
| *** vinaykns has quit IRC | 19:09 | |
| *** apetrich has quit IRC | 19:16 | |
| *** vinaykns has joined #oooq | 19:32 | |
| *** dsneddon has quit IRC | 19:38 | |
| *** sshnaidm|rover is now known as sshnaidm|off | 19:40 | |
| rlandy | weshay: https://review.openstack.org/#/q/topic:build-images-bm+(status:open+OR+status:merged) | 19:46 |
| rlandy | let's test this | 19:46 |
| weshay | rlandy that looks a lot like the ovb-setup playbook :) cool.. this looks good | 19:50 |
| rlandy | weshay: (note I did not default those values - probably bad ) ... under test now: https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status | 19:52 |
| weshay | rlandy once we have some sanity.. could we factor out everything under and including to-build-or-not-to-build? | 19:52 |
| weshay | so it's litterly the same playbook? | 19:52 |
| rlandy | yeah | 19:52 |
| *** jtomasek has joined #oooq | 19:57 | |
| weshay | cool | 19:58 |
| *** holser_ has joined #oooq | 20:05 | |
| rlandy | weshay: not working :( | 20:08 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/stream/6e674dd7c79141208f8a96533ee039eb?logfile=console.log | 20:08 |
| rlandy | checking for image overcloud-full | 20:08 |
| rlandy | it should only look for underloud | 20:09 |
| rlandy | hmm ... maybe that only works with include_role | 20:12 |
| rlandy | rfolco: no need | 20:15 |
| rfolco | rlandy, which one is newer? ipmi or pxe_ipmitool | 20:16 |
| rlandy | idk off hand - yo can check ironic - but we have no issues with | 20:17 |
| rlandy | git too many things where we do have problems to fix | 20:17 |
| *** dsneddon has joined #oooq | 20:23 | |
| *** jtomasek has quit IRC | 20:24 | |
| rlandy | weshay: don't think we can override extra vars (always win precedence) - unless we set_fact | 20:26 |
| weshay | rlandy what is the output of images: | 20:27 |
| rlandy | weshay: I can see it get the overcloud and ipa iamges | 20:27 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039 @ (2 more messages) | 20:28 |
| rlandy | I think if I set_fact it will be fine | 20:28 |
| rlandy | becuase it will be per host | 20:28 |
| *** dsneddon has quit IRC | 20:30 | |
| rlandy | eek - won't work | 20:31 |
| rlandy | will still be overridden | 20:31 |
| rlandy | will have to set in bm tripleo-environments | 20:33 |
| rlandy | let's see if this does better | 20:44 |
| *** hamzy has quit IRC | 20:54 | |
| rlandy | rfolco: weshay: just fyi - may be in a little late tomorrow - taking car for service | 20:54 |
| *** trown is now known as trown|outtypewww | 21:08 | |
| *** aakarsh has quit IRC | 21:10 | |
| weshay | k | 21:15 |
| *** Vorrtex has quit IRC | 21:34 | |
| *** Vorrtex has joined #oooq | 21:35 | |
| *** Vorrtex has quit IRC | 21:36 | |
| *** matbu has joined #oooq | 21:53 | |
| weshay | rlandy is this the job? https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/stream/320e3d92c0e9431db2e172377751ffdc?logfile=console.log | 21:59 |
| rlandy | weshay: something it doesn't like about my definition of images | 22:00 |
| rlandy | weshay: https://code.engineering.redhat.com/gerrit/#/c/166500/4/hardware_environments/hp_dl360_envD/network_configs/single_nic_vlans/env_settings.yml | 22:02 |
| rlandy | think it dislikes that | 22:02 |
| rlandy | testing | 22:02 |
| rlandy | removing the if | 22:02 |
| rlandy | weshay: so it works w/o the if | 22:12 |
| rlandy | my syntax must be wrong | 22:12 |
| *** aakarsh has joined #oooq | 22:26 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039 @ (2 more messages) | 22:28 |
| *** vinaykns has quit IRC | 22:29 | |
| rlandy | weshay: rfolco: do you want me to merge some of these jobs? | 22:32 |
| weshay | which ones you looking at? | 22:32 |
| weshay | imho, might as well.. we are very green atm | 22:32 |
| rlandy | the one adding stein jobs to pipeline shoudl wait | 22:33 |
| rlandy | weshay: think I know what was wrong with bm job - but getting a node failure now | 22:33 |
| rlandy | will try again later | 22:34 |
| weshay | k | 22:34 |
| *** holser_ has quit IRC | 22:43 | |
| *** dsneddon has joined #oooq | 23:35 | |
| *** holser_ has joined #oooq | 23:40 | |
| *** dsneddon has quit IRC | 23:40 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!