*** rascasoft has joined #oooq | 00:04 | |
hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-containers-multinode @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario001-multinode-oooq-container @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7 (1 more message) | 00:08 |
---|---|---|
*** rascasoft has quit IRC | 00:10 | |
*** tosky has quit IRC | 00:28 | |
*** dsneddon has quit IRC | 01:21 | |
*** dsneddon has joined #oooq | 01:23 | |
*** dsneddon has quit IRC | 01:29 | |
*** dsneddon has joined #oooq | 01:34 | |
*** dsneddon has quit IRC | 01:42 | |
*** dsneddon has joined #oooq | 01:45 | |
*** dsneddon has quit IRC | 01:51 | |
*** dsneddon has joined #oooq | 01:58 | |
hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-containers-multinode @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-scenario001-multinode-oooq-container @ https://review.openstack.org/602248, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7 (1 more message) | 02:08 |
*** dsneddon has quit IRC | 02:08 | |
*** dsneddon has joined #oooq | 02:16 | |
*** ykarel|away has joined #oooq | 02:59 | |
*** hamzy_ has quit IRC | 03:10 | |
*** dsneddon has quit IRC | 03:32 | |
*** dsneddon has joined #oooq | 03:34 | |
*** dsneddon has quit IRC | 03:39 | |
*** dsneddon has joined #oooq | 03:55 | |
*** dsneddon has quit IRC | 04:01 | |
*** udesale has joined #oooq | 04:05 | |
hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-containers-multinode @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp- (1 more message) | 04:08 |
*** saneax has joined #oooq | 04:23 | |
*** dsneddon has joined #oooq | 04:34 | |
*** dsneddon has quit IRC | 04:40 | |
*** ykarel|away is now known as ykarel | 04:53 | |
*** dsneddon has joined #oooq | 05:10 | |
*** dsneddon has quit IRC | 05:15 | |
*** ykarel has quit IRC | 05:35 | |
chandankumar | quiquell|off: https://review.rdoproject.org/r/#/admin/projects/rdo-infra/ansible-role-tripleo-ci-reproducer | 05:39 |
*** dsneddon has joined #oooq | 05:45 | |
*** ratailor has joined #oooq | 05:49 | |
*** dsneddon has quit IRC | 05:50 | |
*** dsneddon has joined #oooq | 05:52 | |
*** ykarel has joined #oooq | 05:53 | |
hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-containers-multinode @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp- (1 more message) | 06:08 |
*** jfrancoa has joined #oooq | 06:14 | |
quiquell|off | chandankumar: o/ | 07:21 |
quiquell|off | chandankumar: thanks ! | 07:21 |
*** quiquell|off is now known as quiquell | 07:24 | |
*** quiquell is now known as quiquell|brb | 07:32 | |
chandankumar | quiquell|brb: there is some replication issue with github we will wait for jpena or amoralej to come | 07:41 |
*** ykarel is now known as ykarel|lunch | 07:50 | |
*** kopecmartin|off is now known as kopecmartin | 07:55 | |
*** quiquell|brb is now known as quiquell | 08:01 | |
quiquell | chandankumar: what replication ? | 08:01 |
chandankumar | quiquell: above repo should be replicated here https://github.com/rdo-infra/ | 08:03 |
quiquell | chandankumar: Do I have to change something in the project config ? | 08:05 |
chandankumar | quiquell: nope | 08:05 |
chandankumar | quiquell: may be rdocloud outage caused something | 08:05 |
quiquell | chandankumar: I think yesterday there were issues | 08:08 |
hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (1 more message) | 08:08 |
*** rascasoft has joined #oooq | 08:11 | |
*** tosky has joined #oooq | 08:27 | |
*** dmellado has quit IRC | 08:44 | |
*** ykarel|lunch is now known as ykarel | 08:45 | |
*** dmellado has joined #oooq | 08:46 | |
*** jpena|off is now known as jpena | 08:53 | |
*** tosky has quit IRC | 08:54 | |
*** tosky has joined #oooq | 08:55 | |
*** dsneddon has quit IRC | 09:12 | |
*** skramaja has joined #oooq | 09:13 | |
*** dsneddon has joined #oooq | 09:20 | |
*** derekh has joined #oooq | 09:35 | |
*** dsneddon has quit IRC | 09:40 | |
*** tosky has quit IRC | 09:54 | |
*** tosky has joined #oooq | 09:55 | |
*** holser_ has joined #oooq | 10:00 | |
*** holser_ has quit IRC | 10:00 | |
*** holser_ has joined #oooq | 10:01 | |
hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (1 more message) | 10:08 |
*** ssbarnea has joined #oooq | 10:13 | |
*** dsneddon has joined #oooq | 10:16 | |
*** dsneddon has quit IRC | 10:28 | |
*** jtomasek has joined #oooq | 10:31 | |
*** amoralej is now known as amoralej|afk | 10:31 | |
*** saneax has quit IRC | 10:41 | |
*** udesale has quit IRC | 10:46 | |
*** gkadam has joined #oooq | 10:56 | |
*** agopi has joined #oooq | 10:58 | |
marios | rfolco: panda where can i add this to the board please https://review.openstack.org/604768 and now associated https://review.rdoproject.org/r/#/c/17962/ | 10:59 |
marios | rfolco: panda|off ssbarnea sshnaidm|off quiquell * can you check https://review.rdoproject.org/r/#/c/17962/ when you have time thanks | 11:00 |
*** dsneddon has joined #oooq | 11:02 | |
*** dsneddon has quit IRC | 11:11 | |
quiquell | marios: +1 we have to merge this before the other (My comment in the review is wrong) | 11:11 |
*** jfrancoa has quit IRC | 11:25 | |
*** dsneddon has joined #oooq | 11:26 | |
chandankumar | quiquell: Can I try the reproducer role locally? it is available there? | 11:33 |
*** dsneddon has quit IRC | 11:34 | |
quiquell | chandankumar: We have to wait for public images at RDO cloud | 11:34 |
chandankumar | quiquell: ok | 11:34 |
*** holser_ is now known as holser|lunch | 11:50 | |
*** saneax has joined #oooq | 11:56 | |
panda|off | marios: quiquell https://review.rdoproject.org/api/17745 this is adding important feature yet should be backwards compatible and ready to merge | 12:03 |
panda|off | s/ready/safe | 12:04 |
quiquell | panda|off: ack, looking | 12:04 |
marios | panda|off: ack add comment please? /me going afk biab | 12:07 |
hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (1 more message) | 12:08 |
quiquell | panda|off: Can we run this with a fake periodic job or anything ? | 12:08 |
*** dsneddon has joined #oooq | 12:10 | |
quiquell | Ahh is easy to run it locally | 12:10 |
quiquell | Not needed | 12:10 |
*** amoralej|afk is now known as amoralej | 12:12 | |
panda|off | quiquell: marios this instead https://review.rdoproject.org/api/17744 cannot be tested before, adds feature but for the first pass I'm focusing to make it a non breaking noop for the current pipeline | 12:15 |
quiquell | panda|off: script is working fine, just tested it locally | 12:15 |
panda|off | quiquell: I'm da man | 12:15 |
quiquell | panda|off: +2 | 12:16 |
quiquell | We can do some assertions here and there and also add defaults for RELEASE and the like, but let's not stop on this | 12:16 |
quiquell | panda|off: what else is needed to review ? | 12:17 |
panda|off | I added release, but for example I have no default fro the promote name | 12:17 |
panda|off | quiquell: https://review.rdoproject.org/api/17744 | 12:18 |
*** dsneddon has quit IRC | 12:23 | |
*** jpena is now known as jpena|lunch | 12:24 | |
*** ratailor has quit IRC | 12:24 | |
ykarel | panda|off, hey | 12:26 |
ykarel | panda|off, when u will be |on, i wanted to ask something | 12:26 |
*** panda|off is now known as panda | 12:28 | |
panda | ykarel: ask away | 12:28 |
ykarel | panda, so u was working on rdoinfo jobs translation to new workflow | 12:29 |
ykarel | panda, i wanted to check if that's finished | 12:29 |
ykarel | i see the review: https://review.rdoproject.org/r/#/c/17352/18 | 12:29 |
ykarel | but can't get what's still pending there | 12:29 |
panda | ykarel: define finished | 12:30 |
panda | ykarel: everything is blocked by this https://review.openstack.org/607288 | 12:30 |
ykarel | panda, can we use it | 12:30 |
panda | until that merges, there's no easy way to reuse selected part of tripleo-ci workflow | 12:30 |
ykarel | panda, i mean can we use this job in place of legacy one we are using | 12:30 |
ykarel | panda, ack | 12:30 |
ykarel | looking that review | 12:30 |
panda | ykarel: the job works | 12:30 |
panda | ykarel: but it needs the tasks in form of role | 12:31 |
panda | so it can be used in a different project | 12:31 |
ykarel | panda, Thanks for the info | 12:32 |
ykarel | so https://review.openstack.org/#/c/607288/ just waiting for reviews, right? | 12:32 |
panda | ykarel: it's waiting for planetary alignment | 12:32 |
panda | ykarel: all gate must work, it must be a quiet moment to not create too much distruption, and people must be ok with this big change | 12:33 |
quiquell | panda: +1 https://review.rdoproject.org/r/#/c/17744 little nit | 12:33 |
panda | ykarel: and also there must no change in run-v3 otherwise I have to rebase everything manually again/. | 12:34 |
panda | quiquell: thanks | 12:35 |
ykarel | panda, ack, so atleast jobs in the patch are working, good to test the other jobs not tested there + promotion ones | 12:35 |
ykarel | atleast that will make people happy | 12:36 |
panda | quiquell: the name wasn't there before :) but yeah, we should leave the code a bit better than how we found it. | 12:36 |
quiquell | panda: I know, little boy scout there | 12:37 |
quiquell | Now that we have mixed stuff better to have debuging info | 12:38 |
*** agopi has quit IRC | 12:41 | |
panda | rfolco: when is the followup packaging meeting ? | 12:42 |
rfolco | panda, ooops | 12:43 |
rfolco | panda, forgot that one | 12:43 |
rfolco | chekcing calendar... whats works best for you guys ? | 12:43 |
quiquell | panda, rfolco: Have to take 24th too, going to update etherpad | 12:44 |
panda | rfolco: ok, in 1:15 hour ? | 12:44 |
rfolco | quiquell, I was surprised 24th is official holiday at RedHat (br) | 12:45 |
quiquell | rfolco: yep | 12:45 |
*** derekh has quit IRC | 12:47 | |
panda | quiquell: fixed | 12:48 |
quiquell | panda: thanks | 12:48 |
quiquell | rfolco: spain is from 25th not from 24th the company shutdown thing | 12:49 |
*** derekh has joined #oooq | 12:51 | |
rfolco | quiquell, panda marios ssbarnea weshay|ruck ci breakage/ packaging follow-up scheduled, invites sent (starts +1h from now). | 12:54 |
quiquell | rfolco: thanks | 12:55 |
*** dsneddon has joined #oooq | 12:56 | |
*** chem has quit IRC | 12:57 | |
rfolco | marios, question about replacing multinode w/ standalone... | 12:58 |
rfolco | yesterday while talking to weshay|ruck, I raised the following question: if we replace/remove multinode containers and replace with standalone, what we'll run for stable branches ? none. standalone covers stein only. | 12:59 |
*** holser|lunch is now known as holser_ | 12:59 | |
rfolco | stable branches will be uncovered ? I've added the question here, please clarify https://tree.taiga.io/project/tripleo-ci-board/task/448?kanban-status=1447276 | 13:00 |
*** dsneddon has quit IRC | 13:01 | |
holser_ | ssbarnea https://review.openstack.org/#/c/626157/ and https://review.openstack.org/#/c/625997/ were merged | 13:03 |
holser_ | there shouldn't be any issues with linting anymore | 13:04 |
weshay|ruck | rfolco, add this to the invite https://docs.google.com/document/d/1kxGQ6WNGROUdApeOuogFxo7Kr_bCVMon-Gn87PjLGys/edit#heading=h.dnzjtqczrcp8 | 13:05 |
marios | rfolco: o/ right already considered this | 13:05 |
weshay|ruck | quiquell, panda marios ssbarnea fyi https://docs.google.com/document/d/1kxGQ6WNGROUdApeOuogFxo7Kr_bCVMon-Gn87PjLGys/edit#heading=h.dnzjtqczrcp8 | 13:06 |
*** rlandy has joined #oooq | 13:06 | |
marios | rfolco: see for example in https://review.openstack.org/#/q/topic:replace-scen1 you can see the abandoned ones for the stable/brances | 13:06 |
rfolco | marios, yeah just realized and answered myself. | 13:06 |
rfolco | thanks | 13:06 |
rfolco | weshay|ruck, k, adding | 13:06 |
marios | rfolco: https://tree.taiga.io/project/tripleo-ci-board/task/448 also noted on the description | 13:06 |
marios | rfolco: ack on the call thanks | 13:06 |
quiquell | weshay|ruck: I have stupid questions for the meeting | 13:06 |
*** rlandy is now known as rlandy|rover | 13:07 | |
rlandy|rover | weshay|ruck: morning :0 | 13:08 |
weshay|ruck | quiquell, well.. I am stupid so I should be able to field those questions :) | 13:08 |
weshay|ruck | morning | 13:09 |
weshay|ruck | rlandy|rover, 1/2 merged | 13:09 |
weshay|ruck | rlandy|rover, gate is nice and clear | 13:09 |
rlandy|rover | I see - that's a start | 13:09 |
rlandy|rover | yesterday scared everyone off | 13:09 |
rlandy|rover | periodic-tripleo-centos-7-master-containers-build failing | 13:09 |
rfolco | quiquell, https://etherpad.openstack.org/p/tripleo-ci-squad-meeting @L30, just added a Q&A there, feel free to add your questions | 13:09 |
rfolco | if weshay|ruck prefers to use only the gdocs, we can transfer there | 13:10 |
*** skramaja has quit IRC | 13:10 | |
rlandy|rover | hmmm ... same deal I think | 13:10 |
weshay|ruck | rlandy|rover, I think you can ignore the current master container build job | 13:11 |
weshay|ruck | https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-centos-7-master-containers-build/7caba3f/logs/undercloud/home/zuul/install-undercloud.log.txt.gz | 13:11 |
weshay|ruck | "2018-12-21 12:45:56,616 ERROR: 17420 -- Failed running docker-puppet.py for heat_api", | 13:11 |
weshay|ruck | "2018-12-21 12:45:56,618 ERROR: 17420 -- standard_init_linux.go:203: exec user process caused \"no such file or directory\"", | 13:11 |
rlandy|rover | yeah - was just looking at it | 13:11 |
rlandy|rover | pity - would have liked to have seen the shake out | 13:11 |
weshay|ruck | rlandy|rover, the fix didn't make it in | 13:11 |
Tengu | grumpf. bad podman. | 13:12 |
rlandy|rover | https://review.openstack.org/#/c/626546/ | 13:12 |
rlandy|rover | weshay|ruck: ^^? | 13:12 |
rlandy|rover | just in I guess | 13:12 |
Tengu | rlandy|rover: that one won't correct the "standard_init_linux.go:203:" thing, but the relabelling of netns directory | 13:13 |
Tengu | and yep, it just landed. Another one, by Yatin, is having troubles with the random podman failures: https://review.openstack.org/#/c/626511/ | 13:14 |
Tengu | although apparently the patch for puppet-tripleo is "the" one correcting most of the netns issues. still, yatin's needed. | 13:14 |
weshay|ruck | rlandy|rover, promotion started 3hrs ago | 13:15 |
weshay|ruck | that landed 2hrs ago | 13:15 |
weshay|ruck | quiquell, let's 1-1 | 13:16 |
quiquell | ack | 13:17 |
weshay|ruck | let's knock it out early.. I read my calendar incorrectly in the middle of the night | 13:17 |
* weshay|ruck gets ready | 13:18 | |
quiquell | connecting | 13:18 |
weshay|ruck | https://bluejeans.com/u/whayutin/ | 13:19 |
*** dsneddon has joined #oooq | 13:20 | |
weshay|ruck | quiquell, http://dashboard-ci.tripleo.org/d/cEEjGFFmz/cockpit?orgId=1&panelId=61&fullscreen | 13:29 |
*** dsneddon has quit IRC | 13:31 | |
rfolco | rlandy|rover, do you know what is the issue/bug/log that broke our reproducer ? | 13:40 |
rlandy|rover | rfolco: which one - old one? | 13:40 |
rfolco | yep old one | 13:40 |
rlandy|rover | rfolco: not sure if there was a bug but this is the fix ... https://review.openstack.org/#/c/626758/ | 13:41 |
rlandy|rover | weshay|ruck put it in and I am testing it now | 13:41 |
rlandy|rover | running on my tenant | 13:41 |
rlandy|rover | it was the removal of te-broker | 13:41 |
rfolco | rlandy|rover, ah ok, can I assign to you the new task/story on regression testing for the reproducer on taiga ? | 13:42 |
rfolco | rlandy|rover, oh you are rover... :) | 13:42 |
*** amoralej is now known as amoralej|lunch | 13:42 | |
rfolco | rlandy|rover, will just add the bug to the task | 13:43 |
rfolco | for now... thx | 13:43 |
rlandy|rover | rfolco: probably - I think it's a rover task | 13:43 |
rlandy|rover | to keep the old one in shape | 13:43 |
rlandy|rover | but I think the task is for the new one, no? | 13:43 |
rlandy|rover | regression testing the new reproducer? | 13:43 |
rfolco | rlandy|rover, probably yes. Let me do this. An issue for the old one, assigned to you. The new task for the new one. | 13:44 |
rfolco | rlandy|rover, thx | 13:44 |
rlandy|rover | ok | 13:44 |
rfolco | rlandy|rover, fyi https://tree.taiga.io/project/tripleo-ci-board/issue/536?kanban-status=2027733 | 13:47 |
*** trown|outtypewww is now known as trown | 13:48 | |
quiquell | Impos | 13:53 |
rlandy|rover | quiquell: hi - what happened with the images discussion? | 13:55 |
weshay|ruck | marios, you have a minute? re: https://review.openstack.org/#/c/620305/ | 13:55 |
rlandy|rover | sf not happy with the public image idea? | 13:55 |
*** jtomasek has quit IRC | 13:56 | |
weshay|ruck | wha? | 13:56 |
marios | weshay|ruck: o/ getting ready to talk in 2 mins on bluejeans with you? | 13:57 |
*** dsneddon has joined #oooq | 13:58 | |
quiquell | rlandy|rover: I was talking with kforde about making them public | 13:59 |
weshay|ruck | marios, heh.. ya.. bad timing :) | 13:59 |
quiquell | rfolco: but there is a comment in the task | 13:59 |
quiquell | rlandy|rover: https://tree.taiga.io/project/tripleo-ci-board/task/413?kanban-status=1447275 | 13:59 |
weshay|ruck | marios, I'll catch up w/ you later | 13:59 |
quiquell | rlandy|rover: I am having a discussion at #sf-ops about it | 14:01 |
quiquell | rlandy|rover: with paul, alan and kieran | 14:01 |
rlandy|rover | yeah - following | 14:01 |
rlandy|rover | didn't know it was still in question | 14:01 |
quiquell | rlandy|rover: paul just said that no problem with deletion | 14:02 |
*** dsneddon has quit IRC | 14:02 | |
quiquell | rlandy|rover: going to talk with kforde so at least our personal tenants at our team have them | 14:03 |
quiquell | rlandy|rover: so we can continue with the plan | 14:03 |
rlandy|rover | quiquell: yeah I would think admins would have objected if so | 14:03 |
rlandy|rover | always complicated | 14:03 |
quiquell | rlandy|rover: I am going to put all my energy at CI this before we start to implemend stuff | 14:03 |
weshay|ruck | quiquell, mtg | 14:03 |
quiquell | yep sorryuy | 14:03 |
rlandy|rover | absolutely | 14:04 |
hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (1 more message) | 14:08 |
*** chem has joined #oooq | 14:12 | |
*** saneax has quit IRC | 14:20 | |
weshay|ruck | chandankumar, paste a link to unit tests | 14:21 |
chandankumar | weshay|ruck: sharing a link | 14:22 |
chandankumar | weshay|ruck: https://trunk.rdoproject.org/centos7-master-head/3d/08/3d08aaff7f39b32bb067782c52fa2d3e68f0adf2_88bac5cd/rpmbuild.log | 14:23 |
chandankumar | weshay|ruck: do a ctrl f | 14:23 |
chandankumar | weshay|ruck: Executing(%check): /bin/sh -e | 14:23 |
*** amoralej|lunch is now known as amoralej | 14:24 | |
chandankumar | weshay|ruck: https://github.com/rdo-packages | 14:29 |
chandankumar | weshay|ruck: https://github.com/rdo-common -> forked deps spec which screwed us in earlier from fedora/centos land | 14:29 |
chandankumar | quiquell: weshay|ruck https://blogs.rdoproject.org/2016/07/how-to-build-new-openstack-packages/ | 14:30 |
*** dsneddon has joined #oooq | 14:34 | |
chandankumar | weshay|ruck: quiquell https://src.fedoraproject.org/group/openstack-sig | 14:34 |
*** agopi has joined #oooq | 14:37 | |
quiquell | rlandy|rover: going to mark one of the nodepool image as shared wit the nodepool creds | 14:38 |
quiquell | rlandy|rover: then we can get them into our tenants | 14:38 |
quiquell | super cheap and easy solution | 14:38 |
rlandy|rover | quiquell: sounds good | 14:38 |
rlandy|rover | whatever works at this point | 14:38 |
quiquell | Yep | 14:38 |
*** dsneddon has quit IRC | 14:39 | |
*** agopi has quit IRC | 14:42 | |
chandankumar | marios: quiquell weshay|ruck https://www.rdoproject.org/what/trunk-repos/ | 14:42 |
*** dsneddon has joined #oooq | 14:44 | |
*** dsneddon has quit IRC | 14:49 | |
marios | "openvswitch " https://www.youtube.com/watch?v=g4ChTL-3c3o | 14:55 |
*** chandankumar is now known as chkumar|out | 15:02 | |
marios | o/ folks wdyt http://logs.openstack.org/00/626900/1/check/openstack-tox-docs/af0c893/html/ vs https://docs.openstack.org/tripleo-docs/latest/ simple change at https://review.openstack.org/#/c/626900/ thanks | 15:04 |
*** jpena|lunch is now known as jpena | 15:06 | |
quiquell | rlandy|rover: So it worked | 15:07 |
quiquell | rlandy|rover: shared image from nodepool to my tenant | 15:07 |
quiquell | rlandy|rover: problem is the naming | 15:07 |
rlandy|rover | marios: lol - openvswitch video | 15:07 |
rlandy|rover | quiquell: nice - good start | 15:07 |
*** ykarel is now known as ykarel|afk | 15:08 | |
rlandy|rover | quiquell: we had this naming issue before | 15:08 |
rlandy|rover | I think maybe downstream | 15:08 |
quiquell | rlandy|rover: we can search for meta | 15:08 |
quiquell | and select one of the image | 15:08 |
rlandy|rover | we go some tag to specify latest | 15:08 |
rlandy|rover | I had a ticket out | 15:08 |
quiquell | and put something at tebroker that share the images | 15:08 |
rlandy|rover | to rdo admins | 15:08 |
rlandy|rover | tebroker is gone | 15:09 |
quiquell | kforde also say something about sharing the same project | 15:09 |
rlandy|rover | quiquell: I can search for that info | 15:09 |
rlandy|rover | we definitely got data to specify latest image | 15:09 |
quiquell | Well somwwhere wehre we can have the nodepool creds so we can do an "openstack image add project" | 15:09 |
rlandy|rover | because they don't delete the old image | 15:09 |
rlandy|rover | when they add a new one | 15:09 |
quiquell | They don't ? | 15:10 |
quiquell | Then we are good | 15:10 |
rlandy|rover | there are a few of them there | 15:10 |
rlandy|rover | maybe four | 15:10 |
rlandy|rover | centos | 15:10 |
rlandy|rover | two fedora | 15:10 |
quiquell | Don't know if they are good enough | 15:10 |
quiquell | I suppose | 15:10 |
quiquell | They will disappear when te broker disappear ? | 15:11 |
rlandy|rover | what's the connection to te-broker | 15:11 |
quiquell | Or this is not related ? | 15:11 |
rlandy|rover | the images are nodepool related | 15:11 |
quiquell | ok ok | 15:11 |
rlandy|rover | te-broker deals with overcloud nodes | 15:11 |
quiquell | Give me the uuid of your tenant | 15:11 |
rlandy|rover | so ... | 15:11 |
rlandy|rover | sec - getting | 15:11 |
rlandy|rover | quiquell: now in upshift - it's like kforde was mentioning yesterday | 15:13 |
rlandy|rover | we have a group tenant | 15:13 |
rlandy|rover | and everyone in weshay|ruck's org can share it | 15:13 |
rlandy|rover | so that is the future I think | 15:13 |
rlandy|rover | that will make things easier | 15:13 |
quiquell | much easier | 15:14 |
quiquell | We cannot have the same at rdocloud ? | 15:14 |
*** ykarel|afk has quit IRC | 15:14 | |
*** dsneddon has joined #oooq | 15:20 | |
rlandy|rover | I think it will be like that soon | 15:24 |
rlandy|rover | 192.168.0.0/24 compute.build_timeout 500 network.build_timeout 500 volume.build_timeout 500 service_available.aodh_plugin False orchestration.stack_owner_role Member | 15:25 |
*** dsneddon has quit IRC | 15:25 | |
rlandy|rover | and a rhos-13 error - not so table either | 15:25 |
rlandy|rover | periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset021-rocky - been timing out forever | 15:35 |
*** ykarel|afk has joined #oooq | 15:40 | |
quiquell | Go now, to all that are not going to be around next week, have a good christmas and all | 15:42 |
*** quiquell is now known as quiquell|off | 15:43 | |
*** ykarel|afk is now known as ykarel | 15:43 | |
rlandy|rover | weshay|ruck: looking into fs021 timeout in rocky | 15:48 |
*** dsneddon has joined #oooq | 15:51 | |
weshay|ruck | rlandy|rover, meh.. it's non-criteria | 15:52 |
weshay|ruck | rlandy|rover, did fs20 pass? | 15:52 |
weshay|ruck | rfolco, you ready? | 15:52 |
rfolco | weshay|ruck, I am always ready | 15:53 |
rlandy|rover | weshay|ruck, 20 is still going | 15:55 |
weshay|ruck | rlandy|rover, those jobs should be the same, however 21 does not use a tempest skip list and pulls in centos CR | 15:55 |
rlandy|rover | failed | 15:55 |
rlandy|rover | weshay|ruck; it consistently times out | 15:55 |
rlandy|rover | in tempest | 15:56 |
rlandy|rover | for ages | 15:56 |
weshay|ruck | ya.. | 15:56 |
rlandy|rover | not critical - we can discuss later | 15:56 |
weshay|ruck | so it's failing on a known tempest problem probably | 15:56 |
rlandy|rover | periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-rocky - success | 15:56 |
rlandy|rover | just waiting on 16 | 15:57 |
rlandy|rover | weshay|ruck: ^^ | 15:57 |
rlandy|rover | we may promote something | 15:58 |
*** dsneddon has quit IRC | 15:59 | |
*** kopecmartin is now known as kopecmartin|off | 16:01 | |
*** rlandy|rover is now known as rlandy|rover|brb | 16:04 | |
hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (1 more message) | 16:08 |
*** dsneddon has joined #oooq | 16:24 | |
marios | ttyl folks /me getting ready to go | 16:25 |
marios | have a great break see you in few days | 16:25 |
*** rlandy|rover|brb is now known as rlandy|rover | 16:30 | |
weshay|ruck | marios, later man.. take care | 16:36 |
weshay|ruck | rlandy|rover, rocky is pretty good | 16:37 |
weshay|ruck | and I don't think they are importing atm | 16:37 |
* weshay|ruck just trying to help you prioritize | 16:37 | |
* weshay|ruck checks | 16:37 | |
weshay|ruck | http://rhos-release.virt.bos.redhat.com:3030/rhosp | 16:37 |
weshay|ruck | 2 days old in ooo | 16:37 |
rlandy|rover | weshay|ruck: here's hpoing | 16:37 |
weshay|ruck | rlandy|rover, they havent taken a build from upstream in 66 days | 16:37 |
rlandy|rover | wow | 16:37 |
weshay|ruck | rlandy|rover, not a huge priority :) | 16:37 |
rlandy|rover | clearly no urgency | 16:37 |
weshay|ruck | rlandy|rover, aye | 16:38 |
rlandy|rover | weshay|ruck: something else that is urgent? | 16:38 |
rlandy|rover | weshay|ruck: old ovb reproducer looks ok | 16:38 |
rlandy|rover | trying libvirt | 16:38 |
weshay|ruck | ok good ;) | 16:38 |
weshay|ruck | thank you!! | 16:38 |
weshay|ruck | rlandy|rover, gate looks clean | 16:38 |
rlandy|rover | so easing rovering with weshay|ruck | 16:38 |
* rlandy|rover has little to do | 16:39 | |
weshay|ruck | lolz | 16:39 |
weshay|ruck | rlandy|rover, can't do it now... but ya.. focus is on a master promotion | 16:39 |
* weshay|ruck looking at a few things sec | 16:40 | |
weshay|ruck | rlandy|rover, https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 | 16:40 |
weshay|ruck | we'd want to understand what is causing the low success rate here | 16:40 |
weshay|ruck | rlandy|rover, <hubbot1> FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (1 | 16:41 |
weshay|ruck | more message) | 16:41 |
weshay|ruck | still speaks truth | 16:41 |
weshay|ruck | but often ignored | 16:41 |
weshay|ruck | https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 | 16:41 |
weshay|ruck | those are the kinds of things I'd be poking out.. | 16:42 |
weshay|ruck | I can divide and conquer with you | 16:42 |
weshay|ruck | quiquell|off, did you get the image shared? | 16:42 |
weshay|ruck | kforde says he showed you how | 16:42 |
weshay|ruck | rlandy|rover, woot https://review.openstack.org/#/c/626511/ merged | 16:43 |
rlandy|rover | nice | 16:46 |
rlandy|rover | weshay|ruck: will start looking through those | 16:47 |
weshay|ruck | rlandy|rover, we should see gate failures go down to next 2 by EOD http://dashboard-ci.tripleo.org/d/cEEjGFFmz/cockpit?orgId=1 | 16:52 |
*** chem has quit IRC | 16:52 | |
rlandy|rover | weshay|ruck; hopefully | 16:54 |
*** chem has joined #oooq | 16:54 | |
rlandy|rover | not so bad | 16:54 |
*** gkadam has quit IRC | 16:58 | |
*** gkadam has joined #oooq | 16:58 | |
*** holser_ has quit IRC | 17:23 | |
*** jpena is now known as jpena|off | 17:31 | |
*** derekh has quit IRC | 17:36 | |
rlandy|rover | tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053 still failing | 17:39 |
rlandy|rover | that should be passing now | 17:39 |
*** trown is now known as trown|lunch | 17:44 | |
*** ykarel is now known as ykarel|away | 17:58 | |
*** amoralej is now known as amoralej|off | 18:05 | |
hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb- (1 more message) | 18:08 |
*** holser_ has joined #oooq | 18:10 | |
*** dsneddon has quit IRC | 18:12 | |
*** dsneddon has joined #oooq | 18:13 | |
*** amoralej|off has quit IRC | 18:15 | |
*** trown|lunch is now known as trown | 18:45 | |
*** holser_ has quit IRC | 18:50 | |
*** ykarel|away has quit IRC | 19:09 | |
rlandy|rover | ugh - back with prep images failures | 19:30 |
rlandy|rover | weshay|ruck: guess who's baaaaaaccckkk? and I could actually repo this | 19:31 |
rlandy|rover | http://logs.rdoproject.org/90/625890/4/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/6cfbbc1/logs/undercloud/home/zuul/overcloud_prep_images.log.txt.gz | 19:31 |
rlandy|rover | introspection | 19:32 |
rlandy|rover | passes - and then the timeout | 19:32 |
rlandy|rover | probably hitting 35 an d53 as well | 19:32 |
rlandy|rover | 2018-12-21 11:12:26.508544 | primary | Friday 21 December 2018 11:12:26 +0000 (0:00:03.492) 0:00:26.892 ******* | 19:52 |
rlandy|rover | same deal | 19:52 |
rlandy|rover | overcloud_prep_images_introspection_debug.pcap.log.txt.gz | 20:04 |
rlandy|rover | what is that? | 20:04 |
rlandy|rover | weshay|ruck: ^^? | 20:04 |
rlandy|rover | doesn;t open | 20:04 |
hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445, stable/ocata: tripleo-ci-centos-7-ovb- (1 more message) | 20:08 |
rlandy|rover | suspect node cleaning | 20:26 |
* weshay|ruck reads | 20:47 | |
weshay|ruck | rlandy|rover, fyi https://review.openstack.org/#/c/626955/ | 20:47 |
weshay|ruck | rlandy|rover, that pcap file is the tcp dump | 20:47 |
weshay|ruck | you can import that into wireshark | 20:47 |
weshay|ruck | rlandy|rover, one way to compare .. well maybe is w/ https://review.openstack.org/#/c/614633/ | 20:48 |
weshay|ruck | http://cistatus.tripleo.org/ | 20:49 |
weshay|ruck | ■ tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 | 20:49 |
weshay|ruck | ▼ tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master-vexxhost | 20:49 |
weshay|ruck | heh.. vexxhost is f'd too https://logs.rdoproject.org/33/614633/11/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master-vexxhost/62ce6e2/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 20:50 |
weshay|ruck | rlandy|rover, ah.. so I suspect rdo-cloud has networking issues | 20:52 |
weshay|ruck | rlandy|rover, causing 2018-12-21 11:01:34.471912 | primary | TASK [overcloud-prep-images : Prepare the overcloud images for deploy] ********* | 20:52 |
rlandy|rover | weshay|ruck: yep I see that | 20:52 |
weshay|ruck | we should see that happen in vexx I think | 20:52 |
rlandy|rover | weshay|ruck: I think it's node cleaning | 20:53 |
weshay|ruck | we need to get these errors defined in sova too | 20:53 |
rlandy|rover | I am logging a bug | 20:53 |
rlandy|rover | see ... | 20:53 |
rlandy|rover | 2018-12-21 07:56:02.587 9 INFO ironic.conductor.task_manager [req-fbce19be-f856-48ae-957c-9f914c0c7117 - - - - -] Node 4fb46068-d1e6-4a25-ad0d-3d7c92ca486b moved to provision state "clean failed" from state "clean wait"; target provision state is "available | 20:53 |
rlandy|rover | var/log/containers/ironic/ironic-conductor.log.txt.gz shows | 20:53 |
rlandy|rover | ^^ | 20:53 |
weshay|ruck | rlandy|rover, well let's compare w/ vexx | 20:53 |
rlandy|rover | In my reproducer I can see the node state | 20:53 |
weshay|ruck | OH | 20:53 |
*** chem` has joined #oooq | 20:53 | |
* weshay|ruck waves at chem as wishes him a happy new year | 20:54 | |
rlandy|rover | +--------------------------------------+-------------------+---------------+-------------+--------------------+-------------+ | 20:54 |
rlandy|rover | | UUID | Name | Instance UUID | Power State | Provisioning State | Maintenance | | 20:54 |
rlandy|rover | +--------------------------------------+-------------------+---------------+-------------+--------------------+-------------+ | 20:54 |
rlandy|rover | | ee506bde-d8be-4701-824b-466b82de56f5 | baremetal-67734-0 | None | power off | clean failed | True | | 20:54 |
rlandy|rover | | da989ef3-5553-47f1-b98d-a0f2c12e8965 | baremetal-67734-1 | None | power off | clean failed | True | | 20:54 |
rlandy|rover | | 7fcd9095-7f46-45fc-9d2a-c66e0d91af05 | baremetal-67734-2 | None | power off | clean failed | True | | 20:54 |
weshay|ruck | ah ok | 20:54 |
rlandy|rover | | 20bc4e02-3776-4f54-aa9f-9a538a361d7a | baremetal-67734-3 | None | power off | clean failed | True | | 20:54 |
rlandy|rover | +--------------------------------------+-------------------+---------------+-------------+--------------------+-------------+ | 20:54 |
rlandy|rover | clean failed | 20:54 |
rlandy|rover | only in master | 20:54 |
rlandy|rover | fs001 | 20:54 |
rlandy|rover | 035 | 20:54 |
rlandy|rover | 053 | 20:54 |
rlandy|rover | 35 still has deploy errors | 20:54 |
weshay|ruck | ya.. what ever is going on it's just master | 20:54 |
rlandy|rover | which shoudl have been fixed :( | 20:55 |
weshay|ruck | wow.. we may get a merge party in #tripleo | 20:55 |
rlandy|rover | happy new year to us | 20:55 |
* rlandy|rover will assign the bug to me | 20:55 | |
rlandy|rover | and track there | 20:55 |
weshay|ruck | k | 20:56 |
*** chem has quit IRC | 20:57 | |
weshay|ruck | rlandy|rover, this is the best doc to go by, /me trying again https://docs.google.com/document/d/1i1-_L2mx8_erETAVblchLnymC6-9h7A2x02begy99UQ/edit | 21:03 |
rlandy|rover | weshay|ruck: yes | 21:04 |
weshay|ruck | danka | 21:04 |
rlandy|rover | I was hoping everyone would update it | 21:04 |
rlandy|rover | not sure sure that happened | 21:04 |
rlandy|rover | I think quique did though | 21:04 |
rlandy|rover | OVB is still a mystery to me | 21:04 |
weshay|ruck | hrm.. ok.. well I guess we'll worry about that in January | 21:05 |
rlandy|rover | weshay|ruck: yeah, need to log off ... hope you have a good holiday | 21:05 |
weshay|ruck | thanks you too! | 21:05 |
*** rlandy|rover has quit IRC | 21:05 | |
*** trown is now known as trown|outtypewww | 21:07 | |
*** chem` has quit IRC | 21:12 | |
*** dsneddon has quit IRC | 21:19 | |
*** dsneddon has joined #oooq | 21:34 | |
*** dsneddon has quit IRC | 21:43 | |
*** dsneddon has joined #oooq | 21:46 | |
hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053, tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/560445, stable/ocata: tripleo-ci-centos-7-ovb- (1 more message) | 22:08 |
-openstackstatus- NOTICE: the gerrit service on review.openstack.org is being restarted to pick up new configuration changes, and will return momentarily | 22:55 | |
*** dsneddon has quit IRC | 22:57 | |
*** rascasoft has quit IRC | 23:09 | |
*** dsneddon has joined #oooq | 23:32 | |
*** dsneddon has quit IRC | 23:36 | |
*** dsneddon has joined #oooq | 23:45 | |
*** dsneddon has quit IRC | 23:50 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!