*** dsneddon_ has joined #oooq | 00:33 | |
*** dsneddon_ has quit IRC | 01:22 | |
*** dsneddon_ has joined #oooq | 01:49 | |
*** dsneddon_ has quit IRC | 01:54 | |
*** dsneddon_ has joined #oooq | 01:57 | |
*** dsneddon_ has quit IRC | 02:02 | |
*** dsneddon_ has joined #oooq | 02:58 | |
*** dsneddon_ has quit IRC | 03:03 | |
*** dsneddon_ has joined #oooq | 03:46 | |
*** dsneddon_ has quit IRC | 03:52 | |
*** dsneddon_ has joined #oooq | 04:00 | |
*** aakarsh has quit IRC | 04:09 | |
*** soniya29 has joined #oooq | 04:10 | |
*** ykarel has joined #oooq | 04:18 | |
*** bhagyashris has joined #oooq | 04:30 | |
*** skramaja has joined #oooq | 04:41 | |
*** bhagyashris has quit IRC | 04:56 | |
*** dsneddon_ has quit IRC | 05:04 | |
*** epoojad1 has joined #oooq | 05:10 | |
*** epoojad1 has joined #oooq | 05:10 | |
*** surpatil has joined #oooq | 05:23 | |
*** ratailor has joined #oooq | 05:29 | |
*** bhagyashris has joined #oooq | 05:42 | |
*** dsneddon_ has joined #oooq | 06:00 | |
*** dsneddon_ has quit IRC | 06:05 | |
*** marios has joined #oooq | 06:18 | |
*** kopecmartin|off is now known as kopecmartin | 06:20 | |
*** bhagyashris_ has joined #oooq | 06:24 | |
*** bhagyashris has quit IRC | 06:27 | |
*** ykarel is now known as ykarel|afk | 06:27 | |
*** bhagyashris__ has joined #oooq | 06:28 | |
*** bhagyashris_ has quit IRC | 06:29 | |
*** jtomasek has joined #oooq | 06:36 | |
*** saneax has joined #oooq | 06:47 | |
*** jfrancoa has joined #oooq | 06:54 | |
soniya29 | kopecmartin, Is subunit_describe_calls dependent on tempest? | 07:01 |
---|---|---|
*** dsneddon_ has joined #oooq | 07:01 | |
*** dsneddon_ has quit IRC | 07:06 | |
*** dsneddon_ has joined #oooq | 07:09 | |
*** bhagyashris__ is now known as bhagyashris | 07:09 | |
kopecmartin | soniya29: I'd say no, I don't see any tempest imports in the source file | 07:11 |
*** raukadah is now known as chandankumar | 07:13 | |
*** akahat has joined #oooq | 07:13 | |
*** dsneddon_ has quit IRC | 07:14 | |
*** ccamacho has joined #oooq | 07:27 | |
*** dsneddon_ has joined #oooq | 07:33 | |
*** dsneddon_ has quit IRC | 07:37 | |
*** ccamacho has quit IRC | 07:39 | |
*** surpatil is now known as surpatil|lunch | 07:44 | |
*** ykarel|afk has quit IRC | 07:55 | |
*** ykarel|afk has joined #oooq | 07:55 | |
*** sshnaidm is now known as sshnaidm|off | 07:58 | |
chandankumar | marios: arxcruz panda zbr \o/ I am back finally :-) | 08:18 |
*** tosky has joined #oooq | 08:20 | |
marios | chandankumar: welcome back :) | 08:20 |
*** apetrich has joined #oooq | 08:26 | |
*** amoralej|off is now known as amoralej | 08:32 | |
*** ccamacho has joined #oooq | 08:33 | |
*** dsneddon_ has joined #oooq | 08:33 | |
*** skramaja has quit IRC | 08:36 | |
*** skramaja has joined #oooq | 08:36 | |
*** dsneddon_ has quit IRC | 08:38 | |
*** jbadiapa has joined #oooq | 08:43 | |
arxcruz | chandankumar: welcome back | 08:44 |
zbr | welcome back | 08:48 |
*** d0ugal has joined #oooq | 08:50 | |
*** surpatil|lunch is now known as surpatil | 08:50 | |
*** jpena|off is now known as jpena | 08:57 | |
*** saneax has quit IRC | 09:07 | |
zbr | fyi: friends don't let friends attempt to upgrade c7 to c8, .... is futile. | 09:10 |
*** dsneddon_ has joined #oooq | 09:21 | |
*** dsneddon_ has quit IRC | 09:26 | |
chandankumar | marios: arxcruz zbr Thanks :-) | 09:28 |
*** dtantsur|afk is now known as dtantsur | 09:33 | |
*** ykarel|afk is now known as ykarel | 09:33 | |
*** d0ugal has quit IRC | 09:38 | |
*** d0ugal has joined #oooq | 09:38 | |
*** saneax has joined #oooq | 10:02 | |
*** tosky_ has joined #oooq | 10:08 | |
*** tosky is now known as Guest94751 | 10:08 | |
*** tosky_ is now known as tosky | 10:08 | |
*** Guest94751 has quit IRC | 10:09 | |
*** dsneddon_ has joined #oooq | 10:22 | |
*** d0ugal has quit IRC | 10:25 | |
*** d0ugal has joined #oooq | 10:26 | |
*** dsneddon_ has quit IRC | 10:27 | |
*** bhagyashris has quit IRC | 11:06 | |
*** dsneddon_ has joined #oooq | 11:15 | |
*** bhagyashris has joined #oooq | 11:29 | |
ykarel | arxcruz, chandankumar can u check my comment https://review.opendev.org/#/c/673400/ | 11:39 |
ykarel | the same issue can be with other featuresets | 11:40 |
*** rfolco has joined #oooq | 11:44 | |
*** epoojad1 has quit IRC | 11:49 | |
*** bhagyashris has quit IRC | 11:53 | |
*** bhagyashris has joined #oooq | 11:53 | |
arxcruz | ykarel: i think this is something that chandankumar can answer you :) | 12:07 |
arxcruz | the installation if i recall correctly is on the quickstart.sh | 12:08 |
ykarel | arxcruz, ack | 12:08 |
*** bhagyashris has quit IRC | 12:13 | |
*** jpena is now known as jpena|lunch | 12:31 | |
*** ykarel is now known as ykarel|afk | 12:35 | |
*** skramaja has quit IRC | 12:38 | |
*** dsneddon_ has quit IRC | 12:41 | |
*** ratailor has quit IRC | 12:41 | |
*** weshay_ptg is now known as weshay | 12:52 | |
weshay | 0/ | 12:52 |
*** rlandy has joined #oooq | 12:53 | |
*** rlandy is now known as rlandy|ruck | 12:53 | |
zbr | weshay: o/ nice to see you back! | 12:53 |
weshay | aye.. good to be back :) | 12:54 |
zbr | let me know when you have few free minutes, i want to ask you something re rdo | 12:54 |
weshay | zbr, I'm on the hangout if you want to join early | 12:57 |
zbr | sure, joining now, is re https://tree.taiga.io/project/tripleo-ci-board/issue/1387? | 12:57 |
chandankumar | ykarel|afk: commented | 12:58 |
*** weshay is now known as weshay|rover | 13:01 | |
ykarel|afk | chandankumar, ack looking | 13:04 |
arxcruz | https://bugs.launchpad.net/tripleo/+bug/1841941 | 13:07 |
openstack | Launchpad bug 1841941 in tripleo "Cannot run scenario4 on rhel8 due to missing pcs required by manila" [Critical,In progress] - Assigned to Tom Barron (tpb) | 13:07 |
weshay|rover | arxcruz, well done knocking out 1318, please fold into 1321 and help push the centos8 scen000 job along | 13:13 |
arxcruz | weshay|rover: ok | 13:14 |
weshay|rover | arxcruz, thank you | 13:14 |
*** surpatil has quit IRC | 13:16 | |
rlandy|ruck | amoralej: hi ... in https://bugs.launchpad.net/tripleo/+bug/1851847 bandini says we have a mismatch of the version of pacemaker/pcs/corosync/libqb between host and containers. I see some version coming from rhui per http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-master/e14e45e/logs/overcloud-controller-2/var/log/extra/packag | 13:16 |
openstack | Launchpad bug 1851847 in tripleo "rhel-8-scenario004 fails to deploy standalone - error while resolving custom fact \"rabbitmq_nodename\": undefined method `[]' for nil:NilClass"" [Critical,Triaged] - Assigned to Ronelle Landy (rlandy) | 13:16 |
rlandy|ruck | e-list-installed.txt.gz | 13:16 |
amoralej | let me check | 13:17 |
rlandy|ruck | is there some way to match the versions | 13:17 |
ykarel|afk | chandankumar, okk got the issue, commented on review | 13:18 |
amoralej | rlandy|ruck, i see the same releases | 13:20 |
amoralej | in container and in host | 13:20 |
amoralej | http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-master/e14e45e/logs/overcloud-controller-2/var/log/extra/podman/containers/rabbitmq-bundle-podman-2/podman_info.log.txt.gz | 13:21 |
amoralej | pacemaker.x86_64 2.0.2-3.el8 @rhui-rhel-8-for-x86_64-highavailability-rhui-rpms | 13:21 |
chandankumar | panda: https://github.com/containers/libpod/pull/4464 | 13:21 |
amoralej | same as in http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-rhel-8-ovb-3ctlr_1comp-featureset001-master/e14e45e/logs/overcloud-controller-2/var/log/extra/package-list-installed.txt.gz | 13:21 |
rlandy|ruck | let me check pcs/corosync/libqb on scenario004 as well | 13:22 |
zbr | zuul bug logged as https://bugs.launchpad.net/tripleo/+bug/1852078 | 13:23 |
openstack | Launchpad bug 1852078 in tripleo "rdo zuul has broken zuul logger for pre-runs" [Undecided,Triaged] | 13:23 |
zbr | weshay|rover: ^ i added alert to it, is enough? | 13:23 |
*** amoralej is now known as amoralej|lunch | 13:24 | |
*** aakarsh has joined #oooq | 13:28 | |
*** jpena|lunch is now known as jpena | 13:29 | |
*** dsneddon_ has joined #oooq | 13:31 | |
*** ykarel|afk is now known as ykarel | 13:34 | |
marios | https://paste.centos.org/view/56706f4e | 13:34 |
marios | [m@192 tripleo-heat-templates]$ diff ci/environments/scenario001-standalone.yaml ci/environments/scenario004-standalone.yaml |fpaste | 13:34 |
*** jaosorior has joined #oooq | 13:35 | |
*** dsneddon_ has quit IRC | 13:36 | |
chandankumar | ykarel: you are proposing a patch for the same? | 13:38 |
ykarel | chandankumar, nope | 13:38 |
ykarel | if possible can u take care | 13:39 |
chandankumar | ykarel: ack | 13:39 |
*** dsneddon_ has joined #oooq | 13:40 | |
*** aakarsh has quit IRC | 13:41 | |
*** dsneddon_ has quit IRC | 13:46 | |
*** dsneddon_ has joined #oooq | 13:53 | |
*** dsneddon_ has quit IRC | 13:58 | |
*** soniya29 has quit IRC | 13:58 | |
*** amoralej|lunch is now known as amoralej | 14:04 | |
*** dsneddon_ has joined #oooq | 14:18 | |
*** jschlueter has quit IRC | 14:21 | |
*** jschlueter has joined #oooq | 14:21 | |
*** dsneddon_ has quit IRC | 14:23 | |
marios | https://tree.taiga.io/project/tripleo-ci-board/task/1379?kanban-status=1447274 | 14:27 |
marios | chandankumar: ^ | 14:27 |
chandankumar | marios: done, thanks! | 14:29 |
*** aakarsh has joined #oooq | 14:31 | |
*** aakarsh|2 has joined #oooq | 14:37 | |
*** aakarsh has quit IRC | 14:40 | |
*** dsneddon_ has joined #oooq | 14:45 | |
rlandy|ruck | weshay|rover: marios: apologies, I know I asked this before, but what is the expectation for scneario004 on rhel? Do we expect it to pass in check? periodic? initially I dimissed the failurebit the check job isn't non-voting so I assume this should pass | 14:47 |
rlandy|ruck | we have diffrent failures on train and master | 14:47 |
*** jschlueter has quit IRC | 14:48 | |
*** jschlueter has joined #oooq | 14:49 | |
*** jschlueter has joined #oooq | 14:51 | |
marios | rlandy|ruck: afaik manila/pcs was the issue(card i pointed you at last time) but haven't been following lately for progress on that. is it still red? is it cos manila? maybe reach out to tbarron | 14:52 |
marios | rlandy|ruck: (still in call ) | 14:52 |
*** ykarel_ has joined #oooq | 14:54 | |
rlandy|ruck | chandankumar: I think we messed up the train standalone scenario jobs | 14:56 |
* rlandy|ruck puts in new review | 14:56 | |
*** ykarel_ has quit IRC | 14:56 | |
*** ykarel has quit IRC | 14:56 | |
*** ykarel_ has joined #oooq | 14:56 | |
*** dtrainor has joined #oooq | 15:00 | |
*** ykarel_ is now known as ykarel|away | 15:05 | |
*** jaosorior has quit IRC | 15:06 | |
rlandy|ruck | chandankumar: pls review https://review.rdoproject.org/r/23654 Change parenting of periodic scenario train jobs | 15:07 |
*** akahat has quit IRC | 15:13 | |
*** skramaja has joined #oooq | 15:20 | |
*** jaosorior has joined #oooq | 15:22 | |
*** TrevorV has joined #oooq | 15:31 | |
*** skramaja has quit IRC | 15:32 | |
chandankumar | rlandy|ruck: ok looking | 15:41 |
chandankumar | rlandy|ruck: thanks :-) | 15:47 |
*** jaosorior has quit IRC | 15:47 | |
rfolco | panda, I know what you must be doing there https://media1.giphy.com/media/ToMjGpIYtgvMP38WTFC/giphy.gif | 15:49 |
weshay|rover | panda, ping me tomorrow w/ your follow up questions / concerns k ? | 15:49 |
rfolco | panda, your cam was open, and we recorded | 15:49 |
marios | haha | 15:49 |
panda | weshay|rover: at this point I'll need a simulation of the workflow to not repeat the same question over and over | 15:50 |
panda | weshay|rover: simulation I mean a diagram, so maybe all the things I'm not seeing are there. | 15:50 |
panda | rfolco: never say no to panda | 15:51 |
rfolco | :) | 15:51 |
weshay|rover | panda, sure not a problem | 15:51 |
rlandy|ruck | chandankumar: going to try testproject those | 15:51 |
weshay|rover | rfolco, /me updates https://tree.taiga.io/project/tripleo-ci-board/us/1376?milestone=244669 | 15:53 |
weshay|rover | rfolco, I think we need to rewrite the description | 15:55 |
*** jaosorior has joined #oooq | 15:57 | |
*** jaosorior has quit IRC | 16:04 | |
*** jaosorior has joined #oooq | 16:05 | |
*** chandankumar has quit IRC | 16:05 | |
*** chandankumar has joined #oooq | 16:06 | |
*** saneax has quit IRC | 16:10 | |
weshay|rover | marios, panda getting good feedback from alex re: container builds and component pipeline | 16:24 |
panda | weshay|rover: meaning that they consider the idea positive, or you are receving meaningful contributions from the discussion ? | 16:25 |
*** dsneddon_ has quit IRC | 16:34 | |
marios | weshay|rover: panda /me almost out .. i will catchup on that tomorrow | 16:34 |
marios | weshay|rover: i'll check the logs | 16:34 |
marios | weshay|rover: oh, not in tripleo... where? | 16:34 |
*** dsneddon_ has joined #oooq | 16:38 | |
zbr | if anyone can have a brief look at this bindep-role path, it would be great https://review.opendev.org/#/c/693637/ -- before i ping infra about it. | 16:38 |
*** marios is now known as marios|out | 16:40 | |
*** dsneddon_ has quit IRC | 16:43 | |
marios|out | rlandy|ruck: :/ at https://review.opendev.org/#/c/675313/4 last 3 recheck... failed scen 2 then 1 then 4 fail. just rechecked. will revisit tomorrow /me off | 16:51 |
*** marios|out has quit IRC | 16:51 | |
*** jschlueter has quit IRC | 16:56 | |
*** dsneddon_ has joined #oooq | 16:57 | |
*** jschlueter has joined #oooq | 16:57 | |
rlandy|ruck | ugh rhel-8 is a mess | 17:02 |
*** jfrancoa has quit IRC | 17:02 | |
chandankumar | rlandy|ruck: weshay|rover zbr ssbarnea panda https://review.opendev.org/#/c/693698/ | 17:03 |
chandankumar | please have a look | 17:03 |
chandankumar | arxcruz: ^^ | 17:03 |
zbr | chandankumar: are these all ansible roles? why not using galaxy method? (requirements.yml) | 17:05 |
*** ykarel|away has quit IRC | 17:05 | |
chandankumar | zbr: as those are not on ansible-galaxy | 17:05 |
zbr | they don't have to be on galaxy, you can put git repo there | 17:06 |
chandankumar | zbr: we tried that part, it does not work | 17:06 |
zbr | glad to hear you tried. | 17:06 |
chandankumar | zbr: may be collection can help | 17:07 |
zbr | lets name these extas'extras because that is what there are | 17:07 |
chandankumar | zbr: https://docs.openstack.org/openstack-ansible-os_tempest/latest/user/installation.html | 17:07 |
chandankumar | https://opendev.org/openstack/openstack-ansible-os_tempest/src/branch/master/requirements.yml | 17:07 |
zbr | it was supposed to work, but i do not have time/energy to check it | 17:08 |
chandankumar | then ansible.cfg screwed us so followed that path | 17:08 |
chandankumar | zbr: we talked a lot about making zuul-jobs role platfrom agonstic during ptg following os_tempest model | 17:09 |
chandankumar | hope more will come soon | 17:09 |
chandankumar | *making platform | 17:10 |
chandankumar | rlandy|ruck: sshnaidm|off sorry this time no rdo duck so didnot collected that | 17:10 |
zbr | chandankumar: there is a LOT of work there, already started those that were blocking other changes. | 17:11 |
zbr | chandankumar: one first example: https://review.opendev.org/#/c/693637/ | 17:11 |
chandankumar | weshay|rover: zbr: arxcruz we also talked about getting hackmd on openstack.org hosted they are happy to host we need to provide patches there | 17:12 |
zbr | low hanging: https://code.engineering.redhat.com/gerrit/#/c/185020/ <-- chandankumar rlandy|ruck ? | 17:19 |
chandankumar | rlandy|ruck: when sagi is coming back? | 17:21 |
rlandy|ruck | chandankumar: tomorrow | 17:24 |
weshay|rover | chandankumar, oh really? | 17:24 |
weshay|rover | hackmd or the opensource version? | 17:24 |
chandankumar | weshay|rover: yes opensource version I talked with fungi and clark | 17:24 |
weshay|rover | chandankumar++ | 17:25 |
rlandy|ruck | looking | 17:25 |
chandankumar | they will sort out login stuff letter | 17:25 |
weshay|rover | well done | 17:25 |
chandankumar | zbr: if you want to maintain so zuul jobs role, please talk with jblair he will add as a co maintainer they are looking for people who wants to maintain the role | 17:26 |
weshay|rover | zbr, want to chat about lint jobs for a sec? | 17:26 |
weshay|rover | irc or video, don't care | 17:26 |
chandankumar | i mean some specific roles like bindep as you are mastee there | 17:26 |
chandankumar | *master | 17:27 |
weshay|rover | rlandy|ruck, rhel-8.. scenario-4... is fs001 also failing still? | 17:27 |
zbr | chandankumar: glad to help improving coverage on them for our platforms, we should have done this long time ago. | 17:28 |
chandankumar | zbr: :-) | 17:28 |
weshay|rover | rlandy|ruck, need help? | 17:29 |
zbr | weshay|rover: ready | 17:29 |
chandankumar | zbr: https://etherpad.openstack.org/p/OpenDev-Shanghai-PTG-2019 check line no 129 | 17:30 |
chandankumar | you might like it, we try to include most of the stuff there which was in my head | 17:30 |
chandankumar | mhu is going to help us on that | 17:30 |
rlandy|ruck | weshay|rover: actually yes | 17:30 |
weshay|rover | rlandy|ruck, k.. point me at something | 17:31 |
rlandy|ruck | weshay|rover: it's not clear to me what should and should not be passing | 17:31 |
rlandy|ruck | https://bugs.launchpad.net/tripleo/+bug/1851847 is the starter bug | 17:31 |
openstack | Launchpad bug 1851847 in tripleo "rhel-8-scenario004 fails to deploy standalone - error while resolving custom fact \"rabbitmq_nodename\": undefined method `[]' for nil:NilClass"" [Critical,Triaged] - Assigned to Ronelle Landy (rlandy) | 17:31 |
zbr | chandankumar: ahh, i see it but is not so easy. | 17:31 |
rlandy|ruck | we had rhel-8 containers build failing for a while | 17:31 |
weshay|rover | rlandy|ruck, michele said there was a mispatch of rpms on the node and containers right? | 17:31 |
rlandy|ruck | when that started passing, | 17:32 |
rlandy|ruck | this hit | 17:32 |
chandankumar | zbr: it is just a config change on rdo as well as a rfe for gerrit for depends-on | 17:32 |
chandankumar | future is bright there | 17:32 |
rlandy|ruck | weshay|rover: ack - but I check it with amoralej - there is no mismatch | 17:32 |
weshay|rover | rlandy|ruck, did you confirm? | 17:32 |
rlandy|ruck | weshay|rover: also there are bugs going back as far as 2017 with that mismatch problem | 17:32 |
amoralej | rlandy|ruck, you have more logs for failing jobs? | 17:33 |
rlandy|ruck | weshay|rover: yes - there are tow failing tests in master right now (we will talk train later) | 17:33 |
amoralej | rhui was updated with 8.1 | 17:33 |
rlandy|ruck | amoralej: same ovb fs001 on rhel and scenario004 | 17:33 |
rlandy|ruck | we have check and periodic failures there | 17:34 |
rlandy|ruck | weshay|rover: so originally I didn't even know if we expected a pass out of scenario004 on rhel but for sure ovb should pass | 17:35 |
weshay|rover | rlandy|ruck, yes.. both should pass.. we've had both passing previously | 17:35 |
rlandy|ruck | weshay|rover: now on train ovb is passing | 17:35 |
weshay|rover | zbr, ping me please | 17:35 |
rlandy|ruck | rhel-8 scenario004 is not - but I just made an update there | 17:36 |
weshay|rover | nice | 17:36 |
weshay|rover | ok.. I'll look at that in a sec | 17:36 |
rlandy|ruck | so there we are | 17:36 |
rlandy|ruck | amoralej: "rhui was updated with 8.1" - when did that happen? | 17:37 |
rlandy|ruck | you are right - though - afiact there is no mismatch | 17:37 |
rlandy|ruck | I checked all nodes | 17:37 |
chandankumar | rlandy|ruck: amoralej are we also updating rhel nodepool image to 8.1? | 17:37 |
amoralej | not sure | 17:37 |
rlandy|ruck | that would not impact ovb | 17:37 |
rlandy|ruck | even if it was a standlaone issue | 17:38 |
chandankumar | having the latest image will help to troubleshoot podman related issue early in tripleo side | 17:38 |
rlandy|ruck | there is something up with master | 17:38 |
amoralej | chandankumar, last rhel8 image seems to have 8.1 | 17:38 |
amoralej | https://softwarefactory-project.io/nodepool-log/upstream-rhel-8-0000011236.log | 17:38 |
*** epoojad1 has joined #oooq | 17:38 | |
chandankumar | amoralej: ah, ok, thanks! | 17:39 |
rlandy|ruck | so we clearly have a pacemaker-related issue | 17:40 |
rlandy|ruck | https://review.rdoproject.org/r/#/c/23654/ | 17:41 |
rlandy|ruck | ^^ that's the train update | 17:41 |
rlandy|ruck | https://review.rdoproject.org/r/#/c/23558/ | 17:41 |
rlandy|ruck | and the testproject check on it | 17:41 |
rlandy|ruck | see scenario004 fails there as well - possibly different but better than the last trainfailure | 17:41 |
rlandy|ruck | checking now if we have a selinux issue | 17:45 |
rlandy|ruck | SELINUX=permissive | 17:48 |
rlandy|ruck | SELINUXTYPE=targeted | 17:48 |
rlandy|ruck | looks right | 17:48 |
rlandy|ruck | Nov 11 14:51:47 overcloud-controller-0 podman(galera-bundle-podman-2)[46881]: ERROR: Error: error checking path "/var/log/mariadb": stat /var/log/mariadb: no such file or directory | 17:49 |
rlandy|ruck | Nov 11 14:51:47 overcloud-controller-0 podman(galera-bundle-podman-2)[46888]: ERROR: podman failed to launch container | 17:49 |
rlandy|ruck | weshay|rover: any thoughts? | 17:52 |
* weshay|rover reads | 17:52 | |
rlandy|ruck | forget train for the moment | 17:53 |
rlandy|ruck | master | 17:53 |
weshay|rover | rlandy|ruck, ya.. so pacemaker is going to come from rhel and rhui | 17:53 |
weshay|rover | so we need to make sure that is in sync w/ dlrn.. michele can help ensure that. .but def.. master should be 8.1 | 17:54 |
weshay|rover | that mariadb issue looks like a rpm install issue | 17:55 |
weshay|rover | that's where I've seen that before | 17:55 |
weshay|rover | rlandy|ruck, a good question for michele and amoralej would be what version of pacemaker and rhel is appropriate for master / train | 17:56 |
weshay|rover | master and train | 17:56 |
rlandy|ruck | what part is coming from dlrn that would be out of sync | 17:56 |
weshay|rover | this has happened before | 17:56 |
rlandy|ruck | check the installed packages | 17:56 |
rlandy|ruck | they match | 17:56 |
weshay|rover | k.. I will | 17:56 |
amoralej | pacemaker is only from rhel | 17:56 |
weshay|rover | rlandy|ruck, still a good question to confirm in cix card what versions need to be available | 17:57 |
amoralej | i guess whatever in latest rhel should be good | 17:57 |
weshay|rover | right | 17:57 |
amoralej | but probably michele can confirm | 17:57 |
weshay|rover | ya.. I would assume so too, but better to confirm ^ ya | 17:57 |
weshay|rover | exactly | 17:57 |
amoralej | yep | 17:57 |
rlandy|ruck | the bug pretty much has that question | 17:57 |
rlandy|ruck | ie: where is the mismatch - but will ask more explicitly | 17:58 |
rlandy|ruck | this could have been a problem for a while but was caught behind container build failures | 17:58 |
rlandy|ruck | weshay|rover: (unrelated) the CIX card related to outdated proxy is still sitting on the board. The card has multiple -1's. Phil asks about that card every meeting. What do you want to do with that? | 18:04 |
weshay|rover | rlandy|ruck, also I think you could leverage your osp-16 standalone job | 18:04 |
weshay|rover | rlandy|ruck, plug in a scenario04 job and kick it.. the deps should be the same | 18:05 |
rlandy|ruck | ok - will try that | 18:05 |
rlandy|ruck | supposedly this was already addressed in downstream | 18:06 |
rlandy|ruck | https://review.rdoproject.org/r/#/c/23558/ | 18:06 |
*** jaosorior has quit IRC | 18:06 | |
rlandy|ruck | review on that would be appreciated | 18:06 |
weshay|rover | rlandy|ruck, +2 https://review.rdoproject.org/r/#/c/23654/ | 18:08 |
rlandy|ruck | thanks | 18:09 |
weshay|rover | holy cow tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039 is passing | 18:10 |
weshay|rover | ++++++ | 18:10 |
weshay|rover | to anyone involved in that mess | 18:11 |
rlandy|ruck | sometimes | 18:11 |
weshay|rover | rlandy|ruck, /me turns that on for promotion criteria | 18:11 |
rlandy|ruck | let me check current | 18:12 |
weshay|rover | https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039%09 | 18:12 |
rlandy|ruck | periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039-master | 18:12 |
rlandy|ruck | failed | 18:12 |
rlandy|ruck | rerunning | 18:12 |
weshay|rover | ok.. /me turned it on | 18:13 |
rlandy|ruck | https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039-master | 18:13 |
rlandy|ruck | somewhat stable | 18:13 |
*** jpena is now known as jpena|off | 18:14 | |
*** dtantsur is now known as dtantsur|afk | 18:20 | |
*** Goneri has joined #oooq | 18:25 | |
*** amoralej is now known as amoralej|off | 18:27 | |
zbr | weshay|rover: some good news, the pressure to get linters on centos-8 is lower as I got a new release on ansible-lint today. | 18:38 |
zbr | https://tree.taiga.io/project/tripleo-ci-board/issue/1347 -- i have 4 reviews ready-to-review here. | 18:38 |
zbr | what's the catch with ansible-lint that needs update? mainly old version lacked ability to detect playbook/roles and relied on giving them roles and playbooks, and not somethign else. | 18:39 |
zbr | this was fixed and now is able to discover them correctly | 18:39 |
zbr | due to old behavior/bug, lots of roles/playbooks where not scanned. | 18:40 |
*** Goneri has quit IRC | 19:11 | |
*** epoojad1 has quit IRC | 19:14 | |
rlandy|ruck | weshay|rover: we don't have a rhel 8.1 node downstream yet | 19:36 |
weshay|rover | rlandy|ruck, hrm.... rhos-delivery? | 19:36 |
rlandy|ruck | no infra | 19:37 |
rlandy|ruck | we have one rdolcoud | 19:37 |
rlandy|ruck | rdocloud | 19:37 |
rlandy|ruck | seeing if I can copy/add | 19:37 |
weshay|rover | ok.. rlandy|ruck thank you.. outside of zuul can you check to see if the node is built and available? | 19:38 |
weshay|rover | it's going to kill us if we're running on two different distros between upstream and internal | 19:38 |
rlandy|ruck | weshay|rover: it must be if rdocloud has it | 19:39 |
rlandy|ruck | rhel8 nodes on rdocloud were updated recently | 19:40 |
rlandy|ruck | https://phx2.cloud.rdoproject.org/dashboard/project/ngdetails/OS::Glance::Image/c73ac062-4304-42f1-8b80-cb292b9148b9 | 19:41 |
rlandy|ruck | Created At | 19:42 |
rlandy|ruck | 2019-11-11T16:02:50Z | 19:42 |
rlandy|ruck | Updated At | 19:42 |
rlandy|ruck | 2019-11-11T16:09:24Z | 19:42 |
weshay|rover | rlandy|ruck, it's my understanding the rhel8 nodes are built internally, and then uploaded to rdosf. So we "should" see the same image in internal sf | 19:43 |
*** aakarsh|3 has joined #oooq | 19:54 | |
rlandy|ruck | not here ... https://code.engineering.redhat.com/gerrit/gitweb?p=openstack/sf-config.git;a=blob;f=nodepool/nodepool.yaml | 19:56 |
*** aakarsh|2 has quit IRC | 19:57 | |
*** aakarsh|2 has joined #oooq | 20:21 | |
*** aakarsh|2 has quit IRC | 20:22 | |
*** aakarsh|3 has quit IRC | 20:23 | |
rlandy|ruck | Problem: package openstack-tripleo-image-elements-10.4.1-0.20190705161217.2c8a6a5.el8ost.noarch requires diskimage-builder, but none of the providers can be installed | 20:28 |
rlandy|ruck | weshay|rover: hmm ... this is hitting downstream now ^^ | 20:32 |
rlandy|ruck | https://sf.hosted.upshift.rdu2.redhat.com/logs/periodic/code.engineering.redhat.com/openstack/tripleo-ci-internal-jobs/master/tripleo-ci-rhel-8-standalone-rhos-15/bef11d0/logs/undercloud/home/zuul/install_packages.sh.log.txt.gz | 20:33 |
weshay|rover | none of the providers can be installed? /me looks | 20:33 |
weshay|rover | rlandy|ruck, hrm.. ok.. that is something jason can probably assist with.. but throw it into a boog first | 20:34 |
rlandy|ruck | might be missing from our repos | 20:35 |
rlandy|ruck | http://git.app.eng.bos.redhat.com/git/openstack/sf-config.git/tree/resources/tripleo-ci-internal.yaml#n137 | 20:37 |
rlandy|ruck | there | 20:37 |
rlandy|ruck | weshay|rover: getting somewhere now - we got a rhos-16 job running 'deploy the standalone' now | 21:37 |
rlandy|ruck | so can set up the scenario004 job | 21:38 |
weshay|rover | rlandy|ruck, ++ | 21:38 |
rlandy|ruck | lon fixed it | 21:38 |
rlandy|ruck | not me | 21:38 |
rlandy|ruck | weshay|rover: pls check https://code.engineering.redhat.com/gerrit/185113 | 22:44 |
weshay|rover | k | 22:45 |
rlandy|ruck | we have no mismatch on rhos-16 because it's using earlier version of pacemaker | 22:45 |
weshay|rover | hrm.. not sure if I understand that last statement | 22:46 |
rlandy|ruck | pacemaker.x86_64 2.0.1-4.el8_0.4 | 22:47 |
rlandy|ruck | vs | 22:47 |
rlandy|ruck | pacemaker.x86_64 2.0.2-3.el8 @rhui-rhel-8-for-x86_64-highavailability-rhui-rpms | 22:48 |
rlandy|ruck | rhos-16 vs master | 22:48 |
weshay|rover | ah perfect.. | 22:51 |
weshay|rover | so the pacemaker that is working is in OSP but busted in RHUI? | 22:52 |
weshay|rover | sounds like infra updated RHUI w/o testing | 22:52 |
rlandy|ruck | well it's a diff version | 22:53 |
rlandy|ruck | I need to figure out how to get the rhel 8.1 version installed | 22:54 |
rlandy|ruck | it exists | 22:54 |
weshay|rover | for osp-17? | 22:55 |
weshay|rover | or for the rhui? | 22:55 |
weshay|rover | hi sshnaidm|off :) | 22:56 |
weshay|rover | ur lurking :P | 22:56 |
sshnaidm|off | weshay|rover, :P | 22:56 |
* rlandy|ruck looks for 17 | 22:56 | |
weshay|rover | I don't think OSP-17 is stood up | 22:57 |
weshay|rover | not there | 22:57 |
rlandy|ruck | not there | 23:00 |
rlandy|ruck | so ... | 23:00 |
rlandy|ruck | rhos-release and rhui and different | 23:00 |
rlandy|ruck | ig=f I get this | 23:01 |
rlandy|ruck | if | 23:01 |
weshay|rover | ya.. we need rel-del / michele to advise.. you can drop it now.. you've done everything you can | 23:01 |
rlandy|ruck | I want to see scenario004 deploy | 23:01 |
rlandy|ruck | running now | 23:01 |
rlandy|ruck | on 16 | 23:02 |
*** TrevorV has quit IRC | 23:02 | |
rlandy|ruck | on the upside the stein fix is in gate now | 23:03 |
weshay|rover | nice | 23:10 |
weshay|rover | rlandy|ruck, thanks for totally rucking / rocking it !! | 23:10 |
* rlandy|ruck wants sshnaidm|off back :) | 23:11 | |
sshnaidm|off | rlandy|ruck, in 9 hours :) | 23:12 |
sshnaidm|off | 9.long.hours. | 23:12 |
rlandy|ruck | sshnaidm|off: no rush ... really | 23:13 |
sshnaidm|off | weshay|rover, would be an ansible based ovb something interesting? | 23:16 |
rlandy|ruck | periodic-tripleo-ci-rhel-8-scenario004-standalone-train - passes | 23:28 |
rlandy|ruck | OMG we should set up rhel train promotions | 23:29 |
rlandy|ruck | checkout the latest run | 23:29 |
rlandy|ruck | weshay|rover: ^^ | 23:29 |
* rlandy|ruck goes to the gym .. back later | 23:30 | |
*** rlandy|ruck is now known as rlandy|ruck|bbl | 23:31 | |
weshay|rover | I'll be back later.. my eyes were bleeding :) | 23:33 |
*** tosky has quit IRC | 23:44 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!