| *** dsneddon has quit IRC | 00:09 | |
| *** dsneddon has joined #oooq | 00:35 | |
| hubbot1 | All check jobs are working fine on master, stable/pike, master, stable/queens, stable/rocky, stable/ocata. | 00:54 |
|---|---|---|
| *** apetrich has quit IRC | 01:58 | |
| *** irclogbot_3 has joined #oooq | 02:05 | |
| *** irclogbot_3 has quit IRC | 02:13 | |
| *** irclogbot_1 has joined #oooq | 02:15 | |
| *** altlogbot_2 has joined #oooq | 02:17 | |
| *** irclogbot_1 has quit IRC | 02:19 | |
| *** altlogbot_2 has quit IRC | 02:34 | |
| hubbot1 | FAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.opendev.org/564291 | 02:54 |
| *** brault has joined #oooq | 03:08 | |
| *** slaweq has joined #oooq | 03:11 | |
| *** brault has quit IRC | 03:12 | |
| *** skramaja has joined #oooq | 03:14 | |
| *** skramaja has quit IRC | 03:14 | |
| *** slaweq has quit IRC | 03:15 | |
| *** irclogbot_0 has joined #oooq | 03:19 | |
| *** irclogbot_0 has quit IRC | 03:25 | |
| *** rlandy|bbl is now known as rlandy | 03:36 | |
| *** dsneddon has quit IRC | 03:46 | |
| *** altlogbot_0 has joined #oooq | 03:53 | |
| *** altlogbot_0 has quit IRC | 03:59 | |
| *** ykarel has joined #oooq | 04:10 | |
| *** dsneddon has joined #oooq | 04:12 | |
| *** udesale has joined #oooq | 04:13 | |
| hubbot1 | FAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.opendev.org/564291 | 04:54 |
| *** marios has joined #oooq | 05:05 | |
| *** jfrancoa has joined #oooq | 05:07 | |
| *** jfrancoa has quit IRC | 05:13 | |
| *** dsneddon has quit IRC | 05:21 | |
| marios | sshnaidm|ruck: o/ is this what you were asking me about last night? | 05:23 |
| marios | https://review.opendev.org/#/c/670168/ sshnaidm|ruck | 05:24 |
| * marios biab | 05:24 | |
| *** marios has quit IRC | 05:24 | |
| *** jfrancoa has joined #oooq | 05:27 | |
| *** ccamacho has quit IRC | 05:33 | |
| *** skramaja has joined #oooq | 05:34 | |
| *** dsneddon has joined #oooq | 05:52 | |
| *** dsneddon has quit IRC | 05:56 | |
| *** Goneri has joined #oooq | 06:00 | |
| *** saneax has joined #oooq | 06:04 | |
| *** holser_ has joined #oooq | 06:09 | |
| *** slaweq has joined #oooq | 06:11 | |
| *** dsneddon has joined #oooq | 06:13 | |
| *** ccamacho has joined #oooq | 06:14 | |
| *** slaweq has quit IRC | 06:16 | |
| *** altlogbot_2 has joined #oooq | 06:17 | |
| *** dsneddon has quit IRC | 06:18 | |
| *** dsneddon has joined #oooq | 06:20 | |
| *** altlogbot_2 has quit IRC | 06:23 | |
| *** altlogbot_3 has joined #oooq | 06:23 | |
| *** dsneddon has quit IRC | 06:25 | |
| *** holser_ has quit IRC | 06:27 | |
| *** altlogbot_3 has quit IRC | 06:29 | |
| *** saneax has quit IRC | 06:31 | |
| *** marios has joined #oooq | 06:32 | |
| *** saneax has joined #oooq | 06:33 | |
| *** dsneddon has joined #oooq | 06:35 | |
| *** dsneddon has quit IRC | 06:39 | |
| *** slaweq has joined #oooq | 06:47 | |
| hubbot1 | FAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.opendev.org/564291 | 06:54 |
| *** altlogbot_0 has joined #oooq | 06:55 | |
| *** altlogbot_0 has quit IRC | 07:01 | |
| *** amoralej|off is now known as amoralej | 07:11 | |
| *** dsneddon has joined #oooq | 07:11 | |
| *** ccamacho has quit IRC | 07:12 | |
| *** ccamacho has joined #oooq | 07:12 | |
| *** irclogbot_1 has joined #oooq | 07:15 | |
| *** Goneri has quit IRC | 07:19 | |
| *** tosky has joined #oooq | 07:20 | |
| *** irclogbot_1 has quit IRC | 07:21 | |
| *** irclogbot_3 has joined #oooq | 07:23 | |
| *** dsneddon has quit IRC | 07:25 | |
| *** irclogbot_3 has quit IRC | 07:27 | |
| *** Goneri has joined #oooq | 07:33 | |
| *** ykarel is now known as ykarel|afk | 07:33 | |
| *** dsneddon has joined #oooq | 07:38 | |
| *** dsneddon has quit IRC | 07:42 | |
| *** jtomasek has joined #oooq | 07:44 | |
| *** altlogbot_3 has joined #oooq | 07:47 | |
| *** altlogbot_3 has quit IRC | 07:49 | |
| *** irclogbot_0 has joined #oooq | 07:51 | |
| *** irclogbot_0 has quit IRC | 07:55 | |
| *** ykarel|afk is now known as ykarel | 08:00 | |
| sshnaidm|ruck | marios, yes, trying to clean up the mess with job and branches | 08:02 |
| *** irclogbot_0 has joined #oooq | 08:07 | |
| sshnaidm|ruck | marios, can you revote? https://review.opendev.org/#/c/669913/ | 08:09 |
| *** irclogbot_0 has quit IRC | 08:13 | |
| *** holser_ has joined #oooq | 08:13 | |
| marios | sshnaidm|ruck: so i am still a bit confused... i mean i thought we wanted to guard against changes in master breaking the stein upgrade tasks but it seems like alex patches are the real reason we had that on master? | 08:14 |
| *** holser_ has quit IRC | 08:14 | |
| marios | sshnaidm|ruck: but i think i just confused myself. like even if you propose a change in e.g. tripleo-common, te job will be using the stein version of those packages so the change shouldn't affect it | 08:14 |
| *** dsneddon has joined #oooq | 08:14 | |
| *** holser_ has joined #oooq | 08:15 | |
| marios | sshnaidm|ruck: but i'm still a bit hazy on that | 08:15 |
| marios | sshnaidm|ruck: looking | 08:15 |
| sshnaidm|ruck | marios, Alex means we can't break something in rock-stein job by master patches | 08:16 |
| sshnaidm|ruck | tbh I also don't understand how it can be | 08:16 |
| marios | sshnaidm|ruck: well, 'master' for ci/oooq/extras cos they dn't have branches | 08:16 |
| marios | sshnaidm|ruck: like maybe thats the answer. for the branchless ones, we have to run it on master, cos there is no stein version of it. | 08:16 |
| sshnaidm|ruck | marios, we'll run this job on master in ci repos, that stays as is | 08:17 |
| sshnaidm|ruck | marios, but it was running on master of tht repo | 08:17 |
| marios | sshnaidm|ruck: and thats the answer to why we were running it on master/stein everywhere before, i.e. to guard for those projects that are branchless | 08:17 |
| sshnaidm|ruck | yeah | 08:17 |
| marios | 11:18 < sshnaidm|ruck> marios, but it was running on master of tht repo | 08:17 |
| marios | sshnaidm|ruck: yeah i think that's the mistake ^ | 08:17 |
| *** dsneddon has quit IRC | 08:19 | |
| marios | sshnaidm|ruck: merge 669913? | 08:19 |
| sshnaidm|ruck | marios, yep | 08:20 |
| sshnaidm|ruck | marios, let's see how it works tonight | 08:20 |
| *** jtomasek has quit IRC | 08:23 | |
| *** gkadam has joined #oooq | 08:28 | |
| *** udesale has quit IRC | 08:30 | |
| *** udesale has joined #oooq | 08:31 | |
| *** ykarel is now known as ykarel|lunch | 08:36 | |
| *** derekh has joined #oooq | 08:40 | |
| *** jtomasek has joined #oooq | 08:43 | |
| *** chem has joined #oooq | 08:45 | |
| hubbot1 | FAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.opendev.org/564291 | 08:54 |
| *** dsneddon has joined #oooq | 08:54 | |
| *** dtantsur|afk is now known as dtantsur | 08:57 | |
| *** dsneddon has quit IRC | 08:59 | |
| *** udesale has quit IRC | 09:08 | |
| *** udesale has joined #oooq | 09:09 | |
| *** Goneri has quit IRC | 09:10 | |
| *** ykarel|lunch is now known as ykarel | 09:11 | |
| *** Goneri has joined #oooq | 09:23 | |
| zbr | sshnaidm|ruck: marios : simple review : https://review.rdoproject.org/r/#/c/21435/ ? enables rhel8 testing | 09:32 |
| *** dsneddon has joined #oooq | 09:32 | |
| *** udesale has quit IRC | 09:37 | |
| *** dsneddon has quit IRC | 09:37 | |
| *** udesale has joined #oooq | 09:38 | |
| *** udesale has quit IRC | 09:40 | |
| *** udesale has joined #oooq | 09:41 | |
| sshnaidm|ruck | zbr, commented | 09:43 |
| zbr | sshnaidm|ruck: i seen it, is very debatable. required-project is needed for this specific role inside tripleo-ci repo, is not a specific requirement of the generic job. | 09:45 |
| zbr | it can be put in both places. the big issue with job is that if the need for more required-projects explodes it will affect zuul performance, as zuul will always clone all of them. | 09:46 |
| sshnaidm|ruck | zbr, it doesn't matter, we have ovb repo cloned, although it's required for ovb jobs only | 09:46 |
| sshnaidm|ruck | zbr, please don't put it in both places :) | 09:46 |
| sshnaidm|ruck | zbr, all we need to depend on should be in repos | 09:47 |
| *** irclogbot_1 has joined #oooq | 09:47 | |
| sshnaidm|ruck | zbr, otherwise you can't test together patch of tripleo-repos and tripleo-ci | 09:48 |
| zbr | sshnaidm|ruck: sure, now i see is inhered from tripleo-tox-molecule one, so i will remove it. | 09:48 |
| zbr | still there is one design issue that I do not like, maybe you know how to address | 09:49 |
| sshnaidm|ruck | zbr, yeah, but as we talked it should be in tripleo-ci too | 09:49 |
| zbr | the file filters, which now limit its execution but this means that once we enable molecule for other roles we may need to update the matching pattern | 09:50 |
| *** irclogbot_1 has quit IRC | 09:51 | |
| zbr | sshnaidm|ruck: how about: use "roles" in file pattern, so job would be trigger when any role is touched, this would avoid the need to update its definition. | 09:53 |
| sshnaidm|ruck | zbr, it means that all molecule jobs will start to execute then only one role is changed | 09:54 |
| sshnaidm|ruck | and this is waste of resources | 09:54 |
| sshnaidm|ruck | zbr, can we have multiple jobs with "files" for each one? | 09:54 |
| zbr | yep, that is why i asked. is a trade-off between flexibility and resource use. | 09:54 |
| zbr | yes we can | 09:55 |
| zbr | it can easily become very complex and very easy to miss changes that would affect a role | 09:55 |
| zbr | nobody can parse your ansible code to see that you do an include_role somewhere, or have it listed under dependencies. | 09:56 |
| sshnaidm|ruck | zbr, let's do how it's done in tripleo-ansible: https://github.com/openstack/tripleo-ansible/blob/master/zuul.d/molecule.yaml#L5 | 09:56 |
| sshnaidm|ruck | zbr, one file with all these jobs defined with "files" and one molecule-template that we'll include | 09:57 |
| zbr | sshnaidm|ruck: tripleo-ansible is a huge mess at this point, i am supposed to rework how molecule is called there but did not had time | 09:57 |
| zbr | look inside the tox.ini to realise it | 09:57 |
| zbr | i would rather prefer to add logic in pytest-molecule that detects which files were touched and be able to skip some of the tests | 09:58 |
| sshnaidm|ruck | zbr, looks fine.. what's the problem? | 09:58 |
| sshnaidm|ruck | zbr, and this could be a real mess | 09:59 |
| sshnaidm|ruck | zbr, better explicit than implicit | 09:59 |
| ykarel | sshnaidm|ruck, hi | 10:00 |
| zbr | sshnaidm|ruck: i think it was already fix, it used to have one tox env for each molecule test. it was looking like a nightmare. | 10:00 |
| ykarel | sshnaidm|ruck, is 1836047 queens only? | 10:00 |
| sshnaidm|ruck | "files:" directive is created for that purpose - not to detect changes | 10:01 |
| ykarel | if yes then fs039 queens is running from long and never passed | 10:01 |
| sshnaidm|ruck | ykarel, what is this number? :) | 10:01 |
| ykarel | sshnaidm|ruck, https://bugs.launchpad.net/tripleo/+bug/1836047 | 10:01 |
| openstack | Launchpad bug 1836047 in tripleo "Featureset039 job failing on overcloud_deploy step" [Critical,Triaged] | 10:01 |
| zbr | one thing that people do not realise is that ansible roles are do not really live in isolation, they have dependencies, and testing one almost always would need to use some other roles. this means that triggering testing only when roles/foo/.* is changed, is likely to miss lots of breakages. | 10:02 |
| *** udesale has quit IRC | 10:02 | |
| *** tosky has quit IRC | 10:02 | |
| *** udesale has joined #oooq | 10:02 | |
| *** udesale has quit IRC | 10:03 | |
| *** udesale has joined #oooq | 10:03 | |
| zbr | i personally think that we are trying to optimize the wrong thing, we have lots of fat-jobs doing full deployments and running for ~2h but we are afraid that molecule "unit" testing would waste resources. In fact we should better stop running deployments before we pass all units if we want to save resources. | 10:03 |
| zbr | true, if molecule job would start taking >1h, it we would need to think more about splitting and skipping but not before. | 10:05 |
| *** tosky has joined #oooq | 10:05 | |
| zbr | the developer can easily run only the test he wants via -k parameter provided by pytest. | 10:05 |
| *** bogdando has joined #oooq | 10:06 | |
| sshnaidm|ruck | ykarel, it passed here: https://review.opendev.org/#/c/669424/ | 10:07 |
| sshnaidm|ruck | ykarel, difficult to say, because it fails for different reasons, but I think master should be fine | 10:07 |
| sshnaidm|ruck | zbr, afaik ansible roles should be isolated and atomic | 10:08 |
| ykarel | sshnaidm|ruck, ^^ is master patch, the bug in question is mentioning queens | 10:08 |
| sshnaidm|ruck | zbr, if they are not, then it's different problem | 10:08 |
| ykarel | in queens fs039 never passed https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039&branch=stable%2Fqueens&result=SUCCESS | 10:08 |
| sshnaidm|ruck | ykarel, not sure about rocky, will check now.. stein passed too: https://review.opendev.org/#/c/670082/ | 10:09 |
| sshnaidm|ruck | ykarel, are we talking about periodic? | 10:09 |
| sshnaidm|ruck | ykarel, ohhh, damn, sorry | 10:10 |
| ykarel | sshnaidm|ruck, both periodic and check fs039 queens never passed | 10:10 |
| sshnaidm|ruck | ykarel, yes, it never worked in queens | 10:10 |
| ykarel | yes | 10:10 |
| * sshnaidm|ruck stares on arxcruz|rover | 10:10 | |
| sshnaidm|ruck | yeah, iirc Juan wanted to fix it and never got to it | 10:11 |
| sshnaidm|ruck | where is Juan btw | 10:11 |
| ykarel | afair he has changed responsibilities now, in different DFG | 10:11 |
| ykarel | sshnaidm|ruck, fyi in last sprint i added some jobs in bottom https://etherpad.openstack.org/p/ruckroversprint11, fs039 queens was one of them | 10:12 |
| ykarel | ^^ jobs had issues and needed fixes/cleanups | 10:12 |
| *** dsneddon has joined #oooq | 10:12 | |
| sshnaidm|ruck | ykarel, I'll remove it from all queens, it will never be fixed there | 10:14 |
| sshnaidm|ruck | just waste of resources | 10:14 |
| sshnaidm|ruck | ykarel, which else did you add? | 10:14 |
| *** chem has quit IRC | 10:15 | |
| ykarel | sshnaidm|ruck, Line 396 | 10:15 |
| ykarel | need to check again if some are fixed | 10:15 |
| *** chem has joined #oooq | 10:15 | |
| ykarel | but the fs037-queens -updates is also failing from long | 10:15 |
| sshnaidm|ruck | ykarel, yeah.. I'll go over it, need to add all these to periodic jobs | 10:17 |
| *** dsneddon has quit IRC | 10:17 | |
| sshnaidm|ruck | otherwise we don't see it | 10:17 |
| *** holser_ has quit IRC | 10:18 | |
| sshnaidm|ruck | arxcruz|rover, can you close this one please? It never worked in queens: https://bugs.launchpad.net/tripleo/+bug/1836047 | 10:18 |
| openstack | Launchpad bug 1836047 in tripleo "Featureset039 job failing on overcloud_deploy step" [Critical,Triaged] | 10:18 |
| ykarel | sshnaidm|ruck, ack, let me now if something is unclear there | 10:18 |
| ykarel | sshnaidm|ruck, btw i also added https://bugs.launchpad.net/tripleo/+bug/1836145 today, in case u missed it | 10:18 |
| openstack | Launchpad bug 1836145 in tripleo "[promotion][check][master] standalone upgrade job failing with: the role 'tripleo-docker-rm' was not found in role path" [Critical,Triaged] | 10:18 |
| sshnaidm|ruck | arxcruz|rover, actually it's duplicate of https://bugs.launchpad.net/tripleo/+bug/1821459 | 10:19 |
| openstack | Launchpad bug 1821459 in tripleo "featureset039 fails on queens as ipa is not set as dns server on overcloud nodes" [Medium,Triaged] | 10:19 |
| sshnaidm|ruck | ykarel, I think it's related to moving all roles from tripleo-common that was done recently.. | 10:19 |
| ykarel | sshnaidm|ruck, yes i added that in description and what is causing it i | 10:20 |
| sshnaidm|ruck | ha, really symlink.. | 10:20 |
| ykarel | symlinked role is not installed | 10:20 |
| *** holser_ has joined #oooq | 10:22 | |
| *** altlogbot_0 has joined #oooq | 10:25 | |
| *** altlogbot_0 has quit IRC | 10:29 | |
| chandankumar | marios: sshnaidm|ruck panda dumb-init is available in rhel-8 dlrn deps repo | 10:32 |
| *** altlogbot_2 has joined #oooq | 10:33 | |
| *** dsneddon has joined #oooq | 10:37 | |
| *** altlogbot_2 has quit IRC | 10:39 | |
| *** altlogbot_0 has joined #oooq | 10:39 | |
| *** irclogbot_2 has joined #oooq | 10:39 | |
| *** rascasoft has quit IRC | 10:40 | |
| *** rascasoft has joined #oooq | 10:41 | |
| arxcruz|rover | sshnaidm|ruck https://bugs.launchpad.net/tripleo/+bug/1835615 happened again today | 10:42 |
| openstack | Launchpad bug 1835615 in tripleo "Promotion jobs are failing with could not connect to cluster" [Critical,Triaged] | 10:42 |
| arxcruz|rover | http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-fedora-28-standalone-master/b6d4641/ | 10:42 |
| arxcruz|rover | ops | 10:42 |
| *** dsneddon has quit IRC | 10:42 | |
| arxcruz|rover | http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039-master/e5160ac/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz | 10:42 |
| sshnaidm|ruck | arxcruz|rover, did you see about queens above? | 10:43 |
| arxcruz|rover | sshnaidm|ruck no, | 10:43 |
| arxcruz|rover | sshnaidm|ruck sorry, my irc was disconected, and i did'nt notice | 10:44 |
| chandankumar | panda: Hello | 10:44 |
| *** altlogbot_0 has quit IRC | 10:45 | |
| *** irclogbot_2 has quit IRC | 10:45 | |
| arxcruz|rover | sshnaidm|ruck marked as duplicated | 10:45 |
| chandankumar | panda: where can I find the logs related to overcloud container image build? | 10:46 |
| panda | chandankumar: in triple-buildcontainer job, build.log | 10:46 |
| chandankumar | panda: I am building it locally | 10:46 |
| panda | chandankumar: then in build.log, or in the console output | 10:47 |
| chandankumar | panda: the box which is passed by weshay there I have build | 10:47 |
| chandankumar | currently 25 container built only | 10:47 |
| panda | chandankumar: did you build using kolla command directly ? | 10:48 |
| panda | chandankumar: you have to redirect the output then, no logging is done by default | 10:48 |
| chandankumar | panda: nope using overcloud container image build | 10:49 |
| chandankumar | I have not redirected the output | 10:49 |
| sshnaidm|ruck | arxcruz|rover, connection to cluster is a result of failure, not a reason | 10:50 |
| arxcruz|rover | sshnaidm|ruck, ack | 10:50 |
| panda | chandankumar: yep if you're using the command directly you need to redirect the output, it's not automatically logged | 10:52 |
| panda | chandankumar: uhm wait | 10:53 |
| hubbot1 | FAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.opendev.org/564291 | 10:54 |
| *** holser_ is now known as holser|burger | 10:55 | |
| *** altlogbot_0 has joined #oooq | 10:55 | |
| arxcruz|rover | are we allowed to do that again with hubbot1 ? | 10:57 |
| panda | chandankumar: there should be a build.log somewhere, created by the command | 10:58 |
| *** altlogbot_0 has quit IRC | 11:01 | |
| *** amoralej is now known as amoralej|lunch | 11:01 | |
| *** dsneddon has joined #oooq | 11:12 | |
| zbr | sshnaidm|ruck: i just seen the msg from wes from last night | 11:20 |
| sshnaidm|ruck | zbr, about..? | 11:21 |
| zbr | named "upstream job check queues" | 11:21 |
| *** tesseract has joined #oooq | 11:21 | |
| zbr | sshnaidm|ruck: arxcruz|rover: I think we need to sync over BJ about ^ and assure we do something ASAP. | 11:24 |
| arxcruz|rover | zbr sure, but i didn't get it... | 11:27 |
| arxcruz|rover | zbr didn't get the ASAP | 11:28 |
| *** udesale has quit IRC | 11:39 | |
| zbr | me neither. i added a comment. i guess if we agree on naming/terminology we should be able to proceed. | 11:46 |
| *** apetrich has joined #oooq | 11:46 | |
| zbr | arxcruz|rover: you can skip the brainstorming part, is not important right now. lets focus on first part. | 11:48 |
| arxcruz|rover | zbr not saying that, just wondering the asap :) | 11:49 |
| arxcruz|rover | i can brainstorm with you :P | 11:49 |
| zbr | in 1min... | 11:50 |
| chandankumar | sshnaidm|ruck: http://logs.openstack.org/90/667390/16/check/tripleo-ci-centos-7-containers-multinode-rocky/4b4fd51/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2019-07-11_11_30_54 | 11:53 |
| chandankumar | sshnaidm|ruck: is it a known issue? | 11:53 |
| sshnaidm|ruck | zbr, I'm trying to understand how this patch can help us and I can't | 11:54 |
| zbr | arxcruz|rover: sshnaidm|ruck https://bluejeans.com/2655417928 -- about job templates reorg | 11:54 |
| chandankumar | sshnaidm|ruck: sudo /usr/bin/tripleo-container-image-prepare failure | 11:55 |
| *** altlogbot_3 has joined #oooq | 11:55 | |
| *** ykarel is now known as ykarel|afk | 11:57 | |
| sshnaidm|ruck | zbr, in 15 mins | 11:58 |
| *** altlogbot_3 has quit IRC | 12:01 | |
| sshnaidm|ruck | zbr, arxcruz|rover ready? | 12:18 |
| arxcruz|rover | sshnaidm|ruck we are waiting for you :) | 12:18 |
| zbr | yes, waiting for you to join | 12:18 |
| *** amoralej|lunch is now known as amoralej | 12:23 | |
| *** ykarel|afk is now known as ykarel | 12:23 | |
| chandankumar | weshay: time for 1:1 | 12:30 |
| *** rlandy has joined #oooq | 12:30 | |
| ykarel | chandankumar, fyi fix for rocky issue you pasted above https://review.opendev.org/#/c/670065/ | 12:31 |
| ykarel | in caes u didn't find it already | 12:31 |
| *** irclogbot_2 has joined #oooq | 12:31 | |
| chandankumar | ykarel: cool, thanks :) | 12:32 |
| weshay | chandankumar hey.. joining | 12:32 |
| *** irclogbot_2 has quit IRC | 12:35 | |
| *** skramaja has quit IRC | 12:41 | |
| *** hamzy has quit IRC | 12:42 | |
| *** altlogbot_3 has joined #oooq | 12:49 | |
| rlandy | sshnaidm|ruck: https://review.opendev.org/#/c/668994/ removed the te-broker code per your comment - pls review | 12:50 |
| rlandy | chandankumar: ^^ | 12:50 |
| *** altlogbot_3 has quit IRC | 12:53 | |
| apetrich | weshay, I can't do the 1:1 at the new time. I have to take the kids to a doctor appointment. | 12:53 |
| hubbot1 | FAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.opendev.org/564291 | 12:54 |
| chandankumar | rlandy: cool | 12:59 |
| *** holser|burger is now known as holser_ | 13:00 | |
| * marios foreveralone scrum | 13:00 | |
| rfolco | chandankumar, weshay scrum time | 13:02 |
| weshay | https://review.rdoproject.org/r/21357 | 13:14 |
| weshay | https://review.opendev.org/670290 | 13:15 |
| weshay | sshnaidm|ruck rlandy panda ^ | 13:15 |
| weshay | https://review.opendev.org/669888 | 13:16 |
| marios | zbr: you should have write access now please check? | 13:17 |
| marios | zbr: see bluejeans chat please | 13:19 |
| sshnaidm|ruck | arxcruz|rover, then change your nick! :D | 13:19 |
| *** sshnaidm|ruck is now known as sshnaidm|rover | 13:20 | |
| *** arxcruz|rover is now known as arxcruz|ruck | 13:20 | |
| arxcruz|ruck | sshnaidm|rover, done | 13:20 |
| rlandy | zbr: re: your pipefail question | 13:29 |
| rlandy | zbr: check pvt | 13:29 |
| marios | rlandy: panda in 5 mins @ https://redhat.bluejeans.com/7661925373/ ? ok for you? we can also push to half hour from now if you like | 13:30 |
| rlandy | marios: ack | 13:30 |
| marios | rlandy: joining ? | 13:38 |
| *** irclogbot_2 has joined #oooq | 13:39 | |
| arxcruz|ruck | i'll be back in 1 hour ~ | 13:45 |
| *** irclogbot_2 has quit IRC | 13:45 | |
| *** hamzy has joined #oooq | 13:47 | |
| weshay | apetrich no prob | 13:50 |
| weshay | let's reschedule | 13:50 |
| *** udesale has joined #oooq | 13:56 | |
| rlandy | marios: pls see pvt re: question on doc | 14:01 |
| marios | panda: i hav no idea if you can hear me? lets drop? | 14:01 |
| *** dsneddon has quit IRC | 14:02 | |
| *** ccamacho has quit IRC | 14:03 | |
| *** ykarel is now known as ykarel|afk | 14:06 | |
| *** aakarsh has quit IRC | 14:09 | |
| *** dsneddon has joined #oooq | 14:09 | |
| marios | rlandy: ack checking | 14:14 |
| *** dsneddon has quit IRC | 14:15 | |
| *** aakarsh has joined #oooq | 14:35 | |
| *** dsneddon has joined #oooq | 14:37 | |
| *** dsneddon has quit IRC | 14:42 | |
| *** dsneddon has joined #oooq | 14:45 | |
| *** saneax has quit IRC | 14:54 | |
| hubbot1 | FAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.opendev.org/564291 | 14:54 |
| *** Vorrtex has joined #oooq | 15:02 | |
| marios | weshay: rhui stuffs added in https://tree.taiga.io/project/tripleo-ci-board/task/1167 | 15:05 |
| weshay | marios++ | 15:05 |
| hubbot1 | weshay: marios's karma is now 13 | 15:05 |
| marios | weshay: thanks but no big deal some scp :D | 15:10 |
| *** jfrancoa has quit IRC | 15:19 | |
| rlandy | rfolco: weshay: chandankumar: I am updating the release file ... wrt container settings | 15:21 |
| weshay | thanks | 15:21 |
| rlandy | docker_prep_prefix: centos-binary | 15:21 |
| rlandy | ^^ rhel-binary? | 15:21 |
| rlandy | ^^ redhat-binary? | 15:21 |
| rlandy | docker_ceph_namespace: docker.io/ceph | 15:22 |
| rlandy | docker_openshift_tag: v3.11.0 | 15:22 |
| rlandy | ^^ are there updated values here? | 15:22 |
| *** ykarel|afk is now known as ykarel|away | 15:23 | |
| rlandy | marios: 38.145.34.141/rcm-guest/rhel8-imgs/ is that http or https? | 15:24 |
| *** udesale has quit IRC | 15:28 | |
| rlandy | marios: https://review.opendev.org/#/c/669057/30..31/config/release/tripleo-ci/RedHat-8/master.yml correct? | 15:29 |
| marios | rlandy: time for call? | 15:29 |
| rlandy | ack | 15:29 |
| marios | rlandy: http is fine | 15:29 |
| marios | rlandy: don't know if it exposes https didn't try | 15:29 |
| weshay | rlandy sshnaidm|rover interview | 15:31 |
| *** Goneri has quit IRC | 15:32 | |
| *** dtantsur is now known as dtantsur|afk | 15:36 | |
| *** rfolco is now known as rfolco_brb | 15:43 | |
| arxcruz|ruck | sorry the delay, i had an emergency | 15:46 |
| *** dsneddon has quit IRC | 15:49 | |
| *** tosky has quit IRC | 15:53 | |
| *** dsneddon has joined #oooq | 15:56 | |
| *** dsneddon has quit IRC | 16:00 | |
| *** Vorrtex has quit IRC | 16:03 | |
| *** altlogbot_2 has joined #oooq | 16:04 | |
| *** altlogbot_2 has quit IRC | 16:07 | |
| *** bogdando has quit IRC | 16:13 | |
| *** dsneddon has joined #oooq | 16:19 | |
| *** dsneddon has quit IRC | 16:25 | |
| *** Vorrtex has joined #oooq | 16:27 | |
| weshay | marios rlandy sshnaidm|rover do you want to spend 10min now or later? | 16:32 |
| rlandy | weshay: ack - now | 16:32 |
| rlandy | while we remember :) | 16:32 |
| marios | weshay: sure lets talk your blue? | 16:33 |
| weshay | aye | 16:33 |
| rlandy | joining | 16:33 |
| *** dsneddon has joined #oooq | 16:36 | |
| *** tesseract has quit IRC | 16:36 | |
| *** dsneddon has quit IRC | 16:41 | |
| *** altlogbot_1 has joined #oooq | 16:44 | |
| *** gkadam has quit IRC | 16:46 | |
| *** altlogbot_1 has quit IRC | 16:49 | |
| *** ykarel|away has quit IRC | 16:51 | |
| *** dsneddon has joined #oooq | 16:51 | |
| hubbot1 | FAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.opendev.org/564291 | 16:54 |
| zbr | i am back | 16:58 |
| *** dsneddon has quit IRC | 16:59 | |
| *** marios is now known as marios|out | 17:05 | |
| *** dsneddon has joined #oooq | 17:07 | |
| sshnaidm|rover | arxcruz|ruck, can you please take a look tomorrow at lines 396-426 https://etherpad.openstack.org/p/ruckroversprint11 | 17:10 |
| sshnaidm|rover | arxcruz|ruck, I've started my weekend :) | 17:10 |
| arxcruz|ruck | sshnaidm|rover, ack, have a great weekend | 17:12 |
| weshay | sshnaidm|rover thanks... | 17:12 |
| weshay | arxcruz|ruck I got you covered | 17:12 |
| *** weshay is now known as weshay|rover | 17:12 | |
| sshnaidm|rover | arxcruz|ruck, weshay|rover update etherpad and I'll look in Sun | 17:12 |
| sshnaidm|rover | cu | 17:12 |
| *** sshnaidm|rover is now known as sshnaidm|off | 17:12 | |
| arxcruz|ruck | weshay|rover, danke boss :) | 17:12 |
| chandankumar | so finally clouds.yaml work done, I think no iteration is needed on patches | 17:13 |
| zbr | weshay|rover: how to determine which version of ansible we should test our (ci) roles with? for example tci has no version mentioned in-repo, and i need one for molecule. currently it just installs one, which happens to be 2.8 but this may cause problems if we run the same roles with 2.7 | 17:16 |
| *** marios|out has quit IRC | 17:16 | |
| zbr | should I use the version from tq reqs file as reference? | 17:16 |
| zbr | i want to avoid adding one version on each repository, as we do not want to spend eons bumping stuff. | 17:17 |
| weshay|rover | zbr test w/ the version specified in tq/requirements | 17:18 |
| zbr | ok | 17:19 |
| arxcruz|ruck | weshay|rover, btw https://review.rdoproject.org/r/#/c/21416/ you wanted also the check jobs for the reproducer, but sshnaidm|off said it's not necessary, let me know if shall i abandon or not | 17:22 |
| *** altlogbot_1 has joined #oooq | 17:22 | |
| chandankumar | weshay|rover: arxcruz|ruck we are cancelling the tempest meeting due to interview scheduled ahead | 17:22 |
| chandankumar | tomorrow | 17:22 |
| arxcruz|ruck | chandankumar, ack | 17:22 |
| chandankumar | arxcruz|ruck: panda we do want a prep call tomorrow before the interview/ | 17:23 |
| chandankumar | ? | 17:23 |
| arxcruz|ruck | chandankumar up to you man, if you think we need, why not | 17:24 |
| arxcruz|ruck | chandankumar what i want from you tomorrow morning, is to test the tmate | 17:24 |
| arxcruz|ruck | the vm is up and running | 17:24 |
| *** altlogbot_1 has quit IRC | 17:25 | |
| chandankumar | arxcruz|ruck: ping me then in tomorrow morning | 17:25 |
| *** rfolco_brb is now known as rfolco | 17:27 | |
| *** altlogbot_0 has joined #oooq | 17:30 | |
| *** holser_ has quit IRC | 17:31 | |
| zbr | weshay|rover: how about f28 testing? should I make the upstream molecule use only centos7 or also keep fedora alongside? downsides: more CPU power needed during execution if we test multiple platforms in parallel on the same job. Effective slowdown is not very big but could be annoying for localruns. if we stick to only one platform we lack the benefit of seeing tasks execution results side by side and compare. | 17:31 |
| *** vinaykns has joined #oooq | 17:33 | |
| *** altlogbot_0 has quit IRC | 17:35 | |
| *** altlogbot_3 has joined #oooq | 17:36 | |
| chandankumar | zbr: is it possible to run molecule jobs using rdo-cloud rhel-8 nodepool image? | 17:37 |
| chandankumar | it will also help us to discover issues | 17:38 |
| weshay|rover | rfolco chandankumar? | 17:38 |
| weshay|rover | who's on the box | 17:38 |
| rfolco | weshay|rover, me | 17:38 |
| rfolco | just looking wht is built | 17:38 |
| * chandankumar is not | 17:38 | |
| weshay|rover | rfolco hey.. /me trying again w/ selinux in permissve | 17:38 |
| rfolco | not changing anything | 17:38 |
| rfolco | ah ok | 17:38 |
| zbr | chandankumar: at the moment we use ubi8 image for that, molecule runs docker containers only. | 17:38 |
| rfolco | who did change to localhost 8787 | 17:38 |
| weshay|rover | rfolco memory issues and selinux both silent killers | 17:38 |
| weshay|rover | rfolco blue | 17:39 |
| rfolco | weshay|rover, need 15 min. Will uber my wife at doctor | 17:39 |
| rfolco | brb | 17:39 |
| weshay|rover | np | 17:39 |
| chandankumar | zbr: what about using rfolco rhel8 rhui container for that? | 17:41 |
| *** altlogbot_3 has quit IRC | 17:41 | |
| zbr | chandankumar: that is the plan, i am only waiting for a msg from him regarding when I can start consuming it. | 17:41 |
| *** altlogbot_3 has joined #oooq | 17:42 | |
| zbr | mostly is a config switch away | 17:42 |
| *** amoralej is now known as amoralej|off | 17:44 | |
| *** altlogbot_3 has quit IRC | 17:45 | |
| *** tcw has quit IRC | 17:53 | |
| *** rlandy_ has joined #oooq | 17:56 | |
| *** rlandy_ has quit IRC | 17:58 | |
| *** rlandy_ has joined #oooq | 17:58 | |
| *** rlandy has quit IRC | 17:59 | |
| zbr | rlandy_ or rfolco : any chance to get https://review.opendev.org/#/c/670132/ merged? i already tested the approach in another place: https://review.rdoproject.org/r/#/c/18627/34/ci-scripts/infra-setup/roles/hubbot/molecule/default/molecule.yml | 18:04 |
| *** rlandy_ is now known as rlandy | 18:05 | |
| zbr | regarding lowering the number of jobs run, I wonder if it would make sense to add ".*molecule.*" as ignore pattern for all full jobs. This should allow us to change molecule exclusive code and avoid running any deployments when we do. | 18:08 |
| zbr | if a change contains only files with molecule in their paths, it is clearly not something that could affect deployment, so we should be safe to run only linters and tox* jobs on it. | 18:08 |
| rfolco | weshay|rover, so whats the current state of container build ? | 18:16 |
| weshay|rover | nothing has changed.. I'm collecting debug info in a doc for a wider audience | 18:17 |
| weshay|rover | rfolco shall we try once more w/ sudo? | 18:18 |
| rfolco | weshay|rover, yes, and then build podman/buildah from source perhaps ? | 18:19 |
| weshay|rover | rfolco ya.. let's hold on the from src | 18:19 |
| weshay|rover | for the moment | 18:19 |
| rfolco | k | 18:19 |
| weshay|rover | rfolco check the build.sh script please | 18:20 |
| rfolco | weshay|rover, updated the script, can I prune system? | 18:22 |
| rfolco | oh just saw | 18:23 |
| rfolco | k | 18:23 |
| weshay|rover | rfolco aye.. and rerun | 18:23 |
| *** dsneddon has quit IRC | 18:24 | |
| rfolco | weshay|rover, did you apply selinux stuff from buildcontainer role ? | 18:28 |
| weshay|rover | rfolco no.. but we should set selinux to perm there too | 18:29 |
| rfolco | weshay|rover, hold on, looking for full docker option on selinux | 18:32 |
| weshay|rover | rfolco? | 18:32 |
| rfolco | weshay|rover, oh nm... this is for local registry setup | 18:32 |
| rfolco | weshay|rover, ignore me | 18:33 |
| rfolco | weshay|rover, kolla-build.conf is in /home/zuul.... need to change that if running as root I guess | 18:35 |
| rfolco | full path | 18:35 |
| weshay|rover | ah.. | 18:36 |
| weshay|rover | rfolco hrm.. | 18:36 |
| weshay|rover | root has access to /home/zuul | 18:36 |
| weshay|rover | rfolco we may be more likely to see a real trace by running outside a script at this point | 18:47 |
| rfolco | k | 18:47 |
| weshay|rover | rfolco can we blue | 18:48 |
| weshay|rover | ? | 18:48 |
| rfolco | weshay|rover, joining | 18:49 |
| weshay|rover | rfolco we need to rebuild the image I guess | 18:49 |
| weshay|rover | or pull it | 18:50 |
| rfolco | aaah yes, lets build it | 18:50 |
| rlandy | zbr: starting by merging https://review.rdoproject.org/r/#/c/21435/ | 18:50 |
| rlandy | zbr: done | 18:53 |
| weshay|rover | rfolco https://docs.google.com/document/d/1IME-7SYwrVgHpPHja-6O4S60C3N0nZYcuuQjva4lReI/edit# | 18:53 |
| rlandy | ok - bye-bye old laptop switch over is final | 18:54 |
| hubbot1 | FAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.opendev.org/564291 | 18:54 |
| rlandy | zbr: I'll trade with you - how about you review this one https://review.opendev.org/#/c/668994/? | 19:04 |
| rlandy | if that is approved, I will remove the other dlrnapi-client mess | 19:05 |
| *** derekh has quit IRC | 19:05 | |
| rlandy | zbr: need to drop something off at post office - will be biab | 19:09 |
| rlandy | pls leave your review here when you are done and I'll look at it | 19:09 |
| *** rlandy is now known as rlandy|brb | 19:10 | |
| *** tosky has joined #oooq | 19:26 | |
| *** irclogbot_2 has joined #oooq | 19:28 | |
| *** irclogbot_2 has quit IRC | 19:33 | |
| *** altlogbot_3 has joined #oooq | 19:38 | |
| *** altlogbot_3 has quit IRC | 19:41 | |
| *** sabedevops has joined #oooq | 19:59 | |
| *** rlandy|brb is now known as rlandy | 20:02 | |
| *** irclogbot_1 has joined #oooq | 20:12 | |
| weshay|rover | rfolco you with me? | 20:14 |
| rfolco | weshay|rover, I can hear | 20:14 |
| *** irclogbot_1 has quit IRC | 20:16 | |
| *** brault has joined #oooq | 20:16 | |
| *** brault has quit IRC | 20:17 | |
| *** dsneddon has joined #oooq | 20:20 | |
| rlandy | weshay|rover: rfolco: hmmm ... we're competing for rhel8 nodepool nodes | 20:30 |
| weshay|rover | rlandy GIMMIE GIMMIE | 20:30 |
| rlandy | weshay|rover: I'll drop my job review to run on the check and not the periodic | 20:31 |
| rlandy | weshay|rover: seeing if I can edit availability | 20:31 |
| weshay|rover | rlandy I'm kidding | 20:31 |
| rlandy | so there are nodes available | 20:31 |
| rlandy | weshay|rover: no it's fine - if I can't fix ^^ | 20:31 |
| rlandy | checking sf config | 20:32 |
| *** sabedevops has quit IRC | 20:41 | |
| *** Vorrtex has quit IRC | 20:44 | |
| rlandy | weshay|rover: hmmm ... min_ready is there .. https://softwarefactory-project.io/cgit/config/tree/nodepool/rdo-cloud.yaml#n277 | 20:44 |
| weshay|rover | ah.. let's make that 5 | 20:45 |
| rlandy | weshay|rover: all the others are min_ready 1 | 20:45 |
| rlandy | and we almost never wait | 20:45 |
| weshay|rover | ah.. see that | 20:45 |
| weshay|rover | hrm | 20:45 |
| rlandy | asking o #sf-ps | 20:45 |
| rlandy | sf-ops | 20:45 |
| hubbot1 | FAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.opendev.org/564291 | 20:55 |
| *** hamzy has quit IRC | 20:56 | |
| *** altlogbot_0 has joined #oooq | 21:00 | |
| rlandy | weshay|rover: pls see sf-ops | 21:04 |
| *** altlogbot_0 has quit IRC | 21:05 | |
| rlandy | ha | 21:09 |
| rlandy | how did your job start before mine??? | 21:10 |
| rlandy | weshay|rover: ^^??? | 21:10 |
| rlandy | did you pull rank | 21:10 |
| *** aakarsh has quit IRC | 21:10 | |
| rlandy | ok - now mine started | 21:10 |
| weshay|rover | lolz... just guys are just lucky :) | 21:10 |
| weshay|rover | no need for rank.. when ur lucky | 21:10 |
| rlandy | you said a mouthful there | 21:10 |
| rlandy | this is the true reason why there are so few women in open source!!! | 21:11 |
| rlandy | your jobs never start | 21:11 |
| *** derekh has joined #oooq | 21:13 | |
| *** derekh has quit IRC | 21:13 | |
| rlandy | weshay|rover: seriously though, have a minute to chat about the two build_images roles? | 21:14 |
| weshay|rover | sure | 21:21 |
| weshay|rover | blue | 21:21 |
| *** irclogbot_3 has joined #oooq | 21:22 | |
| *** sabedevops has joined #oooq | 21:22 | |
| *** sabedevops has quit IRC | 21:22 | |
| rlandy | weshay|rover: ack | 21:22 |
| *** aakarsh has joined #oooq | 21:23 | |
| *** irclogbot_3 has quit IRC | 21:26 | |
| *** irclogbot_0 has joined #oooq | 21:28 | |
| *** irclogbot_0 has quit IRC | 21:32 | |
| *** aakarsh has quit IRC | 21:32 | |
| *** aakarsh has joined #oooq | 21:42 | |
| *** hamzy has joined #oooq | 22:07 | |
| *** altlogbot_2 has joined #oooq | 22:16 | |
| *** altlogbot_2 has quit IRC | 22:17 | |
| *** altlogbot_1 has joined #oooq | 22:18 | |
| *** irclogbot_1 has joined #oooq | 22:18 | |
| *** altlogbot_1 has quit IRC | 22:23 | |
| *** irclogbot_1 has quit IRC | 22:24 | |
| *** rfolco has quit IRC | 22:24 | |
| *** rfolco has joined #oooq | 22:24 | |
| *** jtomasek has quit IRC | 22:25 | |
| *** holser_ has joined #oooq | 22:29 | |
| hubbot1 | FAILING CHECK JOBS on stable/ocata: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 @ https://review.opendev.org/564291 | 22:55 |
| rlandy | weshay|rover: where is the bindep role? | 22:56 |
| *** altlogbot_2 has joined #oooq | 22:56 | |
| *** slaweq has quit IRC | 22:56 | |
| *** altlogbot_2 has quit IRC | 22:59 | |
| *** irclogbot_1 has joined #oooq | 23:00 | |
| *** irclogbot_1 has quit IRC | 23:06 | |
| *** tosky has quit IRC | 23:07 | |
| *** irclogbot_3 has joined #oooq | 23:08 | |
| *** holser_ has quit IRC | 23:13 | |
| *** irclogbot_3 has quit IRC | 23:16 | |
| *** altlogbot_2 has joined #oooq | 23:28 | |
| *** altlogbot_2 has quit IRC | 23:29 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!