Tuesday, 2019-07-02

*** d0ugal has quit IRC00:04
*** d0ugal has joined #oooq00:18
*** hamzy has quit IRC00:35
*** ccamacho has quit IRC01:00
*** ccamacho has joined #oooq01:02
*** ccamacho has quit IRC01:57
*** ccamacho has joined #oooq01:58
*** ccamacho has quit IRC01:58
*** ccamacho has joined #oooq01:59
*** ccamacho has quit IRC02:21
*** ccamacho has joined #oooq02:22
*** ccamacho has quit IRC02:31
*** ccamacho has joined #oooq02:31
*** ccamacho has quit IRC02:36
*** ccamacho has joined #oooq02:38
*** ccamacho has quit IRC02:48
*** ccamacho has joined #oooq02:51
*** ccamacho has quit IRC02:55
*** ccamacho has joined #oooq02:56
*** skramaja has joined #oooq03:06
*** ccamacho has quit IRC03:06
*** ykarel|away has joined #oooq03:11
*** hamzy has joined #oooq03:18
*** ykarel|away is now known as ykarel03:24
*** ccamacho has joined #oooq03:29
*** ccamacho has quit IRC03:35
*** ykarel is now known as ykarel|afk03:59
*** ykarel|afk has quit IRC04:06
*** udesale has joined #oooq04:14
*** ykarel|afk has joined #oooq04:34
*** ykarel|afk is now known as ykarel05:02
*** ykarel_ has joined #oooq05:26
*** ykarel has quit IRC05:28
*** udesale has quit IRC05:35
*** ykarel_ is now known as ykarel|meeting05:36
*** udesale has joined #oooq05:36
*** ratailor has joined #oooq05:42
*** ksambor has joined #oooq05:43
*** marios has joined #oooq05:46
*** jtomasek has joined #oooq06:15
*** slaweq has joined #oooq06:30
*** raukadah is now known as chandankumar06:46
*** amoralej|off is now known as amoralej07:05
*** saneax has joined #oooq07:06
*** tesseract has joined #oooq07:15
*** tosky has joined #oooq07:22
*** holser_ has joined #oooq07:38
*** tosky has quit IRC07:43
*** tosky has joined #oooq07:43
*** holser_ has quit IRC07:46
*** holser_ has joined #oooq07:47
*** fmount has quit IRC07:52
*** udesale has quit IRC08:05
*** ykarel_ has joined #oooq08:05
*** udesale has joined #oooq08:06
*** ykarel|meeting has quit IRC08:07
*** ratailor_ has joined #oooq08:08
*** ratailor has quit IRC08:10
*** fmount has joined #oooq08:19
*** ykarel_ has quit IRC08:32
*** sshnaidm|afk is now known as sshnaidm|ruck08:36
*** ykarel_ has joined #oooq08:37
*** ykarel_ is now known as ykarel|lunc08:37
*** ykarel|lunc is now known as ykarel|lunch08:38
zbrmarios: panda : re sagi question about new templates https://docs.google.com/document/d/1u2q7E6SceTo5AxJf4vr9mZK08iAGOhQNJQXSYW1nIVM/edit# and https://review.opendev.org/#/c/667423/6/zuul.d/templates.yaml@2108:51
zbrlets agree on some naming and make it happen, there will be many changes to do.08:52
*** ykarel|lunch is now known as ykarel08:54
sshnaidm|ruckzbr, it's already done in ovb: https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/project-templates.yaml#L42209:02
marioszbr: ack will hav a look09:02
sshnaidm|ruckarxcruz|rover, ykarel we promote master today09:02
arxcruz|roversshnaidm|ruck i saw, featureset039 was fixed :D09:03
arxcruz|roveri was worried about that :)09:03
zbrsshnaidm|ruck: i think that the idea was to get ok from the rest first. but we all know that this can take forever ;)09:03
sshnaidm|ruckarxcruz|rover, it didn't have a fix when ran a job, but I'll run it aside excluding from criteria09:03
ykarelsshnaidm|ruck, nice, but what about fs039?09:04
sshnaidm|ruckykarel, yeah, we talk about it09:04
sshnaidm|ruckykarel, arxcruz|rover had a patch to solve it yesterday, wasn't merged yet when job ran09:04
zbrwhatever naming we pick we need to be sure is writen in that document, in the end we will probably add it to the doc09:05
arxcruz|roverykarel the patch fixes the job, although on the patch the job is failing, but for another random reason, the playbook run fine09:05
sshnaidm|ruckykarel, I'll run it now in some patch, but it shouldn't be a problem, the error was in CI code09:05
sshnaidm|ruckarxcruz|rover, one tempest test failed, but I don't think it's critical: http://logs.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-7-standalone-full-tempest-master/14d4289/job-output.txt.gz09:05
ykarelsshnaidm|ruck, arxcruz|rover ack09:06
arxcruz|roversshnaidm|ruck yeah, it's timeout for random reason09:06
arxcruz|roversshnaidm|ruck i'm checking a failure on fs02109:07
sshnaidm|ruckand everything in 020 passed, but job stuck after tests, so it's infra issue09:07
arxcruz|roverhttps://trello.com/c/heGHieWu/991-cixlp1831223tripleociproa-rockyfs020-tempestapicomputeserverstestserversservershowv263test-failing09:07
*** jaosorior has joined #oooq09:13
sshnaidm|ruckchandankumar, should we use "nodepool-base" in https://softwarefactory-project.io/r/#/c/15855/ ?09:17
*** holser_ has quit IRC09:17
sshnaidm|ruckzbr, can you take a look please? http://logs.rdoproject.org/19/21319/1/check/tox-py27/37a6c77/tox/reports.html09:19
*** holser_ has joined #oooq09:19
sshnaidm|ruckzbr, seems like tox jobs are broken09:19
sshnaidm|ruckzbr, also, can you define them to run only on changes?09:19
zbrsshnaidm|ruck: i do not want that. but i know what broke it, fixing it now.09:22
sshnaidm|ruckzbr, this bug is promotion blocker now :D09:22
sshnaidm|ruckzbr, I really don't want to run molecule test on hubbot when changing configs of promotion..09:23
zbraparently last night release of selinux is broken, i deleted the relese. rebuil, it will work.09:23
zbri seen too often accidents caused by over-optimization of file patterns in zuul, far too often.09:24
zbrlike most jobs failing to be triggered when reqs.txt was updated, or having requirements-check broken for weeks but not knowing because is called only when reqs.txt is modified.09:25
sshnaidm|ruckzbr, I remove them from gate now, we'll add them when it's fixed09:25
zbrand guess what, the global reqs project change broke it09:25
zbrsshnaidm|ruck: run again, it will pass, i removed the broken release from pypi09:25
sshnaidm|ruckzbr, broken release of what?09:26
zbrssh https://pypi.org/manage/project/selinux/release/0.1.5/09:26
zbrthe previous version was ok, only that one was broken and I know what broke it, i guess from now I will check prereleases with molecule itself.09:28
sshnaidm|ruckzbr, ok, seems fine now09:32
*** chem has joined #oooq09:33
sshnaidm|ruckzbr, well, anyway, hubbot molecule test should be only when hubbot code changes or around09:33
sshnaidm|ruckzbr, we have very different and isolated part of code in this repo09:33
sshnaidm|ruckzbr, most of it is not related in any sense to other09:33
zbrwhat i am trying to explain is that there are signifiant external cases which ca break a role: reqs update, ansible new version, other modules, even a new platform/os release.09:34
*** udesale has quit IRC09:35
zbri am not totally against it, just trying to explain the side-effects of skips09:35
*** udesale has joined #oooq09:36
zbrsshnaidm|ruck: as you know I faced this issue yesterday when I was forced to do https://review.opendev.org/#/c/668460/ --- just to repair a job that went broken for a long time due to skips.09:36
zbrmaybe you know how we could avoid this?09:37
*** ratailor_ has quit IRC09:38
*** ratailor has joined #oooq09:40
zbrprobably by assuring that we run run all of then as periodic ones but almost nobody else but us are looking at these. if others would see them (on their chages) they could fix them.09:41
*** holser_ has quit IRC09:43
*** holser_ has joined #oooq09:44
sshnaidm|ruckzbr, that's fine, but ci-config repo is different case, what is in "infra-setup" there should be in separate repo at all, it's completely isolated from other code09:46
chandankumarsshnaidm|ruck: yes, we can use nodepool-base, nodepool-minimal also creates the /etc/nodepool dir09:46
sshnaidm|ruckzbr, we can break this repo to 2-3 parts09:46
zbrsshnaidm|ruck: yep. please put a file pattern there to skip molecule, is much easier than splitting repos.09:48
sshnaidm|ruckzbr, yeah, let's use "files"09:48
chandankumarsshnaidm|ruck: https://softwarefactory-project.io/r/#/c/15854/09:49
zbrsshnaidm|ruck: FYI: i plan to add a feature to pytest-molecule that can run only touched roles, similar to the pre-commit feature.09:49
sshnaidm|ruckwyeah, ould be useful09:49
zbrnot hard to do but neither too easy as it may be tricky to identify what defines a molecule scenario. for example is impossible to guess that an imported role was touched.09:51
zbrthis would be useful only for local testing, never to enable it on ci.09:51
*** ykarel is now known as ykarel|meeting09:58
*** skramaja has quit IRC09:58
*** bogdando has joined #oooq10:00
*** ykarel|meeting is now known as ykarel10:35
chandankumarsshnaidm|ruck: you have +w writes on software factory config project/10:37
chandankumar?10:37
chandankumarsshnaidm|ruck: https://softwarefactory-project.io/r/#/c/15854/10:37
sshnaidm|ruckchandankumar, nope10:37
zbrsshnaidm|ruck: shouldn't we add more from our team to https://review.rdoproject.org/r/#/admin/groups/2801,members ?10:44
zbr... like even all.10:45
sshnaidm|ruckzbr, it should be discussed with rdo team10:47
zbri am sending an email to rdo-list now to ask if they think appropiate10:47
sshnaidm|ruckalthough in ci-config should be all I think10:47
ykarelzbr, sshnaidm|ruck i think it would be good if it's discussed among tripleo-ci team first regarding more cores to those repos10:51
ykareli think as already some guys from tripleo-ci team has moved10:51
*** amoralej is now known as amoralej|brb10:51
ykarelso good to add some more but should be discussed withing team first regarding whom you are going to nominate10:52
*** udesale has quit IRC10:54
zbrykarel: true, i am probably too open to risk as I would personally add *10:54
zbridentified as missing: arxcruz chkumar rfolco marios ssbarnea10:55
zbrwhich means that I should not be the one nominating himself.10:55
zbrsshnaidm|ruck panda rlandy weshay are already there, so they are good canditates to make a decision on who to nominate.10:56
zbri am sure that wes will not block any nomination and considering his PTO, I assume the other 3 could consult each other10:58
ykarelOhhk so 4 are already there, 4/9 is not that bad10:59
ykarelbut it becomes a necessisty to update the list based on role and priority changes10:59
*** udesale has joined #oooq11:00
ykarelanyway my point was just: discuss within Team, and u will have a ready solution11:01
sshnaidm|ruckzbr, I think it's better to wait for weshay_PTO  next weel11:02
sshnaidm|rucks/weel/week11:02
zbri have a better idea, i will send him an email, it will take him 2 secs to give his input and we can avoid one more week of delay.11:06
*** ykarel is now known as ykarel|afk11:09
sshnaidm|ruckyeah, he'll be happy to solve such things in PTO11:11
*** udesale has quit IRC11:13
*** amoralej|brb is now known as amoralej11:15
*** ykarel|afk has quit IRC11:16
zbr /sarcasm :D11:22
*** ratailor has quit IRC11:26
*** saneax has quit IRC11:28
*** ykarel has joined #oooq11:37
*** jaosorior has quit IRC11:42
*** holser_ has quit IRC11:46
*** holser_ has joined #oooq11:47
*** holser_ has quit IRC11:51
*** ykarel is now known as ykarel|meeting11:52
*** skramaja has joined #oooq12:05
rfolcochandankumar, will have to skip today's bug triage.12:21
chandankumarrfolco: ack12:21
*** saneax has joined #oooq12:27
*** rlandy has joined #oooq12:35
*** jaosorior has joined #oooq12:39
*** udesale has joined #oooq12:43
rlandychandankumar: hi12:46
rlandyhttps://softwarefactory-project.io/r/#/c/15854/12:47
rlandy^^ that merged12:47
chandankumarrlandy: yes12:51
rlandychandankumar: I can't find the upstream node12:51
chandankumarrlandy: here is the logs https://softwarefactory-project.io/nodepool-log/?C=M;O=D12:52
chandankumarrlandy: it is not built yet on sf12:52
rlandychandankumar: do you have a link for the build job?12:53
pandadoes anybody know why we have a tripleo-build-containers-fedora-28-master job ?12:53
pandazbr: ^ ?12:53
pandaoh it's non voting12:54
chandankumarrlandy: nope12:54
pandaoh then, tripleo repos patch ready12:54
rlandyk - will ask on sf-ops12:54
zbryep. it was needed for rhel-8 preparation, we will never be able to merge it due to kolla12:54
zbrbut we were supposed to keep an eye on it and react if it fails, especially ruck/rovers12:54
zbrcentos-8 is supposed to fully replace it, when the time comes.12:55
rlandymarios: any idea why this test job never kicked? https://review.rdoproject.org/r/#/c/21316/12:57
rlandyit never failed12:57
rlandynever starte12:57
rlandystarted12:58
*** ykarel|meeting is now known as ykarel13:01
rfolcopanda, heeeelp! o/13:06
rfolcorequests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://trunk.rdoproject.org/rhel8-master/tripleo-ci-testing/delorean.repo13:06
pandarfolco: it's true13:07
rfolcopanda, using your patch to enable support on rhel8 for tripleo-repos. But I guess we don't want rhel8-master13:07
pandarfolco: no hash has been promoted for that repo13:07
rfolcopanda, so chicken and egg problem again13:07
pandarfolco: we have rhel8-master, we don't have triple-ci-testing13:07
pandarfolco: not necessarily, we can do a manual promotion13:08
rfolcohmm13:08
mariosrlandy: looking13:08
rfolcopanda, hmm let me try finding the promoter script13:09
rfolcopanda, will it work w/ rhel8 as is ?13:09
pandarfolco: you don't need the promoter script, you just need a drlnapi call with the right credentials13:10
pandarfolco: yes, and if it doesn't you should poke inra team13:10
mariosrlandy: don't know/but maybe for now try adding in layout of https://review.rdoproject.org/r/#/c/21295/ see if it runs there?13:10
rfolcopanda, cool, thanks13:12
*** ccamacho has joined #oooq13:13
*** aakarsh has quit IRC13:14
*** ykarel is now known as ykarel|afk13:20
rlandymarios: is having the real upstream-rhel-8 node a blocker?13:24
rlandyie: could we just carry on with the fake cloud node?13:24
mariosrlandy: i think since we don't have the image yet (right) so it has to be the 'fake' node for now?13:28
rfolcohttps://bluejeans.com/5878458097 --> community meeting13:30
rfolcohttps://etherpad.openstack.org/p/tripleo-ci-squad-meeting @L5513:30
rfolcoping marios, sshnaidm, weshay, panda, rlandy, arxcruz, rfolco, chkumar, zbr, kopecmartin13:30
rfolcolast call13:33
rfolcoboarding now13:33
*** aakarsh has joined #oooq13:35
*** amoralej is now known as amoralej|lunch13:49
chandankumarsshnaidm|ruck: arxcruz|rover http://logs.openstack.org/90/667390/10/check/tripleo-ci-centos-7-containers-multinode/0d25e17/job-output.txt.gz#_2019-07-02_13_05_13_09930313:55
chandankumarNow I can run os_tempest in multinode jobs13:55
chandankumarneeds few fixes and we are done13:56
arxcruz|roverchandankumar++13:56
pandarfolco: add chandankumar to your default ping list13:58
rfolcopanda, he changes names :)13:58
rfolcohttps://etherpad.openstack.org/p/tripleo-ci-squad-meeting @L813:58
rfolcochandankumar, this is my source ^13:58
rfolcochandankumar, you may want to edit etherpad chkumar13:59
chandankumarrfolco: done, sorry joined late14:01
*** skramaja has quit IRC14:12
chandankumararxcruz|rover: is fs039 job got fixed?14:14
sshnaidm|ruckchandankumar, should be14:14
sshnaidm|ruckchandankumar, at least the python reason14:15
rfolcopanda, is manual promotion documented anywhere?14:17
pandarfolco: in dlrnapi command line tool14:17
arxcruz|roverchandankumar yes14:17
*** vinaykns has joined #oooq14:18
*** amoralej|lunch is now known as amoralej14:32
*** zbr has quit IRC14:53
*** zbr has joined #oooq14:54
*** Vorrtex has joined #oooq15:09
*** Vorrtex has quit IRC15:21
*** Vorrtex has joined #oooq15:28
rlandymarios: who added the cloud-rhel-8-1560357956 image to rdo cloud?15:33
rlandynot in https://softwarefactory-project.io/nodepool-log/?C=M;O=D15:33
rlandythe job does not run because the node is not recognized15:35
rlandylabel: cloud-rhel-815:35
rlandydoes not exist15:35
mariosrlandy: i think maybe jpena or someone else in sf-ops15:38
mariosrlandy: oh rdo cloud? sorry15:39
mariosrlandy: then don't know (on the dfg call too)15:39
rlandymarios: ack15:39
rlandyI need to know what to put on the label for the nodeset15:39
*** ykarel|afk is now known as ykarel15:54
*** marios is now known as marios|out16:01
*** marios|out has quit IRC16:14
*** d0ugal has quit IRC16:21
chandankumarrlandy: jpena added the image16:27
*** rlandy has quit IRC16:41
*** rlandy has joined #oooq16:42
*** rlandy has quit IRC16:43
*** rlandy has joined #oooq16:44
*** bogdando has quit IRC16:48
*** udesale has quit IRC16:49
*** amoralej is now known as amoralej|off16:55
*** ykarel is now known as ykarel|away16:58
*** tesseract has quit IRC17:01
*** ykarel|away has quit IRC17:05
chandankumarrlandy: here is the patchhttps://review.rdoproject.org/r/#/c/21269/ which adds nodes label17:20
rlandychandankumar: ack - the issue is that the fake image was not labeled in nodepool17:26
rlandyyours is17:26
chandankumarrlandy: fake image?17:26
chandankumarrlandy: https://softwarefactory-project.io/nodepool-log/upstream-rhel-8-0000000010.log is a different image?17:27
*** sshnaidm|ruck is now known as sshnaidm|afk17:31
rlandyyep17:31
*** vinaykns has quit IRC17:37
*** vinaykns has joined #oooq17:39
*** holser_ has joined #oooq18:11
*** ykarel|away has joined #oooq18:13
*** dtrainor_ has quit IRC18:14
*** ykarel|away has quit IRC18:23
*** dtrainor has joined #oooq18:34
*** vinaykns has quit IRC18:37
rlandyzbr: ping - what do you know about nodepool elements and pkg-map?18:55
rlandyhttps://opendev.org/openstack/project-config/src/branch/master/nodepool/elements/zuul-worker/pkg-map18:56
zbrrlandy: effectively nothing. first timeI see it but I can only guess.19:02
rlandyk19:02
zbrlist of basic packages to install on workers19:02
zbrobviously it will choke on py3 rhels19:03
zbrbut i can ask on infra if you want19:03
*** vinaykns has joined #oooq19:11
*** tosky has quit IRC19:19
rlandyzbr: I pinged ianw. I don't know much about DIB - I need to make https://opendev.org/openstack/project-config/src/branch/master/nodepool/elements/zuul-worker/pkg-map compatible for rhel 7 and 819:21
zbri did not try it myself but https://opendev.org/openstack/project-config/src/branch/master/nodepool/elements looks kinda clearto me19:23
*** vinaykns has quit IRC19:24
*** panda has quit IRC19:27
*** panda has joined #oooq19:30
*** vinaykns has joined #oooq19:39
*** vinaykns has quit IRC19:51
*** vinaykns has joined #oooq19:56
*** holser_ has quit IRC20:08
*** vinaykns has quit IRC20:10
*** d0ugal has joined #oooq20:31
*** sshnaidm|afk has quit IRC21:06
*** sshnaidm has joined #oooq21:08
*** sshnaidm is now known as sshnaidm|afk21:09
*** vinaykns has joined #oooq21:19
*** saneax has quit IRC21:21
*** holser_ has joined #oooq21:38
*** Vorrtex has quit IRC21:47
*** holser_ has quit IRC21:50
*** vinaykns has quit IRC22:19
*** panda has quit IRC22:52
*** panda has joined #oooq22:59
*** slaweq has quit IRC23:07
*** aakarsh has quit IRC23:27

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!