| *** rlandy|ruck|bbl is now known as rlandy|ruck | 00:07 | |
| *** rlandy|ruck has quit IRC | 02:18 | |
| *** aakarsh has quit IRC | 02:18 | |
| *** Goneri has joined #oooq | 02:53 | |
| *** rfolco has quit IRC | 03:09 | |
| *** Goneri has quit IRC | 03:31 | |
| *** skramaja has joined #oooq | 03:46 | |
| *** ysandeep|away is now known as ysandeep | 04:28 | |
| *** udesale has joined #oooq | 04:35 | |
| *** apetrich has quit IRC | 04:43 | |
| *** ratailor has joined #oooq | 04:44 | |
| *** jtomasek has joined #oooq | 04:53 | |
| *** marios has joined #oooq | 05:04 | |
| *** sshnaidm|afk is now known as sshnaidm|off | 05:34 | |
| *** udesale has quit IRC | 05:40 | |
| *** jfrancoa has joined #oooq | 06:21 | |
| *** udesale has joined #oooq | 06:25 | |
| *** udesale_ has joined #oooq | 06:29 | |
| *** ysandeep is now known as ysandeep|afk | 06:30 | |
| *** udesale has quit IRC | 06:30 | |
| *** amoralej|off is now known as amoralej | 06:31 | |
| *** dtantsur|afk is now known as dtantsur | 06:50 | |
| chandankumar | marios, Good morning | 06:59 |
|---|---|---|
| chandankumar | marios, https://review.opendev.org/#/c/727200 I will ping back when to review when it is ready | 06:59 |
| marios | chandankumar: ack | 07:05 |
| *** jbadiapa has joined #oooq | 07:15 | |
| marios | needs reviews please https://review.rdoproject.org/r/#/c/28161 https://review.rdoproject.org/r/#/c/28162 test at https://review.rdoproject.org/r/#/c/28106 promoter staging/molecule periodics https://tree.taiga.io/project/tripleo-ci-board/task/1801 | 07:37 |
| *** ysandeep|afk is now known as ysandeep | 07:42 | |
| *** dmellado has joined #oooq | 07:43 | |
| *** tosky has joined #oooq | 07:49 | |
| *** jpena|off is now known as jpena | 07:56 | |
| *** bhagyashris is now known as bhagyashris|lunc | 07:57 | |
| *** udesale_ has quit IRC | 08:11 | |
| *** apetrich has joined #oooq | 08:43 | |
| *** holser_ has quit IRC | 08:46 | |
| *** holser has joined #oooq | 08:49 | |
| *** bhagyashris|lunc is now known as bhagyashris | 09:08 | |
| *** derekh has joined #oooq | 09:08 | |
| ysandeep | chandankumar, Facing repos related issue trying c8 train upstream - https://65a019415a675424889f-7d9ee8e46cfbda0590b7875fc069534a.ssl.cf5.rackcdn.com/737682/2/check/tripleo-ci-centos-8-containers-multinode-train/57f94e0/logs/undercloud/etc/yum.repos.d/delorean.repo | 09:20 |
| ysandeep | https://trunk.rdoproject.org/centos8-train/current-tripleo/delorean.repo - doesn't look good to me | 09:20 |
| chandankumar | ysandeep, current-tripleo does not promoted from long time | 09:21 |
| chandankumar | let me take a look | 09:22 |
| chandankumar | ysandeep, https://65a019415a675424889f-7d9ee8e46cfbda0590b7875fc069534a.ssl.cf5.rackcdn.com/737682/2/check/tripleo-ci-centos-8-containers-multinode-train/57f94e0/logs/undercloud/home/zuul/repo_setup.log | 09:22 |
| chandankumar | ysandeep, you can find the issue | 09:22 |
| chandankumar | you might need to take a look at release file | 09:23 |
| chandankumar | train.yaml in c8 dir in tq repo | 09:23 |
| chandankumar | compare with ussuri one | 09:23 |
| chandankumar | it might happened due to change in integration to component repo | 09:24 |
| ysandeep | chandankumar, ack , yes i am wondering same looking at delorean.repo content - why we have components in C8 train , in c7 train we don't have components .. wondering if we will set up a component based pipeline for c8 train too? | 09:25 |
| chandankumar | ysandeep, yes, there is a user story for setting up component based pipeline for c8 train https://tree.taiga.io/project/tripleo-ci-board/us/1810?milestone=267741 | 09:27 |
| chandankumar | ysandeep, but it will not block your work as release files are different based on distro and releases | 09:27 |
| ysandeep | chandankumar, ack, looking at train.yaml in c8 dir in tq repo - to correlate with errors. | 09:30 |
| chandankumar | ysandeep, check this https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/release/tripleo-ci/CentOS-8/ussuri.yml#L41 and https://opendev.org/openstack/tripleo-quickstart/src/branch/master/config/release/tripleo-ci/CentOS-8/train.yml#L33 | 09:30 |
| chandankumar | ysandeep, and also take a look at repo set links given in c8 train hackmd | 09:32 |
| chandankumar | there might be release hardcoded | 09:32 |
| ysandeep | chandankumar, ack looking in https://hackmd.io/4jAfexu4TBivhareCb4MhQ?view if something is mentioned there regarding repo links | 09:35 |
| *** chem has joined #oooq | 09:36 | |
| marios | needs reviews please https://review.rdoproject.org/r/#/c/28161 https://review.rdoproject.org/r/#/c/28162 test at https://review.rdoproject.org/r/#/c/28106 promoter staging/molecule periodics https://tree.taiga.io/project/tripleo-ci-board/task/1801 | 09:38 |
| arxcruz | pane kopecmartin https://review.opendev.org/#/c/720434 prosím | 10:11 |
| kopecmartin | arxcruz: :D .. looking at it now | 10:12 |
| arxcruz | kopecmartin: diký | 10:13 |
| arxcruz | chandankumar: ^ | 10:16 |
| chandankumar | arxcruz, no way | 10:16 |
| chandankumar | arxcruz, just https://review.opendev.org/#/c/720434/ check last comment | 10:16 |
| chandankumar | what do you think | 10:16 |
| arxcruz | chandankumar: sure, right now the validation return nothing, just the 0 if it pass | 10:19 |
| arxcruz | but we can add a message | 10:19 |
| chandankumar | arxcruz, cool, thanks! | 10:19 |
| arxcruz | chandankumar: we can also use stdout_lines instead of a file, because it would be juts one or two lines | 10:20 |
| arxcruz | better use a debug message | 10:20 |
| arxcruz | ansible debug module | 10:20 |
| chandankumar | ysandeep, saw this http://codesearch.openstack.org/?q=release%20is%20search&i=nope&files=&repos= | 10:23 |
| ysandeep | chandankumar, looking | 10:24 |
| chandankumar | ysandeep, you might want to handle those something like this https://review.rdoproject.org/r/#/c/28189/3/ci-scripts/infra-setup/roles/get_hash/tasks/get_hash.yaml as marios done | 10:28 |
| ysandeep | chandankumar, ack will try something similiar , on side note do you know why we have additional "-components" in train url - https://trunk.rdoproject.org/centos8-train-components/component/ vs https://trunk.rdoproject.org/centos8-ussuri/component/ ? | 10:30 |
| chandankumar | ysandeep, https://trunk.rdoproject.org/centos8-train-components/component/ is the old one, it will removed, we need to use https://trunk.rdoproject.org/centos8-train/ | 10:31 |
| ysandeep | chandankumar, ahh okay, thank you :) we need an update here https://trunk.rdoproject.org/centos8-train/current-tripleo/delorean.repo its pointing to centos8-train-components | 10:35 |
| chandankumar | ysandeep, ah, weshay_pto manually promoted the c8 train current tripleo hash with old promoter | 10:37 |
| chandankumar | *with old dlrn | 10:37 |
| chandankumar | panda, Hello | 10:37 |
| chandankumar | panda, can we manually promote c8 train component to toci testing and to current-tripleo | 10:38 |
| chandankumar | ? | 10:38 |
| panda | chandankumar: why to toci-testing ? | 10:38 |
| chandankumar | panda, tripleo ci testing | 10:39 |
| panda | chandankumar: why to tripleo-ci-testing ? | 10:39 |
| chandankumar | panda, as on new dlrn server https://trunk.rdoproject.org/centos8-train tripleo-ci-testing dir does not exists | 10:40 |
| panda | chandankumar: why does it need to exist ? | 10:40 |
| panda | chandankumar: I'm the why monster today | 10:41 |
| panda | chandankumar: anyway, yes, we can force promotion of arbitrary hashes to arbitrary names | 10:42 |
| panda | chandankumar: and yes tripleo-ci-testing is needed, because promotion forcing need a candidate hash | 10:42 |
| panda | chandankumar: with a label attached to it. | 10:43 |
| chandankumar | panda, as current jobs are broken, we need to toci testing dir to run integration jobs | 10:43 |
| panda | chandankumar: so we need to promote consistent to tripleo-ci-testing and then tripleo-ci-testing to current-tripleo | 10:43 |
| chandankumar | panda, or better https://review.rdoproject.org/r/#/c/28189/ merge this | 10:43 |
| chandankumar | panda, I will retrigger the pipeline via test project | 10:43 |
| chandankumar | panda, https://logserver.rdoproject.org/openstack-periodic-24hr/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-8-train-promote-consistent-to-tripleo-ci-testing/7afc6c5/job-output.txt is broken due to "url": "https://trunk.rdoproject.org/centos8-train/consistent/commit.yaml" not found | 10:45 |
| chandankumar | panda, once we have toci testing repo populated, you can promote the hash from tripleo-ci-testing to current tripleo | 10:45 |
| panda | chandankumar: ok, so I'll merge taht | 10:49 |
| *** pojadhav is now known as pojadhav|afk | 11:30 | |
| chandankumar | bhagyashris, can you rename this job https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/integration-pipeline-train-stein.yaml#L117 periodic-tripleo-centos-8-train-promote-consistent-to-tripleo-ci-testing to periodic-tripleo-centos-8-train-promote-promoted-components-to-tripleo-ci-testing | 11:40 |
| chandankumar | you also need to define that job | 11:40 |
| chandankumar | and take a look at ussuri one | 11:40 |
| *** jpena is now known as jpena|lunch | 11:43 | |
| *** rlandy has joined #oooq | 11:45 | |
| *** rlandy is now known as rlandy|ruck | 11:46 | |
| rlandy|ruck | soniya29|rover: hi there | 11:46 |
| chandankumar | ysandeep, Hello | 11:47 |
| bhagyashris | chandankumar, in that same patch or diff patch | 11:48 |
| chandankumar | bhagyashris, in a seperate patch | 11:49 |
| bhagyashris | ok | 11:49 |
| bhagyashris | i will do that | 11:49 |
| bhagyashris | chandankumar, ^ | 11:49 |
| ysandeep | chandankumar, o/ | 11:49 |
| chandankumar | ysandeep, can you take care of this one https://tree.taiga.io/project/tripleo-ci-board/task/1830?kanban-status=1447274 | 11:50 |
| chandankumar | ysandeep, It is needed for promoted component repos | 11:50 |
| ysandeep | chandankumar, ack | 11:51 |
| chandankumar | ysandeep, https://github.com/rdo-infra/ci-config/tree/master/ci-scripts/dlrnapi_promoter/config/CentOS-8/component | 11:51 |
| chandankumar | we need train.yaml | 11:51 |
| ysandeep | chandankumar, i took it | 11:51 |
| ysandeep | chandankumar, regarding update/upgrades task i have some queries - 1) which update/upgrade jobs we want in upstream - 1) standalone 2) multinode or 3) Undercloud or all of them? | 11:52 |
| chandankumar | ysandeep, I think all of them | 11:54 |
| ysandeep | chandankumar, ack thanks! | 11:56 |
| ysandeep | chandankumar, I will prepare a hackmd on update/upgrade jobs on what needs to be done and will sync with you | 11:57 |
| chandankumar | ysandeep, yes sure, please include marios also | 11:57 |
| ysandeep | chandankumar, yes he is on auto include :D | 11:58 |
| *** ysandeep is now known as ysandeep|brb | 11:58 | |
| *** amoralej is now known as amoralej|lunch | 12:06 | |
| *** rfolco has joined #oooq | 12:11 | |
| soniya29|rover | rlandy|ruck, hello | 12:11 |
| rlandy|ruck | soniya29|rover: hey - on prod call | 12:12 |
| rlandy|ruck | rdocloud looks beter | 12:12 |
| rlandy|ruck | better | 12:12 |
| soniya29|rover | rlandy|ruck, yeah | 12:12 |
| rlandy|ruck | rerunning the failed queens jobs to promote | 12:12 |
| *** ysandeep|brb is now known as ysandeep | 12:14 | |
| *** pojadhav|afk is now known as pojadhav | 12:14 | |
| soniya29|rover | rlandy|ruck, okay | 12:17 |
| rlandy|ruck | soniya29|rover: did infra help delete the stuck stacks that were left? | 12:23 |
| rlandy|ruck | or did they magically disappear | 12:23 |
| soniya29|rover | rlandy|ruck, I don't see stuck stack issues more | 12:24 |
| rlandy|ruck | soniya29|rover: ok - so our clean scripts must have got to them | 12:24 |
| soniya29|rover | rlandy|ruck, yeah | 12:25 |
| soniya29|rover | rlandy|ruck, but gate is still not so good | 12:25 |
| rlandy|ruck | looks ok now - yesterday was a disaster | 12:26 |
| rlandy|ruck | soniya29|rover: have you worked with ci.centos before? | 12:26 |
| soniya29|rover | rlandy|ruck, nope | 12:26 |
| rlandy|ruck | if not, will show you after the current meeting | 12:26 |
| soniya29|rover | rlandy|ruck, sure | 12:27 |
| marios | needs reviews please https://review.rdoproject.org/r/#/c/28161 https://review.rdoproject.org/r/#/c/28162 test at https://review.rdoproject.org/r/#/c/28106 promoter staging/molecule periodics https://tree.taiga.io/project/tripleo-ci-board/task/1801 | 12:31 |
| marios | chandankumar: can you re-add your vote on https://review.rdoproject.org/r/#/c/28162 when you get a chance i had to rebase for merge conflict | 12:31 |
| rlandy|ruck | soniya29|rover: ugh - retry limits :( | 12:35 |
| soniya29|rover | rlandy|ruck, yeah, there are too many with retry limits issues | 12:36 |
| rlandy|ruck | soniya29|rover: asking on openstack-infra | 12:37 |
| soniya29|rover | rlandy|ruck, i have monitored most of them | 12:37 |
| rlandy|ruck | soniya29|rover: they look random | 12:38 |
| rlandy|ruck | no particular job | 12:38 |
| soniya29|rover | rlandy|ruck, exactly. Many have build history with same job facing retry-limits but in subsequent builds have passed and failed. so its random | 12:40 |
| soniya29|rover | rlandy|ruck, for such issues, I have given recheck | 12:41 |
| ysandeep | chandankumar, for c8 train criteria file - Currently we don't have all the component jobs definition when compared with upstream/master, further the jobs we have are not running - https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-standalone-cinder-train , Should I add criteria file with *NO* jobs in particular criteria till current gets jobs are stable. | 12:43 |
| ysandeep | particular components* | 12:44 |
| *** jpena|lunch is now known as jpena | 12:51 | |
| *** mjturek has joined #oooq | 13:06 | |
| mjturek | hey - can anyone point me to where the 'ensure-pip' role is from? | 13:06 |
| marios | mjturek: https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/ensure-pip | 13:07 |
| *** skramaja has quit IRC | 13:07 | |
| *** amoralej|lunch is now known as amoralej | 13:08 | |
| marios | mjturek: found via http://codesearch.openstack.org/?q=ensure-pip fyi (I had the same question and it is in my notes from couple days ago) | 13:08 |
| mjturek | marios awesome that is super helpful thank you! | 13:08 |
| marios | mjturek: ack np | 13:09 |
| bhagyashris | rfolco, hi | 13:09 |
| rfolco | bhagyashris, hi | 13:09 |
| bhagyashris | rfolco, want to discuss with you regarding https://tree.taiga.io/project/tripleo-ci-board/task/1832?kanban-status=1447276 | 13:10 |
| bhagyashris | rfolco, as i moved the stein job from openstack-periodic-24hr to openstack-periodic-wednesday-weekend pipeline | 13:11 |
| bhagyashris | rfolco, so is that ok | 13:11 |
| bhagyashris | ? | 13:11 |
| rfolco | bhagyashris, yes thats what I heard from weshay_pto | 13:11 |
| bhagyashris | rfolco, ok | 13:12 |
| bhagyashris | rfolco, now only the problem is i have changed the template according | 13:12 |
| rfolco | bhagyashris, show me the review | 13:13 |
| bhagyashris | in the patches review.rdoproject.org/r/#/c/28211 and review.rdoproject.org/r/#/c/28212 | 13:13 |
| bhagyashris | rfolco, ^ | 13:13 |
| bhagyashris | so there zuul is failing because of inter dependencies | 13:13 |
| bhagyashris | rfolco, can you point me where should correct to get Zuul result green | 13:15 |
| bhagyashris | rfolco, IMO i made correct dependency but it's failing | 13:16 |
| bhagyashris | :( | 13:16 |
| bhagyashris | rfolco, i have checked your review comment | 13:18 |
| rfolco | let me see whats wrong with the rdo-jobs one | 13:19 |
| rfolco | the config one depends on the other one ^ | 13:19 |
| bhagyashris | rfolco, you mean config one should depends on rdo-jobs right? | 13:20 |
| rfolco | yes but you can't rename rdo-jobs one atomically because config one will complain | 13:20 |
| rfolco | you'll need to do this in 2 or 3 steps. | 13:20 |
| bhagyashris | rfolco, yeah exactly | 13:21 |
| rfolco | I would like to see these pipelines named differently | 13:21 |
| rfolco | like master, -1, -2 -3... | 13:21 |
| rfolco | not branch names on pipeline names | 13:21 |
| rfolco | this makes shifts harder | 13:22 |
| bhagyashris | rfolco, me too because every time will need to change that in future and will encounter in same issue | 13:22 |
| bhagyashris | yeah exactly | 13:22 |
| rfolco | bhagyashris, propose a change to the pipeline names, will leave a comment | 13:22 |
| soniya29|rover | rlandy|ruck, Most of the retry_limits issues are resolved, since patches have got merged. | 13:23 |
| rlandy|ruck | soniya29|rover: yep - been chatting with openstack-infra | 13:25 |
| rlandy|ruck | need to join the production-chain call - will ping you after that | 13:25 |
| rfolco | bhagyashris, gave 2 ideas there, pls take a look and feel free to choose one solution | 13:26 |
| bhagyashris | rfolco, but even master -1, -2 , -3 pipeline name will encounter the same issue | 13:30 |
| rfolco | bhagyashris, yes, but u don't need to rename pipelines anymore | 13:30 |
| bhagyashris | rfolco, ok got your point | 13:31 |
| *** rlandy|ruck is now known as rlandy|ruck|mtg | 13:31 | |
| rfolco | bhagyashris, if you want to make it simple, just disable pipeline first, make the move, ask people to merge the sequence quick so we don't loose any periodic jobs | 13:32 |
| chandankumar | ysandeep, I think we can add the file without job | 13:32 |
| chandankumar | and see how it goes | 13:32 |
| bhagyashris | rfolco, ok i will introduce the new pipeline | 13:32 |
| rfolco | bhagyashris, thx | 13:33 |
| bhagyashris | and then will triggered in config | 13:33 |
| bhagyashris | rfolco, thanx | 13:33 |
| chandankumar | marios, https://review.opendev.org/727200 is now ready for review | 13:35 |
| marios | chandankumar: ack will revisit | 13:36 |
| marios | chandankumar: can you re-add your vote on https://review.rdoproject.org/r/#/c/28162 when you get a chance i had to rebase for merge conflict | 13:37 |
| marios | needs reviews please https://review.rdoproject.org/r/#/c/28161 https://review.rdoproject.org/r/#/c/28162 test at https://review.rdoproject.org/r/#/c/28106 promoter staging/molecule periodics https://tree.taiga.io/project/tripleo-ci-board/task/1801 | 13:37 |
| marios | rfolco: panda: zbr: arxcruz: rlandy|ruck|mtg: please when you next have time add to your reviews ^^ | 13:43 |
| arxcruz | zbr: around ? | 13:44 |
| zbr | yep | 13:44 |
| ysandeep | chandankumar, okay , I was just afraid if No jobs in criteria can result in false promotion | 13:51 |
| chandankumar | rfolco, does the component promotion works if there is no job defined in criteria file? | 13:52 |
| rfolco | chandankumar, not sure | 13:53 |
| ysandeep | chandankumar, was thinking of some alternatives - https://hackmd.io/5LCEUIQvRVixqigPRjHaAA?view | 13:53 |
| *** TrevorV has joined #oooq | 13:54 | |
| chandankumar | ysandeep, need to check whether jobs are passing or not | 13:54 |
| ysandeep | chandankumar, Not green - Jobs are not running | 13:54 |
| ysandeep | https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-8-standalone-cinder-train | 13:55 |
| ysandeep | https://hackmd.io/5LCEUIQvRVixqigPRjHaAA?both - alternatives from line 95 | 13:57 |
| marios | thanks for review rfolco replied https://review.rdoproject.org/r/#/c/28162/6/zuul.d/jobs-promoter-centos-7.yaml@131 | 13:57 |
| rfolco | marios, very enlightening | 13:58 |
| rfolco | marios, :) | 13:58 |
| marios | rfolco: yes that's what i was striving for | 13:58 |
| chandankumar | ysandeep, let's try with empty criteria and see how it goes, if not work, we can revert back | 13:59 |
| rfolco | marios, no big deal, just nit picking coz I could not find anything else to annoy you | 13:59 |
| marios | rfolco: da78edf7 (wes hayutin 2020-05-19 20:55:18 +0000 63) PYTEST_REQPASS: 188 | 13:59 |
| ysandeep | chandankumar, ack o/ | 13:59 |
| marios | rfolco: git blame | 13:59 |
| marios | rfolco: looking for the review | 14:00 |
| marios | rfolco: actually that is misleading cos its a fix/revert... the original is from zbr a66652e7 (Sorin Sbarnea 2020-03-18 12:11:30 +0000 96) PYTEST_REQPASS: 188 | 14:02 |
| marios | rfolco: thanks for the rabbit hole | 14:02 |
| * marios keeps falling | 14:02 | |
| marios | rfolco: i guess the answer is 'that is just the exact number of tests we currently have' | 14:04 |
| marios | rfolco: https://review.rdoproject.org/r/#/c/25980/ | 14:04 |
| rfolco | marios, makes sense, thanks for checking | 14:07 |
| chandankumar | ysandeep, https://trunk.rdoproject.org/centos8-train/promoted-components/ now populated | 14:17 |
| ysandeep | chandankumar, ack o/ thanks.. I pushing train criteria patch too in a minute | 14:18 |
| chandankumar | ysandeep, jpena manually created it | 14:18 |
| chandankumar | ysandeep, let me get toci testing repo populated and container builds | 14:18 |
| chandankumar | ysandeep, will test your changes also | 14:19 |
| ysandeep | chandankumar, okay.. will post in 2 mins.. writing commit | 14:19 |
| zbr | marios is right about PYTEST_REQPASS - that is a protection to avoid disabling/skipping test accidentally | 14:20 |
| zbr | needs to be manually adjusted when we do this | 14:21 |
| zbr | very useful protection | 14:21 |
| chandankumar | ysandeep, https://review.rdoproject.org/r/#/c/28204/ let's see how it goes | 14:22 |
| ysandeep | chandankumar, o/ okay, fyi.. https://review.rdoproject.org/r/#/c/28214/ | 14:25 |
| rlandy|ruck|mtg | soniya29|rover: you can join the escalation call if you like | 14:27 |
| soniya29|rover | rlandy|ruck, yeah, i will join | 14:28 |
| *** ysandeep is now known as ysandeep|afk | 14:29 | |
| marios | i will self workflow https://review.rdoproject.org/r/#/c/28162/ in a 5 mins unless someone objects first | 14:33 |
| *** ratailor has quit IRC | 14:35 | |
| marios | panda: rlandy|ruck|mtg: zbr: arxcruz: please add to your reviews list https://review.rdoproject.org/r/#/c/28161/ | 14:40 |
| chandankumar | rlandy|ruck|mtg, marios rfolco https://review.rdoproject.org/r/28215 quick merge | 14:42 |
| chandankumar | needed to fix this failure https://logserver.rdoproject.org/04/28204/6/check/periodic-tripleo-centos-8-train-promote-promoted-components-to-tripleo-ci-testing/503e45f/job-output.txt | 14:43 |
| marios | chandankumar: are you also looking at get-hash or is this from some other task? | 14:45 |
| marios | chandankumar: but i think its wrong let me comment | 14:45 |
| chandankumar | marios, https://review.rdoproject.org/r/gitweb?p=rdo-infra/ci-config.git;a=blob;f=ci-scripts/infra-setup/roles/get_hash/tasks/get_hash.yaml#l8 needs to be skipped | 14:47 |
| chandankumar | from master one https://logserver.rdoproject.org/openstack-periodic-master/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-centos-8-master-promote-promoted-components-to-tripleo-ci-testing/3b0e38e/job-output.txt | 14:49 |
| marios | chandankumar: yeah i +2 just now... i was thinking of adding that this morning (I see you merged https://review.rdoproject.org/r/#/c/28189/ - i didn't revisit it after this morning doing other things so i didn't see that error | 14:49 |
| rlandy|ruck|mtg | soniya29|rover: let's meet in 5 - will show you ci.centos | 14:53 |
| soniya29|rover | rlandy|ruck|mtg, can I join after dinner? | 14:54 |
| *** ysandeep|afk is now known as ysandeep | 14:56 | |
| rlandy|ruck|mtg | soniya29|rover: sure - ping me when you are ready | 14:58 |
| ysandeep | bhagyashris, fyi your patch might conflict with pojadhav patch - https://review.rdoproject.org/r/#/c/28198/ | 15:09 |
| *** ysandeep is now known as ysandeep|away | 15:09 | |
| marios | chandankumar: looks green now https://review.rdoproject.org/r/#/c/28190/ periodic-tripleo-centos-8-train-component-baremetal-promote-consistent-to-component-ci-testing | 15:15 |
| chandankumar | marios, yes | 15:15 |
| chandankumar | marios, we also need https://review.rdoproject.org/r/#/c/28214/ to make the component pipeline working | 15:16 |
| chandankumar | just a hit and trial method not sure it will work | 15:16 |
| marios | chandankumar: ack adding to reviews | 15:17 |
| *** Goneri has joined #oooq | 15:19 | |
| *** rlandy|ruck|mtg is now known as rlandy|ruck | 15:22 | |
| chandankumar | ysandeep|away, marios https://trunk.rdoproject.org/centos8-train/tripleo-ci-testing/ is now available | 15:24 |
| marios | chandankumar: thx | 15:26 |
| bhagyashris | ysandeep|away, yeah i saw that ... | 15:35 |
| chandankumar | rlandy|ruck, marios rfolco https://review.rdoproject.org/r/#/c/28216/ | 15:36 |
| marios | chandankumar: ack | 15:40 |
| marios | zbr: panda: please when you have time check https://review.rdoproject.org/r/#/c/28161/ | 15:41 |
| rlandy|ruck | zbr: thoughts on https://bugs.launchpad.net/tripleo/+bug/1884989? | 15:43 |
| openstack | Launchpad bug 1884989 in tripleo "openstack-tox-pep8 is failing when run on tripleo-common changes - stable/train" [Critical,Triaged] | 15:43 |
| zbr | rlandy|ruck: pep8 is historical job, we were supported to us openstack-tox-linters | 15:44 |
| rlandy|ruck | zbr: can you comment on the bug | 15:45 |
| rlandy|ruck | idk who is responsible to fix this | 15:45 |
| zbr | but best is to post about it on #openstack-infra likely is related to changes made to zuul-jobs | 15:45 |
| chandankumar | rlandy|ruck, please have a look https://logserver.rdoproject.org/94/28194/4/check/periodic-tripleo-build-containers-ubi-8/dd3cf6d/logs/build.log whne free | 15:46 |
| rlandy|ruck | zbr: Alex has a conversation there | 15:46 |
| chandankumar | rlandy|ruck, https://review.rdoproject.org/r/#/c/28194/ | 15:46 |
| rlandy|ruck | zbr: ... | 15:47 |
| rlandy|ruck | <AJaeger> mwhahaha: that is pep8 - and it runs " tox -e linters -- flake8" | 15:47 |
| rlandy|ruck | <AJaeger> So, you invoke tox inside tox ;( | 15:47 |
| rlandy|ruck | <AJaeger> That's the problem | 15:47 |
| rlandy|ruck | who is at fault here? | 15:47 |
| zbr | i am still reading... | 15:48 |
| *** amoralej is now known as amoralej|off | 15:53 | |
| *** marios has quit IRC | 16:07 | |
| rlandy|ruck | zbr++ ... | 16:14 |
| rlandy|ruck | thanks for picking this up | 16:14 |
| *** pojadhav is now known as pojadhav|dinner | 16:15 | |
| *** ysandeep|away is now known as ysandeep | 16:16 | |
| ysandeep | rlandy|ruck, hey ronelle o/ , ideas what can cause POST_FAILURE ? My job rans well but getting POST_FAILURE in status - periodic-tripleo-ci-rhel-8-multinode-1ctlr-featureset010-clients-rhos-17 https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/build/c23178e41c9b4c35b7bfbe386fb6ae2a : POST_FAILURE in 2h 05m 10s (non-voting) | 16:20 |
| rlandy|ruck | ysandeep: been watch upstream this morning ... will look at downstream later | 16:23 |
| rlandy|ruck | there were some failures yesterday - today is looking better | 16:24 |
| rlandy|ruck | panda: hello - promoter question | 16:24 |
| rlandy|ruck | what happens if the promoter is restarted in the middle of a container push? | 16:24 |
| ysandeep | rlandy|ruck, thanks! post failures with multinode job only - but job run is good.. no worries will check later.. know u busy with RR | 16:25 |
| rlandy|ruck | panda: http://38.102.83.109/centos7_stein.log | 16:25 |
| *** ysandeep is now known as ysandeep|away | 16:26 | |
| *** derekh has quit IRC | 16:30 | |
| panda | rlandy|ruck: it will restart from scratch, trying to repush all containers | 16:34 |
| panda | rlandy|ruck: it will take a bit less as there's nothing to push fro some containers | 16:34 |
| rlandy|ruck | panda: ok - cool - at least I didn't break the world | 16:36 |
| rlandy|ruck | stein was pushing | 16:36 |
| rlandy|ruck | queens is now | 16:36 |
| rlandy|ruck | both logs show pushing containers | 16:36 |
| weshay_pto | rlandy|ruck, need anything? | 16:42 |
| soniya29|rover | rlandy|ruck, let's meet | 16:43 |
| rlandy|ruck | weshay_pto: yeah - I'll build your deck .. you can come back and be ruck | 16:43 |
| weshay_pto | lolz | 16:44 |
| rlandy|ruck | weshay_pto: actually not too bad | 16:44 |
| rlandy|ruck | cleaning up promotions | 16:44 |
| rlandy|ruck | queens going now | 16:44 |
| weshay_pto | thanks for working through the issues | 16:44 |
| weshay_pto | nice | 16:44 |
| rlandy|ruck | stein afterwards | 16:44 |
| rlandy|ruck | rdocloud stacks are CLEAN | 16:44 |
| weshay_pto | WOOT | 16:44 |
| rlandy|ruck | we're ok | 16:44 |
| rlandy|ruck | sshnaidm|off is out until eow | 16:45 |
| weshay_pto | ugh | 16:45 |
| rlandy|ruck | even ci.centos is passing | 16:45 |
| weshay_pto | lolz | 16:45 |
| rlandy|ruck | yesterday the gate was disaster | 16:45 |
| rlandy|ruck | better today | 16:45 |
| rlandy|ruck | weshay_pto: how's the deck? | 16:45 |
| rlandy|ruck | soniya29|rover: ready to meet when you are | 16:45 |
| weshay_pto | all the road base is in and we've tamped it | 16:46 |
| weshay_pto | 3,900 bricks to be delivered this saturday | 16:46 |
| rlandy|ruck | weshay_pto: surprised to see that tripleo component has not promoted in ages | 16:46 |
| zbr | rlandy|ruck: i will be out soon, can you watch https://review.opendev.org/#/c/737841/ and eventually tune it? or backporting. | 16:46 |
| weshay_pto | rlandy|ruck, ya. .saw that | 16:46 |
| rlandy|ruck | not upstream or downstream | 16:47 |
| weshay_pto | that puppet change | 16:47 |
| rlandy|ruck | will work on that later today | 16:47 |
| weshay_pto | apache module | 16:47 |
| zbr | summary tox-in-tox is bad, we need to avoid it | 16:47 |
| rlandy|ruck | zbr: ack | 16:47 |
| rlandy|ruck | thanks | 16:47 |
| weshay_pto | nested tox | 16:47 |
| weshay_pto | lolz | 16:47 |
| zbr | we should have known that from the docker-in-docker experience ;) | 16:47 |
| rlandy|ruck | it's always tox | 16:47 |
| rlandy|ruck | weshay_pto: oh guess what??? | 16:48 |
| rlandy|ruck | I have a token to hold nodes now | 16:48 |
| rlandy|ruck | I am so armed and dangerous | 16:48 |
| weshay_pto | ah.. NICE | 16:48 |
| rlandy|ruck | downstream only | 16:48 |
| weshay_pto | bridges are being built finally.. | 16:48 |
| weshay_pto | still good | 16:48 |
| rlandy|ruck | I think infra had it with my asking | 16:48 |
| weshay_pto | lolz | 16:48 |
| weshay_pto | wear them down! | 16:49 |
| rlandy|ruck | aye aye captain | 16:49 |
| soniya29|rover | rlandy|ruck, https://meet.google.com/qbo-sybe-uaa | 16:49 |
| weshay_pto | 0/ | 16:49 |
| weshay_pto | will check in tomorrow | 16:50 |
| weshay_pto | if anyone needs anything | 16:50 |
| weshay_pto | email as well | 16:50 |
| rlandy|ruck | weshay_pto: see you then | 16:50 |
| rlandy|ruck | soniya29|rover: joining | 16:50 |
| rlandy|ruck | soniya29|rover: https://ci.centos.org/view/rdo/view/promotion-pipeline/ | 16:53 |
| *** pojadhav|dinner is now known as pojadhav | 16:58 | |
| *** jpena is now known as jpena|off | 17:03 | |
| *** dtantsur is now known as dtantsur|afk | 17:08 | |
| *** apetrich has quit IRC | 17:20 | |
| soniya29|rover | rlandy|ruck, network is fluctuating | 17:21 |
| rlandy|ruck | soniya29|rover: ok - dropping - ping me if you need anything | 17:22 |
| soniya29|rover | rlandy|ruck, sorry, network fluctuates too badly | 17:22 |
| rlandy|ruck | np | 17:23 |
| *** apetrich has joined #oooq | 17:24 | |
| *** apetrich has quit IRC | 18:15 | |
| *** apetrich has joined #oooq | 18:16 | |
| *** irclogbot_3 has quit IRC | 18:34 | |
| rlandy|ruck | rfolco: what's the story with https://bugs.launchpad.net/tripleo/+bug/1878248? | 18:34 |
| openstack | Launchpad bug 1878248 in tripleo "NetworkSecGroupTest failing on fs020 stein/train" [Critical,In progress] - Assigned to Rafael Folco (rafaelfolco) | 18:34 |
| rlandy|ruck | added to skiplist? | 18:34 |
| rlandy|ruck | https://logserver.rdoproject.org/50/21850/13/check/periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-stein/4d272b9/logs/tempest.html.gz | 18:35 |
| rlandy|ruck | I don't see it here | 18:35 |
| rfolco | rlandy|ruck, long short story... | 18:35 |
| rfolco | rlandy|ruck, was hitting that bug in periodic often | 18:36 |
| rlandy|ruck | it's still on CIX | 18:36 |
| rlandy|ruck | what happened to the test? | 18:36 |
| rfolco | rlandy|ruck, then was suggested to upgrade cirros... but I tested several times in testproject with old cirros, GREEN | 18:36 |
| rlandy|ruck | so can we close the bug? | 18:37 |
| rfolco | rlandy|ruck, yes, if the issue vanished, just close it. | 18:37 |
| rfolco | its not cirros I think* | 18:37 |
| rlandy|ruck | I don;t even see the test in https://logserver.rdoproject.org/50/21850/13/check/periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-stein/4d272b9/logs/tempest.html.gz | 18:37 |
| *** irclogbot_1 has joined #oooq | 18:37 | |
| rlandy|ruck | rfolco: ^^ was it removed? | 18:37 |
| rlandy|ruck | skipped? | 18:37 |
| chandankumar | rfolco, rlandy|ruck, https://review.opendev.org/#/c/733676/3 approved | 18:37 |
| rfolco | rlandy|ruck, skipped in stein I think, but this was also happening in train | 18:37 |
| rfolco | rlandy|ruck, still running in train, you may need to check if still failing | 18:38 |
| rlandy|ruck | chandankumar: rfolco: so we put the test back? | 18:38 |
| * rlandy|ruck confused | 18:38 | |
| rfolco | no, skip list for stein only | 18:38 |
| rfolco | train was under test since it was giving inconsistent results | 18:38 |
| rfolco | but in testproject 90% green, with old cirros | 18:39 |
| rfolco | in periodic more failures | 18:39 |
| rfolco | so I think* its not cirros fault | 18:39 |
| rfolco | maybe resource issue | 18:39 |
| rlandy|ruck | rfolco: chandankumar: ok - so I'm just closing out https://bugs.launchpad.net/tripleo/+bug/1878248 | 18:39 |
| openstack | Launchpad bug 1878248 in tripleo "NetworkSecGroupTest failing on fs020 stein/train" [Critical,In progress] - Assigned to Rafael Folco (rafaelfolco) | 18:39 |
| rlandy|ruck | ok? | 18:39 |
| rfolco | rlandy|ruck, let me check train periodic | 18:39 |
| rfolco | rlandy|ruck, lets close it | 18:41 |
| rfolco | https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-7-ovb-1ctlr_2comp-featureset020-train# | 18:41 |
| rfolco | latest failures are not tempest related | 18:41 |
| rlandy|ruck | ok | 18:42 |
| rlandy|ruck | rfolco: one more ... https://bugs.launchpad.net/tripleo/+bug/1881624 | 18:45 |
| openstack | Launchpad bug 1881624 in tripleo "full-tempest-scenario-master failing on test_ipv6_hotplug" [Critical,Triaged] | 18:45 |
| rlandy|ruck | can we revert the skiplist change? | 18:45 |
| rfolco | rlandy|ruck, need to test with new cirros, I don't know | 18:47 |
| rlandy|ruck | soniya29|rover: ^^ here's an item | 18:48 |
| rfolco | rlandy|ruck, this one netowrking guys were looking at... | 18:48 |
| rlandy|ruck | we need to recheck that | 18:48 |
| rfolco | rlandy|ruck, maybe check with networking dfg first | 18:49 |
| rlandy|ruck | https://trello.com/c/SH18qURV/1479-cixlp1876893tripleociproa-error-error-removing-container-device-or-resource-busy | 18:49 |
| rlandy|ruck | ^^ checking this now | 18:49 |
| *** Goneri has quit IRC | 19:30 | |
| *** sanjayu_ has quit IRC | 19:39 | |
| *** rfolco has quit IRC | 20:47 | |
| *** matbu has quit IRC | 20:56 | |
| *** matbu has joined #oooq | 21:03 | |
| *** jmasud has quit IRC | 21:28 | |
| *** jfrancoa has quit IRC | 21:57 | |
| *** rfolco has joined #oooq | 22:04 | |
| *** Tengu has quit IRC | 22:05 | |
| *** Tengu has joined #oooq | 22:07 | |
| *** rlandy|ruck is now known as rlandy|ruck|bbl | 22:22 | |
| *** rfolco has quit IRC | 22:27 | |
| *** TrevorV has quit IRC | 22:41 | |
| *** tosky has quit IRC | 23:03 | |
| *** rfolco has joined #oooq | 23:23 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!