| *** vinaykns has quit IRC | 00:32 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 00:50 |
|---|---|---|
| *** openstack has joined #oooq | 01:17 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 02:50 |
| *** jaganathan has joined #oooq | 02:51 | |
| *** skramaja has joined #oooq | 02:57 | |
| *** vinaykns has joined #oooq | 03:13 | |
| *** udesale has joined #oooq | 03:46 | |
| *** tcw has quit IRC | 03:50 | |
| *** vinaykns has quit IRC | 03:53 | |
| *** tcw has joined #oooq | 03:58 | |
| *** d0ugal has quit IRC | 04:15 | |
| *** d0ugal_ has joined #oooq | 04:15 | |
| *** ykarel has joined #oooq | 04:21 | |
| *** noama has joined #oooq | 04:41 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 04:50 |
| *** hamzy_ has quit IRC | 05:36 | |
| *** hamzy has joined #oooq | 05:38 | |
| *** hamzy has quit IRC | 05:40 | |
| *** hamzy has joined #oooq | 05:42 | |
| *** ratailor has joined #oooq | 05:45 | |
| *** quiquell|off is now known as quiquell|rover | 05:51 | |
| quiquell|rover | ykarel: Good morning, do you know if qpid were updated at RDO ? | 05:51 |
| ykarel | quiquell|rover, you mean https://review.rdoproject.org/r/#/c/14379/ | 05:52 |
| quiquell|rover | ykarel: ack, yep. | 05:53 |
| *** yolanda has joined #oooq | 05:53 | |
| quiquell|rover | ykarel: Do you know if we can do the same for pike ? | 05:59 |
| ykarel | you mean qpid update? | 06:00 |
| *** bogdando has joined #oooq | 06:00 | |
| ykarel | quiquell|rover, is this repo quickstart-centos-opstools required in pike? | 06:06 |
| ykarel | and updated version is provided by ^^ repo for qpid- | 06:06 |
| quiquell|rover | ykarel: The needed patch is not yet merged | 06:09 |
| quiquell|rover | ykarel: festureset002 doesn't need opstools | 06:09 |
| quiquell|rover | ykarel: And it's the need | 06:09 |
| *** florianf has joined #oooq | 06:10 | |
| *** kopecmartin has joined #oooq | 06:17 | |
| *** jbadiapa has joined #oooq | 06:35 | |
| *** jtomasek has joined #oooq | 06:43 | |
| ykarel | quiquell|rover, btw i have proposed revert:- https://review.openstack.org/#/c/577727/ | 06:46 |
| *** quiquell|rover is now known as quique|rover|afk | 06:47 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 06:50 |
| quique|rover|afk | ykarel: Let's take a look after coming back | 06:52 |
| ykarel | ack | 06:54 |
| *** zoli|gone is now known as zoli | 07:13 | |
| *** tesseract has joined #oooq | 07:20 | |
| *** quique|rover|afk is now known as quiquell|rover | 07:30 | |
| *** saneax has joined #oooq | 07:35 | |
| quiquell|rover | ykarel: You rever is related to this ? https://bugs.launchpad.net/tripleo/+bug/1778472 | 07:37 |
| openstack | Launchpad bug 1778472 in tripleo "docker pull failed: Get https://registry-1.docker.io/v2/tripleomaster/centos-binary-rsyslog-base/manifests/current-tripleo: received unexpected HTTP status: 503 Service Unavailable" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 07:37 |
| ykarel | quiquell|rover, nope | 07:37 |
| ykarel | to fs002 and fs020 failures | 07:37 |
| ykarel | overcloud-prep-images | 07:38 |
| quiquell|rover | ack | 07:40 |
| *** amoralej|off is now known as amoralej | 07:42 | |
| *** pgadiya has joined #oooq | 07:59 | |
| *** pgadiya has quit IRC | 07:59 | |
| *** ccamacho has joined #oooq | 08:11 | |
| *** d0ugal_ has quit IRC | 08:16 | |
| *** d0ugal has joined #oooq | 08:17 | |
| *** d0ugal has joined #oooq | 08:17 | |
| *** ykarel_ has joined #oooq | 08:19 | |
| *** ykarel_ is now known as ykarel|lunch | 08:21 | |
| *** ykarel has quit IRC | 08:22 | |
| *** chem has joined #oooq | 08:24 | |
| *** arxcruz|off is now known as arxcruz | 08:26 | |
| *** sshnaidm|off is now known as sshnaidm | 08:39 | |
| *** jaosorior has joined #oooq | 08:43 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 08:50 |
| *** dtantsur|afk is now known as dtantsur | 09:03 | |
| ajo | folks I neeed help with this "[Openstack] [tripleo] [tripleo-quickstart] quickstart.sh failing" | 09:21 |
| ajo | I'm a bit blocked | 09:22 |
| quiquell|rover | ajo: You mean this ? https://bugs.launchpad.net/tripleo/+bug/1777896 | 09:24 |
| openstack | Launchpad bug 1777896 in tripleo " "AnsibleUndefinedVariable: 'container_build_id' is undefined"}"" [High,In progress] - Assigned to wes hayutin (weshayutin) | 09:24 |
| ajo | quiquell|rover: oh yes | 09:24 |
| quiquell|rover | ajo: I have some many fires now that didn't have time to fix it | 09:24 |
| ajo | quiquell|rover: oh, I'm a bit blocked, I'm working on neutron ml2/ovs to ovn migration and I can't deploy ':D | 09:25 |
| ajo | at least a decent workaround would help me | 09:25 |
| ajo | I found the one of manually defining those vars with whatever it's expected | 09:25 |
| ajo | but then I didn't see my hosts | 09:25 |
| ajo | or the overcloud-deploy.sh script | 09:25 |
| ajo | something went wrong under the hood | 09:26 |
| quiquell|rover | ajo: Let me check, just to change fires at least :-) | 09:26 |
| ajo | quiquell|rover++ I really appreciate your firefighting :S | 09:26 |
| hubbot | ajo: quiquell|rover's karma is now 1 | 09:26 |
| quiquell|rover | Ups I think I had already 1 at my karma :-) | 09:26 |
| ajo | quiquell++ | 09:27 |
| ajo | quiquell If we know when this got broken, I could may be use an older quickstart | 09:27 |
| ajo | quiquell|rover: it should be fine as long as I set the --no-clone option, right? | 09:27 |
| quiquell|rover | ajo: Maybe is not just quickstar and there are some roles issue | 09:28 |
| ajo | oh | 09:28 |
| ajo | ok | 09:28 |
| ajo | makes sense | 09:28 |
| quiquell|rover | let me check | 09:28 |
| *** zoli is now known as zoli|lunch | 09:28 | |
| *** ykarel|lunch is now known as ykarel | 09:29 | |
| ajo | quiquell|rover: I wonder why doesn't it happen on CI? shouldn't we have some sort of very simple quickstart invocation (close to what the novice/default user will invoke) ? | 09:33 |
| ajo | that way if we break the very simple cases we also notice | 09:33 |
| quiquell|rover | ajo: Did you check Wes change ? https://review.openstack.org/#/c/576904/ | 09:37 |
| ajo | quiquell|rover: let me try it | 09:37 |
| quiquell|rover | ajo: We call it differently I think | 09:37 |
| ajo | quiquell|rover: yeah, we need something calling it on the standard way too | 09:40 |
| ajo | quiquell|rover: how do I try that patch? it's on the extras repo | 09:40 |
| ajo | I normally only checkout quickstart | 09:41 |
| quiquell|rover | two options | 09:42 |
| quiquell|rover | change quickstart.sh and add a git review -d 576904 | 09:42 |
| quiquell|rover | at the cloning | 09:42 |
| quiquell|rover | or go to your ~/.quickstart/ directory | 09:43 |
| quiquell|rover | and set it there but also execute with --no-clone | 09:43 |
| ajo | ack | 09:43 |
| ajo | diff --git a/quickstart.sh b/quickstart.sh | 09:43 |
| ajo | index 5275ad3..0900fa6 100755 | 09:43 |
| ajo | --- a/quickstart.sh | 09:43 |
| ajo | +++ b/quickstart.sh | 09:43 |
| ajo | @@ -145,6 +145,7 @@ bootstrap () { | 09:43 |
| ajo | git://git.openstack.org \ | 09:43 |
| ajo | openstack/tripleo-quickstart-extras | 09:43 |
| ajo | cd openstack/tripleo-quickstart-extras | 09:43 |
| ajo | + git review -d 576904 | 09:43 |
| ajo | pip install . | 09:43 |
| ajo | popd | 09:43 |
| ajo | so this may work, right | 09:44 |
| ajo | ? | 09:44 |
| ajo | quiquell|rover: ^ | 09:44 |
| quiquell|rover | ajo: yep | 09:44 |
| ajo | k, trying | 09:44 |
| quiquell|rover | do a --clean just to be sure | 09:44 |
| ajo | ack | 09:45 |
| ajo | it's running, we will see | 09:45 |
| quiquell|rover | ajo: Let me know, I am running it too | 09:45 |
| ajo | ack thanks | 09:45 |
| quiquell|rover | arxcruz: This one can be close https://bugs.launchpad.net/tripleo/+bug/1776729 ? | 09:55 |
| openstack | Launchpad bug 1776729 in tripleo "tempest, access denied error in object storage tests failing in rocky build" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 09:55 |
| arxcruz | quiquell|rover: hey, i update trello board few minutes ago | 09:56 |
| arxcruz | quiquell|rover: but tl;dr; no, because there's no run that we can confirm it's now fixed | 09:56 |
| quiquell|rover | arxcruz: ack | 09:59 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 10:51 |
| *** zoli|lunch is now known as zoli | 11:04 | |
| *** quiquell|rover has quit IRC | 11:06 | |
| *** pgadiya has joined #oooq | 11:14 | |
| *** pgadiya has quit IRC | 11:14 | |
| *** atoth has joined #oooq | 11:15 | |
| *** quiquell has joined #oooq | 11:19 | |
| *** udesale has quit IRC | 11:27 | |
| *** tosky has joined #oooq | 11:28 | |
| *** amoralej is now known as amoralej|lunch | 11:32 | |
| *** noama has quit IRC | 11:37 | |
| *** ratailor has quit IRC | 12:12 | |
| *** trown|outtypewww has quit IRC | 12:15 | |
| *** ykarel_ has joined #oooq | 12:20 | |
| *** weshay_ is now known as weshay|ruck | 12:22 | |
| *** ykarel has quit IRC | 12:22 | |
| *** ykarel_ is now known as ykarel | 12:24 | |
| sshnaidm | rfolco_, hi | 12:27 |
| rfolco_ | o/ sshnaidm | 12:27 |
| sshnaidm | rfolco_, https://softwarefactory.usersys.redhat.com/r/#/c/124/ | 12:27 |
| sshnaidm | rfolco_, do you have 5 min for sync? | 12:27 |
| rfolco_ | yes, bj? | 12:28 |
| weshay|ruck | quiquell, is this the undercloud issue causing all those fails? https://bugs.launchpad.net/tripleo/+bug/1778505 | 12:28 |
| openstack | Launchpad bug 1778505 in tripleo "Undercloud heat installer cannot rely on stack_action" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 12:28 |
| sshnaidm | rfolco_, https://bluejeans.com/u/sshnaidm/ | 12:29 |
| rfolco_ | one sec | 12:29 |
| quiquell | weshay|ruck: Some of them, those are for the upload jobs blockers | 12:29 |
| quiquell | weshay|ruck: Then we have son 503 problems with docker hub | 12:29 |
| weshay|ruck | OH | 12:29 |
| quiquell | weshay|ruck: And also qpid is still hating us on pike and ocata... have a fix for it | 12:30 |
| quiquell | weshay|ruck: But zuul migration doesn't help now | 12:30 |
| quiquell | weshay|ruck: chek the four alerts | 12:30 |
| quiquell | except quickstart | 12:30 |
| weshay|ruck | k.. thanks | 12:30 |
| quiquell | I am totally lose at puppet thing btw pufff | 12:31 |
| *** amoralej|lunch is now known as amoralej | 12:31 | |
| weshay|ruck | quiquell, can you join me in the ci escalation call | 12:31 |
| weshay|ruck | I don't have all the details for this stuff yet | 12:31 |
| quiquell | weshay|ruck: sure, will try my best | 12:32 |
| *** rlandy has joined #oooq | 12:32 | |
| *** trown has joined #oooq | 12:35 | |
| rfolco_ | sshnaidm, https://review.openstack.org/#/c/576956/ | 12:40 |
| weshay|ruck | quiquell, so do you have a fix for fs002? | 12:40 |
| sshnaidm | rfolco_, tripleo-ci-centos-7-undercloud-oooq ? | 12:41 |
| quiquell | weshay|ruck: mwhahaha have one, I am testing it at my reproducer | 12:41 |
| quiquell | weshay|ruck: Make rabbitmq password idempotent | 12:41 |
| weshay|ruck | quiquell, oh man.. why does that only hit the one job? | 12:42 |
| weshay|ruck | overcloud delete? | 12:42 |
| *** chem has quit IRC | 12:42 | |
| quiquell | weshay|ruck: I think it's the only featureset with check_undercloud_idempotentcy activated | 12:42 |
| quiquell | weshay|ruck: At least on the promotions | 12:43 |
| weshay|ruck | quiquell, odd.. that is run in check though | 12:43 |
| weshay|ruck | quiquell, crap | 12:43 |
| weshay|ruck | k | 12:43 |
| quiquell | weshay|ruck: Maybe check is affected too, but we are not exercising using noops | 12:43 |
| quiquell | let me dig a little (my brain is going to blow up ) | 12:43 |
| quiquell | weshay|ruck: btw, added some stuff to the ansible callbacks for ara | 12:44 |
| *** trown_ has joined #oooq | 12:44 | |
| weshay|ruck | quiquell, I saw | 12:47 |
| weshay|ruck | quiquell, the rabbitmq issue is https://bugs.launchpad.net/tripleo/+bug/1778505 ? | 12:47 |
| openstack | Launchpad bug 1778505 in tripleo "Undercloud heat installer cannot rely on stack_action" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 12:47 |
| *** kopecmartin has quit IRC | 12:47 | |
| quiquell | weshay|ruck: Âhttps://bugs.launchpad.net/tripleo/+bug/1777939 | 12:48 |
| openstack | Launchpad bug 1777939 in tripleo "Unable to connect to AMQP server on undercloud.internalapi.localdomain:5672 after None tries: (0, 0): (403) ACCESS_REFUSED " [Critical,In progress] - Assigned to Bogdan Dobrelya (bogdando) | 12:48 |
| weshay|ruck | ok.. so same bug | 12:48 |
| quiquell | weshay|ruck: The other ones discover by it and stopping the first fix | 12:48 |
| quiquell | weshay|ruck: same | 12:48 |
| *** kopecmartin has joined #oooq | 12:48 | |
| *** chem has joined #oooq | 12:49 | |
| *** trown_ has left #oooq | 12:50 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 12:51 |
| quiquell | weshay|ruck: Damn... I miss the scalation CI | 12:53 |
| rfolco_ | sshnaidm, https://softwarefactory.usersys.redhat.com/r/#/c/111/ | 12:54 |
| ajo | quiquell: weshay|ruck ajo: this worked for me https://review.openstack.org/#/c/576904/ | 13:00 |
| ajo | thanks :) | 13:00 |
| rfolco_ | sshnaidm, 111 MERGED | 13:01 |
| sshnaidm | rfolco_, cool, thanks | 13:01 |
| sshnaidm | weshay|ruck, 1:1:? | 13:01 |
| quiquell | ajo: Cool | 13:02 |
| rfolco_ | ty | 13:02 |
| *** waleedm has joined #oooq | 13:02 | |
| weshay|ruck | sshnaidm, need to push out a bit | 13:02 |
| sshnaidm | weshay|ruck, ok, ping me then | 13:03 |
| waleedm | Hi guys, I've an issue the quickstart sttup as container_build_id is undefined, Can anyone help please? | 13:04 |
| quiquell | waleedm: Fix https://review.openstack.org/#/c/576904/ | 13:04 |
| waleedm | quiqell: Is it tested | 13:05 |
| quiquell | waleedm: ajo have similar issue and fixed with it, but we have to productify this | 13:06 |
| *** Guest71763 is now known as honza | 13:07 | |
| waleedm | I used it didn't work, may be I did it with incorrectly, I'll check with ajo how to apply that change | 13:07 |
| ajo | waleedm: I did this: | 13:08 |
| ajo | waleedm: | 13:08 |
| ajo | diff --git a/quickstart.sh b/quickstart.sh | 13:08 |
| ajo | index 5275ad3..0900fa6 100755 | 13:08 |
| ajo | --- a/quickstart.sh | 13:08 |
| ajo | +++ b/quickstart.sh | 13:08 |
| ajo | @@ -145,6 +145,7 @@ bootstrap () { | 13:08 |
| ajo | git://git.openstack.org \ | 13:08 |
| ajo | openstack/tripleo-quickstart-extras | 13:08 |
| ajo | cd openstack/tripleo-quickstart-extras | 13:08 |
| ajo | + git review -d 576904 | 13:08 |
| ajo | pip install . | 13:08 |
| ajo | popd | 13:08 |
| ajo | fi | 13:08 |
| ajo | and I used the --clean | 13:08 |
| ajo | flag | 13:08 |
| waleedm | I see I'll try it, thanks | 13:08 |
| ajo | waleedm :) | 13:09 |
| quiquell | weshay|ruck: docker.io registry is working again | 13:11 |
| *** agopi has joined #oooq | 13:15 | |
| *** kopecmartin has quit IRC | 13:19 | |
| *** kopecmartin has joined #oooq | 13:20 | |
| *** agopi has quit IRC | 13:29 | |
| *** agopi has joined #oooq | 13:30 | |
| *** skramaja has quit IRC | 13:32 | |
| *** agopi_ has joined #oooq | 13:32 | |
| *** agopi has quit IRC | 13:34 | |
| *** agopi_ is now known as agopi | 13:44 | |
| *** jaganathan has quit IRC | 13:47 | |
| *** zoli is now known as zoli|afk | 13:47 | |
| agopi | rlandy, myoung is there a workaround for the setup.cfg for tripleo-quickstart-extras git not copying files ? | 13:49 |
| agopi | ^ more context | 13:50 |
| agopi | https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/periodic-ocata-rdo_trunk-featureset020-1ctlr_1comp_64gb/62/console | 13:50 |
| agopi | ^ the error seems to arise from | 13:50 |
| agopi | https://github.com/openstack/tripleo-quickstart-extras/blob/master/setup.cfg#L29 not executing?? | 13:50 |
| *** vinaykns has joined #oooq | 13:52 | |
| myoung | agopi: welcome back! are you done for the year and back with us now? | 13:53 |
| myoung | agopi: we are about to go into tripleo-ci scrum, can look at this after / later this morning | 13:53 |
| agopi | myoung, yess i am :) | 13:54 |
| agopi | sounds good myoung :) thanks | 13:54 |
| myoung | agopi: great! regarding your error, a quick look yields... | 13:55 |
| myoung | 00:01:16.792 error in setup command: Error parsing /tmp/pip-install-j0PLfE/cliff/setup.cfg: SyntaxError: '<' operator not allowed in environment markers | 13:55 |
| myoung | ^^ dubious...perhaps the slave VM needs an update, feel free to log a LP so we can track, this is a failure in rdo2 and can be triaged / handled as such | 13:55 |
| quiquell | sshnaidm: https://review.rdoproject.org/r/#/c/14473/ | 13:56 |
| myoung | o/ Good monday morning! The Danger Room (https://en.wikipedia.org/wiki/Danger_Room) has been activated, tripleo-ci scrum starts in 2 mins --> https://etherpad.openstack.org/p/tripleo-ci-squad-meeting, https://bluejeans.com/7050859455 | 13:58 |
| sshnaidm | quiquell, for which graph is it? | 13:59 |
| quiquell | sshnaidm: noop check jobs gauge, it was not correct | 13:59 |
| quiquell | sshnaidm: Now it hosws the last 8h run | 13:59 |
| sshnaidm | quiquell, ack | 13:59 |
| quiquell | sshnaidm: Aligned with the table | 14:00 |
| myoung | panda|off: ping | 14:02 |
| agopi | ack myoung | 14:06 |
| *** quiquell is now known as quiquell|off | 14:10 | |
| sshnaidm | rfolco_, do you know why my undercloud job doesn't run? https://softwarefactory.usersys.redhat.com/zuul/t/local/status.html | 14:34 |
| weshay|ruck | sshnaidm, 1-1 | 14:35 |
| rlandy | panda|off: hi - you in today? | 14:35 |
| rlandy | if so, panda|off is confusing us :) | 14:36 |
| rfolco_ | sshnaidm, the job is taking longer to start because it is cloning all the repos .... this started happening when I addded all required-projects to the base job | 14:36 |
| *** ykarel has quit IRC | 14:36 | |
| rlandy | panda|off: I am running through trown's etherpad today but I have no assigned tasks after that - pls advise | 14:36 |
| *** panda|off is now known as panda | 14:36 | |
| rfolco_ | sshnaidm, something bad may happened, will have to talk to SF guys | 14:37 |
| *** ykarel has joined #oooq | 14:38 | |
| rlandy | marios: are you all set for test hardware? | 14:38 |
| rlandy | marios: beaker box you have is sufficient? | 14:39 |
| rfolco_ | sshnaidm, https://softwarefactory.usersys.redhat.com/zuul/t/local/stream.html?uuid=b62708290888418787a236882c247c4b&logfile=console.log | 14:39 |
| rfolco_ | just taking too long, will see if any pre-cache step in dib stage is missing to speed up job start | 14:40 |
| trown | I just noticed there is a giant snake skin in the corner of my office... and I have sandals on... | 14:40 |
| myoung | panda: if you have time today before your out I need 15 mins of your time | 14:41 |
| panda | marios: sure, ready in 30 | 14:41 |
| myoung | trown: you need a pet mongoose | 14:42 |
| *** tcw has quit IRC | 14:42 | |
| trown | myoung: ya... or just an office that is a little more sealed to the outside world :P | 14:42 |
| myoung | trown: and I don't mean ORM :) | 14:43 |
| *** udesale has joined #oooq | 14:45 | |
| marios | rlandy: no, well the reproducer script completed but df -h shows like 100% usage (http://pastebin.test.redhat.com/608693 ) | 14:45 |
| *** tcw has joined #oooq | 14:49 | |
| rlandy | marios: ok - we have a whole spreadsheet of hardware - will chat with weshay|ruck later to see what is available to lend out | 14:49 |
| marios | rlandy: thanks | 14:49 |
| *** zoli|afk is now known as zoli | 14:50 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 14:51 |
| *** bogdando has quit IRC | 14:51 | |
| marios | panda: https://github.com/openstack-infra/tripleo-ci/blob/master/scripts/common_functions.sh | 14:52 |
| marios | https://github.com/openstack-infra/tripleo-ci/tree/master/scripts panda here | 14:52 |
| *** waleedm has quit IRC | 14:55 | |
| *** ykarel is now known as ykarel|away | 14:55 | |
| weshay|ruck | panda, bug triage | 15:03 |
| *** vinaykns has left #oooq | 15:03 | |
| sshnaidm | rfolco_, ok, so it's just slow starting | 15:03 |
| myoung | panda, triage? | 15:03 |
| panda | myoung: weshay|ruck coming | 15:04 |
| *** ykarel|away has quit IRC | 15:14 | |
| arxcruz | panda: myoung sshnaidm weshay|ruck https://review.openstack.org/#/c/570159/ | 15:18 |
| arxcruz | when you guys have chance | 15:18 |
| arxcruz | trown: rlandy ^ | 15:18 |
| sshnaidm | arxcruz, it's too much green | 15:20 |
| *** saneax has quit IRC | 15:20 | |
| sshnaidm | arxcruz, you must be cheating | 15:20 |
| arxcruz | sshnaidm: lol | 15:21 |
| sshnaidm | trown, rlandy marios its' ready for review, please: https://review.openstack.org/#/c/576834/ | 15:21 |
| sshnaidm | and this: https://review.openstack.org/#/c/577801/ | 15:22 |
| sshnaidm | rfolco_, seems like dependent changes weren't used in the job: https://softwarefactory.usersys.redhat.com/r/#/c/125/ | 15:29 |
| sshnaidm | rfolco_, ZUUL_CHANGES=3oci2-jobs:master:refs/changes/25/125/2 | 15:29 |
| sshnaidm | rfolco_, there should be also tripleo-common and quickstart changes from dependencies | 15:29 |
| myoung | weshay|ruck: are you joining tempest squad scrum? | 15:33 |
| myoung | weshay|ruck: should we reschedule this to a diff time? | 15:33 |
| myoung | weshay|ruck: tempest squad has a specific question about https://bugzilla.redhat.com/show_bug.cgi?id=1488095, time critical, need PM input on how to proceed, do you have a moment to pop in? | 15:42 |
| openstack | bugzilla.redhat.com bug 1488095 in openstack-containers "[RFE] Containerize Tempest" [High,On_qa] - Assigned to chkumar | 15:42 |
| *** apetrich has quit IRC | 15:42 | |
| *** apetrich has joined #oooq | 15:45 | |
| *** matbu has quit IRC | 15:45 | |
| arxcruz | rlandy: sshnaidm trown weshay|ruck https://review.openstack.org/#/c/565161/ | 15:46 |
| arxcruz | when you guys have chance | 15:46 |
| *** matbu has joined #oooq | 15:46 | |
| panda | rlandy: you have 5 min to chat re: tasks ? | 15:48 |
| myoung | trown, sshnaidm, rlandy, arxcruz: we have 3 +2 but need a +W --> https://review.openstack.org/#/c/570159 Removing options in configure-tempest | 15:52 |
| rlandy | panda: yeah | 15:56 |
| *** dtantsur is now known as dtantsur|afl | 15:59 | |
| *** dtantsur|afl is now known as dtantsur|afk | 15:59 | |
| *** brault has quit IRC | 16:02 | |
| *** zoli is now known as zoli|gone | 16:03 | |
| *** zoli|gone is now known as zoli | 16:03 | |
| rfolco_ | sshnaidm, looking | 16:06 |
| *** ykarel|away has joined #oooq | 16:09 | |
| rfolco_ | sshnaidm, I guess you should depends-on a change, not a commit: https://zuul-ci.org/docs/zuul/user/gating.html#cross-project-dependencies | 16:13 |
| *** brault has joined #oooq | 16:17 | |
| *** tesseract has quit IRC | 16:18 | |
| rfolco_ | sshnaidm, this seems to work: https://softwarefactory.usersys.redhat.com/r/#/c/111/8//COMMIT_MSG | 16:23 |
| *** ykarel|away has quit IRC | 16:24 | |
| sshnaidm | rfolco_, it's changes, not commits | 16:27 |
| sshnaidm | rfolco_, ok, I suppose I need to reference to them as links, not change-ID | 16:28 |
| rfolco_ | sshnaidm, yes, this have change in the new syntax apparently | 16:28 |
| sshnaidm | rfolco_, ack, let's try now | 16:29 |
| *** quiquell|off has quit IRC | 16:47 | |
| *** dsneddon has quit IRC | 16:48 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 16:51 |
| agopi | myoung, filed a bug https://bugzilla.redhat.com/show_bug.cgi?id=1594913 for the above mentioned error | 16:55 |
| openstack | bugzilla.redhat.com bug 1594913 in openstack-tripleo "CI: Tripleo parsing error while installing cliff" [Unspecified,New] - Assigned to jslagle | 16:55 |
| *** amoralej is now known as amoralej|off | 16:56 | |
| *** udesale has quit IRC | 16:56 | |
| sshnaidm | rfolco_, well, it didn't change much | 17:08 |
| rfolco_ | really? let me see | 17:09 |
| rlandy | trown++ - etherpad instructions wfm. deployment is prepping containers atm | 17:23 |
| hubbot | rlandy: trown's karma is now 2 | 17:23 |
| trown | rlandy: ya having trouble figuring out what is different in CI now :( | 17:24 |
| trown | rlandy: my deploy this morning on libvirt also worked | 17:24 |
| rfolco_ | sshnaidm, tripleo-common is not gated cross projects by zuul, looks like | 17:25 |
| sshnaidm | rfolco_, and tripleo-quickstart? | 17:26 |
| rfolco_ | sshnaidm, I believe it should be added here https://github.com/openstack-infra/tripleo-ci/blob/master/zuul.d/base.yaml#L16 if you want to depends-on a change from tripleo-common | 17:26 |
| *** kopecmartin has quit IRC | 17:27 | |
| sshnaidm | rfolco_, hmm.. then we need to have there all tripleo repos.. and maybe all repos at all | 17:27 |
| rfolco_ | sshnaidm, still looking for tq... | 17:27 |
| sshnaidm | rfolco_, dependencieds should work for all repos | 17:27 |
| rfolco_ | sshnaidm, yeah but this applies for upstream deps too | 17:27 |
| rfolco_ | I mean this is not SF specifics | 17:28 |
| rfolco_ | sshnaidm, if there is any repo you use in tripleo-ci and you want to patch, it should be cross-project-gated by zuul | 17:29 |
| rfolco_ | looks like common is not | 17:29 |
| rfolco_ | and it is not in the base job for legacy-dsvm-base in openstack-zuul-jobs either | 17:30 |
| *** myoung is now known as myoung|biab | 17:33 | |
| rfolco_ | sshnaidm, grant me permission to make a quick debug addition to your patch to see if the commit is correct | 17:36 |
| rfolco_ | sshnaidm, zuul pushes last commit to src dir, so the commit id you see there is not the one you see in the patch... but when you do a git show on the src dir, it shows the right id | 17:37 |
| rfolco_ | https://softwarefactory.usersys.redhat.com/logs/11/111/8/check/tripleo-ci-centos-7-undercloud-oooq/72ce65d/job-output.txt.gz#_2018-06-22_19_50_52_529382 | 17:37 |
| rfolco_ | my depends-on patch was used, look ^ | 17:37 |
| panda | trown: 192.168.24.0/24 dev br-ex proto kernel scope link src 192.168.24.2 | 17:38 |
| panda | 192.168.24.0/24 dev br-ctlplane proto kernel scope link src 192.168.24.1 | 17:38 |
| rfolco_ | sshnaidm, I'll make a quick hack on 125 | 17:38 |
| panda | rlandy: sorry, you have 5 minutes now ? | 17:39 |
| panda | trown: looks like we have two bridges that use the same ip range | 17:39 |
| panda | we need to add the bridges configurations on our logs collection | 17:40 |
| sshnaidm | rfolco_, I don't see where your patch is used.. | 17:41 |
| rfolco_ | sshnaidm, https://softwarefactory.usersys.redhat.com/r/#/c/111/8 | 17:41 |
| rlandy | panda: ok | 17:41 |
| rfolco_ | patchset 8 | 17:41 |
| panda | rlandy: my channel | 17:42 |
| rfolco_ | depends on tq change: Depends-On: https://review.openstack.org/#/c/576577/ | 17:42 |
| rfolco_ | sshnaidm, ^ | 17:42 |
| sshnaidm | rfolco_, it's merged patch | 17:42 |
| rfolco_ | sshnaidm, now its merged. Yours is merged too :) | 17:42 |
| sshnaidm | rfolco_, I think it was a coincidence with merged patch | 17:42 |
| trown | panda: that is true in libvirt setup too | 17:42 |
| rfolco_ | sshnaidm, gimme one sec and will test it again from a non-merged one | 17:43 |
| trown | panda: it is how we have always had it setup in CI, check a legacy job... same setup | 17:43 |
| rfolco_ | sshnaidm, will make a quick change to 125 ok? | 17:43 |
| trown | getting some lunch | 17:43 |
| *** trown is now known as trown|lunch | 17:43 | |
| sshnaidm | rfolco_, if you see it points to "Merge "update README to exclude Fedora from support"", not to original "update README to exclude Fedora from support" | 17:43 |
| sshnaidm | rfolco_, sure, fell free to hack it | 17:43 |
| sshnaidm | rfolco_, but dependencies should be on non-merged patches to avoid such confusion | 17:44 |
| rfolco_ | sshnaidm, ack | 17:44 |
| panda | trown: do you rp_filter set to 1 ? | 17:46 |
| panda | trown|lunch: I'm not making any sense | 18:07 |
| rfolco_ | sshnaidm, I'll investigate where zuul applies the depends-on change | 18:23 |
| *** sshnaidm is now known as sshnaidm|afk | 18:41 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 18:51 |
| *** atoth has quit IRC | 18:58 | |
| *** trown|lunch is now known as trown | 19:42 | |
| weshay|ruck | https://review.openstack.org/#/c/577809/ need reviews please | 19:44 |
| weshay|ruck | and thoughts on which periodic job to switch to test the undercloud idempotency | 19:45 |
| *** dsneddon has joined #oooq | 19:56 | |
| *** yolanda has quit IRC | 20:01 | |
| rlandy | weshay|ruck: have a moment to look at a hw test box to assign to marios? | 20:01 |
| weshay|ruck | ya.. /me looks | 20:01 |
| rlandy | looks like sagi has two assigned - is that required? | 20:01 |
| *** yolanda has joined #oooq | 20:01 | |
| rlandy | weshay|ruck: ^^ | 20:01 |
| weshay|ruck | thanks for the reminder.. I can't find 5 min | 20:01 |
| weshay|ruck | rlandy, no but we better ask him first | 20:01 |
| weshay|ruck | let me see what's under my name | 20:02 |
| rlandy | sshnaidm|afk: ping re: hardware asisgnment | 20:02 |
| rlandy | weshay|ruck: env1 is really not used | 20:02 |
| rlandy | the undercloud never got pxe boot to work | 20:02 |
| * weshay|ruck looks | 20:02 | |
| weshay|ruck | hrm.. ok | 20:02 |
| rlandy | we would need to renetwork those | 20:03 |
| rlandy | as they are setup as undercloud nodes | 20:03 |
| weshay|ruck | what line? | 20:03 |
| rlandy | but for the moment, .. | 20:03 |
| *** florianf has quit IRC | 20:03 | |
| rlandy | 60-76 | 20:03 |
| rlandy | we also have some slave that I am not sure are in full use | 20:04 |
| rlandy | all those virthost production | 20:05 |
| rlandy | I am not sure they are all required | 20:05 |
| weshay|ruck | rlandy, ok.. so | 20:06 |
| weshay|ruck | rlandy, let's not muck w/ the undercloud for env1 ( need to note that in the sheet) but lines 63 - 76 can be handed out as test machines | 20:06 |
| weshay|ruck | that is what we are saying? | 20:06 |
| rlandy | I think so | 20:07 |
| rlandy | unless we need to | 20:07 |
| rlandy | if sshnaidm|afk is using both boxes, | 20:07 |
| rlandy | we can investigate the virthosts | 20:08 |
| weshay|ruck | rlandy, first name.. rdo-ci-fx2-03-s4.lab.eng.rdu.redhat.com | 20:08 |
| weshay|ruck | oh wait | 20:08 |
| rlandy | waiting .... | 20:08 |
| weshay|ruck | ssh root@rdo-ci-fx2-03-s5.v102.rdoc | 20:08 |
| * weshay|ruck trys drac | 20:09 | |
| rlandy | what about that? | 20:09 |
| weshay|ruck | trying to ping / ssh to the hostnames or ips | 20:10 |
| weshay|ruck | nothing is coming back | 20:10 |
| rlandy | weshay|ruck: if we can pxe boot that, we can use it | 20:10 |
| rlandy | but iirc, that is networked to pxe from undercloud | 20:10 |
| weshay|ruck | k.. OH | 20:10 |
| weshay|ruck | k.. in on the drac | 20:11 |
| weshay|ruck | rlandy, so wait.. let's blue jeans for a sec | 20:11 |
| weshay|ruck | rlandy, so we need to update the pxe settings in drac for say.. rdo-ci-fx2-03-s5-drac.mg | 20:12 |
| *** myoung|biab is now known as myoung | 20:17 | |
| *** dsneddon has quit IRC | 20:43 | |
| weshay|ruck | rlandy, https://bugs.launchpad.net/tripleo/+bug/1773569 | 20:50 |
| openstack | Launchpad bug 1773569 in tripleo "TQE: ovb-create-stack.yml role overrides are not working as expected" [High,Triaged] - Assigned to Quique Llorente (quiquell) | 20:50 |
| rlandy | ok | 20:50 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 20:51 |
| weshay|ruck | rlandy, https://bugs.launchpad.net/tripleo/+bug/1773569 | 20:56 |
| openstack | Launchpad bug 1773569 in tripleo "TQE: ovb-create-stack.yml role overrides are not working as expected" [High,Triaged] - Assigned to Quique Llorente (quiquell) | 20:56 |
| weshay|ruck | myoung, fyi ^ | 20:56 |
| weshay|ruck | proposed solution in the bug | 20:56 |
| * myoung looks | 20:56 | |
| rlandy | myoung: we spoke about removing the set_fact | 20:57 |
| rlandy | and doing the switches in jinja in ci-rhos file | 20:57 |
| rlandy | that will accept an override from the command line | 20:57 |
| weshay|ruck | well.. it will just be set correctly w/ the env file | 20:58 |
| myoung | makes sense. | 20:59 |
| *** trown is now known as trown|outtypewww | 21:00 | |
| *** EmilienM_PTO has quit IRC | 21:04 | |
| *** EmilienM has joined #oooq | 21:04 | |
| *** EmilienM has quit IRC | 21:04 | |
| *** EmilienM has joined #oooq | 21:04 | |
| *** matbu has quit IRC | 21:22 | |
| *** dsneddon has joined #oooq | 21:27 | |
| rlandy | weshay|ruck: I put in a reconfigure request for the env 1 boxes to rh.servicenow. You were added to colaborators list | 21:29 |
| *** agopi has quit IRC | 21:31 | |
| *** dsneddon has quit IRC | 21:35 | |
| *** dsneddon has joined #oooq | 21:53 | |
| weshay|ruck | rlandy, thank you! | 22:17 |
| *** yolanda_ has joined #oooq | 22:21 | |
| *** yolanda has quit IRC | 22:22 | |
| *** yolanda__ has joined #oooq | 22:28 | |
| *** yolanda_ has quit IRC | 22:31 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 22:51 |
| *** agopi has joined #oooq | 22:58 | |
| *** tosky has quit IRC | 23:34 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!