| *** vinaykns has quit IRC | 00:20 | |
| *** ssbarnea has quit IRC | 00:28 | |
| *** irclogbot_0 has quit IRC | 00:38 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci- (4 more messages) | 00:44 |
|---|---|---|
| *** rlandy has quit IRC | 01:58 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035 @ https://review.openstack.org/604298, stable/pike: tripleo-ci- (3 more messages) | 02:44 |
| *** trungnv has joined #oooq | 03:42 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-quickstart-extras-gate-master-delorean-full- (2 more messages) | 04:44 |
| *** agopi has joined #oooq | 05:08 | |
| *** hamzy has joined #oooq | 05:18 | |
| *** trungnv has quit IRC | 05:22 | |
| *** rascasoft has quit IRC | 05:28 | |
| *** rnoriega- has quit IRC | 05:28 | |
| *** rnoriega has joined #oooq | 05:29 | |
| *** jrist has quit IRC | 05:58 | |
| *** d0ugal has quit IRC | 06:05 | |
| *** jrist has joined #oooq | 06:11 | |
| *** d0ugal has joined #oooq | 06:21 | |
| *** apetrich has quit IRC | 06:29 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-quickstart-extras-gate-master-delorean-full- (2 more messages) | 06:44 |
| *** radez has quit IRC | 06:44 | |
| *** apetrich has joined #oooq | 06:44 | |
| *** quiquell|off is now known as quiquell | 07:10 | |
| *** ccamacho has joined #oooq | 07:31 | |
| *** apetrich has quit IRC | 07:33 | |
| quiquell | marios: you there ? | 07:44 |
| *** jfrancoa has joined #oooq | 07:45 | |
| *** apetrich has joined #oooq | 07:47 | |
| *** quiquell is now known as quiquell|brb | 07:49 | |
| *** rascasoft has joined #oooq | 07:58 | |
| *** jtomasek has joined #oooq | 08:02 | |
| *** quiquell|brb is now known as quiquell | 08:04 | |
| marios | o/ sorry quiquell i am/as didn't see irc | 08:18 |
| marios | sup | 08:18 |
| quiquell | marios: want to show you something | 08:18 |
| quiquell | marios: Do you have time for redjeans ? | 08:18 |
| marios | sure | 08:18 |
| *** fuzzball81 has quit IRC | 08:22 | |
| *** jjoyce has joined #oooq | 08:40 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-quickstart-extras-gate-master-delorean-full- (2 more messages) | 08:44 |
| *** bogdando has joined #oooq | 08:45 | |
| *** amoralej|off is now known as amoralej | 08:45 | |
| *** ssbarnea has joined #oooq | 09:18 | |
| *** jtomasek has quit IRC | 09:26 | |
| *** jtomasek has joined #oooq | 09:31 | |
| ssbarnea | hi! if there is any sprint item where I can help with, please let me know. | 09:41 |
| *** panda|off is now known as panda | 09:43 | |
| *** derekh has joined #oooq | 09:44 | |
| ssbarnea | quiquell: can you please abandon https://review.openstack.org/#/c/615093/ ? | 09:46 |
| quiquell | done | 09:47 |
| panda | quiquell: ssbarnea what's missing ? | 09:48 |
| quiquell | panda: I would say just the fix for build-test-packages | 09:48 |
| quiquell | panda: and the release file | 09:48 |
| quiquell | panda: from CI perspective | 09:48 |
| quiquell | panda: the other patches ar non CI related | 09:48 |
| quiquell | ssbarnea: You can do some QE on those | 09:54 |
| quiquell | panda, ssbarnea, marios: jobs are broken | 09:56 |
| panda | of course | 09:57 |
| panda | quiquell: which ones ? | 09:57 |
| quiquell | panda: noop of master https://review.openstack.org/#/c/560445/ | 09:58 |
| quiquell | panda: I think it's not a CI stuff | 09:58 |
| quiquell | panda: We merged some stuff at puppet yesterday mybe this is it | 09:58 |
| *** kopecmartin|off is now known as kopecmartin | 09:59 | |
| *** sshnaidm|afk is now known as sshnaidm|rover | 10:01 | |
| quiquell | panda: https://bugs.launchpad.net/tripleo/+bug/1802083 | 10:05 |
| openstack | Launchpad bug 1802083 in tripleo "Undercloud install fails at Unknown function: 'normalize_ip_for_uri'" [Critical,Confirmed] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 10:05 |
| *** dsneddon has quit IRC | 10:16 | |
| panda | quiquell: do we have graphs with the memory usage of standalone tests somewhere ? | 10:31 |
| quiquell | panda: Not that I am aware, sshnaidm|rover ? | 10:33 |
| quiquell | panda: but maybe it's not difficult to get from job artifacts I think it has some measurements there | 10:33 |
| quiquell | panda: meminfo is useful here ? http://logs.openstack.org/79/615479/17/check/tripleo-ci-centos-7-standalone/9e0e2bb/logs/undercloud/var/log/extra/meminfo.txt.gz | 10:36 |
| quiquell | panda: we can collect those at dashboard-ci | 10:36 |
| *** rfolco|ruck has joined #oooq | 10:36 | |
| quiquell | panda: Don't know if final memory is what we want | 10:37 |
| panda | quiquell: found the dstat data | 10:40 |
| panda | alsmost forgot about it | 10:40 |
| sshnaidm|rover | panda, if you merged this we would have it: https://review.openstack.org/#/c/615357/ | 10:40 |
| quiquell | panda: where it is dstat ? | 10:42 |
| quiquell | sshnaidm|rover: cool the atop thingy | 10:43 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario003-multinode-oooq-container @ https://review.openstack.org/604298, master: tripleo- (3 more messages) | 10:44 |
| sshnaidm|rover | quiquell, I think in /var/log/extra should be nice chart of dstat | 10:45 |
| sshnaidm|rover | quiquell, at least it was there before | 10:45 |
| quiquell | sshnaidm|rover: Damn I was near :-) | 10:46 |
| quiquell | humm it's not there, panda where did you found it ? | 10:46 |
| quiquell | humm standalone does not have it :-( | 10:47 |
| quiquell | That could be a bug | 10:47 |
| *** dtantsur|afk is now known as dtantsur | 10:47 | |
| marios | https://tree.taiga.io/project/tripleo-ci-board/task/270 ready for reviews please if you have time at https://review.openstack.org/#/c/613572/ and https://review.openstack.org/615191 | 10:48 |
| marios | panda: ^ you are co-author of that second one btw please vote :) | 10:48 |
| marios | rfolco|ruck: will we move the call today? is the program call at same time? | 10:48 |
| rfolco|ruck | marios, good question. I moved tomorrow's call per wes' request | 10:50 |
| rfolco|ruck | we can decide and change today's call time if needed | 10:50 |
| marios | rfolco|ruck: right i spent 3 mins staring at calendar before realising it was the 8th i was looking at (i.e. the time move made sense for today... but it is for tmorrow) | 10:51 |
| marios | rfolco|ruck: doesn't makes sense to have retro if half team is missing | 10:51 |
| panda | half team ? | 10:51 |
| marios | panda: well usually ruck/rover and wes go to that call? | 10:52 |
| panda | anyway, these are the two weeks with the daylight savings mixup | 10:52 |
| panda | marios: only ruck, or only wes. | 10:52 |
| marios | panda: well in thory things go back to normal now the us has also moved time | 10:52 |
| panda | it makes sens to postpone | 10:52 |
| panda | now when ? | 10:52 |
| marios | panda: well not postpone but maybe start at half passed like tomorrow | 10:52 |
| marios | panda: + half hour | 10:52 |
| marios | panda: the program call status for ci is usuall done at the half hour ;) | 10:53 |
| marios | (ish) | 10:53 |
| panda | marios: postpone the start | 10:53 |
| marios | panda: yes | 10:53 |
| panda | marios: marios marios marios marios marios marios | 10:53 |
| marios | panda: yes yes yes yes yes yes ? | 10:53 |
| quiquell | panda: I don't see dstatnd at standalone jobs, I found it at the others | 10:55 |
| rfolco|ruck | panda, so move 30 min later | 10:55 |
| rfolco|ruck | panda, panda panda panda panda | 10:55 |
| rfolco|ruck | (following the trend) | 10:56 |
| marios | rfolco|ruck: panda i feel this mode of communication doesn't scale very well ^ | 10:56 |
| rfolco|ruck | lolz | 10:56 |
| panda | rfolco|ruck: doens't the program call starts with general sumamry, then eam status is in the second half ? | 10:56 |
| rfolco|ruck | panda, If it did not change, we report at the first 30 min... but not sure | 10:56 |
| rfolco|ruck | ok, will wait for weshay to confirm | 10:57 |
| rfolco|ruck | marios, marios marios marios marios agreed :) | 10:57 |
| marios | rfolco|ruck rfolco|ruck rfolco|ruck rfolco|ruck rfolco|ruck rfolco|ruck ack | 10:58 |
| panda | sshnaidm|rover: does the atop command there work ? is is set setuid root ? | 11:04 |
| sshnaidm|rover | panda, http://logs.openstack.org/57/615357/6/check/tripleo-ci-centos-7-scenario004-multinode-oooq-container/74c391b/logs/undercloud/home/zuul/atop.bin.gz | 11:06 |
| sshnaidm|rover | panda, actually the standalone file: http://logs.openstack.org/57/615357/6/check/tripleo-ci-centos-7-standalone/5ab33b1/logs/undercloud/home/zuul/atop.bin.gz | 11:13 |
| ssbarnea | i need some clarifications about devmode.sh - like its purpose, docs says is deprecated but indicates using reproducer which is not an option if you do not already have a job... | 11:28 |
| panda | ssbarnea: welcome to the CI team. | 11:29 |
| ssbarnea | :D | 11:29 |
| ssbarnea | the only certain thing on CI: confusion. | 11:29 |
| *** ssbarnea has quit IRC | 11:34 | |
| rfolco|ruck | sshnaidm|rover, you know the story behind https://bugs.launchpad.net/tripleo/+bug/1800737 ? | 11:41 |
| openstack | Launchpad bug 1800737 in tripleo "relabel failed /var/lib/config-data: no such file or directory" [Critical,Fix released] - Assigned to Emilien Macchi (emilienm) | 11:41 |
| rfolco|ruck | sshnaidm|rover, the podman disable was reverted and the big is still happening afaik | 11:43 |
| rfolco|ruck | big=bug | 11:43 |
| sshnaidm|rover | rfolco|ruck, nope, didn't see it before | 11:46 |
| rfolco|ruck | sshnaidm|rover, you are in the libpod bug at least ... https://github.com/containers/libpod/issues/1730 | 11:46 |
| sshnaidm|rover | rfolco|ruck, oh, right | 11:47 |
| sshnaidm|rover | rfolco|ruck, need to ask Emilien, he disabled podman, but not sure what is now | 11:47 |
| *** ssbarnea has joined #oooq | 11:53 | |
| *** jfrancoa has quit IRC | 11:58 | |
| *** jfrancoa has joined #oooq | 11:59 | |
| rfolco|ruck | weshay, panda so move today's retro 30 min later ? | 12:09 |
| panda | rfolco|ruck: weshay otherwise someone will have to skip the first 30 minutes to attend the program call. I mean , I'm ok with it and I don't want rfolco|ruck feedback anyway. | 12:10 |
| panda | rfolco|ruck: rfolco|ruck rfolco|ruck rfolco|ruck rfolco|ruck | 12:11 |
| rfolco|ruck | panda, hater! | 12:11 |
| rfolco|ruck | <3 | 12:11 |
| panda | it's acceptable if it is lesser than 3 | 12:17 |
| quiquell | weshay: Do we have 1-1 today or Friday ? | 12:20 |
| *** jfrancoa has quit IRC | 12:30 | |
| marios | all the jobs are failing for https://bugs.launchpad.net/tripleo/+bug/1800737 ? | 12:30 |
| openstack | Launchpad bug 1800737 in tripleo "relabel failed /var/lib/config-data: no such file or directory" [Critical,Fix released] - Assigned to Emilien Macchi (emilienm) | 12:30 |
| *** radez has joined #oooq | 12:31 | |
| rfolco|ruck | marios, I opened a new one just in case https://bugs.launchpad.net/tripleo/+bug/1802096 | 12:36 |
| openstack | Launchpad bug 1802096 in tripleo "(containers) panic: runtime error: invalid memory address or nil pointer dereference" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 12:36 |
| rfolco|ruck | as the relabel error is gone, and the previous bug was fix_release | 12:36 |
| sshnaidm|rover | panda, "-a" will count all processes including non-active, do we need this? | 12:41 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario003-multinode-oooq-container @ https://review.openstack.org/604298, master: tripleo- (3 more messages) | 12:44 |
| quiquell | panda, rfolco|ruck: Do we have the retro 30 m later ? | 12:47 |
| *** jfrancoa has joined #oooq | 12:47 | |
| rfolco|ruck | quiquell, remain same time afaik | 12:47 |
| *** sshnaidm|rover is now known as sshnaidm|afk | 12:50 | |
| weshay | panda, rfolco|ruck I can attend the program call | 12:51 |
| rfolco|ruck | weshay, thanks, I just updated the doc, feel free to edit | 12:52 |
| *** rlandy has joined #oooq | 12:54 | |
| kopecmartin | weshay, panda I'm sorry, I'll be one hour late for the retro, I'll join in 1 hour from now | 12:55 |
| weshay | quiquell, sshnaidm|afk well done re: https://bugs.launchpad.net/tripleo/+bug/1802083 | 12:59 |
| openstack | Launchpad bug 1802083 in tripleo "Undercloud install fails at Unknown function: 'normalize_ip_for_uri'" [Critical,Triaged] - Assigned to Sagi (Sergey) Shnaidman (sshnaidm) | 12:59 |
| weshay | quiquell++ | 12:59 |
| hubbot1 | weshay: quiquell's karma is now 10 | 12:59 |
| weshay | sshnaidm++ | 12:59 |
| marios | panda: rfolco|ruck so retro? | 13:01 |
| rfolco|ruck | yes | 13:01 |
| quiquell | low haging fruit the coverage thing | 13:02 |
| weshay | https://review.openstack.org/#/c/615730 | 13:04 |
| rfolco|ruck | ssbarnea, ping call | 13:04 |
| *** amoralej is now known as amoralej|lunch | 13:06 | |
| marios | bluejeans killed self rejoining | 13:10 |
| *** trown|outtypewww is now known as trown | 13:21 | |
| *** vinaykns has joined #oooq | 13:32 | |
| rfolco|ruck | https://tree.taiga.io/project/tripleo-ci-board/issue/219?kanban-status=2027736 | 13:41 |
| marios | weshay: https://tree.taiga.io/project/tripleo-ci-board/issue/219?kanban-status=2027736 | 13:41 |
| *** agopi has quit IRC | 13:47 | |
| *** jfrancoa has quit IRC | 14:00 | |
| *** jfrancoa has joined #oooq | 14:00 | |
| marios | quiquell: http://logs.openstack.org/87/616187/1/check/openstack-tox-docs/164c631/html/contributor/stages-overview.html | 14:05 |
| marios | quiquell: (simple diagram about tags) | 14:05 |
| marios | https://review.openstack.org/#/c/616187/ | 14:05 |
| quiquell | marios: Let me change brains and will look at it | 14:07 |
| marios | quiquell: ack not important just cos i mentioned this morning | 14:07 |
| weshay | ssbarnea, quiquell http://logs.openstack.org/40/591540/73/check/tripleo-ci-fedora-28-standalone/e5d78d3/job-output.txt.gz | 14:09 |
| weshay | but it looks like the deployment passed | 14:09 |
| quiquell | weshay: hummm fix at tht is missing | 14:10 |
| weshay | http://logs.openstack.org/40/591540/73/check/tripleo-ci-fedora-28-standalone/e5d78d3/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz | 14:10 |
| weshay | quiquell, looks like it passed | 14:10 |
| quiquell | weshay: Not sure we have some "No module named requests" | 14:11 |
| weshay | oh right | 14:11 |
| weshay | hrm | 14:11 |
| quiquell | weshay: the failure in the last line is fix using the review of the release file | 14:11 |
| weshay | 2018-11-06 11:37:50 | Deployment successful! | 14:11 |
| quiquell | But we are on track | 14:11 |
| weshay | quiquell++ | 14:11 |
| hubbot1 | weshay: quiquell's karma is now 11 | 14:11 |
| quiquell | weshay: Now running with tht fix too https://zuul.openstack.org/stream/843ad4242edf41fe8cbebd7d225cce34?logfile=console.log | 14:12 |
| weshay | quiquell, k.. to fix the return code? | 14:13 |
| quiquell | weshay: this was fixed with the old python-tripleoclient fix, to fix the No module named paunch | 14:13 |
| *** agopi has joined #oooq | 14:17 | |
| *** amoralej|lunch is now known as amoralej | 14:25 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario003-multinode-oooq-container @ https://review.openstack.org/604298, master: tripleo- (3 more messages) | 14:44 |
| agopi | rlandy: ping | 15:19 |
| *** gkadam has joined #oooq | 15:20 | |
| rlandy | agopi: what's up? | 15:27 |
| agopi | hey rlandy, i've noticed that queens jobs in perfci and browbeatci now have 2 parameters in overcloud deploy stage | 15:35 |
| agopi | docker.yaml and containers-default-parameters.yaml | 15:36 |
| agopi | the issue arises as containers-default-parameters.yaml doesn't exist but it's actually the containers-prepare-parameter.yaml | 15:37 |
| *** dtantsur is now known as dtantsur|afk | 15:42 | |
| rlandy | agopi: we're in meeting - I'll ping you in a bit to discuss. pls post links so I can review | 15:44 |
| agopi | sure thing thanks rlandy :) | 15:46 |
| agopi | https://thirdparty.logs.rdoproject.org/jenkins-browbeat-quickstart-gerrit-queens-baremetal-CI-511/undercloud/home/stack/overcloud-deploy.sh | 15:46 |
| agopi | https://thirdparty.logs.rdoproject.org/jenkins-browbeat-quickstart-gerrit-queens-baremetal-CI-513/undercloud/home/stack/overcloud-deploy.sh | 15:46 |
| agopi | openstack overcloud deploy part, the extra parameters can be seen | 15:46 |
| agopi | I was just curious what parameter I need to add to point it to containers-prepare-parameter.yaml if it's something that needs to be done in our env | 15:47 |
| *** kopecmartin is now known as kopecmartin|off | 15:51 | |
| rlandy | marios: can we touch base before you check out for the day? | 15:56 |
| marios | rlandy: sure can we take a little break first :) | 15:57 |
| marios | rlandy: shall we say in 15? | 15:57 |
| rlandy | sure | 15:57 |
| marios | rlandy: thanks | 15:58 |
| weshay | arxcruz, /me looking for emails re:openstack-ansible-tempest in openstack-dev | 16:05 |
| weshay | don't see any.. I know there are a few http://lists.openstack.org/pipermail/openstack-dev/ | 16:05 |
| weshay | got link? | 16:05 |
| *** agopi is now known as agopi|lunch | 16:14 | |
| rlandy | agopi|lunch: ugh ... just missed you | 16:14 |
| rlandy | I am not sure how these files don;t exist ... | 16:15 |
| rlandy | let's compare ... | 16:15 |
| rlandy | https://thirdparty.logs.rdoproject.org/jenkins-browbeat-quickstart-gerrit-queens-baremetal-CI-513/undercloud/home/stack/containers-prepare-parameter.yaml.txt.gz | 16:18 |
| *** quiquell is now known as quiquell|off | 16:19 | |
| rlandy | agopi|lunch: -e /usr/share/openstack-tripleo-heat-templates/environments/docker.yaml -e /home/stack/containers-default-parameters.yaml is correct | 16:19 |
| rlandy | and should be fine | 16:19 |
| rlandy | https://thirdparty.logs.rdoproject.org/jenkins-browbeat-quickstart-gerrit-queens-baremetal-CI-511/undercloud/home/stack/overcloud-deploy.sh is missing those parameters | 16:19 |
| rlandy | not sure if that explanation helped ... pls explain more if you're still unsure | 16:20 |
| *** dtrainor has quit IRC | 16:26 | |
| *** jfrancoa has quit IRC | 16:32 | |
| arxcruz | weshay: os_tempest is part of openstack-ansible, i don’t think there is a openstack-ansible-tempest everything is threat as openstack-ansible | 16:35 |
| arxcruz | but i might be wrong | 16:35 |
| arxcruz | I’ll check with OSA guys | 16:35 |
| weshay | arxcruz, hrm.. maybe I said that wrong | 16:41 |
| weshay | arxcruz, I'm suggesting you.. send emails to [openstack-dev][tripleo][openstack-ansible] | 16:42 |
| arxcruz | weshay: ok, got it, I’ll prepare email and send to you first then send to the list | 16:42 |
| arxcruz | sounds good ? | 16:42 |
| weshay | or openstack-dev and introduce the $topic [openstack-ansible-tempest] which may work.. or $something where a thread can be followed reasonably well | 16:43 |
| weshay | arxcruz++ | 16:43 |
| hubbot1 | weshay: arxcruz's karma is now 8 | 16:43 |
| weshay | thanks man | 16:43 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario003-multinode-oooq-container @ https://review.openstack.org/604298, master: tripleo- (3 more messages) | 16:44 |
| *** irclogbot_0 has joined #oooq | 17:03 | |
| *** gkadam has quit IRC | 17:04 | |
| *** trown is now known as trown|lunch | 17:15 | |
| *** bogdando has quit IRC | 17:16 | |
| weshay | arxcruz, kopecmartin|off can you guys triage the bugs in "untriaged" here https://docs.google.com/document/d/1fsd1bJ7r5CS9zaizu9I_92Uxo6z6Vtq8CWdJRsDC_Z4/edit# | 17:38 |
| weshay | please | 17:38 |
| *** derekh has quit IRC | 17:44 | |
| *** dtrainor has joined #oooq | 17:48 | |
| weshay | quiquell|off, ssbarnea re: fed 28 | 17:59 |
| weshay | <mwhahaha> it worked | 17:59 |
| weshay | <mwhahaha> actually | 17:59 |
| weshay | <mwhahaha> that import requests thing is ignored | 17:59 |
| weshay | <mwhahaha> it's an outstanding bug :D | 17:59 |
| weshay | <weshay> good | 17:59 |
| weshay | <weshay> k | 17:59 |
| weshay | http://logs.openstack.org/40/591540/73/check/tripleo-ci-fedora-28-standalone/e5d78d3/logs/undercloud/home/zuul/standalone_deploy.log.txt.gz#_2018-11-06_11_37_50 | 17:59 |
| ssbarnea | can someone point me to the the requests bug? i just want to watch it. | 18:04 |
| *** panda is now known as panda|off | 18:10 | |
| rlandy | panda|off: ssbarnea: sshnaidm|afk: weshay: https://review.openstack.org/#/c/615635/ requesting another review - thanks | 18:11 |
| *** agopi|lunch is now known as agopi | 18:15 | |
| agopi | rlandy, those parameters weren't passed to queens jobs until a couple of days. the issue being it's pointing to containers-default-parameters when it should be pointing to containers-prepare-parameter | 18:17 |
| agopi | I'm looking for a parameter I could pass to the bootstrap script that'll point it to the correct file. | 18:18 |
| rlandy | agopi: looking at an upstream queens job ... | 18:19 |
| *** trown|lunch is now known as trown | 18:20 | |
| rlandy | containers-default-parameters.yaml.txt.gz2018-11-05 15:01813 | 18:20 |
| rlandy | containers-prepare-parameter.yaml.txt.gz2018-11-05 15:01423 | 18:20 |
| rlandy | has both | 18:20 |
| rlandy | and .. | 18:21 |
| rlandy | openstack overcloud deploy \ | 18:21 |
| rlandy | -e /home/zuul/containers-default-parameters.yaml | 18:22 |
| rlandy | agopi,: where is your overcloud deploy command defined? | 18:22 |
| rlandy | are you overriding it in your config files? | 18:22 |
| agopi | rlandy, this is the playbook that's being run https://github.com/openstack/browbeat/blob/master/ansible/oooq/baremetal-virt-undercloud-int-browbeat.yml | 18:26 |
| agopi | the bootstrap script is https://github.com/openstack/browbeat/blob/master/ci-scripts/tripleo/microbrow-browbeat-ci.sh | 18:26 |
| agopi | I don't think anything is overriding it, I can't see it | 18:26 |
| rlandy | {% if release in ['ocata', 'pike', 'queens', 'rocky'] %} | 18:27 |
| rlandy | -e {{ working_dir }}/containers-default-parameters.yaml | 18:27 |
| rlandy | {% else %} | 18:27 |
| rlandy | -e {{ working_dir }}/containers-prepare-parameter.yaml | 18:27 |
| rlandy | {% endif %} | 18:27 |
| rlandy | hasn't changed in a while | 18:27 |
| agopi | yep I checked and this commit couldn't possibly be the reason too :/ https://github.com/openstack/tripleo-quickstart-extras/commit/93e5bc51cba16d4cdf522bfb17c372948fade9ec | 18:28 |
| rlandy | for queens ... | 18:28 |
| rlandy | -e {{ working_dir }}/containers-default-parameters.yaml | 18:28 |
| rlandy | is correct | 18:28 |
| rlandy | containers-default-parameters.yaml doesn't exist | 18:29 |
| rlandy | ^^ agopi - are you sure? | 18:29 |
| agopi | yes rlandy | 18:29 |
| agopi | https://thirdparty.logs.rdoproject.org/jenkins-browbeat-quickstart-gerrit-queens-baremetal-CI-513/undercloud/home/stack/ | 18:29 |
| agopi | is the directory structure for UC | 18:30 |
| agopi | ContainerImagePrepare is present in the containers-prepare-parameter | 18:30 |
| agopi | https://thirdparty.logs.rdoproject.org/jenkins-browbeat-quickstart-gerrit-queens-baremetal-CI-513/undercloud/home/stack/containers-prepare-parameter.yaml.txt.gz | 18:30 |
| agopi | if we could point it to use this file | 18:30 |
| agopi | I am sure it'll work | 18:30 |
| rlandy | sorry - was chatting on other channel | 18:34 |
| rlandy | agopi; we need to see what the diff is with your jobs | 18:34 |
| agopi | np rlandy | 18:35 |
| rlandy | there should not be a change needed | 18:35 |
| agopi | also for upstream queens jobs, do we need to pass an extra parameter called containerized_overcloud: true or anything such? | 18:35 |
| rlandy | agopi: what release file and what fs are you using? | 18:36 |
| rlandy | example ... | 18:37 |
| rlandy | https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/tripleo-quickstart-queens-rdo_trunk-baremetal-hp_dl360_envD-single_nic_vlans/ | 18:37 |
| rlandy | agopi: ^^ let's compare with this job ... | 18:37 |
| rlandy | to examine the diff | 18:37 |
| rlandy | last ran three days ago | 18:37 |
| agopi | okay rlandy , i am not sure if any fs is being used | 18:38 |
| rlandy | https://thirdparty.logs.rdoproject.org/jenkins-tripleo-quickstart-queens-rdo_trunk-baremetal-hp_dl360_envD-single_nic_vlans-151/undercloud/home/stack/ | 18:38 |
| rlandy | agopi: so ... | 18:38 |
| rlandy | here we see https://thirdparty.logs.rdoproject.org/jenkins-tripleo-quickstart-queens-rdo_trunk-baremetal-hp_dl360_envD-single_nic_vlans-151/undercloud/home/stack/ | 18:39 |
| rlandy | both files available | 18:39 |
| rlandy | and | 18:39 |
| rlandy | overcloud deploy.sh using -e /home/stack/containers-default-parameters.yaml | 18:39 |
| agopi | okay our automation seems way off | 18:40 |
| *** jtomasek has quit IRC | 18:40 | |
| rlandy | agopi; so first question is why you don;t have /home/stack/containers-default-parameters.yaml | 18:40 |
| rlandy | let's see where that gets created | 18:40 |
| agopi | https://github.com/openstack/tripleo-quickstart/blob/master/config/release/trunk/queens.yml | 18:41 |
| agopi | is being used i guess | 18:41 |
| agopi | just a second i'll unhook the executor | 18:41 |
| agopi | so we can jump on it | 18:41 |
| rlandy | containerized_undercloud|bool or containerized_overcloud|bool | 18:42 |
| rlandy | containerized_overcloud must be set to true | 18:44 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario003-multinode-oooq-container @ https://review.openstack.org/604298, master: tripleo- (3 more messages) | 18:44 |
| agopi | yep rlandy we're using the release file I linked above | 18:44 |
| rlandy | agopi: ^^ you are correct, you need that parameter set | 18:44 |
| rlandy | agopi; the setting is in the fs file we use ... | 18:45 |
| rlandy | https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset001.yml#L18 | 18:45 |
| rlandy | so you have that set to true? | 18:45 |
| agopi | okay and how can I use the feature set file? | 18:45 |
| agopi | noipe | 18:45 |
| agopi | I don't think we use a fs file in this automation | 18:45 |
| rlandy | agopi: pls see the config of the queens job I pointed to above | 18:45 |
| rlandy | you can see how we use that fs file | 18:46 |
| rlandy | https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/tripleo-quickstart-queens-rdo_trunk-baremetal-hp_dl360_envD-single_nic_vlans/ | 18:46 |
| agopi | okay gotcha | 18:47 |
| agopi | https://github.com/openstack/browbeat/blob/master/ci-scripts/tripleo/microbrow-browbeat-ci.sh is the bootstrap script we use :/ | 18:48 |
| agopi | so i guess | 18:48 |
| agopi | we can either take it out | 18:48 |
| agopi | or make changes to use the fs files | 18:48 |
| rlandy | agopi: you can start by applying containerized_overcloud parameter | 18:50 |
| rlandy | and see if that works | 18:50 |
| agopi | ack thanks rlandy | 18:51 |
| agopi | i'll try and let you know :) | 18:51 |
| agopi | rlandy++ | 18:51 |
| hubbot1 | agopi: rlandy's karma is now 35 | 18:51 |
| *** amoralej is now known as amoralej|off | 19:00 | |
| ssbarnea | weshay: rlandy : if you can have a look at https://review.openstack.org/#/c/591540 it would be great, i made few small tunnings | 19:07 |
| *** dsneddon has joined #oooq | 19:09 | |
| rlandy | ssbarnea: patch looks ok but ci.centos jobs use bash $WORKSPACE/tripleo-quickstart/ci-scripts/basic.sh \ which is not changed | 19:15 |
| rlandy | ssbarnea: weshay: iow - I can +2 it as I dont see anything wrong - but not platform where we actually kick this | 19:17 |
| rlandy | what is the expectation? | 19:17 |
| rlandy | I see weshay's output from a previous version | 19:18 |
| rlandy | anyway +1'ed | 19:21 |
| rlandy | will +2 if answered above | 19:21 |
| weshay | gate is almost clear | 19:27 |
| weshay | hold off on workflow | 19:27 |
| rlandy | ok | 19:36 |
| rlandy | ugh - just worked my other patch | 19:36 |
| rlandy | workflowed | 19:36 |
| rlandy | weshay: I set up https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/tripleo-quickstart-rocky-baremetal-hp_dl360_envD-single_nic_vlans/ to start comparing rhos-14 and queens runs ... few points ... | 20:01 |
| rlandy | 1. these jobs don;t report to dlrn api | 20:02 |
| rlandy | they can - if it helps | 20:02 |
| rlandy | 2. the hash on the rhos-14 side would be a build date | 20:02 |
| rlandy | 3. lastly - question - you want the installed rpms compared? | 20:04 |
| rlandy | https://thirdparty.logs.rdoproject.org/jenkins-tripleo-quickstart-rhos-14-baremetal-hp_dl360_envE-single_nic_vlans-49/undercloud/var/log/extra/yum-list-installed.txt.gz? | 20:05 |
| rlandy | https://thirdparty.logs.rdoproject.org/jenkins-tripleo-quickstart-rhos-14-baremetal-hp_dl360_envE-single_nic_vlans-49/undercloud/var/log/extra/rpm-list.txt.gz | 20:06 |
| rlandy | or the packages? | 20:06 |
| *** rfolco|ruck is now known as rfolco|off | 20:40 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario007-multinode-oooq- (3 more messages) | 20:44 |
| *** kopecmartin|off has quit IRC | 20:47 | |
| *** kopecmartin has joined #oooq | 20:49 | |
| rlandy | marios: panda|off: pls review Design notes added to https://tree.taiga.io/project/tripleo-ci-board/us/283 | 21:01 |
| rlandy | reproducer tasks for this sprint | 21:02 |
| rlandy | rfolco|off: where do we add the ideas for improvement info for tomorrow's meeting? | 21:03 |
| rlandy | no section on the etherpad afaict | 21:03 |
| *** dsneddon has quit IRC | 21:15 | |
| *** dsneddon has joined #oooq | 21:35 | |
| rlandy | weshay: around? | 21:45 |
| *** trown is now known as trown|outtypewww | 22:06 | |
| agopi | yep rlandy it helped | 22:10 |
| rlandy | good | 22:10 |
| agopi | thanks :) | 22:10 |
| rfolco|off | rlandy, let me create the agenda | 22:25 |
| rlandy | rfolco|off: np - can add it tomorrow | 22:25 |
| rfolco|off | k | 22:25 |
| rfolco|off | rlandy, weshay created it :( | 22:26 |
| rfolco|off | L66 | 22:27 |
| rlandy | k - thanks | 22:27 |
| *** rfolco|off has quit IRC | 22:34 | |
| *** ssbarnea has quit IRC | 22:37 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-containerized-undercloud-upgrades, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario007-multinode-oooq- (3 more messages) | 22:44 |
| *** saneax has joined #oooq | 22:57 | |
| *** rlandy is now known as rlandy|bbl | 23:29 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!