| *** hamzy_ has joined #oooq | 00:14 | |
| *** rfolco has quit IRC | 00:21 | |
| *** rfolco has joined #oooq | 00:22 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata, legacy-tripleo-ci-centos-7 (3 more messages) | 00:37 |
|---|---|---|
| *** agopi has quit IRC | 00:42 | |
| *** rlandy has joined #oooq | 00:52 | |
| *** rlandy has quit IRC | 01:24 | |
| *** agopi has joined #oooq | 01:29 | |
| *** links has joined #oooq | 01:30 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, legacy-tripleo-ci-centos-7 (3 more messages) | 02:37 |
| *** brault has quit IRC | 02:53 | |
| *** brault has joined #oooq | 02:57 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata, legacy-tripleo-ci- (2 more messages) | 04:37 |
| *** udesale has joined #oooq | 04:39 | |
| *** udesale has quit IRC | 04:42 | |
| *** udesale has joined #oooq | 04:43 | |
| *** jaganathan has quit IRC | 04:44 | |
| *** jaganathan has joined #oooq | 04:45 | |
| *** ykarel has joined #oooq | 04:46 | |
| *** udesale_ has joined #oooq | 05:13 | |
| *** agopi has quit IRC | 05:14 | |
| *** udesale has quit IRC | 05:15 | |
| *** skramaja has joined #oooq | 05:17 | |
| *** agopi has joined #oooq | 05:18 | |
| *** udesale_ has quit IRC | 05:19 | |
| *** udesale has joined #oooq | 05:20 | |
| *** ratailor has joined #oooq | 05:22 | |
| *** quiquell has joined #oooq | 05:36 | |
| *** jfrancoa has joined #oooq | 05:53 | |
| *** gvrangan has joined #oooq | 05:55 | |
| *** saneax has joined #oooq | 06:05 | |
| *** ccamacho has joined #oooq | 06:09 | |
| chkumar|rover | quiquell: Good morning | 06:09 |
| chkumar|rover | quiquell: can we write something like this http://git.openstack.org/cgit/openstack-infra/devstack-gate/tree/devstack-vm-gate.sh#n75 for ssh in tripleo ci using ansible by looking the private key file? | 06:10 |
| quiquell | chkumar|rover: What are we doing now, this ? | 06:13 |
| *** gvrangan has quit IRC | 06:15 | |
| chkumar|rover | quiquell: i was talking about this part | 06:19 |
| chkumar|rover | http://git.openstack.org/cgit/openstack-infra/tripleo-ci/tree/scripts/common_functions.sh#n267 | 06:19 |
| chkumar|rover | we can use ansible here to check for file permission and existence for that file before proceeding | 06:19 |
| *** gvrangan has joined #oooq | 06:27 | |
| *** pgadiya has joined #oooq | 06:30 | |
| *** pgadiya has quit IRC | 06:31 | |
| quiquell | chkumar|rover: Have to leave now | 06:37 |
| quiquell | lets chat in a few | 06:37 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-queens, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035-queens @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata, legacy-tripleo-ci- (2 more messages) | 06:37 |
| *** quiquell is now known as quiquell|bbl | 06:37 | |
| *** yolanda_ has quit IRC | 07:00 | |
| *** quiquell|bbl is now known as quiquell | 07:01 | |
| *** amoralej|off is now known as amoralej | 07:01 | |
| quiquell | chkumar|rover: We havce to fail if id_rsa is not present | 07:02 |
| quiquell | I think | 07:03 |
| *** kopecmartin has joined #oooq | 07:06 | |
| *** bogdando has joined #oooq | 07:06 | |
| *** gkadam has joined #oooq | 07:16 | |
| *** tesseract has joined #oooq | 07:16 | |
| *** yolanda has joined #oooq | 07:22 | |
| *** florianf has joined #oooq | 07:22 | |
| *** dtantsur|afk is now known as dtantsur | 07:28 | |
| *** jtomasek has joined #oooq | 07:31 | |
| *** ykarel is now known as ykarel|lunch | 07:34 | |
| quiquell | chkumar|rover: Any bug related to this ? http://logs.openstack.org/63/584763/1/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/c28b17f/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2018-07-25_07_08_44 | 07:40 |
| *** chem has joined #oooq | 07:42 | |
| chkumar|rover | quiquell: checking | 07:43 |
| chkumar|rover | quiquell: can we configure ddns on ruck rover site and create a static url for the same | 07:44 |
| *** holser_ has joined #oooq | 07:46 | |
| quiquell | chkumar|rover: rrcockpit is at temporal location, let's see if we can deply today at a permament one | 07:47 |
| chkumar|rover | quiquell: http://logs.openstack.org/63/584763/1/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/c28b17f/logs/undercloud/var/log/containers/mistral/engine.log.txt.gz#_2018-07-25_07_03_18_297 | 07:50 |
| quiquell | sshnaidm|ruck: Can we deploy rrockpit at tripleo-infra an point a ddns to it ? | 07:50 |
| quiquell | chkumar|rover: It's not related to the change | 07:53 |
| chkumar|rover | quiquell: I am still digging why it is behaving like that | 07:54 |
| quiquell | chkumar|rover: It's failing in the gates | 07:58 |
| quiquell | http://logs.openstack.org/20/583320/3/gate/tripleo-ci-centos-7-scenario007-multinode-oooq-container/a52bb75/job-output.txt.gz | 07:58 |
| quiquell | nah different error | 07:59 |
| quiquell | arg | 07:59 |
| chkumar|rover | quiquell: https://review.openstack.org/#/c/558972/ | 07:59 |
| chkumar|rover | last patch related to container image prepare | 08:00 |
| quiquell | But here is passing | 08:00 |
| *** tosky has joined #oooq | 08:02 | |
| quiquell | chkumar|rover: Have just rechecked it doesn't make any sense | 08:02 |
| *** jfrancoa has quit IRC | 08:06 | |
| *** jfrancoa has joined #oooq | 08:07 | |
| chkumar|rover | quiquell: I am opening a bug | 08:09 |
| quiquell | chkumar|rover: Did it appear at the gates ? | 08:11 |
| chkumar|rover | quiquell: in other failed jobs, it is not appearing | 08:12 |
| quiquell | chkumar|rover: Let's wait for the recheck | 08:12 |
| chkumar|rover | as the other jobs are using tripleo-common package from older commit | 08:12 |
| quiquell | Change looks not related, but gates are not failing on this | 08:12 |
| quiquell | chkumar|rover: what do you mean ? gate jobs will take the same version | 08:13 |
| jfrancoa | hey rfolco, do you have a second? I have a doubt about https://github.com/openstack-infra/tripleo-ci/commit/ddc474be96fd9fb9d0b5a8cef884ea008f8b2a6e | 08:15 |
| *** florianf has quit IRC | 08:16 | |
| jfrancoa | chkumar|rover: opened yesterday a LP related to an error when running upgrades jobs: https://bugs.launchpad.net/tripleo/+bug/1783303 and I realized that we're missing the overcloud-upgrade tag | 08:16 |
| openstack | Launchpad bug 1783303 in tripleo "[master] scenario000 multinode upgrade job is failing at tripleo-upgrade include task giving controllers' is undefined"}" [Critical,In progress] - Assigned to Jose Luis Franco (jfrancoa) | 08:16 |
| *** florianf has joined #oooq | 08:16 | |
| chkumar|rover | quiquell: https://review.openstack.org/#/c/558972/ -> python2-tripleo-common-9.1.1-0.20180724171457.526e634.el7.noarch {526e634} and your job http://logs.openstack.org/63/584763/1/check/tripleo-ci-centos-7-scenario001-multinode-oooq-container/c28b17f/logs/undercloud/var/log/extra/rpm-list.txt.gz -> python2-tripleo-common-9.1.1-0.20180725034902.2dfed4e.el7.noarch contains the latest commit for the first review | 08:17 |
| chkumar|rover | jfrancoa: thanks, EmilienM has filed one more bug related to upgrade https://bugs.launchpad.net/tripleo/+bug/1783399 | 08:18 |
| openstack | Launchpad bug 1783399 in tripleo "containerized undercloud upgrade jobs isn't testing upgrades anymore" [Critical,Triaged] - Assigned to Emilien Macchi (emilienm) | 08:18 |
| chkumar|rover | quiquell: passed one used older version and your review used newer version | 08:19 |
| chkumar|rover | of tripleo-common | 08:19 |
| jfrancoa | chkumar|rover: right, it's a similar case for the tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades what it's happening | 08:19 |
| chkumar|rover | jfrancoa: feel free to update the bug | 08:19 |
| jfrancoa | chkumar|rover: sure, thanks for the info | 08:19 |
| chkumar|rover | quiquell: after recheck, if it again comes, i am going to open a bz | 08:20 |
| chkumar|rover | quiquell: sshnaidm|ruck fyi rdo third party jobs are failing due to this https://tree.taiga.io/project/morucci-software-factory/issue/1569 | 08:20 |
| chkumar|rover | because one router might be active on more than one controller | 08:21 |
| *** ykarel|lunch is now known as ykarel | 08:21 | |
| chkumar|rover | he restarted the router, if appears again, we need to bug #rhos-ops | 08:21 |
| *** lucas-afk is now known as lucasagomes | 08:22 | |
| *** gvrangan has quit IRC | 08:31 | |
| *** gvrangan_odl has joined #oooq | 08:31 | |
| *** ykarel is now known as ykarel|mtg | 08:34 | |
| *** florianf has quit IRC | 08:35 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master, legacy-tripleo-ci-centos-7 (2 more messages) | 08:37 |
| *** panda|off is now known as panda | 08:57 | |
| quiquell | panda: Good morning, we are miss workflowing this https://review.openstack.org/#/c/582387/ | 08:58 |
| *** zoli is now known as zoli|lunch | 08:59 | |
| quiquell | But has unrelated failures at jobs | 08:59 |
| marios | quiquell: i think the upgrades/updates jobs might be related to EmilienM fix | 08:59 |
| marios | quiquell: *=* 10:17:58 *=*=*= "Fix TAG logic for all upgrade type jobs" https://review.openstack.org/#/c/585528/2 I8330687ec64f1ebb7e3b100410d5bdc3e67ae7f0 tripleo-ci | 08:59 |
| quiquell | marios: I have also found some issues at scenario jobs at the test review | 09:00 |
| marios | quiquell: might be related to the issue you asked me to check yesterday | 09:00 |
| marios | quiquell: was upgrades job right | 09:00 |
| quiquell | marios: jfrancoa did a fix for it | 09:00 |
| marios | quiquell: seems this particular issue was inadvertently introduced in this sprint i mean with the move but hopefully fixes it | 09:00 |
| quiquell | marios: But also scenarios are broken https://review.openstack.org/#/c/584763/, cannot be related | 09:00 |
| quiquell | What a bad luck | 09:01 |
| *** Guest56850 is now known as honza | 09:01 | |
| quiquell | marios: de controllers undefined ? | 09:01 |
| marios | quiquell: oh do you have a pointer to jfrancoa fix? i mean might be different one. the fix from EmilienM in https://review.openstack.org/#/c/585528/2 fixes the tags | 09:01 |
| marios | quiquell: ack so at least 2 different issues :) | 09:01 |
| quiquell | marios: https://review.openstack.org/#/c/585654/ | 09:02 |
| jfrancoa | marios: quiquell: well, the real fix is Emilien's one. however, there's a "hidden" issue with the tripleo-upgrade, that if we try to invoke the role without passing the proper tag, then it failes with this "controllers' is undefined | 09:03 |
| marios | jfrancoa: ah so indeed your one is the one quiquell asked me to check yesterday i mean that was the error message | 09:03 |
| marios | jfrancoa: thanks checking | 09:04 |
| quiquell | damnit I was the QE there :-( | 09:04 |
| quiquell | marios: So it was working because toci_type has featureset at the end of it :-) | 09:05 |
| quiquell | haha | 09:05 |
| sshnaidm|ruck | chkumar|rover, ack, saw it yesterday too.. | 09:07 |
| sshnaidm|ruck | quiquell, so, let's deploy it on tripleo-infra? | 09:09 |
| sshnaidm|ruck | quiquell, which dns do you want it to be? | 09:09 |
| quiquell | sshnaidm|ruck: What options do we have ? rrcockpit.tripleo.org ? | 09:09 |
| quiquell | sshnaidm|ruck, panda: We need this fix to finish the sprint https://review.openstack.org/#/c/585528 | 09:15 |
| sshnaidm|ruck | quiquell, tbh I don't like much rrcockpit name.. | 09:15 |
| sshnaidm|ruck | quiquell, how about "dashboard"? | 09:15 |
| quiquell | sshnaidm|ruck: We can change it, dashboard.tripleo.org ? | 09:16 |
| sshnaidm|ruck | quiquell, or even grafana.tripleo.org | 09:16 |
| quiquell | sshnaidm|ruck: Only human that have being ruck rover understand it :-) is not that generic | 09:16 |
| quiquell | grafana.ci.tripleo.org | 09:17 |
| sshnaidm|ruck | quiquell, then dashboard or ci-dashboard maybe | 09:17 |
| quiquell | dashboard.ci.tripleo.org | 09:17 |
| sshnaidm|ruck | 4 level domain? :) | 09:17 |
| quiquell | Feels good | 09:17 |
| sshnaidm|ruck | dashboard-ci.tripleo.org? | 09:18 |
| quiquell | sshnaidm|ruck: ok | 09:18 |
| sshnaidm|ruck | quiquell, ok, let's deploy it then.. | 09:18 |
| quiquell | sshnaidm|ruck: Do we want to also rename the instances and all ? | 09:18 |
| sshnaidm|ruck | quiquell, I don't think it's needed.. | 09:18 |
| quiquell | sshnaidm|ruck: Then let's deploy it | 09:19 |
| sshnaidm|ruck | quiquell, ok, starting then | 09:20 |
| * quiquell so nervous | 09:20 | |
| *** arxcruz|off is now known as arxcruz | 09:22 | |
| jfrancoa | sshnaidm|ruck: quiquell: one doubt, which keyword do you use in tqe/tq to import a file which has ansible tasks, include: or include_tasks: ? I am asking because it seems that this error https://bugs.launchpad.net/tripleo/+bug/1783303 doesn't appear if we change this include by an include_tasks -> https://review.openstack.org/#/c/585654/1/tasks/common/controller_post_scripts.yml@7 | 09:22 |
| openstack | Launchpad bug 1783303 in tripleo "[master] scenario000 multinode upgrade job is failing at tripleo-upgrade include task giving controllers' is undefined"}" [Critical,In progress] - Assigned to Jose Luis Franco (jfrancoa) | 09:22 |
| jfrancoa | plus I read that include is deprecated since Ansible 2.4, so maybe I should just submit a patch replacing all include by include_tasks keyword | 09:23 |
| arxcruz | sshnaidm|ruck: https://review.openstack.org/#/c/573220/ can you +w ? :) | 09:23 |
| sshnaidm|ruck | arxcruz, done | 09:24 |
| quiquell | jfrancoa: I only see one "include_tasks" at tqe and it's for the reproducer | 09:24 |
| arxcruz | sshnaidm|ruck: danke! | 09:24 |
| sshnaidm|ruck | arxcruz, bitte | 09:25 |
| jfrancoa | quiquell: mmm..well, I'll propose a patch for tripleo-upgrade master branch to change it, at least in this single task and in the future I'll adapt the rest | 09:26 |
| panda | jfrancoa: use include_tasks, but only when static: no | 09:26 |
| jfrancoa | panda: ok, thanks for the tip | 09:28 |
| panda | jfrancoa: otherwise use import_tasks | 09:28 |
| ssbarnea | do we also happen to have a team mailing list? | 09:29 |
| panda | ssbarnea: no, use rhose-dev or openstack-dev | 09:29 |
| panda | jfrancoa: I don't understand if https://review.openstack.org/585528 fixes your comment 2 on the bug | 09:29 |
| jfrancoa | panda: well, it does because it will add the overcloud-upgrade tags, and then the error won't appear. The "controllers" not defiened variable appears if we invoke tripleo-upgrade without any role-related tag (overcloud-upgrade, overcloud-update, upgrade_noop, etc...), it will skip all tasks but when it gets to https://review.openstack.org/#/c/585654/1/tasks/common/controller_post_scripts.yml@7 then Ka-bum! | 09:31 |
| panda | jfrancoa: and that's why we didn't catch it ? | 09:34 |
| jfrancoa | panda: exactly, because there's not any case in which we run tripleo-upgrade role without any of those upgrades related tags. I did a simple test in my environment, and run mulinode-overcloud-upgrade.yaml playbook with --tags build and then it appears | 09:35 |
| sshnaidm|ruck | quiquell, 38.145.35.97 | 09:36 |
| *** d0ugal has joined #oooq | 09:36 | |
| *** d0ugal has joined #oooq | 09:36 | |
| sshnaidm|ruck | quiquell, it starts, I see some tracebacks in telegraf log, can you please take a look? | 09:36 |
| sshnaidm|ruck | quiquell, let's check that everything works as usual.. | 09:36 |
| quiquell | sshnaidm|ruck: ack | 09:37 |
| sshnaidm|ruck | quiquell, password in root dir | 09:37 |
| *** ykarel|mtg is now known as ykarel | 09:38 | |
| quiquell | sshnaidm|ruck: There are some issues at telegraf | 09:41 |
| quiquell | sshnaidm|ruck: For RDO zuul status | 09:42 |
| chkumar|rover | arxcruz: https://review.openstack.org/#/c/584771/16 | 09:42 |
| quiquell | sshnaidm|ruck: An error code ws missing going to fix RETRY_LIMIT | 09:43 |
| chkumar|rover | based on all the corner cases, we have modified that peices | 09:43 |
| *** zoli|lunch is now known as zoli | 09:53 | |
| quiquell | sshnaidm|ruck:The fix https://review.rdoproject.org/r/#/c/15007/ for the ci-dashboard | 09:55 |
| quiquell | sshnaidm|ruck: Let's check that infra as code is working | 09:55 |
| sshnaidm|ruck | quiquell, yep | 09:56 |
| quiquell | sshnaidm|ruck: 192.168.100.248 is not accessible from promoter | 09:57 |
| sshnaidm|ruck | quiquell, not accessible by ...? | 09:58 |
| quiquell | sshnaidm|ruck: promoter cannot access http://192.168.100.248:8086/write?db=telegraf: | 10:02 |
| quiquell | sshnaidm|ruck: I think the internal ip is wrong | 10:02 |
| quiquell | But can access sova's internal ip 192.168.100.249 | 10:04 |
| quiquell | I hacoded internal ip, that have to be the problem | 10:04 |
| sshnaidm|ruck | quiquell, I see.. it didn't have "default" security group, now added it | 10:05 |
| quiquell | for he instance ? | 10:06 |
| sshnaidm|ruck | quiquell, yep | 10:06 |
| sshnaidm|ruck | quiquell, should be fine now | 10:06 |
| quiquell | workiing | 10:07 |
| quiquell | thanks | 10:07 |
| quiquell | sshnaidm|ruck: Let's merge https://review.rdoproject.org/r/#/c/15007/ this to check that RDO's zuul queue size get fixed | 10:08 |
| chkumar|rover | arxcruz: Hello | 10:09 |
| arxcruz | chkumar|rover: hey | 10:09 |
| chkumar|rover | arxcruz: https://review.openstack.org/#/c/584771/ | 10:09 |
| quiquell | panda: Do you remember why we don't run emit_releases_file.py at all the featuresets ? | 10:10 |
| chkumar|rover | I have replied the last comment | 10:10 |
| chkumar|rover | i think you are ok now | 10:10 |
| arxcruz | chkumar|rover: i'm not seeing the content being copied to {{ working_dir }}/tempest | 10:10 |
| sshnaidm|ruck | quiquell, merging.. | 10:11 |
| chkumar|rover | arxcruz: cp -R {{ working_dir }}/tempest_data/tempest {{ working_dir }} | 10:11 |
| chkumar|rover | it will copy it | 10:11 |
| arxcruz | chkumar|rover: nevermind, found it | 10:11 |
| quiquell | sshnaidm|ruck: ack, will monitor | 10:11 |
| panda | quiquell: we wanted to move to the new method gradually | 10:11 |
| chkumar|rover | arxcruz: updating with fixme | 10:11 |
| arxcruz | chkumar|rover: why instead of copy, just point stackviz to that directory? seems to me a workaround | 10:11 |
| quiquell | panda: so maybe now it works for all of them ? I am testing it so we can simplify toci_gate_test | 10:11 |
| chkumar|rover | arxcruz: we will come with a better solution later on | 10:12 |
| chkumar|rover | currently i need to unblock the promotion | 10:12 |
| arxcruz | chkumar|rover: then add a TODO | 10:12 |
| panda | quiquell: did we test it for all ? | 10:12 |
| quiquell | panda: https://review.openstack.org/#/q/topic:remove_quickstart_release+(status:open+OR+status:merged) | 10:13 |
| quiquell | panda: Is this enough ? | 10:13 |
| panda | quiquell: I don't know, we need to involve the upgrades team to understand if everything works as expected | 10:17 |
| chkumar|rover | sshnaidm|ruck: I will leave today in between retro need to visit niece house that time | 10:17 |
| sshnaidm|ruck | chkumar|rover, sure | 10:18 |
| panda | quiquell: it wouldn't be the first time we don't catch errors in upgrades even if the jobs succeed | 10:18 |
| quiquell | panda: If we want to remove QUICKSTART_RELEASE var we need to run always emit_releases_file.py | 10:19 |
| panda | quiquell: one thing I can say for now, is that you're modifying toci_gate_test.sh and not the template, so no upstream job is really testing it | 10:19 |
| quiquell | panda: That's why I am testing it | 10:19 |
| quiquell | panda: Damnn | 10:19 |
| sshnaidm|ruck | quiquell, seems like working.. | 10:19 |
| quiquell | panda: ok | 10:19 |
| quiquell | sshnaidm|ruck: Don't see the new run at /var/log/ansible-pull.log | 10:20 |
| quiquell | but telegraf is working fine now | 10:20 |
| sshnaidm|ruck | quiquell, this is in journalctl now | 10:21 |
| quiquell | Ook | 10:21 |
| *** d0ugal has quit IRC | 10:21 | |
| quiquell | sshnaidm|ruck: Ok so it's working fine, cool | 10:21 |
| quiquell | sshnaidm|ruck: Let's see if we get the promoter graphs now | 10:21 |
| quiquell | sshnaidm|ruck: They are now, so we are good | 10:22 |
| sshnaidm|ruck | quiquell, \o/ | 10:22 |
| quiquell | sshnaidm|ruck: Yey !!!! | 10:22 |
| quiquell | sshnaidm|ruck: Going to shutdown mine | 10:22 |
| *** sshnaidm|ruck is now known as sshnaidm|afk | 10:29 | |
| quiquell | panda: Fixed the patch to test emit_releases_file at all featuresets | 10:34 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, (2 more messages) | 10:37 |
| *** ykarel is now known as ykarel|mtg | 10:52 | |
| *** ykarel|mtg has quit IRC | 10:52 | |
| *** ykarel has joined #oooq | 10:56 | |
| *** sshnaidm|afk is now known as sshnaidm|ruck | 11:00 | |
| *** ratailor has quit IRC | 11:14 | |
| quiquell | rfolco: I am trying to deal with nodes_file and nodes_args here, to replace it at toci_quickstart https://review.openstack.org/#/c/585714/ | 11:17 |
| *** panda is now known as panda|lunch | 11:26 | |
| *** ccamacho has quit IRC | 11:38 | |
| *** ccamacho has joined #oooq | 11:44 | |
| *** ykarel has quit IRC | 11:56 | |
| rfolco | quiquell, good | 11:57 |
| chkumar|rover | sshnaidm|ruck: myoung since wes is not around, someone needs to update on the program call | 11:58 |
| rfolco | quiquell, I am working on featureset_conf and env_vars.... did not submit yet | 11:58 |
| sshnaidm|ruck | chkumar|rover, It's rucks duty | 11:59 |
| quiquell | rfolco: We have break upgrades with the featurset change, EmilienM has a fix, but maybe we can go an try to merge the TAGs one, but the change is bigger | 11:59 |
| quiquell | rfolco: EmilienM Fix does not pass updates | 12:00 |
| chkumar|rover | sshnaidm|ruck: great, you can do that thanks :-) | 12:00 |
| rfolco | quiquell, I see, I went to the bed 2am and did not get any conclusion why it still fails | 12:00 |
| sshnaidm|ruck | chkumar|rover, yep | 12:01 |
| marios | panda|lunch: wdyt about v11 @ https://review.openstack.org/#/c/583195/ | 12:01 |
| rfolco | quiquell, I am looking at the logs again | 12:01 |
| EmilienM | rfolco, quiquell : anything we can revert in the meantime? I really don't want our upgrade jobs not doing upgrades at this period of the cycle | 12:02 |
| EmilienM | and I'm sure the upgrade folks feel the same | 12:02 |
| *** trown|outtypewww is now known as trown | 12:02 | |
| marios | quiquell: rfolco i think we should merge EmilienM tags fix | 12:03 |
| marios | quiquell: rfolco https://review.openstack.org/#/c/585528/ and continue with landing the rest of sprint 16 stuff | 12:04 |
| EmilienM | marios: right but it doesn't pass updates job, can't figure why (in meeting now) | 12:04 |
| quiquell | marios: Checking the updates jobs, the ansible-playbook call is the same | 12:04 |
| EmilienM | have you compared ansible tags? ansible vars? etc | 12:04 |
| marios | EmilienM: quiquell i see. but still if it fixes the others it is move in the right direction while we are figuring out the updates? | 12:04 |
| EmilienM | that's how I found out that rfolco's patch broke it | 12:04 |
| quiquell | EmilienM, marios, rfolco: Good one http://logs.openstack.org/13/583913/2/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/16fe7b6/job-output.txt.gz#_2018-07-20_08_07_37_471034 | 12:05 |
| quiquell | bad one http://logs.openstack.org/28/585528/2/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/6bbd360/job-output.txt.gz#_2018-07-25_03_18_47_067174 | 12:06 |
| quiquell | for multinode-overcloud-update | 12:06 |
| quiquell | playbook | 12:06 |
| quiquell | The only difference is the path tripleo_root now it points to /home/zuul/src/git.openstack.org/openstack/ | 12:06 |
| quiquell | This is not a problem | 12:06 |
| marios | quiquell: right noticed that one | 12:07 |
| quiquell | Don't find any difference, any env var affecting it ? | 12:09 |
| quiquell | marios: I think you are right is better to fix upgrades than updates, reverse the thing is kind of messy now | 12:19 |
| *** ykarel has joined #oooq | 12:25 | |
| *** jaosorior has quit IRC | 12:27 | |
| zoli | who can point me to the current placve, where to find the documentation? The link I have (http://sol.usersys.redhat.com/tripleo-environments/oooq-downstream.html) is nopt working | 12:32 |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, legacy-tripleo-ci-centos-7-multinode-1ctlr-featureset037-updates-master @ https://review.openstack.org/560445, stable/queens: (1 more message) | 12:37 |
| *** amoralej is now known as amoralej|lunch | 12:38 | |
| *** rlandy has joined #oooq | 12:43 | |
| myoung | o/ good morning! I've created the sprint 16 tag on the retro board (https://trello.com/b/0VFswmht/rdo-infra-retrospective?menu=filter&filter=label:Sprint%2016) | 12:50 |
| *** jaosorior has joined #oooq | 12:50 | |
| rlandy | still rdocloud issues? | 12:50 |
| rlandy | 2018-07-25 07:18:18.840155 | tripleo-ovb-centos-7 | *** FAILED with status: 137 | 12:51 |
| rlandy | rook; agopi: will be following up on rdocloud issues | 12:51 |
| agopi | ack rlandy | 12:51 |
| *** skramaja has quit IRC | 12:52 | |
| sshnaidm|ruck | panda|lunch, marios wrt https://review.rdoproject.org/r/#/c/15000 - when do you plan to remove tripleo.sh call? | 12:52 |
| *** panda|lunch is now known as panda | 12:53 | |
| quiquell | rfolco, EmilienM, marios: Maybe we can try to merge the other folcos change that refactor tags https://review.openstack.org/#/c/584508/ | 12:53 |
| quiquell | I don't find the different at EmilienM patch that breaks the updates | 12:53 |
| panda | sshnaidm|ruck: after rdo job configuration clean up, sprint 17 | 12:53 |
| EmilienM | are we sure they don't break OVB? | 12:54 |
| EmilienM | the series of patches with https://review.openstack.org/#/c/584508/ is pretty high | 12:54 |
| panda | EmilienM: OVB run with the old set of scripts | 12:54 |
| sshnaidm|ruck | panda, I'm talking about upstream code in toci_gate_test | 12:54 |
| EmilienM | mhh | 12:55 |
| EmilienM | you folks figure out :) | 12:55 |
| quiquell | EmilienM: Yep, we have to, thanks EmilienM | 12:56 |
| EmilienM | I'm happy with https://review.openstack.org/#/c/584508/ | 12:56 |
| EmilienM | if we're sure it doesn't break OVB jobs. | 12:56 |
| sshnaidm|ruck | panda, not sure how rdo jobs are related' | 12:57 |
| quiquell | EmilienM: Ok, let's ensure that | 12:57 |
| panda | ssbarnea: meeting ? | 13:02 |
| myoung | good morning folks, Sprint 16 retrospective is starting now: https://bluejeans.com/7050859455 | 13:02 |
| sshnaidm|ruck | panda, can you please respond? | 13:04 |
| *** ssbarnea has quit IRC | 13:05 | |
| panda | sshnaidm|ruck: what I heard was that all rdo jobs were using specific configuration and we needed to clean up before putting something commono for all | 13:07 |
| sshnaidm|ruck | panda, so we don't change anything in rdo jobs at all? | 13:08 |
| *** vinaykns has joined #oooq | 13:08 | |
| sshnaidm|ruck | and where were these rumors from.. | 13:08 |
| *** agopi is now known as agopi|brb | 13:08 | |
| quiquell | EmilienM: the update job fails at OVB for the same reason but at folco's change upstrea update works... that doesn't make any sense | 13:13 |
| *** agopi|brb has quit IRC | 13:13 | |
| marios | quiquell: what is enchilada reviews :) | 13:14 |
| marios | y u no talk | 13:14 |
| marios | and rfolco tabasco | 13:14 |
| EmilienM | quiquell: lol | 13:14 |
| EmilienM | too many vars! | 13:15 |
| quiquell | marios: Mic was screw | 13:22 |
| *** amoralej|lunch is now known as amoralej | 13:25 | |
| *** ykarel has quit IRC | 13:28 | |
| *** d0ugal has joined #oooq | 13:28 | |
| *** agopi has joined #oooq | 13:41 | |
| *** gvrangan_odl has quit IRC | 13:43 | |
| *** d0ugal has quit IRC | 13:45 | |
| quiquell | EmilienM: Can I recheck your change ? folcos changes have good updates at upstream but bad at RDO, that doesn't make sense | 13:59 |
| EmilienM | quiquell: I'm in meeting, take over anything you want | 14:02 |
| quiquell | EmilienM: ack thanks | 14:06 |
| *** hamzy_ has quit IRC | 14:13 | |
| *** ssbarnea has joined #oooq | 14:16 | |
| *** tcw has quit IRC | 14:23 | |
| *** tcw has joined #oooq | 14:23 | |
| *** tcw1 has joined #oooq | 14:24 | |
| *** tcw has quit IRC | 14:24 | |
| quiquell | sshnaidm|ruck, chkumar|rover, rlandy: Updated https://review.rdoproject.org/etherpad/p/ruckrover-sprint16 with rr dashboard url | 14:32 |
| sshnaidm|ruck | quiquell, I think we need to update ruck-rover doc with that | 14:33 |
| *** links has quit IRC | 14:33 | |
| sshnaidm|ruck | I always lose link to it.. | 14:33 |
| quiquell | sshnaidm|ruck: this one ? https://docs.google.com/document/d/1lTTOW-UDXTvxkJofGKS7wptmwifh2TVRdmMEcHuKl-o/edit | 14:35 |
| quiquell | I think we can simplify some points, as they are covers by the alerts | 14:35 |
| EmilienM | quiquell: I'm back from meeting, what's the progress? | 14:37 |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, legacy-tripleo-ci-centos-7-multinode-1ctlr-featureset037-updates-master @ https://review.openstack.org/560445, stable/queens: (1 more message) | 14:37 |
| quiquell | EmilienM: We are in meeting now, but at folcos patch updates at upstream is working but on at RDO, that's weird | 14:37 |
| quiquell | EmilienM: So I have recheck both, also checking quickstart-installation.logs they looks the same, I have to recheck. | 14:38 |
| *** hamzy_ has joined #oooq | 14:38 | |
| *** hamzy_ is now known as hamzy | 14:38 | |
| EmilienM | quiquell: can we revert somethnig in the meantime? | 14:39 |
| EmilienM | I really hate to wait having these jobs working | 14:39 |
| sshnaidm|ruck | quiquell, yeah, this one | 14:40 |
| quiquell | We can try to put back the bash logic into the switch statement | 14:40 |
| quiquell | Thre is no easy revert now | 14:40 |
| quiquell | EmilienM: Give me a min will try a review with that | 14:41 |
| EmilienM | k | 14:41 |
| *** udesale has quit IRC | 14:48 | |
| *** jrist has quit IRC | 14:49 | |
| *** ykarel has joined #oooq | 14:50 | |
| *** chem has quit IRC | 14:52 | |
| *** chem has joined #oooq | 14:53 | |
| *** ykarel is now known as ykarel|away | 14:55 | |
| quiquell | EmilienM: This can be the revert https://review.openstack.org/585776, don't see the difference though... | 15:03 |
| *** tcw1 is now known as tcw | 15:06 | |
| *** bogdando has quit IRC | 15:07 | |
| EmilienM | quiquell: well let's see | 15:07 |
| *** bandini has quit IRC | 15:09 | |
| *** bandini has joined #oooq | 15:10 | |
| marios | sshnaidm|ruck: rlandy i just -2 at https://review.openstack.org/#/c/583195/11 just so we can be happy before merge | 15:11 |
| marios | and others would like to review it | 15:12 |
| marios | thanks for your +2 | 15:12 |
| marios | hopefully unless we find issues we can merge v11 | 15:12 |
| rlandy | fine | 15:12 |
| *** jfrancoa has quit IRC | 15:15 | |
| *** jrist has joined #oooq | 15:15 | |
| *** jrist has quit IRC | 15:15 | |
| *** jrist has joined #oooq | 15:15 | |
| *** saneax has quit IRC | 15:16 | |
| *** kopecmartin has quit IRC | 15:21 | |
| agopi | rlandy, rook this looks good so far https://logs.rdoproject.org/17/583717/18/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053-master/d362b2f/job-output.txt.gz | 15:30 |
| *** quiquell has quit IRC | 15:33 | |
| sshnaidm|ruck | panda, rfolco hand off? | 15:33 |
| rfolco | sshnaidm|ruck, yes please | 15:33 |
| panda | sshnaidm|ruck: where ? | 15:33 |
| sshnaidm|ruck | let's go to blue | 15:33 |
| rfolco | your room? | 15:34 |
| sshnaidm|ruck | https://bluejeans.com/u/sshnaidm | 15:34 |
| sshnaidm|ruck | chkumar|rover, are you there? | 15:34 |
| agopi | issues running cinder workload create-attach-volume-centos and nova boot-snapshot-delete on cirros and last one netcreate-1-boot on cirros, basically all image related issues | 15:38 |
| agopi | ^ rook rlandy | 15:38 |
| *** agopi is now known as agopi|food | 15:46 | |
| *** sshnaidm|ruck is now known as sshnaidm | 15:46 | |
| *** panda is now known as panda|rover | 15:46 | |
| *** rfolco is now known as rfolco|ruck | 15:46 | |
| rfolco|ruck | lunch.run('ruck also eats') | 15:47 |
| panda|rover | rfolco|ruck: no they don't | 15:47 |
| rfolco|ruck | :( | 15:48 |
| panda|rover | rfolco|ruck: you can drink once a day | 15:48 |
| rfolco|ruck | tabasco!! | 15:48 |
| sshnaidm | rfolco|ruck, yeah, drinking tabasco and working with rdo cloud have something in common.. | 15:50 |
| rlandy | agopi|food: ok - is that on the browbeat side to change or something we need to address in CI/infra? | 15:51 |
| *** gkadam has quit IRC | 15:52 | |
| *** sshnaidm is now known as sshnaidm|bbl | 15:56 | |
| *** panda|rover is now known as panda|rover|off | 15:57 | |
| *** vinaykns has quit IRC | 15:59 | |
| *** myoung is now known as myoung|lunch | 16:08 | |
| *** ccamacho has quit IRC | 16:12 | |
| agopi|food | its on browbeat side rlandy | 16:15 |
| rlandy | ok | 16:16 |
| *** agopi|food is now known as agopi | 16:17 | |
| *** ykarel|away has quit IRC | 16:18 | |
| *** ykarel|away has joined #oooq | 16:18 | |
| *** holser_ has quit IRC | 16:21 | |
| *** chkumar|rover is now known as chandankumar | 16:24 | |
| chandankumar | sshnaidm|bbl: just back home | 16:25 |
| *** zoli is now known as zoli|gone | 16:28 | |
| chandankumar | rfolco|ruck: sshnaidm|bbl will i transfer the assigned bug to new rover? | 16:33 |
| rfolco|ruck | chandankumar, panda is rover | 16:34 |
| rfolco|ruck | yep | 16:34 |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, legacy-tripleo-ci-centos-7-multinode-1ctlr-featureset037-updates-master @ https://review.openstack.org/560445, stable/queens: (1 more message) | 16:37 |
| *** holser_ has joined #oooq | 16:38 | |
| *** tesseract has quit IRC | 16:53 | |
| *** trown is now known as trown|lunch | 16:55 | |
| *** vinaykns has joined #oooq | 17:00 | |
| weshay_PTO | hi all | 17:11 |
| weshay_PTO | here for 5-10 min | 17:11 |
| weshay_PTO | anyone need anything? | 17:11 |
| *** ykarel|away has quit IRC | 17:11 | |
| *** holser_ has quit IRC | 17:13 | |
| *** amoralej is now known as amoralej|off | 17:13 | |
| *** dtantsur is now known as dtantsur|afk | 17:13 | |
| *** sshnaidm|bbl is now known as sshnaidm | 17:16 | |
| *** jaganathan has quit IRC | 17:18 | |
| *** trown|lunch is now known as trown | 17:53 | |
| *** ykarel|away has joined #oooq | 17:53 | |
| *** myoung|lunch is now known as myoung | 17:53 | |
| *** ykarel|away has quit IRC | 18:19 | |
| rook | weshay_PTO: i need a coffee | 18:21 |
| *** rodrigod` is now known as rodrigods | 18:22 | |
| *** rodrigods has quit IRC | 18:22 | |
| *** rodrigods has joined #oooq | 18:22 | |
| *** dtrainor has quit IRC | 18:29 | |
| *** quiquell has joined #oooq | 18:29 | |
| agopi | rlandy, facing this problem when running reproducer | 18:31 |
| agopi | https://gist.github.com/aakarshg/ee7c7801a381bda2537099985534f6a6 | 18:31 |
| agopi | i can just ssh into the undercloud though | 18:31 |
| myoung | huh...wonder if that is related to the semi-recent change to remove screen --> tmux? | 18:32 |
| agopi | i cant even hit clear | 18:32 |
| agopi | 'screen.xterm-256color': unknown terminal type. | 18:32 |
| myoung | or maybe i have wires crossed? | 18:33 |
| agopi | https://better-coding.com/solved-xterm-256color-unknown-terminal-type/ | 18:34 |
| agopi | clears it up myoung | 18:34 |
| *** dtrainor has joined #oooq | 18:35 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode @ https://review.openstack.org/567224, stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, legacy-tripleo-ci-centos-7-container- (1 more message) | 18:37 |
| *** quiquell has quit IRC | 18:39 | |
| EmilienM | rfolco|ruck : so what's the status | 18:42 |
| EmilienM | are we going to merge this revert? https://review.openstack.org/#/c/585776/ | 18:42 |
| rlandy | myoung: cool - thanks for solving that | 18:42 |
| EmilienM | it's failing the same way as updates job is failing on the other patch | 18:43 |
| rfolco|ruck | EmilienM, rdo yes, I was waiting for zuul ci, checking | 18:43 |
| rfolco|ruck | same http://logs.openstack.org/76/585776/3/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/8b98aaf/logs/undercloud/home/zuul/overcloud_update_run_Controller.log.txt.gz | 18:44 |
| rfolco|ruck | breakage must be a combination of https://review.openstack.org/#/c/582384 with something else | 18:47 |
| rfolco|ruck | marios, you got a min to bj? perhaps a quick look at https://review.openstack.org/#/c/582885 to see if you see anything... | 18:52 |
| EmilienM | rfolco|ruck: what is the plan? | 18:54 |
| EmilienM | having https://review.openstack.org/#/c/584508/ ? | 18:54 |
| rfolco|ruck | EmilienM, The problem is rdo job fails the same way... legacy-tripleo-ci-centos-7-multinode-1ctlr-featureset037-updates-master | 18:55 |
| EmilienM | sigh | 18:55 |
| EmilienM | we should revert all that work | 18:55 |
| EmilienM | and redo it from scratch | 18:55 |
| rfolco|ruck | EmilienM, I suspect that https://review.openstack.org/#/c/582885 also broke it (rdo)... my tags patch https://review.openstack.org/#/c/584508/ only works for zuul ci... something is missing for rdo side still. | 18:56 |
| rook | agopi rlandy it looks like rdocloud is still struggling? | 19:02 |
| rlandy | so it seems | 19:04 |
| rook | where can one look at that? | 19:11 |
| *** d0ugal has joined #oooq | 19:12 | |
| *** myoung is now known as myoung|bbl | 19:12 | |
| rlandy | https://semaphore.cloud.upshift.engineering.redhat.com/ | 19:12 |
| rlandy | but mostly we just watch the conversation on #rhos-ops | 19:13 |
| rook | All systems are operational! | 19:13 |
| rook | :D | 19:13 |
| rlandy | as of this morning it was not operational | 19:13 |
| rook | LIES! | 19:13 |
| rlandy | I have not tried since then | 19:13 |
| rook | :P | 19:13 |
| * rook runs recheck | 19:13 | |
| rlandy | rfolco|ruck" ^^ any status on rdocloud? | 19:13 |
| rfolco|ruck | jeez | 19:14 |
| rlandy | rook: usually the ruck/river have a good handle on the status | 19:14 |
| rfolco|ruck | rlandy, sshnaidm just did a hand off | 19:15 |
| rlandy | As of right now we are considering RDO-Cloud to be operational. We are looking forward to your feedback. | 19:15 |
| rlandy | from rhos-dev email | 19:15 |
| rlandy | so it should be working now? | 19:15 |
| rlandy | rook: are you looking at job output or working on your personal tenant? | 19:16 |
| rlandy | rfolco|ruck: so we're good to go now? | 19:16 |
| rfolco|ruck | I heard they were resetting things... | 19:16 |
| rlandy | can recheck jobs? | 19:16 |
| rook | rlandy: from the featureset run | 19:16 |
| rlandy | rook: ack | 19:16 |
| rlandy | we can recheck | 19:16 |
| rlandy | when rfolco|ruck thinks they are done with the reset | 19:16 |
| rlandy | rook: welcome to upstream :) | 19:17 |
| rfolco|ruck | sec | 19:17 |
| agopi | rook, | 19:17 |
| agopi | no need to run recheck | 19:17 |
| agopi | browbeat failed running scenarios | 19:17 |
| agopi | issues running cinder workload create-attach-volume-centos and nova boot-snapshot-delete on cirros and last one netcreate-1-boot on cirros, basically all image related issues | 19:17 |
| agopi | https://logs.rdoproject.org/17/583717/18/openstack-check/legacy-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset053-master/d362b2f/job-output.txt.gz | 19:17 |
| agopi | rook^ | 19:18 |
| agopi | culprit: image script | 19:19 |
| rook | oh | 19:19 |
| rook | agopi: did that come from that commit? | 19:20 |
| rook | hm, it did | 19:20 |
| rook | same error I called out before agopi | 19:22 |
| rook | 'stderr': u'volume version 3.52 is not in supported versions: 1, 2, 3', u'failed': True}] | 19:22 |
| agopi | yes rook | 19:24 |
| rook | and I mentioned not to use the browbeat venv | 19:24 |
| rook | let me amend that | 19:24 |
| rfolco|ruck | rlandy, I guess the email gives the green light | 19:24 |
| agopi | oh yes, thats what i forgot | 19:24 |
| rlandy | rhos-dev? | 19:24 |
| rlandy | yep | 19:24 |
| rlandy | ok - we can try again then | 19:24 |
| rfolco|ruck | yes rlandy, let me know if any issues I can follow-up | 19:25 |
| rlandy | rook: agopi: ^^ look slike rdocloud should be back in action now per rhos-dev email | 19:25 |
| rfolco|ruck | rlandy, quick question, hope so... shouldn't we add the same vars to rdo-jobs as we did for upstream tripleo-ci ones ? rdo-jobs --> https://github.com/rdo-infra/rdo-jobs/blob/master/zuul.d/zuul-legacy-jobs.yaml#L1303... tripleo-ci --> https://github.com/openstack-infra/tripleo-ci/blob/master/zuul.d/multinode-jobs.yaml#L402 | 19:33 |
| rlandy | rfolco|ruck: rdo-jobs are complicated :( | 19:36 |
| rfolco|ruck | differente workflow right? they do not run run-v3.yaml | 19:36 |
| rlandy | which is why I was unsure about how to move forward with the changes I had made to include browbeat etc. | 19:36 |
| rlandy | yep | 19:36 |
| rlandy | I really think we need to take a clear decision on this TOMORROW | 19:36 |
| rlandy | like ASAP | 19:37 |
| rlandy | we are going to block oursleves or duplicate | 19:37 |
| rlandy | so, in theory, yse | 19:37 |
| rlandy | we should be doing exactly that | 19:37 |
| rlandy | and we need to consider it in the clean up | 19:38 |
| rfolco|ruck | rlandy, was trying to find out why https://review.openstack.org/#/c/584508/ fails on rdo-jobs (updates fs037) but it works for zuul ci | 19:38 |
| rlandy | rfolco|ruck: one sec - call - then will look | 19:38 |
| rfolco|ruck | sure, no worries. don't want to hold you more | 19:38 |
| rlandy | rfolco|ruck k, sorry about that - looking | 19:43 |
| *** d0ugal has quit IRC | 19:46 | |
| rlandy | hmmm ... "Overcloud minor update execution step failed..." | 19:46 |
| rlandy | where is marios when you need him?!? | 19:47 |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, tripleo-ci- (1 more message) | 20:37 |
| *** agopi is now known as agopi|brb | 20:44 | |
| *** agopi|brb has quit IRC | 20:48 | |
| *** hamzy has quit IRC | 20:55 | |
| *** brault has quit IRC | 21:32 | |
| *** rfolco|ruck is now known as rfolco|ruck|off | 21:39 | |
| *** rook has quit IRC | 21:48 | |
| *** rook has joined #oooq | 21:49 | |
| *** rook is now known as Guest55460 | 21:50 | |
| *** agopi|brb has joined #oooq | 21:54 | |
| *** agopi|brb is now known as agopi | 22:07 | |
| *** vinaykns has quit IRC | 22:37 | |
| hubbot | FAILING CHECK JOBS on stable/ocata: legacy-tripleo-ci-centos-7-ovb-1ctlr_1comp_1ceph-featureset024-ocata @ https://review.openstack.org/564291, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario009-multinode-oooq, legacy-tripleo-ci-centos-7-container-to-container-upgrades-master, tripleo-ci- (1 more message) | 22:37 |
| *** sshnaidm is now known as sshnaidm|afk | 22:38 | |
| *** Guest55460 is now known as rook | 22:52 | |
| *** rook is now known as Guest69190 | 22:52 | |
| *** Guest69190 is now known as rook-- | 22:53 | |
| *** myoung|bbl is now known as myoung | 23:00 | |
| *** tosky has quit IRC | 23:26 | |
| *** rlandy has quit IRC | 23:48 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!