| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario002-standalone, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039 @ (2 more messages) | 00:10 |
|---|---|---|
| *** rascasoft has joined #oooq | 00:20 | |
| *** rascasoft has quit IRC | 00:27 | |
| *** agopi has joined #oooq | 00:48 | |
| *** dsneddon has quit IRC | 01:57 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-scenario002-standalone, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039 @ (2 more messages) | 02:10 |
| *** dsneddon has joined #oooq | 02:22 | |
| *** dsneddon has quit IRC | 02:27 | |
| *** dsneddon has joined #oooq | 02:38 | |
| *** dsneddon has quit IRC | 02:44 | |
| *** rlandy|bbl is now known as rlandy | 02:45 | |
| rlandy | weshay++ | 03:03 |
| hubbot1 | rlandy: weshay's karma is now 16 | 03:03 |
| rlandy | job got past the undercloud_key | 03:03 |
| weshay | nice | 03:03 |
| *** dsneddon has joined #oooq | 03:07 | |
| weshay | rlandy the job running here? https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status | 03:08 |
| rlandy | weshay: ack | 03:08 |
| rlandy | made another change | 03:08 |
| weshay | ah k | 03:08 |
| rlandy | https://review.openstack.org/#/c/639722/11/playbooks/baremetal-prep-virthost.yml | 03:09 |
| rlandy | added non_root_user | 03:09 |
| rlandy | previous error permissions on volumes | 03:09 |
| rlandy | will see what this does | 03:09 |
| rlandy | previous error: https://sf.hosted.upshift.rdu2.redhat.com/logs/49/163849/34/check/periodic-tripleo-ci-centos-7-baremetal-3ctlr_1comp-featureset001-master/d727536/job-output.txt.gz#_2019-02-28_02_54_53_087129 | 03:10 |
| rlandy | oh this one I can fix | 03:11 |
| rlandy | it's the path to instackenv.json | 03:11 |
| rlandy | http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/hardware_environments/hp_dl360_envD/network_configs/single_nic_vlans/env_settings.yml#n29 | 03:13 |
| *** dsneddon has quit IRC | 03:14 | |
| *** dsneddon has joined #oooq | 03:14 | |
| *** udesale has joined #oooq | 03:15 | |
| *** apetrich has quit IRC | 03:15 | |
| * rlandy thinks where to put this file | 03:15 | |
| weshay | rlandy anything permission denied makes me think we don't have the users lined up | 03:15 |
| rlandy | weshay: the missing file error is legit | 03:15 |
| weshay | where to put the env file | 03:15 |
| rlandy | yep | 03:15 |
| rlandy | undercloud_instackenv_template: "{{ local_working_dir }}/tripleo-environments/hardware_environments/hp_dl360_envD/instackenv.json" | 03:16 |
| rlandy | ^^ current path | 03:16 |
| weshay | we used to put that in ~ right? | 03:16 |
| rlandy | yep we still need to | 03:16 |
| rlandy | the path is actually on the localhosr | 03:16 |
| weshay | don't we still use.. the prep role for that? | 03:16 |
| weshay | local wha? | 03:16 |
| rlandy | we need it to deploy | 03:16 |
| rlandy | localhost | 03:16 |
| weshay | ya.. on the undercloud vm | 03:16 |
| weshay | oh. | 03:17 |
| weshay | instackenv.json | 03:17 |
| weshay | so on the virthost | 03:17 |
| weshay | should be the same as any other virthost | 03:17 |
| rlandy | I have this role to copy stiff around where toci expects it ... | 03:17 |
| rlandy | stuff | 03:17 |
| rlandy | https://code.engineering.redhat.com/gerrit/#/c/163849/34/playbooks/copy-env-vars-baremetal.yaml | 03:18 |
| weshay | rlandy toci interacts w/ the instackenv.json? | 03:18 |
| rlandy | well no, but playbooks toci kicks | 03:18 |
| weshay | k... | 03:18 |
| weshay | well https://ci.centos.org/artifacts/rdo/jenkins-tripleo-quickstart-promote-master-current-tripleo-delorean-minimal-469/undercloud/home/stack/ | 03:18 |
| weshay | it is on the undercloud | 03:18 |
| weshay | not virthost | 03:18 |
| * weshay is tired | 03:18 | |
| rlandy | let me try the definition of where it really is | 03:19 |
| weshay | so where was that error? | 03:19 |
| weshay | re: instackenv.json? | 03:19 |
| *** dsneddon has quit IRC | 03:19 | |
| rlandy | {{ zuul.executor.work_root }}/{{ zuul.projects['code.engineering.redhat.com/tripleo-environments'].src_dir }}/... | 03:19 |
| weshay | oh.. because it's checked out on the nodepool node | 03:19 |
| weshay | and then you have to copy it | 03:20 |
| rlandy | yeah idk if it will work | 03:20 |
| weshay | this doesn't make sense yet to me | 03:20 |
| rlandy | but we'll see | 03:20 |
| weshay | where do we clone code.eng on the old jobs? | 03:20 |
| rlandy | this one makes sense to me - I was expecting it | 03:20 |
| weshay | not on the undercloud | 03:20 |
| weshay | k k | 03:20 |
| rlandy | we do | 03:21 |
| rlandy | you'll see it here | 03:21 |
| rlandy | https://sf.hosted.upshift.rdu2.redhat.com/logs/49/163849/34/check/periodic-tripleo-ci-centos-7-baremetal-3ctlr_1comp-featureset001-master/d727536/zuul-info/inventory.yaml | 03:21 |
| weshay | rlandy https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/overcloud-prep-config/tasks/main.yml#L27 | 03:21 |
| rlandy | - when: undercloud_type == "baremetal" | 03:22 |
| rlandy | this is virt undercloud | 03:22 |
| weshay | aye | 03:22 |
| rlandy | src: "{{ network_environment_file }}" | 03:22 |
| *** dsneddon has joined #oooq | 03:22 | |
| rlandy | ugh not that | 03:23 |
| weshay | http://git.openstack.org/cgit/openstack/tripleo-quickstart-extras/tree/roles/undercloud-setup/tasks/ovb_setup_connectivity.yml | 03:23 |
| weshay | and then we have more | 03:23 |
| weshay | rlandy http://git.openstack.org/cgit/openstack/tripleo-quickstart/tree/roles/libvirt/setup/undercloud/tasks/main.yml#n79 | 03:24 |
| weshay | rlandy so if you drop it in ~ on the virthost | 03:24 |
| weshay | that will pick it up | 03:24 |
| weshay | and the undercloud will just get it | 03:25 |
| weshay | maybe not | 03:25 |
| weshay | that is full virt only | 03:25 |
| weshay | I'm tired | 03:25 |
| rlandy | looking for it {{ local_working_dir }}/tripleo-environments/hardware_environments/hp_dl360_envD/instackenv.json | 03:25 |
| rlandy | so I'd have to copy there | 03:25 |
| rlandy | or change the path | 03:25 |
| * rlandy tries to change the path | 03:26 | |
| weshay | rlandy is tripleo-env checked out in {{ local_working_dir }} ? | 03:26 |
| weshay | as a required project? | 03:26 |
| rlandy | not any more | 03:26 |
| rlandy | oh yes | 03:27 |
| rlandy | but the dir is diff | 03:27 |
| weshay | is code.eng still a required project? | 03:27 |
| rlandy | it is | 03:27 |
| weshay | \/usr/share or something? | 03:27 |
| * rlandy puts in review | 03:27 | |
| *** dsneddon has quit IRC | 03:27 | |
| rlandy | weshay: https://code.engineering.redhat.com/gerrit/164089 Adjust path to instackenv.json when in ci | 03:36 |
| rlandy | let's see what that does | 03:38 |
| rlandy | ok - we're going | 03:46 |
| *** dsneddon has joined #oooq | 03:48 | |
| *** skramaja has joined #oooq | 03:53 | |
| *** dsneddon has quit IRC | 04:04 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, (3 more messages) | 04:10 |
| *** ykarel|away has joined #oooq | 04:19 | |
| *** ykarel|away is now known as ykarel | 04:20 | |
| *** rlandy has quit IRC | 04:50 | |
| *** gkadam has joined #oooq | 04:55 | |
| *** saneax has joined #oooq | 04:55 | |
| *** dsneddon has joined #oooq | 05:00 | |
| *** raukadah has quit IRC | 05:03 | |
| *** chandankumar has joined #oooq | 05:04 | |
| *** saneax has quit IRC | 05:27 | |
| *** ratailor has joined #oooq | 05:28 | |
| *** saneax has joined #oooq | 05:28 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, (3 more messages) | 06:10 |
| *** gkadam has quit IRC | 06:27 | |
| quiquell | https://review.openstack.org/#/c/639310 | 06:46 |
| quiquell | chandankumar: commented | 06:46 |
| chandankumar | quiquell: thanks!, commented back :-) | 06:53 |
| quiquell | chandankumar: are you sure about the flag issue? | 07:02 |
| quiquell | Have to be a problem of os_tempest not comparing with bool but with string | 07:02 |
| chandankumar | quiquell: yes let me find that review | 07:02 |
| quiquell | chandankumar: do you have the rr etherpad at ✋ | 07:03 |
| *** jfrancoa has joined #oooq | 07:05 | |
| chandankumar | quiquell: https://review.rdoproject.org/etherpad/p/ruckrover-unisprint6 | 07:05 |
| quiquell | chandankumar: commented in the review about the include_role and become | 07:09 |
| chandankumar | quiquell: not seen, may be forgot to submit | 07:11 |
| quiquell | No is very small comment | 07:11 |
| quiquell | Move ansible become to vars section under include_role | 07:12 |
| quiquell | No problem I mean | 07:12 |
| chandankumar | quiquell: ok will do that | 07:12 |
| *** apetrich has joined #oooq | 07:12 | |
| chandankumar | quiquell: thanks :-) | 07:12 |
| quiquell | Seting it as fact can be dangerous | 07:13 |
| quiquell | Maybe the debug flag too | 07:13 |
| quiquell | To reduce variables scope | 07:14 |
| quiquell | I would use set fact only for conditionals | 07:14 |
| quiquell | Everything else under vars section at include role | 07:14 |
| chandankumar | quiquell: we have catogarize it in section so that enduser can understand what is needed for what purpose. | 07:18 |
| chandankumar | I avoided use of comments so went for set facts | 07:18 |
| chandankumar | that allows me to add more conditionals | 07:18 |
| chandankumar | updating it in new patchset | 07:19 |
| quiquell | chandankumar: ack, but if possible move "Âdebug" since is very generic name | 07:24 |
| quiquell | debug | 07:24 |
| sshnaidm|afk | quiquell, http://paste.openstack.org/show/746474/ | 07:32 |
| *** sshnaidm|afk is now known as sshnaidm | 07:32 | |
| sshnaidm | quiquell, need to put some Change-Id | 07:32 |
| *** kopecmartin|off is now known as kopecmartin | 07:34 | |
| *** quiquell is now known as quiquell|brb | 07:48 | |
| *** ratailor has quit IRC | 07:51 | |
| *** ccamacho has joined #oooq | 07:59 | |
| *** jtomasek has joined #oooq | 08:01 | |
| *** gkadam has joined #oooq | 08:02 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, (3 more messages) | 08:10 |
| *** quiquell|brb is now known as quiquell | 08:14 | |
| quiquell | sshnaidm: hook will do | 08:15 |
| quiquell | Humm with -m maybe not? | 08:16 |
| *** amoralej|off is now known as amoralej | 08:32 | |
| *** dtrainor_ has joined #oooq | 08:39 | |
| *** tosky has joined #oooq | 08:39 | |
| *** dtrainor has quit IRC | 08:41 | |
| *** ratailor has joined #oooq | 08:42 | |
| *** ykarel is now known as ykarel|lunch | 08:43 | |
| chandankumar | kopecmartin: arxcruz Hello | 08:48 |
| chandankumar | kopecmartin: arxcruz there is something wrong with python-tempestconf on os_tempest job http://logs.openstack.org/10/639310/10/check/tripleo-ci-centos-7-standalone-os-tempest/6380363/logs/undercloud/home/zuul/tempest/tempest.log.txt.gz#_2019-02-28_07_03_26_211 | 08:48 |
| chandankumar | kopecmartin: arxcruz it is setting cinder to false | 08:48 |
| kopecmartin | chandankumar, i have a fix for that | 08:49 |
| chandankumar | kopecmartin: in standalone also http://logs.openstack.org/10/639310/10/check/tripleo-ci-centos-7-standalone/d6cb4ee/logs/undercloud/home/zuul/tempest.log.txt.gz#_2019-02-28_06_58_15 | 08:50 |
| kopecmartin | chandankumar, https://review.openstack.org/#/c/638272/ | 08:50 |
| chandankumar | kopecmartin: thanks! | 08:51 |
| kopecmartin | chandankumar, but there are 4 other reviews which need to be merged first starting by this manila change https://review.openstack.org/#/c/638320/ | 08:52 |
| zbr | quiquell: marios: simple review on bindep https://review.openstack.org/#/c/635590/ | 08:53 |
| quiquell | zbr: ansible question | 08:53 |
| quiquell | zbr: do you know if calling "add_host" to override ansible_host is not working ? | 08:53 |
| zbr | quiquell: likely will not, there is a reason why is called "add" | 08:54 |
| quiquell | zbr: host was already there | 08:54 |
| *** jpena|off is now known as jpena | 08:54 | |
| marios | ack zbr | 08:55 |
| quiquell | zbr: humm better pin fedora versions there as they do with fedora | 08:55 |
| quiquell | with centos | 08:55 |
| zbr | this is what i am telling, you likely to be problematic. but you can remove it if it does not work. | 08:55 |
| quiquell | zbr: humm kudos on removing will try | 08:56 |
| quiquell | zbr: thanks mate | 08:56 |
| zbr | quiquell: we are lucky that we were allowed to pin it for our jobs, i was asked explicitly to use latest. | 08:56 |
| quiquell | zbr: ok, so latest it is | 08:56 |
| quiquell | zbr: we don't have to do nothing for this to use python3 instead of python2 ? | 08:57 |
| zbr | not sure why we are not using dynamic inventories, ansible can load any number of inventories from a folder. | 08:57 |
| zbr | i have more changes coming to bindep related to f28 but I need to prepare the testing ground first | 08:57 |
| zbr | if anyone is curious, this is the feature i am trying to land in bindep: https://review.openstack.org/#/c/639951/1 | 08:59 |
| quiquell | zbr: +1 on bindep | 09:00 |
| zbr | i think i don't need to explain you why we need it, in many places. | 09:01 |
| quiquell | zbr: inequalities for version that's cool | 09:01 |
| quiquell | A nooo that's a comment | 09:01 |
| zbr | i have no time to implement version comparison in bindep, but the yum/dnf approach is more than safe to use | 09:02 |
| quiquell | totally | 09:02 |
| quiquell | It will help us a lot | 09:02 |
| quiquell | zbr: thanks | 09:02 |
| quiquell | +1 there too | 09:02 |
| *** bogdando has joined #oooq | 09:03 | |
| *** jaosorior has joined #oooq | 09:06 | |
| *** rascasoft has joined #oooq | 09:26 | |
| *** udesale has quit IRC | 09:28 | |
| *** udesale has joined #oooq | 09:29 | |
| marios | zbr: please remove -1 @ https://review.openstack.org/#/c/638651/ | 09:31 |
| marios | zbr: i don't want to scare away the crows | 09:31 |
| marios | :) | 09:31 |
| *** derekh has joined #oooq | 09:35 | |
| chandankumar | fso35 is timing out at prepare overcloud image is it a known issue https://logs.rdoproject.org/51/639651/4/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035/16a0e1f/job-output.txt.gz#_2019-02-28_06_07_12_059292 | 09:36 |
| chandankumar | or it is just coming for me | 09:36 |
| *** ykarel|lunch is now known as ykarel | 09:48 | |
| *** dtantsur|afk is now known as dtantsur | 09:49 | |
| marios | rfolco|rover: panda|ruck|off weshay quiquell zbr chandankumar sshnaidm arxcruz o/ folks please consider https://review.rdoproject.org/r/#/c/18975/ https://review.openstack.org/#/c/638652/ https://review.openstack.org/#/c/638651 for your next review time. Info about them in https://tree.taiga.io/project/tripleo-ci-board/task/773 & some evidence of it working ;) thank you! | 09:51 |
| *** panda|ruck|off is now known as panda|ruck | 09:51 | |
| marios | zbr: please remove your -1 @ https://review.openstack.org/#/c/638651 (or justify it please) | 09:51 |
| panda|ruck | marios: reviewing now | 09:52 |
| marios | panda|ruck: thanks | 09:52 |
| quiquell | marios: I always forgot, playbooks + defaults works or not ? | 09:54 |
| marios | quiquell: no its why i have the set_facts s/i/we like we use set_fact for the other things there in the build job | 09:54 |
| marios | for that reason | 09:54 |
| marios | quiquell: really we shoul just make it a role and be don | 09:54 |
| ykarel | chandankumar, yes fs035 issue in known, will go away after master promotion, master is promoting currently | 09:54 |
| marios | but not here | 09:54 |
| marios | ! | 09:54 |
| marios | s/here/onthis story | 09:54 |
| chandankumar | ykarel: cool, thanks! | 09:54 |
| panda|ruck | ykarel: hwat ?? again ?? | 09:55 |
| ykarel | chandankumar, fyi: https://bugs.launchpad.net/tripleo/+bug/1817859 | 09:55 |
| openstack | Launchpad bug 1817859 in tripleo "[fs035][master][promotion] Introspection Fails with TypeError: coercing to Unicode: need string or buffer, bool found" [Critical,Triaged] | 09:55 |
| ykarel | panda|ruck, so master was promoted yesterday with broken python-hardware skipping fs035 from criteria | 09:55 |
| panda|ruck | ykarel: yes | 09:55 |
| panda|ruck | ykarel: and fs20 too | 09:56 |
| panda|ruck | ykarel: because the test in tempest should have been skipped | 09:56 |
| ykarel | panda|ruck, fs020 is not running in upstream check, so promoting without it has no issue | 09:56 |
| panda|ruck | ykarel: yes but it's good to make it pass | 09:56 |
| ykarel | but fs035 is running upstream, so ignoring it can make upstream jobs fail | 09:56 |
| ykarel | so since promotion, fs035 is down:- https://review.rdoproject.org/zuul/builds?job_name=tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035&branch=master | 09:57 |
| panda|ruck | ykarel: is it gating ? | 09:58 |
| quiquell | marios: 200~https://review.openstack.org/#/c/638652/ +2 with small nit (you can ignore it) | 09:58 |
| ykarel | panda|ruck, nope | 09:58 |
| panda|ruck | ykarel: and I thought the fix was there | 09:58 |
| marios | quiquell: thanks its still super early so thanks looking for comments will update later lets see if others have more | 09:58 |
| quiquell | I am super bad at reviews so for sure they have | 09:59 |
| ykarel | panda|ruck, fix was there but needed promotion | 09:59 |
| *** holser_ has joined #oooq | 09:59 | |
| ykarel | panda|ruck, i commented on https://review.rdoproject.org/r/#/c/19023/ | 09:59 |
| marios | quiquell: just starting the selling it. i mean we've seen it run so it seems to work ok but maybe i miss something. that is why we do reviews ;) | 09:59 |
| marios | quiquell: so i will spam this channel every day | 09:59 |
| marios | you're welcome | 09:59 |
| quiquell | marios: hehe, harassing bot you need | 10:00 |
| marios | quiquell: no its too much fun to leave it to the bot | 10:00 |
| marios | i like to do it personally | 10:00 |
| marios | zbr: around? | 10:00 |
| marios | zbr: kindly remove -1 @ https://review.openstack.org/#/c/638651/ or justify it please. thanks | 10:01 |
| marios | :D | 10:01 |
| marios | see quiquell ^. | 10:01 |
| marios | :) | 10:01 |
| quiquell | Ohhh I se the f28 containers builds at the review :-) | 10:02 |
| quiquell | zbr: RDO results are there waiting for you, please remove -1 https://review.openstack.org/#/c/638651 | 10:03 |
| marios | quiquell: yeah :D it fails realyly early thoguh | 10:03 |
| panda|ruck | marios: so you gonna merge or fix quiquell's suggestions ? | 10:03 |
| marios | quiquell: but i didn't touch it there. i *am* passing the tripleo-ci-testing for the f28 but in the https://review.rdoproject.org/r/19026 | 10:03 |
| quiquell | panda|ruck: if you are going to workflow it we can forget about that little nit to progress | 10:04 |
| marios | panda|ruck: let me check them then ;) | 10:04 |
| panda|ruck | quiquell: no, your comments make sense | 10:04 |
| quiquell | ack | 10:04 |
| panda|ruck | I also have a bigger solution for all this overrides. But first I have to find time to put up the configuration Doc of the existing | 10:05 |
| marios | panda|ruck: (doing but anyway why you ask me. if you agre with quiquell then say so and maybe -1. then i have a motivation to get your _+" ) | 10:06 |
| marios | thats how it works people ! | 10:06 |
| panda|ruck | marios: if I agree with quiquell I have to put +2 :) | 10:06 |
| zbr | marios: removed but keep in mind that you should merge the f28 first and test that bld cnt works with this change. this was the reason why I added the -1 (had a comment too) | 10:06 |
| zbr | this is why we added to job, to look at its results | 10:07 |
| quiquell | zbr: I see the f28 containers builds already there | 10:07 |
| marios | zbr: thanks but this change is not touching build containers just the repo setup role. i don't think we can block one for the other. there might be rebase needed | 10:07 |
| quiquell | at third party | 10:08 |
| marios | zbr: and yeah it runs there but failed | 10:08 |
| marios | zbr: if you find sometihng point to it in the review and i'll fix. otherwise, if you want to block on some other change be clear, say -1 until foo happens in review http://xyz | 10:08 |
| zbr | damn, merge conflict on https://review.openstack.org/#/c/636160/ -- | 10:09 |
| zbr | you should add a depends-on on https://review.openstack.org/#/c/636160/ | 10:09 |
| marios | zbr: cos fantom -1 without explanation always scares away the crows | 10:09 |
| zbr | marios: there is a comment, check history, it was not just a -1. | 10:09 |
| zbr | sadly the generic comments are not so visible like the code-comments | 10:10 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001, tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, (3 more messages) | 10:10 |
| marios | zbr: ack thanks and sorry to miss the info. yeah when its something like that i ususally add in the commit message as a comment/somewhere obvious | 10:12 |
| marios | quiquell: 1/2 for the comments updated thanks https://review.openstack.org/#/c/638652/11 | 10:13 |
| marios | panda|ruck: ^ | 10:13 |
| zbr | marios: sad that gerrit does not allow to select text in commit message and put comment there, i would have found this really useful. likely already fixed in newer one. | 10:15 |
| quiquell | marios: you have my cheap +2 | 10:15 |
| zbr | i was amazed to see how much gerrit UI evolved in the last year by looking at gerritforge which is always updated. | 10:15 |
| marios | thanks quiquell not cheap :! | 10:15 |
| panda|ruck | zbr: you can | 10:16 |
| sshnaidm | marios, commented https://review.openstack.org/#/c/638652 | 10:17 |
| marios | thanks sshnaidm will check and update thanks for reviews | 10:17 |
| marios | sshnaidm: thanks can you see https://review.openstack.org/#/c/638652/10/playbooks/tripleo-buildcontainers/pre.yaml@6 | 10:18 |
| marios | sshnaidm: its cos it isn't a role | 10:18 |
| zbr | panda|ruck: right, i was looking in the wrong place to comment. | 10:20 |
| sshnaidm | marios, replied | 10:20 |
| marios | sshnaidm: ack doing yeah we can avoid the set_fact i think .. | 10:22 |
| *** udesale has quit IRC | 10:24 | |
| *** udesale has joined #oooq | 10:24 | |
| *** ccamacho has quit IRC | 10:43 | |
| zbr | every time i hear someone asking to refresh my browser cache i roll my eyes... writing web apps correctly should never require user to do that. | 10:46 |
| *** ccamacho has joined #oooq | 10:49 | |
| panda|ruck | if you want to check at a glance what important fields are missing on your user story see last table in http://38.145.32.196/taigacli/201902280600.txt | 10:56 |
| *** saneax has quit IRC | 10:56 | |
| zbr | panda|ruck: out of curiosity: what is the meaning of "QE" column? what is different than "ready for review" on it? | 10:56 |
| marios | zbr: merged not done/accepted yet | 10:57 |
| zbr | who moves from qe to done? | 10:57 |
| marios | zbr: qe | 10:58 |
| panda|ruck | zbr: marios and even if merged, a story is not done until the QE checks that the implementation adhere to the Definition of DOne | 10:58 |
| zbr | i am taking about tasks here, but ok, shortly the owner/driver should never move a task to done, always someone else (qe). | 10:59 |
| zbr | btw, I need a qe for https://tree.taiga.io/project/tripleo-ci-board/task/808 -- it already has two reviews ready for review. should be easy. | 11:00 |
| marios | zbr: maybe it is the owner, if we don't have qe. but owner has to justify it imo like "I tested see foo" or whatever | 11:00 |
| panda|ruck | zbr: yes, the cook cannot understand if the soup is good enough :) | 11:01 |
| panda|ruck | marios: zbr the owner of thye user story right now is there nly to ensure that the important fields are filled | 11:01 |
| zbr | panda|ruck: panda|ruck : i subsribe to the idea of using a 3rd party to decide the quality of the soup | 11:01 |
| zbr | not always convenient but good practice | 11:02 |
| panda|ruck | zbr: yes it's not about how good you are, the eye untrained to your patch spots problems immediately | 11:03 |
| zbr | i am trying to cleanup a little bit the storyless section but I have no idea what to do with a very old task which is not a prio, but also not done. how to remove it from sprint board as it does not make sense to spam it and carry from one sprint to another. parked does not hide it. | 11:05 |
| *** agopi has quit IRC | 11:06 | |
| zbr | the more i use taiga the more I miss jira-agile, it was so easy to manage the tasks there. | 11:08 |
| *** d0ugal has quit IRC | 11:08 | |
| marios | rfolco|rover: panda|ruck no scrum today? seems like there is conflictin the calendar | 11:08 |
| marios | rfolco|rover: panda|ruck do you want to reschedule to 1 hour earlier? | 11:08 |
| marios | rfolco|rover: panda|ruck or 1 hour later probably | 11:08 |
| panda|ruck | marios: I see the scrum | 11:09 |
| marios | panda|ruck: pvt | 11:09 |
| *** d0ugal has joined #oooq | 11:12 | |
| marios | sorry for noise panda|ruck rfolco|rover seems no change needed ;) | 11:13 |
| marios | thank sp | 11:13 |
| marios | thanks panda|ruck | 11:13 |
| panda|ruck | yeah thanks sp, you're always the best. | 11:14 |
| marios | sp rocks | 11:16 |
| panda|ruck | ykarel: is this know ? https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/0398d7f/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2019-02-28_01_33_46 | 11:16 |
| panda|ruck | ykarel: I don't see any bugs on it | 11:16 |
| panda|ruck | ykarel: 019-02-28 01:33:46 | [2019/02/28 01:30:38 AM] [WARNING] Error in 'ip route add 0.0.0.0/0 via 10.0.0.1 dev br-ex', restarting br-ex: | 11:17 |
| panda|ruck | 2019-02-28 01:33:46 | Unexpected error while running command. | 11:17 |
| panda|ruck | 2019-02-28 01:33:46 | Command: /sbin/ip route add 0.0.0.0/0 via 10.0.0.1 dev br-ex | 11:17 |
| panda|ruck | 2019-02-28 01:33:46 | Exit code: 1 | 11:17 |
| panda|ruck | 2019-02-28 01:33:46 | Stdout: u'' | 11:17 |
| panda|ruck | 2019-02-28 01:33:46 | Stderr: u'Object "route add 0.0.0.0/0 via 10.0.0.1 dev br-ex" is unknown, try "ip help".\n | 11:17 |
| ykarel | panda|ruck, i think there is a bug for it | 11:17 |
| ykarel | it used to happen some time | 11:17 |
| panda|ruck | ykarel: ok, not recent though | 11:17 |
| ykarel | so some sort of race, iirc Tengu quiquell worked on it ^^ | 11:18 |
| quiquell | ykarel: yep... I fix stuff but not the race condition, they say they know about it | 11:19 |
| quiquell | ykarel, panda|ruck: They never check if the bridge is up before adding routes | 11:19 |
| marios | folks panda|ruck will be right back with us he is having an existential crisis needs a minute | 11:20 |
| panda|ruck | ... it .. it cannot be ... | 11:21 |
| panda|ruck | ba ba ba | 11:21 |
| panda|ruck | ba ba ba ba ba | 11:21 |
| marios | panda|ruck: you're a progam | 11:21 |
| marios | program even :/ | 11:21 |
| marios | but also a progam! | 11:21 |
| panda|ruck | I'm always in favour of gam | 11:21 |
| marios | yah don't be gamist folks not cool | 11:22 |
| ykarel | quiquell, ack, panda|ruck so for reference:-https://bugs.launchpad.net/tripleo/+bug/1814250 | 11:22 |
| openstack | Launchpad bug 1814250 in tripleo "races condition at os-net-config in overcloud deploy OVB" [High,Triaged] - Assigned to Quique Llorente (quiquell) | 11:22 |
| ykarel | quiquell, but as per Dan's comment it should be fixed by your patch | 11:22 |
| marios | panda|ruck: so wdyt about the call then? we need to move? it does say 'all hands' i'm guessing weshay might be there at least? | 11:23 |
| Tengu | ? | 11:23 |
| Tengu | I work on things? | 11:23 |
| panda|ruck | marios: as far as I remember, most of the time weshay remembers us that the call is recorded, and we can skip the conflicting meeting | 11:24 |
| panda|ruck | Tengu: no you don't | 11:24 |
| panda|ruck | Tengu: you don't exist | 11:24 |
| panda|ruck | Tengu: you're a bot | 11:24 |
| Tengu | panda|ruck: of course I don't, I'm forked in the background :D | 11:24 |
| marios | we should have irc captcha | 11:25 |
| marios | that won't be annoying at all | 11:25 |
| Tengu | :] | 11:25 |
| panda|ruck | marios: ok for me only if you need to do it for every line you write | 11:28 |
| panda|ruck | so pasting 10 lines will require 10 captcha | 11:28 |
| marios | haha imagine the tripleo weekly | 11:28 |
| panda|ruck | lol | 11:28 |
| marios | "how to destroy your laptop in 1 irc meeting or less" | 11:29 |
| bogdando | panda|ruck: illustrated the pipelines proposal with real examples http://lists.openstack.org/pipermail/openstack-discuss/2019-February/003330.html | 11:30 |
| bogdando | weshay: ^^ | 11:30 |
| bogdando | marios: ^^ | 11:30 |
| marios | thanks bogdando i saw the reviews but saw you were updating them this morning will start checking them | 11:31 |
| marios | panda|ruck: wondering if we want to track as storyless task | 11:31 |
| bogdando | marios: yes, it's ready for testing/reviewing. thanks | 11:31 |
| panda|ruck | ykarel: quiquell's fix is only for the rules part, not for the "object unknown" error | 11:32 |
| quiquell | panda|ruck: what fix ? at os-net-config ? | 11:33 |
| ykarel | panda|ruck, yup, as per Dan's comment in the bug, quiquell patch is the fix, so looks like there was some confusion, good to update the bug with new logs | 11:34 |
| bogdando | that's interesting, it gives even a more prominent feedback for the base level checks, than it normally does | 11:34 |
| bogdando | see, a 1h after the last update I have some results already | 11:35 |
| panda|ruck | ykarel: quiquell describes two problems in that bug. He proposed the fix for one but not for the other. Dan says the patch fixes one of the problem, not the general problem | 11:35 |
| quiquell | ykarel: panda|ruck my fix is only to correctly adding the rules but the race condition is still there | 11:36 |
| panda|ruck | quiquell: yes | 11:36 |
| panda|ruck | yes | 11:36 |
| panda|ruck | hundred times yes. | 11:36 |
| quiquell | yep discover the rules one so I fixed it | 11:36 |
| ykarel | yes | 11:36 |
| quiquell | but race condition involves big refactor of that part | 11:36 |
| quiquell | is like thousand of code lines there | 11:36 |
| panda|ruck | also, I don't think it's a problem with the br-ex | 11:38 |
| panda|ruck | if br-ex is not there, the error message is "Cannot find device" | 11:38 |
| panda|ruck | here it's like the command is not recognized | 11:38 |
| quiquell | panda|ruck: well they confirmed that checking bridge was not there | 11:39 |
| panda|ruck | quiquell: ykarel yeah, it seems like we are passing the rest of the argument as a single block | 11:39 |
| panda|ruck | ip 'route add x via y dev z' | 11:39 |
| quiquell | panda|ruck: could be so silly too :-) | 11:39 |
| panda|ruck | with quotes | 11:39 |
| panda|ruck | quiquell: I can reproduce that error | 11:40 |
| panda|ruck | quiquell: with that command line | 11:40 |
| quiquell | panda|ruck: but then why is not failing always man ? | 11:40 |
| quiquell | panda|ruck: if you are right if have to fail always | 11:40 |
| panda|ruck | quiquell: when was the last time an error made sense ? | 11:41 |
| *** d0ugal has quit IRC | 11:41 | |
| *** d0ugal has joined #oooq | 11:41 | |
| quiquell | panda|ruck: well, when it's a feature :-) | 11:43 |
| marios | quiquell: o/ can you check https://review.rdoproject.org/r/#/c/19026/1/playbooks/tripleo-ci-periodic-base/containers-push-registry-login.yaml@6 do you mean, i shouldn't even bother for py3 there? | 11:53 |
| marios | quiquell: but then we have a problem ? | 11:53 |
| marios | quiquell: or i misunderstand what you meant | 11:53 |
| quiquell | marios: https://github.com/openstack-infra/zuul/blob/62e0c131908298a36689b045638d04de35ebaac7/zuul/executor/server.py#L1633 | 11:54 |
| marios | quiquell: updated with the base job as you suggested just now | 11:54 |
| quiquell | marios: they harcode ansible_python_interpreter before running the playbooks | 11:54 |
| quiquell | marios: so everything that runs directly from zuul-executor is python2 | 11:54 |
| marios | quiquell: but that also applies to the playbooks? | 11:55 |
| quiquell | marios: if we want to use python3 we need run nested ansible-playbook | 11:55 |
| quiquell | marios: as we doo at toci_gate P | 11:55 |
| marios | quiquell: so we have a problem with 636160 | 11:55 |
| quiquell | marios: but this is out of toci_gate | 11:55 |
| marios | quiquell: https://review.openstack.org/#/c/636160/ i mean | 11:56 |
| quiquell | marios: it's using virtualenv_python | 11:58 |
| quiquell | marios: so it override to virtualenv3 that is python3 so we are good | 11:58 |
| quiquell | marios: problem is using ansible modules | 11:58 |
| marios | quiquell: ah right it sets up venv | 11:58 |
| quiquell | marios: you cannot specify python version at docker login | 11:58 |
| marios | quiquell: ok gonna update its simpler just python-docker... | 11:58 |
| quiquell | marios: but let's test that | 11:59 |
| quiquell | marios: let's see if it fails at fedora28 with python3 | 11:59 |
| marios | k | 11:59 |
| quiquell | maybe I am missing something | 11:59 |
| panda|ruck | quiquell: AH! it is indeed happpening everytime | 12:04 |
| panda|ruck | quiquell: but since it's not fatal, the job passes anyway | 12:04 |
| *** amoralej is now known as amoralej|lunch | 12:05 | |
| quiquell | panda|ruck: cool so we did have like three bug there | 12:06 |
| quiquell | panda|ruck: the real one the one you discover, the rules and the race condition :-) | 12:06 |
| panda|ruck | quiquell: yes, currenlty the job I'm investigating fails to get IPs, so it's probably RD O cloud failure | 12:07 |
| panda|ruck | ykarel: have you seen this error ? 2019-02-28 01:33:47 | [2019/02/28 01:31:01 AM] [ERROR] stdout: ERROR : [/etc/sysconfig/network-scripts/ifup-eth] Error, some other host (BE:E5:4F:B9:21:B0) already uses address 172.18.0.79 | 12:08 |
| panda|ruck | ykarel: you're my personal bugs.launchpad.org/tripleo "advanced search" | 12:09 |
| panda|ruck | (I never find anything there ... ) | 12:09 |
| ykarel | panda|ruck, yes :) | 12:10 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp- (2 more messages) | 12:10 |
| ykarel | panda|ruck, so sshnaidm weshay too faced that too | 12:12 |
| ykarel | that ip already used | 12:12 |
| panda|ruck | the job also fails in determining ip on all interfaces | 12:13 |
| panda|ruck | not sure if it's a consequence | 12:13 |
| panda|ruck | sshnaidm: is there a bug for the ip duplication ? | 12:18 |
| panda|ruck | sshnaidm: like in https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/0398d7f/logs/undercloud/home/zuul/overcloud_deploy.log.txt.gz#_2019-02-28_01_33_47 | 12:18 |
| panda|ruck | (look for "already uses") | 12:19 |
| sshnaidm | panda|ruck, I didn't open such one | 12:21 |
| panda|ruck | sshnaidm: ok I'll open it then | 12:21 |
| chandankumar | kopecmartin: can we move it to done https://tree.taiga.io/project/tripleo-ci-board/us/658?milestone=220350 ? | 12:22 |
| panda|ruck | opened https://bugs.launchpad.net/tripleo/+bug/1818060 | 12:25 |
| openstack | Launchpad bug 1818060 in tripleo "Nodes periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master fail to get usable IPs though os-net-config with Error, some other host (BE:E5:4F:B9:21:B0) already uses address" [Critical,Triaged] - Assigned to Gabriele Cerami (gcerami) | 12:25 |
| *** ratailor has quit IRC | 12:28 | |
| quiquell | sshnaidm: Do you happend to know where is the moment where we generate keys for the libvirt node ? | 12:30 |
| quiquell | sshnaidm: I don't see the moment where we inject undercloud_key | 12:33 |
| chandankumar | arxcruz: thanks for updating design on cards :-) | 12:33 |
| quiquell | panda|ruck: maybe you know where | 12:33 |
| *** ccamacho has quit IRC | 12:38 | |
| *** jpena is now known as jpena|lunch | 12:41 | |
| panda|ruck | quiquell: not off-hand | 12:41 |
| *** saneax has joined #oooq | 12:43 | |
| *** panda|ruck is now known as panda|ruck|lunch | 12:44 | |
| weshay | rfolco|rover panda|ruck|lunch sshnaidm is sova capturing introspection errors? | 12:44 |
| weshay | http://dashboard-ci.tripleo.org/d/cEEjGFFmz/cockpit?orgId=1&panelId=175&fullscreen | 12:50 |
| quiquell | weshay: o/ do you know where do we inject undercloud_key at libvirt ? | 12:50 |
| weshay | ya. | 12:50 |
| weshay | what are you seeing? | 12:50 |
| weshay | quiquell you looking at the bm jobs | 12:51 |
| quiquell | weshay: Yep, can ssh to the undercloud hardware but not to the libvirt there | 12:51 |
| quiquell | weshay: Looking at roles I don't see where do we inject id_rsa_undercloud key to the libvirt node ( I think we don't) | 12:52 |
| weshay | quiquell to the undercloud guest | 12:52 |
| weshay | quiquell you have not given me context yet | 12:52 |
| weshay | is something failing? | 12:52 |
| quiquell | https://sf.hosted.upshift.rdu2.redhat.com/logs/49/163849/37/check/periodic-tripleo-ci-centos-7-baremetal-3ctlr_1comp-featureset001-master/5c39841/job-output.txt.gz#_2019-02-28_11_36_15_145697 | 12:53 |
| quiquell | Was looking at it to try to debug and understand it | 12:53 |
| weshay | quiquell 10 bucks says it's a user problem :) | 12:53 |
| weshay | meaning we're using the wrong users | 12:54 |
| quiquell | weshay: user or key | 12:54 |
| weshay | quiquell ya.. rlandy put in some changes | 12:54 |
| quiquell | weshay: i don't see key injected in the image | 12:54 |
| weshay | that added the right user to the virthost inventory | 12:54 |
| weshay | however.. when going to the undercloud | 12:54 |
| quiquell | weshay: I have try manually https://sf.hosted.upshift.rdu2.redhat.com/logs/49/163849/37/check/periodic-tripleo-ci-centos-7-baremetal-3ctlr_1comp-featureset001-master/5c39841/logs/quickstart_files/ssh.config.ansible.txt.gz | 12:54 |
| weshay | those settings are lost | 12:54 |
| weshay | quiquell the additions she made.. needs to be made in a environment file | 12:54 |
| weshay | for bm | 12:54 |
| weshay | this is not a key issue | 12:55 |
| quiquell | hummm | 12:55 |
| weshay | quiquell https://github.com/openstack-infra/tripleo-ci/blob/master/toci-quickstart/config/testenv/multinode.yml#L2-L4 | 12:56 |
| weshay | you need the equiv for your job | 12:56 |
| weshay | quiquell I'll bet that ssh connection that fails is attempted w/ stack | 12:56 |
| quiquell | weshay: le me try with stack | 12:57 |
| weshay | quiquell no.. | 12:57 |
| weshay | no | 12:57 |
| weshay | no | 12:57 |
| weshay | stack is not correct | 12:57 |
| quiquell | weshay: do my manual test make any sense ? | 12:57 |
| quiquell | weshay: I am in the read hardware trying | 12:58 |
| weshay | tmate me bro | 12:58 |
| quiquell | ack | 12:58 |
| weshay | tase me bro | 12:58 |
| *** trown|outtypewww is now known as trown | 12:58 | |
| weshay | https://www.youtube.com/watch?v=QkkLUP-gm4Q | 12:58 |
| quiquell | weshay: you in ? | 12:59 |
| kopecmartin | chandankumar, done | 13:03 |
| chandankumar | kopecmartin: thanks! | 13:03 |
| *** ccamacho has joined #oooq | 13:06 | |
| rfolco|rover | weshay, will look at the signature in a bit | 13:09 |
| zbr | marios: added comment on https://review.openstack.org/#/c/638652/13/roles/tripleo-repos/tasks/main.yml -- if you bother to redo it. i didn't downvote. | 13:19 |
| marios | zbr: replied thanks. i mean agree but not on that review | 13:21 |
| marios | zbr: there is existing block of bash. i'm adding one line into it | 13:21 |
| sshnaidm | quiquell, did you find? | 13:24 |
| *** holser_ has quit IRC | 13:29 | |
| *** holser_ has joined #oooq | 13:30 | |
| *** panda|ruck|lunch is now known as panda|ruck | 13:30 | |
| quiquell | sshnaidm: yep | 13:34 |
| quiquell | sshnaidm: thanks anyways | 13:34 |
| *** rlandy has joined #oooq | 13:35 | |
| *** amoralej|lunch is now known as amoralej | 13:36 | |
| quiquell | rlandy: o/ have being debugging a little the current issue at BM | 13:37 |
| quiquell | rlandy: going for lunch now though | 13:37 |
| *** quiquell is now known as quiquell|lunch | 13:38 | |
| rlandy | quiquell: hey - which current issue?BM has no shortage :) | 13:38 |
| rlandy | enoy lunch | 13:38 |
| rlandy | enjoy | 13:38 |
| quiquell|lunch | rlandy: looks like it cannot ssh from from host to guest | 13:38 |
| quiquell|lunch | rlandy: but user zuul and authorized_key are ok inside the libvirt | 13:38 |
| rlandy | quiquell|lunch: ack - that is where I fell asleep last night and gave up | 13:39 |
| quiquell|lunch | rlandy: so maybe permissions of that | 13:39 |
| rlandy | quiquell|lunch: let's talk after your lunch | 13:39 |
| quiquell|lunch | sure | 13:39 |
| * rlandy wants quiquell|lunch to eat before long meeting | 13:39 | |
| marios | quiquell|lunch: on my rdo tenant is that centos-7-rdo-cloud-0000000000 from reproducer ... looks like (upstream cloudinit centos 7 image) | 13:40 |
| marios | quiquell|lunch: cos i just launched a centos instance and that also appeared (running reproducer in a nother box in background) so was super confusing but must be from the reproducer | 13:40 |
| weshay | whayutin•RDO-CI/TRIPLEO-QUICKSTART/review.rdoproject.org-config ᐅ openstack server list | grep -i error | wc -l review/ronelle_landy/dlrn-role-modify✔ thinkdoe ⌚ 6:07:00 | 13:41 |
| weshay | 1 | 13:41 |
| weshay | panda|ruck rfolco|rover ^ | 13:41 |
| marios | rlandy: you seen issue with bindep before? also i think we have chicken/egg with openstack client cc weshay added note on https://tree.taiga.io/project/tripleo-ci-board/task/765 issues 4 and 5 | 13:42 |
| rfolco|rover | weshay, not sure what you mean | 13:43 |
| marios | otherwise \o/ looks like it passed i mean literally just now localhost : ok=52 changed=11 unreachable=0 failed=0 | 13:43 |
| marios | weshay: rlandy ^ | 13:43 |
| marios | on an rdo cloud vm wget reproducer, sthing sthing, profit ! ^ | 13:43 |
| weshay | nice | 13:43 |
| * weshay looks | 13:43 | |
| *** jpena|lunch is now known as jpena | 13:43 | |
| rfolco|rover | panda|ruck, is this patch so unlucky for rdo-jobs ? https://review.openstack.org/#/c/636722 | 13:44 |
| rfolco|rover | jobs ran ok in other patches, but it always get retry_limit error on this one | 13:45 |
| weshay | panda|ruck rfolco|rover we clearly need to kill servers in error via the cleanupscript | 13:45 |
| panda|ruck | rfolco|rover: it's not about luck | 13:45 |
| weshay | http://dashboard-ci.tripleo.org/d/cEEjGFFmz/cockpit?orgId=1&panelId=175&fullscreen | 13:46 |
| rlandy | marios:looking | 13:46 |
| weshay | that tenant is clean now | 13:46 |
| weshay | it will probably get dirty again | 13:46 |
| weshay | panda|ruck rfolco|rover please use the cockpit :) | 13:47 |
| weshay | http://dashboard-ci.tripleo.org/d/cEEjGFFmz/cockpit?orgId=1&panelId=207&fullscreen | 13:48 |
| kopecmartin | chandankumar, where do we want to keep tasks for running os_tempest via `ansible-playbook` command? check my comment here https://tree.taiga.io/project/tripleo-ci-board/task/491 | 13:48 |
| weshay | marios the image check.. I tried to fix that w/ retries and failed | 13:48 |
| weshay | marios but getting that working w/ retries properly should fix that | 13:49 |
| weshay | rerunning usually just works | 13:49 |
| marios | weshay: well here the problem is there is no openstack client at all. and it isn't so much about the image check, but the image imports which are required | 13:49 |
| marios | weshay: like bash: openstack: command not found | 13:49 |
| chandankumar | kopecmartin: let's keep it in the doc user story itself and rename it to Improve user experience for mvp with docs | 13:50 |
| weshay | ok.. so maybe we do need to add python-openstack to requirements | 13:50 |
| chandankumar | kopecmartin: as all are linked with that | 13:50 |
| weshay | quiquell|lunch ^ | 13:50 |
| marios | weshay: it just completed (I think ? \o./ ? at http://pastebin.test.redhat.com/726851 but if you scroll to bottom there is still no openstack :D ) | 13:51 |
| marios | quiquell|lunch: ^ | 13:51 |
| weshay | marios you are using the repro bash script right? | 13:51 |
| sshnaidm | zbr, replied https://review.openstack.org/#/c/639972/ | 13:51 |
| sshnaidm | weshay, ^^ | 13:51 |
| marios | weshay: yeah today i did wget http://logs.openstack.org/98/604298/251/check/tripleo-ci-centos-7-scenario001-standalone/6514d7e/logs/reproducer-zuul-based-quickstart.tar & then ./reproducer-zuul-based-quickstart.sh --workspace /home/marios/WORKSPACE --force-post-failure | 13:52 |
| *** quiquell|lunch is now known as quiquell | 13:52 | |
| marios | weshay: master gate check standalone scn 1 | 13:52 |
| marios | weshay: well, sthin sthing (bindep & i think we need to move keys instructions too rlandy i'll post somethign ina sec | 13:52 |
| marios | like move it from footnote into the setup instructions | 13:53 |
| rlandy | ack | 13:53 |
| marios | both the -m pem bit and also the make sure you upload your keys you just generated to rdo cloud and upstream gerrit | 13:53 |
| marios | cos otherwise 60 retries will fail :D | 13:53 |
| quiquell | marios: so job has finish succesfully and you are at your RDO tenant | 13:53 |
| quiquell | marios: not having openstack there can be anything | 13:53 |
| marios | quiquell: y8eah but we needs it for image import into your tenant | 13:54 |
| weshay | sshnaidm there is a bindep file for the repro | 13:54 |
| marios | quiquell: so its a requirement for running it | 13:54 |
| *** rfolco|rover is now known as rfolco|afk | 13:54 | |
| marios | quiquell: like for your setup steps | 13:54 |
| weshay | sshnaidm is there a reason not to add it to that one? | 13:54 |
| quiquell | marios: hummm what image import ? | 13:54 |
| marios | openstack --os-cloud rdo-cloud image set --accept 6a6d23d7-65e7-43ea-9307-71b2e17d2ead | 13:54 |
| marios | quiquell: do we still need to do the image import | 13:54 |
| quiquell | marios: we don't need that | 13:54 |
| marios | quiquell: its in the instructions | 13:54 |
| marios | quiquell: ok cool, then weshay openstack is not a problem | 13:55 |
| marios | quiquell: if they are already available/public then fine. will include that in the update in the doc | 13:55 |
| quiquell | marios: we are using public openstack now | 13:55 |
| marios | quiquell: see setup steps in http://logs.openstack.org/98/604298/251/check/tripleo-ci-centos-7-scenario001-standalone/6514d7e/logs/README-reproducer-zuul-based-quickstart.html | 13:55 |
| marios | quiquell: that's what i'm talking about | 13:55 |
| rfolco|afk | folks, will miss the scrum, out for a bit | 13:55 |
| sshnaidm | weshay, oh, where is it? | 13:55 |
| sshnaidm | weshay, I thought we have one for all | 13:55 |
| quiquell | marios: would be nice to put some assert in the role to check if the keys are passwordless and done with -m PEM | 13:56 |
| marios | rlandy: weshay then we don't need "openstack" in requirements. if we don't need to do the image import any more | 13:56 |
| marios | quiquell: ack but in the very least lets make it visible right now is in the footnote | 13:56 |
| marios | quiquell: also automate the gerrit/keys check they were uploaded correctly too | 13:56 |
| marios | quiquell: so it doesnt timeout in the FAILED - RETRYING: Wait for zuul tenant (1 retries left). | 13:57 |
| marios | like for me today | 13:57 |
| marios | just cos i forgot | 13:57 |
| quiquell | fail fast more or les | 13:57 |
| quiquell | or fail fast asap | 13:57 |
| weshay | sshnaidm ansible-role-repro | 13:57 |
| sshnaidm | zbr, that what I'd expect in reviews ^^ | 13:58 |
| quiquell | marios: yep Import the nodepool images to your tenant: not needed | 13:58 |
| marios | quiquell: k will remove too | 13:58 |
| rlandy | quiquell: rfolco|afk needed to accept the images | 13:59 |
| quiquell | marios: we can add the "finger" stuff to monitoring the launche djob | 13:59 |
| rlandy | I think that is why weshay put it in the instructions | 13:59 |
| rlandy | marios shouls have had images already | 13:59 |
| quiquell | rlandy: humm does not make sense | 14:00 |
| quiquell | rlandy: they are public | 14:00 |
| quiquell | or they suppose to be | 14:00 |
| rlandy | marios: I don't think so | 14:00 |
| marios | https://tree.taiga.io/project/tripleo-ci-board/task/765 rlandy updated issue 5 there cc weshay quiquell | 14:00 |
| rlandy | sshnaidm shared them with the team | 14:00 |
| weshay | scrum | 14:01 |
| sshnaidm | rlandy, shared what? | 14:01 |
| zbr | sshnaidm: sure, i was in bj meeting. we can discuss about what we should put or not in bindep.txt files. | 14:01 |
| rlandy | we had a task to make them public - laat time I looked, it was parked | 14:01 |
| panda|ruck | quiquell: rlandy marios meeting | 14:01 |
| weshay | join please | 14:01 |
| panda|ruck | zbr: ^ | 14:01 |
| marios | oh yeah... | 14:01 |
| rlandy | sshnaidm: the images for reproducer | 14:01 |
| zbr | marios: kick https://review.openstack.org/#/c/639739/ if you can ;) | 14:03 |
| chandankumar | weshay: kopecmartin arxcruz can we set a meeting tomororw for tempest for syncup? | 14:05 |
| quiquell | Cannot connect to the da... meeting | 14:05 |
| kopecmartin | chandankumar, sure | 14:05 |
| arxcruz | chandankumar: sure | 14:05 |
| sshnaidm | hmm To watch the video, you need Adobe Flash Player 11.1 or higher | 14:06 |
| kopecmartin | chandankumar, pick a date, I'm more or less free the all day | 14:06 |
| chandankumar | sending an invite | 14:06 |
| quiquell | arggg | 14:06 |
| panda|ruck | weshay: where do you want to add that comment for the cleanup ? as a message for the user in the output ? | 14:07 |
| weshay | panda|ruck I don't want a comment... I want the script to kill any server in error | 14:07 |
| panda|ruck | weshay: oh. | 14:07 |
| panda|ruck | Then it's a completely different task. OK | 14:08 |
| weshay | after the stacks are nuked, and the retries.. so line 295? | 14:08 |
| weshay | panda|ruck ? | 14:08 |
| zbr | as long we are inside the red circle we are safe :) | 14:10 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp- (2 more messages) | 14:10 |
| quiquell | rlandy, marios: so rfolco|afk did have to accept the public image ? | 14:12 |
| quiquell | maybe image is no longer public after all the RDO migrations and all | 14:13 |
| rlandy | quiquell: yep he had to accept the image | 14:13 |
| rlandy | and I think it had to be shared with him | 14:13 |
| quiquell | rlandy: it was public kforde did it | 14:13 |
| quiquell | rlandy: what was the name of the image ? | 14:14 |
| *** vinaykns has joined #oooq | 14:14 | |
| quiquell | accept solution does not scale we have to make sure that they are public | 14:14 |
| quiquell | rlandy: want to sync ? | 14:14 |
| quiquell | weshay: can I use the tmate to look at it ? | 14:15 |
| *** ykarel has quit IRC | 14:15 | |
| rlandy | agreed - it doesn't scale | 14:15 |
| weshay | quiquell sec.. let me get that command | 14:15 |
| *** ykarel has joined #oooq | 14:15 | |
| quiquell | ack | 14:15 |
| * weshay want's to boot another instance of the vm | 14:15 | |
| quiquell | rlandy: send priv with tmate | 14:16 |
| rlandy | quiquell; yep on the tmate | 14:19 |
| panda|ruck | weshay: https://review.rdoproject.org/r/19048 I don't know if we need to delete port associated with the errored servers. | 14:27 |
| *** skramaja has quit IRC | 14:27 | |
| panda|ruck | weshay: still WIP | 14:27 |
| arxcruz | weshay: i need to go to a lawyer in a few minutes to talk about the problem with my floor, i won't be able to be on the meeting.. | 14:29 |
| bogdando | few more updates for the CI PiPeLiNeS | 14:30 |
| bogdando | http://lists.openstack.org/pipermail/openstack-discuss/2019-February/003336.html | 14:30 |
| marios | quiquell: well i did it previously but i don't know if you need it if its the first time youre tying it | 14:31 |
| quiquell | marios: you shouldn't if images are public | 14:32 |
| quiquell | rlandy: let's launch the job and test that again | 14:34 |
| weshay | quiquell rlandy ideally if we can trigger w/ the reproducer.. we can hold the nodepool node | 14:36 |
| weshay | and get the full picture on this as well | 14:37 |
| quiquell | weshay: there is somethig there if you have the vpn | 14:37 |
| quiquell | weshay: you can copy the job structure to local gerrit and try it | 14:38 |
| quiquell | weshay: no change at reproducer since it's just using a normal centos image | 14:38 |
| quiquell | or we add another connectin to private gerrit | 14:38 |
| quiquell | going to try that | 14:39 |
| quiquell | rlandy, weshay: after run the job there is no ".ssh" at qcow undercloud image | 14:47 |
| quiquell | so something is missing at image preparation or the like | 14:47 |
| quiquell | and only user there is zuul | 14:48 |
| weshay | quiquell I'm 99.9% sure the code to get the keys on the virthost and undercloud is there man | 14:49 |
| weshay | this is not an untested work flow | 14:49 |
| quiquell | weshay: I see key install at generated at host but not at guest looking at job, but sure I am missing stuff | 14:51 |
| quiquell | weshay: qcow2 should have them ? | 14:51 |
| quiquell | rlandy, weshay: Inject undercloud ssh public key to appliance <-- skipped | 14:54 |
| quiquell | could be related to cleanup "- when: undercloud_vol_check is failed" | 14:56 |
| weshay | log? | 14:57 |
| quiquell | weshay: https://sf.hosted.upshift.rdu2.redhat.com/logs/49/163849/37/check/periodic-tripleo-ci-centos-7-baremetal-3ctlr_1comp-featureset001-master/e71e8f8/job-output.txt.gz#_2019-02-28_14_42_43_949974 | 15:00 |
| quiquell | virt-customize inject the keys in the qcow | 15:00 |
| quiquell | but is skipped at all the block, I think this is another issue of cleanup | 15:00 |
| quiquell | well don't know really | 15:00 |
| chandankumar | weshay: quiquell arxcruz kopecmartin sshnaidm i think it is good to go now https://review.openstack.org/#/c/639310/ | 15:01 |
| quiquell | chandankumar: looks good now | 15:02 |
| quiquell | +2 | 15:02 |
| panda|ruck | ouch | 15:03 |
| marios | blujeans slow here... | 15:04 |
| weshay | rlandy | 15:05 |
| chandankumar | quiquell: we are going to get rid of root, and few other stuff but we need to make changes such a way it will work for other distros and user preferences! | 15:05 |
| panda|ruck | weshay: still failing after other two attempts https://ci.centos.org/view/rdo/view/promotion-pipeline/job/rdo_trunk-promote-rocky-current-tripleo/ | 15:07 |
| weshay | panda|ruck I think there is a real issue | 15:13 |
| *** jfrancoa has quit IRC | 15:17 | |
| panda|ruck | marios: can you add a brief description here ? https://tree.taiga.io/project/tripleo-ci-board/us/813 | 15:25 |
| panda|ruck | marios: so in three weeks we remember what was this about :)D | 15:26 |
| marios | panda|ruck: ack but not right now | 15:27 |
| panda|ruck | marios: sure, not urgent. | 15:27 |
| panda|ruck | marios: what about now ? | 15:28 |
| panda|ruck | :) | 15:28 |
| marios | panda|ruck: no in a bit | 15:28 |
| *** saneax has quit IRC | 15:30 | |
| *** jfrancoa has joined #oooq | 15:32 | |
| *** ykarel is now known as ykarel|away | 15:58 | |
| marios | rlandy: quiquell remote: https://review.openstack.org/640078 Fixup zuul reproducer readme doc - move keys note remove images | 16:00 |
| panda|ruck | weshay: quiquell are we sure we want to proceed with https://tree.taiga.io/project/tripleo-ci-board/us/587?milestone=220350 ? Seems to be yet in the investigation phase, and I'm not sure we'll finish it this sprint. | 16:06 |
| quiquell | panda|ruck: Maybe we can just put in place a poc of both this sprint | 16:08 |
| panda|ruck | quiquell: Yes we would narrow the scope on this sprint and change the DOD to "Create a POC to see which solution is better" | 16:09 |
| *** rfolco|afk is now known as rfolco|rover | 16:10 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container, tripleo-ci-fedora-28-standalone @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp- (2 more messages) | 16:10 |
| quiquell | panda|ruck: will do that at least I think we discard using gerrit and store state ourself | 16:10 |
| quiquell | panda|ruck: is dlrn to manual poll or URLTrigger looking a RDO zuul | 16:11 |
| *** udesale has quit IRC | 16:13 | |
| panda|ruck | quiquell: you tell me, if you try to bring this to completion on this US with the 8 days left, you may be forced to rush solutions, or overwork. So reducing the DOD may be an option | 16:14 |
| marios | rlandy: whats the title of the email you sent plase ? me searching inbox | 16:14 |
| marios | rlfor the vote | 16:14 |
| marios | rlandy: ^ | 16:14 |
| quiquell | panda|ruck: will rewrite the uster story and let see if it's more realistic | 16:15 |
| rlandy | marios: 9 of 24,952 | 16:19 |
| rlandy |  | 16:19 |
| rlandy |  | 16:19 |
| rlandy |  | 16:19 |
| rlandy |  | 16:19 |
| rlandy |  | 16:19 |
| rlandy | Proposing Gabriele Cerami (panda) and Felix Enrique Llorente Pastora (quiquell) as core on review.rdoproject.org repos config and rdo-jobs | 16:19 |
| marios | rlandy: i don't see the subject there but maybe i'm not in a mailing list which list please? | 16:19 |
| rlandy | marios; when to dev on rdolist | 16:20 |
| rlandy | will forward | 16:20 |
| marios | thanks rlandy | 16:20 |
| quiquell | dropping now read you tomorrow | 16:20 |
| *** quiquell is now known as quiquell|off | 16:20 | |
| rlandy | quiquell; wait | 16:21 |
| panda|ruck | I'm not sure non-core can vote for a core proposal | 16:21 |
| quiquell|off | yep ? | 16:21 |
| rlandy | quiquell: what's the last on the debug | 16:21 |
| quiquell|off | I am semioff | 16:21 |
| quiquell|off | rlandy: so undercloud.qcow has zuul user and pub key there | 16:21 |
| marios | have a good one quiquell|off | 16:21 |
| quiquell|off | rlandy: but ssh is not possible | 16:21 |
| marios | remember tomorrow is friday \o/ | 16:21 |
| rlandy | quiquell: charming :) | 16:22 |
| quiquell|off | rlandy: don't know why | 16:22 |
| quiquell|off | rlandy: yep :-/ but after that I think work will do just continue hacking stuff | 16:22 |
| quiquell|off | rlandy: so that's it :-/ | 16:22 |
| chandankumar | rlandy: kopecmartin marios https://review.openstack.org/#/c/639310/ when free thanks! | 16:22 |
| quiquell|off | rlandy: maybe authorized_keys permissions or the like | 16:22 |
| rlandy | quiquell|off; ok - cool - will leave you notes | 16:22 |
| rlandy | if I find anything | 16:22 |
| rlandy | thanks for looking into it | 16:23 |
| quiquell|off | rlandy: cool will try to debug in the morning and give you insight later | 16:23 |
| rlandy | awesome - have a good night | 16:23 |
| quiquell|off | no problem team work is it | 16:23 |
| *** quiquell|off is now known as quique | 16:23 | |
| *** quique is now known as quiquell|off | 16:23 | |
| quiquell|off | re-off | 16:23 |
| marios | chandankumar: tomorrow /me off too | 16:30 |
| chandankumar | marios: no problem sir, see ya tomorrow :-) | 16:31 |
| marios | chandankumar: have a good one sir ;) | 16:32 |
| marios | pretty late in pune no? | 16:32 |
| chandankumar | na still 10:00 P.M. | 16:32 |
| marios | oh right sorry | 16:33 |
| marios | o_O | 16:33 |
| marios | rlandy: so i posted that docs thing but -2 pending discussion .. https://review.openstack.org/640078 ( i mean for the images) | 16:34 |
| *** chandankumar is now known as raukadah | 16:34 | |
| rlandy | marios; yeah - unclear yet what is going on there | 16:36 |
| rlandy | rfolco|rover was unable to reach them which is why we added that | 16:37 |
| rlandy | but it added the other complications | 16:37 |
| marios | rlandy: av | 16:37 |
| marios | rlandy: ack even sorry | 16:37 |
| *** hamzy has quit IRC | 16:40 | |
| *** dtantsur is now known as dtantsur|afk | 16:55 | |
| *** bogdando has quit IRC | 17:08 | |
| *** gkadam has quit IRC | 17:08 | |
| *** ykarel|away has quit IRC | 17:09 | |
| *** kopecmartin is now known as kopecmartin|off | 17:17 | |
| *** ccamacho has quit IRC | 17:22 | |
| panda|ruck | weshay: investigated gate failures on linters, it's ok, it's a patch that took some time to be +1W and now it needs some rebasing. | 17:26 |
| panda|ruck | weshay: at least for 4 of the 9 failures we have. | 17:26 |
| weshay | panda|ruck ya.. zbr's patch should fix it.. or is this a new one? | 17:27 |
| weshay | cryptopgraphy? | 17:27 |
| panda|ruck | weshay: no they failed on https://review.openstack.org/#/c/576471/ | 17:27 |
| *** panda|ruck is now known as panda|ruck|off | 17:42 | |
| zbr | this error seems of different nature, probably one dependency is too old or too new | 17:44 |
| *** holser_ has quit IRC | 17:44 | |
| *** derekh has quit IRC | 17:46 | |
| rfolco|rover | weshay, how do I debug jobs like this one ? https://ci.centos.org/job/tripleo-quickstart-promote-rocky-rdo_trunk-minimal/111/consoleFull | 17:53 |
| *** trown is now known as trown|lunch | 18:03 | |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset035, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp- (3 more messages) | 18:10 |
| *** jpena is now known as jpena|off | 18:12 | |
| *** amoralej is now known as amoralej|off | 18:12 | |
| *** hamzy has joined #oooq | 18:13 | |
| *** ykarel|away has joined #oooq | 18:16 | |
| *** jfrancoa has quit IRC | 18:19 | |
| *** ykarel|away has quit IRC | 19:01 | |
| *** jtomasek has quit IRC | 19:16 | |
| weshay | rlandy https://review.openstack.org/640172 | 19:21 |
| *** trown|lunch is now known as trown | 19:22 | |
| zbr | rfolco|rover: important question from alex https://review.openstack.org/#/c/636160/52 | 19:31 |
| *** dougbtv has quit IRC | 19:33 | |
| weshay | sshnaidm fyi.. ping if you disagree https://review.rdoproject.org/r/19055 | 19:35 |
| rfolco|rover | zbr, looking | 19:36 |
| rfolco|rover | zbr, replied | 19:42 |
| rfolco|rover | zbr, please change to pip | 19:43 |
| weshay | rfolco|rover did you have luck yet w/ ovb deploying? | 19:48 |
| weshay | rfolco|rover and how you feeling man? | 19:49 |
| weshay | you can take the day if you need it | 19:49 |
| rfolco|rover | weshay, feeling ok now, thanks. Nah, just woke up with a terrible headache. I am ok now. | 19:50 |
| rfolco|rover | weshay, ok, now I am hitting this again [rfolco@rdo-ci-fx2-02-s5 ~]$ openstack --os-cloud rdo-cloud image list | 19:50 |
| rfolco|rover | Exception raised: cannot import name image_signer | 19:50 |
| weshay | wha? | 19:50 |
| rfolco|rover | my reproducer stopped here https://paste.fedoraproject.org/paste/DmjxQe~JY~GsuZX7XHr0Yg | 19:50 |
| weshay | in the pre.yaml of a-r-repro | 19:50 |
| rfolco|rover | weshay, sorry if I missed the fix for this one | 19:51 |
| weshay | rfolco|rover can you add that to requiements.txt and see if it fixes it | 19:51 |
| weshay | hrm.. not a pip package | 19:52 |
| weshay | rfolco|rover oh.. you may need to pin python-openstackclient | 19:53 |
| weshay | to an older known good | 19:53 |
| rfolco|rover | true | 19:53 |
| weshay | rfolco|rover but python-openstackclient is not merged yet | 19:53 |
| rfolco|rover | weshay, a small improvement to key gen: ssh-keygen -m PEM -t rsa -q -N "" -f ~/.ssh/id_rsa | 19:58 |
| weshay | rfolco|rover what does that do? | 19:58 |
| rfolco|rover | no prompt | 19:58 |
| rfolco|rover | and if gerrit allowed me to setup keys from command line, could do this: | 19:59 |
| rfolco|rover | cat ~/.ssh/reproducer-key.pub | ssh -p 29418 review.openstack.org gerrit set-account --add-ssh-key - | 19:59 |
| rfolco|rover | but I got Capability modifyAccount is required to access this resource | 19:59 |
| weshay | where would you put that change? | 19:59 |
| rfolco|rover | weshay, well, this could be a -k option to the script to generate for you... | 20:01 |
| rfolco|rover | or to the docs | 20:01 |
| rfolco|rover | weshay, coz user may not want to generate a new key, only if -k is passed as arg.... well, this is just an idea | 20:04 |
| weshay | rfolco|rover are you referring to the gerrit ssh key | 20:05 |
| weshay | if so, ya.. just update the doc w/ a review | 20:05 |
| rfolco|rover | k | 20:06 |
| weshay | rlandy we're both tired :) https://review.openstack.org/#/c/640172/3/roles/create-zuul-based-reproducer/templates/launcher-env-setup-playbook.yaml.j2 | 20:09 |
| weshay | lolz | 20:09 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp- (3 more messages) | 20:10 |
| rlandy | sec | 20:10 |
| *** jtomasek has joined #oooq | 20:10 | |
| rlandy | weshay: hmmm .. "If no, do not retrieve new revisions from the origin repository" | 20:17 |
| rlandy | ok - so I guess that's right | 20:17 |
| weshay | ya.. same thing as the last patch.. just one line | 20:17 |
| weshay | rlandy that last patch took less time than marios took to write it up :) | 20:19 |
| weshay | rlandy did you guys figure out the virt key? | 20:20 |
| rlandy | weshay:haven't worked on it today - I am cleaning up the config errors in tripleo-ci-internal | 20:20 |
| rlandy | there were 170 errors | 20:21 |
| weshay | oh lord | 20:21 |
| rlandy | weshay: well there are 145 now | 20:22 |
| rlandy | it is from the all the upstream parenting | 20:22 |
| rlandy | see conversation on prodchain-infra-dfg | 20:22 |
| weshay | rlandy oh man.. is it worth fixing? | 20:22 |
| weshay | may I see? | 20:23 |
| rlandy | sure - join the party | 20:24 |
| rlandy | the current missing project work should fix a bunch | 20:25 |
| rlandy | the fedora ones are also under discussion | 20:25 |
| rlandy | weshay: ^^ | 20:25 |
| rlandy | already fixed centos nodesets | 20:25 |
| rlandy | once we clear missing projects - will be better | 20:25 |
| weshay | rlandy ok.. all I need to know is .. is that 1-2 day project or more | 20:27 |
| weshay | and does that solve upstream parenting for everyone I suppose | 20:28 |
| rlandy | weshay: it's a pain - you fix one - reveals another missing repo | 20:28 |
| rlandy | everyone and his dog the way we are going | 20:28 |
| rlandy | also - there are some complaints about base jobs | 20:29 |
| weshay | well.. at least the dogs will have a working zuul | 20:29 |
| rlandy | we can move the base tripleo-ci job to config when it's working | 20:29 |
| rlandy | dog were always my greatest concern | 20:29 |
| weshay | so 1-2 days? | 20:29 |
| rlandy | in dog years | 20:29 |
| weshay | ah come on | 20:29 |
| weshay | don't mess w/ me :))) | 20:30 |
| weshay | https://review.openstack.org/#/c/639894/ | 20:30 |
| weshay | https://review.openstack.org/#/c/639794/ | 20:30 |
| rlandy | weshay: k - this is confusing ... https://review.openstack.org/#/c/639894/1/docs/tripleo-quickstart-logs.html | 20:32 |
| rlandy | you rename the <a href='stackviz/#/testrepository.subunit' | 20:33 |
| rlandy | stackviz vs stackwiz | 20:33 |
| rlandy | but leave text | 20:33 |
| weshay | rlandy the href is right.. and it just needs stackwiz presented to the user | 20:34 |
| weshay | what would you put? | 20:35 |
| rlandy | weshay: the spelling is right? stackviz vs stackwiz | 20:35 |
| weshay | hrm | 20:35 |
| rlandy | not just the addition of the subdir | 20:35 |
| weshay | that was before my review | 20:36 |
| weshay | but will fix | 20:36 |
| rlandy | weshay; lol - it's in your review | 20:36 |
| rlandy | let's talk for 2 mins | 20:36 |
| rlandy | we both need a drink | 20:37 |
| weshay | k | 20:37 |
| rlandy | joining your blue | 20:37 |
| *** holser_ has joined #oooq | 20:38 | |
| weshay | rlandy http://logs.openstack.org/70/639670/4/check/tripleo-ci-centos-7-standalone/6a01d33/logs/stackviz/#/testrepository.subunit | 20:38 |
| weshay | stackviz/#/testrepository.subunit | 20:39 |
| *** hamzy has quit IRC | 20:39 | |
| *** hamzy has joined #oooq | 20:43 | |
| *** holser_ has quit IRC | 21:04 | |
| *** holser_ has joined #oooq | 21:18 | |
| rlandy | weshay: k - job has run | 21:41 |
| *** jtomasek has quit IRC | 21:42 | |
| weshay | rlandy https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status | 21:42 |
| weshay | ? | 21:42 |
| rlandy | redhat | 21:43 |
| weshay | rlandy don't see the job | 21:45 |
| rlandy | weshay: ran and failed | 21:45 |
| rlandy | password is not woorking | 21:45 |
| rlandy | oh - I wonder if teardown is working | 21:46 |
| *** hamzy has quit IRC | 21:47 | |
| rlandy | weshay: I don't see it clean up | 21:47 |
| rlandy | it should tear down old vm | 21:47 |
| rlandy | --skip-tags tripleo-validations,teardown-all | 21:48 |
| rlandy | it's the oldvm | 21:48 |
| rlandy | https://github.com/openstack-infra/tripleo-ci/blob/master/roles/run-test/templates/toci_quickstart.sh.j2#L20 | 21:49 |
| rlandy | weshay: ^^ | 21:49 |
| rlandy | bad, bad | 21:49 |
| rlandy | we never clean up as we did in jenkins runs | 21:49 |
| weshay | rlandy ? | 21:49 |
| * weshay gets role | 21:50 | |
| weshay | what is left? | 21:50 |
| rlandy | weshay: we need to run the teardown piece | 21:50 |
| rlandy | the old vm | 21:50 |
| rlandy | undercloud | 21:50 |
| rlandy | and networks | 21:50 |
| rlandy | and everything | 21:50 |
| weshay | rlandy oh.. run w/ --tear-down all | 21:50 |
| weshay | that's all you need | 21:50 |
| rlandy | but toci skips that | 21:50 |
| rlandy | rlandy> https://github.com/openstack-infra/tripleo-ci/blob/master/roles/run-test/templates/toci_quickstart.sh.j2#L20 | 21:51 |
| weshay | well.. | 21:51 |
| rlandy | that's the problem | 21:51 |
| weshay | rlandy define new DEFAULT_ARGS | 21:51 |
| rlandy | well a problem | 21:51 |
| weshay | that's a jinja file | 21:52 |
| rlandy | https://github.com/openstack-infra/tripleo-ci/blob/master/roles/run-test/templates/toci_quickstart.sh.j2#L15 | 21:52 |
| rlandy | weshay: you mean like {% if baremetal%} new default args ... | 21:53 |
| *** zul has quit IRC | 21:53 | |
| weshay | aye | 21:54 |
| rlandy | ok - putting in review | 21:55 |
| *** holser_ has quit IRC | 21:56 | |
| rlandy | weshay: https://review.openstack.org/639824 Add a blank baremetal_hosts file and skip_tags options | 22:09 |
| rlandy | let's try this | 22:09 |
| hubbot1 | FAILING CHECK JOBS on master: tripleo-ci-centos-7-standalone-upgrade, tripleo-ci-centos-7-scenario008-multinode-oooq-container, tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp-featureset039, tripleo-ci-centos-7-scenario012-standalone, tripleo-ci-fedora-28-standalone, tripleo-ci-centos-7-scenario010-multinode-oooq-container @ https://review.openstack.org/604298, stable/pike: tripleo-ci-centos-7-ovb-3ctlr_1comp_1supp- (3 more messages) | 22:10 |
| weshay | rlandy ya.. good idea | 22:10 |
| rlandy | k - running again | 22:10 |
| rlandy | weshay: node failures | 22:28 |
| rlandy | like yesterday at this time :( | 22:28 |
| rlandy | will try again later | 22:28 |
| *** rascasoft has quit IRC | 23:11 | |
| *** vinaykns has quit IRC | 23:47 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!