| weshay|ruck | rlandy, aye | 00:13 |
|---|---|---|
| weshay|ruck | no worries ;) | 00:13 |
| rlandy | :( gates are red -bm is going nowhere | 00:43 |
| EmilienM_PTO | rlandy: lol | 00:47 |
| EmilienM_PTO | Come on | 00:47 |
| EmilienM_PTO | I'm never that far ;) | 00:47 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 00:48 |
| rlandy | EmilienM_PTO: enjoy your PTO - you deserve it | 00:48 |
| EmilienM_PTO | Thx | 00:48 |
| *** sshnaidm_ has joined #oooq | 00:53 | |
| *** sshnaidm|afk has quit IRC | 00:55 | |
| *** sshnaidm__ has joined #oooq | 00:56 | |
| *** sshnaidm_ has quit IRC | 00:57 | |
| *** sshnaidm__ has quit IRC | 01:02 | |
| *** sshnaidm__ has joined #oooq | 01:16 | |
| weshay|ruck | rlandy, EmilienM_PTO is like obi-wan | 01:50 |
| *** vvaldez has quit IRC | 02:23 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 02:48 |
| *** rlandy has quit IRC | 02:49 | |
| *** dtrainor has quit IRC | 03:09 | |
| *** dtrainor has joined #oooq | 03:09 | |
| *** skramaja has joined #oooq | 03:19 | |
| *** ykarel|pto has joined #oooq | 04:01 | |
| *** udesale has joined #oooq | 04:06 | |
| *** ykarel|pto is now known as ykarel | 04:26 | |
| *** jaosorior has joined #oooq | 04:32 | |
| *** holser__ has joined #oooq | 04:35 | |
| ykarel | chandankumar, hi | 04:40 |
| ykarel | chandankumar, is this tempest issue known:- https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset017-master/7c1279e/undercloud/home/jenkins/tempest.log.txt.gz | 04:40 |
| ykarel | in discovert-tempest-config? | 04:40 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 04:48 |
| *** pgadiya has joined #oooq | 04:53 | |
| *** pgadiya has quit IRC | 04:53 | |
| ykarel | hmm found, https://review.openstack.org/#/c/572243/ created the issue. | 04:57 |
| ykarel | chandankumar, proposed https://review.openstack.org/#/c/576356/ | 05:25 |
| *** ratailor has joined #oooq | 05:26 | |
| *** links has joined #oooq | 05:33 | |
| *** saneax has joined #oooq | 05:34 | |
| *** sanjayu_ has joined #oooq | 05:38 | |
| *** saneax has quit IRC | 05:41 | |
| *** quiquell|off is now known as quiquell|rover | 05:44 | |
| quiquell|rover | ykarel: Good morning | 05:44 |
| ykarel | quiquell|rover, Good Morning | 05:44 |
| ykarel | quiquell|rover, created https://bugs.launchpad.net/tripleo/+bug/1777573 | 05:46 |
| openstack | Launchpad bug 1777573 in tripleo "Tempest setup(tempestconf) failing while creating role with Error:- Duplicate entry found with name Member" [Undecided,New] - Assigned to yatin (yatinkarel) | 05:46 |
| quiquell|rover | ykarel: We have this https://bugs.launchpad.net/tripleo/+bug/1777451 | 05:49 |
| openstack | Launchpad bug 1777451 in tripleo "Error: /Stage[main]/Ceph::Rgw::Keystone::Auth/Keystone_role Duplicate entry found with name Member" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 05:49 |
| ykarel | quiquell|rover, that's covering only puppet-ceph | 05:50 |
| quiquell|rover | ykarel: We have to find all the places | 05:50 |
| ykarel | quiquell|rover, yes, possibly fixing puppet-keystone keyston_role provider can fix all puppet related | 05:51 |
| quiquell|rover | ykarel: Are those tripleo ? | 05:52 |
| ykarel | quiquell|rover, tripleo? means? | 05:52 |
| quiquell|rover | ykarel: Na nevermind, coffe still kicking in | 05:54 |
| ykarel | quiquell|rover, :) | 05:54 |
| quiquell|rover | ykarel: Going to mark https://bugs.launchpad.net/tripleo/+bug/1777573 | 05:55 |
| openstack | Launchpad bug 1777573 in tripleo "Tempest setup(tempestconf) failing while creating role with Error:- Duplicate entry found with name Member" [Undecided,New] - Assigned to yatin (yatinkarel) | 05:55 |
| quiquell|rover | as duplicated of https://bugs.launchpad.net/tripleo/+bug/1777451 | 05:55 |
| openstack | Launchpad bug 1777451 in tripleo "Error: /Stage[main]/Ceph::Rgw::Keystone::Auth/Keystone_role Duplicate entry found with name Member" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 05:55 |
| ykarel | quiquell|rover, but include the info from this bug | 05:55 |
| quiquell|rover | sshnaidm__, and weshay|ruck: created it yesterday | 05:55 |
| quiquell|rover | ykarel: Let's start to add patches there, so we fix all the corners | 05:55 |
| ykarel | quiquell|rover, ack | 05:55 |
| *** dsneddon has quit IRC | 05:56 | |
| *** bogdando has joined #oooq | 05:56 | |
| *** holser__ has quit IRC | 05:57 | |
| *** dsneddon has joined #oooq | 05:58 | |
| *** udesale has quit IRC | 06:02 | |
| *** udesale has joined #oooq | 06:18 | |
| *** ykarel_ has joined #oooq | 06:33 | |
| *** ykarel has quit IRC | 06:36 | |
| *** ykarel_ is now known as ykarel | 06:36 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 06:48 |
| *** udesale has quit IRC | 07:00 | |
| *** udesale has joined #oooq | 07:00 | |
| *** tesseract has joined #oooq | 07:02 | |
| *** amoralej|off is now known as amoralej | 07:06 | |
| *** florianf has joined #oooq | 07:16 | |
| *** florianf has quit IRC | 07:16 | |
| *** florianf has joined #oooq | 07:16 | |
| *** ccamacho has joined #oooq | 07:19 | |
| *** sshnaidm__ is now known as sshnaidm | 07:25 | |
| sshnaidm | ykarel, as I understood yesterday it's not sure we can have case insensitive roles in keystone, otherwise amoralej has something prepared.. | 07:26 |
| quiquell|rover | sshnaidm: Do you have a mminute ? | 07:27 |
| *** zoli is now known as zoli|wfh | 07:27 | |
| quiquell|rover | sshnaidm: Have some issues with my RDO cloud and ssh keys | 07:27 |
| *** zoli|wfh is now known as zoli | 07:27 | |
| sshnaidm | quiquell|rover, ya | 07:27 |
| ykarel | sshnaidm, as per Lance Bragstad comment in https://review.openstack.org/#/c/576056/, we can't have case insensitive resources | 07:28 |
| quiquell|rover | sshnaidm: Going to run it again to show you so you can help me | 07:29 |
| *** kopecmartin has joined #oooq | 07:30 | |
| sshnaidm | damn, who did come with capitalized role names? are we in windows?) | 07:30 |
| *** udesale has quit IRC | 07:30 | |
| *** tosky has joined #oooq | 07:34 | |
| quiquell|rover | sshnaidm: I get TASK [multinodes : Wait for provisioned hosts to become reachable] *************************************************** | 07:36 |
| quiquell|rover | [DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using `result|success` instead use `result is | 07:36 |
| quiquell|rover | success`. This feature will be removed in version 2.9. Deprecation warnings can be disabled by setting | 07:36 |
| quiquell|rover | deprecation_warnings=False in ansible.cfg. | 07:36 |
| quiquell|rover | FAILED - RETRYING: Wait for provisioned hosts to become reachable (100 retries left). | 07:36 |
| quiquell|rover | FAILED - RETRYING: Wait for provisioned hosts to become reachable (99 retries left). | 07:36 |
| quiquell|rover | And doing a manual ssh | 07:36 |
| quiquell|rover | [ellorent@quiquell ~]$ ssh centos@192.168.54.7 | 07:36 |
| quiquell|rover | ssh: connect to host 192.168.54.7 port 22: Connection timed out | 07:36 |
| quiquell|rover | sshnaidm: my .ssh file permissions are ok, I am already using the keys | 07:37 |
| quiquell|rover | sshnaidm: Don't know what else could be | 07:37 |
| quiquell|rover | I am executing reproducer with: bash reproducer-quickstart.sh -r true -w .reproducer 2>&1 |tee reproducer.log | 07:37 |
| sshnaidm | quiquell|rover, well, seems like host is not up | 07:38 |
| sshnaidm | quiquell|rover, can you log in via web and see what happens? | 07:39 |
| sshnaidm | quiquell|rover, or just "openstack server list" | 07:39 |
| sshnaidm | quiquell|rover, wait, why do you have internal IP? | 07:39 |
| quiquell|rover | sshnaidm: What do you mean with internal IP ? | 07:40 |
| sshnaidm | 192.168.54.7 | 07:40 |
| sshnaidm | quiquell|rover, is it in rdo cloud or libvirt reproducer? | 07:40 |
| quiquell|rover | sshnaidm: c09d95ae-3eb1-4203-b7f3-b04837987fcd | subnode-0 | ACTIVE | private_net=192.168.54.11, 192.168.54.7, 38.145.33.80 | CentOS-7-x86_64-GenericCloud-1801-01 | m1.large | | 07:40 |
| quiquell|rover | I have a public too | 07:41 |
| quiquell|rover | But it's using internal | 07:41 |
| quiquell|rover | sshnaidm: but public doesn't work too [ellorent@quiquell 1777451]$ ssh centos@38.145.33.80 | 07:42 |
| quiquell|rover | The authenticity of host '38.145.33.80 (38.145.33.80)' can't be established. | 07:42 |
| quiquell|rover | ECDSA key fingerprint is SHA256:owsNJaUKfCpL4rdzPLwCHK1J6/biXcOMJ6B2oQyeE7k. | 07:42 |
| quiquell|rover | ECDSA key fingerprint is MD5:cb:08:a0:b9:72:9c:48:c6:8c:6c:c9:b9:41:24:2a:21. | 07:42 |
| quiquell|rover | Are you sure you want to continue connecting (yes/no)? yes | 07:42 |
| quiquell|rover | Warning: Permanently added '38.145.33.80' (ECDSA) to the list of known hosts. | 07:42 |
| quiquell|rover | centos@38.145.33.80: Permission denied (publickey,gssapi-keyex,gssapi-with-mic). | 07:42 |
| sshnaidm | quiquell|rover, you can not use internal outside the network | 07:43 |
| sshnaidm | quiquell|rover, well, seems like problem with keys/permissions.. do you have correct permissions on your host? | 07:44 |
| quiquell|rover | sshnaidm: ellorent@quiquell ~]$ ls -la .ssh/ | 07:44 |
| quiquell|rover | total 28 | 07:44 |
| quiquell|rover | drwx------. 3 ellorent ellorent 4096 jun 19 08:39 . | 07:44 |
| quiquell|rover | drwx------. 28 ellorent ellorent 4096 jun 19 09:29 .. | 07:45 |
| quiquell|rover | drw-------. 2 ellorent ellorent 4096 jun 5 22:12 bak | 07:45 |
| quiquell|rover | -rw-------. 1 ellorent ellorent 615 jun 5 22:12 config | 07:45 |
| quiquell|rover | -rw-------. 1 ellorent ellorent 1679 jun 19 09:12 id_rsa | 07:45 |
| quiquell|rover | -rw-------. 1 ellorent ellorent 401 jun 19 09:12 id_rsa.pub | 07:45 |
| quiquell|rover | -rw-------. 1 ellorent ellorent 747 jun 19 09:41 known_hosts | 07:45 |
| sshnaidm | quiquell|rover, chmod 700 ~/.ssh | 07:45 |
| *** holser__ has joined #oooq | 07:46 | |
| sshnaidm | quiquell|rover, need to look in console log what happens, maybe some problem with cloud-init on the host.. | 07:47 |
| quiquell|rover | sshnaidm: Found this error at cloud-init | 07:48 |
| quiquell|rover | [ 9.783529] cloud-init[1406]: Provision began: 2018-06-19 07:30:56.222359 | 07:48 |
| quiquell|rover | [ 9.785479] cloud-init[1406]: /var/lib/heat-cfntools/cfn-userdata | 07:48 |
| quiquell|rover | [ 9.794144] cloud-init[1406]: Userdata empty or not executable: [Errno 8] Exec format error | 07:48 |
| quiquell|rover | [ 9.796308] cloud-init[1406]: Provision done: 2018-06-19 07:30:56.233235 | 07:48 |
| quiquell|rover | sshnaidm: re-running with 700 at .ssh | 07:49 |
| sshnaidm | Exec format error doesn't look good at all | 07:49 |
| sshnaidm | quiquell|rover, let me try.. | 07:49 |
| quiquell|rover | sshnaidm: ok, I am just running this | 07:50 |
| quiquell|rover | sshnaidm: with 700 now it can ssh :-), thanks | 07:50 |
| sshnaidm | quiquell|rover, np | 07:51 |
| sshnaidm | quiquell|rover, maybe it just needs time.. try it again | 07:51 |
| quiquell|rover | sshnaidm: But it's still using the local ip ssh -o BatchMode=yes -o StrictHostKeyChecking=no centos@192.168.54.17 -i /home/ellorent/.ssh/id_rsa | 07:52 |
| quiquell|rover | sshnaidm: Going to cleanup my tenant | 07:52 |
| *** gkadam has joined #oooq | 07:54 | |
| quiquell|rover | sshnaidm: virbr0 is l | 07:55 |
| quiquell|rover | sshnaidm: Looks like a I have libvirt detritus around | 07:55 |
| quiquell|rover | sshnaidm: So I have to local interfaces... that's why is choosen the wrong ip | 07:55 |
| quiquell|rover | sshnaidm: Looks like it takes just the second in the array | 07:55 |
| sshnaidm | quiquell|rover, i added recently the second network interface to hosts.. maybe this causes problems | 07:56 |
| sshnaidm | quiquell|rover, can you paste the full log somewhere? | 07:56 |
| sshnaidm | quiquell|rover, btw, do you have bug about undercloud failure? | 07:56 |
| quiquell|rover | sshnaidm: Was trying to see if yatin's fix also fixes the periodic jobs | 07:57 |
| quiquell|rover | sshnaidm: That's the undercloud bug ? | 07:57 |
| quiquell|rover | sshnaidm: About logs of the reproducer, I have three IPs instead of two changed: [localhost] => (item=(0, [u'192.168.54.16', u'192.168.54.17', u'38.145.33.80'])) | 07:58 |
| quiquell|rover | sshnaidm: And it was taking the second one instead of the third | 07:59 |
| quiquell|rover | sshnaidm: I have remove the weird virtual interface | 07:59 |
| quiquell|rover | sshnaidm: Will check now | 07:59 |
| quiquell|rover | sshnaidm: I think I run wrongly with -v true to create virtualenv but it was running libvirt reproducer instead | 07:59 |
| quiquell|rover | sshnaidm: That and the 700 permissions could be my issue | 08:00 |
| *** udesale has joined #oooq | 08:04 | |
| ykarel | sshnaidm, are u looking for https://bugs.launchpad.net/tripleo/+bug/1777541 | 08:06 |
| openstack | Launchpad bug 1777541 in tripleo "undercloud install error, mistra 503 unavailable " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 08:06 |
| marios | gerrit down? | 08:08 |
| sshnaidm | ykarel, exactly | 08:08 |
| sshnaidm | ok, it's already solved, good | 08:09 |
| quiquell|rover | sshnaidm: So the last blocker is the Member thing ? | 08:11 |
| sshnaidm | quiquell|rover, yeah | 08:13 |
| *** gkadam has quit IRC | 08:13 | |
| sshnaidm | quiquell|rover, you're right about interfaces, I'll fix this | 08:13 |
| *** gkadam has joined #oooq | 08:13 | |
| sshnaidm | quiquell|rover, it's because my patch which added additional interface | 08:13 |
| quiquell|rover | sshnaidm: Don't know if we can ask openstack for public interfaces instead of positional | 08:15 |
| sshnaidm | quiquell|rover, btw, about from-upgrades: https://review.openstack.org/#/c/576277 , tested on https://review.openstack.org/#/c/575244/ and it passed | 08:15 |
| quiquell|rover | sshnaidm: ^ Let me get something done as rover I feel bad already | 08:15 |
| quiquell|rover | sshnaidm: Do you have a fix for changed: [localhost] => (item=(0, [u'192.168.54.16', u'192.168.54.18', u'38.145.34.239'])) | 08:16 |
| quiquell|rover | changed: [localhost] => (item=(1, [u'192.168.54.7', u'192.168.54.14', u'38.145.33.92'])) | 08:16 |
| quiquell|rover | ? | 08:16 |
| sshnaidm | quiquell|rover, working on that | 08:16 |
| quiquell|rover | sshnaidm: Ok, let me know | 08:18 |
| *** zoli is now known as zoli|afk | 08:19 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 08:48 |
| *** jaosorior has quit IRC | 08:49 | |
| *** gkadam has quit IRC | 08:54 | |
| quiquell|rover | marios: I have issue with gerrit too, did you found a workaround ? | 08:56 |
| quiquell|rover | marios: working now... | 08:57 |
| marios | quiquell|rover: yeah it was temporary for me | 08:57 |
| tosky | ykarel: please remove from https://review.openstack.org/#/c/576356/ the bug number which is not relevant for tempestconf | 09:00 |
| quiquell|rover | sshnaidm: https://review.openstack.org/#/c/576436/ | 09:01 |
| quiquell|rover | ykarel: going to check the fixes for the periodic jobs now | 09:01 |
| ykarel | tosky, what needs to be done, do i need to create a bug in tempestconf, or bug is not even required | 09:01 |
| ykarel | quiquell|rover, one more issue appeared | 09:01 |
| ykarel | quiquell|rover, fix:- https://review.openstack.org/#/c/576428/ | 09:02 |
| tosky | ykarel: bug on tempestconf, or no bug, but not an unrelated (and even closed as duplicate) bug | 09:02 |
| ykarel | tosky, ok will go with no bug | 09:03 |
| sshnaidm | quiquell|rover, which pip install do you check? the "pip install ." ? | 09:03 |
| ykarel | tosky, Removed bug link | 09:05 |
| ykarel | https://review.openstack.org/#/c/576356/ | 09:05 |
| ykarel | is it fine now? | 09:05 |
| quiquell|rover | sshnaidm: The whole () block | 09:06 |
| quiquell|rover | sshnaidm: It has a -e inside | 09:06 |
| tosky | ykarel: yes, thanks, let's see the gates (hoping that a depends on instack-undercloud will work) | 09:07 |
| quiquell|rover | sshnaidm: I can rename the variable, is does more than pip install there | 09:07 |
| sshnaidm | quiquell|rover, I see now | 09:08 |
| quiquell|rover | sshnaidm: About the injection, I have a variant of your solution, instead of an string | 09:08 |
| quiquell|rover | sshnaidm: It was an struct with release on it, and I was checking release | 09:08 |
| quiquell|rover | sshnaidm: So you can check the release of compressed_gating_repo in the ansible cache | 09:09 |
| quiquell|rover | sshnaidm: but your solution is simpler than adding release to the name | 09:09 |
| sshnaidm | quiquell|rover, well, I didn't want to deal with releases at all, it's only about logic error in role. It's fine even we don't use different releases | 09:10 |
| quiquell|rover | sshnaidm: Cool agree, let's ensure that we don't miss any 'when' | 09:10 |
| ykarel | quiquell|rover, sshnaidm https://bugs.launchpad.net/tripleo/+bug/1777616 | 09:11 |
| openstack | Launchpad bug 1777616 in tripleo "Undercloud installation is failing: Class[Neutron]: has no parameter named 'rabbit_hosts'" [Undecided,New] | 09:11 |
| quiquell|rover | ykarel: ack | 09:12 |
| ykarel | quiquell|rover, please also escalate it | 09:13 |
| sshnaidm | ykarel, thanks.. it's for all underclouds now? | 09:13 |
| ykarel | sshnaidm, yes | 09:13 |
| ykarel | relying on instack-undercloud | 09:13 |
| ykarel | tripleo-ci-centos-7-containers-multinode | 09:15 |
| *** jaosorior has joined #oooq | 09:15 | |
| ykarel | featureset010 | 09:15 |
| quiquell|rover | ykarel: promotion-blocker tagged bugs already appear at CIX ? | 09:15 |
| ykarel | i think they need to be Triaged/Critical too | 09:16 |
| quiquell|rover | ykarel: ack | 09:16 |
| *** ratailor has quit IRC | 09:20 | |
| quiquell|rover | ykarel: Pusshing pat ch | 09:20 |
| ykarel | quiquell|rover, patch for what? | 09:21 |
| *** ratailor has joined #oooq | 09:21 | |
| quiquell|rover | https://bugs.launchpad.net/tripleo/+bug/1777616 | 09:21 |
| openstack | Launchpad bug 1777616 in tripleo "Undercloud installation is failing: Class[Neutron]: has no parameter named 'rabbit_hosts'" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 09:21 |
| quiquell|rover | sshnaidm, ykarel: That would be it ? https://bugs.launchpad.net/tripleo/+bug/1777616 | 09:24 |
| openstack | Launchpad bug 1777616 in tripleo "Undercloud installation is failing: Class[Neutron]: has no parameter named 'rabbit_hosts'" [Critical,In progress] - Assigned to Quique Llorente (quiquell) | 09:24 |
| ykarel | quiquell|rover, already had a patch https://review.openstack.org/#/c/576428/ | 09:24 |
| quiquell|rover | ykarel: ack | 09:26 |
| sshnaidm | quiquell|rover, ykarel y'all faster than me :( https://review.openstack.org/#/c/576448/ | 09:26 |
| quiquell|rover | sshnaidm: Team work would I say | 09:27 |
| sshnaidm | ykarel, please include bug number in commit | 09:29 |
| ykarel | sshnaidm, ack | 09:29 |
| quiquell|rover | sshnaidm: Going to test ykarel changes to see if they fix the periodic job for https://bugs.launchpad.net/tripleo/+bug/1777451 | 09:30 |
| openstack | Launchpad bug 1777451 in tripleo "Error: /Stage[main]/Ceph::Rgw::Keystone::Auth/Keystone_role Duplicate entry found with name Member" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 09:30 |
| ykarel | sshnaidm, 2 +2, do i need to update commit message | 09:30 |
| ykarel | will delay the merge | 09:31 |
| sshnaidm | ykarel, yes, please, I'll merge it even with one +2 | 09:31 |
| ykarel | sshnaidm, ack | 09:31 |
| *** zoli|afk is now known as zoli | 09:35 | |
| *** zoli is now known as zoli|wfh | 09:35 | |
| *** zoli|wfh is now known as zoli | 09:35 | |
| quiquell|rover | sshnaidm: Do you have super powers to +2 +1w at https://review.openstack.org/#/c/576428/ ? | 09:42 |
| sshnaidm | quiquell|rover, yeah, but let's see if it fixes | 09:43 |
| quiquell|rover | sshnaidm: Ok, it's breaking the gates :-( | 09:43 |
| sshnaidm | quiquell|rover, more interesting is how did it pass CI.. | 09:44 |
| * quiquell|rover processing sshnaidm wisdom | 09:45 | |
| sshnaidm | oh, we just didn't have any jobs on puppet-neutron | 09:46 |
| *** dtantsur|afk is now known as dtantsur | 09:46 | |
| quiquell|rover | sshnaidm: It was not discovered in CI ? | 09:47 |
| quiquell|rover | sshnaidm: tripleo-ci-centos-7-containers-multinode job is CI | 09:48 |
| quiquell|rover | or do you mean instack CI ? | 09:48 |
| quiquell|rover | not tripleo CI | 09:48 |
| *** ratailor has quit IRC | 09:49 | |
| sshnaidm | quiquell|rover, the change was introduced here: https://review.openstack.org/#/c/570307/ | 09:50 |
| *** ratailor has joined #oooq | 09:50 | |
| sshnaidm | quiquell|rover, and I don't see there any of tripleo jobs.. | 09:50 |
| quiquell|rover | sshnaidm: No one except tripleo have tripleo jobs, that's always the main issue | 09:53 |
| quiquell|rover | sshnaidm: Suppose they don't care about tripleo | 09:53 |
| sshnaidm | quiquell|rover, we had some.. before zuulv3. weshay|ruck wants to wait for standalone | 09:54 |
| sshnaidm | but I'd add at least undercloud job, short and testing all these puppet stuff | 09:54 |
| quiquell|rover | sshnaidm: That would be great | 09:55 |
| sshnaidm | quiquell|rover, tell me please if https://review.openstack.org/#/c/576455/ doesn't work for you | 09:59 |
| quiquell|rover | sshnaidm: ack | 10:00 |
| quiquell|rover | sshnaidm: Thanks | 10:00 |
| sshnaidm | well, newton is EOL | 10:01 |
| sshnaidm | we can finally delete newton job from ci.centos | 10:01 |
| quiquell|rover | sshnaidm: That needs one week of effort or so ? :-) | 10:02 |
| sshnaidm | quiquell|rover, a sprint | 10:03 |
| quiquell|rover | sshnaidm: Bah only that | 10:03 |
| quiquell|rover | ykarel, sshnaidm: To test fs019 at https://bugs.launchpad.net/tripleo/+bug/1777451 | 10:03 |
| openstack | Launchpad bug 1777451 in tripleo "Error: /Stage[main]/Ceph::Rgw::Keystone::Auth/Keystone_role Duplicate entry found with name Member" [Critical,Triaged] - Assigned to Quique Llorente (quiquell) | 10:03 |
| quiquell|rover | ykarel, sshnaidm: https://bugs.launchpad.net/tripleo/+bug/1777451 | 10:03 |
| ykarel | quiquell|rover, ack | 10:05 |
| quiquell|rover | sshnaidm: Why do we have two internal IPs now with the reproducer ? | 10:06 |
| sshnaidm | quiquell|rover, we create now 2 interfaces in a host | 10:10 |
| sshnaidm | quiquell|rover, and that's why it returns 2 IPs | 10:11 |
| sshnaidm | quiquell|rover, the second interface is required for standalone job | 10:11 |
| quiquell|rover | sshnaidm: Ahh the standalone... | 10:12 |
| sshnaidm | quiquell|rover, ykarel you need to try it guys, it's amazing: https://gist.github.com/mpeterson/bb351543c4abcca8e7bb1205fcea4c75 | 10:12 |
| sshnaidm | no need to go to zuul page at all | 10:12 |
| quiquell|rover | greasymonkye + zuul status: that's brilliant | 10:13 |
| quiquell|rover | sshnaidm: Can we close this >https://bugs.launchpad.net/tripleo/+bug/1777541, or we have to test it with tripleo first >? | 10:18 |
| openstack | Launchpad bug 1777541 in tripleo "undercloud install error, mistra 503 unavailable " [Critical,In progress] - Assigned to Alex Schultz (alex-schultz) | 10:18 |
| quiquell|rover | sshnaidm: The fix is released | 10:19 |
| sshnaidm | quiquell|rover, better to check with tripleo, let's wait for ykarels patch to finish and we'll see | 10:20 |
| *** dtantsur is now known as dtantsur|brb | 10:20 | |
| quiquell|rover | sshnaidm: Testing your reproducer fix now | 10:21 |
| sshnaidm | cool | 10:22 |
| sshnaidm | quiquell|rover, can you remind me please URL of zuul builds on RDO zuul? | 10:22 |
| quiquell|rover | sshnaidm: https://review.rdoproject.org/manage/v2/, remember to sort them | 10:23 |
| quiquell|rover | sshnaidm: Holy shit, running now with the tampermonkey the script :-) | 10:24 |
| quiquell|rover | sshnaidm: 'order_by': 'start_time', 'desc': 'true' | 10:26 |
| arxcruz | kopecmartin++ | 10:28 |
| hubbot | arxcruz: kopecmartin's karma is now 2 | 10:28 |
| *** udesale has quit IRC | 10:28 | |
| quiquell|rover | sshnaidm: Reproducer reproducing, I think we need a job to test it | 10:33 |
| sshnaidm | quiquell|rover, maybe on libvirt.. because we'll need a cloud to test it | 10:37 |
| quiquell|rover | sshnaidm: We cannot accesss credentials from within RDO cloud ? | 10:37 |
| sshnaidm | quiquell|rover, not from the job | 10:38 |
| quiquell|rover | sshnaidm: I see | 10:39 |
| *** apetrich has quit IRC | 10:39 | |
| *** apetrich has joined #oooq | 10:42 | |
| *** udesale has joined #oooq | 10:45 | |
| quiquell|rover | marios: Do you have a minute regarding https://review.openstack.org/#/c/574417/ ? | 10:45 |
| *** udesale has quit IRC | 10:46 | |
| *** udesale has joined #oooq | 10:46 | |
| marios | quiquell|rover: o/ | 10:47 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224 | 10:48 |
| quiquell|rover | marios: So is this still broken? or the problem was here https://review.openstack.org/#/c/574417/ ? | 10:49 |
| marios | quiquell|rover: do yo mean the https://bugs.launchpad.net/tripleo/+bug/1777132 or something else? | 10:49 |
| openstack | Launchpad bug 1777132 in tripleo "queens branch tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades is broken" [High,Triaged] - Assigned to Quique Llorente (quiquell) | 10:49 |
| marios | quiquell|rover: or you mean with the wrong releases being set? | 10:50 |
| marios | quiquell|rover: afaics it is donig te right thing as i pointed for the upgrades job right? | 10:50 |
| marios | quiquell|rover: i mean deploys queens and upgrade to master | 10:50 |
| marios | well, at least that is what the release file says i didn't dig to see if that is actually happening | 10:51 |
| quiquell|rover | marios: Yep, that's what I see as you state there, no more we can do... | 10:51 |
| quiquell|rover | marios: What I don't know if the fix is this https://review.openstack.org/#/c/574417/ | 10:51 |
| quiquell|rover | sorry https://review.openstack.org/#/c/574724/ | 10:51 |
| quiquell|rover | jiri's change | 10:51 |
| *** ykarel has quit IRC | 10:56 | |
| marios | quiquell|rover: don't know but the release files look ok there too update is master to master and q->m for upgrades http://logs.openstack.org/17/574417/5/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/ccccd5c/logs/emit_releases_file.txt.gz http://logs.openstack.org/17/574417/5/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/4cde328/logs/emit_releases_file.txt.gz | 10:56 |
| *** ykarel has joined #oooq | 10:56 | |
| marios | quiquell|rover: oo thats the wrong one :/ | 10:57 |
| ykarel | sshnaidm, greasemonkey + zuul status really nice | 10:58 |
| quiquell|rover | marios: updates states master->master with different hashes | 10:58 |
| marios | quiquell|rover: hm, so the updates has http://logs.openstack.org/24/574724/1/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/3212319/logs/emit_releases_file.txt.gz but upgrade doesnt have emit releases there? http://logs.openstack.org/24/574724/1/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/b09367e/logs/ | 10:58 |
| quiquell|rover | marios: updates -> http://logs.openstack.org/17/574417/5/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-updates/ccccd5c/logs/releases.sh | 10:58 |
| quiquell|rover | marios: upgrades -> http://logs.openstack.org/17/574417/5/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/4cde328/logs/releases.sh | 10:59 |
| quiquell|rover | marios: They are ok for stable release: master and n-1 -> n upgrade | 10:59 |
| marios | quiquell|rover: yeah i meant for 574724 jistr one | 11:00 |
| marios | quiquell|rover: s/meant/pointed at above | 11:01 |
| quiquell|rover | marios: upgrades doesn't not have because the don't exercise emit_releases script | 11:03 |
| quiquell|rover | marios: That's the wes change for | 11:03 |
| marios | quiquell|rover: ah right | 11:03 |
| quiquell|rover | marios: Maybe we need to test jistr change with Wes change | 11:03 |
| quiquell|rover | marios: And check the output | 11:03 |
| marios | quiquell|rover: so i pointed to the fs51 thing in wes change, but i couldn't see where fs52 is used | 11:03 |
| marios | quiquell|rover: i only found a stand-alone job in thereview.rdoproject.org-config | 11:04 |
| marios | quiquell|rover: where 52 was mentioned | 11:04 |
| marios | quiquell|rover: asking as that is what wes change does i.e. 51 and 52 | 11:04 |
| * quiquell|rover checking featuresets I always forget about it | 11:05 | |
| *** links has quit IRC | 11:06 | |
| marios | quiquell|rover: oh no worries man, i meant if you knew or maybe point me to where you are checking so i can learn too ;) | 11:09 |
| marios | quiquell|rover: but thanks for checking | 11:09 |
| *** panda is now known as panda|lunch | 11:09 | |
| quiquell|rover | marios: I want to learn too :-), let me find it | 11:10 |
| marios | quiquell|rover: ty | 11:10 |
| quiquell|rover | marios: fs51 is upgrades, I think review comments are wrong | 11:11 |
| marios | quiquell|rover: right i mean fs 51 as i noted at so the scen0 upgrade job is fs 51 because of https://github.com/openstack-infra/tripleo-ci/blob/7f61409bf12510982ce82902a3ba492869b5d49c/zuul.d/multinode-jobs.yaml#L385-L394 ? ? assuming that is correct | 11:12 |
| quiquell|rover | marios: https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset051.yml#L33 | 11:13 |
| quiquell|rover | marios: Also https://github.com/openstack/tripleo-quickstart/blob/master/config/general_config/featureset051.yml#L36 | 11:14 |
| quiquell|rover | so fs051 is upgrades | 11:14 |
| quiquell|rover | fs037 are the updates | 11:15 |
| quiquell|rover | fs052 is standalone, and that's other kind of animal I think | 11:15 |
| marios | quiquell|rover: cool thanks. yeah i did see that stand-alone in the review.rdoproject.org-config | 11:20 |
| marios | quiquell|rover: and so was confused as that was the only one i saw it for | 11:21 |
| marios | quiquell|rover: so wes review is wrong then? | 11:21 |
| marios | i.e. it isn't 52 we want | 11:21 |
| quiquell|rover | marios: Don't know, I suppose we want to test as much fs as possible | 11:21 |
| marios | quiquell|rover: gonna add a note anyway since i already had the question about that fs52 from earlier | 11:21 |
| quiquell|rover | marios: But for checking fs037(updates) and fs051(upgrades) would be good enough | 11:21 |
| *** links has joined #oooq | 11:22 | |
| quiquell|rover | marios: Going to ask Jiri about the issue he commented | 11:22 |
| quiquell|rover | marios: Maybe it's also related to your upgrade bug (didn't have time to event reproduce it) | 11:23 |
| quiquell|rover | sshnaidm: It's going to be so painful to have release name in the gating repo ? I think it's good for debugging | 11:23 |
| marios | quiquell|rover: oh in fact its in tripleo-ci not in rdoproject review (the 52 one) | 11:24 |
| marios | quiquell|rover: ack | 11:24 |
| sshnaidm | quiquell|rover, I think so. Why do we need it for debugging? | 11:25 |
| quiquell|rover | sshnaidm: To know for what release have beign would | 11:25 |
| quiquell|rover | sshnaidm: Now that we have n - 1 -> n and n -> n + 1 can be useful | 11:25 |
| quiquell|rover | sshnaidm: Even if we also want to support install and target changes | 11:26 |
| sshnaidm | quiquell|rover, AFAIU we build test package only once | 11:26 |
| quiquell|rover | sshnaidm: But in case we break something in releases the gating repo would have the release on it | 11:26 |
| quiquell|rover | sshnaidm: Maybe we can put the release inside it not in the name | 11:26 |
| sshnaidm | quiquell|rover, it's fine to put it in comment for example if you need this, but there are various way to see which release it's built for | 11:27 |
| quiquell|rover | sshnaidm: ack | 11:28 |
| sshnaidm | quiquell|rover, like adding comment here: https://github.com/openstack/tripleo-quickstart-extras/blob/1792332d0cd80037545cdbebe0ca7d1928781727/roles/install-built-repo/templates/install-built-repo.sh.j2#L15 | 11:29 |
| *** sshnaidm is now known as sshnaidm|lnch | 11:31 | |
| *** jtomasek has quit IRC | 11:32 | |
| quiquell|rover | sshnaidm|lnch: Yep and also inside the gating_repo.tar.gz | 11:33 |
| quiquell|rover | sshnaidm|lnch: Going to comment it in the review | 11:33 |
| *** links has quit IRC | 11:39 | |
| *** quiquell|rover is now known as quique|rover|lch | 11:39 | |
| quique|rover|lch | marios: jistr just confirmed that it's working fine. | 11:40 |
| *** dtantsur|brb is now known as dtantsur | 11:44 | |
| *** dougbtv has joined #oooq | 11:56 | |
| *** amoralej is now known as amoralej|lunch | 11:57 | |
| *** dougbtv has quit IRC | 11:59 | |
| marios | quique|rover|lch: ack thanks in call | 11:59 |
| *** dougbtv has joined #oooq | 12:00 | |
| *** quique|rover|lch is now known as quiquell|rover | 12:05 | |
| *** links has joined #oooq | 12:05 | |
| *** ratailor has quit IRC | 12:06 | |
| *** trown|outtypewww is now known as trown | 12:07 | |
| quiquell|rover | trown: Good morming | 12:09 |
| trown | morning quiquell|rover | 12:09 |
| quiquell|rover | trown: Have a problem with libvirt reproducer | 12:09 |
| quiquell|rover | trown: The `libvirt` module is not importable. Check the requirements. | 12:09 |
| quiquell|rover | trown: At TASK [libvirt/setup/common : Start volume pool] | 12:10 |
| quiquell|rover | trown: Maybe something is missing in the requirements ' | 12:10 |
| *** panda|lunch is now known as panda | 12:11 | |
| sshnaidm|lnch | quiquell|rover, which ansible version? | 12:11 |
| *** sshnaidm|lnch is now known as sshnaidm | 12:11 | |
| trown | quiquell|rover: do you have python-libvirt and python-lxml https://docs.ansible.com/ansible/2.5/modules/virt_pool_module.html | 12:11 |
| quiquell|rover | sshnaidm: 2.4.2.0 | 12:11 |
| quiquell|rover | sshnaidm: Didn't updated it with pip yet | 12:12 |
| quiquell|rover | sshnaidm: The reproducer should update it ? | 12:12 |
| sshnaidm | quiquell|rover, nope, that's fine | 12:12 |
| *** rnoriega has quit IRC | 12:13 | |
| *** lhinds has quit IRC | 12:13 | |
| quiquell|rover | trown: Nope, maybe we need to add those to the --install-deps ? | 12:14 |
| *** rnoriega has joined #oooq | 12:14 | |
| *** rnoriega has quit IRC | 12:14 | |
| *** lhinds has joined #oooq | 12:15 | |
| quiquell|rover | are that's quickstart not the preoducer | 12:15 |
| quiquell|rover | ok will install those | 12:15 |
| *** rnoriega has joined #oooq | 12:16 | |
| *** rlandy has joined #oooq | 12:17 | |
| trown | quiquell|rover: ya probably need to add those somewhere | 12:18 |
| quiquell|rover | trown: Ok, will try | 12:18 |
| quiquell|rover | thanks | 12:18 |
| weshay|ruck | quiquell|rover, morning | 12:19 |
| weshay|ruck | good times good times | 12:19 |
| quiquell|rover | weshay|ruck: Good mormning mr ruck | 12:20 |
| quiquell|rover | We are red as hell, but we fixes in the way | 12:20 |
| quiquell|rover | s/we/with/ | 12:21 |
| weshay|ruck | oof we're still red as hell | 12:21 |
| weshay|ruck | quiquell|rover, let's chat | 12:21 |
| quiquell|rover | weshay|ruck: ok | 12:21 |
| quiquell|rover | weshay|ruck: connecting | 12:22 |
| *** d0ugal has quit IRC | 12:24 | |
| weshay|ruck | https://trello.com/c/MqLYBRsm/619-cixlp1776729tripleociproa-tempest-access-denied-error-in-object-storage-tests-failing-in-rocky-build | 12:28 |
| *** sshnaidm is now known as sshnaidm|afk | 12:29 | |
| *** sshnaidm__ has joined #oooq | 12:29 | |
| panda | trown: can you share your findings with the network somewhere ? | 12:29 |
| sshnaidm__ | rfolco, git fatal: unable to access 'https://softwarefactory.usersys.redhat.com/r/tripleo-ci-internal/': SSL certificate problem: unable to get local issuer certificate | 12:31 |
| trown | panda: I dont have much as of yet... only that we dont want to run https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/undercloud-setup/tasks/main.yml#L21-L23 if we dont use devstack-gate | 12:31 |
| sshnaidm__ | rfolco, can we maybe use LetsEncrypt for it..? | 12:31 |
| trown | panda: I have not been using the upstream infra review because CI is so under water... waiting for the under patches to merge before rebasing at least | 12:31 |
| rlandy | https://softwarefactory.usersys.redhat.com/r/3oci2-jobs - still not found | 12:34 |
| rlandy | panda: are we using the community meeting today for sprint cards? | 12:35 |
| rlandy | dtantsur: how do I get nodes out of 'clean failed' state? | 12:38 |
| *** tcw has joined #oooq | 12:38 | |
| weshay|ruck | arxcruz, how you doing | 12:40 |
| arxcruz | weshay|ruck: we are working since this morning to fix the problem | 12:41 |
| arxcruz | me, tosky and kopecmartin | 12:41 |
| *** sanjay__u has quit IRC | 12:41 | |
| trown | rfolco: is the idea to copy 3oci2 (C3PO?) to the tripleo-ci-internal repo? | 12:42 |
| *** d0ugal has joined #oooq | 12:44 | |
| panda | rlandy: that slot might be used by the other tiger team too | 12:44 |
| rlandy | panda: I don;t mind which tiger team I join - the other one was just fuller | 12:45 |
| rlandy | panda: so can we meet then at another time? | 12:47 |
| dtantsur | rlandy: openstack baremetal node manage | 12:48 |
| rfolco | trown, no, tripleo-ci-internal is a new one to create the new jobs | 12:48 |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario002-multinode- (1 more message) | 12:48 |
| quiquell|rover | ykarel, sshnaidm__: fs019 working with "Member" fixes at my reproducer | 12:48 |
| trown | rfolco: so what is 3oci2 then? | 12:50 |
| rfolco | sshnaidm__, I don't know LetsEncrypt, but the ssl issue needs to be fixed by sf folks | 12:50 |
| rfolco | trown, this is the project I used to run the poc | 12:51 |
| rfolco | trown, now, we won't copy any config, we will use zuulv3 inheritance to base jobs on upstream ones | 12:51 |
| rfolco | makes sense ? | 12:51 |
| *** amoralej|lunch is now known as amoralej | 12:52 | |
| trown | rfolco: ok. so you figured out the required-projects thing? | 12:52 |
| rlandy | dtantsur: thanks - the introspection step left the nodes in a provide state- but the deployment failed with 'no available hosts'. Checking the nodes at the point of failure, they are in 'clean failed' state. Does that make sense to land in that state during deployment? | 12:52 |
| rlandy | undercloud_clean_nodes is set | 12:53 |
| rfolco | trown, we'll have to try what nicolas suggested in the doc | 12:54 |
| rlandy | oh, I see, 'Clean up mode for the temp files for heat installer on exit' | 12:54 |
| ykarel | quiquell|rover, ack | 12:54 |
| dtantsur | rlandy: it may happen, cleaning runs before providing and also after each tear down | 12:55 |
| dtantsur | I wonder when exactly your problem happened | 12:56 |
| rlandy | dtantsur: https://thirdparty.logs.rdoproject.org/jenkins-tq-gate-rhos-13-ci-rhos-ovb-featureset001-54/undercloud/home/stack/overcloud_deploy.log.txt.gz | 12:56 |
| rlandy | I am on the undercloud and want to run again | 12:56 |
| rlandy | I know a file was left out of the deployment (network-environment.yaml) | 12:56 |
| rlandy | but I was not expecting a 'no available hosts' issue | 12:57 |
| dtantsur | rlandy: it would be really useful if we outputted openstack baremetal node list before running the deploy command | 12:58 |
| rfolco | trown, I think his suggestion is to import the repos in config repo, under zuul/upstream.yaml... and make sure we add include: [] at the beginning to only import the code, not the zuul config for the project | 12:58 |
| rlandy | dtantsur, ok - I can add that to the CI | 12:59 |
| weshay|ruck | bet you guys are glad you have an internal sf now :) | 12:59 |
| weshay|ruck | :P | 12:59 |
| *** jtomasek has joined #oooq | 12:59 | |
| trown | rfolco: dont we want the zuul config too? | 12:59 |
| trown | rfolco: if we are relying on it for inheritence? | 12:59 |
| *** Goneri has joined #oooq | 13:00 | |
| rfolco | trown, let me see if I find the doc that explains that | 13:01 |
| rfolco | gimme one min will get a coffee | 13:02 |
| *** tcw has quit IRC | 13:02 | |
| sshnaidm__ | weshay|ruck, can you add me pls? https://softwarefactory.usersys.redhat.com/r/#/admin/groups/11,members | 13:04 |
| *** myoung|off is now known as myoung | 13:06 | |
| rfolco | sshnaidm__, please confirm your email | 13:07 |
| sshnaidm__ | rfolco, how? | 13:07 |
| rfolco | here | 13:07 |
| sshnaidm__ | rfolco, sorry, I don't follow you | 13:08 |
| rfolco | sshnaidm__, I submitted this yesterday to add people...https://softwarefactory.usersys.redhat.com/r/#/c/106/ | 13:08 |
| *** sshnaidm__ is now known as sshnaidm | 13:08 | |
| rfolco | but SF didn't like your email or marios one.... | 13:09 |
| rfolco | perhaps because you never logged in | 13:09 |
| sshnaidm | rfolco, I logged in today | 13:09 |
| *** tcw has joined #oooq | 13:10 | |
| rfolco | sshnaidm, done it works | 13:10 |
| rfolco | added you and marios too | 13:11 |
| marios | rfolco: ack i logged in this morning/replied to your email thanks | 13:11 |
| sshnaidm | rfolco, great, thanks | 13:11 |
| rfolco | pls let me know if any issues | 13:11 |
| tosky | arxcruz, chandankumar: uhm, about https://review.openstack.org/#/c/576500/, the change removes setting tempest_format, but then where is it set? Will it always be "packages"? But then why not containers on master? | 13:12 |
| arxcruz | tosky: the default is packages https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/validate-tempest/defaults/main.yml | 13:14 |
| tosky | right, and the change means no more container on master? | 13:15 |
| tosky | to be honest, I have troubles parsing the commit message | 13:15 |
| arxcruz | tosky: so, tl;dr | 13:15 |
| arxcruz | containers are messed | 13:15 |
| arxcruz | let's run tempest as we were running before | 13:16 |
| tosky | I see | 13:16 |
| rasca | rlandy, myoung, please if you can merge this https://code.engineering.redhat.com/gerrit/141909 asap, I'm failing queens rdophase2 (they changed without advice) thanks!!! | 13:16 |
| myoung | rasca: don't we went centos 7.5? | 13:17 |
| myoung | want* | 13:17 |
| myoung | vs. 7.4? | 13:17 |
| tosky | ehm, code.engineering here? | 13:17 |
| tosky | out of scope? | 13:17 |
| rlandy | myoung: rasca: afaik 7.5 is not available | 13:18 |
| rlandy | I tried for quiquell|rover | 13:18 |
| myoung | ahh ok | 13:18 |
| myoung | rasca: lgtm | 13:18 |
| rlandy | 7.4 was the best I could download | 13:18 |
| rasca | myoung, rlandy, yep 7.5 not yet available at the moment, and in any case the procedure does a yum update before proceeding, problem here is that is failing before, selecting the distro tree (which doesn't exists anymore) | 13:19 |
| * myoung nods | 13:19 | |
| weshay|ruck | sshnaidm, done | 13:19 |
| weshay|ruck | rlandy, panda trown added as admins | 13:19 |
| weshay|ruck | rfolco, fyi | 13:21 |
| rfolco | weshay|ruck, thx | 13:21 |
| *** sshnaidm is now known as sshnaidm|afk | 13:21 | |
| myoung | quiquell|rover: if you encounter more missing packages in libvirt reproducer please add them --> https://bugs.launchpad.net/tripleo/+bug/1769538 | 13:22 |
| openstack | Launchpad bug 1769538 in tripleo "RFE (libvirt-reproducer): Add option to install prerequisite packages (rpm, pip) " [High,Triaged] | 13:22 |
| rasca | myoung++ | 13:22 |
| hubbot | rasca: myoung's karma is now 2 | 13:22 |
| *** links has quit IRC | 13:22 | |
| rlandy | rfolco: how many repos should we clone/use? I have 3oci2-jobs and config - is there anything else? | 13:23 |
| rlandy | zuul-jobs | 13:24 |
| rfolco | rlandy, 3oci2-jobs is the poc ... yes config and zuul-jobs, which are the standard ones for zuul.... where common config and jobs stand | 13:24 |
| rfolco | rlandy, and now we have a new brand one tripleo-ci-internal for creating jobs for this sprint. | 13:25 |
| rfolco | just to have a clean space | 13:25 |
| rlandy | ok - getting that one | 13:25 |
| rlandy | sorry I am lagging a bit here | 13:25 |
| rfolco | nah you are good :) | 13:26 |
| *** vvaldez has joined #oooq | 13:26 | |
| quiquell|rover | myoung: ack | 13:34 |
| quiquell|rover | myoung: Have question about a bug on phase2 | 13:34 |
| myoung | quiquell|rover: yo | 13:35 |
| *** atoth has joined #oooq | 13:35 | |
| *** skramaja has quit IRC | 13:36 | |
| rasca | rlandy, hey, looking at this https://review.openstack.org/#/c/572155 I realized that you were right: we were passing an additional parameter instead of one less... But that said, I am still wondering why the error message was like that (saying we were passing 1 arg less) | 13:38 |
| quiquell|rover | myoung: https://bugs.launchpad.net/tripleo/+bug/1773572, current_build is missing but I don't know where it comes from | 13:38 |
| openstack | Launchpad bug 1773572 in tripleo "rdo2: periodic ovb job (master) isn't handling hashes correctly" [High,Triaged] - Assigned to Quique Llorente (quiquell) | 13:38 |
| * myoung looks | 13:39 | |
| panda | rfolco: what's the best way to test a triplo-quickstart change in internal sf ? | 13:40 |
| *** zoli is now known as zoli|afk | 13:40 | |
| myoung | quiquell|rover: ahh this one. for these rdo2 jobs the current_build param is set to a hash (or puddle) via a config file (a text file with KVP's that jenkins uses to define parameters) | 13:41 |
| * myoung fetches links | 13:41 | |
| rfolco | panda, not sure there is a better way, but I'd fetch the change on /opt/git/openstack/tripleo-quickstart | 13:42 |
| rfolco | in a pre.yaml | 13:42 |
| marios | quiquell|rover: fyi the failed scen0 queens job is now failing for something earlier than https://bugs.launchpad.net/tripleo/+bug/1777132?comments=all - on the upgrade prepare http://logs.openstack.org/24/567224/31/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/dc5556d/logs/undercloud/home/zuul/overcloud_upgrade_prepare.log.txt.gz | 13:42 |
| openstack | Launchpad bug 1777132 in tripleo "queens branch tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades is broken" [High,Triaged] - Assigned to Quique Llorente (quiquell) | 13:42 |
| marios | quiquell|rover: i mean for latest run here https://review.openstack.org/#/c/567224/ | 13:42 |
| *** ccamacho has quit IRC | 13:42 | |
| marios | quiquell|rover: i wanted to make some progress on the y u no pcmk | 13:43 |
| rlandy | rasca: I didn't fix anything ... EmilienM_PTO did :) | 13:43 |
| rlandy | rasca: I felt rather stupid after he fixed it | 13:43 |
| rasca | rlandy, sure, and I saw what he changed: he removed a parameter (the mock_sleep's one) | 13:43 |
| rlandy | I could have done that | 13:43 |
| rlandy | but oh well | 13:44 |
| rlandy | at least it's done | 13:44 |
| quiquell|rover | marios: Yep, zuul's check jobs are stuck one bug, Âthere is a fix already | 13:44 |
| rlandy | you pointed me to the solution for queens failure - so thank you for that | 13:44 |
| marios | quiquell|rover: org/centos7-queens/deps/latest/noarch/ansible-2.4.4.0-1.el7.ans.noarch.rpm: [Errno 14] curl#7 - "Failed connect to trunk.rdoproject.org:443; Connection refused" | 13:44 |
| rasca | rasca, well me too... I mean, I always feel stupid, so no big deal, but this time the error was difficult to interpret | 13:44 |
| rasca | rlandy ^^^ | 13:45 |
| quiquell|rover | marios: Humm this is different | 13:45 |
| * rasca is doing auto ping :/ the beginning of the end | 13:45 | |
| panda | rfolco: is is advisable to have an internal tripleo-quickstart ? | 13:45 |
| myoung | quiquell|rover: it *should* be coming from http://git.app.eng.bos.redhat.com/git/tripleo-environments.git/tree/jenkins/jobs/tripleo-quickstart/promote-rdo-master.yml#n100 | 13:46 |
| marios | quiquell|rover: http://logs.openstack.org/24/567224/31/check/tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades/dc5556d/logs/undercloud/home/zuul/overcloud_upgrade_prepare.log.txt.gz here fyi | 13:47 |
| marios | quiquell|rover: should i just recheck it? might be transiet (network issue) | 13:47 |
| marios | transient | 13:47 |
| marios | quiquell|rover: but weird the rest of the jobs are green | 13:47 |
| rfolco | panda, well, I am not sure this will make our life easier to rebase changes and sync work.... | 13:47 |
| rfolco | this is a good topic to discuss with the team... | 13:47 |
| rfolco | with the toci_gate discovery and cleanup, we may need to sync work and this may become hard doing upstream with unmerged code | 13:48 |
| panda | rfolco: the other side here is how to check changes in tripleo-quickstat, either we implement our method to check changes, or leverage the Depends-On: in some way | 13:49 |
| marios | folks how/when/who is https://review.openstack.org/#/c/567224/ rebase myoung ? can i recheck it i want to see what the story is with the failed queens upgrade prepare (failing for failed connect trunk.rdoproject.org:443 connection refused | 13:49 |
| rfolco | panda, need to define this today indeed | 13:50 |
| quiquell|rover | marios: You can create your own patch | 13:50 |
| quiquell|rover | marios: With the same change and do rechecks on it | 13:50 |
| rlandy | panda: rfolco: unless we have to, keeping internal repos is a pain - and syncing up | 13:50 |
| myoung | marios the hubbot bot rebases it | 13:50 |
| rlandy | think about the stable branches we keep | 13:50 |
| quiquell|rover | marios: But not the right moment right now, we need a clear queue for the blocking reviews to land | 13:50 |
| marios | myoung: i see thanks | 13:50 |
| rlandy | double update/ff | 13:50 |
| marios | quiquell|rover: thanks | 13:50 |
| marios | ok i wont quiquell|rover | 13:50 |
| marios | i wont recheck i mean | 13:50 |
| quiquell|rover | marios: Thanks man | 13:50 |
| myoung | %config plugins.GateStatus.changeIDs | 13:50 |
| hubbot | myoung: I0cbf9ffb8552411e4dd891c38702ff8d1f6db5b1 I214272a6f25feb75496e44eb0a16269c6ee4cfe2 I4c5bdf00ce8cf7eabf669b248b99cb8443e82fab If12c8fe9bd0bea98a4842f279399285344f22246 | 13:50 |
| marios | quiquell|rover: i guess that will be rebase at somepoint today so we can just check again tomorrow to make progress on that https://bugs.launchpad.net/tripleo/+bug/1777132 | 13:51 |
| openstack | Launchpad bug 1777132 in tripleo "queens branch tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades is broken" [High,Triaged] - Assigned to Quique Llorente (quiquell) | 13:51 |
| myoung | marios: can also just make a new patch or just recheck/rebase things in additional to hubbot | 13:52 |
| panda | rlandy: I agree, can you think of an easy way to test changes in tripleo-quickstart in internal sf ? | 13:52 |
| rfolco | upstream branching is not an option panda rlandy ? | 13:52 |
| marios | myoung: tx | 13:52 |
| rfolco | zuulv3/ branch | 13:52 |
| panda | can someone find the new Depends-On: implementation details somewhere ? | 13:52 |
| rlandy | panda: rfolco: I'd rather use git clone from upstream and git review | 13:52 |
| panda | rfolco: ok, how do you check the upstream branch in internal sf ? | 13:52 |
| rlandy | a branch is a better idea | 13:53 |
| myoung | rfolco, rlandy, panda this (branching, internal repos, etc) is what I was trying to get at yesterday... | 13:53 |
| rlandy | but still a sync nightmare | 13:53 |
| rfolco | sorry for not getting this myoung | 13:53 |
| rfolco | you think ahead :) | 13:53 |
| myoung | we do have an existing solution that we could either mimic, or just outright use | 13:53 |
| rlandy | rfolco: panda: we have some experince with working downstream | 13:53 |
| myoung | but while we *can* do it by hand, it's a royal PITA | 13:53 |
| rlandy | and it's not easy to stay in sync | 13:54 |
| panda | I don't think we need a regular sync | 13:54 |
| rlandy | continuous rebasing is better | 13:54 |
| myoung | what we do now for TQ/TQE is have internal versions of those repos (code.eng) with a cron job that syncs all changes from github.com --> code.eng every 15 mins...(master --> master) - then internally we use branches | 13:55 |
| rlandy | the ff in this case is dangerous | 13:55 |
| myoung | so we can rebase internal branches and/or CP | 13:55 |
| panda | internal sf work is job driven | 13:55 |
| myoung | we could do something similar, either using code.eng, or (likely better) repos on SF | 13:55 |
| panda | no need to keep repos in sync when a new is not in the working | 13:55 |
| myoung | but automatic sync master --> master, and for sprint work we can work on a branch | 13:55 |
| myoung | make it easier to rebase and/or push --> gerrit when we want to go back to upstream | 13:55 |
| rlandy | panda: getting out of sync - even for a short time creates future debt | 13:56 |
| myoung | want to just talk after the tripleo meeting? I think (taking marios idea from yesterday) we can just cancel the community meeting and discuss after #tripleo? | 13:57 |
| panda | hah, I'm about to open a 20 years mortgage, debt doesn't scare me. | 13:57 |
| * panda hides | 13:57 | |
| trown | someone has taken over pandas irc | 13:57 |
| quiquell|rover | panda: That's rock-50 | 13:57 |
| quiquell|rover | rocky-50 | 13:57 |
| trown | quick ban this fake panda from the channel | 13:57 |
| rasca | LOL | 13:58 |
| trown | the real panda would never say "debt doesn't scare me" | 13:58 |
| rlandy | sorry I think we need to preserve this for eternity | 13:58 |
| rlandy | "debt doesn't scare me" is not in panda's vocabulary | 13:59 |
| myoung | quiquell|rover: i poked at rdo2 for that bug and seeing something wierd. something has silently rotten over time. check this out: https://rhos-dev-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/myoung-slave-env-dump/2/console | 13:59 |
| rlandy | to be honest - debt scares me | 13:59 |
| myoung | I think the param's plugin is choking on this | 13:59 |
| myoung | should just have 1 hash, not $allTheHashesEver[] | 13:59 |
| quiquell|rover | myoung: ack | 13:59 |
| *** ccamacho has joined #oooq | 14:00 | |
| myoung | quiquell|rover: HAH...found the bug | 14:00 |
| marios | folks any one else having issue with rdocloud/devmode like http://pastebin.test.redhat.com/605872 FAILED - RETRYING: Wait for provisioned host to become reachable (1 retries left). | 14:01 |
| quiquell|rover | myoung: current_build is there, what is preveting from appear ? | 14:01 |
| panda | rlandy: do youi know if zuul in internal sf supports this ? https://zuul-ci.org/docs/zuul/user/gating.html#cross-project-dependencies | 14:02 |
| rlandy | marios: ack - that happens can you can't ssh to the undercloud | 14:02 |
| rlandy | marios: devmode went out with the dinosaurs | 14:02 |
| rlandy | panda: you must mean rfolco ^^?? | 14:02 |
| marios | rlandy: heh, what should i be using these days then | 14:03 |
| panda | rlandy: yes sorry | 14:03 |
| quiquell|rover | myoung: Don't leave it out leave it out | 14:03 |
| rlandy | marios: reproducer | 14:03 |
| marios | rlandy: pointy please? | 14:03 |
| marios | s/pointy/pointer | 14:03 |
| rlandy | marios: are you working with a particular job? failure? | 14:03 |
| rlandy | marios: each CI run produces a quickstart reproducer | 14:04 |
| marios | rlandy: no, i am just trying to stand up some envs, master for now (i lost my pike -> queens envs as i lost the .ssh.ansible directories and so wiped both of them | 14:04 |
| rfolco | panda, it should, we can import projects from any source, even M$ GitHub :) | 14:04 |
| marios | rlandy: i see (like in the logs the pointer to 'reproducer instructions) | 14:04 |
| marios | rlandy: thanks, what if y ou just wana do master is it possible? | 14:04 |
| rlandy | marios: getting | 14:04 |
| rlandy | marios: wget this file ... https://logs.rdoproject.org/52/576252/1/openstack-check/gate-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/Z9da6c2cefb974de0a3de1607d2602aba/reproducer-quickstart.sh | 14:05 |
| rlandy | remove ZUUL_CHANGES | 14:05 |
| marios | rlandy: thanks btw tripleo weekly starting now | 14:05 |
| rlandy | ${ZUUL_CHANGES:=""} | 14:06 |
| myoung | quiquell|rover: https://code.engineering.redhat.com/gerrit/141919 The RDO variant of build info param file was perma-appended | 14:06 |
| panda | rfolco: ok, we have to try it | 14:06 |
| panda | rlandy: maybe we can just leave a dummy repo in internal, and have all the changes in upstream. Changes in the dummy repo can just Depends-On upstream changes | 14:10 |
| panda | uff | 14:10 |
| panda | rfolco: ^ | 14:10 |
| panda | please change your names | 14:10 |
| *** rfolco is now known as folco | 14:11 | |
| folco | hi i am folco | 14:11 |
| folco | panda, better ? | 14:11 |
| panda | no no, I meant your real name | 14:11 |
| trown | or panda can just type 2 chars before tabbing :P | 14:12 |
| *** folco is now known as rfolco | 14:12 | |
| panda | folco: don't you like a name like "Tiago" ? | 14:12 |
| rfolco | panda=lazyfinger | 14:12 |
| panda | trown: too much work | 14:12 |
| panda | trown: with you t + tab is enough | 14:12 |
| rlandy | panda: there is somebody else with the nick rlandry - I get his pings all the time | 14:13 |
| rfolco | haha | 14:13 |
| rfolco | trown, https://softwarefactory-project.io/docs/zuul/admin/tenants.html#attr-tenant.untrusted-projects.%3Cproject%3E.include | 14:14 |
| trown | rlandy: same with me and trozet | 14:14 |
| panda | I remember when Sunil was still in our team. We had a sthaha and a staha. Man How many mails to the wrong person ... | 14:14 |
| rfolco | trown, for tq tqe and tu we don't have to load anything in .zuul.yaml.... so we can load code like this https://softwarefactory-project.io/r/gitweb?p=config.git;a=blob;f=zuul/ansible_networking.yaml;h=5a2e126d601f4b89d4f484fb4a524e1b4fd2586f;hb=HEAD#l9 | 14:15 |
| weshay|ruck | myoung, status for tripleo mtg https://etherpad.openstack.org/p/tripleo-ci-squad-meeting | 14:16 |
| myoung | weshay|ruck: aye, thought that's usually ruck/rover to update. I'll add it now. | 14:17 |
| weshay|ruck | myoung, is that doc'd some where? | 14:20 |
| myoung | weshay|ruck: I'll check ruck/rover guide, it's just what we've done. I've updated https://etherpad.openstack.org/p/tripleo-ci-squad-meeting @ L28 with current # of days for jobs, if there's additional ongoing ruck/rover ongoing issues please add. I'll add current promotion blockers now as well. | 14:21 |
| weshay|ruck | k.. cool $news to me | 14:22 |
| *** bogdando has quit IRC | 14:26 | |
| rlandy | marios; you all set with the reproducer - instructions on how to run are in the file. (source your rdocloud tenant rc file.. that file runs ovb - you can change the node config if you want fewer nodes) | 14:27 |
| marios | rlandy: didn't get to it yet, one thing i noticed is the zuul user i guess i can create one or edit the script | 14:29 |
| marios | but thanks for the pointer will check rlandy | 14:29 |
| rlandy | marios: the user is zuul as it sets up the nodes exactly as CI would | 14:30 |
| rlandy | same diff - it's just your undercloud_user has another name | 14:30 |
| arxcruz | quiquell|rover: weshay|ruck is this error already triaged? http://logs.openstack.org/69/568869/37/check/tripleo-ci-centos-7-containers-multinode/741d19a/logs/undercloud/home/zuul/undercloud_install.log.txt.gz#_2018-06-19_13_58_21 | 14:33 |
| quiquell|rover | arxcruz: yes | 14:33 |
| quiquell|rover | arxcruz: https://bugs.launchpad.net/tripleo/+bug/1777616 | 14:33 |
| openstack | Launchpad bug 1777616 in tripleo "Undercloud installation is failing: Class[Neutron]: has no parameter named 'rabbit_hosts'" [Critical,In progress] - Assigned to yatin (yatinkarel) | 14:33 |
| quiquell|rover | arxcruz: A fix is already merged | 14:33 |
| arxcruz | quiquell|rover: is this already being fixed? because the tempestconf patches are blocked | 14:34 |
| quiquell|rover | arxcruz: Let us know if it doesn't work after a recheck | 14:34 |
| arxcruz | okay, we might need a recheck | 14:34 |
| arxcruz | tosky: ^ | 14:34 |
| quiquell|rover | arxcruz: Do the recheck (sound like a song) | 14:34 |
| *** quiquell|rover is now known as quiquell|off | 14:35 | |
| tosky | arxcruz: oh, a recheck even if the python-tempestconf patch by ykarel is not merged? | 14:36 |
| quiquell|off | tosky: add a Depends-On the change | 14:36 |
| arxcruz | tosky: my patch also fix the error, in a different way | 14:36 |
| arxcruz | cuz add a try except | 14:36 |
| tosky | arxcruz: let me summarize: if we merge https://review.openstack.org/#/c/568869/, we don't need https://review.openstack.org/#/c/576356/? | 14:37 |
| *** hamzy_ is now known as hamzy | 14:37 | |
| arxcruz | tosky: no, because if the role already exist, it will not fail anymore | 14:38 |
| arxcruz | tosky: if tries to add a role that already exist, it will be caught by the try except | 14:38 |
| tosky | so should we hold 576356 for now? | 14:38 |
| tosky | aka I don't need to add a +2+w there? | 14:38 |
| arxcruz | tosky: we can later add the lower() that's no problem, but now will no longer fail, and will log saying role x already exist | 14:39 |
| tosky | arxcruz: ack, good to know, asking to focus on the order of merging | 14:39 |
| arxcruz | tosky: https://review.openstack.org/#/c/568869/37/config_tempest/services/object_storage.py line 53 | 14:39 |
| tosky | because resources are limited etc etc | 14:40 |
| *** udesale has quit IRC | 14:42 | |
| ykarel | hmm, 568869 should also fix the member/Member issue, but too big change | 14:42 |
| *** udesale has joined #oooq | 14:42 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario002-multinode- (1 more message) | 14:48 |
| *** ccamacho has quit IRC | 14:53 | |
| *** dtantsur is now known as dtantsur|afk | 14:54 | |
| *** sanjayu_ has quit IRC | 15:05 | |
| *** zoli|afk is now known as zoli | 15:07 | |
| *** zoli is now known as zoli|wfh | 15:07 | |
| *** zoli|wfh is now known as zoli | 15:07 | |
| *** vinaykns has joined #oooq | 15:12 | |
| marios | rfolco: btw your volume is a bit low i mean your mic fyi | 15:18 |
| rfolco | marios, auto volume | 15:19 |
| rfolco | :( | 15:19 |
| marios | rfolco: ack yeah i keep fighting mine too | 15:19 |
| marios | panda: pointer to the history of toci gate etherpad please :) | 15:25 |
| panda | .... | 15:26 |
| panda | I'll have to dig | 15:26 |
| marios | panda: ack thanks | 15:26 |
| rlandy | panda: where are we meeting? | 15:39 |
| panda | rlandy: bj/gcerami | 15:39 |
| panda | marios: what team are you on ? | 15:39 |
| marios | panda: well, added myself to the other one, but shoul di join this one? i can do whatever | 15:39 |
| * marios defects | 15:39 | |
| marios | panda: joining | 15:40 |
| rfolco | panda, the toci_gate cleanup was included in the reparenting (renamed) card... should we just move description from the reparenting card ? | 15:40 |
| rfolco | panda, looks like you created a 3rd card | 15:40 |
| weshay|ruck | vinaykns, sorry.. it's just a bad day re: upstream | 15:41 |
| weshay|ruck | vinaykns, usually I have a bit more time | 15:41 |
| *** sshnaidm|afk is now known as sshnaidm | 15:41 | |
| weshay|ruck | but.. if you read openstack-dev you'll find the upstream check/gate jobs for tripleo are down, almost fixed though hopefully | 15:41 |
| sshnaidm | myoung, marios so for me and marios it's EOD, not sure we can do something today about removing code | 15:42 |
| sshnaidm | myoung, marios I suggest to sync tomorrow about that | 15:42 |
| myoung | sshnaidm: | 15:42 |
| myoung | sshnaidm: ack. | 15:42 |
| vinaykns | weshay|ruck Oh..that bad...but hope it is fixed..!! | 15:42 |
| myoung | panda: if you could share a link to your etherpad re: toci, or just add it to the card (better) would be helpful. | 15:43 |
| weshay|ruck | vinaykns, hrm.. not /etc/hosts | 15:43 |
| weshay|ruck | but ~/.quickstart or {{ local_working_dir }}/hosts | 15:43 |
| weshay|ruck | --wd | 15:43 |
| *** ykarel is now known as ykarel|away | 15:43 | |
| weshay|ruck | vinaykns, can you $user ssh root@virthost ls | 15:44 |
| weshay|ruck | w/o passwd prompt | 15:44 |
| vinaykns | ruck, Oops http://paste.openstack.org/show/723839/ | 15:45 |
| marios | sshnaidm: sure works for me. i added myself to that team and i am also listening in on the networking discussion now on suggestion from panda. im not sure what i will do realisticaly ;) but i can try and follow for reviews etc. please add me if you setup call? | 15:49 |
| vinaykns | ruck It is complaining about this ssh: Could not resolve hostname virthost: Name or service not known. But I tried by replacing virthost with 127.0.0.2 then it showed anaconda-ks.cfg | 15:51 |
| weshay|ruck | vinaykns, tmate? | 15:51 |
| vinaykns | sure.! | 15:51 |
| vinaykns | ssh liU4lLB5PhVXcBWZDYAIIAcHH@ny2.tmate.io | 15:51 |
| *** hamzy has quit IRC | 15:51 | |
| weshay|ruck | vinaykns, oooh.. don't post that in public | 15:52 |
| weshay|ruck | vinaykns, make a new one | 15:52 |
| weshay|ruck | send privately | 15:52 |
| vinaykns | Oops..! | 15:52 |
| *** ykarel|away has quit IRC | 15:54 | |
| weshay|ruck | vinaykns, shall I start from the beginning? | 15:55 |
| vinaykns | Ya sure.! | 15:55 |
| vinaykns | Btw I added that yum in the ansible...that we discussed.! | 15:56 |
| weshay|ruck | k | 15:56 |
| vinaykns | Do you want me to go ahead and run the command.! | 15:56 |
| weshay|ruck | rlandy, rasca congrats https://review.openstack.org/#/c/572155/ | 16:03 |
| weshay|ruck | vinaykns, see it | 16:03 |
| weshay|ruck | vinaykns, OH | 16:03 |
| vinaykns | Yeah I get python2 yum module is needed for this module" | 16:04 |
| rlandy | weshay|ruck: yep - still waiting on the nodes config to merge | 16:04 |
| myoung | rlandy, weshay|ruck, quiquell|off: https://code.engineering.redhat.com/gerrit/#/c/141919 fixes https://bugs.launchpad.net/tripleo/+bug/1773572 | 16:05 |
| openstack | Launchpad bug 1773572 in tripleo "rdo2: periodic ovb job (master) isn't handling hashes correctly" [High,In progress] - Assigned to Matt Young (halcyondude) | 16:05 |
| *** myoung is now known as myoung|lunch | 16:05 | |
| weshay|ruck | vinaykns, weird.. | 16:07 |
| weshay|ruck | - name: ensure libguestfs is installed | 16:07 |
| weshay|ruck | yum: name=libguestfs-tools-c state=latest | 16:07 |
| weshay|ruck | become: true | 16:07 |
| weshay|ruck | that's all it's trying to do | 16:07 |
| weshay|ruck | let's see what happens | 16:08 |
| *** sshnaidm is now known as sshnaidm|afk | 16:08 | |
| weshay|ruck | vinaykns, this looks like an ansible bug | 16:09 |
| weshay|ruck | vinaykns, dnf-yum is installed and the yum module is not working | 16:10 |
| weshay|ruck | vinaykns, w/o a significant change.. this probably blocks you.. I can put up a change to change any yum: call to package: | 16:10 |
| weshay|ruck | vinaykns, if oyu need this for your work though.. I would suggest moving to a supported platform.. centos or rhel | 16:10 |
| weshay|ruck | and centos would be the best choice | 16:11 |
| vinaykns | But you need a physical machine right..?? | 16:11 |
| vinaykns | Can I do it on a VM..?? | 16:11 |
| weshay|ruck | vinaykns, ya.. you need a physical machine | 16:21 |
| weshay|ruck | w/ centos or rhel | 16:22 |
| panda | myoung|lunch: marios chances of finding that etherpad with tripleo.sh breakdown are dwinding into single digits nowm I'll comnitnue some digging tomorrow | 16:26 |
| *** panda is now known as panda|off | 16:26 | |
| weshay|ruck | https://review.openstack.org/576577 | 16:28 |
| weshay|ruck | vinaykns, | 16:28 |
| weshay|ruck | rlandy, trown ^ Readme update | 16:28 |
| marios | thanks panda|off no worries, /me EOD ttyl | 16:29 |
| weshay|ruck | arxcruz, looks clear https://review.openstack.org/#/c/576356/3 | 16:30 |
| weshay|ruck | chandankumar, ^ | 16:30 |
| arxcruz | weshay|ruck: the real problem is https://review.openstack.org/#/c/568869/ that also fix that problem from this patch :) | 16:31 |
| weshay|ruck | arxcruz, you still working that? | 16:32 |
| weshay|ruck | meaning.. still hitting issues | 16:32 |
| arxcruz | weshay|ruck: it escalate very fast | 16:32 |
| weshay|ruck | ? | 16:32 |
| arxcruz | weshay|ruck: we found several other problems while trying to fix the swift role | 16:33 |
| weshay|ruck | arxcruz, any other reviews or bugs? | 16:33 |
| arxcruz | weshay|ruck: nope, just that | 16:33 |
| tosky | arxcruz: talking about 568869 and its dependency 576472, can we recheck the latter? | 16:39 |
| *** udesale has quit IRC | 16:41 | |
| arxcruz | tosky: yup | 16:44 |
| hubbot | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-scenario003-multinode-oooq-container, (1 more message) | 16:48 |
| *** Goneri has quit IRC | 17:01 | |
| *** zoli is now known as zoli|gone | 17:06 | |
| *** zoli|gone is now known as zoli | 17:06 | |
| *** tesseract has quit IRC | 17:08 | |
| *** kopecmartin has quit IRC | 17:11 | |
| *** Goneri has joined #oooq | 17:15 | |
| *** trown is now known as trown|lunch | 17:27 | |
| *** myoung|lunch is now known as myoung | 17:32 | |
| *** hamzy has joined #oooq | 17:36 | |
| *** Goneri has quit IRC | 17:38 | |
| *** amoralej is now known as amoralej|off | 17:53 | |
| *** holser__ has quit IRC | 18:03 | |
| weshay|ruck | trown|lunch, rlandy fyi.. not 100% sure but 95% sure the upstream gates are clear | 18:07 |
| weshay|ruck | waiting on a test patch to confirm | 18:07 |
| rlandy | weshay|ruck: that would be awesome | 18:07 |
| rlandy | weshay|ruck: pls let us know if we can recheck | 18:08 |
| *** Goneri has joined #oooq | 18:08 | |
| *** trown|lunch is now known as trown | 18:28 | |
| *** hamzy_ has joined #oooq | 18:39 | |
| *** hamzy has quit IRC | 18:39 | |
| hubbot | FAILING CHECK JOBS on stable/queens: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades @ https://review.openstack.org/567224, master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario002-multinode- (1 more message) | 18:48 |
| *** atoth has quit IRC | 18:51 | |
| *** dsneddon has quit IRC | 19:15 | |
| *** dsneddon has joined #oooq | 19:16 | |
| rlandy | weshay|ruck: trown: the reproducer looks messed up for multinode - see https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset016-master/e03ba6c/reproducer-quickstart.sh | 19:24 |
| rlandy | note missing pieces for https://github.com/openstack/tripleo-quickstart-extras/blob/master/roles/create-reproducer-script/templates/reproducer-quickstart.sh.j2#L247 | 19:24 |
| trown | ya its missing all the pieces :P | 19:25 |
| trown | rlandy: I am just using the old etherpad to work on networking stuff... | 19:25 |
| rlandy | no libvirt nodepool | 19:25 |
| rlandy | trown: I'll work on fixing the reproducer | 19:25 |
| rlandy | last review chopped off a bit more than intended | 19:26 |
| trown | rlandy++ thanks | 19:26 |
| hubbot | trown: rlandy's karma is now 7 | 19:26 |
| rfolco | weshay|ruck, I'm more inclined to use upstream for upstream work and let the SF instance for internal jobs with RDO, OSP. Much easier to use mirrors, required-projects, depends-on from upstream. It's all set. We cannot configure mirrors on SF. This makes things much more difficult. | 19:29 |
| rfolco | https://softwarefactory.usersys.redhat.com/r/gitweb?p=config.git;a=blob;f=playbooks/upstream/pre.yaml;h=d29a0674d1b555957de5983327be1389a9deaa2e;hb=HEAD#l12 | 19:35 |
| rlandy | I guess it's only a problem for periodic | 19:40 |
| *** Goneri has quit IRC | 20:08 | |
| *** tcw has quit IRC | 20:32 | |
| *** jtomasek has quit IRC | 20:43 | |
| weshay|ruck | any puppet cores here? https://review.openstack.org/#/q/topic:tripleo-ci+(status:open+OR+status:merged) | 20:46 |
| hubbot | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-scenario003-multinode-oooq-container, (1 more message) | 20:48 |
| *** hamzy_ has quit IRC | 20:54 | |
| weshay|ruck | useful https://support.google.com/mail/answer/7190?hl=en | 20:59 |
| *** trown is now known as trown|outtypewww | 21:01 | |
| *** rfolco is now known as rfolco|off | 21:18 | |
| vinaykns | Hello channel.! | 21:47 |
| *** myoung is now known as myoung|off | 21:59 | |
| *** jrist has quit IRC | 22:05 | |
| *** florianf has quit IRC | 22:10 | |
| *** vvaldez has quit IRC | 22:24 | |
| *** yolanda has quit IRC | 22:43 | |
| *** apetrich has quit IRC | 22:44 | |
| *** apetrich has joined #oooq | 22:44 | |
| *** rfolco|off has quit IRC | 22:45 | |
| *** yolanda has joined #oooq | 22:45 | |
| hubbot | FAILING CHECK JOBS on master: tripleo-ci-centos-7-scenario000-multinode-oooq-container-upgrades, tripleo-ci-centos-7-3nodes-multinode, tripleo-ci-centos-7-scenario001-multinode-oooq-container, tripleo-ci-centos-7-scenario007-multinode-oooq-container, tripleo-ci-centos-7-scenario002-multinode-oooq-container, tripleo-ci-centos-7-containers-multinode, tripleo-ci-centos-7-scenario003-multinode-oooq-container, (1 more message) | 22:48 |
| *** vvaldez has joined #oooq | 22:51 | |
| *** vinaykns has quit IRC | 23:03 | |
| *** hamzy_ has joined #oooq | 23:20 | |
| *** hamzy_ is now known as hamzy | 23:21 | |
| *** Goneri has joined #oooq | 23:22 | |
| *** rfolco has joined #oooq | 23:25 | |
| *** rlandy has quit IRC | 23:34 | |
| *** tosky has quit IRC | 23:45 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!