| *** limao_ has quit IRC | 00:00 | |
| *** gvrangan has joined #tripleo | 00:01 | |
| *** pmannidi has quit IRC | 00:01 | |
| *** yamahata has joined #tripleo | 00:02 | |
| *** pmannidi has joined #tripleo | 00:04 | |
| *** garyk has quit IRC | 00:05 | |
| thrash | EmilienM: I'm getting close on this ironic inspector thing... | 00:08 |
|---|---|---|
| thrash | EmilienM: something to do with the keystone session of course. | 00:08 |
| thrash | EmilienM: will have more tomorrow. | 00:08 |
| *** ooolpbot has joined #tripleo | 00:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 00:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 00:10 |
| *** ooolpbot has quit IRC | 00:10 | |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 00:10 |
| EmilienM | thrash: ok | 00:15 |
| EmilienM | thrash: thanks! | 00:16 |
| *** garyk has joined #tripleo | 00:43 | |
| *** artom has quit IRC | 00:48 | |
| *** artom has joined #tripleo | 00:49 | |
| *** artom has quit IRC | 00:50 | |
| *** artom has joined #tripleo | 00:50 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Fix repos for promotion jobs https://review.openstack.org/460558 | 00:55 |
| *** garyk has quit IRC | 00:57 | |
| *** therve has quit IRC | 00:59 | |
| *** eck`gone is now known as eck` | 01:00 | |
| *** tiswanso has joined #tripleo | 01:01 | |
| *** jkilpatr has quit IRC | 01:02 | |
| *** tiswanso has quit IRC | 01:02 | |
| *** tiswanso has joined #tripleo | 01:03 | |
| *** therve has joined #tripleo | 01:04 | |
| *** ooolpbot has joined #tripleo | 01:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 01:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 01:10 |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 01:10 |
| *** ooolpbot has quit IRC | 01:10 | |
| *** limao has joined #tripleo | 01:16 | |
| *** tzumainn has quit IRC | 01:31 | |
| *** gbarros has joined #tripleo | 01:31 | |
| *** dixiaoli has joined #tripleo | 01:33 | |
| *** gbarros has quit IRC | 01:37 | |
| *** gvrangan has quit IRC | 01:38 | |
| *** dmacpher has quit IRC | 01:43 | |
| *** gvrangan has joined #tripleo | 01:48 | |
| *** enrraja has joined #tripleo | 02:01 | |
| *** gvrangan_ has joined #tripleo | 02:06 | |
| *** ooolpbot has joined #tripleo | 02:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 02:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 02:10 |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 02:10 |
| *** ooolpbot has quit IRC | 02:10 | |
| *** gvrangan has quit IRC | 02:22 | |
| *** yolanda has joined #tripleo | 02:26 | |
| *** gbarros has joined #tripleo | 02:31 | |
| *** fragatina has joined #tripleo | 02:51 | |
| *** gvrangan has joined #tripleo | 02:51 | |
| *** fragatina has quit IRC | 02:53 | |
| *** gvrangan_ has quit IRC | 02:53 | |
| *** fragatina has joined #tripleo | 02:53 | |
| *** fragatin_ has quit IRC | 02:54 | |
| *** fragatin_ has joined #tripleo | 03:01 | |
| *** Lokesh_Jain__ has joined #tripleo | 03:04 | |
| *** igorbelikov_ has joined #tripleo | 03:04 | |
| *** fragatina has quit IRC | 03:04 | |
| *** vpickard has joined #tripleo | 03:05 | |
| *** fragatin_ has quit IRC | 03:05 | |
| *** slagle__ has joined #tripleo | 03:07 | |
| *** enrraja has quit IRC | 03:08 | |
| *** rlandy|afk is now known as rlandy | 03:09 | |
| *** ooolpbot has joined #tripleo | 03:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 03:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 03:10 |
| *** ooolpbot has quit IRC | 03:10 | |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 03:10 |
| *** kbyrne_ has joined #tripleo | 03:10 | |
| *** gvrangan_ has joined #tripleo | 03:11 | |
| *** yolanda has quit IRC | 03:11 | |
| *** tdasilva- has quit IRC | 03:11 | |
| *** slagle has quit IRC | 03:11 | |
| *** rodrigod` has quit IRC | 03:11 | |
| *** hexo has quit IRC | 03:11 | |
| *** leanderthal|afk has quit IRC | 03:11 | |
| *** Lokesh_Jain_ has quit IRC | 03:11 | |
| *** vpickard_ has quit IRC | 03:11 | |
| *** hamzy has quit IRC | 03:11 | |
| *** pblaho has quit IRC | 03:11 | |
| *** portdirect has quit IRC | 03:11 | |
| *** igorbelikov has quit IRC | 03:11 | |
| *** kbyrne has quit IRC | 03:11 | |
| *** rodrigods has joined #tripleo | 03:11 | |
| *** kbyrne_ is now known as kbyrne | 03:11 | |
| *** Lokesh_Jain__ is now known as Lokesh_Jain_ | 03:11 | |
| *** igorbelikov_ is now known as igorbelikov | 03:11 | |
| *** ramishra has joined #tripleo | 03:13 | |
| *** hexo has joined #tripleo | 03:14 | |
| *** yolanda has joined #tripleo | 03:17 | |
| *** leanderthal|afk has joined #tripleo | 03:18 | |
| *** pblaho has joined #tripleo | 03:18 | |
| *** hamzy has joined #tripleo | 03:19 | |
| *** funzo has joined #tripleo | 03:20 | |
| *** mich_chap has joined #tripleo | 03:22 | |
| *** tdasilva has joined #tripleo | 03:23 | |
| *** funzo has quit IRC | 03:25 | |
| *** psahoo has joined #tripleo | 03:26 | |
| *** dixiaoli has quit IRC | 03:30 | |
| *** gvranga__ has joined #tripleo | 03:44 | |
| *** gvrangan_ has quit IRC | 03:45 | |
| *** gvranga__ has quit IRC | 03:54 | |
| *** gvrangan has quit IRC | 03:58 | |
| *** gvrangan has joined #tripleo | 03:59 | |
| *** ykarel has joined #tripleo | 04:03 | |
| *** ooolpbot has joined #tripleo | 04:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 04:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 04:10 |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 04:10 |
| *** ooolpbot has quit IRC | 04:10 | |
| *** gvrangan_ has joined #tripleo | 04:10 | |
| *** gvrangan has quit IRC | 04:16 | |
| *** ykarel has quit IRC | 04:17 | |
| *** ykarel has joined #tripleo | 04:17 | |
| *** gbarros has joined #tripleo | 04:17 | |
| *** yamahata has quit IRC | 04:35 | |
| *** fragatina has joined #tripleo | 04:39 | |
| *** fragatina has quit IRC | 04:40 | |
| *** fragatina has joined #tripleo | 04:40 | |
| *** gvrangan_ has quit IRC | 04:44 | |
| *** ratailor has joined #tripleo | 04:57 | |
| *** gvrangan has joined #tripleo | 04:59 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add bzip2 to test install https://review.openstack.org/462366 | 05:00 |
| bandini | EmilienM: looking sec | 05:03 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add --params to dib-block-device in cleanup https://review.openstack.org/462369 | 05:03 |
| bandini | EmilienM: hohum that error means the patch was not applied though https://review.openstack.org/#/c/462073/ | 05:06 |
| *** limao has quit IRC | 05:06 | |
| * bandini looks more | 05:06 | |
| *** limao has joined #tripleo | 05:07 | |
| bandini | EmilienM: I think it was a temporary glitch I see most updates jobs passing and I checked the ipv6 vip is correctly set/configured | 05:09 |
| bandini | EmilienM: and thanks for the rdo puppet-pacemaker change :) | 05:09 |
| *** ooolpbot has joined #tripleo | 05:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 05:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 05:10 |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 05:10 |
| *** ooolpbot has quit IRC | 05:10 | |
| *** gbarros has quit IRC | 05:10 | |
| *** portdirect has joined #tripleo | 05:13 | |
| *** prateek has joined #tripleo | 05:16 | |
| *** enrraja has joined #tripleo | 05:18 | |
| *** hjensas has quit IRC | 05:18 | |
| *** links has joined #tripleo | 05:18 | |
| *** funzo has joined #tripleo | 05:21 | |
| *** funzo has quit IRC | 05:25 | |
| *** mich_chap has quit IRC | 05:26 | |
| *** gkadam has quit IRC | 05:31 | |
| *** gkadam has joined #tripleo | 05:34 | |
| *** dsariel_ has joined #tripleo | 05:37 | |
| *** pgadiya has joined #tripleo | 05:39 | |
| *** japestinho has quit IRC | 05:40 | |
| *** janki has joined #tripleo | 05:40 | |
| *** lmiccini has joined #tripleo | 05:40 | |
| *** ykarel_ has joined #tripleo | 05:43 | |
| *** ykarel has quit IRC | 05:45 | |
| *** iranzo has joined #tripleo | 05:46 | |
| *** iranzo has joined #tripleo | 05:46 | |
| *** dsneddon has quit IRC | 05:47 | |
| *** yprokule has joined #tripleo | 05:47 | |
| *** dsneddon has joined #tripleo | 05:48 | |
| *** enrraja has quit IRC | 05:51 | |
| *** ykarel_ has quit IRC | 05:52 | |
| *** ykarel_ has joined #tripleo | 05:53 | |
| *** masco has joined #tripleo | 05:54 | |
| *** dparkes has joined #tripleo | 05:55 | |
| *** anshul has joined #tripleo | 05:57 | |
| *** hjensas has joined #tripleo | 05:59 | |
| *** gkadam has quit IRC | 06:00 | |
| *** gkadam has joined #tripleo | 06:01 | |
| *** dciabrin has joined #tripleo | 06:06 | |
| *** mdnadeem has joined #tripleo | 06:07 | |
| *** dsariel_ has quit IRC | 06:08 | |
| *** ooolpbot has joined #tripleo | 06:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 06:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 06:10 |
| *** ooolpbot has quit IRC | 06:10 | |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 06:10 |
| *** jprovazn has joined #tripleo | 06:12 | |
| *** brault has quit IRC | 06:19 | |
| *** dsariel_ has joined #tripleo | 06:20 | |
| *** udesale has joined #tripleo | 06:24 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Add bzip2 to test install https://review.openstack.org/462366 | 06:29 |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: Fix network isolation args for ovb oooq job https://review.openstack.org/462278 | 06:30 |
| *** ebarrera has joined #tripleo | 06:37 | |
| *** enrraja has joined #tripleo | 06:44 | |
| *** pcaruana has joined #tripleo | 06:45 | |
| *** dsariel_ has quit IRC | 06:46 | |
| *** limao has quit IRC | 06:53 | |
| *** limao has joined #tripleo | 06:54 | |
| *** limao has quit IRC | 06:57 | |
| *** limao has joined #tripleo | 06:57 | |
| *** dsariel_ has joined #tripleo | 06:58 | |
| *** ccamacho has joined #tripleo | 07:02 | |
| *** zoli|gone is now known as zoli | 07:02 | |
| *** jlinkes has joined #tripleo | 07:03 | |
| *** shardy has joined #tripleo | 07:08 | |
| *** ooolpbot has joined #tripleo | 07:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 07:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 07:10 |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 07:10 |
| *** ooolpbot has quit IRC | 07:10 | |
| *** nyechiel has joined #tripleo | 07:16 | |
| *** ffiore has joined #tripleo | 07:16 | |
| *** funzo has joined #tripleo | 07:22 | |
| *** funzo has quit IRC | 07:26 | |
| *** bogdando has joined #tripleo | 07:27 | |
| *** tesseract has joined #tripleo | 07:29 | |
| *** jpich has joined #tripleo | 07:35 | |
| *** jpena|off is now known as jpena | 07:40 | |
| *** pmannidi has quit IRC | 07:46 | |
| *** amoralej|off is now known as amoralej | 07:46 | |
| *** ffiore has quit IRC | 07:47 | |
| *** karimb has joined #tripleo | 07:49 | |
| *** sid1 has joined #tripleo | 07:53 | |
| *** yprokule_ has joined #tripleo | 07:55 | |
| *** zoli is now known as zoli|afk | 07:56 | |
| *** dtantsur|afk is now known as dtantsur | 07:56 | |
| *** yprokule has quit IRC | 07:57 | |
| *** yprokule_ is now known as yprokule | 07:57 | |
| *** zzzeek has quit IRC | 08:00 | |
| *** zzzeek has joined #tripleo | 08:00 | |
| bandini | any brave soul around to review https://review.openstack.org/#/c/460724/ ? | 08:05 |
| *** ffiore has joined #tripleo | 08:05 | |
| *** sid1 has quit IRC | 08:06 | |
| *** ooolpbot has joined #tripleo | 08:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 08:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 08:10 |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 08:10 |
| *** ooolpbot has quit IRC | 08:10 | |
| *** yprokule_ has joined #tripleo | 08:10 | |
| *** udesale has quit IRC | 08:11 | |
| *** yprokule has quit IRC | 08:12 | |
| *** yprokule_ is now known as yprokule | 08:12 | |
| shardy | bandini: Hey, looking - one question - do we want that to run on nodes where pacemaker_remote is or only pacemaker itself? | 08:13 |
| *** lucas-afk is now known as lucasagomes | 08:13 | |
| *** udesale has joined #tripleo | 08:14 | |
| bandini | shardy: thanks. only where pacemaker is running (aka we need to run that code only on a single node across the entire overcloud) | 08:14 |
| *** jaosorior_away is now known as jaosorior | 08:14 | |
| shardy | bandini: Ok, my question is because the service_names | grep will match both, but I assume the is-active will return false on non-controller nodes? | 08:14 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE: Testing LDAP integration https://review.openstack.org/461865 | 08:14 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Deploy FreeIPA-backed LDAP domain for keystone in fakeha-caserver job https://review.openstack.org/461864 | 08:14 |
| shardy | bandini: and is the is-active thing enough to run only on one node, or do we need to match the bootstrap_nodeid? | 08:15 |
| shardy | bandini: On nvm you've got that test below | 08:16 |
| bandini | shardy: I think we should be covered by line 51 in yum_update.sh | 08:16 |
| shardy | bandini: ack, thanks, yeah I need some coffee ;) | 08:16 |
| bandini | shardy: we all do, *all* the time :) | 08:17 |
| shardy | hehe :) | 08:17 |
| marios | o/ morning folks | 08:17 |
| bandini | yo marios | 08:18 |
| matbu | marios: o/ | 08:18 |
| bandini | o/ matbu | 08:19 |
| shardy | bandini: lgtm, but I think we could avoid matching pacemaker_remote by testing for pacemaker_enabled in hiera instead | 08:19 |
| bandini | let me check | 08:19 |
| shardy | happy to approve if you'd rather that was a follow-up | 08:19 |
| shardy | but I think that may provide a stricter match | 08:20 |
| bandini | shardy: oh I see. I did not touch that code (just moved it up a bit). I'll fix it up in a follow up then, since logically, it is a different change | 08:21 |
| bandini | shardy++ nice catch | 08:21 |
| *** paramite has joined #tripleo | 08:21 | |
| *** ffiore_ has joined #tripleo | 08:21 | |
| *** ffiore has quit IRC | 08:22 | |
| shardy | Hmm the upgrade job failed because it can't find post_puppet_pacemaker.yaml | 08:22 |
| *** sid1 has joined #tripleo | 08:23 | |
| * shardy recalls ccamacho may have a patch related to that | 08:23 | |
| *** brault has joined #tripleo | 08:24 | |
| ccamacho | hey shardy, yeahp Im actually checking it I filled https://bugs.launchpad.net/tripleo/+bug/1687908 and checking the code in the python tripleoclient | 08:24 |
| openstack | Launchpad bug 1687908 in tripleo "Could not fetch contents for file:///usr/share/openstack-tripleo-heat-templates/extraconfig/tasks/post_puppet_pacemaker.yaml" [High,Triaged] | 08:24 |
| shardy | ccamacho: Ok so it's broken since the j2 rendering | 08:26 |
| shardy | the path looks wrong, it should be rewritten in tripleoclient to point to the tmpdir with the rendered files | 08:26 |
| shardy | ccamacho: can you reproduce this locally? | 08:26 |
| shardy | I can probably help with the tripleoclient code, as I've unfortunately had to fix it a few times myself | 08:26 |
| *** gvrangan has quit IRC | 08:27 | |
| ccamacho | shardy that would be awesome :) | 08:27 |
| ccamacho | Im trying to reproduce it but getting errors in my ooq undercloud :( | 08:27 |
| shardy | ccamacho: Ok, I have some other things to test first but let me know if you want me to try | 08:27 |
| *** karimb has quit IRC | 08:28 | |
| ccamacho | shardy Ill try to fix my env to test it, hopefully soon, I already did some changes but want to test them first | 08:29 |
| ccamacho | Ill let you know | 08:29 |
| ccamacho | thanks for asking! | 08:29 |
| *** zoli|afk is now known as zoli | 08:29 | |
| *** chem_gone is now known as chem | 08:29 | |
| matbu | ccamacho: shardy i can help, this bug is my crux :) | 08:30 |
| matbu | ccamacho: where did you see it ? | 08:30 |
| ccamacho | ahahaha matbu help is welcomed, in every job https://bugs.launchpad.net/tripleo/+bug/1687908 | 08:31 |
| openstack | Launchpad bug 1687908 in tripleo "Could not fetch contents for file:///usr/share/openstack-tripleo-heat-templates/extraconfig/tasks/post_puppet_pacemaker.yaml" [High,Triaged] | 08:31 |
| ccamacho | *** I mean in every multinode upgrade job | 08:31 |
| ccamacho | matbu shardy's comments seems sharp and accurate "the path looks wrong, it should be rewritten in tripleoclient to point to the tmpdir with the rendered files" | 08:33 |
| * shardy looks for more clues in the logs | 08:33 | |
| matbu | ccamacho: generaly when it appear, its due to an issue with the path in the deploy command | 08:34 |
| shardy | http://logs.openstack.org/24/460724/12/check/gate-tripleo-ci-centos-7-multinode-upgrades-nv/b18052c/logs/var/log/mistral/executor.txt.gz#_2017-05-04_06_12_23_870 | 08:34 |
| shardy | you can see it get rendered there | 08:35 |
| *** gvrangan has joined #tripleo | 08:36 | |
| *** derekh has joined #tripleo | 08:36 | |
| *** hjensas_ has joined #tripleo | 08:38 | |
| *** athomas has joined #tripleo | 08:38 | |
| *** ubijtsa is now known as assassin | 08:41 | |
| ccamacho | yeahp shardy its rendered correctly, also as you told me with process-templates.py it also gets generated | 08:41 |
| shardy | ccamacho: OK I think I see why | 08:42 |
| shardy | http://logs.openstack.org/24/460724/12/check/gate-tripleo-ci-centos-7-multinode-upgrades-nv/b18052c/console.html#_2017-05-04_06_12_55_100829 | 08:42 |
| shardy | --templates /opt/stack/new/ocata//usr/share/openstack-tripleo-heat-templates | 08:42 |
| shardy | -e /usr/share/openstack-tripleo-heat-templates/ci/environments/multinode.yaml | 08:44 |
| shardy | we're mixing the path prefix for before/after t-h-t locations | 08:44 |
| shardy | and tripleoclient matches that prefix to calculate the relative paths | 08:44 |
| *** mcornea has joined #tripleo | 08:45 | |
| *** Tyrantelf has quit IRC | 08:45 | |
| shardy | I thought EmilienM had a patch for that, sec | 08:45 |
| bogdando | shardy: hi. The patch for ansible tasks is great. Not sure if my comments for ansible shell/command idempotency isn't just a nitpicking, but it seems a best practice we should follow | 08:45 |
| *** Tyrantelf has joined #tripleo | 08:45 | |
| bogdando | even though quickstart roles may not always do... | 08:45 |
| ccamacho | I see, so the tripleoclient should be healthy then :) | 08:46 |
| shardy | ccamacho: Yeah I think it's a CI issue | 08:47 |
| shardy | bogdando: thanks for the feedback, I'll test and update the patch | 08:47 |
| *** karimb has joined #tripleo | 08:50 | |
| *** zoli is now known as zoli|lunch | 08:52 | |
| *** ratailor_ has joined #tripleo | 08:52 | |
| *** ratailor has quit IRC | 08:55 | |
| *** ckyriakidou has joined #tripleo | 08:57 | |
| *** suuuper has joined #tripleo | 08:57 | |
| *** salmankhan has joined #tripleo | 08:59 | |
| *** karimb has quit IRC | 09:00 | |
| openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Use mixed release for container upgrade https://review.openstack.org/460061 | 09:00 |
| *** karimb has joined #tripleo | 09:02 | |
| *** sid1 has quit IRC | 09:06 | |
| *** ooolpbot has joined #tripleo | 09:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 09:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 09:10 |
| *** ooolpbot has quit IRC | 09:10 | |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 09:10 |
| *** tosky has joined #tripleo | 09:11 | |
| *** tosky has quit IRC | 09:11 | |
| *** enrraja has quit IRC | 09:11 | |
| *** tosky has joined #tripleo | 09:12 | |
| shardy | mandre, sshnaidm|afk: we still have a problem with the undercloud-containers-nv job because check-tripleo-undercloud-jobs isn't a template that's applied to t-h-t | 09:14 |
| shardy | I'll push another project-config patch | 09:14 |
| sshnaidm|afk | shardy, we need to add this job only, not check-tripleo-undercloud template | 09:14 |
| *** sshnaidm|afk is now known as sshnaidm | 09:15 | |
| *** japestinho has joined #tripleo | 09:16 | |
| shardy | sshnaidm: Yes, https://review.openstack.org/462449 moves it | 09:17 |
| shardy | lets just get it running per commit on t-h-t as a first step | 09:17 |
| mandre | shardy: I already had https://review.openstack.org/#/c/462141/ | 09:19 |
| *** funzo has joined #tripleo | 09:19 | |
| *** enrraja has joined #tripleo | 09:19 | |
| shardy | mandre: Ok, I can abandon but IMO we need to remove it from check-tripleo-undercloud-jobs | 09:20 |
| shardy | that template is applied to a bunch of repos, most of which don't yet care about containers? | 09:20 |
| sshnaidm | shardy, it's for instack-undercloud, puppet-tripleo, tripleo-ci | 09:21 |
| sshnaidm | shardy, tripleo-ci definitely cares about containers | 09:21 |
| openstackgerrit | Christian Schwede proposed openstack/tripleo-heat-templates master: Add missing Swift services for containerized deployments https://review.openstack.org/445891 | 09:22 |
| shardy | sshnaidm: Ok but we're running it for instack-undercloud and tripleo-ui which don't add useful coverage I think | 09:23 |
| shardy | my point was lets get it stable on t-h-t first, but I guess we can burn resources on multiple repos if folks feel it's worthwhile | 09:23 |
| *** funzo has quit IRC | 09:24 | |
| sshnaidm | shardy, it's infra's resources, who cares :) | 09:26 |
| *** limao has quit IRC | 09:26 | |
| sshnaidm | (while Paul doesn't read it) | 09:27 |
| *** hjensas has quit IRC | 09:27 | |
| *** hjensas_ has quit IRC | 09:27 | |
| *** athomas has quit IRC | 09:27 | |
| *** hjensas has joined #tripleo | 09:28 | |
| *** pkovar has joined #tripleo | 09:29 | |
| openstackgerrit | Radomir Dopieralski proposed openstack/tripleo-heat-templates master: Containerize Horizon https://review.openstack.org/450303 | 09:35 |
| mandre | shardy: I see you point, as you wish, but then we'll have to add it to tripleo-ci and puppet-tripleo | 09:36 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Containerize Horizon https://review.openstack.org/450303 | 09:45 |
| *** links has quit IRC | 09:45 | |
| *** karimb has quit IRC | 09:47 | |
| *** michapma_dsk has joined #tripleo | 09:49 | |
| *** karimb has joined #tripleo | 09:50 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: Fix up pacemaker_status test in yum_update.sh https://review.openstack.org/462467 | 09:54 |
| openstackgerrit | Martin André proposed openstack/tripleo-heat-templates master: Containerize Horizon https://review.openstack.org/450303 | 09:55 |
| *** pratapagoutham has joined #tripleo | 09:56 | |
| openstackgerrit | Sagi Shnaidman proposed openstack/tripleo-quickstart master: Fix network isolation args for ovb oooq job https://review.openstack.org/462278 | 09:56 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Internal TLS: use common CA file parameter for libvirt CA cert https://review.openstack.org/460025 | 09:58 |
| *** milan has joined #tripleo | 09:58 | |
| *** remix_tj has quit IRC | 10:00 | |
| *** remix_tj has joined #tripleo | 10:02 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Initial VIP ipv6 minor update code https://review.openstack.org/460724 | 10:04 |
| *** testtest has joined #tripleo | 10:06 | |
| *** testtest has quit IRC | 10:06 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: Fix up pacemaker_status test in yum_update.sh https://review.openstack.org/462467 | 10:08 |
| *** jaganathan has joined #tripleo | 10:09 | |
| *** yolanda_ has joined #tripleo | 10:10 | |
| *** ooolpbot has joined #tripleo | 10:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 10:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 10:10 |
| *** ooolpbot has quit IRC | 10:10 | |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 10:10 |
| *** yolanda_ has quit IRC | 10:12 | |
| *** garyk has joined #tripleo | 10:13 | |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Fix overcloud image path and repo url https://review.openstack.org/459677 | 10:18 |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo stable/ocata: IPv6 VIP addresses need to be /128 https://review.openstack.org/462479 | 10:19 |
| *** vijaya has joined #tripleo | 10:20 | |
| vijaya | Hello | 10:20 |
| vijaya | we are having problem with tripleo quickstart..could someone help | 10:20 |
| vijaya | ? | 10:20 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates stable/ocata: Initial VIP ipv6 minor update code https://review.openstack.org/462480 | 10:20 |
| *** vijaya has left #tripleo | 10:21 | |
| *** vijaya_ has joined #tripleo | 10:22 | |
| *** ffiore_ has quit IRC | 10:23 | |
| *** athomas has joined #tripleo | 10:23 | |
| *** panda|bbl is now known as panda | 10:23 | |
| *** ffiore_ has joined #tripleo | 10:24 | |
| *** gfidente has joined #tripleo | 10:39 | |
| *** gfidente has quit IRC | 10:39 | |
| *** gfidente has joined #tripleo | 10:39 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-quickstart master: Add libvirt_cpu_model https://review.openstack.org/459768 | 10:40 |
| *** dmacpher has joined #tripleo | 10:40 | |
| *** dsariel_ has quit IRC | 10:43 | |
| *** ratailor_ has quit IRC | 10:46 | |
| vijaya_ | triplo quickstart installation failing with this error fatal: [undercloud]: FAILED! => {"changed": true, "cmd": "set -o pipefail && /home/stack/undercloud-install.sh 2>&1 | awk '{ print strftime(\"%Y-%m-%d %H:%M:%S |\"), $0; fflush(); }' > /home/stack/undercloud_install.log", "delta": "0:07:50.727177", "end": "2017-05-04 09:26:43.248571", "failed": true, "rc": 1, "start": "2017-05-04 09:18:52.521394", "stderr": "", "stdout": "", "std | 10:46 |
| *** brault_ has joined #tripleo | 10:48 | |
| *** brault has quit IRC | 10:49 | |
| openstackgerrit | Merged openstack/puppet-tripleo master: MySQL client: Make CA file configurable https://review.openstack.org/462062 | 10:50 |
| *** Ng has quit IRC | 10:51 | |
| *** Ng has joined #tripleo | 10:52 | |
| *** ChanServ sets mode: +v Ng | 10:52 | |
| *** jkilpatr has joined #tripleo | 10:53 | |
| *** ansmith has quit IRC | 10:53 | |
| sou|manos | Hi would there be anyone here that could help me with the tripleo-UI ? | 10:57 |
| *** zoli|lunch is now known as zliXXL | 10:58 | |
| *** zliXXL is now known as zoliXXL | 10:58 | |
| sou|manos | Just wondering if when selecting 'environments/network-environment.yaml' from Step 2 -> 'Edit Configuration' -> 'Options' -> 'environments/network-environment.yaml' if the various AllocationPools (InternalApiAllocationPools:, StorageAllocationPools: etc) are then exposed as parameters anywhere? - I can't for the life of me find them in the UI and need to set them as parameter_defaults: | 11:04 |
| *** jpena is now known as jpena|lunch | 11:04 | |
| jpich | sou|manos: Hi! Which version are you using? There's been major work to make environments and parameters easier to configure recently | 11:08 |
| sou|manos | Hi! - Im using the version bundled with Redhat's OpenStack Platform Director | 11:09 |
| sou|manos | OSPD 10 | 11:09 |
| *** ooolpbot has joined #tripleo | 11:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 11:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 11:10 |
| *** ooolpbot has quit IRC | 11:10 | |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 11:10 |
| sou|manos | Is there a command I can run to tell you exactly the version of the UI? | 11:10 |
| sou|manos | openstack-tripleo-ui.noarch 1.1.0-1.el7ost @rhel-7-server-openstack-10-rpms | 11:12 |
| *** pradk has joined #tripleo | 11:13 | |
| *** yolanda has quit IRC | 11:13 | |
| jpich | sou|manos: Right, so Newton timeframe... When I was testing with it I usually modified the networking templates before uploading the plan. It might be possible to change using the "ExtraConfig" parameter but I'm less familiar with it | 11:14 |
| jpich | jtomasek: Does that sound accurate? ^ | 11:14 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: DO NOT MERGE: Testing LDAP integration https://review.openstack.org/461865 | 11:16 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci master: Deploy FreeIPA-backed LDAP domain for keystone in fakeha-caserver job https://review.openstack.org/461864 | 11:16 |
| *** fzdarsky has joined #tripleo | 11:17 | |
| jtomasek | jpich, sou|manos: yes, the feature which allows configuring parameters in environments is not available in osp10 | 11:17 |
| *** dsariel_ has joined #tripleo | 11:17 | |
| *** atoth has joined #tripleo | 11:17 | |
| jtomasek | sou|manos: so you can either set the parameters in environment directly before uploading/updating them as plan | 11:17 |
| jtomasek | sou|manos: or try searching in roles detail and services in roles. maybe those parameters are there | 11:18 |
| jtomasek | roles detail is accessible via 'pencil' icon at role card | 11:18 |
| *** oidgar has joined #tripleo | 11:19 | |
| *** funzo has joined #tripleo | 11:20 | |
| *** gvrangan has quit IRC | 11:20 | |
| *** pgadiya has quit IRC | 11:21 | |
| sou|manos | ahh ok, thank you. I'll try out your suggestion and set them directly in 'environments/network-environment.yaml' and then upload as a new plan | 11:21 |
| *** paramite has quit IRC | 11:21 | |
| sou|manos | yep, I went through all the options in Roles -> Controller -> Parameter & Services tab and couldn't find them. It seems just about every other configuration item is there except these particular items. | 11:24 |
| sou|manos | thank you though. appreciate the help | 11:24 |
| sou|manos | ...unless they're named differently? - but I couldn't spot anything obvious | 11:25 |
| *** funzo has quit IRC | 11:25 | |
| *** gvrangan has joined #tripleo | 11:25 | |
| *** rbowen has joined #tripleo | 11:25 | |
| *** rbowen has quit IRC | 11:25 | |
| *** rbowen has joined #tripleo | 11:25 | |
| jtomasek | sou|manos: try to search the template files to check if the parameters are actually there | 11:25 |
| sou|manos | They are: [stack@scfp-v-r-unc-02 ~]$ cat /usr/share/openstack-tripleo-heat-templates/environments/network-environment.yaml | grep Pool | 11:26 |
| jtomasek | sou|manos: in newer releases there is a tab for each enabled environment which lets you set parameters specific for that certain environment file | 11:26 |
| sou|manos | InternalApiAllocationPools: [{'start': '172.17.0.10', 'end': '172.17.0.200'}] | 11:26 |
| sou|manos | StorageAllocationPools: [{'start': '172.18.0.10', 'end': '172.18.0.200'}] | 11:26 |
| sou|manos | etc | 11:26 |
| jtomasek | ok, yeah, so those parameters are probably defined in templates specific for that environment, so it is not available in UI in OSP10 | 11:27 |
| jpich | thanks, jtomasek | 11:29 |
| *** karimb has quit IRC | 11:29 | |
| sou|manos | cool. Stops me going mad trying to find them! - Redhat haven't released an updated tripleo-ui package into their repo's so I'll try your suggestions. Many thanks! | 11:30 |
| jpich | Good luck! | 11:31 |
| openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Use mixed release for container upgrade https://review.openstack.org/460061 | 11:31 |
| *** dtantsur is now known as dtantsur|brb | 11:33 | |
| *** ffiore_ has quit IRC | 11:33 | |
| EmilienM | shardy: hey, what's up? | 11:34 |
| *** EmilienM sets mode: +o shardy | 11:34 | |
| *** jaganathan has quit IRC | 11:35 | |
| shardy | EmilienM: Hey, ccamacho was looking into the issues with the upgrades CI that are due to mixing the old/new t-h-t environments | 11:35 |
| EmilienM | shardy: again? | 11:35 |
| shardy | http://logs.openstack.org/24/460724/12/check/gate-tripleo-ci-centos-7-multinode-upgrades-nv/b18052c/console.html#_2017-05-04_06_12_55_100829 | 11:36 |
| shardy | EmilienM: we're still mixing /usr/share with /opt/stack/new | 11:37 |
| shardy | I thought you had a patch for that, but perhaps I was mistaken | 11:37 |
| EmilienM | that was long time ago, I'll need to refresh my mind on this one | 11:37 |
| EmilienM | I'll look at it during the day | 11:40 |
| EmilienM | ccamacho: is it about https://bugs.launchpad.net/tripleo/+bug/1687908 ? | 11:41 |
| openstack | Launchpad bug 1687908 in tripleo "Could not fetch contents for file:///usr/share/openstack-tripleo-heat-templates/extraconfig/tasks/post_puppet_pacemaker.yaml" [High,Triaged] | 11:41 |
| hjensas | I keep hitting this when testing instack_undercloud: http://paste.openstack.org/show/608850/ - I belive I have the latest packages from https://trunk.rdoproject.org/centos7/4f/97/4f97537a5171a8ca4c2d2e8fab4453f794814801_f98deee5/. | 11:42 |
| *** shardy is now known as shardy_lunch | 11:43 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Run introspection 20 nodes at a time https://review.openstack.org/439568 | 11:43 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: NO MERGEY - testing low concurrency https://review.openstack.org/449215 | 11:43 |
| *** limao has joined #tripleo | 11:44 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Run introspection 20 nodes at a time https://review.openstack.org/439568 | 11:45 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: NO MERGEY - testing low concurrency https://review.openstack.org/449215 | 11:45 |
| *** morazi has joined #tripleo | 11:46 | |
| vijaya_ | anyone available to help me with tripleo quickstart? | 11:47 |
| adarazs | vijaya_: what's your problem? | 11:48 |
| vijaya_ | we are having problem with undercloud installation? script to install undercloud is not getting generated through ansible | 11:48 |
| vijaya_ | TASK [undercloud-deploy : Install the undercloud] ****************************** task path: /root/.quickstart/usr/local/share/ansible/roles/undercloud-deploy/tasks/install-undercloud.yml:15 Thursday 04 May 2017 11:18:50 +0200 (0:00:04.106) 0:07:56.215 ********** fatal: [undercloud]: FAILED! => {"changed": true, "cmd": "set -o pipefail && /home/stack/undercloud-install.sh 2>&1 | awk '{ print strftime(\"%Y-%m-%d %H:%M:%S |\"), | 11:49 |
| adarazs | vijaya_: can you show me the complete output including the quickstart.sh command you run? you can paste it in http://paste.openstack.org/ or something. | 11:49 |
| vijaya_ | http://paste.openstack.org/show/608851/ | 11:51 |
| vijaya_ | here is the full log | 11:51 |
| vijaya_ | @adarazs can you please check | 11:52 |
| adarazs | vijaya_: also looking at the output... don't run quickstart as root, it's one of the first note in the documentation: https://docs.openstack.org/developer/tripleo-quickstart/readme.html#tripleo-quickstart | 11:52 |
| *** athomas has quit IRC | 11:52 | |
| adarazs | that's probably not your problem, but it's better. | 11:52 |
| *** fzdarsky has quit IRC | 11:54 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add resource to fetch CRL https://review.openstack.org/462514 | 11:54 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Use CRL for HAProxy https://review.openstack.org/462515 | 11:54 |
| vijaya_ | for me ansible and virthost are the same ..okay I can give it a try as other user as well | 11:54 |
| vijaya_ | let me know if tou find anything | 11:54 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates master: Fix up pacemaker_status test in yum_update.sh https://review.openstack.org/462467 | 11:54 |
| *** amoralej is now known as amoralej|lunch | 11:55 | |
| *** limao has quit IRC | 11:55 | |
| adarazs | vijaya_: there's only the first 595 lines in that paste. anyway, the easiest thing is to give a go like this: create another user on that machine and make sure you can ssh into the machine as root@localhost from that user (set up the public key authentication) | 11:55 |
| *** atoth has quit IRC | 11:56 | |
| jistr | ...aaand container upgrades job is down again due to "downgrading" instead of upgrading http://logs.openstack.org/04/447504/8/experimental/gate-tripleo-ci-centos-7-containers-multinode-upgrades-nv/be79296/logs/subnode-2/var/log/messages.txt.gz#_May__4_10_50_05 | 11:56 |
| adarazs | vijaya_: then use 127.0.0.2 as the machine IP when you start quickstart. that's a .2 at the end, so 127.0.0.*2*... and see if it works. | 11:56 |
| vijaya_ | okay | 11:56 |
| jistr | i have WIP patches posted to make the job O->P, locally i've already succeded with a fully OOOQ-driven upgrade (whohoo! \o/) but not in CI yet | 11:57 |
| *** jpena|lunch is now known as jpena | 11:57 | |
| jistr | cc mandre shardy_lunch ^ | 11:57 |
| adarazs | vijaya_: then if it still fails I'll need the full logs and probably the undercloud deployment logs from the undercloud too. | 11:57 |
| jistr | testing it right now in CI at https://review.openstack.org/#/c/460061 | 11:58 |
| *** salmankhan has quit IRC | 11:59 | |
| *** jayg|g0n3 is now known as jayg | 12:01 | |
| *** yamahata has joined #tripleo | 12:04 | |
| *** udesale has quit IRC | 12:07 | |
| *** enrraja has quit IRC | 12:09 | |
| *** ooolpbot has joined #tripleo | 12:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 12:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 12:10 |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 12:10 |
| *** ooolpbot has quit IRC | 12:10 | |
| *** fpan has joined #tripleo | 12:11 | |
| *** tvignaud_ has quit IRC | 12:11 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Convert puppet and docker steps to ansible https://review.openstack.org/462211 | 12:14 |
| *** lucasagomes is now known as lucas-hungry | 12:14 | |
| openstackgerrit | Harald Jensås proposed openstack/instack-undercloud master: Tripleo routed networks ironic inspector, and Undercloud https://review.openstack.org/437544 | 12:16 |
| shardy_lunch | d0ugal: hey could you revisit https://review.openstack.org/#/c/458407/ when you get a moment, I think it's good to land now | 12:16 |
| *** shardy_lunch is now known as shardy | 12:16 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Configure crl file for HAProxy https://review.openstack.org/462526 | 12:17 |
| mandre | jistr: ack, thanks for the heads up | 12:19 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Use CRL for HAProxy https://review.openstack.org/462515 | 12:19 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add resource to fetch CRL https://review.openstack.org/462514 | 12:19 |
| mandre | jistr: it's caused by containers that are too old, right? | 12:19 |
| jistr | mandre: yea exactly | 12:20 |
| d0ugal | shardy: sure thing | 12:20 |
| *** masco has quit IRC | 12:20 | |
| *** liverpooler has joined #tripleo | 12:22 | |
| *** rlandy has joined #tripleo | 12:23 | |
| *** dprince has joined #tripleo | 12:24 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-quickstart-extras master: Don't overwrite tht_dir for upgrades to master https://review.openstack.org/462172 | 12:24 |
| sshnaidm | has anybody seen nova errors like: AttributeError: 'Instance' object has no attribute '_save_tags' ? | 12:25 |
| adarazs | sshnaidm: nope. | 12:25 |
| adarazs | sshnaidm: where do you see it? | 12:25 |
| sshnaidm | adarazs, http://logs.openstack.org/78/462278/3/check-tripleo/gate-tripleo-ci-centos-7-ovb-ha-oooq-nv/c996893/logs/overcloud-controller-1/var/log/nova/nova-conductor.log.txt.gz | 12:25 |
| *** tvignaud_ has joined #tripleo | 12:26 | |
| adarazs | oh, you're looking at the ovb-ha job, awesome :) | 12:26 |
| sshnaidm | adarazs, in ovb-ha-oooq job in pingtest | 12:26 |
| shardy | sshnaidm: no but there has just been a new novaclient release which could be related ;) | 12:26 |
| *** ffiore_ has joined #tripleo | 12:26 | |
| *** eck` is now known as eck`gone | 12:26 | |
| adarazs | that indeed sounds suspicious. | 12:27 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Internal TLS: Use specific CA file for mysql-client https://review.openstack.org/462066 | 12:28 |
| *** yolanda has joined #tripleo | 12:29 | |
| *** abishop has joined #tripleo | 12:30 | |
| adarazs | shardy, sshnaidm: though we should see the same problem in the non-oooq job as well, because we issue the same commands. | 12:32 |
| ccamacho | hey EmilienM shardy I was getting lunch | 12:33 |
| *** psahoo has quit IRC | 12:33 | |
| ccamacho | Emilien if there is no patch to fix CI Ill check it | 12:33 |
| *** tiswanso has quit IRC | 12:33 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Use CRL for HAProxy https://review.openstack.org/462515 | 12:34 |
| shardy | ccamacho: I thought there was one but I've failed to find it | 12:34 |
| EmilienM | ccamacho: ok thanks, I haven't looked at it yet | 12:34 |
| shardy | ccamacho: so go ahead - basically we need to ensure all paths match --templates foo | 12:34 |
| shardy | and the same when we switch --templates during the upgrade | 12:34 |
| *** lucas-hungry is now known as lucasagomes | 12:34 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Configure crl file for HAProxy https://review.openstack.org/462526 | 12:34 |
| ccamacho | oki, shardy EmilienM ill play with the config | 12:35 |
| *** athomas has joined #tripleo | 12:36 | |
| *** tvignaud_ has quit IRC | 12:36 | |
| *** ratailor has joined #tripleo | 12:37 | |
| *** dmacpher has quit IRC | 12:39 | |
| *** artom has quit IRC | 12:39 | |
| slagle__ | ccamacho: EmilienM : are we good to go ahead and merge this one? https://review.openstack.org/#/c/459572/ | 12:40 |
| *** slagle__ is now known as slagle | 12:40 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add a variable for the dir where the repo is built https://review.openstack.org/461411 | 12:40 |
| slagle | it passed CI on PS3 | 12:40 |
| ccamacho | hey slagle its hitting the issue with the gate multinode-upgrades | 12:41 |
| ccamacho | slagle this one https://bugs.launchpad.net/tripleo/+bug/1687908 | 12:41 |
| openstack | Launchpad bug 1687908 in tripleo "Could not fetch contents for file:///usr/share/openstack-tripleo-heat-templates/extraconfig/tasks/post_puppet_pacemaker.yaml" [High,Triaged] | 12:41 |
| *** jaganathan has joined #tripleo | 12:41 | |
| slagle | ccamacho: oh, i see that | 12:41 |
| slagle | might need to backport the other patch first | 12:41 |
| ccamacho | slagle yeahp backport the fix to CI | 12:42 |
| *** fzdarsky has joined #tripleo | 12:42 | |
| ccamacho | and then it should be fine | 12:42 |
| ccamacho | slagle im trying to check the scripts for running the job and make them use the same path | 12:43 |
| shardy | ccamacho: I think the Change-Id is wrong? | 12:43 |
| shardy | not sure how that happened when the commit reference is correct :) | 12:43 |
| thrash | EmilienM: I think I see the issue now... | 12:43 |
| thrash | EmilienM: Let me put up a mistral patch, and you can try depending on it.. | 12:44 |
| EmilienM | thrash: sounds good to me | 12:45 |
| vijaya_ | @adarazs it still fails at the same point | 12:46 |
| vijaya_ | http://paste.openstack.org/show/608858/ | 12:46 |
| vijaya_ | here are the logs | 12:46 |
| ccamacho | mm shardy yeahp , I should have done something wrong when cherry picking the change, In any case Ill check it after fixing the CI issue :) | 12:47 |
| vijaya_ | these are first 600 lines | 12:47 |
| adarazs | vijaya_: I don't see the end of the output in that paste, it only goes to 686 | 12:47 |
| *** tvignaud_ has joined #tripleo | 12:48 | |
| adarazs | vijaya_: so is it still failing on the undercloud deployment? | 12:48 |
| *** ansmith has joined #tripleo | 12:48 | |
| vijaya_ | yes | 12:48 |
| *** ffiore_ has quit IRC | 12:48 | |
| vijaya_ | skipping: [undercloud] => {"changed": false, "skip_reason": "Conditional check failed", "skipped": true} | 12:49 |
| vijaya_ | many tasks were skipped with this reason | 12:49 |
| *** panda is now known as panda|ko | 12:49 | |
| adarazs | that's normal. | 12:49 |
| adarazs | vijaya_: can you login to the undercloud and check the undercloud install log? | 12:50 |
| adarazs | vijaya_: $ ssh -F ~/.quickstart/ssh.config.ansible undercloud | 12:50 |
| adarazs | and there check the undercloud_install.log file for errors. | 12:50 |
| vijaya_ | undercloud VM is not installed | 12:50 |
| adarazs | vijaya_: what virthost are you using? is it centos? do you have enough space on it? did you update the packages recently? | 12:51 |
| vijaya_ | script to install undercloud is not present | 12:51 |
| *** limao has joined #tripleo | 12:51 | |
| vijaya_ | no redhat 7.3 I am using | 12:51 |
| *** chem has quit IRC | 12:51 | |
| vijaya_ | I have 320GB available | 12:52 |
| *** chem has joined #tripleo | 12:52 | |
| pradk | can i get some reviews on https://review.openstack.org/#/c/462237/ please | 12:52 |
| vijaya_ | unser / | 12:52 |
| *** ratailor_ has joined #tripleo | 12:52 | |
| *** salmankhan has joined #tripleo | 12:52 | |
| *** ffiore_ has joined #tripleo | 12:53 | |
| *** jmelvin has joined #tripleo | 12:53 | |
| adarazs | vijaya_: RHEL 7.3 should work... I'd really need to see the full output. maybe https://paste.fedoraproject.org/ can take longer logs? | 12:53 |
| d0ugal | thrash: when you get some time, could you review this? https://review.openstack.org/#/c/439568 | 12:54 |
| openstackgerrit | Justin Kilpatrick proposed openstack/tripleo-quickstart-extras master: Add config for many node RDO cloud job https://review.openstack.org/459830 | 12:54 |
| shardy | pradk: done | 12:54 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Move iscsid to a container https://review.openstack.org/462538 | 12:54 |
| thrash | d0ugal: will do... trying to finish up the keystone mistal stuff | 12:54 |
| pradk | thx shardy ! | 12:54 |
| *** vkhanna has joined #tripleo | 12:54 | |
| d0ugal | thrash: sure, no huge rush. | 12:54 |
| vijaya_ | https://paste.fedoraproject.org/paste/aJE2GH1yWn7OKmx5F7ezLl5M1UNdIGYhyRLivL9gydE= | 12:55 |
| vijaya_ | full log is here | 12:55 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: TLS everywhere: configure mongodb's TLS settings https://review.openstack.org/461780 | 12:56 |
| *** ratailor has quit IRC | 12:56 | |
| *** brault has joined #tripleo | 12:56 | |
| *** brault_ has quit IRC | 12:57 | |
| sshnaidm | adarazs, omg, gate-tripleo-ci-centos-7-ovb-ha-oooq-nv passes: https://review.openstack.org/#/c/462278/ \o/ \o/ | 12:57 |
| adarazs | sshnaidm++ | 12:57 |
| sshnaidm | adarazs, let's merge it asap while it passes :D | 12:57 |
| adarazs | sshnaidm: \o/ :D | 12:57 |
| shardy | lol, good work guys :) | 12:57 |
| *** Goneri has joined #tripleo | 12:58 | |
| *** paramite has joined #tripleo | 12:59 | |
| *** rbowen has quit IRC | 13:00 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates master: Add StackUpdateType to set hiera on upgrade https://review.openstack.org/438044 | 13:01 |
| *** pratapagoutham has quit IRC | 13:01 | |
| *** amoralej|lunch is now known as amoralej | 13:01 | |
| *** oidgar has quit IRC | 13:02 | |
| *** jaganathan has quit IRC | 13:02 | |
| openstackgerrit | Damien Ciabrini proposed openstack/puppet-tripleo master: WIP galera HA docker container https://review.openstack.org/455345 | 13:05 |
| *** tiswanso has joined #tripleo | 13:06 | |
| adarazs | vijaya_: I'm looking at your logs. | 13:06 |
| vijaya_ | thanks adarazs | 13:07 |
| adarazs | vijaya_: it does look like the undercloud-install.sh is created from your logs. | 13:08 |
| adarazs | vijaya_: can you ssh into the undercloud? | 13:08 |
| vijaya_ | [root@rhel-ironic ~]# ls -l /home/stack/undercloud-install.sh ls: cannot access /home/stack/undercloud-install.sh: No such file or directory | 13:09 |
| adarazs | vijaya_: you're not on the undercloud, you're on the virthost. | 13:09 |
| adarazs | vijaya_: the undercloud is a VM running on the virthost. | 13:09 |
| adarazs | vijaya_: you can access it by sshing into it with $ ssh -F ~/.quickstart/ssh.config.ansible undercloud | 13:09 |
| vijaya_ | virthost and ansible hosts are the same | 13:10 |
| adarazs | (using the user you ran quickstart.sh with, not root. | 13:10 |
| *** eck`gone is now known as eck` | 13:10 | |
| *** ooolpbot has joined #tripleo | 13:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 13:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 13:10 |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 13:10 |
| *** ooolpbot has quit IRC | 13:10 | |
| adarazs | vijaya_: yes, but there's three things: 1) host you're running quickstart.sh from 2) virthost (that has the VMs) 3) VMs on that virthost, i.e. undercloud and overcloud nodes. | 13:10 |
| adarazs | vijaya_: in your case 1 and 2 is the same, but 3 is not the same as the others :) | 13:11 |
| adarazs | you have to ssh into that VM | 13:11 |
| *** jaganathan has joined #tripleo | 13:11 | |
| adarazs | and you'll have the undercloud_install.log on that (and also the rest of the scripts inside /home/stack) | 13:12 |
| vijaya_ | 2017-05-04 12:40:53 | [2017-05-04 12:40:53,347] (os-refresh-config) [ERROR] during configure phase. [Command '['dib-run-parts', '/usr/libexec/os-refresh-config/configure.d']' returned non-zero exit status 1] 2017-05-04 12:40:53 | 2017-05-04 12:40:53 | [2017-05-04 12:40:53,347] (os-refresh-config) [ERROR] Aborting... 2017-05-04 12:40:53 | Traceback (most recent call last): 2017-05-04 12:40:53 | File "<string>", line 1, in <module> 2 | 13:12 |
| adarazs | hrm, that might be a proper error. | 13:13 |
| *** toure|gone is now known as toure | 13:13 | |
| *** karimb has joined #tripleo | 13:13 | |
| *** dmacpher has joined #tripleo | 13:14 | |
| vijaya_ | is it possible to reinstall from undercloud? | 13:14 |
| adarazs | vijaya_: yeah, if you rerun the quickstart command it automatically removes all VMs and recreates them from scratch, but I think we have some real bug that you're hitting and it won't help. | 13:15 |
| vijaya_ | :( | 13:15 |
| vijaya_ | 2017-05-04 12:40:30 | 2017-05-04 12:40:30 - ^[[mNotice: /Stage[main]/Neutron::Db::Sync/Exec[neutron-db-sync]/returns: sqlalchemy.exc.OperationalError: (pymysql.err.OperationalError) (1045, u"Access denied for user 'neutron'@'192.168.24.1' (using password: YES)")^[[0m 2017-05-04 12:40:30 | 2017-05-04 12:40:30 - ^[[1;31mError: /Stage[main]/Neutron::Db::Sync/Exec[neutron-db-sync]: Failed to call refresh: neutron-db-manage --config-file | 13:15 |
| adarazs | vijaya_: you can try the octaa release meanwhile, if you don't mind not having newton. | 13:16 |
| *** vkhanna has left #tripleo | 13:17 | |
| adarazs | vijaya_: can you try to run "./quickstart.sh --release ocata 127.0.0.2" and see if that works? | 13:17 |
| adarazs | maybe add "--clean" for good measure, deleting your local working directory. | 13:17 |
| *** bvandenh has joined #tripleo | 13:20 | |
| *** vkhanna has joined #tripleo | 13:20 | |
| *** jaganathan has quit IRC | 13:20 | |
| *** tzumainn has joined #tripleo | 13:20 | |
| *** vkhanna has left #tripleo | 13:20 | |
| openstackgerrit | Sven Anderson proposed openstack/tripleo-heat-templates stable/ocata: Add parameter Ec2ApiExternalNetwork for VPCs https://review.openstack.org/462542 | 13:20 |
| *** ratailor_ has quit IRC | 13:21 | |
| vijaya_ | okay let me try | 13:22 |
| shardy | dprince: Hey if you have a moment I'm looking for help understanding some idempotency issues with docker-puppet tasks | 13:23 |
| *** dtantsur|brb is now known as dtantsur | 13:24 | |
| shardy | http://paste.openstack.org/show/608861/ shows the issue, it seems re-running docker-puppet tasks for nova-libvirt fails if the container hasn't been replaced | 13:24 |
| dprince | shardy: looking | 13:24 |
| *** janki has quit IRC | 13:24 | |
| vijaya_ | how can i check where the VMs are running..virsh list --all return snothing on the host | 13:24 |
| shardy | I'm not quite sure where the rm is happening, I guess in the puppet run but it's a little hard to trace when it's running in the utility container | 13:24 |
| vijaya_ | is it inside virtual env? | 13:25 |
| shardy | vijaya_: sudo su - stack | 13:25 |
| jrist | jtomasek: do you think this is a TripleO thing or a UI thing? https://bugs.launchpad.net/tripleo/+bug/1688053 | 13:25 |
| openstack | Launchpad bug 1688053 in tripleo "EC2MetadataIp not assigned, causes deployment failure" [High,Triaged] | 13:25 |
| shardy | https://docs.openstack.org/developer/tripleo-quickstart/accessing-libvirt.html#where-are-my-guests | 13:25 |
| adarazs | vijaya_: we're using session mode for the virthost, so you can only see the VMs from under the stack user on the virthost. the best way to log in like that is | 13:26 |
| adarazs | $ ssh -F ~/.quickstart/ssh.config.ansible virthost | 13:26 |
| adarazs | vijaya_: then virsh list --all should show you all the VMs | 13:26 |
| adarazs | vijaya_: FWIW I was able to reproduce the undercloud install failure on my CentOS virthost. so it's something generic problem. I'll investigate and open a bug. | 13:27 |
| jtomasek | jrist: hm, I am not sure. dtrainor are you around? | 13:27 |
| vijaya_ | hm thanks | 13:27 |
| adarazs | vijaya_: I think ocata won't be affected. | 13:28 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-quickstart-extras master: Don't overwrite tht_dir for upgrades to master https://review.openstack.org/462172 | 13:28 |
| adarazs | Error: /Stage[main]/Heat::Db::Sync/Exec[heat-dbsync]: | 13:29 |
| adarazs | Failed to call refresh: heat-manage --config-file /etc/heat/heat.conf db_sync returned 1 instead of one of [0] | 13:29 |
| adarazs | have you guys seen this error before? | 13:29 |
| adarazs | when I manually try to execute that command I get | 13:30 |
| adarazs | ERROR: (pymysql.err.OperationalError) (1045, u"Access denied for user 'heat'@'192.168.24.1' (using password: YES)") | 13:30 |
| adarazs | weird. | 13:30 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-tripleoclient master: Updated from global requirements https://review.openstack.org/462559 | 13:31 |
| *** chlong has joined #tripleo | 13:32 | |
| jrist | jtomasek: not awake yet | 13:32 |
| *** jaganathan has joined #tripleo | 13:32 | |
| jtomasek | jrist: I am updating the bug | 13:32 |
| thrash | EmilienM: https://review.openstack.org/462560 | 13:34 |
| *** dhill_ has quit IRC | 13:34 | |
| shardy | dprince: aha, I see it's the rm -Rf /var/lib/config-data/nova_libvirt in the "Disables archiving" section of docker-puppet-nova_libvirt.sh | 13:34 |
| adarazs | May 04 12:43:36 undercloud.localdomain systemd[1]: epmd@0.0.0.0.socket failed to listen on sockets: Address already in use | 13:34 |
| adarazs | May 04 12:43:36 undercloud.localdomain systemd[1]: Failed to listen on Erlang Port Mapper Daemon Activation Socket. | 13:34 |
| adarazs | May 04 12:43:36 undercloud.localdomain systemd[1]: Unit epmd@0.0.0.0.socket entered failed state. | 13:34 |
| thrash | EmilienM: that hopefully should fix it | 13:34 |
| vijaya_ | 2017-05-04 13:32:29 | 2017-05-04 13:32:29,802 INFO: Cannot find a valid baseurl for repo: base/7/x86_64 2017-05-04 13:32:29 | 2017-05-04 13:32:29,802 INFO: Could not retrieve mirrorlist http://mirrorlist.centos.org/?release=7&arch=x86_64&repo=os&infra=genclo error was 2017-05-04 13:32:29 | 2017-05-04 13:32:29,802 INFO: 14: curl#7 - "Failed to connect to 2001:1b48:203::4:10: Network is unreachable" 2017-05-04 13:32:29 | 2017-05-04 13: | 13:34 |
| *** dhill_ has joined #tripleo | 13:34 | |
| vijaya_ | fot ocata | 13:34 |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-heat-templates master: Add role specific information to the service template https://review.openstack.org/437956 | 13:34 |
| vijaya_ | it failed at the very beginning..while running yum update | 13:36 |
| openstackgerrit | Damien Ciabrini proposed openstack/tripleo-heat-templates master: WIP THT part of HAproxy HA docker container https://review.openstack.org/459597 | 13:36 |
| *** jaganathan has quit IRC | 13:37 | |
| jrist | jtomasek: thanks | 13:39 |
| EmilienM | thrash: nice | 13:42 |
| *** zoliXXL is now known as zoli|brb | 13:42 | |
| *** skramaja has joined #tripleo | 13:42 | |
| EmilienM | ccamacho: moving https://bugs.launchpad.net/tripleo/+bug/1687908 to alert - upgrades are critical to us | 13:42 |
| openstack | Launchpad bug 1687908 in tripleo "Could not fetch contents for file:///usr/share/openstack-tripleo-heat-templates/extraconfig/tasks/post_puppet_pacemaker.yaml" [Critical,Triaged] | 13:42 |
| thrash | EmilienM: basically, mistral was looking for [keystone_authtoken/admin_user] instead of [keystone_authtoken/username] | 13:42 |
| *** jaganathan has joined #tripleo | 13:42 | |
| EmilienM | thrash: bouuuu | 13:43 |
| *** gvrangan has quit IRC | 13:43 | |
| ccamacho | EmilienM ack im still digging into the tripleo-ci repo | 13:44 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Use httpd in Heat docker services https://review.openstack.org/447504 | 13:44 |
| slagle | hi everyone, just a reminder that in 15 minutes, i'll give a deep dive on deployed-server | 13:45 |
| *** skramaja has quit IRC | 13:45 | |
| shardy | dprince: so AFAICS we can't re-run docker-puppet to generate config without first killing the related container (or skipping the rm) as that dir is bound into the running container | 13:46 |
| adarazs | slagle: cool. what will be the URL for it? last week it was a bit confusing. :) | 13:46 |
| openstackgerrit | Damien Ciabrini proposed openstack/puppet-tripleo master: WIP containerized pacemaker haproxy https://review.openstack.org/458832 | 13:46 |
| *** masco has joined #tripleo | 13:47 | |
| shardy | I guess I can go with NO_ARCHIVE but I'm unclear what the side-effects of that will be | 13:47 |
| slagle | adarazs: https://bluejeans.com/176756457/ | 13:47 |
| EmilienM | thrash: I added depends-on https://review.openstack.org/#/c/461038/ | 13:47 |
| EmilienM | thrash: so we can actually test it | 13:47 |
| thrash | EmilienM: ack. Cool | 13:47 |
| adarazs | slagle: thanks! | 13:48 |
| dprince | shardy: yeah, the 'archiving' feature is probably worth looking at docker-puppet.py for | 13:48 |
| *** jaganathan has quit IRC | 13:48 | |
| shardy | dprince: yeah I'm looking at it, just trying to understand at a high level how the update workflow here is expected to work | 13:48 |
| shardy | e.g should we re-run docker-puppet every update to refresh the config, or find some way to make it conditional? | 13:48 |
| dtantsur | slagle, it's all recorded, isn't it? | 13:49 |
| shardy | And if it's conditional, do we kill the old container, regen config, start the container? | 13:49 |
| dprince | shardy: I think it would be regen config, and then kill old container, start new one | 13:49 |
| slagle | dtantsur: i plan to record it | 13:49 |
| dtantsur | cool, I'd love to see it | 13:49 |
| dprince | shardy: the regen config step is probably required in order to determine if there as been a meaningful change that requires a restart | 13:50 |
| * dtantsur also needs to find the recording of the previous deep dive, on oooq | 13:50 | |
| shardy | dprince: Ok but regen config with NO_ARCHIVE, and somehow work out if the config changed? | 13:50 |
| d0ugal | jkilpatr: working with bm is teaching me how unstable introspection is :( | 13:50 |
| shardy | dprince: I was thinking I'd only need to look at the container json but it seems we also need to checksum the config because puppet could change and generate a new config? | 13:50 |
| dprince | shardy: ah, I see. You are trying no to clobber the existing configs in the process. We could use NO_ARCHIVE perhaps. Or alternately we could add an option to specify an alternate "staging" archive directory | 13:51 |
| dprince | shardy: there is also perhaps something we could do w/ 'docker diff' although that would require investigation I think | 13:51 |
| shardy | dprince: yeah maybe we should make that path unique based on the heat config/deployment ID or something | 13:51 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui master: NodesListView and ListView components https://review.openstack.org/460536 | 13:51 |
| *** yamahata has quit IRC | 13:51 | |
| jkilpatr | d0ugal, there's a reason why it's often a painpoint for customers. spurious failures happen like 1-5% even on perfect hardware in a perfect env | 13:51 |
| jkilpatr | now on cheap hardware like that supermicro, it gets worse | 13:52 |
| dprince | shardy: that works for me. Adding a configurable 'archive directory' would be totally fine. For debugging though having the configs for the actively running containers in a known location would be good I think | 13:52 |
| dprince | shardy: like being able to go to /var/lib/config-data is a useful thing | 13:52 |
| d0ugal | jkilpatr: yeah, it's kinda driving me mad :) | 13:52 |
| jkilpatr | d0ugal, let me know if you want to look at the virtual consoles of those nodes | 13:52 |
| dprince | shardy: but for the staging directories we could do whatever | 13:52 |
| shardy | dprince: Ok, I'll look into that, I guess it could be /var/lib/config-data/<id>/foo | 13:52 |
| shardy | dprince: it's kinda complicated by the fact that we will have to change the ID for all containers at a given step | 13:53 |
| shardy | even if only one changed | 13:53 |
| *** gkadam has quit IRC | 13:53 | |
| shardy | it's the same problem for minor updates of any kind I think | 13:53 |
| shardy | dprince: thanks for the info, I'll keep digging | 13:54 |
| dprince | shardy: I suppose what I'm suggesting is more like stage the configs to /var/lib/temp-config-data/. And once you decide to actually run that container then copy it to /var/lib/config-data/heat for example | 13:54 |
| dprince | shardy: or we could use soft-links so that the /var/lib/config-data/<volumes> refer to uuids or something | 13:55 |
| *** Goneri has quit IRC | 13:55 | |
| *** bkopilov has quit IRC | 13:56 | |
| slagle | deep dive starting now, https://bluejeans.com/176756457/ | 14:00 |
| *** jaganathan has joined #tripleo | 14:00 | |
| *** chlong has quit IRC | 14:01 | |
| shardy | dprince: ah, yeah that could work too, I'll give it a try | 14:01 |
| shardy | dprince: That would solve the heat config ID problem, but involve a little bit more work unless we can just add a config sha to the payload consumed by paunch | 14:02 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Move OVB settings to tripleo-quickstart-extras https://review.openstack.org/448805 | 14:02 |
| shardy | then let it figure out which containers need a restart | 14:02 |
| shardy | I'll try to catch stevebaker for his thoughts on it | 14:03 |
| *** oidgar has joined #tripleo | 14:03 | |
| d0ugal | jkilpatr: What do you think the best retry strategy would be? retry nodes that fail straight away? finish the others and retry the failures at the end? Have a command the user runs that only retries the failed nodes? | 14:04 |
| d0ugal | something else? :) | 14:04 |
| jkilpatr | d0ugal, I've spent an inordinate amount of time thinking about this | 14:04 |
| *** Goneri has joined #tripleo | 14:04 | |
| d0ugal | lol | 14:04 |
| d0ugal | probably while you wait for introspection to finish? :) | 14:04 |
| jkilpatr | I have a small set of data about what happens as you introspect at scale once that dhcp issue is fixed | 14:04 |
| *** jaganathan has quit IRC | 14:05 | |
| jkilpatr | it says that failure rate increases linearly at a rate of like 1% per 30 nodes | 14:05 |
| *** radan has joined #tripleo | 14:05 | |
| jkilpatr | of course I only had like 50 so.... don't put too much stock into that | 14:05 |
| *** rbowen has joined #tripleo | 14:05 | |
| jkilpatr | regardless so long as the failure increase stays linear the *optimal* strategy is to introspect everything like even 10k nodes | 14:05 |
| jkilpatr | then inspect everything that failed | 14:06 |
| jkilpatr | then repeat until done. | 14:06 |
| jkilpatr | but if a node is lets say misconfigured it's going to fail every time so you need to pull nodes that fail many batches out | 14:06 |
| *** hjensas has quit IRC | 14:06 | |
| d0ugal | jkilpatr: okay, that seems reasonable | 14:06 |
| *** brault has quit IRC | 14:06 | |
| jkilpatr | but if you do this "everything! all the time" strategy you're remainders will always be nodes that fail spuriously many times, so how do you know that they are not misconfigured | 14:07 |
| d0ugal | Yeah, I guess there should be a limit for the retries | 14:07 |
| jkilpatr | well you don't until you get down to trying a small batch | 14:07 |
| *** gvrangan has joined #tripleo | 14:07 | |
| d0ugal | jkilpatr: or maybe we could stop when the number of failing nodes doesn't decrease, then we can assume no progress will be made | 14:07 |
| jkilpatr | its a fun statistics problem actually, the remainder batch is always the outliers so we need to seperate outliers from nodes that fail supriously but in large enough deployments even very rare outliers may exist (like 5 consecutive failures) | 14:07 |
| jkilpatr | that could work | 14:08 |
| *** zoli|brb is now known as zoli|mtg | 14:08 | |
| d0ugal | so, for example, 100 nodes, 30 fail, out of the 30 on retrying 15 fail and we continue until 5 constantly fail, then we give up | 14:08 |
| d0ugal | "constantly fail" could be a user-defined (but with a sane default) number of repeated retries | 14:09 |
| *** prateek has quit IRC | 14:09 | |
| d0ugal | jkilpatr: now that the batching patch seems to be working well, I am going to do a follow up that improves this. | 14:09 |
| d0ugal | s/improves this/implements this/ | 14:10 |
| *** ooolpbot has joined #tripleo | 14:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 14:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1687908 | 14:10 |
| *** ooolpbot has quit IRC | 14:10 | |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 14:10 |
| openstack | Launchpad bug 1687908 in tripleo "Could not fetch contents for file:///usr/share/openstack-tripleo-heat-templates/extraconfig/tasks/post_puppet_pacemaker.yaml" [Critical,Triaged] | 14:10 |
| jkilpatr | d0ugal, sounds good. Just be verbose to the user about what's going on / what your doing. So that an operator can glance at that and see "x nodes failed, this may be spurious, we will try n more times" | 14:11 |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: test ci do not review https://review.openstack.org/462570 | 14:11 |
| d0ugal | jkilpatr: will do, thanks | 14:12 |
| *** chlong has joined #tripleo | 14:13 | |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-validations master: Show all roles in inventory https://review.openstack.org/450233 | 14:14 |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: Mount hostpath logs on /var/log https://review.openstack.org/442603 | 14:15 |
| *** nyechiel has quit IRC | 14:16 | |
| jaosorior | sshnaidm: Could you check this commit out? https://review.openstack.org/#/c/461864/ It tests keystone LDAP integration in the fakeha-caserver gate. | 14:16 |
| jaosorior | EmilienM: ^ | 14:16 |
| openstackgerrit | Michael Chapman proposed openstack/tripleo-quickstart-extras master: Support arbitrary nat network order https://review.openstack.org/462571 | 14:16 |
| bandini | mwhahaha: I added a comment on https://review.openstack.org/#/c/458077/ we can probably make it more robust in tht as well, but I thought it is worth pointing out | 14:17 |
| openstackgerrit | Michael Chapman proposed openstack/tripleo-quickstart master: Add support for external network bridges https://review.openstack.org/406421 | 14:18 |
| *** michapma_dsk has quit IRC | 14:19 | |
| openstackgerrit | Merged openstack/python-tripleoclient master: Save DefaultPasswords values for undercloud deploy https://review.openstack.org/458407 | 14:20 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Remove multiple plan support from plan export command https://review.openstack.org/457693 | 14:20 |
| mwhahaha | bandini: it's cause we didn't have the NovaLibvirtNetwork defined, but yea it's an improvement for later | 14:21 |
| bandini | mwhahaha: ah you're on top of it already, perfect :) | 14:21 |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: test ci do not review https://review.openstack.org/462570 | 14:24 |
| *** enrraja has joined #tripleo | 14:25 | |
| jkilpatr | rlandy, https://rhos-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/poc-tripleo-quickstart-master-ovb-rdocloud-periodic-scale/28/consoleFull | 14:28 |
| jkilpatr | failed to checkout branch none? | 14:28 |
| openstackgerrit | Numan Siddique proposed openstack/tripleo-heat-templates master: Pacemaker HA suport for OVN DB servers https://review.openstack.org/436767 | 14:29 |
| *** jlinkes has quit IRC | 14:30 | |
| adarazs | EmilienM, rbrady, trown|outtypewww, sshnaidm, weshay, hrybacki, panda|ko, rlandy, bkero, arxcruz: TripleO CI Squad meeting in half an hour, add agenda items to https://etherpad.openstack.org/p/tripleo-ci-squad-meeting | 14:30 |
| EmilienM | adarazs: I won't be able to join today, i'm working on a critical bug right now | 14:30 |
| rlandy | jkilpatr: looking | 14:31 |
| rlandy | jkilpatr: those reviews are in a bit of a flux state - working with trown|outtypewww to get all the installs into the working_dir only | 14:32 |
| rlandy | but I can fix this | 14:32 |
| jaosorior | adarazs: : Could you check this commit out? https://review.openstack.org/#/c/461864/ It tests keystone LDAP integration in the fakeha-caserver gate. | 14:33 |
| *** jaganathan has joined #tripleo | 14:33 | |
| adarazs | jaosorior: I'm don't think I can do it today, I'm on the deep dive now, and will have the CI Squad meeting after that. :/ | 14:34 |
| *** garyk has quit IRC | 14:34 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/tripleo-common master: [WIP][PoC] Add workflow for IPMI nodes discovery https://review.openstack.org/462577 | 14:34 |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-common master: move mistral base action dependency to mistral_lib https://review.openstack.org/454632 | 14:35 |
| *** rbowen has quit IRC | 14:36 | |
| *** jaganathan has quit IRC | 14:40 | |
| *** gvrangan has quit IRC | 14:40 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Use CRL for HAProxy https://review.openstack.org/462515 | 14:41 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo master: Add resource to fetch CRL https://review.openstack.org/462514 | 14:41 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates master: Configure crl file for HAProxy https://review.openstack.org/462526 | 14:41 |
| jkilpatr | rlandy, don't worry about it too much, so long as the stack doesn't get created we just eat a slave for a few seconds | 14:42 |
| jkilpatr | very low cost failure | 14:42 |
| *** gvrangan has joined #tripleo | 14:42 | |
| openstackgerrit | Bogdan Dobrelya proposed openstack/tripleo-heat-templates master: DO NOT MERGE testing hostpath logs/custom undercloud https://review.openstack.org/459625 | 14:42 |
| * jkilpatr stares accusingly at 15 hour builds that fail because of cdn issues. | 14:42 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Parameterize OVB stack flavors https://review.openstack.org/445163 | 14:50 |
| *** hjensas has joined #tripleo | 14:51 | |
| *** hjensas has quit IRC | 14:51 | |
| *** hjensas has joined #tripleo | 14:51 | |
| *** limao has quit IRC | 14:51 | |
| rlandy | jkilpatr: pls try rerun now | 14:55 |
| rlandy | review is updated | 14:55 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Use openstackclient from the venv when deleting ovb stacks https://review.openstack.org/462261 | 14:56 |
| openstackgerrit | Michael Lammon proposed openstack/tripleo-docs master: Update the guide for pxe_ssh to vbmc migration include pxe_ipmitool https://review.openstack.org/460338 | 14:57 |
| *** jlinkes has joined #tripleo | 14:58 | |
| *** gfidente has quit IRC | 15:01 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras master: Add a variable for the dir where the repo is built https://review.openstack.org/461411 | 15:02 |
| adarazs | rlandy, EmilienM, panda|ko: CI Squad meeting time! \o/ (if you can make it) | 15:02 |
| *** sid1 has joined #tripleo | 15:03 | |
| *** ebarrera has quit IRC | 15:04 | |
| *** jerrygb has joined #tripleo | 15:07 | |
| jkilpatr | rlandy, running fine this time. | 15:08 |
| *** jaganathan has joined #tripleo | 15:08 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart-extras master: Collect the last 4 hours from the journal in text form https://review.openstack.org/447099 | 15:09 |
| *** ooolpbot has joined #tripleo | 15:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 15:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1687908 | 15:10 |
| *** ooolpbot has quit IRC | 15:10 | |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 15:10 |
| openstack | Launchpad bug 1687908 in tripleo "Could not fetch contents for file:///usr/share/openstack-tripleo-heat-templates/extraconfig/tasks/post_puppet_pacemaker.yaml" [Critical,Triaged] - Assigned to Carlos Camacho (ccamacho) | 15:10 |
| *** enrraja has quit IRC | 15:10 | |
| ccamacho | mm the bot calls me :P | 15:11 |
| *** limao has joined #tripleo | 15:12 | |
| *** jaganathan has quit IRC | 15:14 | |
| adarazs | panda|ko: get well! | 15:15 |
| arxcruz | adarazs: https://review.openstack.org/#/c/459981/ now you're no longer in meeting :D | 15:16 |
| adarazs | arxcruz: merged. | 15:17 |
| arxcruz | adarazs: tyvm | 15:17 |
| arxcruz | :D | 15:17 |
| *** karimb has quit IRC | 15:17 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates master: Remove nova placement config for compute service node on upgrade https://review.openstack.org/462593 | 15:18 |
| *** dougbtv has joined #tripleo | 15:18 | |
| *** iranzo has quit IRC | 15:18 | |
| *** brault has joined #tripleo | 15:19 | |
| adarazs | rlandy: +2 for the build_repo_dir change, thanks for fixing that up. | 15:19 |
| adarazs | sshnaidm: can you rereview this? (re journalctl log output) https://review.openstack.org/447099 | 15:20 |
| *** karimb has joined #tripleo | 15:20 | |
| *** jprovazn is now known as jprovazn_afk | 15:22 | |
| *** garyk has joined #tripleo | 15:22 | |
| *** brault has quit IRC | 15:24 | |
| *** Goneri has quit IRC | 15:24 | |
| *** yprokule has quit IRC | 15:29 | |
| *** limao has quit IRC | 15:30 | |
| *** jaganathan has joined #tripleo | 15:32 | |
| *** mdnadeem has quit IRC | 15:33 | |
| *** ykarel_ has quit IRC | 15:34 | |
| *** chlong has quit IRC | 15:36 | |
| *** jaganathan has quit IRC | 15:39 | |
| *** lmiccini has quit IRC | 15:40 | |
| *** jaganathan has joined #tripleo | 15:46 | |
| *** mich_chap has joined #tripleo | 15:47 | |
| *** dparkes has quit IRC | 15:49 | |
| *** jaganathan has quit IRC | 15:51 | |
| *** sid1 has quit IRC | 15:52 | |
| *** jaosorior has quit IRC | 15:54 | |
| *** dtrainor has quit IRC | 15:55 | |
| *** jaganathan has joined #tripleo | 15:56 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart master: Fix depends-on to use the cloned repo https://review.openstack.org/462654 | 16:00 |
| *** jaganathan has quit IRC | 16:01 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart master: Fix depends-on to use the cloned repo https://review.openstack.org/462654 | 16:02 |
| bogdando | mandre, flaper87: omg, it has passed undercloud containers https://review.openstack.org/#/c/442603/ | 16:08 |
| *** jaganathan has joined #tripleo | 16:08 | |
| bogdando | could we merge it soon?? | 16:08 |
| *** salmankhan has quit IRC | 16:09 | |
| openstackgerrit | Merged openstack/tripleo-quickstart master: Fix network isolation args for ovb oooq job https://review.openstack.org/462278 | 16:09 |
| bogdando | dprince, jistr: ^^ | 16:09 |
| *** ooolpbot has joined #tripleo | 16:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 16:10 |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 16:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1687908 | 16:10 |
| *** ooolpbot has quit IRC | 16:10 | |
| openstack | Launchpad bug 1687908 in tripleo "Could not fetch contents for file:///usr/share/openstack-tripleo-heat-templates/extraconfig/tasks/post_puppet_pacemaker.yaml" [Critical,Triaged] - Assigned to Carlos Camacho (ccamacho) | 16:10 |
| *** dsariel_ has quit IRC | 16:10 | |
| bogdando | basically, cuz of the scope of changes, it has being broken by every commit to t-h-t, so we have to do it fast =) | 16:11 |
| *** suuuper has quit IRC | 16:12 | |
| *** suuuper has joined #tripleo | 16:12 | |
| *** jaganathan has quit IRC | 16:13 | |
| *** athomas has quit IRC | 16:14 | |
| *** milan has quit IRC | 16:15 | |
| *** zoli|mtg is now known as zoliXXL | 16:15 | |
| *** jpich has quit IRC | 16:17 | |
| *** bogdando has quit IRC | 16:17 | |
| *** gvrangan has quit IRC | 16:22 | |
| *** lucasagomes is now known as lucas-afk | 16:26 | |
| *** anshul has quit IRC | 16:26 | |
| *** khrystop_ has quit IRC | 16:27 | |
| *** khrystoph has joined #tripleo | 16:28 | |
| *** zoliXXL is now known as zoli|gone | 16:28 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-heat-templates master: multinode-container-upgrade.yaml usable for initial deplyoment too https://review.openstack.org/462664 | 16:29 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-quickstart-extras master: Don't overwrite tht_dir for upgrades to master https://review.openstack.org/462172 | 16:29 |
| openstackgerrit | Alan Bishop proposed openstack/puppet-tripleo master: Add support for Cinder "NAS secure" driver params https://review.openstack.org/462665 | 16:29 |
| *** garyk has quit IRC | 16:30 | |
| openstackgerrit | Jiri Stransky proposed openstack-infra/tripleo-ci master: Use mixed release for container upgrade https://review.openstack.org/460061 | 16:30 |
| *** garyk has joined #tripleo | 16:30 | |
| *** gbarros has joined #tripleo | 16:33 | |
| openstackgerrit | Alan Bishop proposed openstack/tripleo-heat-templates master: Add support for Cinder "NAS secure" driver params https://review.openstack.org/462667 | 16:34 |
| *** gvrangan has joined #tripleo | 16:34 | |
| *** Ng has quit IRC | 16:35 | |
| thrash | EmilienM: didn't work... testing locally again | 16:36 |
| EmilienM | thrash: /me sad face | 16:36 |
| *** oidgar has quit IRC | 16:37 | |
| *** ckyriakidou has quit IRC | 16:38 | |
| *** pcaruana has quit IRC | 16:40 | |
| *** athomas has joined #tripleo | 16:40 | |
| *** Ng has joined #tripleo | 16:41 | |
| *** ChanServ sets mode: +v Ng | 16:41 | |
| *** ffiore_ has quit IRC | 16:41 | |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: Run introspection 20 nodes at a time https://review.openstack.org/439568 | 16:44 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common master: NO MERGEY - testing low concurrency https://review.openstack.org/449215 | 16:44 |
| *** gbarros has quit IRC | 16:45 | |
| *** yolanda has quit IRC | 16:47 | |
| *** jkilpatr has quit IRC | 16:48 | |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Fix path for the multinode job when runing the major upgrade. https://review.openstack.org/462570 | 16:53 |
| *** ramishra has quit IRC | 16:53 | |
| *** fragatina has quit IRC | 16:54 | |
| *** yolanda has joined #tripleo | 16:54 | |
| *** shardy has quit IRC | 16:57 | |
| *** ansmith has quit IRC | 16:58 | |
| *** athomas has quit IRC | 16:59 | |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Fix path for the multinode job when runing the major upgrade. https://review.openstack.org/462570 | 17:00 |
| *** athomas has joined #tripleo | 17:01 | |
| *** derekh has quit IRC | 17:01 | |
| *** ramishra has joined #tripleo | 17:02 | |
| *** karimb has quit IRC | 17:02 | |
| *** gvrangan_ has joined #tripleo | 17:04 | |
| *** jkilpatr has joined #tripleo | 17:04 | |
| *** paramite has quit IRC | 17:06 | |
| *** gvrangan_ has quit IRC | 17:09 | |
| *** ooolpbot has joined #tripleo | 17:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 17:10 |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 17:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1687908 | 17:10 |
| *** ooolpbot has quit IRC | 17:10 | |
| openstack | Launchpad bug 1687908 in tripleo "Could not fetch contents for file:///usr/share/openstack-tripleo-heat-templates/extraconfig/tasks/post_puppet_pacemaker.yaml" [Critical,Triaged] - Assigned to Carlos Camacho (ccamacho) | 17:10 |
| *** jpena is now known as jpena|off | 17:12 | |
| *** dtantsur is now known as dtantsur|afk | 17:12 | |
| *** fragatina has joined #tripleo | 17:13 | |
| *** ansmith has joined #tripleo | 17:14 | |
| *** Goneri has joined #tripleo | 17:18 | |
| *** funzo has joined #tripleo | 17:19 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-common master: Add sahara docker containers https://review.openstack.org/462680 | 17:20 |
| *** masco has quit IRC | 17:22 | |
| *** Goneri has quit IRC | 17:23 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: Containerize Sahara https://review.openstack.org/462681 | 17:24 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates master: WIP: Test containerized Sahara https://review.openstack.org/462682 | 17:24 |
| *** ckyriakidou has joined #tripleo | 17:24 | |
| *** funzo has quit IRC | 17:24 | |
| *** gvrangan_ has joined #tripleo | 17:24 | |
| *** gvrangan_ has quit IRC | 17:27 | |
| *** ckyriakidou has quit IRC | 17:29 | |
| openstackgerrit | Merged openstack/tripleo-common master: Remove update abort https://review.openstack.org/449242 | 17:30 |
| *** tesseract has quit IRC | 17:30 | |
| openstackgerrit | Merged openstack/puppet-tripleo master: Restrict nova migration ssh tunnel https://review.openstack.org/458077 | 17:30 |
| openstackgerrit | Merged openstack/python-tripleoclient master: Allow setting pm_port when importing nodes from a .csv file https://review.openstack.org/427757 | 17:31 |
| *** ffiore has joined #tripleo | 17:31 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Skipping build image for periodic tempest jobs https://review.openstack.org/459981 | 17:31 |
| *** dmacpher has quit IRC | 17:33 | |
| *** jaganathan has joined #tripleo | 17:33 | |
| *** dsariel_ has joined #tripleo | 17:33 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/python-tripleoclient master: Updated from global requirements https://review.openstack.org/462559 | 17:34 |
| *** cylopez has joined #tripleo | 17:35 | |
| *** masco has joined #tripleo | 17:37 | |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Fix path for the multinode job when running the major upgrade. https://review.openstack.org/462570 | 17:37 |
| *** ffiore has quit IRC | 17:38 | |
| *** ffiore_ has joined #tripleo | 17:38 | |
| *** jaganathan has quit IRC | 17:38 | |
| *** dsariel_ has quit IRC | 17:43 | |
| *** dsariel_ has joined #tripleo | 17:45 | |
| *** deadnull has joined #tripleo | 17:46 | |
| *** jprovazn_afk is now known as jprovazn | 17:47 | |
| *** karthiks has joined #tripleo | 17:48 | |
| *** ffiore_ has quit IRC | 17:48 | |
| *** mich_chap has quit IRC | 17:49 | |
| pabelanger | EmilienM: let me know when is a good time to do the msync for puppet changes | 17:49 |
| EmilienM | pabelanger: tbh it's a bad timeing | 17:49 |
| EmilienM | pabelanger: also I don't remember how the msync thing works | 17:50 |
| *** jaganathan has joined #tripleo | 17:50 | |
| pabelanger | EmilienM: we can setup a propose job | 17:50 |
| pabelanger | EmilienM: I wrote the code a while back, we can move forward on it again | 17:51 |
| EmilienM | it was rejected | 17:51 |
| EmilienM | back in last summer | 17:51 |
| EmilienM | maybe before evn | 17:51 |
| EmilienM | wow was it in 2015? | 17:51 |
| pabelanger | EmilienM: right, but now openstack-infra is okay with proposal things | 17:51 |
| pabelanger | so, we can propose it again | 17:51 |
| EmilienM | ok then | 17:51 |
| pabelanger | let me test it locally, I'll use recent change | 17:52 |
| pabelanger | then push up review for next time | 17:52 |
| EmilienM | ok | 17:52 |
| EmilienM | pabelanger: we'll also need to update https://github.com/openstack/puppet-modulesync-configs/blob/master/managed_modules.yml | 17:53 |
| EmilienM | and it won't update stable branches | 17:53 |
| *** masco has quit IRC | 17:53 | |
| *** fragatina has quit IRC | 17:54 | |
| *** fragatina has joined #tripleo | 17:54 | |
| *** tosky has quit IRC | 17:54 | |
| *** jaganathan has quit IRC | 17:56 | |
| *** gbarros has joined #tripleo | 17:57 | |
| *** garyk has quit IRC | 17:59 | |
| *** amoralej is now known as amoralej|off | 18:00 | |
| *** jaganathan has joined #tripleo | 18:01 | |
| *** cylopez has left #tripleo | 18:09 | |
| *** jaganathan has quit IRC | 18:09 | |
| *** ooolpbot has joined #tripleo | 18:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 18:10 |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 18:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1687908 | 18:10 |
| *** ooolpbot has quit IRC | 18:10 | |
| openstack | Launchpad bug 1687908 in tripleo "Could not fetch contents for file:///usr/share/openstack-tripleo-heat-templates/extraconfig/tasks/post_puppet_pacemaker.yaml" [Critical,Triaged] - Assigned to Carlos Camacho (ccamacho) | 18:10 |
| *** mcornea has quit IRC | 18:10 | |
| *** gvrangan has quit IRC | 18:13 | |
| *** dciabrin has quit IRC | 18:14 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Refactor: block-device filesystem creation, mount and fstab https://review.openstack.org/444586 | 18:15 |
| bandini | Slower: around by chance? | 18:16 |
| *** milan has joined #tripleo | 18:18 | |
| *** dciabrin has joined #tripleo | 18:18 | |
| *** gvrangan has joined #tripleo | 18:19 | |
| *** gbarros has quit IRC | 18:20 | |
| *** ansmith has quit IRC | 18:21 | |
| *** Goneri has joined #tripleo | 18:26 | |
| *** jprovazn has quit IRC | 18:31 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-pacemaker master: Fix up race when setting a property https://review.openstack.org/462704 | 18:33 |
| *** milan has quit IRC | 18:35 | |
| *** ansmith has joined #tripleo | 18:35 | |
| *** jaganathan has joined #tripleo | 18:38 | |
| bandini | dprince: around by chance? we're stuck on some keystone container error but are not sure where the breakage is | 18:39 |
| dprince | bandini: yo yo, whats up? | 18:39 |
| bandini | dprince: so this is the error we get http://paste.openstack.org/show/608898/ | 18:40 |
| dprince | bandini: hmmm, that doesn't tell me much | 18:41 |
| dprince | bandini: got an env I can jump into perhaps? | 18:41 |
| bandini | but keystone container seems up, we can reach mysql correctly | 18:41 |
| bandini | dprince: yes, sec | 18:41 |
| bandini | dprince: do you have an ssh public key handy? | 18:41 |
| *** deadnull has quit IRC | 18:45 | |
| openstackgerrit | Honza Pokorny proposed openstack/tripleo-ui master: Replace plan list table with a card view https://review.openstack.org/462230 | 18:45 |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient master: Handle failed actions https://review.openstack.org/460720 | 18:47 |
| *** jaganathan has quit IRC | 18:51 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Add refactor of tree-like vs graph https://review.openstack.org/461353 | 18:51 |
| *** gvrangan has quit IRC | 18:52 | |
| thrash | bandini: pro tip... https://github.com/dprince.keys | 18:57 |
| bandini | thrash: thanks :) I always forget about that | 18:57 |
| thrash | bandini: :D | 18:57 |
| *** dparkes has joined #tripleo | 19:01 | |
| *** suuuper has quit IRC | 19:05 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Configure snmpd auth params in ceilometer profile https://review.openstack.org/462237 | 19:06 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Disable Telemetry services on undercloud containers https://review.openstack.org/460274 | 19:07 |
| *** ooolpbot has joined #tripleo | 19:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 19:10 |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 19:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1687908 | 19:10 |
| *** ooolpbot has quit IRC | 19:10 | |
| openstack | Launchpad bug 1687908 in tripleo "Could not fetch contents for file:///usr/share/openstack-tripleo-heat-templates/extraconfig/tasks/post_puppet_pacemaker.yaml" [Critical,Triaged] - Assigned to Carlos Camacho (ccamacho) | 19:10 |
| *** jaganathan has joined #tripleo | 19:10 | |
| *** rhallisey has quit IRC | 19:13 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Merge "Add refactor of tree-like vs graph" https://review.openstack.org/462713 | 19:13 |
| *** gvrangan has joined #tripleo | 19:16 | |
| *** gbarros has joined #tripleo | 19:17 | |
| *** ramishra has quit IRC | 19:19 | |
| bandini | dciabrin, eck`, dprince: https://bugs.launchpad.net/tripleo/+bug/1688380 | 19:24 |
| openstack | Launchpad bug 1688380 in tripleo "containers need a system to define a bootstrap node" [High,Triaged] | 19:24 |
| dprince | bandini: got it, thanks | 19:27 |
| *** atoth has joined #tripleo | 19:29 | |
| *** jaganathan has quit IRC | 19:31 | |
| openstackgerrit | Oliver Walsh proposed openstack/puppet-tripleo master: Disable SSH login for nova_migration user when migration over ssh is disabled. https://review.openstack.org/462720 | 19:34 |
| *** jaganathan has joined #tripleo | 19:37 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Raise exception when base element does not match https://review.openstack.org/444330 | 19:37 |
| *** gbarros has quit IRC | 19:38 | |
| *** brault has joined #tripleo | 19:40 | |
| *** jaganathan has quit IRC | 19:42 | |
| *** brault_ has joined #tripleo | 19:45 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common stable/ocata: Add skip_deploy_identifier https://review.openstack.org/462723 | 19:46 |
| *** garyk has joined #tripleo | 19:46 | |
| *** garyk has quit IRC | 19:47 | |
| *** jaganathan has joined #tripleo | 19:47 | |
| *** brault has quit IRC | 19:48 | |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient stable/ocata: Add --skip-deploy-identifier https://review.openstack.org/462724 | 19:49 |
| *** jmelvin has quit IRC | 19:49 | |
| *** gvrangan has quit IRC | 19:50 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-common stable/ocata: Add skip_deploy_identifier https://review.openstack.org/462723 | 19:50 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates master: Containerize Ceilometer Agents https://review.openstack.org/454314 | 19:51 |
| *** jaganathan has quit IRC | 19:52 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Refactor block-device base functions. https://review.openstack.org/461356 | 19:54 |
| *** gvrangan has joined #tripleo | 20:04 | |
| *** ipsecguy_ has joined #tripleo | 20:05 | |
| *** atheurer has joined #tripleo | 20:06 | |
| *** ipsecguy has quit IRC | 20:07 | |
| *** liverpooler has quit IRC | 20:09 | |
| *** ooolpbot has joined #tripleo | 20:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 20:10 |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 20:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1687908 | 20:10 |
| *** ooolpbot has quit IRC | 20:10 | |
| openstack | Launchpad bug 1687908 in tripleo "Could not fetch contents for file:///usr/share/openstack-tripleo-heat-templates/extraconfig/tasks/post_puppet_pacemaker.yaml" [Critical,Triaged] - Assigned to Carlos Camacho (ccamacho) | 20:10 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart master: Add supplemental node provisioner https://review.openstack.org/451523 | 20:13 |
| leifmadsen | Could I get someone to +workflow this change and get it merged down? https://review.openstack.org/#/c/458223/ | 20:14 |
| leifmadsen | it has a couple of +1 and a +2 | 20:14 |
| slagle | LIBVIRT_DEFAULT_URI is the bug that will never die | 20:16 |
| leifmadsen | :D | 20:16 |
| *** jmelvin has joined #tripleo | 20:17 | |
| *** garyk has joined #tripleo | 20:17 | |
| *** jaganathan has joined #tripleo | 20:21 | |
| *** khrystoph has quit IRC | 20:22 | |
| *** khrystoph has joined #tripleo | 20:22 | |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart master: Add supplemental node provisioner https://review.openstack.org/451523 | 20:24 |
| *** jaganathan has quit IRC | 20:25 | |
| *** skramaja has joined #tripleo | 20:25 | |
| openstackgerrit | James Slagle proposed openstack/python-tripleoclient stable/ocata: Add --skip-deploy-identifier https://review.openstack.org/462724 | 20:39 |
| *** hamzy has quit IRC | 20:42 | |
| *** ansmith has quit IRC | 20:42 | |
| *** dsariel_ has quit IRC | 20:44 | |
| *** garyk1 has joined #tripleo | 20:45 | |
| *** garyk has quit IRC | 20:47 | |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Support heterogeneous OVB environments https://review.openstack.org/458651 | 20:49 |
| *** cylopez has joined #tripleo | 20:49 | |
| *** garyk1 has quit IRC | 20:51 | |
| *** eck` is now known as eck`gone | 20:52 | |
| *** athomas has quit IRC | 20:52 | |
| *** hjensas is now known as hjensas|afk | 20:53 | |
| *** khrystoph has quit IRC | 20:54 | |
| *** garyk has joined #tripleo | 20:55 | |
| *** khrystoph has joined #tripleo | 20:55 | |
| *** dprince has quit IRC | 21:00 | |
| *** abishop has quit IRC | 21:01 | |
| *** garyk has quit IRC | 21:01 | |
| *** brault_ has quit IRC | 21:03 | |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart master: Add supplemental node provisioner https://review.openstack.org/451523 | 21:08 |
| *** ooolpbot has joined #tripleo | 21:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 21:10 |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 21:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1687908 | 21:10 |
| *** ooolpbot has quit IRC | 21:10 | |
| openstack | Launchpad bug 1687908 in tripleo "Could not fetch contents for file:///usr/share/openstack-tripleo-heat-templates/extraconfig/tasks/post_puppet_pacemaker.yaml" [Critical,Triaged] - Assigned to Carlos Camacho (ccamacho) | 21:10 |
| *** gvrangan has quit IRC | 21:10 | |
| *** Goneri has quit IRC | 21:12 | |
| *** garyk1 has joined #tripleo | 21:13 | |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci master: Fix path for the multinode job when running the major upgrade. https://review.openstack.org/462570 | 21:13 |
| *** morazi has quit IRC | 21:15 | |
| *** garyk has joined #tripleo | 21:20 | |
| *** gvrangan has joined #tripleo | 21:20 | |
| *** cylopez has quit IRC | 21:21 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Refactor block-device base functions. https://review.openstack.org/461356 | 21:21 |
| *** garyk1 has quit IRC | 21:23 | |
| *** atoth has quit IRC | 21:24 | |
| *** tiswanso has quit IRC | 21:25 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: Refactor: block-device filesystem creation, mount and fstab https://review.openstack.org/444586 | 21:30 |
| *** skramaja has quit IRC | 21:31 | |
| *** jaganathan has joined #tripleo | 21:31 | |
| *** jmelvin has quit IRC | 21:32 | |
| *** dougbtv has quit IRC | 21:32 | |
| *** yolanda has quit IRC | 21:34 | |
| *** fzdarsky has quit IRC | 21:34 | |
| *** jerrygb has quit IRC | 21:35 | |
| *** jaganathan has quit IRC | 21:36 | |
| *** fpan has quit IRC | 21:38 | |
| *** karthiks has quit IRC | 21:38 | |
| *** jlinkes has quit IRC | 21:38 | |
| *** vkhanna has joined #tripleo | 21:41 | |
| *** garyk has quit IRC | 21:44 | |
| *** garyk has joined #tripleo | 21:45 | |
| *** ramishra has joined #tripleo | 21:48 | |
| *** gvrangan has quit IRC | 21:53 | |
| *** tiswanso has joined #tripleo | 21:53 | |
| *** ansmith has joined #tripleo | 21:55 | |
| *** tiswanso has quit IRC | 21:58 | |
| *** garyk has quit IRC | 21:59 | |
| *** gvrangan has joined #tripleo | 21:59 | |
| *** ffiore has joined #tripleo | 21:59 | |
| *** garyk has joined #tripleo | 22:00 | |
| *** jbadiapa has quit IRC | 22:01 | |
| *** garyk has quit IRC | 22:04 | |
| *** artom has joined #tripleo | 22:06 | |
| *** ooolpbot has joined #tripleo | 22:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 22:10 |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 22:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1687908 | 22:10 |
| *** ooolpbot has quit IRC | 22:10 | |
| openstack | Launchpad bug 1687908 in tripleo "Could not fetch contents for file:///usr/share/openstack-tripleo-heat-templates/extraconfig/tasks/post_puppet_pacemaker.yaml" [Critical,Triaged] - Assigned to Carlos Camacho (ccamacho) | 22:10 |
| *** arxcruz has quit IRC | 22:14 | |
| *** jbadiapa has joined #tripleo | 22:15 | |
| *** rlandy has quit IRC | 22:16 | |
| *** arxcruz has joined #tripleo | 22:17 | |
| *** ramishra has quit IRC | 22:18 | |
| *** garyk has joined #tripleo | 22:35 | |
| *** jerrygb has joined #tripleo | 22:37 | |
| *** idlemind has quit IRC | 22:39 | |
| dsneddon | Does anyone know whether OS::Neutron::Segment should be available in the version of Heat on the undercloud in master? This link says it should be available in Pike (9.0.0), but the undercloud Heat says it's not recognized. https://docs.openstack.org/developer/heat/template_guide/openstack.html#OS::Neutron::Segment | 22:39 |
| dsneddon | RPM for heat-api is 1:9.0.0-0.20170420143908.a9c423c.el7.centos | 22:40 |
| *** idlemind has joined #tripleo | 22:40 | |
| *** jerrygb has quit IRC | 22:41 | |
| *** vkhanna has left #tripleo | 22:43 | |
| *** idlemind_ has joined #tripleo | 22:45 | |
| *** idlemind has quit IRC | 22:45 | |
| *** percevalbot has quit IRC | 22:48 | |
| openstackgerrit | Adam Harwell proposed openstack/diskimage-builder master: Fix py3 error in block-device https://review.openstack.org/462751 | 22:55 |
| *** garyk has quit IRC | 22:57 | |
| *** garyk has joined #tripleo | 23:00 | |
| *** garyk has quit IRC | 23:02 | |
| *** artom has quit IRC | 23:02 | |
| *** brault has joined #tripleo | 23:04 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: Restrict nova migration ssh tunnel https://review.openstack.org/458082 | 23:05 |
| openstackgerrit | Merged openstack/tripleo-heat-templates master: [N->O] Add openstack-nova-migration to compute nodes. https://review.openstack.org/461115 | 23:05 |
| *** ffiore has quit IRC | 23:06 | |
| *** brault has quit IRC | 23:09 | |
| *** ooolpbot has joined #tripleo | 23:10 | |
| ooolpbot | URGENT TRIPLEO TASKS NEED ATTENTION | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1684272 | 23:10 |
| ooolpbot | https://bugs.launchpad.net/tripleo/+bug/1687908 | 23:10 |
| *** ooolpbot has quit IRC | 23:10 | |
| openstack | Launchpad bug 1684272 in tripleo "10 minute increase in overcloud deploy/update time" [Critical,In progress] | 23:10 |
| openstack | Launchpad bug 1687908 in tripleo "Could not fetch contents for file:///usr/share/openstack-tripleo-heat-templates/extraconfig/tasks/post_puppet_pacemaker.yaml" [Critical,Triaged] - Assigned to Carlos Camacho (ccamacho) | 23:10 |
| *** pmannidi has joined #tripleo | 23:14 | |
| *** garyk has joined #tripleo | 23:19 | |
| *** garyk has quit IRC | 23:20 | |
| *** funzo has joined #tripleo | 23:21 | |
| *** hamzy has joined #tripleo | 23:24 | |
| *** funzo has quit IRC | 23:26 | |
| *** garyk has joined #tripleo | 23:27 | |
| *** garyk1 has joined #tripleo | 23:28 | |
| *** garyk has quit IRC | 23:28 | |
| *** jkilpatr has quit IRC | 23:38 | |
| *** garyk has joined #tripleo | 23:39 | |
| *** jkilpatr has joined #tripleo | 23:39 | |
| openstackgerrit | Oliver Walsh proposed openstack/puppet-tripleo master: Disable SSH login for nova_migration user when migration over ssh is disabled. https://review.openstack.org/462720 | 23:39 |
| *** garyk1 has quit IRC | 23:41 | |
| *** artom has joined #tripleo | 23:50 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!