| *** cwolferh has joined #tripleo | 00:03 | |
| *** rook-remote has joined #tripleo | 00:08 | |
| *** Ng has quit IRC | 00:17 | |
| *** NobodyCam has quit IRC | 00:17 | |
| *** igorbelikov has quit IRC | 00:17 | |
| *** hrybacki has quit IRC | 00:18 | |
| *** patrickeast has quit IRC | 00:19 | |
| *** myoung has quit IRC | 00:19 | |
| *** Ng has joined #tripleo | 00:20 | |
| *** ChanServ sets mode: +v Ng | 00:20 | |
| *** igorbelikov has joined #tripleo | 00:20 | |
| *** NobodyCam has joined #tripleo | 00:20 | |
| *** hrybacki has joined #tripleo | 00:21 | |
| *** patrickeast has joined #tripleo | 00:22 | |
| *** zigo has quit IRC | 00:37 | |
| *** sthillma has quit IRC | 00:43 | |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 00:48 |
|---|---|---|
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Remove using a swap partition https://review.openstack.org/327094 | 00:48 |
| *** akshai_ has quit IRC | 00:48 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-heat-templates: Use already Deployed/Installed servers https://review.openstack.org/222772 | 00:49 |
| *** dmacpher has quit IRC | 00:57 | |
| *** rook-remote has quit IRC | 01:02 | |
| *** fzdarsky_ has joined #tripleo | 01:02 | |
| *** zigo has joined #tripleo | 01:03 | |
| *** fzdarsky has quit IRC | 01:06 | |
| *** ayoung has joined #tripleo | 01:07 | |
| *** dbecker has joined #tripleo | 01:13 | |
| *** chlong has joined #tripleo | 01:15 | |
| *** cwolferh has quit IRC | 01:19 | |
| openstackgerrit | Merged openstack/diskimage-builder: Add cinder-backup mappings https://review.openstack.org/326411 | 01:20 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Pre-install pip/virtualenv packages https://review.openstack.org/327472 | 01:21 |
| *** tzumainn has joined #tripleo | 01:23 | |
| *** dbecker has quit IRC | 01:23 | |
| *** akshai has joined #tripleo | 01:28 | |
| *** tzumainn has quit IRC | 01:29 | |
| *** dmacpher has joined #tripleo | 01:34 | |
| *** yamahata has joined #tripleo | 01:46 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-common: Add baremetal workflows https://review.openstack.org/300200 | 01:51 |
| *** akshai has quit IRC | 01:52 | |
| *** r-mibu has quit IRC | 01:57 | |
| *** yamahata has quit IRC | 01:58 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Import ::nova class from THT https://review.openstack.org/325982 | 02:04 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Remove usage of ::nova class in THT https://review.openstack.org/325983 | 02:05 |
| *** r-mibu has joined #tripleo | 02:12 | |
| *** Goneri has joined #tripleo | 02:14 | |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Implement Nova API profile https://review.openstack.org/325937 | 02:25 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Deploy nova::db classes in api profile https://review.openstack.org/326027 | 02:27 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Implement Nova API profile https://review.openstack.org/325937 | 02:28 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Deploy nova::db classes in api profile https://review.openstack.org/326027 | 02:30 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Enable nova-api as a composable service https://review.openstack.org/326020 | 02:31 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Remove nova::db classes, moved to puppet-tripleo https://review.openstack.org/326028 | 02:31 |
| *** akshai has joined #tripleo | 02:32 | |
| *** dkehn has quit IRC | 02:37 | |
| *** zaneb has quit IRC | 02:42 | |
| *** ramishra has quit IRC | 02:42 | |
| *** tzumainn has joined #tripleo | 02:46 | |
| EmilienM | slagle: https://review.openstack.org/#/c/316031/ is about to land \o/ | 02:47 |
| *** yamahata has joined #tripleo | 02:48 | |
| *** coolsvap has joined #tripleo | 02:49 | |
| *** tzumainn has quit IRC | 02:50 | |
| *** akshai has quit IRC | 03:04 | |
| *** saneax is now known as saneax_AFK | 03:27 | |
| *** numans has joined #tripleo | 03:27 | |
| *** yamahata has quit IRC | 03:37 | |
| *** yamahata has joined #tripleo | 03:38 | |
| *** panda|Zz has quit IRC | 03:46 | |
| *** panda|Zz has joined #tripleo | 03:46 | |
| *** jaosorior has joined #tripleo | 03:48 | |
| *** Goneri has quit IRC | 03:49 | |
| *** links has joined #tripleo | 04:00 | |
| *** saneax_AFK is now known as saneax | 04:30 | |
| *** coolsvap_ has joined #tripleo | 04:31 | |
| *** skramaja has quit IRC | 04:32 | |
| *** xinwu has quit IRC | 04:34 | |
| *** coolsvap has quit IRC | 04:35 | |
| *** coolsvap_ is now known as coolsvap | 04:36 | |
| *** cllewellyn_ has joined #tripleo | 04:40 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Remove using a swap partition https://review.openstack.org/327094 | 04:41 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Ceilometer composable roles https://review.openstack.org/324117 | 04:45 |
| *** cwolferh has joined #tripleo | 04:51 | |
| *** xinwu has joined #tripleo | 04:54 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Clear up "already provided" message https://review.openstack.org/290968 | 05:05 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Add python logger configuration https://review.openstack.org/325409 | 05:05 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Introspect logging testing more https://review.openstack.org/328071 | 05:05 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Convert element_dependencies to logging https://review.openstack.org/328072 | 05:05 |
| *** jprovazn has joined #tripleo | 05:07 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Clear up "already provided" message https://review.openstack.org/290968 | 05:07 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder: Convert element_dependencies to logging https://review.openstack.org/328072 | 05:07 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add sahara services to pacemaker environment https://review.openstack.org/326012 | 05:19 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Fix the ManagementNetValueSpecs param type https://review.openstack.org/309549 | 05:20 |
| *** skramaja has joined #tripleo | 05:23 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/tripleo-ci: Use dlrn instead of delorean for delorean-build command https://review.openstack.org/325823 | 05:26 |
| *** masco has joined #tripleo | 05:34 | |
| openstackgerrit | Merged openstack/os-refresh-config: Updated from global requirements https://review.openstack.org/324845 | 05:35 |
| openstackgerrit | Merged openstack/os-apply-config: Updated from global requirements https://review.openstack.org/324842 | 05:35 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Adjust UpgradeLevelNovaCompute rpc messaging pin to mitaka https://review.openstack.org/323299 | 05:38 |
| *** apetrich has quit IRC | 05:52 | |
| *** apetrich has joined #tripleo | 05:53 | |
| *** numans has quit IRC | 05:58 | |
| *** chlong has quit IRC | 06:03 | |
| *** numans has joined #tripleo | 06:05 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for keystone https://review.openstack.org/327029 | 06:06 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for heat https://review.openstack.org/327069 | 06:06 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for glance API and registry https://review.openstack.org/327473 | 06:06 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/puppet-tripleo: Enable TLS in the internal network for RabbitMQ https://review.openstack.org/327482 | 06:06 |
| numans | jaosorior, Hi, can you please put this into your review queue - https://review.openstack.org/#/c/320531/. | 06:09 |
| jaosorior | numans: Will that be required in other nodes other than the compute and the controller? | 06:11 |
| jaosorior | such as the object and block storage? | 06:12 |
| *** fragatina has quit IRC | 06:13 | |
| *** xinwu has quit IRC | 06:16 | |
| *** xinwu has joined #tripleo | 06:18 | |
| *** chlong has joined #tripleo | 06:20 | |
| *** cllewellyn_ has quit IRC | 06:20 | |
| *** apetrich has quit IRC | 06:28 | |
| *** apetrich has joined #tripleo | 06:29 | |
| *** cwolferh has quit IRC | 06:32 | |
| *** openstackgerrit has quit IRC | 06:32 | |
| *** openstackgerrit has joined #tripleo | 06:33 | |
| *** fragatina has joined #tripleo | 06:33 | |
| *** chlong has quit IRC | 06:35 | |
| *** fragatina has quit IRC | 06:36 | |
| *** fragatina has joined #tripleo | 06:37 | |
| *** cwolferh has joined #tripleo | 06:37 | |
| *** pcaruana has joined #tripleo | 06:40 | |
| *** Guest76774 has joined #tripleo | 06:43 | |
| *** xinwu has quit IRC | 06:47 | |
| *** dmacpher has quit IRC | 06:48 | |
| *** links has quit IRC | 06:55 | |
| openstackgerrit | Karthik S proposed openstack/tripleo-heat-templates: Customize the reservation of memory for host processes https://review.openstack.org/327705 | 07:04 |
| numans | jaosorior, sorry i was away. No its not required in other nodes. | 07:05 |
| jaosorior | numans: Alright, just making sure. I posted it for recheck and will merge it once it passes CI. Just a formality though, the commit should be fine. | 07:06 |
| numans | jaosorior, ok. thanks for the review | 07:06 |
| *** tremble has joined #tripleo | 07:06 | |
| jaosorior | no worries | 07:07 |
| *** links has joined #tripleo | 07:09 | |
| *** florianf has joined #tripleo | 07:11 | |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Enable bulk delete in swift for gnocchi https://review.openstack.org/327272 | 07:12 |
| *** ccamacho has quit IRC | 07:13 | |
| openstackgerrit | Merged openstack/puppet-tripleo: Enable bulk delete in swift for gnocchi https://review.openstack.org/327214 | 07:13 |
| *** apetrich has quit IRC | 07:14 | |
| *** ebarrera has joined #tripleo | 07:16 | |
| *** apetrich has joined #tripleo | 07:17 | |
| *** rcernin has joined #tripleo | 07:17 | |
| *** ccamacho has joined #tripleo | 07:18 | |
| ccamacho | morning! | 07:20 |
| jaosorior | ccamacho hey dude | 07:21 |
| ccamacho | jaosorior, hey man! one thing, you remember that we were facing lot of time outs in the deployments? In think is related to https://bugs.launchpad.net/tripleo/+bug/1590755 for liberty and to https://bugs.launchpad.net/tripleo/+bug/1546749 in general.. When the vms are not able to start.. you have a nice time out :) | 07:23 |
| openstack | Launchpad bug 1590755 in tripleo "TripleO deployment fails using Centos7 + stable/liberty" [Undecided,Fix committed] - Assigned to Carlos Camacho (ccamacho) | 07:23 |
| openstack | Launchpad bug 1546749 in tripleo "CI testenv vm stuck in boot loop trying to boot rescue kernel" [Critical,Invalid] - Assigned to James Slagle (james-slagle) | 07:23 |
| jaosorior | ccamacho: Well, that sounds like a reasonable explanation | 07:25 |
| *** dtantsur|afk is now known as dtantsur | 07:25 | |
| ccamacho | jaosorior there is definitively something hitting us there.. Ill try to get more information, at least an error. | 07:26 |
| *** tesseract has joined #tripleo | 07:27 | |
| *** TSCHAK has quit IRC | 07:29 | |
| *** mcornea has joined #tripleo | 07:29 | |
| *** openstackgerrit has quit IRC | 07:33 | |
| *** openstackgerrit has joined #tripleo | 07:33 | |
| openstackgerrit | Carlos Camacho proposed openstack-infra/tripleo-ci: Update deprecated references to heat in tripleo.sh https://review.openstack.org/312350 | 07:33 |
| *** zoli_gone-proxy is now known as zoliXXL | 07:33 | |
| *** zoliXXL is now known as zoli|wfh | 07:33 | |
| *** jpena|off is now known as jpena | 07:34 | |
| *** numans has quit IRC | 07:39 | |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates: Updates and fixes to NIC config template routes https://review.openstack.org/318389 | 07:41 |
| *** panda|Zz has quit IRC | 07:46 | |
| *** apetrich has quit IRC | 07:46 | |
| *** apetrich has joined #tripleo | 07:47 | |
| *** panda|Zz has joined #tripleo | 07:47 | |
| *** cwolferh has quit IRC | 07:54 | |
| *** coolsvap has quit IRC | 07:59 | |
| *** cwolferh has joined #tripleo | 08:00 | |
| *** jtomasek_ has joined #tripleo | 08:03 | |
| *** shardy has joined #tripleo | 08:03 | |
| *** ohamada has joined #tripleo | 08:05 | |
| *** ohamada has quit IRC | 08:07 | |
| *** ohamada has joined #tripleo | 08:09 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Ensure extracted log file are readable https://review.openstack.org/327053 | 08:10 |
| *** apetrich has quit IRC | 08:10 | |
| *** apetrich has joined #tripleo | 08:11 | |
| *** athomas has joined #tripleo | 08:11 | |
| *** coolsvap has joined #tripleo | 08:11 | |
| jaosorior | marios: Resopnded to your review https://review.openstack.org/#/c/315051/40 | 08:15 |
| jaosorior | thanks for checking it out :D | 08:15 |
| marios | jaosorior: ack looking (was I completely wrong?) | 08:16 |
| marios | jaosorior: what about the manage_service | 08:17 |
| *** zoli|wfh is now known as zoli|brb | 08:17 | |
| *** racedo has joined #tripleo | 08:19 | |
| jaosorior | I see that is definitely missed | 08:19 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates: Aodh upgrade heat template and manifests to replace ceilometer alarms https://review.openstack.org/320150 | 08:20 |
| *** jtomasek_ has quit IRC | 08:20 | |
| jaosorior | marios: yep, service_manage is missing. Thanks for pointing that out! | 08:21 |
| jaosorior | as per that duplicate section | 08:21 |
| jaosorior | that is a tricky part | 08:21 |
| jaosorior | as it's still needed by ceilometer there | 08:21 |
| marios | jaosorior: np man i said i would so i did :) | 08:21 |
| jaosorior | I guess that section could end up being a resource by itself | 08:22 |
| marios | jaosorior: yeah fair enough. i commented on that puppet-tripleo side, mainlyu cos i noticed it wasn't really common to the two existing tht manifests | 08:22 |
| marios | jaosorior: but i also don't think it should hurt so just +2 there | 08:22 |
| jaosorior | damn, I guess we ended up having issues with the rebases, from what Ican see the state is now | 08:24 |
| jaosorior | excellent review | 08:25 |
| jaosorior | thanks dude | 08:25 |
| jaosorior | ccamacho: actually that section in the ceilometer commit isn't removed in the mongodb one | 08:27 |
| ccamacho | jaosorior, but is needed right? | 08:27 |
| ccamacho | jaosorior, Can I update the missing param in the mongodb submission? just confirm not duplicated effort. | 08:28 |
| ccamacho | or you are adding it? | 08:29 |
| jaosorior | ccamacho: you can add it | 08:29 |
| jaosorior | it's needed for ceilometer there | 08:29 |
| jaosorior | yeah | 08:29 |
| ccamacho | jaosorior, nice! | 08:29 |
| jaosorior | also, check the comments on the mongodb one | 08:29 |
| ccamacho | jaosorior, ack | 08:29 |
| *** jaosorior has quit IRC | 08:30 | |
| *** jaosorior has joined #tripleo | 08:30 | |
| *** hjensas has joined #tripleo | 08:31 | |
| jaosorior | ccamacho: Also check the comments in both the puppet and the t-h-t patches for mongo | 08:32 |
| *** hjensas has quit IRC | 08:32 | |
| ccamacho | ok | 08:32 |
| jaosorior | ccamacho: I think that section is gonna end up as a resource itself... what do you think? | 08:33 |
| openstackgerrit | Thomas Bechtold proposed openstack/diskimage-builder: Remove discover from test-requirements https://review.openstack.org/328170 | 08:34 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Convert SNMP configuration to composable services format https://review.openstack.org/320597 | 08:36 |
| openstackgerrit | Steven Hardy proposed openstack/tripleo-heat-templates: Convert swift storage to composable services https://review.openstack.org/320580 | 08:36 |
| *** ifarkas has joined #tripleo | 08:37 | |
| jaosorior | Hey guys, here's a quick review https://review.openstack.org/#/c/327631/ converting some no-op templates to use OS::Heat::None instead :D | 08:39 |
| jaosorior | code removal FTW | 08:39 |
| shadower | YES INDEED | 08:39 |
| ccamacho | jaosorior, yeahp, I think it should, but im not fully aware how to handle the scope with the variables, i.e. im using it here https://review.openstack.org/#/c/304780/24/manifests/profile/base/database/mongodb.pp including it and then referencing it, but never did it with s define | 08:41 |
| jistr | also here's a backport fixing minor updates on stable/mitaka https://review.openstack.org/#/c/326631 | 08:43 |
| jistr | still trying to get non-ha pass with a recheck, but in theory that shouldn't be necessary, as it doesn't test anything in that patch | 08:43 |
| shardy | Hmm, why are nonha jobs hitting stack timeouts after only 20mins?! | 08:44 |
| shardy | http://logs.openstack.org/11/326511/2/check-tripleo/gate-tripleo-ci-centos-7-nonha/e572c14/logs/postci.txt.gz | 08:45 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Update .sh references from openstack-keystone to openstack-core https://review.openstack.org/326631 | 08:45 |
| *** hjensas has joined #tripleo | 08:45 | |
| *** hjensas has joined #tripleo | 08:45 | |
| jaosorior | jistr: There was some fix commited not too long ago to stable/mitaka. That might help iwht this? that's why I rebased | 08:46 |
| jistr | jaosorior: ok thanks a bunch :) | 08:46 |
| jaosorior | shardy, ccamacho had a theory, we might be hitting this bug https://bugs.launchpad.net/tripleo/+bug/1590755 | 08:46 |
| openstack | Launchpad bug 1590755 in tripleo "TripleO deployment fails using Centos7 + stable/liberty" [Undecided,Fix committed] - Assigned to Carlos Camacho (ccamacho) | 08:46 |
| jaosorior | ah wait | 08:47 |
| jaosorior | I meant this one https://bugs.launchpad.net/tripleo/+bug/1546749 | 08:47 |
| openstack | Launchpad bug 1546749 in tripleo "CI testenv vm stuck in boot loop trying to boot rescue kernel" [Critical,Invalid] - Assigned to James Slagle (james-slagle) | 08:47 |
| *** coolsvap has quit IRC | 08:47 | |
| jaosorior | shardy ^^ | 08:47 |
| shardy | jaosorior: I'm not sure that is the same - we didn't hit the infra timeout with a stalled job, the job ran fine but the heat stack timed out way too soon | 08:48 |
| *** rasca has quit IRC | 08:48 | |
| jaosorior | funky | 08:48 |
| *** pino|work has joined #tripleo | 08:49 | |
| jistr | hmm the timeout_mins above this spot http://logs.openstack.org/11/326511/2/check-tripleo/gate-tripleo-ci-centos-7-nonha/e572c14/logs/postci.txt.gz#_2016-06-10_07_44_38_000 | 08:49 |
| ccamacho | jaosorior shardy yeahp im recording a screencast, but this generates a timeout after 2 hours ... | 08:49 |
| jistr | it's really set to 20 8-| | 08:49 |
| *** rasca has joined #tripleo | 08:50 | |
| jaosorior | since when is it set to 20? O_o | 08:50 |
| *** coolsvap has joined #tripleo | 08:51 | |
| shardy | It should be 240 ... | 08:52 |
| jaosorior | that's weird | 08:52 |
| *** coolsvap has quit IRC | 08:52 | |
| * shardy wonders if we've somehow mixed up pingtest and overcloud timeouts somewhere | 08:52 | |
| *** coolsvap has joined #tripleo | 08:52 | |
| openstackgerrit | Merged openstack/os-cloud-config: Updated from global requirements https://review.openstack.org/324843 | 08:53 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Replace no-op TLS stacks with OS::Heat::None https://review.openstack.org/327631 | 08:54 |
| jistr | shardy, jaosorior: i wonder if something changed with devstack_gate_timeout https://github.com/openstack-infra/tripleo-ci/blob/4750ff460b41c9f3697cd63c9ee0c4ed2cf933e9/toci_gate_test.sh#L53 | 08:55 |
| jistr | hmm http://logs.openstack.org/11/326511/2/check-tripleo/gate-tripleo-ci-centos-7-nonha/e572c14/console.html#_2016-06-10_06_39_35_756326 | 08:56 |
| shardy | jistr: ah, that may explain it, good spotting :) | 08:57 |
| jistr | on older jobs it's 80 http://logs.openstack.org/01/324301/4/check-tripleo/gate-tripleo-ci-centos-7-nonha/0132144/console.html | 08:58 |
| *** zoli|brb is now known as zoli|wfh | 08:58 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Composable Mistral services https://review.openstack.org/323436 | 08:59 |
| jistr | not sure how to fix it though, e.g. where does devstack_gate_timeout come from | 09:00 |
| jistr | certainly not from here https://github.com/openstack-infra/tripleo-ci/blob/5fdf3baeed17104fc92a896329c11b6f758ec8bf/scripts/bighammer.sh#L107 | 09:00 |
| shardy | Yeah, I'm assuming that doesn't mean the global infra timout has changed, only that we're looking at the wrong variable | 09:00 |
| *** coolsvap has quit IRC | 09:03 | |
| *** apetrich has quit IRC | 09:04 | |
| *** numans has joined #tripleo | 09:04 | |
| *** apetrich has joined #tripleo | 09:08 | |
| *** coolsvap has joined #tripleo | 09:10 | |
| d0ugal | Anyone else having issues builing images? | 09:11 |
| d0ugal | (for the overcloud) | 09:11 |
| jistr | hmm we may need help from derekh or pabelanger on the timeout issue.. the rest of the openstack-infra CI workings is a mystery to me, can't find much in there | 09:12 |
| openstackgerrit | Steven Hardy proposed openstack-infra/tripleo-ci: DNM timeout debugging https://review.openstack.org/328183 | 09:12 |
| shardy | jistr: Yeah, I've looked at various repos too, and I can't see where that variable is derived from | 09:12 |
| shardy | or, rather, I can see it being set and it's not recently changed | 09:13 |
| *** numans has quit IRC | 09:13 | |
| openstackgerrit | Merged openstack/python-tripleoclient: Updated from global requirements https://review.openstack.org/300044 | 09:13 |
| jistr | yea.. | 09:13 |
| shardy | https://github.com/openstack-infra/devstack-gate/blob/master/devstack-vm-gate-wrap.sh#L364 | 09:13 |
| shardy | I've just pushed a patch to dump the env then fail, so we can hopefully see what the various timeouts are set to | 09:14 |
| shardy | perhaps we can just pick a different variable to use | 09:14 |
| jistr | i saw we recently switched from f22 to centos7, and i wondered if that could have something to do with it, but couldn't find anything related to timeout | 09:14 |
| jistr | cool re env variables inspection | 09:15 |
| *** tosky has joined #tripleo | 09:15 | |
| *** coolsvap has quit IRC | 09:15 | |
| shardy | http://logs.openstack.org/11/326511/2/check-tripleo/gate-tripleo-ci-centos-7-ha/671bbfb/console.html#_2016-06-10_06_39_35_881 | 09:15 |
| * jistr gets back to trying to spot https://bugs.launchpad.net/tripleo/+bug/1589986 | 09:15 | |
| openstack | Launchpad bug 1589986 in tripleo "Interactive mode of overcloud update command not working" [High,Triaged] | 09:15 |
| shardy | what I don't understand is it's only affecting the nonha job | 09:16 |
| shardy | is that the one derekh moved to the ovb cloud? | 09:16 |
| shardy | I'm not sure if that happened yet | 09:16 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Remove the unused service_host arg from node registration https://review.openstack.org/326036 | 09:17 |
| shardy | https://bugs.launchpad.net/tripleo/+bug/1591102 | 09:19 |
| openstack | Launchpad bug 1591102 in tripleo "nonha job faiing due to wrong timeout of 20 mins" [Critical,Triaged] | 09:19 |
| shardy | raised that | 09:19 |
| *** apetrich has quit IRC | 09:20 | |
| *** coolsvap has joined #tripleo | 09:22 | |
| *** apetrich has joined #tripleo | 09:22 | |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Register nodes new workflow https://review.openstack.org/323665 | 09:24 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Remove the unused service_host arg from node registration https://review.openstack.org/326036 | 09:28 |
| openstackgerrit | Merged openstack/tripleo-image-elements: Replace deprecated LOG.warn with LOG.warning https://review.openstack.org/291627 | 09:38 |
| *** Ablu has left #tripleo | 09:40 | |
| *** dtantsur is now known as dtantsur|lunch | 09:42 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Avoid repetition in endpoint map https://review.openstack.org/308182 | 09:43 |
| *** rook-remote has joined #tripleo | 09:44 | |
| *** coolsvap is now known as coolsvap|afk | 09:46 | |
| *** mbound has joined #tripleo | 09:48 | |
| *** dmacpher has joined #tripleo | 09:51 | |
| *** yamahata has quit IRC | 09:56 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add placeholder for Internal TLS template https://review.openstack.org/328214 | 09:56 |
| *** rook-remote has quit IRC | 09:56 | |
| *** athomas has quit IRC | 09:57 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add flags to enable internal TLS https://review.openstack.org/328216 | 10:00 |
| *** akrivoka has joined #tripleo | 10:02 | |
| *** athomas has joined #tripleo | 10:03 | |
| jaosorior | shardy: Hey man, it seems that I'm actually gonna need this https://review.openstack.org/#/c/308182/16 . It's the commit that introduces the map_merge for the endpoint map | 10:08 |
| jaosorior | shardy: I'm working on enabling TLS everywhere. And for enabling https in the internal and admin endpoints, that would be pretty useful. | 10:09 |
| jaosorior | Because if you have both internal and public enabled, there will be two versions of the endpoint map imported, and it might get problematic for the deployer | 10:10 |
| jaosorior | so, if we would have the map_merge set, we could do something like this https://review.openstack.org/#/c/328216/1/environments/internal-tls.yaml | 10:10 |
| jaosorior | what do you think? | 10:13 |
| shardy | jaosorior: I'll have to give it some more thought - I'm still not a fan of having EndpointMapDefaults and EndpointMap | 10:14 |
| shardy | like, it seems to me it'd be better if we located definition of things like default port and endpoint paths in the service templates | 10:15 |
| shardy | I commented to that effect, did you see it? | 10:15 |
| shardy | Currently we have one bug EndpointMap for all services, but that kinda is the opposite of the direction we've been heading with the composable services | 10:15 |
| shardy | Basically I'm wondering if the defaults should go in the service templates, then the user-supplied map is used only to override defaults | 10:16 |
| shardy | (which, I think, is what you want?) | 10:16 |
| jaosorior | yeah | 10:17 |
| jaosorior | that would be another way to go | 10:17 |
| jaosorior | I'm honestly not entirely sure how to get there though | 10:17 |
| jaosorior | cause we need some URLs already formed and passed via hieradata | 10:18 |
| jaosorior | which is the reason the endpoint map exists in the first place | 10:18 |
| *** jprovazn has quit IRC | 10:18 | |
| jaosorior | shardy: You had mentioned that you were gonna do a quick hack to see how that would look like though. Did you ever get time for something like that? | 10:20 |
| *** mgould|afk is now known as mgould | 10:24 | |
| shardy | jaosorior: Yeah, sorry I didn't get to it, I'll try to do something later, but basically it'd just be a merge of data inside each API template with that passed in via a parameter | 10:24 |
| shardy | we might need to use the new heat yaql function if we need a deep merge (or update map_merge to support this) so that folks can provide a partial endpoint data override | 10:25 |
| shardy | (e.g just the port, protocol or whatever) | 10:26 |
| *** osp has quit IRC | 10:28 | |
| *** coolsvap|afk is now known as coolsvap | 10:29 | |
| jaosorior | shardy: well, I'll give it a thought... either way, I guess to be able to do a solution for that, we need the composable services work to be more stable | 10:32 |
| coolsvap | shardy, hi | 10:32 |
| shardy | DEVSTACK_GATE_TIMEOUT=170 | 10:32 |
| *** cwolferh has quit IRC | 10:32 | |
| jaosorior | Can someone merge this? https://review.openstack.org/#/c/327499/ It pretty much just updates the requirements from tripleo-validations to have them correct according to global-requirements | 10:33 |
| shardy | + echo 'Job timeout set to: 159 minutes' in one nonha job, then echo 'Job timeout set to: 93 minutes' in another | 10:36 |
| shardy | wha? | 10:36 |
| shardy | coolsvap: Hi! | 10:36 |
| *** cwolferh has joined #tripleo | 10:36 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-tripleo: WIP: integration of the new puppet pacemaker. https://review.openstack.org/309069 | 10:36 |
| *** zoli|wfh is now known as zoli_gone-proxy | 10:37 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-tripleo: WIP: integration of the new puppet pacemaker. https://review.openstack.org/309069 | 10:37 |
| coolsvap | shardy, hi I want to get approval for the membership of https://launchpad.net/~tripleo group, I am planning to do bug triage next week | 10:37 |
| shardy | coolsvap: Ok, no problem (and thanks!), what's your launchpad ID? | 10:38 |
| coolsvap | coolsvap | 10:38 |
| shardy | :D | 10:38 |
| shardy | coolsvap: added! | 10:41 |
| coolsvap | shardy, thanks! | 10:43 |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-heat-templates: Split Heat pacemaker roles into separate services https://review.openstack.org/327709 | 10:49 |
| *** osp has joined #tripleo | 10:54 | |
| *** dtantsur|lunch is now known as dtantsur | 10:58 | |
| *** florianf has quit IRC | 10:59 | |
| *** rook-remote has joined #tripleo | 11:01 | |
| *** florianf has joined #tripleo | 11:08 | |
| *** coolsvap has quit IRC | 11:08 | |
| *** zoli_gone-proxy is now known as zoliXXL | 11:09 | |
| *** dmk0202 has joined #tripleo | 11:10 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates: WIP: integration of the new puppet pacemaker. https://review.openstack.org/302409 | 11:16 |
| ccamacho | Hey jaosorior, jistr, shardy I just added the screencasts and logs for the timeout issue as comments in https://bugs.launchpad.net/tripleo/+bug/1546749 | 11:20 |
| openstack | Launchpad bug 1546749 in tripleo "CI testenv vm stuck in boot loop trying to boot rescue kernel" [Critical,Invalid] - Assigned to James Slagle (james-slagle) | 11:20 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: make the config dir outside of src. virt_env/config https://review.openstack.org/327288 | 11:20 |
| *** jpena is now known as jpena|lunch | 11:22 | |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-heat-templates: Composable Mistral services https://review.openstack.org/323436 | 11:22 |
| *** masco has quit IRC | 11:23 | |
| *** fzdarsky_ is now known as fzdarsky|lunch | 11:23 | |
| *** dmk0202 has quit IRC | 11:23 | |
| ccamacho | jaosorior im redeploying my local env to test the mongodb changes, ill push them after that | 11:24 |
| *** jcoufal has joined #tripleo | 11:26 | |
| dtantsur | hey folks! what's the status of https://review.openstack.org/#/c/302381/ can it be merged? | 11:27 |
| dtantsur | it's unclear if upgrades job works at all on liberty | 11:27 |
| dtantsur | it has 2x +2 and ha and nonha gates passed there | 11:28 |
| *** ccamacho is now known as ccamacho|lunch | 11:29 | |
| *** rhallisey has joined #tripleo | 11:29 | |
| shardy | dtantsur: It was working at one point - AFAICS it started failing around the 30th March | 11:34 |
| shardy | http://paste.fedoraproject.org/377028/58505146 | 11:35 |
| openstackgerrit | Merged openstack/instack-undercloud: Force rebuild of ramdisk as part of overcloud-full https://review.openstack.org/302381 | 11:35 |
| shardy | jistr, marios: Hey have you looked into that upgrades job failure? | 11:35 |
| shardy | or, we can just merge it with failing CI and leave the job broken :\ | 11:36 |
| marios | shardy: hey no i have not - I believe gfidente worked on that primarily, and despite the name it doesn't actually upgrade | 11:36 |
| shardy | yeah it does an update | 11:36 |
| marios | shardy: i mean it does a stack update yes but not any upgrade workflow | 11:36 |
| dtantsur | shardy, well, I'm pretty sure this patch is not something breaking the job.. | 11:36 |
| *** dmk0202 has joined #tripleo | 11:36 | |
| shardy | dtantsur: Yeah I know, it's just frustrating it's been broken this long | 11:37 |
| dtantsur | oh yeah | 11:37 |
| shardy | marios: pingtest is failing after the update I think, glance seems to be broken | 11:37 |
| shardy | Or actually keystone | 11:37 |
| shardy | ugh | 11:38 |
| marios | shardy: ok will have a look after i get this thing i've got in vim committed gimme few | 11:38 |
| shardy | marios: ack, thanks | 11:38 |
| *** fultonj has quit IRC | 11:39 | |
| *** fultonj has joined #tripleo | 11:40 | |
| *** jprovazn has joined #tripleo | 11:40 | |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Use Mistral for baremetal registration https://review.openstack.org/322612 | 11:40 |
| *** dprince has joined #tripleo | 11:44 | |
| *** pkovar has joined #tripleo | 11:44 | |
| jistr | shardy: i looked several weeks ago but was blocked from deploying Liberty at all by the issue that we've been able to work around just yesterday (the XFS inode problem), haven't looked since | 11:45 |
| *** panda|Zz has quit IRC | 11:45 | |
| *** panda|Zz has joined #tripleo | 11:46 | |
| shardy | jistr: ack - perhaps you can test re-running overcloud deploy when you have a working deployment | 11:46 |
| shardy | from the CI results it looks like things break after any stack update | 11:46 |
| * shardy lunch | 11:47 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Avoid repetition in endpoint map https://review.openstack.org/308182 | 11:49 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add placeholder for Internal TLS template https://review.openstack.org/328214 | 11:49 |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack/tripleo-heat-templates: Add flags to enable internal TLS https://review.openstack.org/328216 | 11:49 |
| *** panda|Zz is now known as panda | 11:49 | |
| *** pcaruana has quit IRC | 11:51 | |
| jistr | shardy: not sure if/when i'll get to deploying upstream stable/liberty but will try that if i do | 11:53 |
| *** morazi has joined #tripleo | 11:55 | |
| *** rodrigods has quit IRC | 11:55 | |
| *** rodrigods has joined #tripleo | 11:56 | |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-heat-templates: Replace use of deprecated neutron puppet param (network_device_mtu) https://review.openstack.org/328256 | 11:56 |
| dprince | If we land this we can push in 2-3 of the Neutron composable service patches: https://review.openstack.org/#/c/326119/ | 11:58 |
| *** fzdarsky|lunch is now known as fzdarsky | 12:00 | |
| social__ | marios: ping? | 12:03 |
| social__ | jistr: do we have meeting? | 12:04 |
| jistr | social__: i thought it's in 2 hrs | 12:04 |
| social__ | oh 14:00 wasn't CEST? | 12:04 |
| jistr | mine says 16:00 | 12:05 |
| social__ | ack | 12:05 |
| jistr | which i hope is translated to CEST :) | 12:05 |
| social__ | ok, back to dib an ipxe | 12:06 |
| * social__ cries | 12:06 | |
| dprince | rbrady, d0ugal: https://review.rdoproject.org/r/#/c/1359/ | 12:06 |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-common: Fix interactive update race condition https://review.openstack.org/328260 | 12:06 |
| dprince | trown|outtypewww, jtomasek: new Mistral dependency https://review.rdoproject.org/r/#/c/1359/ | 12:06 |
| *** pcaruana has joined #tripleo | 12:07 | |
| openstackgerrit | Marios Andreou proposed openstack/tripleo-heat-templates: Rework the pacemaker_common_functions for M..N upgrades https://review.openstack.org/321027 | 12:09 |
| openstackgerrit | James Slagle proposed openstack-infra/tripleo-ci: Add mulitnode CI job support to tripleo-ci https://review.openstack.org/324777 | 12:10 |
| *** jayg|g0n3 is now known as jayg | 12:12 | |
| *** pcaruana has quit IRC | 12:13 | |
| *** pcaruana has joined #tripleo | 12:13 | |
| openstackgerrit | Jiri Stransky proposed openstack/tripleo-common: Fix interactive update race condition https://review.openstack.org/328260 | 12:14 |
| *** ayoung has quit IRC | 12:15 | |
| *** weshay has joined #tripleo | 12:18 | |
| openstackgerrit | Lukas Bezdicka proposed openstack/instack-undercloud: [WIP] Update puppet dependancies before running puppet https://review.openstack.org/328264 | 12:19 |
| *** zoliXXL is now known as zoli|lunch | 12:20 | |
| *** jpena|lunch is now known as jpena | 12:21 | |
| dprince | rbrady, d0ugal: See notes here on line 38 https://etherpad.openstack.org/p/tripleo-mistral-api | 12:24 |
| *** dmk0202 has quit IRC | 12:25 | |
| dprince | rbrady, d0ugal: hitting a weird 'TypeError: expected string or buffer' this morning after building a new undercloud and deploying the rebased baremetal.yaml changes yesterday to do the renaming | 12:25 |
| dprince | rbrady, d0ugal: I don't think it is our code that is causing this one though | 12:25 |
| rbrady | dprince: can you paste the error and we can cross reference recent mistral changes? | 12:26 |
| dprince | rbrady: See full paste here: http://paste.openstack.org/show/510518/ | 12:26 |
| dprince | rbrady: the registration actually works fine (the workflow ran to SUCCESS) | 12:27 |
| dprince | rbrady: the raw format from the Zaqar message body is off though | 12:27 |
| dprince | rbrady: recv() isn't playing nicely with the json.loads anymore :/ | 12:27 |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Remove usage of ::nova class in THT https://review.openstack.org/325983 | 12:30 |
| dtantsur | dprince, please see my comments on https://review.openstack.org/#/c/327760/ tl;dr you're still operating wrong assumptions about your register_all_nodes function. | 12:33 |
| dprince | rook: commented here https://review.openstack.org/#/c/327109/1 | 12:34 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Refactors service url retrieval https://review.openstack.org/322121 | 12:34 |
| dprince | rook: I think I mentioned this last week but this is the second time I've been asked to remove the tenant MTU settings via that dnsmasq config file. It clearly breaks TripleO ATM to do so... | 12:35 |
| openstackgerrit | Merged openstack/puppet-tripleo: Make neutron server/ml2 profiles match t-h-t https://review.openstack.org/326119 | 12:35 |
| rook-remote | dprince huh? removing the dnsmasq file breaks TripleO? | 12:36 |
| *** dmsimard is now known as dmsimard|afk | 12:37 | |
| openstackgerrit | Merged openstack/tripleo-ui: Add create plan progress indicator https://review.openstack.org/326041 | 12:37 |
| marios | shardy: dtantsur: had a poke at /#/c/302381/ upgrades job logs. most suspicious thing i can see is http://logs.openstack.org/81/302381/1/check-tripleo/gate-tripleo-ci-f22-upgrades/49b8a76/console.html.gz#_2016-05-17_23_33_16_916 but can't quickly find where that comes from (e.g. i checked python-openstackclient). | 12:37 |
| dprince | rook-remote: yes, it breaks our CI | 12:37 |
| marios | shardy: dtantsur i'm wondering if the 503 is because it gets the URL wrong (due to version) | 12:37 |
| rook-remote | dprince: well TripleO isn't broke | 12:37 |
| rook-remote | dprince: it looks like a guest failed to launch | 12:37 |
| *** skramaja has quit IRC | 12:38 | |
| marios | shardy: dtantsur cos looking at overcloud glance logs I see no issues | 12:38 |
| rook-remote | dprince: 2016-06-09 20:17:54.779 | | server1 | 7cb1ff59-959b-4d99-a294-872097cd388d | ResourceInError: resources.server1: Went to status ERROR due to "Message: Build of instance dc2d4db6-b119-4559-aa1d-b07a124d527f aborted: Failed to allocate the network(s), not rescheduling., Code: 500" | CREATE_FAILED | 2016-06-09T20:00:56 | | 12:38 |
| dprince | rook-remote: I actually think the problem might be we still specify /etc/neutron/dnsmasq-neutron.conf as the conf file | 12:38 |
| rook-remote | dprince: right, that would cuase the dhcp-agent to stb | 12:39 |
| dprince | rook-remote: Just did a recheck on https://review.openstack.org/#/c/325926/2 so lets see what happens | 12:39 |
| rook-remote | dprince: roger. | 12:39 |
| *** dmk0202 has joined #tripleo | 12:39 | |
| dprince | dtantsur: if the intent for the UUIDs is only this I'm fine with them. | 12:39 |
| social__ | jistr: I'm bit stuck with DIB, so DIB is responsible for installing puppet and puppet modules from git or from package but in instack-undercloud I'd love to ensure latest version yet DIB does not have support for package update. Can I check for DIB env variables in instack-undercloud or should I pach DIB? :) | 12:39 |
| dprince | dtantsur: just concerned about what happens if I (as an end user) also start introducing UUIDs into my own json files for consistency as well | 12:40 |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates: Keystone liberty mitaka upgrade step https://review.openstack.org/302235 | 12:40 |
| *** florianf has quit IRC | 12:40 | |
| dtantsur | dprince, UUID is the only reliable way to address an ironic node. we use a couple of other means, but I know how to break every one of them :) | 12:40 |
| dprince | dtantsur: so how would UUIDs work with the client (python-tripleoclient) | 12:41 |
| dtantsur | dprince, you may want to. for example if you want to update a driver, it is likely to fail right now (or end up in a new node instead of an update). putting UUID to instackenv.json will avoid it | 12:41 |
| dprince | dtantsur: we've got now state/session there | 12:41 |
| dtantsur | dprince, sorry? you lost me there | 12:41 |
| dprince | dtantsur: oh, so you intend to have python-tripleoclient accept a file of nodes to upload, and then write out the same file again? | 12:42 |
| dtantsur | dprince, no, no writing. if you have UUID there - fine. | 12:42 |
| dprince | dtantsur: I don't, so then we do the best we can I think | 12:43 |
| dprince | dtantsur: which is what happens now | 12:43 |
| dtantsur | dprince, ironic will happily accept a UUID generated by you instead of generating it | 12:43 |
| jistr | social__: i don't think DIB should know anything about updates, it should be only concerned about a one-off build. The fact that we use re-run DIB elements in instack-undercloud for installing and updating means using them in a bit in a way they weren't intended to use IMHO. | 12:43 |
| dtantsur | dprince, maybe I still misunderstand your concern. I don't see how it's different from allowing to set a name, for example (which we do) | 12:43 |
| jistr | social__: so my initial impression is that we should not patch DIB elements to care about updates | 12:43 |
| dprince | dtantsur: the UI isn't generating a name, that is what is differnt | 12:44 |
| dtantsur | dprince, why? it can well set a name provided by a user | 12:44 |
| jistr | social__: you want to look for what variable OPM install source? so that we support updating both RPMs and git? | 12:44 |
| dtantsur | dprince, also what's wrong with UI generating a UUID? how does it matter for anything on which side it's generated? | 12:44 |
| dprince | dtantsur: correct | 12:44 |
| dprince | dtantsur: that is the end user, not the UI | 12:44 |
| jistr | social__: s/what variable/what variable?/ | 12:44 |
| dprince | dtantsur: I'm fine with this feature on the basis it provides the end user something useful | 12:45 |
| dprince | dtantsur: I question the fact that the UI wants to play man in the middle | 12:45 |
| dprince | dtantsur: and generate the UUIDs | 12:45 |
| mgould | hi everyone | 12:45 |
| dtantsur | dprince, to be honest, from my past experience, generating UUID's on a client side is the only sane option, but openstack does not care about it :) | 12:46 |
| dprince | dtantsur: and if it doesn, why aren't we doing the same thing via pyton-tripleoclient? | 12:46 |
| mgould | I have a trivial docs-only patch that's finally passing CI, can someone please review it? https://review.openstack.org/#/c/321116/ | 12:46 |
| dtantsur | dprince, first of all, tripleoclient is not registering nodes in the same manner as UI does | 12:46 |
| openstackgerrit | Merged openstack/instack-undercloud: Set Neutron notification project correctly https://review.openstack.org/327325 | 12:46 |
| dprince | dtantsur: that is a problem | 12:46 |
| dtantsur | dprince, it just takes a file, UI essentially generates this file | 12:46 |
| dprince | dtantsur: we should be using the same mechanism | 12:46 |
| *** rook-remote has quit IRC | 12:47 | |
| dtantsur | well, that's the feature :) writing an instackenv.json has never been a user-friendly way of doing node registration | 12:47 |
| dprince | dtantsur: I actually think that is the core of my issues with much of the baremetal workflow feedback, it is that the UI is trying to start from scratch... when I think it'd be better to have parity first | 12:47 |
| dtantsur | have you seen the UI mockups? they will provide a user with a form, not with "please write a file in a weird and badly documented format" | 12:47 |
| dprince | dtantsur: has upstream seen those mockups :) | 12:47 |
| dtantsur | dprince, yes, posted on the ML | 12:48 |
| rook | dtantsur that is why I wrote a csv-to-instack script :) | 12:48 |
| *** rlandy has joined #tripleo | 12:48 | |
| dtantsur | lol | 12:48 |
| dprince | dtantsur: I'd prefer a file | 12:48 |
| rook | dtantsur doing some of the larger scale deployments 300+ with TripleO | 12:48 |
| *** kbyrne has quit IRC | 12:48 | |
| dprince | dtantsur: not a form | 12:48 |
| dtantsur | dprince, man, I'm sorry, but tripleoclient UX is not something to be proud of. hope you don't take it too close | 12:48 |
| dprince | dtantsur: if the UI wants both, then fine | 12:48 |
| rook | Could you imagine a 300 node instack file :( | 12:48 |
| dprince | dtantsur: I think we can support both probably fine. But we need parity | 12:48 |
| dprince | rook: yes, I can | 12:48 |
| rook | dprince i can share one iwth ya | 12:49 |
| dtantsur | dprince, any sane UI would want a form. as I said " write a file in a weird and badly documented format (incompatible with ironic representation)" is not a UX | 12:49 |
| dprince | dtantsur: I'm not proud of tripleoclient, it was also developed not so upstream I think | 12:49 |
| dtantsur | but we get further from the discussion point | 12:49 |
| dprince | dtantsur: I want both | 12:49 |
| *** kbyrne has joined #tripleo | 12:49 | |
| dprince | dtantsur: I'm never going to individually add 300 nodes to a cluster | 12:49 |
| dtantsur | 300 nodes was not my comment :) | 12:50 |
| dprince | dtantsur: even 10 | 12:50 |
| dprince | dtantsur: why would I spend the time to click a form 10 times to upload my nodes? | 12:50 |
| dtantsur | even with 10 nodes: if you don't generate UUID's on client side, you may get into problems with future updates | 12:50 |
| dprince | dtantsur: anyway, I'm glad we got to the root of this problem | 12:50 |
| dtantsur | dprince, for the same reason you would spend the time writing a json from them? | 12:50 |
| dprince | dtantsur: sounds like I need to go look at the UI mockups... | 12:51 |
| bandini | jistr: pradk and I have a puppet question. We need to add vhosts to put aodh and keystone under wsgi/httpd *and* we must avoid a systemctl restart httpd. to solve this we include the apache class and set 'has_restart' to /bin/true, which solves the restart issue but removes any other vhost that was defined previously. Are there any puppet tricks we could leverage to solve this? | 12:51 |
| dprince | dtantsur: json can be autogenerated and validated quite nicely | 12:51 |
| dprince | dtantsur: YAML, json, whatever | 12:51 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Refactors service url retrieval https://review.openstack.org/322121 | 12:51 |
| dtantsur | dprince, you do, but again, that's a bit different topic. not supporting UUID is bad for updateability | 12:51 |
| social__ | jistr: DIB_INSTALLTYPE_puppet_modules | 12:51 |
| dtantsur | dprince, then you don't need json, you need to call ironic API | 12:51 |
| dtantsur | but ok, I'm stopping on this topic. this is not something anyone (but me) wants to change. now, UUID | 12:52 |
| dprince | dtantsur: I'm fine to support UUIDs | 12:52 |
| dprince | dtantsur: as an end user feature | 12:52 |
| pradk | jistr, yea, we're curious why the vhosts files get overridden .. is it because we're re-initializing the apach class? | 12:52 |
| social__ | jistr: so I should work around DIB in instack-undercloud | 12:52 |
| dtantsur | dprince, anything particular you want to fix in this patch? | 12:52 |
| *** ccamacho|lunch is now known as ccamacho | 12:52 | |
| dtantsur | dprince, note that "parity with ironic API" is a good enough reason to have UUID btw | 12:52 |
| dprince | dtantsur: no, I've got the feedback I was after I think | 12:52 |
| dprince | dtantsur: I don't like the commit message, but meh | 12:53 |
| dprince | dtantsur: +A | 12:53 |
| dtantsur | dprince, thanks :) | 12:54 |
| jistr | bandini, pradk: ouch i see. There must be some collector-type thing somewhere that gets a list of all vhosts defined in puppet and writes them. And since we run an incomplete puppet manifest, it will write an incomplete set of vhosts. | 12:54 |
| *** links has quit IRC | 12:54 | |
| jistr | bandini, pradk: how are the vhosts managed? are they separate files, and they just get deleted on the aodh migration? | 12:54 |
| dtantsur | dprince, by the way: I'd like to eventually make register_all_nodes to support the same format as ironic. do you have any objections to that? | 12:54 |
| *** florianf has joined #tripleo | 12:55 | |
| pradk | jistr, yes they are separate files and only the aodh gets deployed | 12:55 |
| dtantsur | like supporting nested driver_info etc | 12:55 |
| pradk | jistr, similarly looks like only keystone one gets deployed after that upgrade and aodh and horizon are lost | 12:55 |
| jistr | pradk: and the ones that were there previously get erased? | 12:55 |
| pradk | jistr, yep | 12:55 |
| dprince | dtantsur: not at all. I very much like the idea. But I would like to have proper deprecation of the old formats, and in the meantime move ahead with making our workflows API driven | 12:55 |
| dprince | dtantsur: having the CLI and UI supoprt the same formats in this cycle is more important I think | 12:56 |
| pradk | jistr, bandini has a quick hack to redeploy horizon along with aodh and same with keystone | 12:56 |
| pradk | jistr, but we were curious if there is a cleaner way | 12:56 |
| dtantsur | dprince, yeah, it's not my highest priority anyway. I have enough fun with ironic-in-overcloud thing | 12:56 |
| dprince | dtantsur: havint the UI support a new file format, the the CLI the old one would seem to defeat some of our goals | 12:56 |
| pradk | jistr, when the whole puppet converge happens i assume these will show up again | 12:56 |
| jistr | pradk, bandini: yea, i don't know of any. This will heavily depend on the way the module is written. I'll do a quick search. | 12:57 |
| *** chem has quit IRC | 12:57 | |
| dprince | dtantsur: agree, lets track it as a feature or bug somewhere so we capture the idea though | 12:57 |
| dtantsur | dprince, and btw the final request before I stop annoying you: please rereview the ironic-in-overcloud spec | 12:57 |
| jistr | pradk: yea they would, but it's probably too late | 12:57 |
| dprince | dtantsur: cool | 12:57 |
| bandini | jistr: thanks you sir, I'd love to solve this without including each vhost thing I expect to exist in each upgrade snippet ;) | 12:57 |
| dtantsur | link: https://review.openstack.org/320995 | 12:57 |
| pradk | jistr, right.. if we want alarms/horizon to work while we wait on compute upgrades, they will remain broken | 12:58 |
| *** dmk0202 has quit IRC | 12:58 | |
| openstackgerrit | Merged openstack/tripleo-common: Support setting node UUID when registering nodes https://review.openstack.org/327760 | 12:58 |
| *** dmk0202 has joined #tripleo | 12:59 | |
| *** chem has joined #tripleo | 13:00 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Use quickstart.sh to collect logs https://review.openstack.org/328289 | 13:01 |
| ccamacho | folks, would you mind to check https://review.openstack.org/#/c/327773/ ? | 13:01 |
| social__ | jistr: meeting is now :) | 13:02 |
| social__ | marios: ^^ | 13:02 |
| jistr | social__: so it's not 16 CEST? | 13:02 |
| * jistr confused | 13:02 | |
| rhallisey | marios, jistr meeting? | 13:02 |
| rhallisey | it's now | 13:03 |
| jistr | huh ok | 13:03 |
| marios | rhallisey: err no it should be 1400 UTC | 13:03 |
| marios | social__: | 13:03 |
| jistr | yea that's what i thought | 13:03 |
| rhallisey | everyone is in the meeting :) | 13:03 |
| marios | rhallisey: then they're an hour early? | 13:04 |
| rhallisey | the calendar invite was for right now | 13:04 |
| EmilienM | do you know google calendar? :) | 13:04 |
| marios | rhallisey: for me it shows for an hour from now | 13:05 |
| marios | rhallisey: and i thought we agreed on 1400 UTC. ok joining then anyway dprince are you in? | 13:05 |
| *** rodrigods has quit IRC | 13:05 | |
| *** rodrigods has joined #tripleo | 13:05 | |
| dprince | marios: we did agree 1400, but it shows up on my calendar now :) | 13:05 |
| matbu | meeting now ? | 13:05 |
| dprince | marios: DTS failure dude | 13:05 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-tripleo: WIP: integration of the new puppet pacemaker. https://review.openstack.org/309069 | 13:06 |
| pabelanger | jistr: this could be an issue with zl01.o.o, and the DEVSTACK_GATE_TIMEOUT. Let me quickly take a look | 13:06 |
| EmilienM | do you guys have a secret meeting somewhere? | 13:07 |
| *** jaosorior has quit IRC | 13:07 | |
| ccamacho | EmilienM +1 | 13:08 |
| EmilienM | jistr, marios, dprince: what is this secret meeting everybody talks? | 13:09 |
| matbu | EmilienM: upgrade meeting | 13:09 |
| EmilienM | why not doing it on IRC / public channel? | 13:09 |
| *** cwolferh has quit IRC | 13:10 | |
| matbu | EmilienM: i'm fine w/ that :) | 13:10 |
| chem | matbu: social__ marios jistr rhallisey can I join in ? | 13:10 |
| rhallisey | chem, sure | 13:10 |
| rhallisey | do you need the bj link? | 13:10 |
| chem | yeap | 13:10 |
| rhallisey | chem, https://bluejeans.com/833158260/?src=calendarLink&g=ojugc3dmnfzwkqdsmvsgqylufzrw63i= | 13:10 |
| matbu | chem: yep | 13:10 |
| rhallisey | and for anyone else curious | 13:11 |
| *** derekh has joined #tripleo | 13:11 | |
| matbu | EmilienM: ^ | 13:12 |
| *** cwolferh has joined #tripleo | 13:12 | |
| ccamacho | Ill join :) | 13:12 |
| chem | rhallisey:thanks | 13:12 |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-quickstart: add ssh config to collect-logs https://review.openstack.org/328294 | 13:15 |
| *** lblanchard has joined #tripleo | 13:16 | |
| *** ayoung has joined #tripleo | 13:16 | |
| *** tzumainn has joined #tripleo | 13:20 | |
| pabelanger | jistr: okay, I think I see the issue, we are no longer seeting the BUILD_TIMEOUT variable in zuul-launcher, which is causing devstack_gate to default to 120mins, minus 10 for clean up, minus 90 by tripileo leaves 20mins | 13:20 |
| pabelanger | jistr: will work on a fix | 13:20 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Refactors service url retrieval https://review.openstack.org/322121 | 13:20 |
| *** jistr is now known as jistr|mtg | 13:20 | |
| *** pcaruana has quit IRC | 13:20 | |
| openstackgerrit | mathieu bultel proposed openstack/tripleo-heat-templates: WIP Fix mariadb upgrade and add sanity checks for pcs https://review.openstack.org/327959 | 13:21 |
| EmilienM | pabelanger: so it's not only 'nonha' jobs, it's jobs that run on zl nodes, right? | 13:22 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Gate ansible-role-tripleo-* roles https://review.openstack.org/326037 | 13:22 |
| pabelanger | EmilienM: right | 13:23 |
| pabelanger | EmilienM: looks that way | 13:23 |
| EmilienM | ok | 13:23 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Refactors service url retrieval https://review.openstack.org/322121 | 13:24 |
| *** dmk0202 has quit IRC | 13:29 | |
| openstackgerrit | Adriano Petrich proposed openstack/tripleo-quickstart: add ssh config to collect-logs https://review.openstack.org/328294 | 13:30 |
| *** dtrainor has joined #tripleo | 13:31 | |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Gate ansible-role-tripleo-* roles https://review.openstack.org/326037 | 13:34 |
| *** links has joined #tripleo | 13:36 | |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Move ironic config to post install https://review.openstack.org/328300 | 13:38 |
| slagle | derekh: can i get some quota on rh2? thought i might try some multinode jobs there manually | 13:38 |
| pabelanger | EmilienM: jistr|mtg : First pass at fixing the issue: https://review.openstack.org/#/c/328298/ | 13:38 |
| *** pcaruana has joined #tripleo | 13:39 | |
| derekh | slagle: I after deleting the entire thing to test the redploy scripts havn't missed anything. starting from scratch again | 13:39 |
| slagle | derekh: cool, alright | 13:39 |
| EmilienM | pabelanger: neat | 13:39 |
| openstackgerrit | Attila Darazs proposed openstack/tripleo-quickstart: Use quickstart.sh to collect logs https://review.openstack.org/328289 | 13:40 |
| slagle | pabelanger: hey, was wondering if there was anyway to test https://review.openstack.org/#/c/326095/ before it merges? | 13:40 |
| derekh | slagle: sorry | 13:40 |
| slagle | pabelanger: or do we need to get it to merge and wait for nodepool to get updated? | 13:40 |
| derekh | slagle: shardy dprince bnemec btw, I ran 12 simultanious job (non ha) on rh2 this morning 9 passed, so I'm happy everything should be good for the switch over | 13:41 |
| pabelanger | slagle: you could test that with a 3rd party CI setup. Run it on your own nodepool instances before pushing it upstream | 13:41 |
| *** egafford has joined #tripleo | 13:41 | |
| pabelanger | slagle: that's usually what is done in these cases | 13:41 |
| pabelanger | otherwise, you'll need to wait for opentack-infra to merge the patch | 13:42 |
| slagle | pabelanger: ok, yea, was thinking of doing that on the rh2 rack | 13:42 |
| pabelanger | if it was me, I would add centos-7-2-node and get devstack / devstack-gate working first. To fix up all the ubuntuizums first | 13:43 |
| slagle | we're not running devstack in this setup | 13:44 |
| openstackgerrit | Dmitry Tantsur proposed openstack/puppet-tripleo: Add ironic profiles https://review.openstack.org/319297 | 13:45 |
| dprince | derekh: nice, thanks for the update | 13:45 |
| *** akshai has joined #tripleo | 13:45 | |
| jtomasek | dprince, dtantsur: I'll try to explain how GUI registers nodes in a reply to the patch review | 13:46 |
| dtantsur | jtomasek, thanks, will be helpful for everyone. maybe even bring it to the ML? | 13:46 |
| slagle | pabelanger: where would the ubuntuizms potentially be? multinode_setup.sh looks pretty universal i think | 13:47 |
| jtomasek | dtantsur: ok, good point. Not sure if I manage to do it right now, but at latest by Monday | 13:47 |
| slagle | pabelanger: other than that, i think it's just devstack-vm-gate.sh, which we're already running on centos | 13:49 |
| pabelanger | okay | 13:49 |
| pabelanger | clarkb is the person to get signoff from, hes our multinode person. | 13:49 |
| slagle | k, will sync with him | 13:49 |
| *** Goneri has joined #tripleo | 13:56 | |
| *** apetrich has quit IRC | 13:56 | |
| *** ifarkas has quit IRC | 13:56 | |
| *** adarazs is now known as adarazs_afk | 13:56 | |
| *** ramishra has joined #tripleo | 13:58 | |
| *** apetrich has joined #tripleo | 13:58 | |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Move ironic config to post install https://review.openstack.org/328300 | 13:59 |
| *** links has quit IRC | 14:01 | |
| *** saneax is now known as saneax_AFK | 14:02 | |
| *** apetrich has quit IRC | 14:04 | |
| *** apetrich has joined #tripleo | 14:05 | |
| *** mgould is now known as mgould|afk | 14:05 | |
| *** MaxPC has joined #tripleo | 14:06 | |
| *** dtrainor has quit IRC | 14:09 | |
| *** jistr|mtg is now known as jistr | 14:09 | |
| *** cwolferh has quit IRC | 14:09 | |
| jistr | thanks pabelanger | 14:11 |
| *** zoli|lunch is now known as zoli|wfh | 14:11 | |
| rhallisey | shardy, dprince, matbu, marios, social__ , jistr , https://etherpad.openstack.org/p/tripleo-composable-upgrades-discussion | 14:11 |
| rhallisey | and anyone else interested ^ | 14:11 |
| *** cwolferh has joined #tripleo | 14:12 | |
| jistr | pradk, bandini: sorry, i'm back to the apache vhosts issue now | 14:12 |
| matbu | rhallisey: thanks | 14:12 |
| bandini | jistr: thanks a bunch! | 14:12 |
| *** yamahata has joined #tripleo | 14:14 | |
| *** noslzzp has joined #tripleo | 14:16 | |
| marios | rhallisey: ack thanks | 14:18 |
| shardy | rhallisey: thanks | 14:20 |
| *** MaxPC has quit IRC | 14:21 | |
| *** Guest76774 has quit IRC | 14:22 | |
| *** jprovazn has quit IRC | 14:23 | |
| openstackgerrit | Michele Baldessari proposed openstack/tripleo-heat-templates: [WIP] Initial work to dump and restore galera db during major upgrades https://review.openstack.org/325205 | 14:23 |
| *** myoung has joined #tripleo | 14:24 | |
| jistr | bandini, pradk: we could try setting apache::purge_vhost_dir to false apparently :) | 14:26 |
| jistr | https://github.com/puppetlabs/puppetlabs-apache/blob/6b1ce946dbfd1697aef29235d35d29b7868803f9/manifests/init.pp#L38 | 14:26 |
| pradk | jistr, nice | 14:26 |
| openstackgerrit | Stig Telfer proposed openstack/tripleo-heat-templates: Added support for pass-through iSER configuration https://review.openstack.org/324781 | 14:26 |
| pradk | jistr, much cleaner i guess.. will give it a try | 14:26 |
| *** karthiks has quit IRC | 14:30 | |
| bandini | pradk, jistr: awesome! | 14:30 |
| *** ifarkas has joined #tripleo | 14:32 | |
| openstackgerrit | Merged openstack/puppet-tripleo: Import ::nova class from THT https://review.openstack.org/325982 | 14:32 |
| pradk | jistr, hmm so purge_vhost_dir is by default undef | 14:32 |
| pradk | jistr, and if not it gets set to purge_vdir | 14:33 |
| pradk | jistr, which is by default false | 14:33 |
| shardy | pradk: Hi! I was wondering if you'd spotted https://bugs.launchpad.net/tripleo/+bug/1590730 | 14:33 |
| openstack | Launchpad bug 1590730 in tripleo "httpd fails to start, aodh errors" [Undecided,Triaged] | 14:33 |
| pradk | so essentially if i set it to false ot not the purge_vhostd ends up being false either way? | 14:33 |
| shardy | I hit that yesterday and I'm not sure on the fix | 14:33 |
| shardy | any suggestions would be much appreciated :) | 14:33 |
| *** ebalduf has quit IRC | 14:34 | |
| jistr | pradk: maybe, but i think it's worth trying still :) i'm not sure what else would delete those files. Puppet doesn't just delete the things that it doesn't manage, it has to be implemented somewhere. | 14:34 |
| *** sshnaidm has quit IRC | 14:35 | |
| pradk | shardy, i think we ran into that during upgrades and the solution was to initialize apache class and not let it manage .. apparently pacemaker gets in the way? i thought this was only upgrade issue http://paste.openstack.org/show/510548/ | 14:36 |
| shardy | pradk: this is on a nonha deployment, so no pacemaker | 14:36 |
| d0ugal | dprince: I am hitting a TypeError in the JSON code when calling a workflow | 14:36 |
| d0ugal | dprince: sounds similar to what you had earlier | 14:36 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Register nodes new workflow https://review.openstack.org/323665 | 14:37 |
| dprince | d0ugal: yeah, the workflows all still work | 14:37 |
| dprince | d0ugal: but the zaqar message coming back changed format or something? | 14:37 |
| *** ebalduf has joined #tripleo | 14:38 | |
| dprince | d0ugal: I thought perhaps Mistral and/or Zaqar had a regression. It was working for be before we changed the 'register' workflow name, but then I rebuilt my undercloud and it fails for me now | 14:38 |
| d0ugal | There have been a few small tweaks in the code, so hopefully it wasn't us :) | 14:38 |
| jistr | bandini, pradk: also we should probably set purge_configs = false, which is true by default | 14:39 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Register nodes new workflow https://review.openstack.org/323665 | 14:40 |
| *** dtrainor has joined #tripleo | 14:40 | |
| *** karthiks has joined #tripleo | 14:43 | |
| openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Add mongodb profiles https://review.openstack.org/304780 | 14:43 |
| shardy | derekh: Hey, I was wondering, can you think of any reason why some nonha jobs would be given a smaller timeout than others? | 14:44 |
| shardy | http://logs.openstack.org/27/321027/13/check-tripleo/gate-tripleo-ci-centos-7-nonha/3f0210c/console.html#_2016-06-10_12_21_56_719518 | 14:45 |
| shardy | echo 'Job timeout set to: 97 minutes' | 14:45 |
| shardy | which is too short, so it fails | 14:45 |
| shardy | some other jobs are getting the normal timeout, and work fine | 14:45 |
| jtomasek | dmatthews: did you try to re-register the already registered nodes from CLI using new baremetal workflow? | 14:45 |
| shardy | I don't see the pattern atm as to which jobs get the wrong value | 14:45 |
| EmilienM | shardy: I commented in the LP you reported, not sure it's related | 14:45 |
| *** adarazs_afk is now known as adarazs | 14:45 | |
| EmilienM | https://bugs.launchpad.net/tripleo/+bug/1591102 | 14:46 |
| openstack | Launchpad bug 1591102 in tripleo "TripleO job sometimes failing due to wrong timeout of 20 mins" [Critical,Triaged] - Assigned to Paul Belanger (pabelanger) | 14:46 |
| jtomasek | dmatthews: the message I receive when doing so gives me status: FAILED and error message is: [{},{}] | 14:46 |
| shardy | EmilienM: ah, thanks, looking | 14:46 |
| openstackgerrit | Merged openstack/tripleo-common: Fix interactive update race condition https://review.openstack.org/328260 | 14:46 |
| jtomasek | d0ugal: ^^^^ | 14:46 |
| jtomasek | d0ugal: but the nodes actually get updated | 14:46 |
| openstackgerrit | Florian Fuchs proposed openstack/tripleo-ui: Adds a tarball upload option to plan creation https://review.openstack.org/314582 | 14:46 |
| shardy | EmilienM: ah, thanks | 14:46 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: composable neutron server https://review.openstack.org/315129 | 14:46 |
| derekh | shardy: no idea, looking | 14:46 |
| d0ugal | jtomasek: oh, weird. Sounds like a workflow issue? | 14:46 |
| d0ugal | jtomasek: I'll try again in a bit, in the middle of testing introspection | 14:47 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: composable neutron ml2 and ovs agent https://review.openstack.org/308514 | 14:47 |
| openstackgerrit | Merged openstack/tripleo-heat-templates: Remove unused Neutron parameters from roles https://review.openstack.org/325625 | 14:47 |
| *** Goneri has quit IRC | 14:47 | |
| shardy | https://review.openstack.org/#/c/328298/1/zuul/launcher/ansiblelaunchserver.py just landed, lets see if that fixes it | 14:47 |
| jtomasek | d0ugal: ok, I'll do more investigation and report on the review. this is the only thing that bugs me about the workflow we have now. | 14:47 |
| marios | bandini: le CIB https://gist.github.com/anonymous/6106df256b2c94aa52e67e165214b8ae | 14:48 |
| bandini | marios: tres bien! merci ;) | 14:48 |
| marios | bandini: heh thanks man, just cos you asked. I added a note/context on the review to justify the timeout bump. if you get a chance to review wrt the 1800 we have there wuold be great but no rush it aint landing today :) | 14:51 |
| derekh | shardy: looks like pabelanger is on top of it | 14:52 |
| *** saneax_AFK is now known as saneax | 14:52 | |
| shardy | derekh: yup, thanks, sorry for the interruption | 14:52 |
| derekh | shardy: no prob | 14:52 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Composable roles within services - MongoDB https://review.openstack.org/315051 | 14:53 |
| pradk | jistr, something like this should do it? http://paste.openstack.org/show/510561/ | 14:54 |
| openstackgerrit | Jiri Tomasek proposed openstack/tripleo-ui: Register nodes new workflow https://review.openstack.org/323665 | 14:54 |
| jistr | pradk: yea that's what i'd hope for :) | 14:57 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: Implement Nova API profile https://review.openstack.org/325937 | 14:58 |
| pradk | jistr, if this works we owe you a beer.. this is so much cleaner :) | 14:58 |
| *** sshnaidm has joined #tripleo | 14:59 | |
| *** rbrady_ has joined #tripleo | 15:00 | |
| *** rbrady has quit IRC | 15:00 | |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Aodh upgrade heat template and manifests to replace ceilometer alarms https://review.openstack.org/320150 | 15:01 |
| *** rbrady_ has quit IRC | 15:01 | |
| *** rbrady_ has joined #tripleo | 15:02 | |
| *** karthiks has quit IRC | 15:03 | |
| rook | dprince: looks like CI is happy now | 15:03 |
| *** MaxPC has joined #tripleo | 15:03 | |
| panda | I have a simple deploy (controller + compute) that hangs, but I don't understand where. both overcloud nodes loop over os-collect-config not finding local data, last thing in console log is 2016-06-10 14:42:52 [ControllerConfig]: CREATE_COMPLETE state changed. How do I understand where's the problem |? | 15:04 |
| dprince | rook: so we need to reverse the ordering of the Depends-On | 15:04 |
| dprince | rook: I will fix it | 15:04 |
| openstackgerrit | wes hayutin proposed openstack/tripleo-quickstart: Add ceph to the minimal deployment https://review.openstack.org/327717 | 15:04 |
| openstackgerrit | ayoung proposed openstack/tripleo-quickstart: Allow for multiple undercloud nodes https://review.openstack.org/315749 | 15:05 |
| openstackgerrit | ayoung proposed openstack/tripleo-quickstart: Provision Identity VM https://review.openstack.org/328335 | 15:05 |
| *** rbrady_ has quit IRC | 15:06 | |
| *** tesseract has quit IRC | 15:09 | |
| matbu | panda: the os-collect-config logs is just a warning afaik, not an issue | 15:10 |
| *** ebarrera has quit IRC | 15:11 | |
| *** colonwq has quit IRC | 15:12 | |
| *** pcaruana has quit IRC | 15:13 | |
| pradk | shardy, so looking at the info in the bug.. the evaluator error is due to missing redis .. thats not related to apache not starting | 15:13 |
| pradk | shardy, python-redis should be installed and running at this point for evaluator to connect | 15:13 |
| shardy | pradk: Hmm, ok thanks - but is there any reason it would work on deploy, then not work on an update? | 15:14 |
| pradk | shardy, the apache error is not clear are it doesnt say anything related to aodh | 15:14 |
| shardy | I didn't upgrade between versions, I just did repeated openstack overcloud deploy commands, which re-ran puppet (with the same config) a few times | 15:14 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Move Neutron core and service plugin to base https://review.openstack.org/327306 | 15:14 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Composable Neutron Plumgrid plugin https://review.openstack.org/327307 | 15:14 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Drop extraconfig for neutron-nuage.yaml https://review.openstack.org/327742 | 15:14 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Drop extraconfig for neutron-plumgrid.yaml https://review.openstack.org/327318 | 15:14 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Composable neutron nuage plugin https://review.openstack.org/327741 | 15:14 |
| pradk | shardy, i wouldnt think so..but i havent tried multiple re-runs on same.. i can try this afternoon and let you know if anything stands out wrt aodh | 15:15 |
| shardy | pradk: Yeah, I wasn't certain if aodh was the root cause tbh, does it run under apache? | 15:15 |
| pradk | shardy, the evaluator should not block httpd as its not an apache service | 15:15 |
| panda | matbu: so I have nothing at all. Thanks. | 15:15 |
| shardy | pradk: Ok, perhaps it's two unrelated issues then, thanks for the info | 15:15 |
| pradk | shardy, cool, i'll do a test this afternoon anyway | 15:16 |
| shardy | pradk: ack, thanks! | 15:16 |
| matbu | panda: lol yep sorry, i got some kind of similar issue | 15:16 |
| shardy | pradk: for quicker testing, I was actually doing this http://hardysteven.blogspot.co.uk/2016/06/tripleo-partial-stack-updates.html | 15:17 |
| matbu | panda: but it was due to pacemaker, i don't think you have it enable on your deployment | 15:17 |
| pradk | shardy, cool | 15:17 |
| shardy | I made puppet re-run on only the controllers several times, and after a few attempts it broke - I'll try to reproduce and see if I can decouple the aodh erros and httpd not starting | 15:17 |
| pradk | ok | 15:18 |
| *** karthiks has joined #tripleo | 15:19 | |
| *** rcernin has quit IRC | 15:19 | |
| *** rbrady has joined #tripleo | 15:21 | |
| panda | matbu: indeed I don't | 15:21 |
| *** ramishra has quit IRC | 15:21 | |
| *** tremble has quit IRC | 15:23 | |
| *** ramishra has joined #tripleo | 15:23 | |
| matbu | panda: but take a look of the services, heat is probably waiting until the default timeout for a service to start or something like this | 15:24 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Create overcloud images for liberty using EXT4 https://review.openstack.org/327773 | 15:26 |
| *** Goneri has joined #tripleo | 15:29 | |
| panda | matbu: heat-engine.log is looping over something like overcloud-Compute-q337bxv3wefe and overcloud-Controller-x7hex7tyjpbn. I guess it's polling task status. | 15:29 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: profile/base/nova: declare nova class properly https://review.openstack.org/328347 | 15:29 |
| *** xinwu has joined #tripleo | 15:29 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: Remove usage of ::nova class in THT https://review.openstack.org/325983 | 15:32 |
| matbu | panda: yep heat log won't help i think | 15:34 |
| *** jkraj has joined #tripleo | 15:35 | |
| shardy | dprince: Hey, could you check out https://review.openstack.org/#/c/305039/ when you get a moment please? | 15:37 |
| *** chem has quit IRC | 15:38 | |
| *** mcornea has quit IRC | 15:38 | |
| dtantsur | folks, seems like there is something wrong with mistral on master | 15:40 |
| dtantsur | its puppet manifests start using its tables before they get created | 15:40 |
| dtantsur | 2016-06-10 15:34:30 - Notice: /Stage[main]/Mistral::Db::Sync/Exec[mistral-db-populate]/returns: sqlalchemy.exc.ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Tabl | 15:41 |
| dtantsur | e 'mistral.action_definitions_v2' doesn't exist") [SQL: u'DELETE FROM action_definitions_v2 WHERE (action_definitions_v2.project_id = %s OR action_definitions_v2.scope = %s | 15:41 |
| dtantsur | OR action_definitions_v2.id != action_definitions_v2.id) AND action_definitions_v2.is_system = true'] [parameters: ('<default-project>', 'public')] | 15:41 |
| EmilienM | dtantsur: sounds like a bug in mistral no? please show logs | 15:42 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Nothing to see here https://review.openstack.org/111011 | 15:42 |
| dtantsur | EmilienM, do you know if openstack undercloud install logs get duplicated anywhere? | 15:43 |
| openstackgerrit | Merged openstack/os-net-config: Add support for OVS tunnels https://review.openstack.org/304215 | 15:43 |
| *** panda is now known as panda|afk | 15:43 | |
| *** MaxPC has quit IRC | 15:43 | |
| dtantsur | anyway, rerunning now | 15:44 |
| *** apetrich has quit IRC | 15:44 | |
| *** osp has quit IRC | 15:45 | |
| *** panda|afk has quit IRC | 15:46 | |
| *** panda|afk has joined #tripleo | 15:46 | |
| *** ramishra has quit IRC | 15:46 | |
| *** ramishra has joined #tripleo | 15:48 | |
| *** apetrich has joined #tripleo | 15:48 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/tripleo-common: Updated from global requirements https://review.openstack.org/323090 | 15:51 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Build and upload instack.raw image https://review.openstack.org/315072 | 15:51 |
| *** mgarciam has joined #tripleo | 15:52 | |
| dtantsur | EmilienM, https://bugs.launchpad.net/tripleo/+bug/1591262 | 15:53 |
| openstack | Launchpad bug 1591262 in tripleo "During undercloud installation mistral puppet manifests do not recreate its database" [Undecided,New] | 15:53 |
| EmilienM | dtantsur: it sounds like a regression in mistral | 15:54 |
| EmilienM | I never saw it befe | 15:54 |
| EmilienM | before* | 15:54 |
| openstackgerrit | Sven Anderson proposed openstack/tripleo-heat-templates: Enable nova-compute as a composable service https://review.openstack.org/328361 | 15:54 |
| dtantsur | EmilienM, it's not blocking me (any more), so lets just leave it there in case someone is looking for a bug to fix | 15:55 |
| * dtantsur will only delete nova's database the next time | 15:55 | |
| *** MaxPC has joined #tripleo | 15:56 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Look for a passing periodic upgrades job before moving pin https://review.openstack.org/315075 | 15:57 |
| dtantsur | EmilienM, you work on composable nova, don't you? do you plan on nova-compute? | 15:58 |
| EmilienM | dtantsur: hey, indeed I did most of the patches until now, but still struggling to make it pass CI for base roles, on controller. Once I get it, I'll continue with compute role | 15:59 |
| EmilienM | sven (not here?) already started a patch in puppet-tripleo though | 16:00 |
| dtantsur | EmilienM, cool. as you're maybe aware, with ironic in play things become tricky. we'll place our compute on *controller* :) | 16:01 |
| dtantsur | if you've seen the spec you probably know why | 16:01 |
| shardy | EmilienM, dtantsur: https://review.openstack.org/#/c/328361/ | 16:01 |
| shardy | is the t-h-t patch, it was posted a few minutes ago | 16:02 |
| shardy | ^^ | 16:02 |
| dtantsur | fantastic, thanks shardy | 16:02 |
| dtantsur | I think for me the most important will be the puppet part, cause tht part will probably be pretty different for our compute variant | 16:02 |
| EmilienM | dtantsur: yes and it makes sense | 16:03 |
| *** apetrich has quit IRC | 16:04 | |
| dtantsur | meh folks, we should seriously think about increasing our default undercloud disk size | 16:04 |
| *** florianf has quit IRC | 16:04 | |
| dtantsur | what we have now is nothing | 16:04 |
| dtantsur | also, why the heck swift occupies 8 GiB and mongodb 3.5 GiB on a reinstalled undercloud??? | 16:05 |
| * dtantsur tries not to ask how on earth we ended up with mongodb at all | 16:06 | |
| dtantsur | openstack is now webscale, right/ | 16:06 |
| dtantsur | ? | 16:06 |
| *** apetrich has joined #tripleo | 16:06 | |
| shardy | dtantsur: we disabled ceilometer, so probably that shouldn't be running (mongo) | 16:06 |
| * dtantsur kills it with fire | 16:07 | |
| shardy | https://github.com/openstack/instack-undercloud/commit/f6ce77547831a015bb7f6404c040957028022edd | 16:07 |
| dtantsur | shardy, what about swift? what do we store there? | 16:07 |
| shardy | dtantsur: looks like I missed it there | 16:07 |
| shardy | dtantsur: we use it to store templates for UI->Mistral->Heat deployment workflows, and optionally to store deploy "artefacts" such as updated puppet modules, which are then made available to nodes via a swift tempurl | 16:08 |
| dtantsur | shardy, should it really take 8 GiB on a dev machine? | 16:09 |
| shardy | it could possibly be made optional, but by default we probably need it | 16:09 |
| dtantsur | yeah, I'm fine with swift present, we also use it in inspector, I'm just wondering about size | 16:09 |
| shardy | dtantsur: we also store introspection data in it don't we? | 16:10 |
| dtantsur | shardy, correct. but that's probably several kilobytes per run | 16:10 |
| shardy | dtantsur: ack, where is the space being used? | 16:10 |
| *** weshay is now known as weshay_br | 16:10 | |
| *** weshay_br is now known as weshay_brb | 16:10 | |
| *** ifarkas has quit IRC | 16:10 | |
| dtantsur | 8.4G /srv | 16:11 |
| dtantsur | this is on my test machine after maybe a dozen of deploy attempts | 16:11 |
| dtantsur | (maybe 2 dozens) | 16:11 |
| shardy | dtantsur: only 2.6G on mine | 16:11 |
| dtantsur | interesting. how many times did you deploy anything on it? | 16:11 |
| dtantsur | maybe the key is that every time I used slightly different templates? | 16:12 |
| shardy | dtantsur: quite a few, I've been running this undercloud for several weeks | 16:12 |
| shardy | dtantsur: atm we don't store the templates in swift unless you use mistral | 16:12 |
| shardy | (which, by default we currently don't) | 16:12 |
| dtantsur | interesting... | 16:12 |
| shardy | can you derive the container uuid from the du output of srv then look at the contents for those large objects? | 16:13 |
| dtantsur | 2 containers: | 16:13 |
| dtantsur | ]$ swift list | 16:13 |
| dtantsur | ov-6gxqdrmhxf-0-gynu57fxk4yr-NovaCompute-ngtcbyy65ocm | 16:13 |
| dtantsur | ov-dbcp7auzfeu-0-wzgfvajieuyy-Controller-ux7d3eriyz4j | 16:13 |
| dtantsur | shardy, each container has one small JSON Oo | 16:15 |
| dtantsur | wtf swift? | 16:15 |
| dtantsur | shardy, lemme guess: does glance store images in swift? | 16:17 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Add flag to save hosts file https://review.openstack.org/327286 | 16:17 |
| *** MaxPC has quit IRC | 16:17 | |
| shardy | dtantsur: yep | 16:17 |
| dtantsur | shardy, aha. and never cleans up replaced overcloud-full images >_< | 16:18 |
| shardy | https://github.com/openstack/instack-undercloud/commit/70024dc06e1b9f84cefe0478c4e00fadf58cda97 | 16:18 |
| dtantsur | well, at least it explains something | 16:18 |
| dtantsur | shardy, is there maybe some rotation or something? | 16:18 |
| *** jkraj has quit IRC | 16:18 | |
| d0ugal | dprince: gah, I figured it out. | 16:19 |
| dtantsur | seems like I have 7 copies stored now | 16:19 |
| d0ugal | dprince: it seems it was my fault, sorry! | 16:19 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Add flag to save hosts file https://review.openstack.org/327286 | 16:19 |
| openstackgerrit | Carlos Camacho proposed openstack/puppet-tripleo: Add mongodb profiles https://review.openstack.org/304780 | 16:19 |
| *** xinwu has quit IRC | 16:19 | |
| ansiwen | shardy: thanks for the review. I did this basically in a blind flight, by replicating what emilien was doing for the controller. | 16:20 |
| shardy | ansiwen: np, sure, something we can iterate on :) | 16:20 |
| EmilienM | ansiwen: cool no worries, it's good to have early review | 16:20 |
| openstackgerrit | Harry Rybacki proposed openstack/tripleo-quickstart: Add flag to save hosts file https://review.openstack.org/327286 | 16:20 |
| shardy | dtantsur: not sure how glance handles that tbh | 16:20 |
| *** yamahata has quit IRC | 16:20 | |
| EmilienM | ansiwen: I hope to get my stuff done for nova base this week end | 16:20 |
| ansiwen | shardy: and he also references a nova-base.yaml for example here https://review.openstack.org/#/c/326020/ | 16:20 |
| EmilienM | ansiwen: once my stuff is landed (nova base), we can iterate with your work | 16:21 |
| ansiwen | EmilienM: thanks, that would be great | 16:21 |
| shardy | ansiwen: yeah, but there's not two implementations for compute unlike some other services | 16:21 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Add websocket utils module https://review.openstack.org/322611 | 16:21 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Use Mistral for baremetal registration https://review.openstack.org/322612 | 16:21 |
| openstackgerrit | Carlos Camacho proposed openstack/tripleo-heat-templates: Composable roles within services - MongoDB https://review.openstack.org/315051 | 16:21 |
| EmilienM | ansiwen: I'm full time on it :) | 16:21 |
| *** weshay_brb is now known as weshay | 16:21 | |
| ansiwen | shardy: but doesn't it mean the file is there anyways? | 16:21 |
| shardy | ansiwen: No, because it's not in your patch | 16:22 |
| ansiwen | shardy: I still have no clue how alle the files are related to each other | 16:22 |
| ansiwen | shardy: it's also not in emiliens patch, is it? | 16:22 |
| shardy | https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/swift-proxy.yaml | 16:22 |
| shardy | you can just do it like that | 16:22 |
| *** panda|afk has quit IRC | 16:22 | |
| d0ugal | dprince: that update I just pushed should fix it ^^ | 16:22 |
| openstackgerrit | ayoung proposed openstack/tripleo-quickstart: Provision Identity VM https://review.openstack.org/328335 | 16:23 |
| openstackgerrit | ayoung proposed openstack/tripleo-quickstart: Allow for multiple undercloud nodes https://review.openstack.org/315749 | 16:23 |
| openstackgerrit | ayoung proposed openstack/tripleo-quickstart: Setup IPA server https://review.openstack.org/328373 | 16:23 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: WIP Use Mistral for baremetal introspection https://review.openstack.org/327780 | 16:23 |
| EmilienM | shardy: I disagree a bit | 16:23 |
| shardy | ansiwen: sorry, yeah you're right, nova-base merged and provides the rabbit credentials | 16:23 |
| EmilienM | shardy: we don't need to include the base profile in the service | 16:23 |
| shardy | sorry, I need a cofee | 16:23 |
| ayoung | shardy, big props on that partial stack blog post. | 16:23 |
| EmilienM | but rather, include the base profiles in puppet-tripleo | 16:23 |
| EmilienM | shardy: it avoids including puppet classes in services, but do it in puppet-tripleo, our composition layer | 16:24 |
| EmilienM | shardy: I'm doing like this in nova | 16:24 |
| shardy | EmilienM: but https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/services/nova-base.yaml sets the hieradata with the rabbit credentials | 16:24 |
| shardy | which will be needed by both compute and nova-* services? | 16:24 |
| *** athomas has quit IRC | 16:24 | |
| EmilienM | shardy: https://github.com/openstack/puppet-tripleo/blob/master/manifests/profile/base/nova/conductor.pp#L30 | 16:24 |
| shardy | ayoung: glad it was useful | 16:24 |
| *** racedo has quit IRC | 16:25 | |
| shardy | ayoung: I'm going to try to start writing stuff more regularly, let me know if there's specific topics you'd like to see covered | 16:25 |
| *** zoli|wfh is now known as zoli|gone | 16:25 | |
| ayoung | shardy, well, if you wanted to show how to update all of the policy files on an overcloud, I'd be quite greatful | 16:25 |
| ayoung | grateful even | 16:26 |
| shardy | EmilienM: but if you do that, the rabbit credentials still won't be in the hieradata on the compute? | 16:26 |
| shardy | ayoung: sure, I can do that next week | 16:26 |
| ayoung | shardy, wonderful...long time goal to document that... | 16:26 |
| shardy | there are a couple of ways to do it that I mentioned on the ml, I'll try to cover them both | 16:27 |
| ansiwen | shardy, EmilienM: for my understanding it would be very useful to have a kind of walkthrough which file references to which other files. I'm a bit overwhelmed at how all the files are connected. can you recommend a doc or something? | 16:27 |
| zoli|gone | have a good weekend | 16:27 |
| EmilienM | shardy: in puppet-tripleo/profiles/base/nova/compute -> you need to include profiles/base/nova | 16:27 |
| shardy | ansiwen: ccamacho has a docs patch posted which provides a good overview | 16:27 |
| ansiwen | shardy, EmilienM, for example, where is the entry point for this hole framework? | 16:27 |
| EmilienM | ansiwen: it's mostly puppet / hiera things | 16:27 |
| EmilienM | shardy: my point is "do the include in profiles rather than in services" | 16:28 |
| ansiwen | shardy: yes, I know these, but I thought they are more specific for composability | 16:28 |
| ansiwen | so, maybe a plain puppet tutorial might be helpful :-) | 16:28 |
| *** zoli|gone is now known as zoli_gone-proxy | 16:28 | |
| *** racedo has joined #tripleo | 16:29 | |
| EmilienM | shardy: I think result is the same really | 16:29 |
| EmilienM | we can either use THT or puppet-tripleo to include common class | 16:30 |
| ccamacho | ansiwen this is a very simple example how things are connected https://review.openstack.org/#/c/311512/ the patch is compiled here for a better review http://tripleo-docs.readthedocs.io/en/latest/tht_walkthrough/tht_walkthrough.html | 16:30 |
| EmilienM | shardy: I just think moving a maximum of puppet code to puppet-tripleo makes more sense | 16:30 |
| ansiwen | ccamacho: great, thanks, the compiled version is especially useful | 16:31 |
| ccamacho | ansiwen, with some other references at the end. | 16:31 |
| * EmilienM afk for lunch | 16:31 | |
| *** racedo has quit IRC | 16:32 | |
| ccamacho | ansiwen after reading, you might post comments on the patchset review :) if you think you need more details I can add them to the review content. | 16:32 |
| *** ayoung has quit IRC | 16:33 | |
| ccamacho | enjoy the weekend folks!! | 16:34 |
| *** ccamacho is now known as ccamacho|away | 16:34 | |
| *** yamahata has joined #tripleo | 16:38 | |
| *** dtrainor has quit IRC | 16:39 | |
| openstackgerrit | Merged openstack/tripleo-quickstart: Add flag to save hosts file https://review.openstack.org/327286 | 16:40 |
| *** chem has joined #tripleo | 16:42 | |
| dprince | d0ugal: which patch needed fixing? | 16:45 |
| *** qasims has joined #tripleo | 16:45 | |
| dprince | d0ugal: Oh, I see. recv() is now returning json. Got it :) | 16:45 |
| d0ugal | dprince: Yeah, that happened due to suggestions on the other patch, I failed to remember I needed to update that one :( | 16:46 |
| pradk | jistr, the purge_configs thing worked looks like .. thx for the tip | 16:46 |
| pradk | jistr++ | 16:46 |
| dprince | d0ugal: its cool, appreciate the fix... I'll try it now | 16:46 |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/puppet-tripleo: WIP: integration of the new puppet pacemaker. https://review.openstack.org/309069 | 16:48 |
| openstackgerrit | Pradeep Kilambi proposed openstack/tripleo-heat-templates: Keystone liberty mitaka upgrade step https://review.openstack.org/302235 | 16:50 |
| *** colonwq has joined #tripleo | 16:52 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack/tripleo-heat-templates: WIP: integration of the new puppet pacemaker. https://review.openstack.org/302409 | 16:52 |
| *** dtantsur is now known as dtantsur|afk | 16:52 | |
| openstackgerrit | Ryan Brady proposed openstack/tripleo-common: Add Plan Deletion https://review.openstack.org/299937 | 16:57 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Add websocket utils module https://review.openstack.org/322611 | 16:59 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: Use Mistral for baremetal registration https://review.openstack.org/322612 | 16:59 |
| openstackgerrit | Dougal Matthews proposed openstack/python-tripleoclient: WIP Use Mistral for baremetal introspection https://review.openstack.org/327780 | 16:59 |
| openstackgerrit | Dan Sneddon proposed openstack/tripleo-heat-templates: Updates and fixes to NIC config template routes https://review.openstack.org/318389 | 17:02 |
| *** qasims has quit IRC | 17:06 | |
| *** ebalduf_ has joined #tripleo | 17:06 | |
| derekh | slagle: rh2 is back up, want creds if you want to try anything out? its temporary though as I'll be redeploying it again mid next week one last time | 17:08 |
| slagle | derekh: sure, go ahead and send me some. i may or may not get to it before you redeploy | 17:09 |
| slagle | you can have the right to blow it away at any time :) | 17:09 |
| *** milan has quit IRC | 17:09 | |
| *** xinwu has joined #tripleo | 17:11 | |
| derekh | slagle: sent, last redeploy will likely be on tuesday/wednesday | 17:11 |
| slagle | k, thx | 17:11 |
| *** derekh has quit IRC | 17:14 | |
| *** ayoung has joined #tripleo | 17:14 | |
| *** ohamada has quit IRC | 17:16 | |
| *** MaxPC has joined #tripleo | 17:19 | |
| *** MaxPC has quit IRC | 17:20 | |
| *** cwolferh has quit IRC | 17:21 | |
| *** ebalduf_ has quit IRC | 17:22 | |
| *** panda has joined #tripleo | 17:28 | |
| openstackgerrit | Martin Mágr proposed openstack/puppet-tripleo: New composable service: Sensu https://review.openstack.org/323303 | 17:30 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates: Availability monitoring support https://review.openstack.org/254788 | 17:33 |
| *** jpena is now known as jpena|off | 17:34 | |
| *** dprince has quit IRC | 17:34 | |
| *** dprince has joined #tripleo | 17:35 | |
| *** cwolferh has joined #tripleo | 17:37 | |
| *** dtrainor has joined #tripleo | 17:40 | |
| *** xinwu has quit IRC | 17:42 | |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates: Availability monitoring support https://review.openstack.org/254788 | 17:43 |
| *** noslzzp has quit IRC | 17:44 | |
| *** xinwu has joined #tripleo | 17:45 | |
| *** xinwu has quit IRC | 17:45 | |
| *** pkovar has quit IRC | 17:47 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci: DONT MERGE TESTING https://review.openstack.org/316436 | 17:48 |
| *** pino|work has quit IRC | 17:53 | |
| *** dtrainor has quit IRC | 17:54 | |
| openstackgerrit | Merged openstack/tripleo-common: Add Heat Capabilities Actions https://review.openstack.org/284460 | 17:55 |
| *** mbound has quit IRC | 17:55 | |
| *** shardy has quit IRC | 17:56 | |
| *** MaxPC has joined #tripleo | 17:58 | |
| *** apetrich has quit IRC | 17:58 | |
| *** apetrich has joined #tripleo | 17:59 | |
| *** zaneb has joined #tripleo | 18:08 | |
| *** lblanchard has quit IRC | 18:10 | |
| *** dtrainor has joined #tripleo | 18:13 | |
| *** apetrich has quit IRC | 18:13 | |
| *** apetrich has joined #tripleo | 18:15 | |
| openstackgerrit | Dan Prince proposed openstack/puppet-tripleo: Pacemaker: only create DB on pacemaker master https://review.openstack.org/328446 | 18:16 |
| dprince | EmilienM: ^^^ | 18:16 |
| EmilienM | dprince: ack | 18:16 |
| dprince | anybody else that could review that too... it is a bug I introduced today | 18:16 |
| dprince | EmilienM helped catch it and we might see intermittent failures due to the race it causes | 18:17 |
| EmilienM | dprince: if CI patch, we'll land it right away | 18:17 |
| dprince | EmilienM: ++ | 18:17 |
| openstackgerrit | Martin Mágr proposed openstack/tripleo-heat-templates: Availability monitoring support https://review.openstack.org/254788 | 18:18 |
| openstackgerrit | Emilien Macchi proposed openstack/puppet-tripleo: profile/base/nova: declare nova class properly https://review.openstack.org/328347 | 18:19 |
| *** lblanchard has joined #tripleo | 18:20 | |
| EmilienM | dprince: rebasing on top of your patch & rechecking my THT patch so I can move forward with ::nova thing | 18:20 |
| *** paramite has quit IRC | 18:25 | |
| *** lblanchard has quit IRC | 18:28 | |
| *** fzdarsky has quit IRC | 18:31 | |
| *** dtrainor has quit IRC | 18:32 | |
| openstackgerrit | Brad P. Crochet proposed openstack/tripleo-heat-templates: Replace use of deprecated neutron puppet param (network_device_mtu) https://review.openstack.org/328256 | 18:37 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Add baremetal workflows https://review.openstack.org/300200 | 18:40 |
| *** akrivoka has quit IRC | 18:44 | |
| *** akrivoka has joined #tripleo | 18:45 | |
| *** fzdarsky has joined #tripleo | 18:45 | |
| *** ibravo has joined #tripleo | 18:46 | |
| *** julim has quit IRC | 18:46 | |
| *** jcoufal has quit IRC | 18:46 | |
| *** jcoufal has joined #tripleo | 18:48 | |
| *** akrivoka has quit IRC | 18:49 | |
| *** ibravo has quit IRC | 18:53 | |
| *** ibravo has joined #tripleo | 18:54 | |
| EmilienM | slagle: could you review & eventually +2 https://review.openstack.org/#/c/328446/ please? So when it pass CI I'll +A | 18:56 |
| *** mbound has joined #tripleo | 18:56 | |
| *** fragatina has quit IRC | 18:59 | |
| *** fragatina has joined #tripleo | 18:59 | |
| *** mbound has quit IRC | 19:01 | |
| *** fragatina has quit IRC | 19:04 | |
| *** athomas has joined #tripleo | 19:06 | |
| *** ibravo has left #tripleo | 19:13 | |
| *** sambetts is now known as sambetts|afk | 19:13 | |
| dprince | EmilienM: would you be up for reviewing this? https://review.openstack.org/#/c/299643/ | 19:16 |
| dprince | EmilienM: this is what I use for fast local puppet-tripleo change testing | 19:16 |
| EmilienM | dprince: looking | 19:16 |
| dprince | EmilienM: would be nice to get that in finally so we can document it too | 19:16 |
| EmilienM | dprince: +A | 19:17 |
| openstackgerrit | Dougal Matthews proposed openstack/tripleo-common: Remove the unused service_host arg from node registration https://review.openstack.org/326036 | 19:18 |
| *** MaxPC has quit IRC | 19:19 | |
| EmilienM | dprince: I noticed latest mistral is broken | 19:19 |
| EmilienM | http://logs.openstack.org/14/328414/1/check/gate-puppet-mistral-puppet-beaker-rspec-centos-7/4ed1143/console.html#_2016-06-10_17_58_31_141533 | 19:19 |
| EmilienM | dtantsur|afk: ^ | 19:19 |
| dprince | EmilienM: https://review.rdoproject.org/r/#/c/1359/ | 19:19 |
| dprince | EmilienM: perhaps that? Alan helped me land it earlier today | 19:19 |
| EmilienM | oh nice | 19:20 |
| EmilienM | I'll bump our CI again | 19:20 |
| dprince | EmilienM: it is working for me now on master | 19:20 |
| EmilienM | dprince: lot of red http://tripleo.org/cistatus.html | 19:24 |
| EmilienM | it's probably the zuul timeout thing | 19:24 |
| dprince | EmilienM: perhaps | 19:25 |
| dprince | EmilienM: the more recent HA job failures could be the racy puppet-tripleo neutron thing I caused | 19:25 |
| EmilienM | http://logs.openstack.org/27/328427/1/check-tripleo/gate-tripleo-ci-centos-7-nonha/d1c0227/console.html#_2016-06-10_18_54_30_670 | 19:27 |
| EmilienM | yeah it sounds like a timeout thing | 19:27 |
| *** zbitter has joined #tripleo | 19:29 | |
| *** zaneb has quit IRC | 19:33 | |
| *** mbound has joined #tripleo | 19:34 | |
| *** apetrich has quit IRC | 19:36 | |
| *** apetrich has joined #tripleo | 19:36 | |
| *** fzdarsky has quit IRC | 19:39 | |
| *** fzdarsky has joined #tripleo | 19:39 | |
| *** apetrich has quit IRC | 19:42 | |
| *** apetrich has joined #tripleo | 19:42 | |
| *** fzdarsky has quit IRC | 19:44 | |
| *** fzdarsky has joined #tripleo | 19:48 | |
| EmilienM | dprince: job are failing https://review.openstack.org/#/c/328446/ :( maybe another issue | 19:51 |
| EmilienM | it does not sound related to you code | 19:52 |
| dprince | EmilienM: looking | 19:53 |
| dprince | EmilienM: that looks like an image build failure | 19:54 |
| *** jcoufal has quit IRC | 19:54 | |
| dprince | EmilienM: totally unrelated. I still think we need this puppet-tripleo fix | 19:54 |
| EmilienM | dprince: you want me to land it? | 19:54 |
| dprince | EmilienM: we could, at the very least perhaps we should file a bug so that others who potentially see it notice the bug too | 19:55 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Move Neutron core and service plugin to base https://review.openstack.org/327306 | 19:55 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Composable Neutron Plumgrid plugin https://review.openstack.org/327307 | 19:55 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Drop extraconfig for neutron-nuage.yaml https://review.openstack.org/327742 | 19:55 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Drop extraconfig for neutron-plumgrid.yaml https://review.openstack.org/327318 | 19:55 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Composable neutron nuage plugin https://review.openstack.org/327741 | 19:55 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Composable opencontrail plugin https://review.openstack.org/328471 | 19:55 |
| openstackgerrit | Dan Prince proposed openstack/tripleo-heat-templates: Drop extraconfig for neutron-opencontrail.yaml https://review.openstack.org/328472 | 19:55 |
| EmilienM | dprince: I'll be online during the week-end if something breaks I can revert it | 19:56 |
| dprince | boom, take that CI | 19:56 |
| EmilienM | lol | 19:56 |
| EmilienM | everything is read man | 19:56 |
| EmilienM | red* | 19:56 |
| EmilienM | http://tripleo.org/cistatus.html | 19:56 |
| EmilienM | bnemec: you around by any chance? | 19:59 |
| EmilienM | I'm looking for a second core reviewer to approve https://review.openstack.org/#/c/328446/ | 19:59 |
| bnemec | EmilienM: I'm pretty uncomfortable merging something that has never passed CI when CI is broken. | 20:01 |
| EmilienM | ok | 20:01 |
| EmilienM | pabelanger: do you know if the zuul timeout thing should still occur? | 20:01 |
| EmilienM | bnemec: so we have 2 issues right now: the timeout thing and the hajob exposed to race condition | 20:02 |
| bnemec | WTH? Our job got killed in 30 minutes? | 20:02 |
| *** Erming_ has quit IRC | 20:02 | |
| dprince | EmilienM: I will help look at CI more this evening | 20:02 |
| bnemec | Oh, no, toci didn't start so we killed ourselves. | 20:03 |
| EmilienM | dprince: no worries I'll also be around | 20:03 |
| dprince | EmilienM: I wanted to get the initial Neutron vendor patches started this week as there seems to be a push for them (concern about getting them done) and having a plan for how we deal with these up front seemed wise | 20:03 |
| EmilienM | dprince: it seems fair | 20:04 |
| *** zbitter has quit IRC | 20:04 | |
| EmilienM | dprince: do you have some patches I need to review? the THT patches you just pushed? | 20:04 |
| openstackgerrit | Ryan Hallisey proposed openstack/tripleo-heat-templates: Upgrade playbook for Glance https://review.openstack.org/327341 | 20:04 |
| openstackgerrit | Ryan Hallisey proposed openstack/tripleo-heat-templates: WIP - Upgrade playbook for Cinder & Pacemaker Skeleton https://review.openstack.org/328477 | 20:04 |
| dprince | EmilienM: sure, they are good I think | 20:05 |
| dprince | EmilienM: the dependant puppet-tripleo once are there too for nuage, plumgrid, and opencontrail | 20:05 |
| EmilienM | excellent | 20:05 |
| pabelanger | EmilienM: I don't think we have landed it yet | 20:05 |
| *** rhallisey has quit IRC | 20:05 | |
| pabelanger | so timeout likely to still happen | 20:05 |
| EmilienM | it's very hard to tell if it works | 20:05 |
| EmilienM | dprince: because we have no CI for it | 20:06 |
| pabelanger | checking zl02.o.o however | 20:06 |
| EmilienM | pabelanger: yeah :( | 20:06 |
| EmilienM | pabelanger: thx | 20:06 |
| dprince | EmilienM: I was very careful, all of this code is perfect | 20:06 |
| EmilienM | lol | 20:06 |
| EmilienM | dprince: like neutron/db :-P ? /me runs | 20:06 |
| *** julim has joined #tripleo | 20:06 | |
| pabelanger | EmilienM: we haven't restarted yet. Going to see how we can | 20:07 |
| dprince | EmilienM: right, well the t-h-t will work. but the puppet code has no warranty | 20:07 |
| EmilienM | pabelanger: ack, tripleo CI is super red atm | 20:07 |
| EmilienM | dprince: https://review.openstack.org/#/c/317259/10/manifests/profile/base/neutron/plugins/plumgrid.pp | 20:07 |
| EmilienM | why you check db? | 20:07 |
| dprince | EmilienM: oh, right. Because neutron-db-sync requires plugin.ini to exist | 20:08 |
| dprince | EmilienM: So with pacemaker the db sync runs earlier and we need that file to exist | 20:08 |
| EmilienM | ah right ok fair enough | 20:09 |
| pabelanger | EmilienM: Wow, that many jobs are running on zl02? | 20:09 |
| *** ibravo has joined #tripleo | 20:09 | |
| EmilienM | dprince: docstring is wrong though | 20:09 |
| EmilienM | default is set to True not undef | 20:09 |
| dprince | EmilienM: -1 me! | 20:11 |
| EmilienM | dprince: no... | 20:12 |
| EmilienM | dprince: I'll fix it later | 20:12 |
| dprince | EmilienM: cool, fine w/ me man | 20:12 |
| *** apetrich has quit IRC | 20:12 | |
| *** apetrich has joined #tripleo | 20:14 | |
| pabelanger | EmilienM: will be a little while longer until we restart zuul-launchers, but I don't think all the failures are related to zuul-launcher. Might be something else you are having issues with | 20:14 |
| EmilienM | damn | 20:15 |
| EmilienM | ok | 20:15 |
| *** thrash is now known as thrash|wknd | 20:15 | |
| EmilienM | dprince: wait | 20:17 |
| EmilienM | dprince: https://review.openstack.org/#/c/327307/5/environments/puppet-pacemaker.yaml | 20:17 |
| EmilienM | do we deploy plumgrid everytime we have pacemaker or? | 20:17 |
| dprince | no, this only sets the pacemaker default for it | 20:17 |
| dprince | neutron-plumgrid.yaml would also be required to enable it | 20:18 |
| EmilienM | ahh ok | 20:18 |
| EmilienM | fair enough | 20:18 |
| dprince | EmilienM: This does require that pacemaker come before the neutron vendors in your environment files. | 20:18 |
| dprince | EmilienM: for which my plan was to add it to a Mistral validation | 20:18 |
| dprince | EmilienM: but that is secondary, this will work I think... just fine | 20:18 |
| EmilienM | kk | 20:19 |
| *** zbitter has joined #tripleo | 20:19 | |
| EmilienM | dprince: +2 | 20:20 |
| EmilienM | dprince: wait, you didn't move ::neutron yet? | 20:22 |
| dprince | EmilienM: waiting on Juan's patch in puppet-tripleo to land | 20:22 |
| EmilienM | which one | 20:23 |
| dprince | EmilienM: I guess I could go on and post it now and Depends-On: | 20:23 |
| dprince | EmilienM: nm, it landed : | 20:23 |
| dprince | EmilienM: https://review.openstack.org/#/c/325755/ | 20:23 |
| EmilienM | dprince: ok I looked all your vendor patches, they all look good, excellent work here | 20:23 |
| dprince | EmilienM: thanks, hopefully we can do the same for the Storage (cinder) vendors | 20:24 |
| EmilienM | dprince: we need to drop ::neutron from THT | 20:24 |
| EmilienM | I can submit a patch | 20:24 |
| *** panda has quit IRC | 20:24 | |
| dprince | EmilienM: eventually, yes | 20:24 |
| dprince | EmilienM: go for it | 20:24 |
| *** panda has joined #tripleo | 20:25 | |
| EmilienM | dprince: I'm afraid to break midonet | 20:25 |
| EmilienM | dprince: https://github.com/openstack/tripleo-heat-templates/blob/master/puppet/manifests/overcloud_controller.pp#L209-L212 | 20:26 |
| EmilienM | if I drop ::neutron in THT, I'll break midonet probably | 20:26 |
| dprince | EmilienM: well, if you prefer I can break them :) | 20:26 |
| EmilienM | dprince: excelt if you set service_plugins to empty array in their hiera | 20:26 |
| EmilienM | except* | 20:26 |
| EmilienM | oh they don't have a composable plugin yet | 20:27 |
| EmilienM | so I'll keep this code and add a TODO | 20:27 |
| *** Jabadia has joined #tripleo | 20:28 | |
| Jabadia | OSPd RH question- I can extract the agent.kernel using gzip -dc .... | cpio -id | 20:28 |
| Jabadia | I need to do the same for the overcloud image | 20:28 |
| Jabadia | I tried to openstack-save overcloud-full-vmlinuz , but trying to extract it gives me 'overcloud-full-vmlinuz: not in gzip format' | 20:29 |
| *** dprince has quit IRC | 20:30 | |
| openstackgerrit | Emilien Macchi proposed openstack/tripleo-heat-templates: neutron: stop include ::neutron & ::neutron::config https://review.openstack.org/328487 | 20:31 |
| EmilienM | dprince ^ | 20:31 |
| EmilienM | ho he left | 20:31 |
| EmilienM | :'( | 20:31 |
| openstackgerrit | Gabriele Cerami proposed openstack/tripleo-quickstart: Use virtio for guest vms disks https://review.openstack.org/328488 | 20:31 |
| *** dprince has joined #tripleo | 20:31 | |
| *** apetrich has quit IRC | 20:34 | |
| openstackgerrit | Merged openstack/tripleo-quickstart: Use virtio for guest vms disks https://review.openstack.org/328488 | 20:35 |
| *** apetrich has joined #tripleo | 20:36 | |
| *** fragatina has joined #tripleo | 20:39 | |
| slagle | EmilienM: +2'd | 20:40 |
| EmilienM | slagle: thx | 20:40 |
| *** Goneri has quit IRC | 20:41 | |
| *** zbitter is now known as zaneb | 20:41 | |
| *** jayg is now known as jayg|g0n3 | 20:44 | |
| *** TSCHAK has joined #tripleo | 20:45 | |
| *** ayoung has quit IRC | 20:49 | |
| *** dprince has quit IRC | 20:51 | |
| *** jdob has quit IRC | 20:54 | |
| *** mgarciam has left #tripleo | 21:01 | |
| *** mgarciam has quit IRC | 21:01 | |
| *** Jabadia has quit IRC | 21:09 | |
| *** fzdarsky has quit IRC | 21:14 | |
| *** ibravo has left #tripleo | 21:17 | |
| *** akshai has quit IRC | 21:18 | |
| *** pradk has quit IRC | 21:39 | |
| *** fragatin_ has joined #tripleo | 22:03 | |
| *** number80 has quit IRC | 22:04 | |
| *** fragatina has quit IRC | 22:07 | |
| pabelanger | EmilienM: zl01.o.o is online with the fix, we've put zl02.o.o into shutdown more. | 22:12 |
| pabelanger | mode* | 22:12 |
| EmilienM | ok | 22:12 |
| EmilienM | let's retry | 22:12 |
| EmilienM | thx for the headsup | 22:12 |
| pabelanger | EmilienM: running jobs are still on zl02, but new jobs will be using zl01 | 22:13 |
| EmilienM | ok I rechecked 328446 which is our most critical patch ATM, it will fix HA jobs. | 22:13 |
| EmilienM | I just hope this timeout was really related to the zuul thing | 22:13 |
| EmilienM | I'll monitor that tonight & this week end | 22:19 |
| *** panda is now known as panda|Zz | 22:25 | |
| *** yamahata has quit IRC | 22:27 | |
| *** rlandy has quit IRC | 22:31 | |
| *** apetrich has quit IRC | 22:36 | |
| *** apetrich has joined #tripleo | 22:36 | |
| *** julim has quit IRC | 22:39 | |
| *** yamahata has joined #tripleo | 22:41 | |
| *** yamahata has quit IRC | 22:53 | |
| *** yamahata has joined #tripleo | 22:54 | |
| EmilienM | pabelanger: still failing | 22:55 |
| EmilienM | everything fails at 29 min | 22:55 |
| EmilienM | http://logs.openstack.org/46/328446/1/check-tripleo/gate-tripleo-ci-centos-7-ha/4a128fb/console.html#_2016-06-10_22_42_06_263 | 22:55 |
| *** tosky has quit IRC | 23:01 | |
| *** apetrich has quit IRC | 23:02 | |
| *** apetrich has joined #tripleo | 23:03 | |
| *** fragatin_ has quit IRC | 23:22 | |
| *** fragatina has joined #tripleo | 23:23 | |
| *** sshnaidm has quit IRC | 23:26 | |
| *** weshay has quit IRC | 23:29 | |
| *** mbound has quit IRC | 23:36 | |
| *** rbrady has quit IRC | 23:41 | |
| pabelanger | EmilienM: I don't think this is related to zuul-launcher. toci.started is not happening. | 23:42 |
| pabelanger | I have no idea what controls taht | 23:42 |
| pabelanger | that* | 23:42 |
| pabelanger | what does testenv-client do? | 23:43 |
| pabelanger | something related to gearman? | 23:43 |
| pabelanger | should check if the gearman server is running again, which is external | 23:43 |
| *** rwsu has quit IRC | 23:54 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!