| greghaynes | yea, fair enough | 00:03 |
|---|---|---|
| *** pcrews has joined #tripleo | 00:03 | |
| *** mandre has joined #tripleo | 00:07 | |
| *** mandre has quit IRC | 00:11 | |
| *** Marga_ has joined #tripleo | 00:11 | |
| *** mandre has joined #tripleo | 00:12 | |
| *** Marga_ has quit IRC | 00:14 | |
| *** Marga_ has joined #tripleo | 00:15 | |
| *** Marga_ has quit IRC | 00:19 | |
| *** Marga_ has joined #tripleo | 00:21 | |
| *** Marga_ has quit IRC | 00:22 | |
| *** Marga_ has joined #tripleo | 00:22 | |
| *** eghobo has joined #tripleo | 00:24 | |
| *** Marga_ has quit IRC | 00:27 | |
| *** Marga_ has joined #tripleo | 00:32 | |
| *** yamahata has quit IRC | 00:34 | |
| TheJulia | greghaynes: intruiging... although I suspect it would require a specialized module to wait and look for the signed key to re-appear. The only real issue that I see off hand is that it is rather prescriptive and absoloutely requires that, so anyone wanting to use that would have to go down that route.... backwards compatability also becomes an issue in my mind, but I'd have to think through it some more. | 00:35 |
| *** eghobo has quit IRC | 00:45 | |
| openstackgerrit | Yuiko Takada proposed openstack/tripleo-incubator: Remove incorrect comments https://review.openstack.org/151964 | 00:48 |
| openstackgerrit | Yuiko Takada proposed openstack/tripleo-incubator: Remove incorrect comments https://review.openstack.org/151965 | 00:52 |
| *** Marga_ has quit IRC | 00:55 | |
| *** Marga_ has joined #tripleo | 00:56 | |
| *** eghobo has joined #tripleo | 00:56 | |
| *** eghobo has quit IRC | 00:58 | |
| *** avozza is now known as zz_avozza | 01:20 | |
| *** zhenzanz has joined #tripleo | 01:38 | |
| *** Marga_ has quit IRC | 01:41 | |
| *** jerryz has joined #tripleo | 01:53 | |
| *** Yanyanhu has joined #tripleo | 01:57 | |
| *** wuhg has joined #tripleo | 01:58 | |
| *** zz_avozza is now known as avozza | 02:11 | |
| *** avozza is now known as zz_avozza | 02:23 | |
| openstackgerrit | Jerry Zhao proposed openstack/tripleo-image-elements: Create port with fixed ip for booting CI overcloud utility vms https://review.openstack.org/151974 | 02:31 |
| openstackgerrit | Jerry Zhao proposed openstack/tripleo-image-elements: Create port with fixed ip for booting CI overcloud utility vms https://review.openstack.org/151974 | 02:32 |
| *** noslzzp has quit IRC | 02:37 | |
| *** pradeep has joined #tripleo | 03:38 | |
| *** pcrews has quit IRC | 03:40 | |
| StevenK | stevebaker: If you're around, I need a little more information about when requiring a Keystone domain for Heat was added and when it's likely to be required. | 03:43 |
| stevebaker | StevenK: \o | 03:45 |
| *** eghobo has joined #tripleo | 03:45 | |
| stevebaker | StevenK: have you seen shardy's blog post on the topic? http://hardysteven.blogspot.co.nz/2014/04/heat-auth-model-updates-part-2-stack.html | 03:46 |
| *** daneyon_ has joined #tripleo | 03:50 | |
| *** daneyon has joined #tripleo | 03:54 | |
| *** eghobo has quit IRC | 03:58 | |
| *** daneyon_ has quit IRC | 03:58 | |
| *** untriaged-bot has joined #tripleo | 04:00 | |
| untriaged-bot | Untriaged bugs so far: | 04:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1416180 | 04:00 |
| TempLPBugBot` | Launchpad bug 1416180 in diskimage-builder "Grub install fails for Debian Wheezy on Centos 7" (affected: 1, heat: 6) [Undecided,New] | 04:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1396854 | 04:00 |
| TempLPBugBot` | Launchpad bug 1396854 in tripleo "fail to create an instance with specific ip" (affected: 5, heat: 22) [Undecided,In progress] - Assigned to Jerry Zhao (zhaoxinyu) | 04:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1415674 | 04:00 |
| TempLPBugBot` | Launchpad bug 1415674 in tripleo "tripleo rabbitmq logrotate broken" (affected: 1, heat: 6) [Undecided,New] | 04:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1409583 | 04:00 |
| untriaged-bot | https://bugs.launchpad.net/tuskar/+bug/1387487 | 04:00 |
| TempLPBugBot` | Launchpad bug 1409583 in tripleo "overcloud controller os-refresh-config abort because haproxy horizon failed to bind socket" (affected: 1, heat: 6) [Undecided,New] | 04:00 |
| TempLPBugBot` | Launchpad bug 1387487 in tuskar " tripleo-image-elements/elements/tuskar-ui /os-refresh-config /post-configure.d/101-tuskar-ui needs authentication from Keystone" (affected: 1, heat: 6) [Undecided,New] | 04:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1415240 | 04:00 |
| TempLPBugBot` | Launchpad bug 1415240 in diskimage-builder "package-install-v2 breaks older distros" (affected: 1, heat: 6) [Undecided,New] - Assigned to John Dewey (retr0h) | 04:00 |
| *** untriaged-bot has quit IRC | 04:00 | |
| StevenK | stevebaker: That does a really good job explaining why, but not when :-) | 04:02 |
| stevebaker | when in the release cycle? the stack lifecycle? | 04:02 |
| StevenK | stevebaker: The former -- I remember SpamapS_ mentioning it got turned on and broke TripleO because we weren't creating a domain user yet | 04:03 |
| stevebaker | I can't recall off hand when it first landed, but it would be a mature feature in Juno heat. Need to go further back than that? | 04:04 |
| stevebaker | the openstack client not being installed was one of the barriers afair | 04:06 |
| StevenK | stevebaker: I've writen a script in os-cloud-config that will create the domain, but I'm getting push back for the -incubator patch to explain why it's needed, and I'm struggling beyond "Because SpamapS_ said it is" :-) | 04:07 |
| stevebaker | ah. The reason is so that you don't need to be an admin user to launch heat stacks. Which I think is a *really* good thing | 04:08 |
| stevebaker | StevenK: although, if you procrastinate a bit longer for metadata and signalling to happen via swift TempURLs then heat won't need to create users at all (in its domain, or with an admin user) | 04:11 |
| stevebaker | StevenK: and I'll likely be pushing that into tripleo once it has landed in heat | 04:12 |
| *** eghobo has joined #tripleo | 04:23 | |
| *** eghobo has quit IRC | 04:32 | |
| *** eghobo has joined #tripleo | 04:34 | |
| *** zz_avozza is now known as avozza | 04:43 | |
| *** akuznetsov has joined #tripleo | 04:48 | |
| *** stevebaker has quit IRC | 04:49 | |
| *** stevebaker has joined #tripleo | 04:49 | |
| *** akuznetsov has quit IRC | 04:50 | |
| *** daneyon_ has joined #tripleo | 04:52 | |
| greghaynes | TheJulia: Yes, thats true that it doesnt actually fix the whole host key preservation issue. Youd still have to find a way to gen them before the host boots up and pass them in via cloud-init or somesuch | 04:53 |
| *** avozza is now known as zz_avozza | 04:53 | |
| *** daneyon has quit IRC | 04:55 | |
| SpamapS_ | stevebaker: It's essential and highly necessary. Can you please point me to the push back so I can set the record straight? | 05:08 |
| * SpamapS_ thinks essential might mean "highly necessary" :-P | 05:09 | |
| *** SpamapS_ is now known as SpamapS | 05:09 | |
| *** SpamapS has quit IRC | 05:09 | |
| *** SpamapS has joined #tripleo | 05:09 | |
| StevenK | SpamapS: https://review.openstack.org/#/c/151122/1//COMMIT_MSG | 05:10 |
| SpamapS | StevenK: ty, looking | 05:11 |
| StevenK | SpamapS: To my mind, it's been bought up before, so I don't think it's really a surprise | 05:12 |
| *** daneyon_ has quit IRC | 05:13 | |
| *** pensu has joined #tripleo | 05:14 | |
| SpamapS | StevenK: I don't think we need such detailed documentation in a commit message. | 05:15 |
| SpamapS | StevenK: that said, Heat's documentation is sparse enough, a recently-former heat-core cannot find where config is documented | 05:16 |
| *** Marga_ has joined #tripleo | 05:26 | |
| SpamapS | StevenK: https://review.openstack.org/#/c/151122/ -1'd for different reasons. ;) | 05:32 |
| SpamapS | Also worth noting, http://docs.openstack.org/juno/install-guide/install/yum/content/heat-install-controller-node.html does not mention the domain admin | 05:33 |
| StevenK | Heh | 05:33 |
| StevenK | SpamapS: The overcloud does as well? setup-undercloud-passwords deals with the Heat domain password, but setup-overcloud-passwords does not. | 05:36 |
| *** Marga_ has quit IRC | 05:37 | |
| *** Marga__ has joined #tripleo | 05:37 | |
| StevenK | Oh. Because the change introduced the change to setup-undercloud-passwords. Sigh. | 05:39 |
| *** stevebaker has quit IRC | 05:43 | |
| *** stevebaker has joined #tripleo | 05:43 | |
| SpamapS | StevenK: we're doing a particularly crappy job of setting up overcloud Heat | 05:44 |
| *** zz_avozza is now known as avozza | 05:44 | |
| StevenK | SpamapS: I've added it for the overcloud, just running it against devtest locally. | 05:44 |
| *** masco has joined #tripleo | 05:45 | |
| SpamapS | StevenK: Helion's devplatform uses HEat to deploy Trove and Designate, and it includes Heat stuff for other user-focused bits, and it doesn't work as a non-admin so those users are particularly unhappy with it. | 05:45 |
| StevenK | Blah | 05:46 |
| StevenK | devtest runs sync -- and I'm in the middle of dumping some stuff onto a USB key. | 05:46 |
| *** lazy_prince has quit IRC | 05:46 | |
| StevenK | SpamapS: I'm just driving by since it impacts os-cloud-config :-P | 05:46 |
| *** killer_prince has joined #tripleo | 05:51 | |
| *** killer_prince is now known as lazy_prince | 05:51 | |
| *** ishant has joined #tripleo | 05:52 | |
| *** avozza is now known as zz_avozza | 05:54 | |
| *** stevebaker has quit IRC | 06:14 | |
| *** stevebaker has joined #tripleo | 06:14 | |
| *** Marga__ has quit IRC | 06:22 | |
| *** Marga_ has joined #tripleo | 06:22 | |
| *** lazy_prince has quit IRC | 06:26 | |
| *** stevebaker has quit IRC | 06:26 | |
| *** stevebaker has joined #tripleo | 06:26 | |
| *** Marga_ has quit IRC | 06:26 | |
| tchaypo | greghaynes: then I | 06:32 |
| tchaypo | Gah | 06:32 |
| tchaypo | greghaynes: would signed ssh keys help here? | 06:33 |
| tchaypo | I don't think it does | 06:33 |
| *** bvandenh has joined #tripleo | 06:34 | |
| *** zz_avozza is now known as avozza | 06:44 | |
| *** killer_prince has joined #tripleo | 06:50 | |
| *** killer_prince is now known as lazy_prince | 06:50 | |
| *** Marga_ has joined #tripleo | 06:53 | |
| *** yog_ has joined #tripleo | 06:56 | |
| *** Marga_ has quit IRC | 06:57 | |
| *** bvandenh has quit IRC | 06:59 | |
| *** jcoufal has joined #tripleo | 07:00 | |
| *** jprovazn has joined #tripleo | 07:01 | |
| *** lazy_prince has quit IRC | 07:04 | |
| *** chuckC__ has joined #tripleo | 07:11 | |
| *** chuckC_ has quit IRC | 07:14 | |
| *** chuckC__ is now known as chuckC_ | 07:14 | |
| openstackgerrit | Steve Kowalik proposed openstack/tripleo-incubator: Call new init-keystone-heat-domain https://review.openstack.org/151122 | 07:15 |
| *** avozza is now known as zz_avozza | 07:16 | |
| *** Yanyanhu has quit IRC | 07:18 | |
| *** Yanyanhu has joined #tripleo | 07:18 | |
| *** Marga_ has joined #tripleo | 07:23 | |
| *** mrunge has joined #tripleo | 07:25 | |
| *** Marga_ has quit IRC | 07:27 | |
| *** eghobo has quit IRC | 07:31 | |
| *** lazy_prince has joined #tripleo | 07:33 | |
| *** mrunge has quit IRC | 07:36 | |
| *** lazy_prince has quit IRC | 07:45 | |
| *** jcoufal_ has joined #tripleo | 07:49 | |
| *** zz_avozza is now known as avozza | 07:49 | |
| *** jcoufal has quit IRC | 07:52 | |
| *** jang2 has joined #tripleo | 07:56 | |
| *** lazy_prince has joined #tripleo | 07:58 | |
| *** lazy_prince has joined #tripleo | 07:59 | |
| *** chlong has quit IRC | 08:00 | |
| *** mkerrin has quit IRC | 08:00 | |
| *** dshulyak has joined #tripleo | 08:01 | |
| *** dtantsur|afk is now known as dtantsur | 08:05 | |
| *** jtomasek has joined #tripleo | 08:06 | |
| openstackgerrit | Martin André proposed stackforge/kolla: WIP Build docker images from diskimage elements https://review.openstack.org/152017 | 08:10 |
| lifeless | <3 | 08:11 |
| lifeless | morganfainberg: ^ | 08:11 |
| lifeless | bah | 08:11 |
| lifeless | mordred: ^ | 08:11 |
| morganfainberg | lol | 08:14 |
| *** Marga_ has joined #tripleo | 08:24 | |
| *** Marga_ has quit IRC | 08:26 | |
| *** Marga_ has joined #tripleo | 08:26 | |
| *** Marga_ has quit IRC | 08:31 | |
| *** mandre has quit IRC | 08:42 | |
| *** panda has quit IRC | 08:47 | |
| *** dshulyak has quit IRC | 08:48 | |
| *** panda has joined #tripleo | 08:48 | |
| *** rwsu has joined #tripleo | 08:49 | |
| *** rwsu is now known as rwsu-afk | 08:50 | |
| *** mrunge has joined #tripleo | 08:50 | |
| *** jistr has joined #tripleo | 08:58 | |
| *** gfidente has joined #tripleo | 09:05 | |
| *** derekh has joined #tripleo | 09:12 | |
| *** zhenzanz has quit IRC | 09:13 | |
| *** rdopiera has joined #tripleo | 09:13 | |
| *** pensu has quit IRC | 09:13 | |
| rdopiera | hi there | 09:16 |
| *** mcornea has joined #tripleo | 09:18 | |
| *** pdb has joined #tripleo | 09:19 | |
| *** rdopiera has quit IRC | 09:20 | |
| *** rdopiera has joined #tripleo | 09:21 | |
| *** GheRiver1 is now known as GheRivero | 09:22 | |
| *** ralala has joined #tripleo | 09:24 | |
| *** athomas has joined #tripleo | 09:25 | |
| *** Marga_ has joined #tripleo | 09:27 | |
| *** Marga__ has joined #tripleo | 09:29 | |
| *** subscope has joined #tripleo | 09:29 | |
| *** bvandenh has joined #tripleo | 09:30 | |
| *** Marga_ has quit IRC | 09:32 | |
| *** Marga__ has quit IRC | 09:33 | |
| *** pensu has joined #tripleo | 09:33 | |
| *** yog_ has quit IRC | 09:40 | |
| *** mcornea has quit IRC | 09:48 | |
| *** rdopiera has quit IRC | 09:48 | |
| *** rdopiera has joined #tripleo | 09:48 | |
| *** mcornea has joined #tripleo | 09:48 | |
| GheRivero | hi all | 09:48 |
| *** pensu has quit IRC | 09:49 | |
| *** mkerrin has joined #tripleo | 09:54 | |
| *** rdopiera has quit IRC | 09:56 | |
| *** rdopiera has joined #tripleo | 09:56 | |
| *** yog_ has joined #tripleo | 09:56 | |
| *** untriaged-bot has joined #tripleo | 10:00 | |
| untriaged-bot | Untriaged bugs so far: | 10:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1416180 | 10:00 |
| TempLPBugBot` | Launchpad bug 1416180 in diskimage-builder "Grub install fails for Debian Wheezy on Centos 7" (affected: 1, heat: 6) [Undecided,New] | 10:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1396854 | 10:00 |
| TempLPBugBot` | Launchpad bug 1396854 in tripleo "fail to create an instance with specific ip" (affected: 5, heat: 22) [Undecided,In progress] - Assigned to Jerry Zhao (zhaoxinyu) | 10:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1415674 | 10:00 |
| TempLPBugBot` | Launchpad bug 1415674 in tripleo "tripleo rabbitmq logrotate broken" (affected: 1, heat: 6) [Undecided,New] | 10:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1409583 | 10:00 |
| TempLPBugBot` | Launchpad bug 1409583 in tripleo "overcloud controller os-refresh-config abort because haproxy horizon failed to bind socket" (affected: 1, heat: 6) [Undecided,New] | 10:00 |
| untriaged-bot | https://bugs.launchpad.net/tuskar/+bug/1387487 | 10:00 |
| TempLPBugBot` | Launchpad bug 1387487 in tuskar " tripleo-image-elements/elements/tuskar-ui /os-refresh-config /post-configure.d/101-tuskar-ui needs authentication from Keystone" (affected: 1, heat: 6) [Undecided,New] | 10:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1415240 | 10:00 |
| TempLPBugBot` | Launchpad bug 1415240 in diskimage-builder "package-install-v2 breaks older distros" (affected: 1, heat: 6) [Undecided,New] - Assigned to John Dewey (retr0h) | 10:00 |
| *** pensu has joined #tripleo | 10:00 | |
| *** untriaged-bot has quit IRC | 10:00 | |
| *** pensu has quit IRC | 10:04 | |
| *** yog_ has quit IRC | 10:15 | |
| *** pelix has joined #tripleo | 10:17 | |
| *** yog_ has joined #tripleo | 10:18 | |
| *** jp_at_hp has joined #tripleo | 10:20 | |
| *** tserong has quit IRC | 10:20 | |
| *** pblaho has joined #tripleo | 10:20 | |
| *** yog_ has quit IRC | 10:23 | |
| *** Marga_ has joined #tripleo | 10:29 | |
| *** jang2 has quit IRC | 10:32 | |
| *** Marga_ has quit IRC | 10:35 | |
| *** yog_ has joined #tripleo | 10:36 | |
| *** akrivoka has joined #tripleo | 10:37 | |
| *** luisjariz has joined #tripleo | 10:39 | |
| *** dtantsur is now known as dtantsur|brb | 10:48 | |
| *** gfidente has quit IRC | 10:48 | |
| *** rlandy has joined #tripleo | 10:49 | |
| *** gfidente has joined #tripleo | 10:52 | |
| *** sdake_ has joined #tripleo | 10:52 | |
| *** andreaf_ is now known as andreaf | 10:58 | |
| *** sdake_ has quit IRC | 11:05 | |
| *** Yanyanhu has quit IRC | 11:05 | |
| *** sdake_ has joined #tripleo | 11:07 | |
| *** sdake_ has quit IRC | 11:13 | |
| *** kbyrne has joined #tripleo | 11:14 | |
| *** sdake_ has joined #tripleo | 11:14 | |
| derekh | Anybody else having trouble being up a overcloud on F20 ? Instances staying in a spawning state, | 11:17 |
| derekh | happening locally but started in CI at some stage over the weekend | 11:18 |
| *** sdake_ has quit IRC | 11:20 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: temprevert: Do not pass PXE net config from boo... https://review.openstack.org/152089 | 11:29 |
| derekh | gfidente: ^^ I have a feeling that revert might fix the problem you reported | 11:30 |
| *** derekh changes topic to "All overcloud jobs failing https://bugs.launchpad.net/tripleo/+bug/1417026 | Mid-cycle meetup Feb 18 - 20 in Seattle http://bit.ly/1AiNuMK | Using OpenStack to deploy OpenStack; meetings Tuesday 1900/0800 UTC in #openstack-meeting-alt" | 11:30 | |
| *** Marga_ has joined #tripleo | 11:30 | |
| gfidente | hi derekh wow, great, thanks | 11:31 |
| gfidente | derekh, I am seeing this as well https://bugs.launchpad.net/tripleo/+bug/1414098 happening quite a lot | 11:33 |
| TempLPBugBot` | Launchpad bug 1414098 in tripleo "get_state_from_hosts often fails to unpack logs" (affected: 2, heat: 10) [Critical,Triaged] | 11:33 |
| gfidente | yet the real problem there is that it can't reach the target host | 11:34 |
| gfidente | hints on how to troubleshoot that furthet? | 11:35 |
| gfidente | *further | 11:35 |
| *** Marga_ has quit IRC | 11:35 | |
| derekh | gfidente: trying to figure that one out aswell but can't get that far at the moment | 11:35 |
| derekh | gfidente: I'm inclined to blame the test env hosts as I havn't seen it locally but don't have much to go on yet, once we get this current problem sorted I'll get back to it | 11:36 |
| *** ishant has quit IRC | 11:45 | |
| derekh | gfidente: greghaynes: tchaypo https://bugs.launchpad.net/tripleo/+bug/1414098 | 11:59 |
| TempLPBugBot` | Launchpad bug 1414098 in tripleo "get_state_from_hosts often fails to unpack logs" (affected: 2, heat: 10) [Critical,Triaged] | 11:59 |
| *** dtantsur|brb is now known as dtantsur | 12:00 | |
| openstackgerrit | Gonéri Le Bouder proposed openstack/tripleo-image-elements: tox: fix the test suite https://review.openstack.org/151885 | 12:05 |
| *** avozza is now known as zz_avozza | 12:05 | |
| *** pensu has joined #tripleo | 12:17 | |
| *** subscope has quit IRC | 12:21 | |
| *** Marga_ has joined #tripleo | 12:23 | |
| *** Marga_ has quit IRC | 12:24 | |
| *** Marga_ has joined #tripleo | 12:24 | |
| *** masco has quit IRC | 12:28 | |
| *** subscope has joined #tripleo | 12:30 | |
| *** ralala has quit IRC | 12:34 | |
| *** akrivoka has quit IRC | 12:36 | |
| *** akrivoka has joined #tripleo | 12:37 | |
| *** zz_avozza is now known as avozza | 12:41 | |
| *** regebro has joined #tripleo | 12:50 | |
| *** weshay has joined #tripleo | 12:51 | |
| *** lblanchard has joined #tripleo | 12:57 | |
| *** dprince has joined #tripleo | 13:01 | |
| *** pradeep has quit IRC | 13:01 | |
| *** Marga_ has quit IRC | 13:04 | |
| *** Marga_ has joined #tripleo | 13:05 | |
| TheJulia | tchaypo: I kind of see the idea as you verifiy that the key is appropriately signed before proceeding forth, but I think it only makes everything more complex when compared to just a basic restoration of what was there. The only other way would be to write an ssh module that waited for the known host key to re-appear.... hmmmm | 13:06 |
| *** morazi has joined #tripleo | 13:09 | |
| *** tzumainn has joined #tripleo | 13:10 | |
| openstackgerrit | Merged openstack/tuskar-ui: Use handle_errors decorator to handle image_get https://review.openstack.org/150367 | 13:12 |
| openstackgerrit | Merged openstack/tuskar-ui: Refactor metering utility and view functions https://review.openstack.org/149671 | 13:12 |
| openstackgerrit | Merged openstack/tuskar-ui: Tests for utils.metering https://review.openstack.org/150422 | 13:13 |
| openstackgerrit | Merged openstack/tuskar-ui: Remove outdated TODOs https://review.openstack.org/150785 | 13:13 |
| openstackgerrit | Jiri Tomasek proposed openstack/tuskar-ui: Fixed Roles table positioning https://review.openstack.org/152110 | 13:21 |
| openstackgerrit | Merged openstack/tuskar-ui: Display form errors in plan validation and add more validation checks https://review.openstack.org/151604 | 13:22 |
| *** gfidente has quit IRC | 13:24 | |
| openstackgerrit | Merged openstack/tuskar-ui: Memoize the get_role_link() function https://review.openstack.org/151264 | 13:24 |
| openstackgerrit | Merged openstack/tuskar-ui: Display roles on flavor detail page https://review.openstack.org/150774 | 13:27 |
| *** gfidente has joined #tripleo | 13:36 | |
| *** pradeep1 has joined #tripleo | 13:41 | |
| *** ralala has joined #tripleo | 13:43 | |
| *** pradeep1 has quit IRC | 13:45 | |
| openstackgerrit | Merged openstack/tuskar-ui: Fixed Roles table positioning https://review.openstack.org/152110 | 13:47 |
| *** avozza is now known as zz_avozza | 13:49 | |
| *** sseago has left #tripleo | 13:56 | |
| openstackgerrit | James Polley proposed openstack/tripleo-incubator: Wait for all ovs agents, rather than just one. https://review.openstack.org/112419 | 14:01 |
| *** mcornea has quit IRC | 14:01 | |
| *** regebro has quit IRC | 14:02 | |
| tchaypo | gfidente: I’ve got a patch in flight somewhere that seperates the tar creation out - so it gets created on the seed, then we copy it, then we untar it - rather than trying to do it all at once | 14:02 |
| tchaypo | we’ve already found that it’s helped us figure out what’s going on with the seed | 14:03 |
| tchaypo | in some cases it’s just that the seed isn’t reachable, so that’s still an unsolved mystery | 14:03 |
| *** masco has joined #tripleo | 14:03 | |
| tchaypo | in other cases, tar was barfing because we told it to `—exclude /dev/blah`, but /dev/blah doesn’t exist, so tar aborts when it fails to stat the file we told it to ignore.. | 14:03 |
| tchaypo | derekh: I was going to look at f20 but I’ve only just managed to get online in rome | 14:04 |
| pdb | is this the best channel for kolla stuff? if so does anyone know how to enable priviledged mode for kubernetes in the vagrant setup? | 14:05 |
| derekh | tchaypo: disk space issue https://bugs.launchpad.net/tripleo/+bug/1414098 | 14:07 |
| TempLPBugBot` | Launchpad bug 1414098 in tripleo "get_state_from_hosts often fails to unpack logs" (affected: 2, heat: 10) [Critical,Triaged] | 14:07 |
| tchaypo | pdb: I don’t see much chatter about kolla here, but I don’t know of a better place | 14:08 |
| gfidente | tchaypo, pardon, I should have pinged about https://review.openstack.org/#/c/112419/ this in IRC but I couldn't resist the chance to do a review! | 14:09 |
| tchaypo | derekh: i started reading the bug and was about to ask about old images being cached | 14:09 |
| tchaypo | gfidente: revenge? | 14:09 |
| tchaypo | gfidente: ;) | 14:09 |
| gfidente | not at all actually I promise I'll never do that again | 14:09 |
| *** morazi has quit IRC | 14:09 | |
| tchaypo | hehe | 14:10 |
| tchaypo | your comment looks sane but I don’t understand the change well enough to know what to do next | 14:10 |
| gfidente | we should figure how many controllers and computes we have | 14:11 |
| gfidente | because those are the only ones where we deploy l2 agent I think | 14:11 |
| gfidente | they were also the only type of node before | 14:11 |
| tchaypo | Can you add that as a comment on the review? | 14:11 |
| gfidente | but ideally not anymore | 14:11 |
| tchaypo | Also | 14:11 |
| gfidente | sure | 14:11 |
| tchaypo | gfidente: I’m in rome! | 14:11 |
| gfidente | tchaypo, WHEN YOU TELL ME! | 14:11 |
| gfidente | where are you? | 14:11 |
| *** mcornea has joined #tripleo | 14:17 | |
| *** regebro has joined #tripleo | 14:18 | |
| StevenK | ~/ | 14:21 |
| derekh | tchaypo: what to you mean about the old image being cached ? | 14:25 |
| derekh | also core, ironic regression being dealt with at the moment, in the mean time merge this ---> https://review.openstack.org/#/c/152089/ | 14:26 |
| derekh | *cores | 14:26 |
| *** zigo has quit IRC | 14:31 | |
| *** noslzzp has joined #tripleo | 14:34 | |
| *** zigo has joined #tripleo | 14:35 | |
| *** rbrady has joined #tripleo | 14:37 | |
| *** vipul has quit IRC | 14:37 | |
| *** esp has quit IRC | 14:38 | |
| derekh | Ok, going to just redeploy all rh1 testenvs to sort out https://bugs.launchpad.net/tripleo/+bug/1414098 | 14:39 |
| TempLPBugBot` | Launchpad bug 1414098 in tripleo "get_state_from_hosts often fails to unpack logs" (affected: 2, heat: 10) [Critical,Triaged] | 14:39 |
| tchaypo | derekh: actually this looks different to what I was thinking of | 14:39 |
| derekh | at the same time going to increas RAM per VM to 4G and change to amd64 | 14:39 |
| derekh | tchaypo: SpamapS dprince slagle ^^ any objections ? | 14:40 |
| tchaypo | I’ve seen my $TRIPLEO_ROOT get very big because I run the devtest scripts there and it builds new images and renames the old ones | 14:40 |
| tchaypo | derekh: none form me - we discussed this in channel the other day and everyone seems fine with it, and the comments on the list were all positive | 14:40 |
| derekh | tchaypo: ahh ok, | 14:40 |
| derekh | tchaypo: ok, no is a good time because F20 overcloud jobs are failing anyways https://review.openstack.org/#/c/152089/ | 14:41 |
| *** vipul has joined #tripleo | 14:41 | |
| *** esp has joined #tripleo | 14:41 | |
| dprince | derekh: can we switch to x86_64 now too? | 14:41 |
| *** Marga_ has quit IRC | 14:42 | |
| derekh | dprince: yup <derekh> at the same time going to increas RAM per VM to 4G and change to amd64 | 14:42 |
| *** derekh changes topic to "CI DOWN FOR MAINTENANCE | Mid-cycle meetup Feb 18 - 20 in Seattle http://bit.ly/1AiNuMK | Using OpenStack to deploy OpenStack; meetings Tuesday 1900/0800 UTC in #openstack-meeting-alt" | 14:42 | |
| dprince | derekh: awesome. I've got no objections either way. Would just like to see x86_64 sooner :) | 14:42 |
| tchaypo | derekh: https://review.openstack.org/#/c/152089/1/toci_devtest.sh - line 44 seems like a dupe of line 42 | 14:43 |
| tchaypo | is that intentional? | 14:43 |
| derekh | tchaypo: woop, no its a copy/paste error will fix | 14:43 |
| tchaypo | thanks | 14:43 |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: temprevert: Do not pass PXE net config from boo... https://review.openstack.org/152089 | 14:48 |
| *** zz_avozza is now known as avozza | 14:49 | |
| *** openstackgerrit has quit IRC | 14:52 | |
| *** openstackgerrit has joined #tripleo | 14:52 | |
| *** jprovazn has quit IRC | 14:55 | |
| *** jerryz has quit IRC | 14:56 | |
| *** mcornea has quit IRC | 14:58 | |
| *** mcornea has joined #tripleo | 14:58 | |
| *** pradeep1 has joined #tripleo | 14:59 | |
| *** rhallisey has joined #tripleo | 15:04 | |
| *** yog_ has quit IRC | 15:06 | |
| *** spzala has joined #tripleo | 15:11 | |
| *** jerryz has joined #tripleo | 15:12 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Switch to x86_64 Fedora image https://review.openstack.org/152147 | 15:13 |
| *** mcornea has quit IRC | 15:14 | |
| *** pradeep2 has joined #tripleo | 15:14 | |
| *** pradeep1 has quit IRC | 15:15 | |
| *** masco has quit IRC | 15:17 | |
| *** morazi has joined #tripleo | 15:17 | |
| openstackgerrit | Derek Higgins proposed openstack/tripleo-incubator: Make the default for NODE_CNT less arbitrary https://review.openstack.org/152150 | 15:17 |
| openstackgerrit | Derek Higgins proposed openstack/tripleo-incubator: Make the default for NODE_CNT less arbitrary https://review.openstack.org/152150 | 15:17 |
| *** jprovazn has joined #tripleo | 15:19 | |
| *** pradeep1 has joined #tripleo | 15:22 | |
| openstackgerrit | Dan Prince proposed openstack/tripleo-puppet-elements: Add puppet-tripleo module. https://review.openstack.org/152151 | 15:23 |
| *** pradeep2 has quit IRC | 15:24 | |
| slagle | dprince: do you have an example of the static metadata needed if you wanted to build a seed vm to use puppet instead of the openstack elements? | 15:26 |
| *** pradk has joined #tripleo | 15:27 | |
| slagle | dprince: basically this file, but puppetized: https://github.com/openstack/tripleo-image-elements/blob/master/elements/seed-stack-config/config.json | 15:27 |
| tchaypo | derekh: re https://review.openstack.org/#/c/152150 | 15:27 |
| dprince | slagle: you don't need anything special in your seed. | 15:27 |
| *** mcornea has joined #tripleo | 15:28 | |
| tchaypo | my understanding is that greghaynes proposed the change to 15 because it’s expensive if we need to increase the number in future | 15:28 |
| dprince | slagle: you will need DNS working (neutron nameserver needs to be set for the subnet) | 15:28 |
| *** pradeep2 has joined #tripleo | 15:29 | |
| slagle | dprince: so the values in that file will take effect as is? | 15:29 |
| tchaypo | if I’m reading your comments, the problem now is that ironic isn’t consistently picking the same host eahc time | 15:29 |
| tchaypo | could we fix thie bug by making ironic be more consistent? | 15:29 |
| dprince | slagle: should be fine, yes. I don't modify the seed's config.json for my own dev environment. | 15:29 |
| dprince | slagle: have you seed this? http://git.openstack.org/cgit/openstack/tripleo-incubator/tree/doc/source/puppet.rst | 15:30 |
| slagle | ok, thx | 15:30 |
| *** pradeep1 has quit IRC | 15:30 | |
| slagle | dprince: yes, but that made it sound like i had a seed deployed via the normal means | 15:30 |
| dprince | slagle: FWIW, you could actually use a source built seed for puppet. It would work fine. I typically use package for everything though. | 15:30 |
| *** jerryz has quit IRC | 15:31 | |
| *** rdopiera has quit IRC | 15:31 | |
| *** rdopiera has joined #tripleo | 15:31 | |
| slagle | i want my seed to use packages and puppet | 15:32 |
| slagle | i'll give it a try | 15:32 |
| dprince | slagle: packages yes, puppet: not so much. | 15:32 |
| dprince | slagle: we haven't done the puppet work for the undercloud yet | 15:32 |
| dprince | slagle: or the seed | 15:32 |
| dprince | slagle: puppet is currently being developed for the overcloud only, which any old seed should be capable of driving | 15:33 |
| *** pradeep2 has quit IRC | 15:33 | |
| *** pradeep1 has joined #tripleo | 15:33 | |
| slagle | dprince: ack, ok | 15:35 |
| *** stendulker_ has joined #tripleo | 15:35 | |
| *** pradeep2 has joined #tripleo | 15:37 | |
| *** pradk has quit IRC | 15:37 | |
| *** pradeep1 has quit IRC | 15:38 | |
| *** daneyon has joined #tripleo | 15:45 | |
| *** andreaf is now known as andreaf_ | 15:47 | |
| gfidente | tchaypo, derekh, greghaynes I would leave that intentionally *LOW* and put more emphasis on the need for that to be customized | 15:53 |
| gfidente | not try to put a randomically high number | 15:53 |
| gfidente | can I add that as a comment in the change? | 15:54 |
| *** rdopiera has quit IRC | 15:59 | |
| *** untriaged-bot has joined #tripleo | 16:00 | |
| untriaged-bot | Untriaged bugs so far: | 16:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1416180 | 16:00 |
| TempLPBugBot` | Launchpad bug 1416180 in diskimage-builder "Grub install fails for Debian Wheezy on Centos 7" (affected: 1, heat: 6) [Undecided,New] | 16:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1396854 | 16:00 |
| TempLPBugBot` | Launchpad bug 1396854 in tripleo "fail to create an instance with specific ip" (affected: 5, heat: 22) [Undecided,In progress] - Assigned to Jerry Zhao (zhaoxinyu) | 16:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1415674 | 16:00 |
| TempLPBugBot` | Launchpad bug 1415674 in tripleo "tripleo rabbitmq logrotate broken" (affected: 1, heat: 6) [Undecided,New] | 16:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1409583 | 16:00 |
| TempLPBugBot` | Launchpad bug 1409583 in tripleo "overcloud controller os-refresh-config abort because haproxy horizon failed to bind socket" (affected: 1, heat: 6) [Undecided,New] | 16:00 |
| untriaged-bot | https://bugs.launchpad.net/tuskar/+bug/1387487 | 16:00 |
| TempLPBugBot` | Launchpad bug 1387487 in tuskar " tripleo-image-elements/elements/tuskar-ui /os-refresh-config /post-configure.d/101-tuskar-ui needs authentication from Keystone" (affected: 1, heat: 6) [Undecided,New] | 16:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1415240 | 16:00 |
| TempLPBugBot` | Launchpad bug 1415240 in diskimage-builder "package-install-v2 breaks older distros" (affected: 1, heat: 6) [Undecided,New] - Assigned to John Dewey (retr0h) | 16:00 |
| *** untriaged-bot has quit IRC | 16:00 | |
| *** beekneemech is now known as bnemec | 16:00 | |
| *** Marga_ has joined #tripleo | 16:02 | |
| *** pcrews has joined #tripleo | 16:04 | |
| *** tteggel_ is now known as tteggel | 16:04 | |
| *** mrunge has quit IRC | 16:05 | |
| *** sdake_ has joined #tripleo | 16:09 | |
| *** daneyon_ has joined #tripleo | 16:11 | |
| *** daneyon has quit IRC | 16:14 | |
| *** david-lyle_afk is now known as david-lyle | 16:19 | |
| openstackgerrit | Nicholas Randon proposed openstack/tripleo-image-elements: Remove /opt/stack/{repo} files https://review.openstack.org/93077 | 16:23 |
| openstackgerrit | Nicholas Randon proposed openstack/tripleo-image-elements: Remove /opt/stack/{repo} files https://review.openstack.org/93077 | 16:24 |
| *** lazy_prince is now known as killer_prince | 16:31 | |
| *** pradeep2 has quit IRC | 16:35 | |
| *** daneyon_ has quit IRC | 16:36 | |
| *** daneyon has joined #tripleo | 16:36 | |
| *** rwsu-afk is now known as rwsu | 16:40 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Switch to x86_64 Fedora image https://review.openstack.org/152147 | 16:40 |
| derekh | slagle: tchaypo can you re add your +2 here https://review.openstack.org/#/c/152147/2 , CI passed just fixed a typo | 16:41 |
| slagle | yep | 16:47 |
| tchaypo | Not at computer right now but I think this is a case where the fixed version doesn't need a +2 | 16:49 |
| tchaypo | Will add when I'm back | 16:49 |
| derekh | tchaypo: no prob, I've approved myself... now sure why it hasn't merged | 16:50 |
| *** daneyon has quit IRC | 16:50 | |
| derekh | *not sure | 16:50 |
| openstackgerrit | Merged openstack-infra/tripleo-ci: temprevert: Do not pass PXE net config from boo... https://review.openstack.org/152089 | 16:51 |
| *** daneyon has joined #tripleo | 16:51 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci: Switch to x86_64 Fedora image https://review.openstack.org/152147 | 16:51 |
| *** derekh changes topic to "devtest failing on Fedora https://bugs.launchpad.net/tripleo/+bug/1417026 | Mid-cycle meetup Feb 18 - 20 in Seattle http://bit.ly/1AiNuMK | Using OpenStack to deploy OpenStack; meetings Tuesday 1900/0800 UTC in #openstack-meeting-alt" | 16:52 | |
| *** derekh changes topic to "devtest failing on Fedora https://bugs.launchpad.net/tripleo/+bug/1417026 | Mid-cycle meetup Feb 18 - 20 in Seattle http://bit.ly/1AiNuMK | Using OpenStack to deploy OpenStack; meetings Tuesday 1900/0800 UTC in #openstack-meeting-alt" | 16:52 | |
| *** daneyon has quit IRC | 16:55 | |
| *** killer_prince has quit IRC | 16:55 | |
| *** killer_prince has joined #tripleo | 16:56 | |
| *** killer_prince is now known as lazy_prince | 16:56 | |
| derekh | We are now running amd64 test envs with 4G of RAM each on rh1 as per http://lists.openstack.org/pipermail/openstack-dev/2015-January/053897.html | 16:57 |
| derekh | I'll reply to the mail later with details once I've confirmed everything is ok | 16:57 |
| derekh | Will update hp1 aswell and see if I can figure out the problems we're having with it | 16:58 |
| *** lazy_prince has quit IRC | 16:58 | |
| *** masco has joined #tripleo | 17:00 | |
| *** killer_prince has joined #tripleo | 17:01 | |
| *** killer_prince is now known as lazy_prince | 17:01 | |
| *** Marga_ has quit IRC | 17:02 | |
| *** daneyon has joined #tripleo | 17:06 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Switch TE host VM to amd64 https://review.openstack.org/152188 | 17:07 |
| *** pradeep1 has joined #tripleo | 17:07 | |
| *** eghobo has joined #tripleo | 17:08 | |
| *** wuhg has quit IRC | 17:09 | |
| *** chuckC_ has quit IRC | 17:12 | |
| *** eghobo has quit IRC | 17:13 | |
| *** ChuckC_ has joined #tripleo | 17:14 | |
| *** eghobo has joined #tripleo | 17:15 | |
| openstackgerrit | Derek Higgins proposed openstack/tripleo-image-elements: Adjust Test env requirements https://review.openstack.org/152192 | 17:15 |
| *** ChuckC has quit IRC | 17:18 | |
| *** EmilienM is now known as EmilienM|afk | 17:18 | |
| *** pradeep has joined #tripleo | 17:19 | |
| SpamapS | derekh: no objections btw. :) | 17:20 |
| *** pradeep1 has quit IRC | 17:20 | |
| *** masco has quit IRC | 17:21 | |
| *** pradeep1 has joined #tripleo | 17:22 | |
| derekh | SpamapS: great...cause undoing it would be a pain in the ass ;-) | 17:23 |
| *** dtantsur is now known as dtantsur|afk | 17:23 | |
| *** pradeep has quit IRC | 17:23 | |
| SpamapS | derekh: no doubt. :) | 17:25 |
| *** pblaho has quit IRC | 17:25 | |
| derekh | greghaynes: I believe the intermittent F20 failures of the seed we have been seeing should now be gone (we'll know for sure over the next few hours) | 17:26 |
| *** daneyon has quit IRC | 17:26 | |
| *** jang2 has joined #tripleo | 17:27 | |
| SpamapS | derekh: oh thats great news | 17:32 |
| SpamapS | derekh: I didn't consider that the seed was also bound by the same VM sizes and it might just be crashing | 17:32 |
| derekh | SpamapS: The seed is bound by the same VM sizes but that wasn't the problem, some of the TE host machines had full disks | 17:33 |
| bnemec | derekh: SpamapS: I left a comment on one of derekh's reviews, but I think we should change the devtest default too. | 17:36 |
| bnemec | 32-bit isn't really a production default, and we've been seeing issues that are probably related to 3 gig vms so that's not a good default anymore either. | 17:36 |
| *** dshulyak has joined #tripleo | 17:38 | |
| *** jistr has quit IRC | 17:39 | |
| *** pradeep has joined #tripleo | 17:40 | |
| *** pradeep1 has quit IRC | 17:40 | |
| *** mcornea has quit IRC | 17:41 | |
| derekh | bnemec: ack, seems reasonable to me, | 17:43 |
| *** jcoufal_ has quit IRC | 17:46 | |
| openstackgerrit | Merged stackforge/tripleo-ansible: Correct syntax issues in glance_download module https://review.openstack.org/151304 | 17:51 |
| *** pdb has quit IRC | 17:52 | |
| *** dshulyak has quit IRC | 17:53 | |
| *** derekh has quit IRC | 17:53 | |
| *** Marga_ has joined #tripleo | 17:59 | |
| *** eghobo has quit IRC | 17:59 | |
| *** yamahata has joined #tripleo | 18:00 | |
| *** EmilienM|afk is now known as EmilienM | 18:00 | |
| *** bvandenh has quit IRC | 18:00 | |
| *** stendulker_ has quit IRC | 18:01 | |
| *** vinsh has joined #tripleo | 18:03 | |
| *** daneyon has joined #tripleo | 18:05 | |
| *** regebro has quit IRC | 18:07 | |
| SpamapS | bnemec: devtest isn't strictly intended as a production tool.. but testing as close to production as possible is important. :) | 18:10 |
| *** athomas has quit IRC | 18:11 | |
| bnemec | SpamapS: Well, as I understand it one of our original tenets was production defaults in devtest. Which I always felt was somewhat of a contradiction, but it is what it is I guess. :-) | 18:12 |
| SpamapS | bnemec: stackuser shouldn't be there then. :) | 18:12 |
| * SpamapS wonders if it may have been removed when he wasn't looking | 18:12 | |
| bnemec | Not that I know of. | 18:13 |
| bnemec | And like I said, I always found requiring production defaults in a tool called DevTest sort of weird. | 18:13 |
| openstackgerrit | Ana Krivokapic proposed openstack/tuskar-ui: Auto-discover missing node parameters by default https://review.openstack.org/152219 | 18:13 |
| SpamapS | bnemec: I do too. If we wrote that down somewhere, we should unwrite it. | 18:14 |
| SpamapS | bnemec: what we actually need is a production installer that devtest calls with dev/test harnesses attached. :-P | 18:14 |
| bnemec | I am inclined to agree. :-) | 18:15 |
| SpamapS | The Helion team did some work to split things out like that. But I'm not sure if it ever got pushed anywhere consumable beyond inclusion in Helion community edition. | 18:18 |
| openstackgerrit | Merged stackforge/tripleo-ansible: Update online update for newer Ansible and base playbooks https://review.openstack.org/151305 | 18:19 |
| *** akrivoka has quit IRC | 18:20 | |
| *** jp_at_hp has quit IRC | 18:21 | |
| *** ChuckC has joined #tripleo | 18:21 | |
| *** ChuckC_ has quit IRC | 18:24 | |
| *** dsneddon has quit IRC | 18:27 | |
| *** ChuckC has quit IRC | 18:28 | |
| *** Marga_ has quit IRC | 18:30 | |
| *** eghobo has joined #tripleo | 18:33 | |
| *** dshulyak has joined #tripleo | 18:36 | |
| *** Marga_ has joined #tripleo | 18:38 | |
| *** ChuckC has joined #tripleo | 18:47 | |
| *** daneyon has quit IRC | 18:54 | |
| tchaypo | SpamapS: my understanding is that there was some background work happening to tidy up some prerequisites so that the installer could be pushed to stackforge, but I don’t know how that got. | 18:56 |
| *** daneyon has joined #tripleo | 18:56 | |
| tchaypo | I’ve been sitting back because it seemed other people were driving that, but if we don’t have news about it by seattle it might be time for me to dive in and start pushing it | 18:57 |
| tchaypo | Actually, maybe that should go on the seattle agenda - what would an installer look like? | 18:57 |
| SpamapS | tchaypo: indeed. | 18:57 |
| tchaypo | if the thing helion already has matches that we can push it; if not, we can start working on a different installer. | 18:57 |
| SpamapS | I didn't look too closely at it but for obvious reasons it split build and deploy out. | 18:59 |
| *** daneyon_ has joined #tripleo | 19:00 | |
| *** ChuckC has quit IRC | 19:01 | |
| *** ChuckC has joined #tripleo | 19:02 | |
| *** daneyon has quit IRC | 19:03 | |
| *** daneyon has joined #tripleo | 19:03 | |
| *** chuckC_ has joined #tripleo | 19:04 | |
| *** dprince has quit IRC | 19:06 | |
| *** daneyon_ has quit IRC | 19:06 | |
| *** pelix has quit IRC | 19:09 | |
| *** sdake_ has quit IRC | 19:16 | |
| *** daneyon_ has joined #tripleo | 19:22 | |
| *** ChuckC has quit IRC | 19:23 | |
| *** daneyon__ has joined #tripleo | 19:24 | |
| *** daneyon__ has quit IRC | 19:24 | |
| *** daneyon__ has joined #tripleo | 19:25 | |
| *** EmilienM is now known as EmilienM|afk | 19:25 | |
| *** daneyon has quit IRC | 19:26 | |
| *** dsneddon has joined #tripleo | 19:27 | |
| *** daneyon_ has quit IRC | 19:27 | |
| *** daneyon__ has quit IRC | 19:29 | |
| *** daneyon has joined #tripleo | 19:30 | |
| TheJulia | so I've been thinking about keepalived, and actually just removing the hup cron job causes things to behave far better on update, infact, hasn't failed me yet with the current version since I pulled the cron job out of my local branch. I have also wondered if we should NOT be starting keepalived on boot, which would actually completely remove the issue at hand, the only thing that would need to be done is to detail that it needs to be treated like MySQL | 19:31 |
| TheJulia | err, SpamapS ^^^^ | 19:31 |
| *** dprince has joined #tripleo | 19:32 | |
| *** Marga_ has quit IRC | 19:34 | |
| *** Marga_ has joined #tripleo | 19:35 | |
| *** penick has joined #tripleo | 19:35 | |
| *** Marga_ has quit IRC | 19:38 | |
| gfidente | TheJulia, I might have missed something here, what is the cron job you mentioning about keepalived? | 19:38 |
| *** Marga__ has joined #tripleo | 19:38 | |
| TheJulia | gfidente: there is a cron job that executes every 5 minutes and sends a hup to keepalived | 19:38 |
| *** Marga__ has quit IRC | 19:39 | |
| *** Marga_ has joined #tripleo | 19:39 | |
| gfidente | which element is installing that? and what is the purpose of it? | 19:42 |
| *** Marga_ has quit IRC | 19:43 | |
| TheJulia | Seems prudent to remove it given keepalived apparently can loose the file handlers when its hupped. | 19:43 |
| *** Marga_ has joined #tripleo | 19:43 | |
| TheJulia | gfidente: the keepalived element, Basically as a partial fix for the bug I'm looking at https://bugs.launchpad.net/tripleo/+bug/1367742 | 19:44 |
| TempLPBugBot` | Launchpad bug 1367742 in tripleo "keepalived brings the VIP up in multiple places on a controller reboot" (affected: 3, heat: 14) [High,Triaged] - Assigned to Julia Kreger (juliaashleykreger) | 19:44 |
| *** Marga_ has quit IRC | 19:45 | |
| *** Marga_ has joined #tripleo | 19:46 | |
| *** EmilienM|afk is now known as EmilienM | 19:50 | |
| greghaynes | TheJulia: do you mean just start it as a result of o-r-c? | 19:51 |
| *** daneyon_ has joined #tripleo | 19:53 | |
| TheJulia | greghaynes: not really, I'm thinking if x node rebooted, do I really want a VIP address jumping back to it as soon as it is partially back online | 19:53 |
| *** Marga_ has quit IRC | 19:54 | |
| greghaynes | well, you want to wait for it to be fully up but then yes | 19:54 |
| *** Marga_ has joined #tripleo | 19:54 | |
| greghaynes | you want that to be an option, otherwise updates are a problem | 19:54 |
| *** eghobo has quit IRC | 19:54 | |
| TheJulia | granted, haproxy should be operational, but then all sorts of undesirable things can happen | 19:55 |
| TheJulia | greghaynes: how so are updates a problem? | 19:55 |
| greghaynes | if youre turning everything on and off it has to be able to fail back | 19:55 |
| greghaynes | I guess im wondering, what are you proposing it gets started by? | 19:56 |
| TheJulia | greghaynes: yes, but like mysql, at least with tripleo-ansible, we explicitly bring the VIP online. o-r-c would start it up otherwise | 19:56 |
| *** daneyon has quit IRC | 19:56 | |
| greghaynes | ah, so yes just run it from o-r-c? | 19:57 |
| TheJulia | o-r-c if it gets run by hand, somebody would also need to bring mysql back online on the node for o-r-c to complete after a reboot | 19:57 |
| TheJulia | s/somebody/something/ | 19:57 |
| *** daneyon_ has quit IRC | 19:58 | |
| *** Marga_ has quit IRC | 19:59 | |
| *** daneyon has joined #tripleo | 20:01 | |
| greghaynes | SpamapS: You were messing with the whole 'how to figure out where ephemeral comes from' problem: https://blueprints.launchpad.net/nova/+spec/nova-ephemeral-cinder | 20:02 |
| greghaynes | http://logs.openstack.org/77/93077/5/check-tripleo/check-tripleo-ironic-overcloud-f20-nonha/4ae4714/console.html is an odd fail | 20:05 |
| TheJulia | Looks like the author proposed | 20:06 |
| TheJulia | err | 20:06 |
| TheJulia | the author abandoned his proposed spec | 20:06 |
| greghaynes | TheJulia: yep, there was talk about working on that for L though | 20:06 |
| greghaynes | er, resurrecting | 20:06 |
| TheJulia | ahh | 20:06 |
| *** spzala_ has joined #tripleo | 20:07 | |
| *** spzala has quit IRC | 20:08 | |
| *** spzala_ is now known as spzala | 20:08 | |
| greghaynes | TheJulia: If im reading your bug correctly, keepalived crashes when failing over is the issue now? | 20:12 |
| TheJulia | crashes is a bad way to put it, it fails to remove the VIP | 20:12 |
| greghaynes | ah | 20:13 |
| greghaynes | well, that is literally the only task we use keepalived for, removing the vip when it adds it somewhere else | 20:13 |
| greghaynes | "You had one job, keepalived" | 20:13 |
| TheJulia | yup | 20:13 |
| *** dprince has quit IRC | 20:13 | |
| TheJulia | I'm going to make more coffee and I'll propose a fix | 20:14 |
| greghaynes | TheJulia: have you seen the 1.2.13 release nodes that reference this issue? | 20:15 |
| TheJulia | greghaynes: I read the section, except I've seen the same issue with 1.2.13 | 20:15 |
| greghaynes | aye, no luck for us then | 20:16 |
| TheJulia | yeah... I was hoping 1.2.13 would do it, but then realized... "we're doing it to ourselves!" | 20:16 |
| *** dshulyak has quit IRC | 20:17 | |
| greghaynes | oh, so whats happening is it is failing over too early? | 20:17 |
| * greghaynes is still not 100% clear on whats going on | 20:17 | |
| greghaynes | I think theres like 3 different issues that bug hits on | 20:18 |
| *** pensu has quit IRC | 20:21 | |
| TheJulia | greghaynes: so the case the bug is encountered is upon reboot, or potentially cause it to activate so network segmentation would also now cause it (due to the cron job that was attempted as a partial fix). I can basically reproduce it by bringing two nodes back online in rapid succession from a reboot. They end up stealing the vip from the working controller, and one if it has been hupped, looses it's handle when a few minutes later the 3rd controller's | 20:22 |
| *** pradk has joined #tripleo | 20:22 | |
| greghaynes | (you cut off at 'the 3rd controller's') | 20:22 |
| TheJulia | later the 3rd controller's keepalived fires up and steals the vip. | 20:24 |
| greghaynes | by lose its handle you mean the IP_DROP_MEMBERSHIP fail? | 20:24 |
| TheJulia | the other conundrum is if os-r-c runs a number of times, and keeps hupping it since we can't actually restart it. | 20:24 |
| TheJulia | greghaynes: yup | 20:24 |
| TheJulia | if you go dig in the code, it is lacking the file handler to netlink | 20:25 |
| TheJulia | and returns that message | 20:25 |
| *** Marga_ has joined #tripleo | 20:25 | |
| greghaynes | Awesome, you said you see it in coordination with the sighupping? :/ | 20:27 |
| TheJulia | yup | 20:27 |
| *** pensu has joined #tripleo | 20:28 | |
| greghaynes | weve reached the point where my searching for keepalived issues brings up our own bug reports | 20:29 |
| greghaynes | this is a bad place | 20:29 |
| *** Marga_ has quit IRC | 20:30 | |
| SpamapS | greghaynes: /win 31 | 20:31 |
| SpamapS | greghaynes: aye (reading the ephemeral thing) | 20:31 |
| greghaynes | SpamapS: I cant handle that much win | 20:31 |
| SpamapS | also #irssifail | 20:31 |
| SpamapS | greghaynes: oh you couldn't handle my irssi then. my irssi has 100 win. | 20:32 |
| * TheJulia is up to 34 at the moment... :) | 20:32 | |
| greghaynes | when I hit triple digits that kicks off my gc routine | 20:32 |
| greghaynes | TheJulia: our ovs stuff, is that something we are configuring via stuff we kick off in o-r-c? im curious how asynchronous that is | 20:33 |
| greghaynes | seems like better waiting for the ovs config to be applied before kicking off keepalived would solve most of this | 20:33 |
| *** daneyon_ has joined #tripleo | 20:34 | |
| greghaynes | im guessing its pretty async so well have to wait_for ifconfig | grep stuff or similar | 20:34 |
| TheJulia | greghaynes: I think in part yes, I stored records for that on DVDs so I'll need to have the vault technician put those in the autochanger | 20:35 |
| greghaynes | hah | 20:35 |
| stevebaker | SpamapS, StevenK: I've raised a heat doc bug, feel free to add to it https://bugs.launchpad.net/openstack-manuals/+bug/1417260 | 20:35 |
| TempLPBugBot` | Launchpad bug 1417260 in openstack-manuals "Install guide for heat is missing section on Stack Domain Users" (affected: 1, heat: 6) [Undecided,New] | 20:35 |
| greghaynes | it still wouldnt fix the fact that we assume the network is reliable, but thats a separate bug IMO | 20:36 |
| TheJulia | yeah | 20:36 |
| SpamapS | stevebaker: oh thank you! I actually started digging into where to add that and got distracted | 20:37 |
| *** dprince has joined #tripleo | 20:37 | |
| TheJulia | greghaynes: part of my brain is a little scrabbled because I looked at related issues in helion with-in the past couple months... coffee will help the autochanger work faster :) | 20:37 |
| *** daneyon has quit IRC | 20:37 | |
| greghaynes | oh fun | 20:38 |
| * greghaynes also handles a SIGNEEDCOFFEE interrupt | 20:38 | |
| *** ChuckC has joined #tripleo | 20:57 | |
| *** dprince has quit IRC | 21:00 | |
| *** eghobo has joined #tripleo | 21:05 | |
| *** jprovazn has quit IRC | 21:05 | |
| TheJulia | greghaynes: The downstream issue that my mind was thinking of had a similar root cause in networking initialization, but the idea of just waiting for the interface to come up by checking for keepalived.keepalive_interface to be up. A wait_for on $(ip link | grep $(os-apply-config --key keepalived.keepalive_interface --key-default 'NO_MATCH' --type raw)|grep -q "UP") seems like it would work | 21:09 |
| harmw | guys, if I configure enabled_drivers = fake_pxe in /etc/ironic/ironic.conf where/how would I see the result? | 21:12 |
| harmw | i was expecting to see it reflected in the dropdown when registering new nodes | 21:13 |
| *** cody-somerville has joined #tripleo | 21:15 | |
| *** cody-somerville has joined #tripleo | 21:15 | |
| SpamapS | greghaynes: I read that as "sigh, need coffee" | 21:20 |
| daneyon_ | http://wwwin.cisco.com/learning/GlobalPrograms/newhire/ | 21:21 |
| *** dshulyak has joined #tripleo | 21:25 | |
| *** Marga_ has joined #tripleo | 21:26 | |
| *** Marga_ has quit IRC | 21:31 | |
| *** cody-somerville has quit IRC | 21:39 | |
| *** Marga_ has joined #tripleo | 21:41 | |
| *** rhallisey has quit IRC | 21:44 | |
| *** gfidente has quit IRC | 21:45 | |
| *** pensu has quit IRC | 21:45 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-incubator: Use cloneable tripleo-puppet-elements git link https://review.openstack.org/152288 | 21:53 |
| *** dshulyak has quit IRC | 21:57 | |
| openstackgerrit | James Slagle proposed openstack/tripleo-incubator: Use cloneable tripleo-puppet-elements git link https://review.openstack.org/152288 | 21:59 |
| *** untriaged-bot has joined #tripleo | 22:00 | |
| untriaged-bot | Untriaged bugs so far: | 22:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1416180 | 22:00 |
| TempLPBugBot` | Launchpad bug 1416180 in diskimage-builder "Grub install fails for Debian Wheezy on Centos 7" (affected: 1, heat: 6) [Undecided,New] | 22:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1396854 | 22:00 |
| TempLPBugBot` | Launchpad bug 1396854 in tripleo "fail to create an instance with specific ip" (affected: 5, heat: 22) [Undecided,In progress] - Assigned to Jerry Zhao (zhaoxinyu) | 22:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1415674 | 22:00 |
| TempLPBugBot` | Launchpad bug 1415674 in tripleo "tripleo rabbitmq logrotate broken" (affected: 1, heat: 6) [Undecided,New] | 22:00 |
| untriaged-bot | https://bugs.launchpad.net/tripleo/+bug/1409583 | 22:00 |
| TempLPBugBot` | Launchpad bug 1409583 in tripleo "overcloud controller os-refresh-config abort because haproxy horizon failed to bind socket" (affected: 1, heat: 6) [Undecided,New] | 22:00 |
| untriaged-bot | https://bugs.launchpad.net/tuskar/+bug/1387487 | 22:00 |
| TempLPBugBot` | Launchpad bug 1387487 in tuskar " tripleo-image-elements/elements/tuskar-ui /os-refresh-config /post-configure.d/101-tuskar-ui needs authentication from Keystone" (affected: 1, heat: 6) [Undecided,New] | 22:00 |
| untriaged-bot | https://bugs.launchpad.net/diskimage-builder/+bug/1415240 | 22:00 |
| TempLPBugBot` | Launchpad bug 1415240 in diskimage-builder "package-install-v2 breaks older distros" (affected: 1, heat: 6) [Undecided,New] - Assigned to John Dewey (retr0h) | 22:00 |
| *** untriaged-bot has quit IRC | 22:00 | |
| *** penick has quit IRC | 22:01 | |
| *** spzala has quit IRC | 22:02 | |
| *** daneyon_ has quit IRC | 22:05 | |
| *** spzala has joined #tripleo | 22:09 | |
| *** pradeep1 has joined #tripleo | 22:12 | |
| *** pradeep has quit IRC | 22:12 | |
| *** rlandy has quit IRC | 22:13 | |
| *** anderbubble has joined #tripleo | 22:15 | |
| *** anderbubble has quit IRC | 22:15 | |
| *** anderbubble has joined #tripleo | 22:22 | |
| anderbubble | I have been directed to post in here by #openstack-ironic regarding a problem I’m having with an image generated by `disk-image-create centos7 baremetal -o my-image` | 22:23 |
| *** jtomasek has quit IRC | 22:24 | |
| anderbubble | my node has no eth0; its first network interface is eno1; but the built image only contains configuration for eth0, causing network startup to fail, and cloud-init to fail | 22:24 |
| anderbubble | what is the correct way to get my image to have correct network interface configuration? | 22:25 |
| dsneddon | anderbubble, If you can find a way to modify the bootstring to include net.ifnames=0 that will revert to the eth0 naming scheme | 22:28 |
| anderbubble | dsneddon, but how can I direct the image to use the current naming scheme? Can I do this by mixing in a new element during disk-image-create? | 22:29 |
| dsneddon | anderbubble, I don't know how to do that | 22:30 |
| *** pradeep has joined #tripleo | 22:30 | |
| *** pradeep1 has quit IRC | 22:30 | |
| anderbubble | dsneddon, do you know how the image decides how to configure network? or does it just have a static eth0 in it? | 22:31 |
| dsneddon | anderbubble, It's got a static reference to eth0, unfortunately | 22:31 |
| dsneddon | At least, I'm pretty sure based on dev chatter that I've observed on the subject. | 22:32 |
| dsneddon | anderbubble, Another option is to inject DEVICE=eth0 into the ifcfg file with the HWADDR, that will use the name specified by DEVICE=. | 22:35 |
| anderbubble | sure; but if I could manipulate the eth0 file, I could probably also create the eno1 file I need | 22:36 |
| *** noslzzp has quit IRC | 22:36 | |
| anderbubble | looks like the dhcp-all-interfaces element will do what I want | 22:36 |
| anderbubble | so now I’m trying `disk-image-create centos7 baremetal dhcp-all-interfaces -o centos7-dhcp-all` | 22:37 |
| *** noslzzp has joined #tripleo | 22:39 | |
| *** jang2 has quit IRC | 22:42 | |
| *** daneyon has joined #tripleo | 22:43 | |
| *** weshay has quit IRC | 22:44 | |
| *** lblanchard has quit IRC | 22:53 | |
| SpamapS | anybody know who John Dewey and Shane Gibson are? | 23:05 |
| *** daneyon_ has joined #tripleo | 23:08 | |
| *** daneyon has quit IRC | 23:11 | |
| *** chlong has joined #tripleo | 23:11 | |
| *** sdake_ has joined #tripleo | 23:14 | |
| sdake_ | daneyon_ around? | 23:14 |
| daneyon_ | hey, i just hopped off the webex | 23:14 |
| daneyon_ | how's it going? | 23:14 |
| sdake_ | good | 23:14 |
| sdake_ | i dont see you on the webex | 23:14 |
| sdake_ | let me reconnect | 23:15 |
| sdake_ | oh you siad hopped off | 23:15 |
| sdake_ | sorry, been struggling with irc working at same time as vpn | 23:16 |
| sdake_ | I guess lets reschedule to tomorrow afternoon? | 23:16 |
| sdake_ | i knod o fwanted to test out the audio/vdieo | 23:16 |
| sdake_ | can you join real quick so we can test that out? | 23:17 |
| daneyon_ | ya, one sec | 23:18 |
| *** andreaf has joined #tripleo | 23:19 | |
| sdake_ | can'thear me? | 23:20 |
| *** penick has joined #tripleo | 23:20 | |
| sdake_ | i can hear you but i think you can't hear me | 23:20 |
| *** anderbubble has quit IRC | 23:33 | |
| *** sdake_ has quit IRC | 23:33 | |
| *** pradk has quit IRC | 23:33 | |
| *** cody-somerville has joined #tripleo | 23:34 | |
| *** cody-somerville has joined #tripleo | 23:34 | |
| *** derekh has joined #tripleo | 23:39 | |
| derekh | Redeploying hp1 testenvs for 64bit VMs | 23:39 |
| *** derekh changes topic to "Mid-cycle meetup Feb 18 - 20 in Seattle http://bit.ly/1AiNuMK | Using OpenStack to deploy OpenStack; meetings Tuesday 1900/0800 UTC in #openstack-meeting-alt" | 23:46 | |
| *** ralala has quit IRC | 23:48 | |
| openstackgerrit | Derek Higgins proposed openstack-infra/tripleo-ci: Remove tempreverts https://review.openstack.org/152343 | 23:50 |
| *** andreaf has quit IRC | 23:52 | |
| *** noslzzp has quit IRC | 23:53 | |
| *** tserong has joined #tripleo | 23:55 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!