| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras: Modify OVB role to work with non-ready undercloud images https://review.openstack.org/412567 | 00:04 |
|---|---|---|
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras: Modify OVB role to work with non-ready undercloud images https://review.openstack.org/412567 | 00:11 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras: Modify OVB role to work with non-ready undercloud images https://review.openstack.org/412567 | 00:12 |
| *** Goneri has joined #tripleo | 00:15 | |
| *** ebarrera has quit IRC | 00:17 | |
| *** Goneri has quit IRC | 00:27 | |
| *** limao has joined #tripleo | 00:47 | |
| *** rlandy has quit IRC | 01:04 | |
| *** palmertime has quit IRC | 01:37 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras: Modify OVB role to work with non-ready undercloud images https://review.openstack.org/412567 | 01:37 |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras: Modify OVB role to work with non-ready undercloud images https://review.openstack.org/412567 | 01:37 |
| leifmadsen | Feedback welcome: http://blog.leifmadsen.com/blog/2016/12/28/create-a-virtual-undercloud-with-tripleo-quickstart/ | 01:38 |
| *** noslzzp has quit IRC | 01:57 | |
| *** bana_k has joined #tripleo | 02:12 | |
| *** ramishra has joined #tripleo | 02:40 | |
| *** limao has quit IRC | 02:57 | |
| *** limao_ has joined #tripleo | 02:57 | |
| *** limao_ has quit IRC | 03:02 | |
| *** limao has joined #tripleo | 03:02 | |
| *** bana_k has quit IRC | 03:09 | |
| *** bkopilov has quit IRC | 03:10 | |
| *** bana_k has joined #tripleo | 03:11 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: WIP Add centos7 mirror https://review.openstack.org/415584 | 03:21 |
| *** links has joined #tripleo | 03:22 | |
| *** abregman has joined #tripleo | 03:40 | |
| *** jeckersb_gone has quit IRC | 03:44 | |
| *** jeckersb_gone has joined #tripleo | 03:44 | |
| *** radez has quit IRC | 03:44 | |
| *** radez has joined #tripleo | 03:44 | |
| *** jayg|g0n3 has quit IRC | 03:44 | |
| *** jayg|g0n3 has joined #tripleo | 03:45 | |
| *** Goneri has joined #tripleo | 03:46 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: WIP Add centos7 mirror https://review.openstack.org/415584 | 03:52 |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: WIP Add centos7 mirror https://review.openstack.org/415584 | 04:25 |
| *** limao has quit IRC | 04:25 | |
| *** bkopilov has joined #tripleo | 04:27 | |
| *** gkadam has joined #tripleo | 04:29 | |
| *** prateek has joined #tripleo | 04:45 | |
| *** fragatina has quit IRC | 04:56 | |
| *** fragatina has joined #tripleo | 04:56 | |
| *** Goneri has quit IRC | 04:58 | |
| *** Goneri has joined #tripleo | 04:59 | |
| *** fragatina has quit IRC | 05:01 | |
| *** udesale has joined #tripleo | 05:10 | |
| openstackgerrit | Saravanan KR proposed openstack/tripleo-common: User provided pwd has to be merged for get_passwords workflow https://review.openstack.org/414099 | 05:38 |
| *** bana_k has quit IRC | 05:38 | |
| *** bana_k has joined #tripleo | 05:39 | |
| *** bana_k has quit IRC | 05:40 | |
| *** prateek_ has joined #tripleo | 05:46 | |
| *** prateek has quit IRC | 05:48 | |
| *** saneax-_-|AFK is now known as saneax | 06:09 | |
| *** masco has joined #tripleo | 06:27 | |
| *** bana_k has joined #tripleo | 06:42 | |
| *** rcernin has joined #tripleo | 06:53 | |
| *** pgadiya has joined #tripleo | 07:01 | |
| *** tesseract has joined #tripleo | 07:08 | |
| *** karthiks has quit IRC | 07:28 | |
| *** shinobu____ has quit IRC | 07:36 | |
| *** shinobu___ has joined #tripleo | 07:38 | |
| *** karthiks has joined #tripleo | 07:38 | |
| *** nyechiel_ has joined #tripleo | 08:06 | |
| -openstackstatus- NOTICE: All CI tests are currently broken since logs.openstack.org is down. Refrain from recheck or approval until this is fixed. | 08:20 | |
| *** ChanServ changes topic to "All CI tests are currently broken since logs.openstack.org is down. Refrain from recheck or approval until this is fixed." | 08:20 | |
| *** anshul has joined #tripleo | 08:28 | |
| *** nyechiel_ has quit IRC | 08:34 | |
| *** cylopez has joined #tripleo | 08:43 | |
| *** iranzo has joined #tripleo | 08:44 | |
| *** iranzo has joined #tripleo | 08:44 | |
| *** karthiks has quit IRC | 08:51 | |
| *** anshul has quit IRC | 08:52 | |
| *** zzzeek has quit IRC | 09:00 | |
| *** zzzeek has joined #tripleo | 09:00 | |
| *** pgadiya has quit IRC | 09:02 | |
| *** anshul has joined #tripleo | 09:04 | |
| *** nyechiel_ has joined #tripleo | 09:18 | |
| *** pgadiya has joined #tripleo | 09:18 | |
| *** abregman has quit IRC | 09:27 | |
| *** artom has quit IRC | 09:27 | |
| *** pgadiya has quit IRC | 09:31 | |
| *** pgadiya has joined #tripleo | 09:44 | |
| *** b00tcat has joined #tripleo | 10:16 | |
| *** bana_k has quit IRC | 10:23 | |
| *** bana_k has joined #tripleo | 10:24 | |
| *** bana_k has quit IRC | 10:24 | |
| *** tesseract has quit IRC | 10:25 | |
| *** tesseract has joined #tripleo | 10:26 | |
| *** apetrich has quit IRC | 10:30 | |
| *** d0ugal has quit IRC | 10:30 | |
| *** yolanda has quit IRC | 10:30 | |
| *** mrunge has quit IRC | 10:30 | |
| *** george_goh has quit IRC | 10:30 | |
| *** jroll has quit IRC | 10:30 | |
| *** akrzos has quit IRC | 10:30 | |
| *** fungi has quit IRC | 10:30 | |
| *** pcaruana has joined #tripleo | 10:31 | |
| *** apetrich has joined #tripleo | 10:36 | |
| *** d0ugal has joined #tripleo | 10:36 | |
| *** yolanda has joined #tripleo | 10:36 | |
| *** mrunge has joined #tripleo | 10:36 | |
| *** george_goh has joined #tripleo | 10:36 | |
| *** akrzos has joined #tripleo | 10:36 | |
| *** abregman has joined #tripleo | 10:38 | |
| *** jroll has joined #tripleo | 10:39 | |
| *** fungi has joined #tripleo | 10:39 | |
| *** fzdarsky has joined #tripleo | 10:58 | |
| *** saneax is now known as saneax-_-|AFK | 11:03 | |
| *** noslzzp has joined #tripleo | 11:11 | |
| *** ChanServ changes topic to "TripleO : http://tripleo.org/ | https://wiki.openstack.org/wiki/TripleO | Meetings On Tuesdays at 14:00 UTC in #openstack-meeting-alt" | 11:11 | |
| -openstackstatus- NOTICE: logs.openstack.org is up again. Feel free to recheck any failures. | 11:11 | |
| *** masco has quit IRC | 11:16 | |
| *** nyechiel_ has quit IRC | 11:17 | |
| *** pcaruana has quit IRC | 11:28 | |
| *** nyechiel_ has joined #tripleo | 11:29 | |
| *** nyechiel_ has quit IRC | 11:34 | |
| *** prateek_ has quit IRC | 11:54 | |
| openstackgerrit | Saravanan KR proposed openstack/os-net-config: Exclude SR-IOV VFs in the nic numbering https://review.openstack.org/415682 | 11:59 |
| *** bkopilov has quit IRC | 12:05 | |
| *** skramaja has quit IRC | 12:10 | |
| *** jkilpatr has joined #tripleo | 12:19 | |
| *** dbecker has joined #tripleo | 12:27 | |
| *** gkadam has quit IRC | 12:35 | |
| *** gkadam has joined #tripleo | 12:36 | |
| *** gkadam has quit IRC | 12:36 | |
| *** pgadiya has quit IRC | 12:48 | |
| *** sshnaidm has quit IRC | 12:58 | |
| *** sshnaidm has joined #tripleo | 12:59 | |
| *** bfournie has joined #tripleo | 13:08 | |
| *** david-lyle has joined #tripleo | 13:12 | |
| *** b00tcat has quit IRC | 13:12 | |
| *** david-lyle has quit IRC | 13:17 | |
| *** b00tcat has joined #tripleo | 13:39 | |
| *** b00tcat has quit IRC | 13:39 | |
| *** b00tcat has joined #tripleo | 13:39 | |
| *** jkilpatr has quit IRC | 13:44 | |
| *** bfournie has quit IRC | 13:58 | |
| *** jmelvin has joined #tripleo | 13:59 | |
| *** bkopilov has joined #tripleo | 14:07 | |
| *** liverpooler has quit IRC | 14:14 | |
| *** liverpooler has joined #tripleo | 14:14 | |
| *** links has quit IRC | 14:27 | |
| *** anshul has quit IRC | 14:28 | |
| *** jkilpatr has joined #tripleo | 14:35 | |
| *** iranzo has quit IRC | 14:40 | |
| *** jkilpatr has quit IRC | 14:42 | |
| *** jcoufal has joined #tripleo | 14:47 | |
| *** b00tcat has quit IRC | 15:00 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras: Add generic undercloud setup role https://review.openstack.org/406324 | 15:00 |
| *** palmertime has joined #tripleo | 15:00 | |
| openstackgerrit | Ronelle Landy proposed openstack/tripleo-quickstart-extras: Modify OVB role to work with non-ready undercloud images https://review.openstack.org/412567 | 15:01 |
| *** abregman is now known as abregman|brb | 15:29 | |
| *** udesale has quit IRC | 15:35 | |
| openstackgerrit | Itzik Brown proposed openstack/puppet-tripleo: Add the ml2_odl section when using opendalight_v2 https://review.openstack.org/415714 | 15:39 |
| openstackgerrit | Itzik Brown proposed openstack/tripleo-heat-templates: Setting networking-odl v2 as a mechanism driver https://review.openstack.org/415182 | 15:41 |
| *** abregman|brb is now known as abregman | 15:42 | |
| *** nyechiel_ has joined #tripleo | 15:43 | |
| *** jcoufal_ has joined #tripleo | 15:46 | |
| *** jcoufal__ has joined #tripleo | 15:49 | |
| *** jcoufal has quit IRC | 15:49 | |
| *** jcoufal_ has quit IRC | 15:52 | |
| *** nyechiel_ has quit IRC | 16:13 | |
| openstackgerrit | Paul Belanger proposed openstack/diskimage-builder: WIP Add centos7 mirror https://review.openstack.org/415584 | 16:13 |
| *** jcoufal has joined #tripleo | 16:14 | |
| *** jcoufal__ has quit IRC | 16:16 | |
| *** jcoufal_ has joined #tripleo | 16:18 | |
| *** jcoufal has quit IRC | 16:21 | |
| *** tesseract has quit IRC | 16:32 | |
| *** jcoufal has joined #tripleo | 16:36 | |
| *** jcoufal_ has quit IRC | 16:39 | |
| *** jcoufal_ has joined #tripleo | 16:50 | |
| *** jcoufal__ has joined #tripleo | 16:51 | |
| *** jcoufal has quit IRC | 16:52 | |
| *** jcoufal_ has quit IRC | 16:54 | |
| *** bana_k has joined #tripleo | 17:01 | |
| *** b00tcat has joined #tripleo | 17:04 | |
| palmertime | I'm having extremely different results when deploying an overcloud to baremetal. It is only having issues with hardware that is newer generation. As in a year old or less. From a remote console, as well as logs on the undercloud, I can see the systems boot, mount iSCSI, copy over the image and then reboot. Sometimes it will do the 3 or 4 times before setting the boot device to a disk. | 17:05 |
| palmertime | The last time i tried, after the 4th reboot it finally set the boot device to a disk but powered off an couldn't power it on. | 17:06 |
| palmertime | Here is the error i found in the ironic logs: https://gist.github.com/palmertime/318e359f138c3242bdd30e9ce4ad30f1 | 17:07 |
| openstackgerrit | Leif Madsen proposed openstack/tripleo-quickstart: Add ability to work with bridge interfaces direct https://review.openstack.org/414320 | 17:15 |
| leifmadsen | palmertime: multiple hard drives? | 17:16 |
| palmertime | leifmadsen: Yes, there are 2 per system but configured as a RAID1/Mirror. | 17:17 |
| leifmadsen | not sure this error really says much other than it couldn't turn the machine on with IPMI | 17:17 |
| palmertime | leifmadsen: I have tried to set the root disk by serial number and have had the same results | 17:17 |
| leifmadsen | anything pop up on the console of the overcloud nodes while it is trying to drop the image onto the drives? Did you make it past the introspection stage with everything set availables? | 17:19 |
| palmertime | leifmadsen: I have not noticed any errors on the console besides DHCP error on interfaces not being used by the install. Introspection work great and found everything with out error. | 17:20 |
| *** jcoufal has joined #tripleo | 17:21 | |
| palmertime | leifmadsen: Since that last error i have re deployed again and all systems have moved on to the configuration stage. 1 system installed 1st try and another took 3 reboots. | 17:22 |
| *** jcoufal__ has quit IRC | 17:23 | |
| palmertime | Fortunately, this is a small test environment with 2 nodes. I couldn't imagine doing this on 100+ node deployment. The odds of all nodes installing successfully is slim. | 17:24 |
| leifmadsen | palmertime: almost sounds like a timeout issue of some sort where something is taking a long time to boot? | 17:24 |
| palmertime | Hopefully, im doing something wrong. | 17:24 |
| leifmadsen | I've done 300 before, and that required some fancy baby sitting moves :) | 17:25 |
| *** jcoufal_ has joined #tripleo | 17:26 | |
| palmertime | leifmadsen: There are some extra devices in these systems as they have been repurposed for Openstack. I'll try to remove them and see if that gives more consistent results. | 17:26 |
| *** jcoufal has quit IRC | 17:27 | |
| palmertime | leifmadsen: Do you have any documentation publicly available of the baby sitting moves? :) | 17:28 |
| leifmadsen | yea, I think at this point you should watch the console of the failing nodes and find out why it might be failing, and then tail the logs on the undercloud to try and determine if it's a timeout issue, or what | 17:28 |
| leifmadsen | nothing right now, but let me look at my notes and see if I took enough to write something | 17:28 |
| leifmadsen | palmertime: ahh... the baby sitting was primarily around the introspection (this was OSP8 / Liberty), and my notes are mostly just to set the nodes back to maintenance mode and then introspect the failed nodes manually | 17:33 |
| leifmadsen | I've noticed introspection with OSP10 / TripleO Newton is *much* improved | 17:33 |
| leifmadsen | (I've also not had to deploy 300 nodes again :)) | 17:34 |
| leifmadsen | oh, actually I found the section I documented before | 17:35 |
| leifmadsen | palmertime: are you seeing nodes sitting in the WAIT-CALLBACK state until it eventually times out? | 17:35 |
| leifmadsen | basically, all these notes say, is that we watched for the WAIT-CALLBACK to exist for a UUID from 'ironic node-list' for a period of 6 cycles (each cycle has a sleep 30 wait), and if we we that, we had to manually reboot the node via the DRAC interface | 17:36 |
| leifmadsen | nothing too magical, just some older hardware that seemed to periodically get hung for whatever reason, but we were also doing 20-50 nodes at a time, and may have been overwhelming the undercloud resources | 17:37 |
| *** jcoufal has joined #tripleo | 17:42 | |
| *** jcoufal_ has quit IRC | 17:43 | |
| *** b00tcat has quit IRC | 17:58 | |
| *** rcernin has quit IRC | 18:14 | |
| *** Goneri has quit IRC | 18:19 | |
| palmertime | leifmadsen: Thanks for the info. | 18:21 |
| palmertime | Another step that seems to be consistently failing on is: resources.AllNodesDeploySteps.resources.ControllerDeployment_Step5.resources[0] | 18:22 |
| *** jcoufal_ has joined #tripleo | 18:22 | |
| palmertime | Where can i find out what this step is doing? | 18:22 |
| *** jcoufal has quit IRC | 18:23 | |
| *** nyechiel_ has joined #tripleo | 18:28 | |
| *** bana_k has quit IRC | 18:31 | |
| *** idlemind has joined #tripleo | 18:38 | |
| *** jcoufal_ has quit IRC | 18:39 | |
| leifmadsen | palmertime: you'll need to trace the tripleo heat templates | 18:39 |
| *** jcoufal has joined #tripleo | 18:39 | |
| leifmadsen | http://hardysteven.blogspot.ca/ | 18:39 |
| leifmadsen | there's a couple blog posts there about debugging heat issues | 18:39 |
| palmertime | leifmadsen: Great, thanks! I'll read through them. | 18:40 |
| *** idlemind has quit IRC | 18:50 | |
| *** abregman has quit IRC | 18:50 | |
| *** jmelvin has quit IRC | 19:02 | |
| *** jcoufal has quit IRC | 19:06 | |
| *** palmertime1 has joined #tripleo | 19:08 | |
| *** palmertime has quit IRC | 19:08 | |
| *** palmertime1 has quit IRC | 19:10 | |
| *** palmertime has joined #tripleo | 19:10 | |
| *** noslzzp has quit IRC | 19:12 | |
| *** shinobu___ has quit IRC | 19:13 | |
| *** jmelvin has joined #tripleo | 19:16 | |
| *** hogepodge has quit IRC | 19:39 | |
| *** rlandy has joined #tripleo | 19:49 | |
| *** Goneri has joined #tripleo | 20:20 | |
| *** rcernin has joined #tripleo | 20:25 | |
| openstackgerrit | Leif Madsen proposed openstack/tripleo-quickstart: Only deploy cloud when environment tag used https://review.openstack.org/415754 | 20:29 |
| *** nyechiel_ has quit IRC | 20:34 | |
| *** jmelvin has quit IRC | 20:45 | |
| *** Goneri has quit IRC | 20:48 | |
| openstackgerrit | Michele Baldessari proposed openstack/puppet-tripleo: WIP Make sure we bind the rabbit inter-cluster to a specific interface https://review.openstack.org/415757 | 20:53 |
| *** jmelvin has joined #tripleo | 20:54 | |
| *** jkilpatr has joined #tripleo | 20:56 | |
| *** jkilpatr has quit IRC | 21:04 | |
| *** shinobu___ has joined #tripleo | 21:13 | |
| *** cylopez has quit IRC | 21:16 | |
| *** noslzzp has joined #tripleo | 21:26 | |
| openstackgerrit | Leif Madsen proposed openstack/tripleo-quickstart: Update default libvirt role image path https://review.openstack.org/415759 | 21:36 |
| *** kbyrne has joined #tripleo | 21:36 | |
| *** Goneri has joined #tripleo | 21:45 | |
| *** bana_k has joined #tripleo | 21:51 | |
| *** bana_k has quit IRC | 22:07 | |
| *** yamahata has quit IRC | 22:16 | |
| openstackgerrit | Leif Madsen proposed openstack/tripleo-quickstart: Add ability to work with bridge interfaces direct https://review.openstack.org/414320 | 22:29 |
| *** palmertime has quit IRC | 22:40 | |
| *** jkilpatr has joined #tripleo | 22:47 | |
| *** rlandy has quit IRC | 23:16 | |
| *** limao has joined #tripleo | 23:18 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!