| *** esberglu has joined #openstack-powervm | 00:10 | |
| *** esberglu has quit IRC | 00:15 | |
| *** edmondsw has joined #openstack-powervm | 00:19 | |
| *** edmondsw has quit IRC | 00:24 | |
| *** thorst has joined #openstack-powervm | 00:49 | |
| *** thorst has quit IRC | 00:50 | |
| *** edmondsw has joined #openstack-powervm | 02:07 | |
| *** edmondsw has quit IRC | 02:12 | |
| *** svenkat has joined #openstack-powervm | 02:13 | |
| *** svenkat has quit IRC | 02:30 | |
| *** thorst has joined #openstack-powervm | 02:51 | |
| *** thorst has quit IRC | 02:59 | |
| *** jwcroppe has joined #openstack-powervm | 03:24 | |
| *** chhavi has joined #openstack-powervm | 03:37 | |
| *** chhavi has quit IRC | 03:53 | |
| *** edmondsw has joined #openstack-powervm | 03:55 | |
| *** edmondsw has quit IRC | 04:00 | |
| *** jwcroppe has quit IRC | 04:12 | |
| *** jwcroppe has joined #openstack-powervm | 04:12 | |
| *** edmondsw has joined #openstack-powervm | 05:43 | |
| *** edmondsw has quit IRC | 05:48 | |
| *** thorst has joined #openstack-powervm | 05:56 | |
| *** thorst has quit IRC | 06:01 | |
| *** k0da has joined #openstack-powervm | 06:30 | |
| *** jay1_ has joined #openstack-powervm | 06:31 | |
| *** jwcroppe has quit IRC | 06:32 | |
| *** k0da has quit IRC | 07:12 | |
| *** edmondsw has joined #openstack-powervm | 07:31 | |
| *** edmondsw has quit IRC | 07:36 | |
| *** thorst has joined #openstack-powervm | 07:57 | |
| *** thorst has quit IRC | 08:02 | |
| *** k0da has joined #openstack-powervm | 08:23 | |
| *** openstackgerrit has quit IRC | 08:49 | |
| *** edmondsw has joined #openstack-powervm | 09:19 | |
| *** edmondsw has quit IRC | 09:24 | |
| *** thorst has joined #openstack-powervm | 09:58 | |
| *** thorst has quit IRC | 10:03 | |
| *** edmondsw has joined #openstack-powervm | 11:07 | |
| *** edmondsw has quit IRC | 11:12 | |
| *** jay1_ has quit IRC | 11:17 | |
| *** edmondsw has joined #openstack-powervm | 11:30 | |
| *** smatzek has joined #openstack-powervm | 11:38 | |
| *** thorst has joined #openstack-powervm | 12:02 | |
| *** thorst_ has joined #openstack-powervm | 12:04 | |
| *** thorst has quit IRC | 12:06 | |
| *** svenkat has joined #openstack-powervm | 12:09 | |
| *** svenkat_ has joined #openstack-powervm | 12:13 | |
| *** svenkat has quit IRC | 12:13 | |
| *** svenkat_ is now known as svenkat | 12:13 | |
| *** miltonm has joined #openstack-powervm | 12:46 | |
| *** kylek3h has joined #openstack-powervm | 12:51 | |
| *** jay1_ has joined #openstack-powervm | 12:52 | |
| *** apearson has joined #openstack-powervm | 13:05 | |
| *** esberglu has joined #openstack-powervm | 13:09 | |
| *** apearson has quit IRC | 14:00 | |
| *** apearson has joined #openstack-powervm | 14:01 | |
| *** apearson has quit IRC | 14:01 | |
| *** apearson has joined #openstack-powervm | 14:02 | |
| *** apearson has quit IRC | 14:03 | |
| *** jwcroppe has joined #openstack-powervm | 14:07 | |
| esberglu | edmondsw: efried: thorst_: CI is limping along with the six systems that are still up. I'm reinstalling neo 6,7,8 and 11 | 14:08 |
|---|---|---|
| esberglu | Can't connect to the neo or fsp for neo 26, 27, 28, and 30 | 14:08 |
| edmondsw | esberglu what happened? | 14:08 |
| esberglu | No idea the ssp for 6-11 got destroyed somehow and a bunch of stuff wasn't working | 14:08 |
| esberglu | No sure about the other 4 | 14:09 |
| esberglu | *not | 14:09 |
| esberglu | Apparently 26 - 30 were down for a week but I didn't notice because the rest of the systems were picking up the slack | 14:10 |
| esberglu | But then the ssp died for the other group and that's when I saw that those were down as well | 14:10 |
| efried | esberglu I'm about to stack a new node. Any tips/tricks before I do? | 14:20 |
| efried | AIO local.conf from powervm-ci still the best starting point? | 14:20 |
| esberglu | efried: Yep | 14:21 |
| esberglu | Make sure you run | 14:21 |
| esberglu | https://github.com/powervm/powervm-ci/blob/master/devstack/prep_devstack.sh#L185-L188 | 14:21 |
| esberglu | Those 4 lines before you stack | 14:21 |
| esberglu | And you should be good to go | 14:21 |
| efried | esberglu Where's the 2G image live? | 14:29 |
| esberglu | efried: DM'ed | 14:30 |
| thorst_ | esberglu: I think there were some fun network issues in the lab | 14:31 |
| thorst_ | though I think they're resolved now...wonder if that was the cause | 14:32 |
| *** smatzek has quit IRC | 14:37 | |
| edmondsw | esberglu is there something we can do differently where we would have noticed 26-30 were down earlier, so failures don't pile up like this? | 14:38 |
| *** tjakobs has joined #openstack-powervm | 14:38 | |
| esberglu | edmondsw: I'm sure there must be a way to set up email notifications | 14:39 |
| esberglu | I'll take a look after I get the systems back up | 14:39 |
| edmondsw | I'll throw something on your TODO list | 14:39 |
| *** apearson has joined #openstack-powervm | 14:47 | |
| *** apearson has quit IRC | 14:52 | |
| *** jay1_ has quit IRC | 14:59 | |
| *** smatzek has joined #openstack-powervm | 15:02 | |
| *** apearson has joined #openstack-powervm | 15:10 | |
| *** k0da has quit IRC | 15:27 | |
| *** efried has quit IRC | 16:59 | |
| *** efried has joined #openstack-powervm | 17:11 | |
| *** apearson has joined #openstack-powervm | 17:29 | |
| esberglu | thorst_: edmondsw: 6 - 11 are back up with an ssp. I rebooted 26 - 30 and have access again | 17:40 |
| esberglu | But 26-30 are showing the ssp cluster on the vios, however on the neo it says it failed to find any ssp entries | 17:41 |
| esberglu | Any ideas on how to resolve | 17:41 |
| esberglu | Apparently "cluster -sync" does the trick | 18:02 |
| esberglu | CI is coming down while I redeploy with all of the systems. Should be back up by EOD unless something weird happens. | 18:03 |
| esberglu | I redeployed staging last night with no issues so I'm not expecting problems | 18:03 |
| edmondsw | esberglu ack, tx | 18:11 |
| *** apearson has quit IRC | 18:16 | |
| *** apearson has joined #openstack-powervm | 18:17 | |
| *** efried is now known as efried_lunch | 18:23 | |
| *** openstackgerrit has joined #openstack-powervm | 18:37 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/networking-powervm master: Updated from global requirements https://review.openstack.org/485318 | 18:37 |
| *** jay1_ has joined #openstack-powervm | 18:38 | |
| *** apearson has quit IRC | 18:58 | |
| *** kjw3 has joined #openstack-powervm | 19:11 | |
| *** k0da has joined #openstack-powervm | 19:23 | |
| *** jay1_ has quit IRC | 19:27 | |
| *** apearson has joined #openstack-powervm | 19:48 | |
| *** kjw3 has quit IRC | 19:49 | |
| *** efried_lunch is now known as efried | 19:59 | |
| *** thorst_ has quit IRC | 20:07 | |
| *** thorst has joined #openstack-powervm | 20:10 | |
| *** thorst has quit IRC | 20:14 | |
| *** apearson has quit IRC | 20:25 | |
| *** smatzek has quit IRC | 20:25 | |
| *** kylek3h has quit IRC | 21:02 | |
| *** esberglu has quit IRC | 21:02 | |
| *** thorst has joined #openstack-powervm | 21:14 | |
| *** esberglu has joined #openstack-powervm | 21:14 | |
| *** thorst has quit IRC | 21:19 | |
| *** jwcroppe has quit IRC | 21:22 | |
| *** jwcroppe has joined #openstack-powervm | 21:23 | |
| *** thorst has joined #openstack-powervm | 21:25 | |
| *** jwcroppe has quit IRC | 21:28 | |
| *** jwcroppe has joined #openstack-powervm | 21:29 | |
| *** svenkat has quit IRC | 21:37 | |
| *** svenkat has joined #openstack-powervm | 21:39 | |
| *** apearson has joined #openstack-powervm | 21:41 | |
| *** svenkat has quit IRC | 21:41 | |
| *** tjakobs has quit IRC | 21:48 | |
| *** jwcroppe has quit IRC | 21:51 | |
| *** tjakobs has joined #openstack-powervm | 22:08 | |
| *** jwcroppe has joined #openstack-powervm | 22:08 | |
| *** svenkat has joined #openstack-powervm | 22:13 | |
| *** apearson has quit IRC | 22:29 | |
| *** tjakobs has quit IRC | 22:38 | |
| *** edmondsw has quit IRC | 22:40 | |
| *** k0da has quit IRC | 22:42 | |
| *** jwcroppe has quit IRC | 22:45 | |
| *** jwcroppe has joined #openstack-powervm | 22:46 | |
| *** jwcroppe has quit IRC | 22:51 | |
| *** jwcroppe has joined #openstack-powervm | 22:54 | |
| *** thorst has quit IRC | 22:56 | |
| *** jwcroppe has quit IRC | 23:29 | |
| *** jwcroppe has joined #openstack-powervm | 23:29 | |
| *** esberglu has quit IRC | 23:33 | |
| *** jwcroppe has quit IRC | 23:33 | |
| *** esberglu has joined #openstack-powervm | 23:33 | |
| *** esberglu has quit IRC | 23:33 | |
| *** edmondsw has joined #openstack-powervm | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!