| *** chas has joined #openstack-powervm | 00:09 | |
| *** chas has quit IRC | 00:14 | |
| *** thorst has joined #openstack-powervm | 00:14 | |
| *** thorst has quit IRC | 00:15 | |
| *** thorst has joined #openstack-powervm | 00:17 | |
| *** jwcroppe has joined #openstack-powervm | 00:17 | |
| *** thorst has quit IRC | 00:19 | |
| *** esberglu has joined #openstack-powervm | 00:31 | |
| openstackgerrit | Sridhar Venkat proposed openstack/networking-powervm master: VIOS availability check during agent startup https://review.openstack.org/469291 | 00:31 |
|---|---|---|
| *** esberglu has quit IRC | 00:35 | |
| *** svenkat has joined #openstack-powervm | 00:36 | |
| *** k0da has quit IRC | 00:45 | |
| *** jwcroppe has quit IRC | 00:51 | |
| *** thorst has joined #openstack-powervm | 01:19 | |
| *** thorst has quit IRC | 01:24 | |
| *** chas has joined #openstack-powervm | 02:10 | |
| *** thorst has joined #openstack-powervm | 02:13 | |
| *** thorst has quit IRC | 02:13 | |
| *** esberglu has joined #openstack-powervm | 02:14 | |
| *** esberglu has quit IRC | 02:14 | |
| *** esberglu has joined #openstack-powervm | 02:14 | |
| *** esberglu has quit IRC | 02:15 | |
| *** chas has quit IRC | 02:15 | |
| *** esberglu has joined #openstack-powervm | 02:15 | |
| *** esberglu has quit IRC | 02:20 | |
| openstackgerrit | Sridhar Venkat proposed openstack/networking-powervm master: VIOS availability check during agent startup https://review.openstack.org/469291 | 02:20 |
| *** svenkat has quit IRC | 02:28 | |
| *** thorst has joined #openstack-powervm | 02:37 | |
| *** thorst has quit IRC | 02:38 | |
| *** thorst has joined #openstack-powervm | 03:09 | |
| *** thorst has quit IRC | 03:26 | |
| *** arunman has joined #openstack-powervm | 03:58 | |
| *** arunman has quit IRC | 04:07 | |
| *** chas has joined #openstack-powervm | 04:11 | |
| *** chas has quit IRC | 04:15 | |
| *** chhavi has joined #openstack-powervm | 04:40 | |
| *** thorst has joined #openstack-powervm | 05:23 | |
| *** thorst has quit IRC | 05:28 | |
| *** arunman has joined #openstack-powervm | 05:39 | |
| *** esberglu has joined #openstack-powervm | 05:52 | |
| *** esberglu has quit IRC | 05:53 | |
| *** esberglu has joined #openstack-powervm | 05:53 | |
| *** esberglu has quit IRC | 05:53 | |
| *** esberglu has joined #openstack-powervm | 05:53 | |
| *** esberglu has quit IRC | 05:58 | |
| *** thorst has joined #openstack-powervm | 06:24 | |
| *** thorst has quit IRC | 06:29 | |
| *** k0da has joined #openstack-powervm | 06:50 | |
| *** chhavi has quit IRC | 07:22 | |
| *** thorst has joined #openstack-powervm | 07:46 | |
| *** thorst has quit IRC | 07:50 | |
| *** chhavi has joined #openstack-powervm | 08:02 | |
| *** chas has joined #openstack-powervm | 08:24 | |
| *** esberglu has joined #openstack-powervm | 08:34 | |
| *** chas has quit IRC | 08:35 | |
| *** chas has joined #openstack-powervm | 08:35 | |
| *** esberglu has quit IRC | 08:39 | |
| *** chas has quit IRC | 08:40 | |
| *** chas has joined #openstack-powervm | 08:44 | |
| *** thorst has joined #openstack-powervm | 08:47 | |
| *** chas has quit IRC | 08:48 | |
| *** chas has joined #openstack-powervm | 08:50 | |
| *** chas has quit IRC | 08:55 | |
| *** adreznec has quit IRC | 09:04 | |
| *** adreznec has joined #openstack-powervm | 09:05 | |
| *** thorst has quit IRC | 09:06 | |
| *** esberglu has joined #openstack-powervm | 09:31 | |
| *** esberglu has quit IRC | 09:31 | |
| *** esberglu has joined #openstack-powervm | 10:24 | |
| *** esberglu has quit IRC | 10:28 | |
| *** chhavi has quit IRC | 10:37 | |
| *** chhavi has joined #openstack-powervm | 10:40 | |
| *** chas has joined #openstack-powervm | 10:42 | |
| *** chas has quit IRC | 10:47 | |
| *** chas has joined #openstack-powervm | 10:49 | |
| *** chas has quit IRC | 10:53 | |
| *** chas has joined #openstack-powervm | 10:55 | |
| *** chas has quit IRC | 10:59 | |
| *** thorst has joined #openstack-powervm | 11:04 | |
| *** thorst has quit IRC | 11:08 | |
| *** thorst has joined #openstack-powervm | 11:30 | |
| *** chhavi has quit IRC | 11:33 | |
| *** svenkat has joined #openstack-powervm | 11:59 | |
| *** edmondsw has joined #openstack-powervm | 12:02 | |
| *** smatzek has joined #openstack-powervm | 12:03 | |
| *** chas has joined #openstack-powervm | 12:42 | |
| *** chas_ has joined #openstack-powervm | 12:47 | |
| *** chas has quit IRC | 12:47 | |
| *** chas_ has quit IRC | 12:52 | |
| *** lan has joined #openstack-powervm | 13:04 | |
| *** chas has joined #openstack-powervm | 13:05 | |
| *** mdrabe has joined #openstack-powervm | 13:06 | |
| *** k0da has quit IRC | 13:08 | |
| *** lan has quit IRC | 13:09 | |
| *** jwcroppe has joined #openstack-powervm | 13:10 | |
| *** chas has quit IRC | 13:14 | |
| *** jpasqualetto has joined #openstack-powervm | 13:16 | |
| *** chas has joined #openstack-powervm | 13:17 | |
| *** dwayne has quit IRC | 13:18 | |
| *** chas has quit IRC | 13:20 | |
| *** esberglu has joined #openstack-powervm | 13:31 | |
| *** chhavi has joined #openstack-powervm | 13:32 | |
| *** smatzek has quit IRC | 13:39 | |
| *** smatzek has joined #openstack-powervm | 14:03 | |
| *** kriskend has joined #openstack-powervm | 14:08 | |
| *** kriskend has quit IRC | 14:13 | |
| *** kriskend has joined #openstack-powervm | 14:15 | |
| *** dwayne has joined #openstack-powervm | 14:17 | |
| *** chas has joined #openstack-powervm | 14:46 | |
| *** dwayne has quit IRC | 14:49 | |
| *** chas has quit IRC | 14:50 | |
| *** arunman has quit IRC | 15:01 | |
| *** tjakobs has joined #openstack-powervm | 15:04 | |
| openstackgerrit | Eric Fried proposed openstack/networking-powervm master: Fix docstrings for neutron-lib constants https://review.openstack.org/469536 | 15:12 |
| *** dwayne has joined #openstack-powervm | 15:30 | |
| *** mdrabe has quit IRC | 15:33 | |
| *** mdrabe has joined #openstack-powervm | 15:34 | |
| *** mdrabe has quit IRC | 15:55 | |
| *** smatzek_ has joined #openstack-powervm | 16:12 | |
| *** smatzek has quit IRC | 16:15 | |
| *** jwcroppe has quit IRC | 16:16 | |
| *** mdrabe has joined #openstack-powervm | 16:25 | |
| *** chas has joined #openstack-powervm | 16:27 | |
| *** chas has quit IRC | 16:31 | |
| *** jwcroppe has joined #openstack-powervm | 17:04 | |
| *** chas has joined #openstack-powervm | 17:28 | |
| *** chas has quit IRC | 17:48 | |
| *** chas has joined #openstack-powervm | 17:49 | |
| *** chas has quit IRC | 17:53 | |
| *** chhavi has quit IRC | 18:17 | |
| openstackgerrit | Eric Fried proposed openstack/nova-powervm master: WIP: Delay events while spawning https://review.openstack.org/469612 | 18:19 |
| *** smatzek_ is now known as smatzek | 18:26 | |
| *** chas has joined #openstack-powervm | 18:29 | |
| esberglu | efried: Is that the source of some of the CI problems? ^^ | 18:32 |
| efried | esberglu I seriously doubt it. | 18:57 |
| esberglu | efried: K I just glanced briefly thought it might | 18:58 |
| esberglu | What logs should I start looking into to find the source of the long close_vterm operations | 18:59 |
| efried | esberglu I pretty much have no idea. Maybe the REST logs? | 18:59 |
| *** dwayne has quit IRC | 19:03 | |
| *** chas has quit IRC | 19:04 | |
| *** chas has joined #openstack-powervm | 19:05 | |
| *** chas has quit IRC | 19:09 | |
| *** dwayne has joined #openstack-powervm | 19:17 | |
| *** dwayne has quit IRC | 19:23 | |
| *** dwayne has joined #openstack-powervm | 19:39 | |
| *** esberglu has quit IRC | 19:56 | |
| *** esberglu has joined #openstack-powervm | 20:10 | |
| *** k0da has joined #openstack-powervm | 20:20 | |
| *** esberglu has quit IRC | 20:23 | |
| *** esberglu has joined #openstack-powervm | 20:29 | |
| *** smatzek has quit IRC | 20:34 | |
| edmondsw | esberglu is there something I can do to help with the CI? | 20:51 |
| esberglu | edmondsw: I'm trying to track down what might be causing the close vterm operation to time out | 21:00 |
| esberglu | edmondsw: Otherwise you can just look into any failing run and see if you can uncover anything | 21:10 |
| *** svenkat has quit IRC | 21:13 | |
| *** thorst has quit IRC | 21:17 | |
| efried | esberglu edmondsw Got +W on the SSP change! | 21:28 |
| efried | We get to declare blueprint complete for pike. | 21:28 |
| esberglu | efried: Okay we need to identify and enable relevant tempest tests for that | 21:28 |
| edmondsw | efried yeah, I saw that :) | 21:28 |
| esberglu | But awesome! | 21:28 |
| edmondsw | hoo-rah! | 21:28 |
| efried | esberglu Right - not sure what those will be. At this point we can boot an instance, but still no network, so I don't know that anything will pass that didn't before. | 21:29 |
| *** k0da has quit IRC | 21:31 | |
| edmondsw | efried esberglu surely there are some tests about having a volume attached, no? | 21:31 |
| efried | edmondsw We don't have volumes yet | 21:32 |
| edmondsw | efried boot volume | 21:32 |
| efried | edmondsw Perhaps. How would they tell? | 21:32 |
| efried | and still - it's not "boot from volume". Not sure how specific we're being here, but the SSP stuff is only ephemeral. | 21:33 |
| edmondsw | s/volume/disk/ if you like :) | 21:33 |
| efried | Anyway, my point is, I'm not aware of any APIs that allow the compute manager to ask the driver, "Do you have storage attached?" | 21:34 |
| edmondsw | hmmm... ok | 21:34 |
| efried | esberglu I posted a recheck here https://review.openstack.org/#/c/469536/ >3h ago. That does not bode well. Can you tell what's going on there? | 21:35 |
| esberglu | Probably just hitting timeouts | 21:35 |
| edmondsw | esberglu the last time it did run the failed test was due to a timeout http://paste.openstack.org/show/611140/ | 21:38 |
| edmondsw | esberglu would that slow down getting results significantly? | 21:38 |
| edmondsw | efried SSP just merged :) | 21:39 |
| efried | Yup. | 21:39 |
| esberglu | edmondsw: Yeah depending on what it is. For example the close vterm usually completes quickly. But the timeout is long (30 min I think?) | 21:39 |
| * efried celebrates | 21:39 | |
| esberglu | So if a run hits that a few times it can add an hour onto the run easily | 21:39 |
| edmondsw | esberglu this was on test_rebuild_server_with_auto_disk_config | 21:40 |
| esberglu | edmondsw: Yeah efried and I have looked into that a few times and can't figure out what is the actual issue | 21:40 |
| esberglu | I think we must have some sort of scalability problem | 21:40 |
| *** chas has joined #openstack-powervm | 21:41 | |
| esberglu | Or enviromental. I had staging running last night with the same code as production (plus the local.confs in powervm-ci) and it was passing 90% | 21:41 |
| *** chas has quit IRC | 21:46 | |
| esberglu | efried: I can figure out which neo a run is on while it's still running though | 21:46 |
| efried | Sure ;-) | 21:46 |
| efried | It probably wouldn't be harmful to put the (short) hostname of the neo into a log somewhere so we can figger this out for debug purposes in the future. | 21:47 |
| efried | Remind me why we don't post the REST logs with the results? Too big? | 21:47 |
| edmondsw | esberglu this is out of date where it talks about reporting/voting/silent for the various programs, right? https://wiki.openstack.org/wiki/ThirdPartySystems/IBM_PowerVM_CI | 21:49 |
| esberglu | Yeah. There's way more storage now though (right thorst?) so we can probably increase the size of the logserver and start posting them | 21:49 |
| esberglu | edmondsw: Yep out-of-date | 21:50 |
| edmondsw | esberglu if you could update that when you get a chance | 21:50 |
| esberglu | will do | 21:50 |
| esberglu | efried: Doesn't look like thorst is here to confirm but I'm fairly confident that storage was increased | 21:51 |
| efried | Perhaps we can limit to posting the REST logs if there are failures. | 21:52 |
| esberglu | Yeah should be able to. I know you can specify that steps in the jenkins jobs that only run after success so I'm assuming the same can be done for failures | 21:53 |
| *** thorst has joined #openstack-powervm | 21:56 | |
| edmondsw | thorst ^ | 21:59 |
| *** edmondsw has quit IRC | 22:01 | |
| *** edmondsw has joined #openstack-powervm | 22:01 | |
| *** kriskend has quit IRC | 22:03 | |
| *** edmondsw_ has joined #openstack-powervm | 22:03 | |
| *** edmondsw has quit IRC | 22:05 | |
| *** jpasqualetto has quit IRC | 22:07 | |
| *** edmondsw_ has quit IRC | 22:07 | |
| *** dwayne has quit IRC | 22:08 | |
| *** AndyWojo has quit IRC | 22:23 | |
| *** edmondsw has joined #openstack-powervm | 22:31 | |
| *** mdrabe has quit IRC | 22:32 | |
| *** edmondsw has quit IRC | 22:35 | |
| *** jwcroppe has quit IRC | 22:48 | |
| *** thorst has quit IRC | 23:09 | |
| *** dwayne has joined #openstack-powervm | 23:11 | |
| *** tjakobs has quit IRC | 23:14 | |
| *** thorst has joined #openstack-powervm | 23:20 | |
| *** chas has joined #openstack-powervm | 23:40 | |
| *** chas has quit IRC | 23:44 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!