Monday, 2016-12-05

*** seroyer has quit IRC00:09
*** svenkat has joined #openstack-powervm00:19
*** esberglu has joined #openstack-powervm00:26
*** svenkat has quit IRC00:31
*** esberglu has quit IRC00:34
*** apearson has quit IRC00:37
*** kylek3h is now known as kylek3h_away00:38
*** apearson has joined #openstack-powervm00:38
*** apearson has quit IRC00:38
*** apearson has joined #openstack-powervm00:39
*** apearson has quit IRC00:39
*** apearson has joined #openstack-powervm00:39
*** apearson has quit IRC00:40
*** apearson has joined #openstack-powervm00:40
*** apearson has quit IRC00:41
*** apearson has joined #openstack-powervm00:41
*** apearson has quit IRC00:42
*** apearson has joined #openstack-powervm00:42
*** apearson has quit IRC00:42
*** apearson has joined #openstack-powervm00:43
*** apearson has quit IRC00:43
*** apearson has joined #openstack-powervm00:43
*** apearson has joined #openstack-powervm00:44
*** apearson has quit IRC00:45
*** apearson has joined #openstack-powervm00:45
*** apearson has quit IRC00:46
*** apearson has joined #openstack-powervm00:46
*** apearson has quit IRC00:46
*** apearson has joined #openstack-powervm00:47
*** apearson has quit IRC00:47
*** apearson has joined #openstack-powervm00:47
*** apearson has quit IRC00:48
*** apearson has joined #openstack-powervm00:48
*** apearson has joined #openstack-powervm00:49
*** apearson has quit IRC00:50
*** apearson has joined #openstack-powervm00:50
*** thorst_ has joined #openstack-powervm00:50
*** apearson has quit IRC00:51
*** thorst_ has quit IRC00:58
*** esberglu has joined #openstack-powervm01:26
*** esberglu has quit IRC01:30
*** thorst_ has joined #openstack-powervm01:45
*** thorst_ has quit IRC01:47
*** esberglu has joined #openstack-powervm02:21
*** esberglu has quit IRC02:26
*** thorst_ has joined #openstack-powervm02:52
*** thorst_ has quit IRC03:01
*** esberglu has joined #openstack-powervm03:11
*** thorst_ has joined #openstack-powervm03:11
*** thorst_ has quit IRC03:12
*** esberglu has quit IRC03:15
*** efried has quit IRC04:11
*** esberglu has joined #openstack-powervm04:11
*** efried has joined #openstack-powervm04:11
*** thorst_ has joined #openstack-powervm04:12
*** esberglu has quit IRC04:15
*** thorst_ has quit IRC04:21
*** apearson has joined #openstack-powervm04:49
*** esberglu has joined #openstack-powervm05:09
*** esberglu has quit IRC05:14
*** thorst_ has joined #openstack-powervm05:19
*** thorst_ has quit IRC05:26
*** apearson has quit IRC06:06
*** thorst_ has joined #openstack-powervm06:25
*** thorst_ has quit IRC06:31
*** thorst_ has joined #openstack-powervm07:30
*** thorst_ has quit IRC07:36
*** openstackgerrit has quit IRC08:03
*** k0da has joined #openstack-powervm08:09
*** kylek3h__ has joined #openstack-powervm08:31
*** thorst_ has joined #openstack-powervm08:34
*** kylek3h_away has quit IRC08:34
*** thorst_ has quit IRC08:41
*** thorst_ has joined #openstack-powervm09:39
*** thorst_ has quit IRC09:45
*** thorst_ has joined #openstack-powervm11:07
*** thorst_ has quit IRC11:12
*** efried has quit IRC12:00
*** svenkat has joined #openstack-powervm12:00
*** efried has joined #openstack-powervm12:01
*** thorst_ has joined #openstack-powervm12:10
*** svenkat has quit IRC12:14
*** thorst_ has quit IRC12:16
*** seroyer has joined #openstack-powervm12:32
*** thorst_ has joined #openstack-powervm12:50
*** svenkat has joined #openstack-powervm13:08
*** tblakes_ has joined #openstack-powervm13:10
*** edmondsw has joined #openstack-powervm13:11
*** tblakes_ is now known as tblakes13:15
*** seroyer has quit IRC13:44
*** dwayne_ has joined #openstack-powervm13:59
*** tlian has joined #openstack-powervm13:59
*** seroyer has joined #openstack-powervm14:00
*** mdrabe has joined #openstack-powervm14:12
*** esberglu has joined #openstack-powervm14:42
*** gianpero has joined #openstack-powervm14:47
*** kriskend has joined #openstack-powervm15:01
*** tjakobs has joined #openstack-powervm15:09
thorst_esberglu: how'd the weekend runs look?15:28
esbergluPretty good. Quite a few failures, but they were mostly patches that needed a rebase15:29
esbergluThey were failing because of that patch I put up with the HVType and VMMode change15:29
esberglu3 runs that actually failed tempest so far. Just taking inventory for now, gonna dig into the failures after15:31
*** apearson has joined #openstack-powervm15:32
thorst_excellent15:33
*** openstackgerrit has joined #openstack-powervm15:47
openstackgerritTaylor Jakobson proposed openstack/nova-powervm: Retry up to 3 times on disk create  https://review.openstack.org/40635515:47
tjakobsthorst_: i tried rebasing the retry code and restarting nova-compute, but i'm still getting AttributeError: type object 'Architecture' has no attribute 'PPC64'15:53
thorst_tjakobs: hmm...that was fixed by something that esberglu merged in last week15:58
thorst_let me find the commit.15:58
thorst_https://review.openstack.org/#/c/406304/15:58
thorst_even though the commit says something else, it fixed that error15:58
tjakobsi found that, i'm thinking maybe the nova stuff is just out of date on the system15:59
thorst_o, could be15:59
tjakobsis there any easy way to update that? for ansible setup15:59
esbergluAnd this commit15:59
esbergluhttps://review.openstack.org/#/c/403934/15:59
thorst_tjakobs: I'm not sure...I thought it always updated...16:01
tjakobswhen? (i've only been restarting the nova-compute.serivce)16:02
thorst_if you redeploy OSA, it should've pulled it16:02
openstackgerritDrew Thorstensen (thorst) proposed openstack/nova-powervm: Add delay queue for events  https://review.openstack.org/39116416:05
adreznectjakobs: where are you hitting this issue?16:05
tjakobsit'll probably be on both the systems kris/I were using for the glance stuff16:06
kriskendwe have not redeployed OSA on there for awhile16:08
thorst_kriskend: are you comfortable with the storage fix?16:09
thorst_the one down in pypowervm16:09
thorst_if so, I want to put it up for proper review.16:09
kriskendnot yet... I haven't tried to break it yet :-) But in theory I am16:09
thorst_kriskend: can you try to break it?16:10
thorst_tjakobs did some 'try to break it' the other day.16:10
thorst_and while glance fell over, it cleaned up this time16:10
kriskendthat is why Taylor was trying to but the code on the system16:10
thorst_ahh16:10
thorst_got it16:10
kriskendso he could give it to me to try to break16:10
thorst_adreznec: removing this live migration object brings me joy16:24
thorst_all this hackery built for just this silly object.16:24
esbergluthorst_: adreznec: One of the runs failed waiting for VIF to be created16:45
esbergluAnother one failed due to and SSL decryption failure, doesn't seem like an issue from our end.16:46
adreznecesberglu: Hmm ok, did the VIF create just hit a timeout?16:48
esbergluYeah looks like it16:58
*** mdrabe has quit IRC17:02
*** jwcroppe has quit IRC17:06
*** jwcroppe has joined #openstack-powervm17:06
openstackgerritTaylor Jakobson proposed openstack/nova-powervm: Retry up to 3 times on disk create  https://review.openstack.org/40635517:09
*** k0da has quit IRC17:09
*** mdrabe has joined #openstack-powervm17:10
*** jwcroppe has quit IRC17:11
*** jwcroppe has joined #openstack-powervm17:23
*** jwcroppe has quit IRC17:26
*** jwcroppe has joined #openstack-powervm17:26
*** jwcroppe_ has joined #openstack-powervm17:29
*** jwcroppe has quit IRC17:31
*** jwcroppe_ has quit IRC17:54
*** jwcroppe has joined #openstack-powervm17:55
*** jwcroppe has quit IRC17:59
*** jwcroppe has joined #openstack-powervm18:00
*** openstackstatus has joined #openstack-powervm18:54
*** ChanServ sets mode: +v openstackstatus18:54
*** gianpero has quit IRC19:08
*** tjakobs_ has joined #openstack-powervm19:18
*** adi_____ has joined #openstack-powervm19:20
*** jwcroppe has quit IRC19:28
*** tjakobs has quit IRC19:28
*** adi____ has quit IRC19:28
*** adi_____ is now known as adi____19:28
*** k0da has joined #openstack-powervm19:31
*** jwcroppe has joined #openstack-powervm19:35
*** k0da has quit IRC19:38
*** k0da has joined #openstack-powervm19:45
thorst_esberglu: it really shouldn't hit a vif timeout19:49
thorst_the new eventing model should fix that.19:49
*** k0da has quit IRC20:06
*** gianpero has joined #openstack-powervm20:35
*** edmondsw has quit IRC20:41
*** edmondsw has joined #openstack-powervm20:47
*** gianpero has quit IRC20:48
*** edmondsw has quit IRC20:52
*** edmondsw has joined #openstack-powervm20:53
*** gianpero has joined #openstack-powervm20:54
*** edmondsw has quit IRC20:58
openstackgerritMerged openstack/nova-powervm: Document compute_driver setting in usage docs  https://review.openstack.org/40486820:59
*** gianpero has quit IRC21:01
thorst_adreznec: mind taking a look for a +2 here?  https://review.openstack.org/#/c/391164/21:06
adreznecthorst_: will do, in a meeting now21:11
*** k0da has joined #openstack-powervm21:23
*** edmondsw has joined #openstack-powervm21:25
*** edmondsw has quit IRC21:29
*** edmondsw has joined #openstack-powervm21:34
thorst_kriskend: did you manage to get your env working?21:35
kriskendyep... been testing it today... so far so good21:35
thorst_ready for me to un-WIP it21:35
kriskendyeah I think so21:36
thorst_after all of that just a 'so far so good'21:36
thorst_:-)21:36
kriskendlol... I am being paranoid, cuz everytime I say .. Yep looks great, it falls apart21:37
openstackgerritDrew Thorstensen (thorst) proposed openstack/nova-powervm: Remove the PowerVM Live Migration Object  https://review.openstack.org/40721121:38
thorst_heh...21:38
kriskendI am still seeing lots of glance fails21:38
thorst_what could go wrong21:38
seroyerSchrodinger's deploy.  As long as you don't label it, it won't fail (or succeed)21:38
thorst_we finally have a reason that explains why we could never track this down21:38
kriskendbut now we retry and we clean things up21:38
kriskendso yeah it is much better than hanging and failing21:38
thorst_heh, good21:39
thorst_adreznec efried: https://review.openstack.org/#/c/407211/21:39
thorst_kriskend: looks like the patch set needs a tweak...21:47
thorst_nothing in the deadlocking...21:47
thorst_I'll work on that tomorrow or tonight.21:47
*** thorst_ has quit IRC21:47
*** kriskend_ has joined #openstack-powervm22:01
*** svenkat has quit IRC22:01
*** kriskend has quit IRC22:01
*** thorst has joined #openstack-powervm22:07
*** thorst has quit IRC22:11
*** tblakes has quit IRC22:32
*** seroyer has quit IRC22:32
*** seroyer has joined #openstack-powervm22:32
*** seroyer has quit IRC22:49
*** seroyer has joined #openstack-powervm22:49
*** seroyer has quit IRC22:55
*** mdrabe has quit IRC23:00
*** kriskend_ has quit IRC23:03
*** tjakobs_ has quit IRC23:03
*** esberglu has quit IRC23:07
*** seroyer has joined #openstack-powervm23:12
*** seroyer has quit IRC23:12
*** esberglu has joined #openstack-powervm23:19
*** thorst has joined #openstack-powervm23:20
*** thorst has quit IRC23:22
*** thorst has joined #openstack-powervm23:22
*** esberglu has quit IRC23:23
*** thorst has quit IRC23:29
*** esberglu has joined #openstack-powervm23:32
*** esberglu has quit IRC23:36
*** jwcroppe has quit IRC23:42
*** esberglu has joined #openstack-powervm23:45
*** esberglu has quit IRC23:50

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!