Monday, 2016-06-27

*** thorst has joined #openstack-powervm00:27
*** thorst has quit IRC00:36
*** thorst has joined #openstack-powervm00:37
*** tblakeslee has joined #openstack-powervm00:39
*** thorst has quit IRC00:44
*** tblakeslee has quit IRC00:59
*** esberglu has joined #openstack-powervm01:02
*** smatzek has joined #openstack-powervm01:23
*** smatzek has quit IRC01:32
*** thorst has joined #openstack-powervm01:42
*** thorst has quit IRC01:50
*** smatzek has joined #openstack-powervm01:50
*** esberglu has quit IRC01:51
*** thorst has joined #openstack-powervm02:08
*** thorst has quit IRC02:12
*** thorst has joined #openstack-powervm02:13
*** smatzek has quit IRC02:22
*** thorst has quit IRC02:22
*** thorst has joined #openstack-powervm03:22
*** thorst has quit IRC03:27
*** jwcroppe has joined #openstack-powervm03:49
*** tjakobs has joined #openstack-powervm03:55
*** tjakobs has quit IRC04:20
*** thorst has joined #openstack-powervm04:25
*** thorst has quit IRC04:32
*** thorst has joined #openstack-powervm05:29
*** jwcroppe has quit IRC05:31
*** jwcroppe has joined #openstack-powervm05:32
*** thorst has quit IRC05:36
*** jwcroppe has quit IRC05:36
*** kotra03 has joined #openstack-powervm05:53
*** kylek3h has joined #openstack-powervm05:56
*** kylek3h has quit IRC06:01
*** kotra03 has quit IRC06:18
*** kotra03 has joined #openstack-powervm06:21
*** jwcroppe has joined #openstack-powervm06:33
*** thorst has joined #openstack-powervm06:34
*** jwcroppe has quit IRC06:40
*** thorst has quit IRC06:41
*** jwcroppe has joined #openstack-powervm07:37
*** thorst has joined #openstack-powervm07:40
*** jwcroppe has quit IRC07:42
*** thorst has quit IRC07:46
*** k0da has joined #openstack-powervm08:12
*** jwcroppe has joined #openstack-powervm08:38
*** jwcroppe has quit IRC08:43
*** thorst has joined #openstack-powervm08:44
*** thorst has quit IRC08:52
*** kylek3h has joined #openstack-powervm09:33
*** kylek3h has quit IRC09:38
*** jwcroppe has joined #openstack-powervm09:39
*** jwcroppe has quit IRC09:44
*** kotra03 has quit IRC09:47
*** thorst has joined #openstack-powervm09:49
*** thorst has quit IRC09:57
*** kotra03 has joined #openstack-powervm10:24
*** jwcroppe has joined #openstack-powervm10:41
*** jwcroppe has quit IRC10:46
*** thorst has joined #openstack-powervm10:54
*** thorst has quit IRC11:02
*** jwcroppe has joined #openstack-powervm11:42
*** jwcroppe has quit IRC11:47
*** thorst has joined #openstack-powervm11:50
*** thorst_ has joined #openstack-powervm11:51
*** thorst has quit IRC11:55
*** tblakeslee has joined #openstack-powervm12:11
*** erlarese has joined #openstack-powervm12:30
*** jwcroppe has joined #openstack-powervm12:44
*** seroyer has joined #openstack-powervm12:44
*** kylek3h has joined #openstack-powervm12:46
*** svenkat has joined #openstack-powervm12:47
*** esberglu has joined #openstack-powervm12:47
*** jwcroppe has quit IRC12:48
*** svenkat has left #openstack-powervm12:49
*** svenkat has joined #openstack-powervm12:53
*** smatzek has joined #openstack-powervm12:57
smatzekchmod6661rg, did you have issues in the past with ntp and AIX cloud-init?12:58
*** edmondsw has joined #openstack-powervm13:01
*** lmtaylor1 has joined #openstack-powervm13:09
*** Ashana has joined #openstack-powervm13:13
thorst_smatzek: there was that clock issue where some clocks were going back to 197013:19
thorst_but I think there is a fix out for that...  I can find if you'd like13:19
smatzekthorst_, yep there is a firmware fix for that and chmod6661rg hit that as well, but I think he may have hit another issue with the ntp clients post-deploy, which is something I'm seeing elsewhere now13:21
*** mdrabe has joined #openstack-powervm13:24
*** ManojK has joined #openstack-powervm13:24
*** mdrabe has quit IRC13:37
*** mdrabe has joined #openstack-powervm13:38
*** k0da has quit IRC13:39
*** burgerk has joined #openstack-powervm13:41
*** lmtaylor1 has quit IRC13:45
*** jwcroppe has joined #openstack-powervm13:45
*** apearson has quit IRC13:47
*** jwcroppe has quit IRC13:50
*** ManojK has quit IRC13:54
*** ManojK has joined #openstack-powervm13:55
*** burgerk has quit IRC13:55
*** seroyer has quit IRC13:58
*** tjakobs has joined #openstack-powervm14:01
*** seroyer has joined #openstack-powervm14:14
*** apearson has joined #openstack-powervm14:15
*** dwayne has joined #openstack-powervm14:15
*** arnoldje has joined #openstack-powervm14:41
*** thorst__ has joined #openstack-powervm14:41
*** thorst_ has quit IRC14:45
*** k0da has joined #openstack-powervm14:45
*** jwcroppe has joined #openstack-powervm14:47
*** jwcroppe has quit IRC14:55
AndyWojoyou can run AIX on openstack using powervm as the hypervisor?15:09
thorst__AndyWojo: definitely15:09
*** thorst__ is now known as thorst_15:09
AndyWojowhat?15:09
AndyWojoMind blown15:09
thorst_AndyWojo: let me rephrase...15:09
thorst_OpenStack can deploy AIX VMs.15:09
thorst_OpenStack can not run on top of AIX...but OpenStack can deploy AIX VMs.15:09
AndyWojoRight. I had no idea. That's game changing.15:09
thorst_+215:09
thorst_IBMi too.15:09
AndyWojoHow do people not know this!15:09
AndyWojomeh15:10
AndyWojowho cares about ibmi? :)15:10
thorst_heh15:10
AndyWojojk15:10
thorst_AndyWojo: help spread the word15:10
AndyWojoI will15:10
*** ManojK has quit IRC15:11
*** ManojK has joined #openstack-powervm15:18
efriedthorst_, https://review.openstack.org/#/c/333474/ passed jenkins.  Anything else needed before we push it?15:19
thorst_LGTM15:22
efriedThanks.15:25
efriedthorst_, you going to get a chance to scrutinize the vNIC anti-affinity thing?15:26
thorst_efried: looking at it right now actually15:26
efriedcoo15:26
*** k0da has quit IRC15:33
*** lmtaylor has joined #openstack-powervm15:45
thorst_efried: haters gonna hate on that vNIC anti-affininty thing16:10
efriedthorst_, that doesn't look near as hatey as it could've.16:12
thorst_I mean, its confusing as heck logic16:13
efriedOh, yeah it is.  I had to iterate on it a fair bit - earlier (simpler) iterations simply weren't correct.16:13
efriedI can stare at it some more this week and see if I can make it simpler again.  But I suspect if I make it readable, sonar is going to give me the big finger.16:13
efriedwhich is stupid.16:14
thorst_lulz16:14
thorst_efried: since I reviewed yours....16:14
thorst_https://review.openstack.org/#/c/333499/16:14
efried"Dude, sonar, sometimes the code we write *is* hard, yo."16:14
efriedoh, that's a beautiful change set.16:15
thorst_efried: yeah...way simpler than the gigantic nightmare I tried earlier16:16
thorst_that said...I want to move a bunch of my stuff from media down into pypowervm16:18
*** dwayne has quit IRC16:23
*** mdrabe has quit IRC16:24
*** mdrabe has joined #openstack-powervm16:42
*** tblakeslee has quit IRC16:52
*** ManojK has quit IRC17:05
openstackgerritEric Berglund proposed openstack/nova-powervm: Concurrent Delete on same lpar failure  https://review.openstack.org/33459317:51
*** tblakeslee has joined #openstack-powervm17:52
openstackgerritEric Berglund proposed openstack/nova-powervm: Concurrent LPAR Delete Failure  https://review.openstack.org/33459317:52
*** tblakeslee_ has joined #openstack-powervm17:55
openstackgerritEric Berglund proposed openstack/nova-powervm: Concurrent LPAR Delete Failure  https://review.openstack.org/33459317:56
*** tblakeslee has quit IRC17:57
*** tblakeslee_ is now known as tblakeslee17:57
*** ManojK has joined #openstack-powervm18:01
*** tblakeslee has quit IRC18:05
*** tblakeslee has joined #openstack-powervm18:18
openstackgerritMerged openstack/nova-powervm: Allow the mgmt partition to be VIOS or LPAR  https://review.openstack.org/33349918:19
*** kotra03 has quit IRC18:33
openstackgerritEric Berglund proposed openstack/nova-powervm: Concurrent Delete on same lpar failure  https://review.openstack.org/33459318:41
*** dwayne has joined #openstack-powervm18:44
*** tblakeslee has quit IRC18:54
thorst_efried: 3495...that's been bugging me for a while18:56
thorst_pushed it down into pypowervm.18:56
thorst_will move ~400 loc out of nova-powervm with it18:56
thorst_(mostly test...)18:56
efriedthorst_, rgr18:56
*** tblakeslee has joined #openstack-powervm18:57
openstackgerritEric Berglund proposed openstack/nova-powervm: Concurrent Delete on same lpar failure  https://review.openstack.org/33459318:59
thorst_efried: working with esberglu and we're seeing some amazingly long deploy times19:04
thorst_do you happen to remember if we have all the patches on all the systems...or just neo38/3919:05
efriedthorst_, I haven't kept up with those systems in weeks.  No idea.19:05
efriedIs there anything in-flight that we would still need "patched"?19:05
thorst_I'm thinking apearson is going to need to put on his monacle and investigate this19:06
thorst_efried: nothing that I know of in flight...but these VIOSes are quite old19:06
efriedSo we should perhaps update pvm-novalink and VIOSes to latest first.19:06
thorst_efried: novalinks are up to date...19:07
thorst_vioses are pretty old.19:07
efriedHow old?  I don't remember hearing of any VIOS fixes in a while.19:07
thorst_2-3 months19:08
thorst_hsould be updated19:08
thorst_VIOS team isn't eager to investigate since I think they're pre-GA19:08
apearson@thorst_ - what is it I should be looking at?19:09
thorst_looks like the SSP is to blame19:09
thorst_apearson: can I give you a ring?19:10
apearsonsure19:10
thorst_esberglu: /var/log/pvm/wlp19:22
openstackgerritEric Berglund proposed openstack/nova-powervm: Concurrent Delete on same lpar failure  https://review.openstack.org/33459319:31
efriedthorst_, hatin back atcha.19:31
*** svenkat has quit IRC19:38
*** svenkat has joined #openstack-powervm19:47
openstackgerritEric Berglund proposed openstack/nova-powervm: Concurrent Delete on same lpar failure  https://review.openstack.org/33459319:48
*** apearson has quit IRC19:59
*** ManojK has quit IRC19:59
*** ManojK has joined #openstack-powervm20:01
*** apearson has joined #openstack-powervm20:01
*** svenkat_ has joined #openstack-powervm20:06
*** svenkat has quit IRC20:06
*** svenkat_ is now known as svenkat20:06
lmtaylorefried: about your comment in https://review.openstack.org/#/c/332485/20:29
efriedYes, hit me.20:29
lmtaylorI don't think moving the "retry" to all swift operations is the right move...20:29
lmtaylorsince this specific ClientException will only occur on upload operations.20:29
efriedWill it?20:29
*** smatzek has quit IRC20:30
efriedWhat happens if the token expires right before we do a fetch?20:30
lmtaylorso from what i've seen in the SwiftClient code, The SwiftClient already has a retry operation. The actual inter workings is the _retry() method.20:31
lmtaylorThe method takes a 'reset' function as the first parameter.  This first parameter is normally 'None' for operations EXCEPT the upload operation.20:31
lmtaylorFor upload, it's set to a default method that throws a ClientException if the object to upload either doesn't implement tell()/see() or reset()... and we aren't, we are using six.StringIO()20:32
lmtaylorSo basically if the 401 occurs on the upload, then the ClientException is raised and there is no retry.  But for any other operation include Fetch, SwiftClient will retry the operation and then succeed.20:33
lmtaylorefried: does that make sense?20:35
*** smatzek has joined #openstack-powervm20:35
efriedlmtaylor, Well, it's a stupid implementation in swift, and not the first we've seen - but your explanation makes sense, and your code change makes sense in light of that.  Perhaps an explanatory comment in the code would help enlighten our posterity (and me, for that matter, when I look back at this in a week and have forgotten this conversation).20:37
lmtayloryah i'll go beef up the comments to make this implementation clearer.20:39
efriedCool, thanks.20:40
*** svenkat has quit IRC20:43
*** edmondsw has quit IRC20:52
*** apearson has quit IRC20:54
*** catintheroof has joined #openstack-powervm20:55
*** smatzek has quit IRC20:58
*** esberglu has quit IRC20:58
*** thorst_ has quit IRC20:58
*** apearson has joined #openstack-powervm21:00
*** k0da has joined #openstack-powervm21:11
*** esberglu has joined #openstack-powervm21:12
*** arnoldje has quit IRC21:17
*** thorst_ has joined #openstack-powervm21:34
*** smatzek has joined #openstack-powervm21:37
*** thorst_ has quit IRC21:38
*** smatzek has quit IRC21:43
*** seroyer has quit IRC21:43
openstackgerritLauren Taylor proposed openstack/nova-powervm: Some VM deploys fail from expired keystone token  https://review.openstack.org/33248521:45
*** lmtaylor has left #openstack-powervm21:45
*** seroyer has joined #openstack-powervm21:46
*** tblakeslee has quit IRC21:49
*** kylek3h has quit IRC21:52
*** catintheroof has quit IRC21:55
*** ManojK has quit IRC22:00
*** ManojK has joined #openstack-powervm22:01
*** mdrabe has quit IRC22:06
*** esberglu has quit IRC22:13
*** Ashana has quit IRC22:29
*** Ashana has joined #openstack-powervm22:30
*** seroyer has quit IRC22:30
*** ManojK has quit IRC22:30
*** tjakobs has quit IRC22:34
*** Ashana has quit IRC22:34
*** k0da has quit IRC22:34
*** Ashana has joined #openstack-powervm22:36
*** Ashana has quit IRC22:40
*** Ashana has joined #openstack-powervm22:41
*** Ashana has quit IRC22:47
*** Ashana has joined #openstack-powervm22:49
*** Ashana has quit IRC22:53
*** Ashana has joined #openstack-powervm22:55
*** ManojK has joined #openstack-powervm22:57
*** Ashana has quit IRC22:59
*** jwcroppe has joined #openstack-powervm23:00
*** Ashana has joined #openstack-powervm23:00
*** Ashana has quit IRC23:05
*** Ashana has joined #openstack-powervm23:06
*** Ashana has quit IRC23:11
*** Ashana has joined #openstack-powervm23:12
*** Ashana has quit IRC23:16
*** Ashana has joined #openstack-powervm23:18
*** Ashana has quit IRC23:22
*** Ashana has joined #openstack-powervm23:24
*** Ashana has quit IRC23:28
*** Ashana has joined #openstack-powervm23:30
*** Ashana has quit IRC23:34
*** Ashana has joined #openstack-powervm23:36
*** Ashana has quit IRC23:40
*** Ashana has joined #openstack-powervm23:42
*** Ashana has quit IRC23:46
*** Ashana has joined #openstack-powervm23:49
*** Ashana has quit IRC23:54
*** Ashana has joined #openstack-powervm23:55
*** Ashana has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!