Tuesday, 2018-10-02

*** mvkr has quit IRC00:05
*** mriedem has quit IRC00:05
*** moshele has quit IRC00:19
*** 07IAAFY1M has quit IRC00:24
*** dpawlik has joined #openstack-cinder00:45
*** dpawlik has quit IRC00:50
*** hoonetorg has quit IRC00:56
*** dpawlik has joined #openstack-cinder01:01
*** mhen has quit IRC01:05
*** dpawlik has quit IRC01:05
*** mhen has joined #openstack-cinder01:07
*** hoonetorg has joined #openstack-cinder01:10
*** raunak12_ has joined #openstack-cinder01:22
*** Dinesh_Bhor has joined #openstack-cinder01:23
*** brinzhang has joined #openstack-cinder01:32
*** threestrands has quit IRC01:33
*** raunak12_ has quit IRC01:40
*** Dinesh_Bhor has quit IRC01:45
*** Dinesh_Bhor has joined #openstack-cinder01:48
*** hoonetorg has quit IRC01:49
*** Dinesh_Bhor has quit IRC01:53
*** hoonetorg has joined #openstack-cinder02:01
*** 07IAAF4QO has joined #openstack-cinder02:05
*** abishop_ has quit IRC02:27
*** Dinesh_Bhor has joined #openstack-cinder03:00
*** dpawlik has joined #openstack-cinder03:02
*** dpawlik has quit IRC03:06
*** dpawlik has joined #openstack-cinder03:17
*** dpawlik has quit IRC03:22
*** mvkr has joined #openstack-cinder03:29
*** Dinesh_Bhor has quit IRC03:54
*** 07IAAF4QO has quit IRC04:03
*** raunak12 has joined #openstack-cinder04:07
*** Dinesh_Bhor has joined #openstack-cinder04:34
*** pcaruana has joined #openstack-cinder04:36
*** pcaruana has quit IRC04:43
*** e0ne has joined #openstack-cinder05:06
*** e0ne has quit IRC05:06
*** dpawlik has joined #openstack-cinder05:18
*** dpawlik has quit IRC05:23
*** raunak12 has quit IRC05:24
*** raunak12 has joined #openstack-cinder05:25
*** raunak12 has joined #openstack-cinder05:26
*** raunak12 has joined #openstack-cinder05:27
*** raunak12 has joined #openstack-cinder05:27
*** raunak12 has joined #openstack-cinder05:28
*** raunak12 has quit IRC05:28
*** raunak12 has joined #openstack-cinder05:29
*** raunak12 has joined #openstack-cinder05:30
*** raunak12 has joined #openstack-cinder05:31
*** raunak12 has joined #openstack-cinder05:31
*** dpawlik has joined #openstack-cinder05:34
*** dpawlik has quit IRC05:39
*** Dinesh_Bhor has quit IRC05:48
*** Dinesh_Bhor has joined #openstack-cinder05:54
*** Dinesh_Bhor has quit IRC05:58
*** dpawlik has joined #openstack-cinder06:00
*** Luzi has joined #openstack-cinder06:02
*** Dinesh_Bhor has joined #openstack-cinder06:03
*** sapd1 has joined #openstack-cinder06:08
*** Emine has quit IRC06:36
*** hoonetorg has quit IRC06:36
*** dims has quit IRC06:38
*** dims has joined #openstack-cinder06:44
*** dims has quit IRC06:48
*** dims has joined #openstack-cinder06:51
*** Dinesh_Bhor has quit IRC06:55
*** e0ne has joined #openstack-cinder07:00
*** rcernin has quit IRC07:01
*** pcaruana has joined #openstack-cinder07:01
*** moshele has joined #openstack-cinder07:01
*** dpawlik has quit IRC07:04
*** moshele has quit IRC07:04
*** moshele has joined #openstack-cinder07:23
*** dpawlik has joined #openstack-cinder07:24
openstackgerritXianjin Shao proposed openstack/cinder master: [APIDOC]  Add "ins_public" to the api document for volume types  https://review.openstack.org/60711507:30
*** Dinesh_Bhor has joined #openstack-cinder07:31
*** psachin has joined #openstack-cinder07:35
*** amoralej|off is now known as amoralej08:08
openstackgerritXianjin Shao proposed openstack/cinder master: [APIDOC]  Add "ins_public" to the api document for volume types  https://review.openstack.org/60711508:24
*** Luzi has quit IRC08:28
*** Luzi has joined #openstack-cinder08:40
*** gkadam has joined #openstack-cinder08:48
*** mhen has quit IRC08:55
*** mhen has joined #openstack-cinder08:56
openstackgerritMerged openstack/cinder stable/queens: Fix IPv6 for Cinder NetApp ONTAP drivers  https://review.openstack.org/60508208:56
openstackgerritMerged openstack/cinder master: nimble storage: retype support  https://review.openstack.org/60149208:57
*** Dinesh_Bhor has quit IRC08:57
*** hamdyk has joined #openstack-cinder09:32
*** Dinesh_Bhor has joined #openstack-cinder09:43
*** moshele has quit IRC09:52
*** moshele has joined #openstack-cinder09:55
*** brinzhang has quit IRC09:57
*** mvkr has quit IRC09:57
*** moshele has quit IRC09:58
*** psachin has quit IRC09:59
*** moshele has joined #openstack-cinder10:09
openstackgerritIvaylo Mitev proposed openstack/cinder master: Implement volume capacity stats for VMware  https://review.openstack.org/60576210:10
*** moshele has quit IRC10:12
*** dpawlik has quit IRC10:16
*** dpawlik has joined #openstack-cinder10:17
*** luizbag has joined #openstack-cinder10:23
*** mvkr has joined #openstack-cinder10:26
*** Dinesh_Bhor has quit IRC10:27
*** Dinesh_Bhor has joined #openstack-cinder10:29
*** Dinesh_Bhor has quit IRC10:31
*** sapd1 has quit IRC10:49
*** dave-mccowan has joined #openstack-cinder11:02
*** amoralej is now known as amoralej|lunch11:05
*** e0ne has quit IRC11:10
*** mvkr has quit IRC11:16
*** mvkr has joined #openstack-cinder11:17
*** ganso has joined #openstack-cinder11:24
*** tbarron has joined #openstack-cinder11:28
*** moshele has joined #openstack-cinder11:47
*** e0ne has joined #openstack-cinder11:50
*** abishop_ has joined #openstack-cinder11:53
*** amoralej|lunch is now known as amoralej12:19
*** Emine has joined #openstack-cinder12:23
*** _hemna has quit IRC12:27
*** Luzi has quit IRC12:29
*** markvoelker has joined #openstack-cinder12:32
*** Bhujay has joined #openstack-cinder12:36
*** Luzi has joined #openstack-cinder12:43
*** mriedem has joined #openstack-cinder12:46
*** hamdyk has quit IRC12:54
*** pcaruana has quit IRC12:57
smcginnisjungleboyj: These need to go in to get driverfixes moving again: https://review.openstack.org/#/q/owner:%22Sean+McGinnis%22+status:open+branch:%22%255Edriverfixes.*%2213:05
*** Luzi has quit IRC13:06
smcginnise0ne: Thanks for all those reviews!13:07
*** moshele has quit IRC13:07
e0nesmcginnis: you're welcome! I guess that CI will work after your patches will be landed13:08
smcginnise0ne: Yeah, there aren't any jobs defined now, so those are needed to get zuul to pick it up.13:16
jungleboyjsmcginnis:  Got them.  Thanks for fixing that.  Going to work on doing some reviews here this morning before I get pulled into other stuff.  :-)13:22
smcginnisCool, thanks.13:22
smcginnisI went through a few things yesterday, so I think there might be a few that just need a second look.13:22
smcginnisUnless e0ne already got all of those. :)13:22
*** Luzi has joined #openstack-cinder13:23
*** moshele has joined #openstack-cinder13:23
*** pcaruana has joined #openstack-cinder13:27
*** dustins has joined #openstack-cinder13:27
*** e0ne has quit IRC13:32
*** moshele has quit IRC13:37
*** tpsilva has joined #openstack-cinder13:39
*** moshele has joined #openstack-cinder13:39
*** moshele has quit IRC13:50
openstackgerritGaudenz Steinlin proposed openstack/cinder stable/pike: RBD: Don't query Ceph on stats for exclusive pools  https://review.openstack.org/60719213:56
*** dustins has quit IRC13:58
*** mriedem has quit IRC14:00
*** mhen has quit IRC14:01
*** dustins has joined #openstack-cinder14:01
*** e0ne has joined #openstack-cinder14:02
*** mriedem has joined #openstack-cinder14:05
*** mhen has joined #openstack-cinder14:06
jungleboyje0ne:  If you have a minute this would be a good one to get in:  https://review.openstack.org/#/c/604160/14:16
e0nejungleboyj: approved!14:16
smcginnisI have a few other client patches that might be good: https://review.openstack.org/#/q/project:openstack/python-cinderclient+status:open+owner:%22Sean+McGinnis+%253Csean.mcginnis%2540gmail.com%253E%2214:17
*** Luzi has quit IRC14:19
jungleboyje0ne: Thanks.14:23
jungleboyjsmcginnis:  Looking.14:23
*** gnufied has quit IRC14:48
*** Emine has quit IRC14:55
*** gnufied has joined #openstack-cinder14:57
smcginnishemna: If you get a chance, I responded to your comment here - https://review.openstack.org/#/c/588673/2/cinderclient/v3/volume_transfers.py15:02
smcginnisjungleboyj: We should have that in the next release since we broke backwards compatibility ^15:03
jungleboyjOk.  I have on my list that I need to do some os-brick and python-cinderclient releases.15:05
jungleboyjHopefully hemna can look there and validate that he is ok with your response.15:05
*** e0ne has quit IRC15:19
openstackgerritMerged openstack/cinder master: Update Dell EMC Driver's multi-attach Support  https://review.openstack.org/60578115:21
*** dpawlik has quit IRC15:22
*** ircuser-1 has joined #openstack-cinder15:25
*** dave-mccowan has quit IRC15:27
*** dave-mccowan has joined #openstack-cinder15:28
jgriffithjungleboyj: it's the same as V2, he even provided the link to prove it15:50
jgriffithnothing to "not" be ok about15:50
jungleboyjjgriffith:  ?15:50
jgriffithNM done15:51
jungleboyjjgriffith:  Fair enough.  Don't like approving patches with -1's on them but you are right on that one.15:51
openstackgerritMerged openstack/python-cinderclient master: Default help output to include MV updates  https://review.openstack.org/60416015:51
jgriffithYeah, makes sense.  Just figure he's not here yet, issue is explained so you can release your client :)15:52
jungleboyjBwah ha ha!  Release the Client!15:53
openstackgerritIvaylo Mitev proposed openstack/cinder master: Implement volume capacity stats for VMware  https://review.openstack.org/60576215:54
openstackgerritIvaylo Mitev proposed openstack/cinder master: Implement volume capacity stats for VMware  https://review.openstack.org/60576215:56
openstackgerritIvaylo Mitev proposed openstack/cinder master: Implement volume capacity stats for VMware  https://review.openstack.org/60576215:57
jgriffithI'm always nervous clicking on links you post... but that was safe and funny16:01
smcginnisWhat the heck was that! :D16:01
jungleboyjjgriffith: Hey now!  I don't send anything that inappropriate.16:01
jgriffithha... emphasis on *that*16:01
openstackgerritMerged openstack/os-brick master: Add LIO barbican tests to .zuul.yaml  https://review.openstack.org/55703616:04
*** Bhujay has quit IRC16:12
openstackgerritRajat Dhasmana proposed openstack/cinder master: Fix: storage_pools key in Huawei Driver  https://review.openstack.org/60729916:14
openstackgerritMerged openstack/python-cinderclient master: Fix endpoint identification for api-version query  https://review.openstack.org/58919116:16
*** raunak12 has joined #openstack-cinder16:20
*** rosmaita has joined #openstack-cinder16:25
openstackgerritMerged openstack/python-cinderclient master: Fix functional error check for invalid volume create size  https://review.openstack.org/60162516:28
*** gnufied has quit IRC16:28
*** gnufied has joined #openstack-cinder16:33
*** _hemna has joined #openstack-cinder16:46
openstackgerritMerged openstack/cinder master: VMAX Driver - Fix for manage volume if volume is part of SG  https://review.openstack.org/60430316:55
openstackgerritMerged openstack/cinder master: Raise HTTPUnsupportedMediaType when content type is unsupported  https://review.openstack.org/59403616:56
openstackgerritMerged openstack/cinder master: api-ref: remove encryption from Show-an-encryption-type  https://review.openstack.org/60680316:57
openstackgerritMerged openstack/cinder master: Remove systool from rootwrap  https://review.openstack.org/60661016:57
openstackgerritMerged openstack/cinder master: api-ref: fix req/resp params for v3 os-quota-class-sets  https://review.openstack.org/60480816:57
openstackgerritMerged openstack/cinder master: api-ref: clarify volume_type param in volume create API  https://review.openstack.org/60481016:57
openstackgerritMerged openstack/cinder master: hosts api ref: all fields should be of type string  https://review.openstack.org/60356516:57
openstackgerritMerged openstack/cinder master: Changed default behaviour of nas_secure_file_* for Quobyte driver  https://review.openstack.org/59496716:57
openstackgerritMerged openstack/cinder master: Fix pylint warning  https://review.openstack.org/60556616:57
imacdonnZuul had his wheaties? ;)17:04
*** amoralej is now known as amoralej|off17:24
openstackgerritRaunak Kumar proposed openstack/cinder master: nimble storage: support for force detach  https://review.openstack.org/60732817:25
*** gkadam has quit IRC17:28
*** mvkr has quit IRC17:31
openstackgerritMerged openstack/python-cinderclient master: Fix backwards compat for volume transfer < 3.55  https://review.openstack.org/58867317:33
openstackgerritRaunak Kumar proposed openstack/cinder stable/queens: nimble storage: retype support  https://review.openstack.org/60733117:39
openstackgerritRaunak Kumar proposed openstack/cinder stable/queens: nimble storage: retype support  https://review.openstack.org/60733117:40
openstackgerritRaunak Kumar proposed openstack/cinder stable/queens: nimble storage: retype support  https://review.openstack.org/60733117:40
*** Emine has joined #openstack-cinder17:43
*** dpawlik has joined #openstack-cinder17:47
*** openstackgerrit has quit IRC17:51
*** dpawlik has quit IRC17:53
*** openstackgerrit has joined #openstack-cinder18:01
openstackgerritMerged openstack/cinder master: Fix wrong filter of backups in db api  https://review.openstack.org/60032918:01
*** pcaruana has quit IRC18:02
*** raunak12_ has joined #openstack-cinder18:04
*** mvkr has joined #openstack-cinder18:05
*** raunak12 has quit IRC18:06
*** raunak12_ is now known as raunak1218:06
openstackgerritMerged openstack/cinder stable/queens: VMAX Driver - Fix for get-pools and returned Service Levels  https://review.openstack.org/59704418:09
*** dpawlik has joined #openstack-cinder18:09
*** dpawlik has quit IRC18:14
*** Emine has quit IRC18:15
*** imacdonn has quit IRC18:21
*** imacdonn has joined #openstack-cinder18:21
*** openstackgerrit has quit IRC18:35
*** kmalloc has joined #openstack-cinder19:27
kmallochey lovely cinder folks, I have a person over in #openstack-keystone asking about something weird and I want to see if it's something wonky going on in middleware or deeper in enforcement19:28
kmallocthey are getting a 401, such as this, when some actions are succeeding with OSC commands19:28
kmalloci'm taking a look at the cinder code base, but it feels like a weird thing to get a 401 back from.19:28
kmallocthis is what makes me go a bit o.O: RESP BODY: {"error_id":"9afcdd56-21b0-4bf3-9b62-c88d88a8ebf3","code":401,"title":"Unauthorized","message":"Authentication failed","key":"unauthorized","public":true}19:29
DHEas a user, I'd check if the keystone authentication settings in cinder.conf is correct, and if keystone itself has the 'cinder' user properly configured (admin of the service group, etc)19:29
kmallocwell, volume list is working19:30
kmallocfor example19:30
kmallocbut volume type list is not19:30
* kmalloc is happy to poke around in cinder to see if a 401 is somehow incorrectly being raised up.19:31
kmalloci figured it might be as quick to ask if this was a known behavior.19:31
*** e0ne has joined #openstack-cinder19:32
kmallocso some tokens are validating correctly19:34
kmallocs/some tokens/tokens for some actions19:34
*** dave-mccowan has quit IRC19:41
smcginniskmalloc: I have not seen that behavior. If you (or they) are able to get volume list, they should be able to get volume-type list fine.19:41
kmallocsmcginnis: that was my expectation19:41
smcginniskmalloc: Not that we want it to be any better, but I would try cinder list and cinder type-list to see if it's universal, or something in osc.19:42
smcginnisJust to be sure.19:42
kmallocsmcginnis: the API is giving a 401 for sure, i'll ask them to use cinderclient19:42
kmallocsee if there is some extra debug.19:42
*** mogindi has joined #openstack-cinder19:43
smcginnisYeah, just thinking of the outside chance that osc is setting up the call differently or something.19:43
kmallocsmcginnis: ++19:43
smcginnisOh s/if/of/ :)19:43
kmallocsmcginnis: mogindi is who is having issues here. so we'll get direct feedback as it being tried19:43
smcginnisI tried on my out of date cloud and it works fine, so if it broke, it's likely a regression.19:44
kmallocthis is happening in a few services, but i figure if we can troubleshoot one (cinder is the most direct weirdness) case we can figure what is weird across all of them19:44
smcginnisWell, some solace that it's not just cinder I guess. :)19:45
kmallocit was also router create19:45
kmallocit's aslo a pike-based cloud19:46
kmallocmogindi: can you past the issue here?19:51
kmallocmogindi: with cinderclient19:51
mogindismcginnis kmalloc: http://paste.openstack.org/show/731291/19:52
smcginnismogindi: Looks like that is the same one using osc. Can you try with cinderclient and see if there is any difference?19:52
smcginnisThe lack of anything in the cinder-api log makes me think it's never even getting to us.19:53
mogindiim in the middle of troubleshooting why i can't use cinder client with token actually. Got this error with any cinder command "ERROR: argument --os-token: conflicting option string(s): --os-token"19:53
smcginnisHmm, I wonder if that could happen if the token is in an environment variable as well as passed in as a command line argument.19:55
kmallocoh that could do it19:55
kmallocthough... that is strange behaviors19:56
smcginnis<- grasping at straws19:56
mogindiim not passing it as argument though, just env var19:56
smcginnisWell that's really weird then.19:56
*** abishop_ has quit IRC19:56
kmalloccan you pass --os-token eplicitly19:57
kmallocexplicitly instead of via ENV19:57
mogindiokay, unsetting OS_TOKEN and will try passing as argument19:58
kmallocis this pip-installed cinderclient or distro installed cinderclient, or something else?19:58
smcginniskmalloc: Only potential change I can find so far is https://review.openstack.org/#/c/532217/19:59
smcginnisThat was queens.20:00
mogindipip installed20:00
mogindiversion 4.0.120:00
mogindishould i try to downgrade?20:00
smcginnisThat should be OK.20:01
mogindibtw still getting same issue when passing --os-token20:01
mogindiwithout OS_TOKEN20:01
mogindismcginnis: ^20:03
kmallocsmcginnis: yeah i don't think that change is relevant here.20:04
kmallocmogindi: can you post a sanitized version of the cinder.conf?20:04
smcginnisNo idea on the os-token thing.20:04
kmallocmogindi: and is this a distro of openstack or something you've installed/configured yourself. Also can you post sanitized logs from cinder when the failure happens?20:05
*** dave-mccowan has joined #openstack-cinder20:07
mogindiokay working on it20:08
mogindiits just canonical20:08
mogindinothing configured ourselves20:08
* kmalloc nods.20:12
smcginnisI was able to test with a 4.0.1 cinderclient, both using cinder type-list and openstack volume type list, and no errors.20:16
*** dustins has quit IRC20:16
smcginnisSo it's not something in the client at any rate.20:16
smcginnisEither configuration or service side. Odd that I don't get the os-type error.20:17
*** luizbag has quit IRC20:21
mogindikmalloc: http://paste.openstack.org/show/731296/20:21
mogindialso, there are zero logs regarding the 40120:21
mogindithe whole operation produces no logs in when doing `tail -f cinder*.log`20:22
mogindicould it be something weird in haproxy that we may have accidentally set? Or do we know that if `openstack volume list` works, the rest should?20:23
kmallocmogindi: that might in fact be the case20:29
kmallocit's weird.20:29
kmallocif there is no logging, no request hitting cinder...20:30
*** dave-mccowan has quit IRC20:30
kmallocthen something might be misconfigured a layer up20:30
kmallocyeah that looks sane (to a quick look) the config20:30
*** dave-mccowan has joined #openstack-cinder20:31
*** elmaciej has joined #openstack-cinder20:31
mogindikmalloc: ok, i'll try to investigate a bit more and see if i find something there.20:33
mogindismcginnis: when u tested with cinderclient, was the token passed as a env var also?20:33
*** dave-mccowan has quit IRC20:36
mogindi@smcginnis kmalloc: also wanna make sure im not missing an env var or anything. This is what I set in the env http://paste.openstack.org/show/731298/20:38
smcginnisSorry, pulled away...20:40
smcginnisYeah, if we're not even seeing it hit the cinder api then my guess is it's somewhere else before it gets to us.20:41
smcginnisLoad balancers always make me a little suspicious, so if you can go directly to one of the nodes mogindi, that might be a good test.20:41
smcginnismogindi: I am not setting OS_TOKEN. Here's all I have set: http://paste.openstack.org/show/731299/20:42
*** openstackgerrit has joined #openstack-cinder20:43
openstackgerritMerged openstack/cinder stable/pike: VMAX Driver - Initiator retrieval short hostname fix  https://review.openstack.org/60163920:43
mogindi@smcginnis: my commands work fine with admin endpoint and password. The issue only happens with token, tested with public endpoint.20:50
smcginnismogindi: OK, at least it's limited to one way then. Does that sounds like a ksa issue kmalloc?20:54
kmallocsmcginnis: maybe?20:58
kmalloci am unsure how things are getting to the wrong place though.21:00
kmallocit is possible we are raising a 401 in ksa in a weird place21:00
kmallocunless somehow we're dropping the token on the floor in some cases21:01
*** e0ne has quit IRC21:02
smcginnisI'm still suspicious of any load balancers. :)21:06
mogindiokay trying without21:11
*** Emine has joined #openstack-cinder21:16
*** elmaciej has quit IRC21:18
*** moshele has joined #openstack-cinder21:36
mogindikmalloc @smcginnis: for now looks like could be caused by our haproxy or redirects layer above. When using the token with public endpoint on native haproxy deployed on controllers (we don't use them but they're there), it works21:39
mogindigonna investigate more and will update u if i find something weird that i think could be from keystone/cinder21:39
smcginnismogindi: Great, thanks. Good luck!21:48
*** mogindi has quit IRC21:51
*** Emine has quit IRC21:53
*** mriedem has quit IRC22:03
*** rosmaita has left #openstack-cinder22:07
sorrisonHi cinder folks, would someone be able to look at https://review.openstack.org/#/c/599866/ would appreciate some feedback22:08
openstackgerritMerged openstack/cinder master: Fujitsu DX: Add retries for busy error  https://review.openstack.org/59757222:16
*** ganso has quit IRC22:20
*** moshele has quit IRC22:24
*** tpsilva has quit IRC22:55
*** icey has quit IRC23:05
imacdonnsmcginnis: you around, by any chance ?23:08
*** _alastor_ has quit IRC23:08
*** icey has joined #openstack-cinder23:12
openstackgerritMerged openstack/os-brick master: The validation of iscsi session should be case insensitive  https://review.openstack.org/60425323:22
*** erlon has joined #openstack-cinder23:36
*** rcernin has joined #openstack-cinder23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!