Friday, 2017-08-11

*** baojg has quit IRC00:02
*** baojg has joined #openstack-manila00:14
*** baojg has quit IRC00:14
*** baojg has joined #openstack-manila00:15
*** baojg has quit IRC00:15
*** baojg has joined #openstack-manila01:16
*** baojg has quit IRC01:24
zhongjunbswartz: I replied vponomaryov's inline commits, waiting for  vponomaryov's response.01:35
*** openstackgerrit has joined #openstack-manila01:38
openstackgerritMerged openstack/manila-ui master: Imported Translations from Zanata  https://review.openstack.org/49206701:38
openstackgerritzhongjun proposed openstack/manila master: Add API document for share type quota  https://review.openstack.org/49171101:43
openstackgerritzhongjun proposed openstack/manila master: Fix quota error in batch delete shares  https://review.openstack.org/48950102:06
*** ianychoi_ has joined #openstack-manila02:11
bswartzzhongjun: you fixed the issues he pointed out?02:16
bswartzat this point we're not looking to cut RC1 until tomorrow morning at the earliest02:17
*** ianychoi has quit IRC02:18
*** dsariel has quit IRC02:18
*** openstackgerrit has quit IRC02:21
*** baojg has joined #openstack-manila02:21
zhongjunbswartz: I just modify the function name that he pointed out.02:21
zhongjunbswartz: not do anything else in code02:22
*** baojg has quit IRC02:26
*** openstackgerrit has joined #openstack-manila02:29
openstackgerritMerged openstack/manila master: Add API document for share group quotas  https://review.openstack.org/49170002:29
openstackgerritzhongjun proposed openstack/manila master: Add API document for share type quota  https://review.openstack.org/49171102:36
bswartzzhongjun: regarding the renamed "context" variable, it would be clearer if you used a name like admin_ctx to separate it from the other variable03:16
bswartzalso, perhaps add a comment about why the original variable is retained03:16
bswartzI was confused for the same reason vponomaryov was03:16
zhongjunbswartz: yeah, it would be better to make it more meaningful03:18
openstackgerritzhongjun proposed openstack/manila master: Fix quota error in batch delete shares  https://review.openstack.org/48950103:22
zhongjunbswartz: agree, done03:22
*** baojg has joined #openstack-manila04:23
*** baojg has quit IRC04:30
*** dsariel has joined #openstack-manila04:31
*** markstur has quit IRC04:32
*** sapcc-bot has joined #openstack-manila05:33
*** markstur has joined #openstack-manila05:35
*** sapcc-bot1 has quit IRC05:37
*** markstur has quit IRC05:40
*** lpetrut has joined #openstack-manila05:52
openstackgerritBen Swartzlander proposed openstack/manila master: Re-enable broken CG code in NetApp driver  https://review.openstack.org/49187705:56
openstackgerritBen Swartzlander proposed openstack/manila master: Re-enable broken CG code in NetApp driver  https://review.openstack.org/49187706:02
*** baojg has joined #openstack-manila06:27
*** jprovazn has joined #openstack-manila06:30
*** baojg has quit IRC06:34
openstackgerritzhongjun proposed openstack/manila master: [Doc] Fix access rule description in api-ref  https://review.openstack.org/49281706:34
*** lpetrut has quit IRC06:52
*** rraja has joined #openstack-manila07:17
openstackgerritzhongjun proposed openstack/manila master: [Doc] Fix access rule description in api-ref  https://review.openstack.org/49281707:26
*** baojg has joined #openstack-manila07:30
*** baojg has quit IRC07:37
*** dsariel_ has joined #openstack-manila07:57
*** dsariel has quit IRC07:57
*** openstackgerrit has quit IRC08:02
*** openstackgerrit has joined #openstack-manila08:26
openstackgerritjunbo.li proposed openstack/manila master: [Api-ref] Add supported protocol "MAPRFS" in doc  https://review.openstack.org/49286408:26
openstackgerrityfzhao proposed openstack/manila master: Fix wrong links  https://review.openstack.org/49287908:48
*** dsariel_ has quit IRC09:04
*** jprovazn has quit IRC09:22
*** baojg has joined #openstack-manila09:34
*** rejy has joined #openstack-manila09:35
*** ianychoi_ is now known as ianychoi09:36
*** baojg has quit IRC09:40
openstackgerritOpenStack Proposal Bot proposed openstack/manila-ui master: Imported Translations from Zanata  https://review.openstack.org/49293209:57
*** ociuhandu has quit IRC10:08
*** jprovazn has joined #openstack-manila10:14
*** rejy has quit IRC10:18
*** markstur has joined #openstack-manila10:31
*** markstur has quit IRC10:36
*** ganso has joined #openstack-manila10:45
*** jprovazn has quit IRC11:24
*** jprovazn has joined #openstack-manila11:32
*** jprovazn has quit IRC11:53
*** jprovazn has joined #openstack-manila12:09
*** jprovazn is now known as jprovazn_mtg12:09
zhongjunvponomaryov: ping12:09
*** jprovazn_mtg is now known as jprovazn12:10
zhongjunvponomaryov: link: https://review.openstack.org/#/c/489501/2/manila/share/api.py@92612:10
zhongjunvponomaryov: Are you around12:11
vponomaryovzhongjun: pong12:12
zhongjunvponomaryov: How to check whether the "release of real resources" on storage backend be deleted?12:13
vponomaryovzhongjun: how do you think?12:13
zhongjunvponomaryov: We could have this case:  We still have share record in db and the real resources on storage backend has been deleted12:13
zhongjunvponomaryov: In this case,  we can still change the share status to available and force delete it. It means the share record in db still work and we still don't need to -1 shares quota12:14
zhongjunvponomaryov: Deletion of DB record could be tied to "quota calculation".12:15
vponomaryovzhongjun: I still don't see arguments against my proposal to remove quota handling in "share-api" and move to "share-manager"12:18
zhongjunvponomaryov: We only control the db in manila. If the DB record has deleted, it means the manila not need to manage this share, and we need to -1 shares quota. Am I missing something?12:18
*** jprovazn has quit IRC12:19
*** guyr-infinidat has quit IRC12:19
*** jprovazn has joined #openstack-manila12:19
*** guyr-infinidat has joined #openstack-manila12:19
zhongjunvponomaryov: Because we have two places to delete share instance in db. The one is code line 926 in manila-api service, the another one is code line 924, it will send delete share instance to manila-share service.12:20
*** gouthamr has joined #openstack-manila12:20
*** lpetrut has joined #openstack-manila12:22
zhongjunvponomaryov: The case is: 1. create a share 2. the scheduler can not find a host, raise error  3. create a share status change to "error" and the share doesn't exist 'host'.   4 delete this share.   Then we will go to code line 926 and we can never go to share-manager12:23
vponomaryovzhongjun: the main goal you have is to make sure quota calculated correctly, no more, no less. There is no real need to delete DB record exactly in share-api service. Especially, if we are talking about "share-manager"-specific resources.12:23
vponomaryovzhongjun: user consumes "real" resources, not DB records12:24
vponomaryovzhongjun: it means, if share was not even scheduled anywhere, it should not consume quota as it is only DB record of failed attempt to create share12:25
vponomaryovzhongjun: in manila-api we check, if share doesn't have "host" value then it haven't taken any real resources and we can just delete DB record in place. But if it has "host" value, then we dedicate such right to "share-manager"12:26
vponomaryovin this case manila-api services will not have "concurrency"12:28
zhongjunvponomaryov: But the actually is we cost the shares quota even if we doesn't have "host" value12:28
*** xyang1 has joined #openstack-manila12:29
vponomaryovbug12:29
zhongjunvponomaryov: haha12:29
vponomaryov?12:29
zhongjunvponomaryov: It looks like we still have many bug in quotas12:30
*** catintheroof has joined #openstack-manila12:30
zhongjunvponomaryov: :)12:30
vponomaryovbugs everywhere12:30
vponomaryovit is question of "whether you are able to leave with them or not"12:30
vponomaryovit is very minor bug12:31
vponomaryovbecause you can just force-delete DB record without any problem12:31
vponomaryovso, we can leave with it12:31
zhongjunvponomaryov: yeah, we only handle +1 shares quota in share-api services.12:32
zhongjunvponomaryov: We doesn't handle all  errors  when we create a share.12:35
zhongjunvponomaryov: we can leave with what?12:41
openstackgerritMerged openstack/manila-ui master: Imported Translations from Zanata  https://review.openstack.org/49293212:41
vponomaryovzhongjun: with bug that we consider "just DB record" as resource consumption12:42
openstackgerritJan Provaznik proposed openstack/manila master: [Doc] Add more description to user messages api-ref  https://review.openstack.org/49298712:43
zhongjunvponomaryov: We handle most of all quota operate in manila-api services. I think we need to discuss it with other manila members12:45
zhongjunvponomaryov: How to check the real resources be created?12:49
zhongjunvponomaryov: We could get error even if the real share has created in backend storage12:50
zhongjunbswartz: ping12:51
*** dustins has joined #openstack-manila12:54
*** baojg has joined #openstack-manila13:03
*** MVenesio has joined #openstack-manila13:07
*** MVenesio has quit IRC13:13
*** MVenesio has joined #openstack-manila13:13
openstackgerritMerged openstack/manila master: [Api-ref] Add supported protocol "MAPRFS" in doc  https://review.openstack.org/49286413:33
*** jprovazn has quit IRC13:41
*** jprovazn has joined #openstack-manila13:41
*** jmlowe_ has joined #openstack-manila13:47
*** jmlowe has quit IRC13:49
*** cknight has joined #openstack-manila13:54
*** rraja has quit IRC13:55
bswartzhey zhongjun14:06
bswartzgouthamr vponomaryov: https://review.openstack.org/#/c/491877/14:07
*** markstur has joined #openstack-manila14:08
bswartzzhongjun vponomaryov: are we not agreed on the approach to use for quota management? I'll admit that I'm not an expert on quotas, but tbarron had a specific proposal in Austin that I was okay with14:08
vponomaryovbswartz: there is no NetApp CI results so far14:08
bswartzperhaps we need to revisit the issue at PTG14:08
bswartzvponomaryov: doh14:08
bswartzI and all the tests and they passed, finally14:09
bswartzI'll go see why the CI system hasn't voted14:09
*** rraja has joined #openstack-manila14:10
*** markstur has quit IRC14:12
bswartzvponomaryov: hmm netapp CI seems to be not listening to event stream14:13
zhongjunbswartz: yes, vponomaryov think we need to remove most of all quota operate from manila-api service to manila-manager, in order to change "just DB record" as resource consumption to "real resource consumption"14:15
bswartzzhongjun: we're not going to fix the architectural issues in a bugfix14:15
bswartzwe should solve the architectural issues in queens14:16
bswartzthe question is whether this bugfix makes things better or not14:16
zhongjunvponomaryov:  Do we still have problem about this bug except  the architectural issues?14:18
*** jprovazn has quit IRC14:19
*** markstur has joined #openstack-manila14:20
zhongjunbswartz: I didn't see another problem about this bug fix except the architectural issues that vponomaryov pointed out14:20
zhongjunvponomaryov: Do I missing something?14:21
*** markstur has quit IRC14:24
*** rraja has quit IRC14:25
bswartzvponomaryov: I have no idea why the CI isn't posting comments, but here is the successful test run: http://paste.openstack.org/show/618189/14:26
bswartzvponomaryov: looks like the CI system has developed a new bug >_< it's failing to pull patches from gerrit14:31
bswartzvponomaryov: we restarted zuul and it will vote in about an hour15:04
*** markstur has joined #openstack-manila15:04
vponomaryovbswartz: gouthamr has already provided logs, +2'ed15:05
bswartzvponomaryov: thx15:06
bswartzvponomaryov: what about zhongjun's bugfix? not worth merging in pike?15:06
vponomaryovbswartz: personally, I disagree with the approach there15:07
bswartzso you prefer to leave the bug in until we have a better approach to fix all the related issues?15:07
vponomaryovbswartz: bugfix is simple, not harder than current approach15:07
vponomaryovjust different15:07
*** jprovazn has joined #openstack-manila15:08
*** jprovazn has quit IRC15:08
vponomaryovbswartz: I prefer 'proper', from my point of view, fix, good if in Pike15:09
bswartzwell if this fix isn't the right one, then we won't fix it in pike15:10
bswartzwe'll have to do some fixes in queens and backport them after the release15:10
bswartzthat's probably a better approach in any case15:10
bswartzimproving the quota system will be high on my priority list of queens15:11
vponomaryovbswartz: looks like I am the only one who have reviewed it, you may want to find some other couple of eye sfor it15:11
bswartztbarron: ^ are you back online yet?15:11
bswartzvponomaryov: I'm okay with not merging it if the fix isn't correct15:11
vponomaryovbswartz: it is too loud to say it is improving15:11
vponomaryovbswartz: just moving small pile of code to other place15:12
bswartzI just wanted to give the patch a closer look since zhongjun did the work to get it fixed by the deadline15:12
bswartzI'm going to untarget the quota bugs from RC1 and tag the release when the NetApp bugfix clears the gate15:12
bswartzthen we can start planning for queens work and hunting for bugs to fix in RC215:13
bswartzzhongjun: thanks for your work on the quota bug, looks like we'll have to -1 it for now15:13
*** baojg_ has joined #openstack-manila15:15
zhongjunIt is okay, because we still have some things need to discuss about quotes problems15:16
*** baojg has quit IRC15:16
zhongjunbswartz: It would be better if we solve all quotes problems at the same time15:20
*** ociuhandu has joined #openstack-manila15:34
*** ociuhandu has quit IRC16:10
*** lpetrut has quit IRC16:18
* bswartz curses gate-manila-tempest-minimal-dsvm-lvm-centos-716:20
openstackgerritValeriy Ponomaryov proposed openstack/manila master: Fix quota usages update deleting same share from several API endpoints  https://review.openstack.org/49307116:22
vponomaryovbswawrtz, zhongjun: ^16:22
vponomaryovhaven't tested it on lab, and haven't updated unit tests, it is for testing and review purposes16:23
bswartzvponomaryov: I'd like tbarron to look at that too -- I'm curious how it compares to what other projects are doing for quotas16:26
*** jmlowe_ has quit IRC16:34
*** jmlowe has joined #openstack-manila16:56
openstackgerritMerged openstack/manila master: Fix wrong links  https://review.openstack.org/49287917:22
*** lpetrut has joined #openstack-manila19:25
openstackgerritBen Swartzlander proposed openstack/manila master: Re-enable broken CG code in NetApp driver  https://review.openstack.org/49187719:41
*** lpetrut has quit IRC20:01
*** lpetrut has joined #openstack-manila20:02
*** gouthamr has quit IRC20:14
*** MVenesio has quit IRC20:14
*** catintheroof has quit IRC20:15
*** gouthamr has joined #openstack-manila20:32
*** jmlowe has quit IRC20:45
*** jmlowe has joined #openstack-manila20:47
*** cknight has quit IRC20:53
*** jmlowe has quit IRC20:56
*** dustins has quit IRC21:00
*** MVenesio has joined #openstack-manila21:33
*** baojg has joined #openstack-manila21:37
*** baojg_ has quit IRC21:37
openstackgerritMerged openstack/manila master: Re-enable broken CG code in NetApp driver  https://review.openstack.org/49187721:50
*** xyang1 has quit IRC21:54
*** MVenesio_ has joined #openstack-manila22:18
*** MVenesio has quit IRC22:22
*** lpetrut has quit IRC22:23
*** ganso has quit IRC22:31
*** MVenesio_ has quit IRC22:51
openstackgerritOpenStack Release Bot proposed openstack/manila master: Update reno for stable/pike  https://review.openstack.org/49325723:00

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!