Wednesday, 2018-11-28

*** hoonetorg has quit IRC00:09
openstackgerritDhinesh Balasubramaniam proposed openstack/cinder master: Hedvig Cinder driver implementation  https://review.openstack.org/43334100:11
openstackgerritDhinesh Balasubramaniam proposed openstack/cinder master: Hedvig Cinder driver implementation  https://review.openstack.org/43334100:17
*** hoonetorg has joined #openstack-cinder00:22
*** lixiaoy1 has joined #openstack-cinder00:27
*** Liang__ has joined #openstack-cinder00:27
*** erlon has joined #openstack-cinder00:32
*** brinzhang has joined #openstack-cinder00:43
openstackgerritMerged openstack/cinder stable/rocky: Handling unexpected python error "NoneType object is not iterable"  https://review.openstack.org/61897800:50
openstackgerritMerged openstack/cinder master: doc: Change variable name DEFAULT_API_VERSION to _MIN_API_VERSION  https://review.openstack.org/61750800:50
*** bhagyashris has joined #openstack-cinder00:57
*** Liang__ is now known as LiangFang01:31
*** hedvig_01 has quit IRC01:46
*** erlon has quit IRC01:54
*** dhineshb has quit IRC02:24
*** Dinesh_Bhor has joined #openstack-cinder02:33
*** psachin has joined #openstack-cinder02:41
*** mhen has quit IRC02:42
*** mhen has joined #openstack-cinder02:45
openstackgerritBrian Rosmaita proposed openstack/cinder master: Correct default policy file  https://review.openstack.org/62045003:53
*** chhagarw has joined #openstack-cinder03:59
*** rosmaita has left #openstack-cinder04:08
*** hoangcx has joined #openstack-cinder04:11
*** lpetrut has joined #openstack-cinder04:51
*** udesale has joined #openstack-cinder04:54
*** pcaruana has joined #openstack-cinder05:09
*** lpetrut has quit IRC05:28
*** imacdonn has quit IRC05:30
*** imacdonn has joined #openstack-cinder05:30
*** e0ne has joined #openstack-cinder05:37
*** imacdonn has quit IRC05:38
*** imacdonn has joined #openstack-cinder05:38
*** hedvig_01 has joined #openstack-cinder05:39
openstackgerritYingxin Cheng proposed openstack/os-brick master: Support RSD scenario of nvme connector  https://review.openstack.org/62025005:40
*** e0ne has quit IRC05:42
*** e0ne has joined #openstack-cinder05:44
*** e0ne has quit IRC05:45
*** brinzhang has quit IRC05:45
*** brinzhang has joined #openstack-cinder05:46
*** hedvig_01 has quit IRC05:47
*** caixiaoyu has joined #openstack-cinder05:53
*** caixiaoyu_1 has joined #openstack-cinder06:15
*** caixiaoyu has quit IRC06:18
openstackgerritVieri proposed openstack/python-brick-cinderclient-ext master: add python 3.6 unit test job  https://review.openstack.org/62046806:31
openstackgerritVieri proposed openstack/python-cinderclient master: add python 3.6 unit test job  https://review.openstack.org/62047006:32
openstackgerritYachika_Ralhan proposed openstack/cinder master: Driver QuantaStor added  https://review.openstack.org/61750306:35
*** udesale has quit IRC06:43
*** udesale has joined #openstack-cinder06:44
*** udesale has quit IRC06:45
*** udesale has joined #openstack-cinder06:46
*** psachin has quit IRC06:47
*** brinzh has joined #openstack-cinder06:52
*** caixiaoyu_1 has quit IRC06:54
*** brinzhang has quit IRC06:56
*** udesale has quit IRC06:57
*** rcernin has quit IRC06:57
*** Luzi has joined #openstack-cinder07:00
*** gkadam has joined #openstack-cinder07:00
*** slaweq has joined #openstack-cinder07:04
*** dpawlik has joined #openstack-cinder07:16
openstackgerritYachika_Ralhan proposed openstack/cinder master: Driver QuantaStor added  https://review.openstack.org/61750307:18
*** dpawlik has quit IRC07:20
openstackgerritRajat Dhasmana proposed openstack/cinder master: DNM: Test jobs running on bionic instead of xenial  https://review.openstack.org/62050107:23
*** dpawlik has joined #openstack-cinder07:24
*** caixiaoyu_1 has joined #openstack-cinder07:24
openstackgerritYingxin Cheng proposed openstack/os-brick master: Support RSD scenario of nvme connector  https://review.openstack.org/62025007:31
*** caixiaoyu_2 has joined #openstack-cinder07:32
*** dcdamien has joined #openstack-cinder07:34
*** caixiaoyu_1 has quit IRC07:36
*** LiangFang has quit IRC07:50
*** udesale has joined #openstack-cinder07:53
*** e0ne has joined #openstack-cinder07:54
*** udesale has quit IRC07:58
*** udesale has joined #openstack-cinder08:11
*** e0ne has quit IRC08:37
*** lemko has joined #openstack-cinder08:38
openstackgerritcaixiaoyu proposed openstack/cinder master: Add test case: clone volume with bad size  https://review.openstack.org/61852208:41
openstackgerritwangwei proposed openstack/cinder master: Fix the problem of the scheduler status  https://review.openstack.org/61644008:53
*** lixiaoy1 has quit IRC08:57
*** arne_wiebalck_ has joined #openstack-cinder09:08
*** arne_wiebalck_ has quit IRC09:09
*** arne_wiebalck_ has joined #openstack-cinder09:11
*** dcdamien has quit IRC09:20
openstackgerritRajat Dhasmana proposed openstack/cinder-tempest-plugin master: DNM: Test jobs running on bionic instead of xenial  https://review.openstack.org/62054209:22
*** luizbag has joined #openstack-cinder09:24
*** whoami-rajat has joined #openstack-cinder09:28
whoami-rajatsmcginnis:  Hi Sean, are all cinder repo's (cinder-tempest-plugin, os-brick ...) jobs running on bionic?09:30
smcginniswhoami-rajat: I think we only have cinder running with a bionic job at this point.09:30
smcginniswhoami-rajat: I don't believe depending on devstack's job changes will do anything for our repos to test.09:34
smcginniswhoami-rajat: whoami-rajat The openstack-python36-jobs template should be added for that.09:35
smcginniswhoami-rajat: That causes openstack-tox-py36 to be run, which is defined to use bionic.09:35
smcginnishttp://git.openstack.org/cgit/openstack/cinder/tree/.zuul.yaml09:35
smcginnishttp://git.openstack.org/cgit/openstack-infra/openstack-zuul-jobs/tree/zuul.d/jobs.yaml#n39109:35
smcginniswhoami-rajat: Oh, it does appear all Cinder repos have been updated to include that. So yes, all cinder repos have bionic jobs.09:37
*** caixiaoyu_2 has quit IRC09:37
whoami-rajatsmcginnis: so the DNM patches aren't needed anymore?09:38
smcginnisCorrect09:38
whoami-rajatsmcginnis: ok thanks sean.09:38
*** caixiaoyu has joined #openstack-cinder09:39
*** bhagyashris has quit IRC09:45
*** caixiaoyu_1 has joined #openstack-cinder09:55
openstackgerritRajat Dhasmana proposed openstack/python-brick-cinderclient-ext master: DNM: Test jobs running on bionic instead of xenial  https://review.openstack.org/62054609:56
*** ganso has joined #openstack-cinder09:58
*** caixiaoyu has quit IRC09:59
*** arne_wiebalck_ has quit IRC10:04
*** dcdamien has joined #openstack-cinder10:05
*** Liang__ has joined #openstack-cinder10:10
*** tobias-urdin has quit IRC10:10
*** e0ne has joined #openstack-cinder10:14
openstackgerritMaxime Guyot proposed openstack/cinder master: Add rbd_data_pool  https://review.openstack.org/53956610:15
*** tobias-urdin has joined #openstack-cinder10:15
openstackgerritRajat Dhasmana proposed openstack/python-brick-cinderclient-ext master: DNM: Test jobs running on bionic instead of xenial  https://review.openstack.org/62054610:16
openstackgerritRajat Dhasmana proposed openstack/cinder-tempest-plugin master: DNM: Test jobs running on bionic instead of xenial  https://review.openstack.org/62054210:18
smcginniswhoami-rajat: We already have jobs running on bionic. Why do we need all those DNM patches?10:23
whoami-rajatsmcginnis: we've some jobs that are still running on xenial as can be seen here cinder-tempest-plugin-lvm-lio for cinder-tempest-plugin10:26
whoami-rajathttp://logs.openstack.org/64/616564/1/check/cinder-tempest-plugin-lvm-lio/3879dde/job-output.txt.gz#_2018-11-08_14_50_32_59997510:26
whoami-rajatsmcginnis:  and brick-cinderclient-dsvm-functional for python-brick-cinderclient-ext10:28
whoami-rajathttp://logs.openstack.org/68/620468/1/check/brick-cinderclient-dsvm-functional/301c4d2/job-output.txt.gz#_2018-11-28_06_53_10_59234510:28
smcginniswhoami-rajat: Yes, but we have jobs that also run on bionic, so there shouldn't be any need to test that.10:28
*** erlon has joined #openstack-cinder10:29
smcginnisAnd I still don't understand what is expected to be tested by depending on a patch that just changes what jobs are run against devstack patches.10:29
whoami-rajatsmcginnis:  The devstack and tempest jobs are being migrated to bionic so all modules are being checked for stability with the release. maybe the description is more clear here http://lists.openstack.org/pipermail/openstack-discuss/2018-November/000168.html10:33
*** jistr is now known as jistr|mtg10:34
openstackgerritLee Yarwood proposed openstack/cinder stable/rocky: lvm: Avoid premature calls to terminate_connection for muiltiattach vols  https://review.openstack.org/61847210:35
openstackgerritLee Yarwood proposed openstack/cinder stable/queens: lvm: Avoid premature calls to terminate_connection for muiltiattach vols  https://review.openstack.org/61847310:36
smcginniswhoami-rajat: Yeah, looks not needed and the comment on one of those patches from Ghanshyam seems to confirm that.10:36
*** caixiaoyu_1 has quit IRC10:46
*** Liang__ has quit IRC10:48
*** caixiaoyu_1 has joined #openstack-cinder10:58
*** Dinesh_Bhor has quit IRC11:42
*** dave-mccowan has joined #openstack-cinder11:44
*** tpsilva has joined #openstack-cinder11:45
openstackgerritErlon R. Cruz proposed openstack/cinder-tempest-plugin master: Adds .idea files to .gitignore  https://review.openstack.org/62057511:46
openstackgerritErlon R. Cruz proposed openstack/cinder-tempest-plugin master: Fix volume revert to snapshot tests  https://review.openstack.org/62057611:46
openstackgerritErlon R. Cruz proposed openstack/cinder-tempest-plugin master: Adds new scenario test for revert to snapshot  https://review.openstack.org/62057711:46
*** e0ne has quit IRC12:09
openstackgerritcaixiaoyu proposed openstack/cinder master: Add test case: extend non-exist volume  https://review.openstack.org/62058412:14
gmannsmcginnis: whoami-rajat actually those DNM patches will test few specific jobs which cinder has dependency on other repo etc. for example cinder-rally-task. this job is different than other jobs running on cinder by doing the checkout of  openstack/rally-openstack master. So 620501 will comfirm when QA team will migrate their base jobs to bionic, cinder-rally-task will not cause any issue. because there is chance that12:20
gmannopenstack/rally-openstack master might have code which does not work on Bionic. so it is better to check cross dependency also to avoid any gate block.12:20
gmannand similarly you can take decision on other repo jobs also if they are cross repo dependency and running on xenial as of now. those DNM patch can give OK to qa team to go ahead and merge the base job on bionic.12:21
gmannif you feel such specific jobs does not make much difference then, we can skip the testing patches12:23
*** brinzh has quit IRC12:34
*** takamatsu has quit IRC12:37
*** takamatsu has joined #openstack-cinder12:43
*** caixiaoyu_1 has quit IRC12:55
*** arne_wiebalck_ has joined #openstack-cinder12:58
*** rosmaita has joined #openstack-cinder13:02
*** e0ne has joined #openstack-cinder13:05
*** Liang__ has joined #openstack-cinder13:13
*** abishop has joined #openstack-cinder13:21
*** jistr|mtg is now known as jistr13:21
e0nejungleboyj, smcginnis: hi. I've got a question about https://bugs.launchpad.net/cinder/+bug/180207013:23
openstackLaunchpad bug 1802070 in openstack-ansible "Add resource_filter field in cinder.conf for non-admin user can retrieve volume & snapshot volume" [Undecided,In progress] - Assigned to KimMinsik (for-beatitudo)13:23
e0nejungleboyj, smcginnis: I suppose, the expected behavior is to reject all filers, isn't it?13:24
*** takamatsu has quit IRC13:29
*** takamatsu has joined #openstack-cinder13:30
tobias-urdin^ i did hit that as well for rocky, pushed patches to RDO to include the resource_filters.json in /etc/cinder and notified the ubuntu team13:31
tobias-urdindont think i ever filed a bug thought but i talked about it here on irc13:31
*** Dinesh_Bhor has joined #openstack-cinder13:43
openstackgerritLiang Fang proposed openstack/cinder master: [WIP] Handle image download and conversion errors  https://review.openstack.org/61897613:44
*** takamatsu has quit IRC13:44
*** takamatsu has joined #openstack-cinder13:48
*** eharney has joined #openstack-cinder13:56
*** Dinesh_Bhor has quit IRC14:10
*** arne_wiebalck_ has quit IRC14:13
*** mriedem has joined #openstack-cinder14:23
*** udesale has quit IRC14:24
*** udesale has joined #openstack-cinder14:25
*** MrRon has joined #openstack-cinder14:29
MrRonHello there. May I ask a question about Cinder database schema as I'm debugging a problem on my side (I'm still quite new to OpenStack).14:31
MrRonIn the End I just want to figure out which file in the git repo of cinder is responsible to create the database and the tables :)14:32
MrRonIs it models.py ?14:32
eharneyMrRon: they're created by the numbered files in cinder/db/sqlalchemy/migrate_repo/versions/14:33
MrRoneharney: Ah ok. So there is no single file which creates the db schema at installation time? I thought the versions dir is used for migrations in case of fixes.14:35
eharneyMrRon: not really, 085 does a bulk of the creation of tables etc, then later numbers make changes on top of that -- they all get applied at installation time14:36
MrRoneharney: Thanks a lot! Now I understand better!14:40
*** dklyle has quit IRC14:47
openstackgerritBrian Rosmaita proposed openstack/cinder master: Correct default policy file  https://review.openstack.org/62045014:51
*** MrRon has quit IRC14:58
_hemnae0ne: did someone delete the resource_filters.json?14:58
_hemnaregarding that bug14:58
e0ne_hemna: looks like it was not copied originally14:59
*** dustins has joined #openstack-cinder15:04
*** dpawlik has quit IRC15:16
*** hedvig_01 has joined #openstack-cinder15:28
*** gkadam has quit IRC15:35
openstackgerritIvan Kolodyazhny proposed openstack/cinder master: Remove deprecated query_volume_filters config option  https://review.openstack.org/62063215:36
*** udesale has quit IRC15:43
*** udesale has joined #openstack-cinder15:43
*** dustins_ has joined #openstack-cinder15:48
*** xyang has joined #openstack-cinder15:50
*** dustins has quit IRC15:50
openstackgerritIvan Kolodyazhny proposed openstack/cinder master: Remove deprecated query_volume_filters config option  https://review.openstack.org/62063215:53
*** hedvig_01 has quit IRC15:54
*** Luzi has quit IRC16:15
*** alkhodos has joined #openstack-cinder16:16
*** Liang__ has quit IRC16:18
*** dpawlik has joined #openstack-cinder16:24
alkhodosHi all! Can someone help me understand why this patch https://review.openstack.org/#/c/586239/ fails openstack-tox-docs test?16:27
smcginnisalkhodos: Did you take a look at the logs?16:28
alkhodossmcginnis: yes, but I struggle to understand the reason16:28
smcginnishttp://logs.openstack.org/39/586239/9/check/openstack-tox-docs/08cafa6/job-output.txt.gz#_2018-11-08_10_24_56_04826616:30
alkhodossmcginnis: but this file was not touched by the patch...16:31
alkhodossmcginnis: am I missing something obvious?16:33
smcginnisalkhodos: I think it's because you removed the code-block directive in nfs.py. Was there a reason for doing that?16:33
*** udesale has quit IRC16:34
alkhodossmcginnis: you're probably right, I'll try putting it back there, thanks16:36
smcginnisalkhodos: Make sure you run tox -e docs locally. That should catch it.16:38
alkhodossmcginnis: I will16:38
*** dpawlik has quit IRC16:42
openstackgerritJon Bernard proposed openstack/cinder master: RBD: add support for multiattach  https://review.openstack.org/59582716:54
alkhodossmcginnis: I've just tried tox -e docs without re-adding the code-block directive and I don't have any errors locally? Is that the right test suite?16:55
smcginnisHmm, should be. I can try running that locally after the meeting is over.16:55
alkhodossmcginnis: I'd really appreciate that, don't want to spam patchsets before finding the issue16:56
*** lbragstad has quit IRC17:02
*** e0ne has quit IRC17:02
*** dpawlik has joined #openstack-cinder17:03
*** pcaruana has quit IRC17:03
*** lbragstad has joined #openstack-cinder17:05
*** dpawlik has quit IRC17:07
openstackgerritHelen Walsh proposed openstack/cinder master: PowerMax driver - rebranding VMAX to PowerMax  https://review.openstack.org/62065917:09
*** KeithMnemonic has quit IRC17:14
*** jackivanov has quit IRC17:28
openstackgerritHelen Walsh proposed openstack/cinder master: PowerMax driver - rebranding VMAX to PowerMax  https://review.openstack.org/62065917:37
openstackgerritSean McGinnis proposed openstack/cinder stable/queens: Remove cinder-tox-compliance job  https://review.openstack.org/62066517:45
*** abhishekk has joined #openstack-cinder17:53
openstackgerritHelen Walsh proposed openstack/cinder master: PowerMax driver - rebranding VMAX to PowerMax  https://review.openstack.org/62065917:55
*** hedvig_01 has joined #openstack-cinder18:02
*** mszwed has quit IRC18:02
hedvig_01Hi, we got a -1 from zuul and it looks like setup error. I did a recheck last night and I still don't see us in the pipeline. Has it been disabled? https://review.openstack.org/#/c/433341/18:03
smcginnishedvig_01: I don't see any rechecks on there.18:04
hedvig_01I replied recheck as a comment18:04
smcginnisOh, nevermind, I see it.18:04
hedvig_01okay18:04
hedvig_01We are not in the pipeline though. I checked the zuul status link18:05
*** dcdamien has quit IRC18:05
smcginnisI wonder if they had to restart zuul last night or something. Try leaving a recheck comment again.18:05
*** rtjure has joined #openstack-cinder18:13
hedvig_01okay thank you18:14
openstackgerritGorka Eguileor proposed openstack/cinder master: Import the cinderlib code  https://review.openstack.org/62066918:17
openstackgerritGorka Eguileor proposed openstack/cinder master: Add cinderlib docs  https://review.openstack.org/62067018:17
openstackgerritGorka Eguileor proposed openstack/cinder master: Add cinderlib functional tests  https://review.openstack.org/62067118:17
*** geguileo has joined #openstack-cinder18:18
*** abhishekk has quit IRC18:18
*** chhagarw has quit IRC18:41
*** preece has joined #openstack-cinder19:03
*** dklyle has joined #openstack-cinder19:03
*** whoami-rajat has quit IRC19:07
*** e0ne has joined #openstack-cinder19:07
mriedemso uh, you can't attach a server to a volume in 'error' status right?19:08
*** lbragstad has quit IRC19:08
mriedembut what happens if you update a volume attachment with a connector to a volume in error status? will that be allowed and the volume status will change to 'attaching'?19:08
mriedemhard to tell from the code, but that seems to be what happens in the cinder db api code19:09
mriedemin the volume_attached() method19:09
jungleboyjmriedem:  Hmmm, I don't think we would want to allow attachment of a volume in error status regardless.19:10
mriedemwell, i'm thinking through the rebuild/reimage flow,19:10
jungleboyjOk ...19:10
mriedemthe server is going to hold an empty volume attachment record to the volume while it's being reimaged so we don't lose the volume19:10
mriedemto another server19:10
mriedemif the reimage fails and the volume goes to error status,19:10
mriedemi was wondering if nova should update the empty attachment to have the host connector again, but i think that will put the volume in 'attaching' status rather than error19:11
mriedemwhich would be bad probably19:11
*** lbragstad has joined #openstack-cinder19:12
*** lbragstad has quit IRC19:12
mriedemalso,19:13
*** rosmaita has left #openstack-cinder19:14
*** lbragstad has joined #openstack-cinder19:14
mriedemit looks like if this happens, the admin fixes the backend and then wants to reset the volume status to 'reserved' using the os-reset_status volume action API, they can't do that19:14
*** lbragstad has quit IRC19:14
mriedembecause the 'reserved' status is not in this list https://github.com/openstack/cinder/blob/master/cinder/objects/fields.py#L16819:14
mriedembut 'reserved' is definitely a valid volume status right?19:14
*** pck has quit IRC19:14
*** luizbag has quit IRC19:14
mriedemit's in the api-ref at least https://developer.openstack.org/api-ref/block-storage/v3/?expanded=reset-a-volume-s-statuses-detail#volumes-volumes19:14
mriedemand this https://developer.openstack.org/api-ref/block-storage/v3/?expanded=reset-a-volume-s-statuses-detail#reserve-volume19:14
*** e0ne has quit IRC19:15
*** erlon has quit IRC19:15
*** lbragstad has joined #openstack-cinder19:16
*** lbragstad has quit IRC19:16
jungleboyjHmmm, that is interesting that we can't change the status of a reserved volume.  Seems like that should be valid.19:17
*** e0ne has joined #openstack-cinder19:17
*** e0ne has quit IRC19:18
jungleboyjBut if it is listed in the API it shoudl work.  Right?19:19
jgriffithmriedem: I odn't remember *for sure* but it shouldn't toggle the volume status, on the attach-status19:20
jgriffithwhich is "good"19:20
jgriffithThe API shouldn't allow subsequent attach calls based on the status check19:20
jgriffithmriedem: I can test that out, see if reserve/update attachment works when voume status=error, but for some reason I thougt we checked that at the API layer19:21
mriedemjungleboyj: the os-reset_status API reference just says you can update the status, not what the valid values are19:23
mriedembut looking at https://developer.openstack.org/api-ref/block-storage/v3/?expanded=reset-a-volume-s-statuses-detail,reserve-volume-detail#volumes-volumes19:23
mriedemer https://developer.openstack.org/api-ref/block-storage/v3/#volumes-volumes19:24
mriedemi would think any of those are fair game19:24
mriedemjgriffith: maybe attachment_create but i'm not seeing volume status checks in attachment_update19:24
jungleboyjmriedem: That would be my expectation as well but I don't know the API that well.  :-(19:24
jgriffithhttps://github.com/openstack/cinder/blob/master/cinder/volume/api.py#L68319:24
jgriffithOh.. hmm19:25
mriedemyeah reserve_volume is os-reserve actoin, which is legacy19:25
mriedemhttps://github.com/openstack/cinder/blob/master/cinder/volume/api.py#L206919:25
mriedemis attachment_create19:25
mriedembut i think, from what i'm looking at in code, that one could update an attachment on an error'ed volume and it will change the volume status to 'attaching'19:26
mriedemhttps://github.com/openstack/cinder/blob/master/cinder/db/sqlalchemy/api.py#L158119:26
jgriffithmriedem: I think you may be correct :(19:27
mriedemget out the party hats people19:27
jgriffithLOL19:27
*** dklyle has quit IRC19:27
jgriffithNahh, that's for when you're actually wrong about something19:27
jgriffith:)19:27
jungleboyjHe he.19:27
mriedemjungleboyj: https://bugs.launchpad.net/cinder/+bug/180569219:29
openstackLaunchpad bug 1805692 in Cinder "Unable to reset volume status to 'reserved'" [Medium,Triaged]19:29
jungleboyjmriedem:  Got it.  Thanks.19:30
*** erlon has joined #openstack-cinder19:30
*** rosmaita has joined #openstack-cinder19:46
*** erlon has quit IRC19:52
*** eharney has quit IRC19:59
*** eharney has joined #openstack-cinder20:11
*** e0ne has joined #openstack-cinder20:19
*** e0ne has quit IRC20:20
imacdonneharney: you around?20:23
imacdonnwill ramble a bit, for consumption whenever .... regarding cascading delete, following up from yesterday20:26
imacdonnthe issue is that, with some backends (e.g. Oracle ZFSSA), a volume created from a snapshot remains dependent on that snapshot ... in fact, in the ZFSSA case, the backend only actually stores deltas since the snapshot20:27
imacdonncinder, or at least the unit tests, seem to assume that a volume created from a snapshot becomes an independent entity20:27
eharneyvolumes created from snapshots have to be independent of the source snapshot/volume20:28
smcginnisThe storage I used to maintain works that way too, but I could still mark that snapshot as deleted.20:28
smcginnisIt just wouldn't go away until any other dependent volumes were also deleted.20:28
eharneyright, which is a fine way to handle that20:28
imacdonnso that's where we hit an impasse20:28
imacdonnhmm, mark as deleted ... where ?20:29
*** lbragstad has joined #openstack-cinder20:30
smcginnisIn my case, the backend allowed that to happen. eharney, didn't the ceph driver need to do something special to handle this?20:30
eharneyi don't think so?20:30
eharneywell, the rbd does do some form for marking either volumes or snaps as deleted when they aren't yet, so they can be cleaned up later20:31
eharneybut what i'm saying is that from the Cinder API POV, they are independent20:31
smcginnisThat must be what I was thinking of.20:31
smcginnisVery similar to how my old storage worked.20:31
eharneythe important part is that the semantics of cinder API calls work as expected, the driver can make that happen however is needed20:32
smcginnis++20:32
imacdonnis the expected behaviour documented somewhere?20:33
imacdonnit feels wrong to me, so call something deleted when it really still exists20:34
imacdonns/so/to/20:34
imacdonnI guess you're saying that "it's dead to cinder"20:35
*** openstackgerrit has quit IRC20:36
eharneyyeah, from Cinder's POV it's deleted20:36
imacdonnI guess maybe I can make the driver check, when asked to delete a volume, if it has any snapshots that have dependent children, and only actually delete it if there are none .... bit concerned about creating orphans .. I'll look into it20:38
jungleboyjimacdonn:  It is really a question of whether it is managed by Cinder.  If we have deleted it ... no.20:39
imacdonn"orphans" isn't the right word ... leaving behind parents that never get cleaned up20:39
*** dcdamien has joined #openstack-cinder20:39
jungleboyjBut your concern is right.20:39
eharneywell, the driver needs to make sure they get cleaned up at some point20:39
imacdonnI don't know of any way to trigger "at some point" for a volume that cinder has already forgotten20:40
*** e0ne has joined #openstack-cinder20:40
imacdonnso I have a volume "A", that I snapshot'ed, then created "B" and "C" from the snapshot20:41
imacdonnI then delete "A" ... cinder believes it no longer exists, but the backend has to keep it "for now"20:41
smcginnisZFFSA doesn't have any way to "delete" the snapshot and have it get cleaned up once those other volumes go away?20:41
imacdonnlater, I delete "B".... I suppose I have to look up through it's ancestry to determine that it has a parent volume .. then determine if that parent volume has other children, and if not, delete it ... but only if it's been deleted from cinder already20:42
imacdonnsmcginnis: not that I know of20:42
eharneythe driver would have to associate A with B somehow to keep track of it, when A was deleted20:42
imacdonnthe "keeping track of" is the problem .. how's it supposed to do that? It doesn't have a database....20:43
eharneythe RBD driver does this by renaming the object on the backend to have a name that ends with ".deleted", and then knows it can trash those later when they are in the parent chain of another thing being deleted20:45
imacdonnthat may be a possibility20:45
*** e0ne has quit IRC20:49
imacdonnI'll look into it .. thanks20:49
alkhodosimacdonn: also, zfs should be able to promote datasets to get ownership of snapshots. So your clone will become the parent of snapshot and the original volume can be deleted after that.20:54
imacdonnalkhodos: pretty sure that's not possible with zvols (cinder volumes are zvols, not datasets)20:56
alkhodosimacdonn: we do that for zvols in NexentaStor (which is ZFS based)20:57
alkhodosimacdonn: keep it mind that it can become complicated with large number of zvols/snapshots20:58
imacdonnalkhodos: yeah, I can see it being complicated w.r.t. space management, at least ... I'm not sure if that ZFS capability is exposed in the ZFS Storage Appliance ... I'm fairly sure it was not at one point in the past, but maybe it got added20:59
alkhodosimacdonn: yes, we had some difficulties with promote at some point too. Problem with renaming for later deletion is that when you have a large tree of zvols, snapshot, then multiple clones from that snapshot, then snapshots again etc, those zvols and snapshots tend to stay there forever21:01
imacdonnalkhodos: yeah, I was pondering that too21:02
alkhodosimacdonn: so we figured that correct promote usage is the only real option, just sharing ;)21:03
imacdonnalkhodos: will take that into consideration - thanks!21:03
alkhodossmcginnis: did you get a chance to run that tox -e docs test for my patch? Sorry for being annoying...21:04
alkhodosimacdonn: sure, np21:04
jungleboyjalkhodos:  What was the patch?21:05
*** dustins_ has quit IRC21:05
smcginnisSorry, been non-stop meetings. I'll pull that down quick now while someone else has the floor. :)21:05
alkhodosjungleboyj: https://review.openstack.org/#/c/586239/21:05
alkhodossmcginnisL thanks! sorry for the distraction21:05
smcginnisI don't mind being distracted from this meeting. ;)21:06
jungleboyjalkhodos:  Trying.21:06
smcginnisI get the error.21:07
alkhodossmcginnis: running on devstack?21:07
smcginnis?21:07
smcginnisIt's a doc build error. tox -e docs21:08
alkhodosI thought I needed to run tox -e docs from cinder location, no?..21:08
smcginnisI guess it depends what you mean by cinder location. At the root of the cinder repo, you run the command tox -e docs, just like running the unit tests.21:10
alkhodosyep, that's what I did. Very strange, I'll look into it21:10
alkhodosthanks!21:10
imacdonn2018-11-08 10:24:56.048266 | ubuntu-xenial | /home/zuul/src/git.openstack.org/openstack/cinder/doc/source/drivers.rst:1251:Unexpected indentation.21:19
imacdonn2018-11-08 10:24:57.012447 | ubuntu-xenial | ERROR: InvocationError for command '/home/zuul/src/git.openstack.org/openstack/cinder/.tox/docs/bin/sphinx-build -W -b html doc/source doc/build/html' (exited with code 2)21:19
imacdonnalkhodos ^^21:19
*** eharney has quit IRC21:20
jungleboyjI saw that too.21:21
imacdonnalthough that file is not modified in the change .. hmmm21:21
*** e0ne has joined #openstack-cinder21:21
imacdonnthere's also: Error when trying to get requirement for VCS system Command "git config --get-regexp remote\..*\.url" failed with error code 1 in /home/zuul/src/git.openstack.org/openstack/cinder, falling back to uneditable format,Could not determine repository location of /home/zuul/src/git.openstack.org/openstack/cinder21:21
*** e0ne has quit IRC21:21
*** ganso has quit IRC21:22
alkhodosimacdonn: thanks, Sean gave me an idea of what could cause that, it's just that I didn't get the error locally. Re-running it atm to see if proposed fix helps21:22
imacdonnk, good luck :)21:23
alkhodosimacdonn: thx :)21:23
*** mchlumsky has quit IRC21:25
*** e0ne has joined #openstack-cinder21:26
*** e0ne has quit IRC21:27
smcginnisThat file is dynamically generated at doc build time to create the driver list: https://docs.openstack.org/cinder/latest/drivers.html21:30
smcginnisLooking at the generated file, it's not happy with the formatting of the list.21:30
alkhodossmcginnis:  yep, just found this out21:30
jungleboyjsmcginnis:  ++21:30
smcginnisalkhodos: Yep, adding the code-block directives back fixes the issue.21:33
*** lemko has quit IRC21:35
*** lbragstad has quit IRC21:37
*** lbragstad has joined #openstack-cinder21:37
*** rcernin has joined #openstack-cinder21:50
*** openstackgerrit has joined #openstack-cinder21:55
openstackgerritAlexey Khodos proposed openstack/cinder master: Refactored NexentaStor5 driver  https://review.openstack.org/58623921:55
*** rcernin has quit IRC22:03
*** abishop has quit IRC22:11
*** rcernin has joined #openstack-cinder22:11
*** rcernin has quit IRC22:11
*** rcernin has joined #openstack-cinder22:12
*** tpsilva has quit IRC22:22
mriedemsmcginnis: you might enjoy this https://github.com/openstack/nova/commit/eadbacbda628ecc969a980378faf55bc02f514bf22:38
smcginnismriedem: Woot!22:39
mriedemit's like i traveled back in time22:40
smcginnismriedem: So it does really only work with the v3 api now?22:41
smcginnisAnd I could have removed that check for v2 when I removed v1...22:42
*** Reepicheep has quit IRC22:45
mriedemumm, you could push a devstack change quick to test it,22:45
mriedemconfigure nova.conf with [cinder]catalog_info=volumev2:cinderv2:publicURL22:45
*** slaweq has quit IRC22:46
mriedemi think it would fail though since we check the version and fail if it's not 3 when constructing our internal cinderclient22:47
mriedemand we default to using 3.0 for all requests22:48
*** N3l1x has quit IRC23:17
imacdonnre cascading delete, just noticed this irony, given earlier mention of rbd...23:37
imacdonn    @testtools.skipIf(CONF.volume.storage_protocol == 'ceph',23:37
imacdonn                      'Skip because of Bug#1677525')23:37
imacdonn    def test_volume_from_snapshot_cascade_delete(self):23:37
*** erlon has joined #openstack-cinder23:38
*** slaweq has joined #openstack-cinder23:55

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!