Tuesday, 2015-05-12

*** esker has joined #openstack-manila00:03
*** esker has quit IRC00:10
*** esker has joined #openstack-manila00:10
*** ganso has joined #openstack-manila00:13
*** esker has quit IRC00:14
*** ganso has quit IRC00:27
*** akerr has joined #openstack-manila00:50
*** akerr_ has joined #openstack-manila00:52
*** akerr has quit IRC00:55
*** ChanServ changes topic to "#openstack-manila"00:55
-openstackstatus- NOTICE: Gerrit has been downgraded to version 2.8 due to the issues observed today. Please report further problems in #openstack-infra.00:55
*** tobe has joined #openstack-manila00:58
*** mtanino has quit IRC01:10
*** jasonsb has quit IRC01:59
*** jitao has joined #openstack-manila02:37
*** jasonsb has joined #openstack-manila02:54
*** cknight has joined #openstack-manila03:09
*** Zhongjun has joined #openstack-manila03:09
*** Zhongjun has quit IRC03:14
*** Zhongjun has joined #openstack-manila03:14
*** zaitcev has quit IRC03:24
*** marcusvrn has joined #openstack-manila03:38
*** cknight has quit IRC03:39
*** cknight has joined #openstack-manila03:39
*** bill_az has quit IRC03:41
*** dalgaaf has quit IRC03:47
*** marcusvrn has quit IRC03:54
jitaoHi, who have a valid link about ubuntu_1204_nfs_cifs.qcow2. I can't download it from dropbox, tks04:01
*** haomai___ has quit IRC04:03
*** bill_az has joined #openstack-manila04:05
*** akerr_ has quit IRC04:14
openstackgerritClinton Knight proposed openstack/manila: Add doc for network plugins  https://review.openstack.org/17116604:17
*** cknight has quit IRC04:19
*** tobe has quit IRC04:52
*** 5EXAA60VI has joined #openstack-manila04:52
*** lpetrut has joined #openstack-manila04:55
*** sks has joined #openstack-manila05:01
*** rraja has joined #openstack-manila05:09
*** nkrinner has joined #openstack-manila05:20
*** deepakcs has joined #openstack-manila05:24
*** sgotliv has joined #openstack-manila06:09
*** tobe has joined #openstack-manila06:19
*** tobe has quit IRC06:19
*** csaba2 is now known as csaba106:27
*** bill_az has quit IRC06:29
*** vbellur has quit IRC06:58
*** tobe43 has joined #openstack-manila07:00
*** vbellur has joined #openstack-manila07:05
*** vbellur has quit IRC07:11
*** vbellur has joined #openstack-manila07:26
*** lpetrut has left #openstack-manila07:37
*** rraja has quit IRC07:50
*** rraja has joined #openstack-manila07:52
*** openstackstatus has quit IRC07:52
*** openstack has joined #openstack-manila07:54
*** vponomaryov has joined #openstack-manila08:19
csaba1toabctl: ping08:46
*** rraja has quit IRC08:58
*** jitao has quit IRC09:05
*** jitao__ has quit IRC09:05
*** jitao_ has quit IRC09:05
*** tobe43 has quit IRC09:31
toabctlcsaba1: pong09:40
csaba1toabctl: I answered to your comment on https://review.openstack.org/165482, can you pls take a look at it?09:41
csaba1toabctl: thx!10:37
toabctlcsaba1: ah. forgot to mention the I answered!10:38
csaba1yep np I noticed10:38
*** rcallawa has joined #openstack-manila10:39
*** rcallawa_ has joined #openstack-manila10:39
*** rcallawa has quit IRC10:43
openstackgerritCsaba Henk proposed openstack/manila: ganesha: Add doc  https://review.openstack.org/16548210:49
openstackgerritValeriy Ponomaryov proposed openstack/manila: Release Neutron ports after share server deletion using generic driver  https://review.openstack.org/18147010:53
openstackgerritValeriy Ponomaryov proposed openstack/manila: Release Neutron ports after share server deletion using generic driver  https://review.openstack.org/18147011:08
openstackgerritValeriy Ponomaryov proposed openstack/manila: Fix share-server resources cleanup in generic driver  https://review.openstack.org/18138011:13
openstackgerritValeriy Ponomaryov proposed openstack/manila: Release Neutron ports after share server deletion using generic driver  https://review.openstack.org/18147011:14
openstackgerritValeriy Ponomaryov proposed openstack/manila: Fix share-server resources cleanup in generic driver  https://review.openstack.org/18138011:14
openstackgerritValeriy Ponomaryov proposed openstack/manila: Release Neutron ports after share server deletion using generic driver  https://review.openstack.org/18147011:14
*** timcl has joined #openstack-manila11:25
*** marcusvrn has joined #openstack-manila11:30
*** marcusvrn has quit IRC11:31
*** marcusvrn has joined #openstack-manila11:31
*** deepakcs has quit IRC11:44
*** rcallawa_ has quit IRC11:56
*** Zhongjun has quit IRC11:59
*** lpetrut has joined #openstack-manila12:03
*** lpetrut has quit IRC12:05
*** fthiagogv has joined #openstack-manila12:05
*** bswartz has quit IRC12:12
*** akerr has joined #openstack-manila12:29
openstackgerritValeriy Ponomaryov proposed openstack/manila: [WIP] Debug no-share-servers tempest job  https://review.openstack.org/18226312:34
openstackgerritIgor Malinovskiy proposed openstack/manila: Provide private data storage API for drivers  https://review.openstack.org/17687712:50
*** bswartz has joined #openstack-manila12:51
*** rcallawa has joined #openstack-manila12:52
*** rcallawa has quit IRC12:53
*** rcallawa has joined #openstack-manila12:54
*** rcallawa has quit IRC12:55
*** rcallawa has joined #openstack-manila12:57
*** cknight has joined #openstack-manila12:57
*** ganso has joined #openstack-manila13:12
*** timcl has quit IRC13:23
*** dustins has joined #openstack-manila13:37
*** rushil has joined #openstack-manila13:41
openstackgerritMerged openstack/manila: Add doc for network plugins  https://review.openstack.org/17116613:43
*** rushil has quit IRC13:47
*** Zhongjun has joined #openstack-manila13:53
*** rushil has joined #openstack-manila14:16
*** deepakcs has joined #openstack-manila14:21
*** lpetrut has joined #openstack-manila14:28
openstackgerritOpenStack Proposal Bot proposed openstack/manila: Updated from global requirements  https://review.openstack.org/18194814:30
openstackgerritValeriy Ponomaryov proposed openstack/manila: [WIP] Debug no-share-servers tempest job  https://review.openstack.org/18226314:36
*** mtanino has joined #openstack-manila14:45
*** deepakcs has quit IRC14:54
*** nkrinner has quit IRC14:55
*** dustins_ has joined #openstack-manila15:02
*** rushil_ has joined #openstack-manila15:04
*** dustins has quit IRC15:05
*** sks has quit IRC15:06
*** rushil has quit IRC15:06
*** ganso has quit IRC15:08
*** vbellur has quit IRC15:17
*** jasonsb has quit IRC15:17
*** juzuluag has joined #openstack-manila15:18
*** jasonsb has joined #openstack-manila15:18
*** lpetrut has left #openstack-manila15:19
*** jasonsb has quit IRC15:22
*** jasonsb has joined #openstack-manila15:22
*** rraja has joined #openstack-manila15:23
*** esker has joined #openstack-manila15:28
*** ganso has joined #openstack-manila15:38
*** zaitcev has joined #openstack-manila15:43
*** vbellur has joined #openstack-manila15:44
gansovponomaryov: ping15:45
vponomaryovganso: pong15:46
gansoI am reading your comments, thanks a lot for the review :)15:46
vponomaryovnp15:46
gansothere are two or three comments that I led me to notice that there is a certain confusion around the migration approach15:46
gansothere is a temporary share DB entry15:47
gansowe will discuss this @ Vancouver15:48
gansobut in summary:15:48
gansothe generic approach is to create a totally new share in the dest backend, mount both shares, copy data over, delete the old physical share and the new DB entry, thus it will remain only the original DB entry (original ID), and the new physical share... this is the same approach as Cinder's15:50
gansothe only thing that is temporary is the new share DB entry. The physical share itself is not temporary15:51
vponomaryovganso: this - https://review.openstack.org/#/c/176877/ will allow us to avoid creation of "temp" share in DB15:53
vponomaryovganso: so, I guess, there is no need to use "this", Cinder's approach15:54
*** vbellur has quit IRC15:54
vponomaryovganso: also, what do you think about proposal fol "general" "task state" instead of "migration_status" share field?15:55
*** rushil_ has quit IRC15:56
gansovponomaryov: the approach certainly can be improved, when I started prototyping it, Private Share Data was still being discussed as a concept15:56
vponomaryovganso: now, it is ready to be merged15:56
vponomaryovganso: just no review activity so far =)15:57
gansoI have taken a look at it, it still has to be rebased, right?15:57
*** rushil has joined #openstack-manila15:58
gansovponomaryov: I am not familiar with the task_state field from nova, the concept of "migration_status" as used in Cinder was easy enough for me to understand15:58
vponomaryovganso: it is not at the HEAD of master branch, but there is no need to rebase it.15:58
vponomaryovganso: it says what being performed with a share (instance)15:59
gansovponomaryov: it looks quite behind, there may be conflicts during merge15:59
gansovponomaryov: I had several problems rebasing Share_migration15:59
gansotask_state = "migrating" for instance?15:59
vponomaryovganso: I answered about rebase of "driver private data" =)16:00
vponomaryovganso: right16:00
gansovponomaryov: you are right, that looks better, lemme check if this field already exist16:00
*** cknight has quit IRC16:00
vponomaryovganso: not in manila16:00
vponomaryovganso: it should be separate change16:01
*** dustins_ has quit IRC16:01
vponomaryovganso: add field in general, then reuse it for migration functionality16:01
gansoyea maybe I could submit another patch with that field, and migration would be the first to use it16:01
vponomaryovganso: picking from mind =)16:01
gansovponomaryov: thanks a lot for these suggestions :)16:01
gansovponomaryov: as for the temporary DB entry, there is still one concerning detail16:02
*** cknight has joined #openstack-manila16:02
vponomaryovwhich one?16:02
*** dustins has joined #openstack-manila16:03
*** dustins has quit IRC16:04
gansovponomaryov: I believe that drivers will still need to get acquainted with private share data in order for this to be compatible, for instance, drivers currently may be used to storing information in the DB during share creation, the approach taken from Cinder is because drivers add backend-specific metadata to Volumes during volume creation. We do not have that with shares, but I was worried that might be a problem.16:04
gansovponomaryov: Either way, it is easy to change that, I can make it skip DB entry creation when creating the new physical share in dest backend16:04
vponomaryovganso: support of "migration" is absent in drivers too16:05
*** dustins has joined #openstack-manila16:05
vponomaryovganso: so, no problems =)16:05
gansovponomaryov: yes, very well observed hehe16:06
vponomaryovganso: support of "migration" feature in drivers can be implemented using "driver private storage"16:06
gansovponomaryov: sometimes i think too far ahead16:06
gansovponomaryov: isn't that only related to additional metadata storage?16:07
vponomaryovganso: I did not get, what "it" is related to additional metadata storage?16:08
ganso"driver private storage"16:09
gansovponomaryov: it is supposed to store only metadata added by driver/manager, correct?16:09
vponomaryovit is the same16:09
*** Zhongjun has quit IRC16:09
vponomaryovganso: right16:09
vponomaryovganso: no user interface16:09
vponomaryovganso: only driver-visible16:09
vponomaryovganso: driver/manager16:10
gansovponomaryov: great, so the part about obtaining information from backends, like network path and mount command, can be stored there, instead of running a command in the dest backend to retrieve it.16:10
vponomaryovganso: network path?16:11
vponomaryovganso: you mean export location?16:11
*** openstackgerrit_ has quit IRC16:11
gansovponomaryov: network path between the node that is mounting and the backend. The Node mounting needs to be able to reach the export location IP address16:12
gansovponomaryov: when we create a share, we expect the VMs inside openstack to mount it16:13
gansovponomaryov: we usually do not expect a controller or an admin-node to mount it16:13
vponomaryovganso: network availability is a must, but, Manila should not change any networking routes16:13
vponomaryovalso, I am not sure that we should strictly use "manila node" for it16:14
*** dustins has quit IRC16:14
gansovponomaryov: Manila does not, it is up to driver, same as generic driver creates a VIF so the Manila-shr node can SSH into the share server16:14
vponomaryovganso: admin should be able to specify some specific host/VM that will perform migration operation16:14
gansovponomaryov: we will not, as bswartz suggested, we will only integrate manila when we have a Data Copy Service running16:15
gansovponomaryov: integrate *share_migration to manila16:15
gansovponomaryov: in the generic driver implementation, I use the same IP address as the Manila-shr uses to SSH into the share servers, that is the network path.16:17
vponomaryovganso: what about absen of share servers?16:17
vponomaryovs/absen/absence?16:18
vponomaryovganso: second driver mode16:18
gansovponomaryov: also up to driver, in generic driver implementation (https://review.openstack.org/#/c/179791/), since all manual share server parameters are set through manila.conf, the network path also is. So the IP address to reach the VM needs to be set in manila.conf as well16:20
openstackgerritIgor Malinovskiy proposed openstack/manila: Add share extend API  https://review.openstack.org/18237716:20
gansovponomaryov: currently it seems like a lot of work for a driver to support migration, but with "driver private share data" we will greatly simplify it16:21
vponomaryovganso: Did you consider not file-based migration but some byte-copying?16:22
gansovponomaryov: Yes, that was very troublesome... mainly because Share Backends understand filesystems, not block storage.16:23
gansovponomaryov: When we copy a file from Filesystem X to Filesytem Y, this works because both filesystems understand files, they may lose some information like timestamp, access permissions, or some other filesystem-related metadata, but they can be copied, it like copying from NTFS to FAT32.16:24
gansovponomaryov: but if we copy all blocks from the underlying volume in share X to the underlying volume in share Y, and share Y's backend is not familiar with the filesystem when attempting to read it, then it is not going to work16:25
gansothe "driver migration" approach is free to do that16:26
gansovponomaryov: but the generic migration should not16:26
*** jasonsb has quit IRC16:29
vponomaryovganso: "share backends" are also "block storages"16:29
vponomaryovganso: also we can verify "compatibility"16:30
*** jasonsb has joined #openstack-manila16:30
vponomaryovganso: "mount" operation is some-kind of work-around for "migration" operation, IMHO16:31
gansovponomaryov: I checked this on 2 Share backend types I work here, one is a NAS backend, and moving block storage among them was not supported by either16:31
*** rushil has quit IRC16:32
vponomaryovganso: we do not need "moving" indeed, we need copy data by any means16:32
gansovponomaryov: so far, the mount operation is what I found to work when one backend does not know anything about the other. The driver migration is up to move block storage if it finds it understands the destination backend and can do so16:32
vponomaryovganso: so,  I guess, Manila's migration should be able to provide different "types" of migration16:33
vponomaryovganso: it is very likely to have same types of backends, but in different DCs16:34
gansovponomaryov: Cinder attaches both volumes to the Cinder node, it would be easier to do the same in Manila, just copy files from one share to the other without having to mount them, but that would be likely impossible when they are not in the same manufacturer backend16:34
vponomaryovganso: and we may want to perform evacuation from one of DCs16:34
*** jasonsb has quit IRC16:34
gansovponomaryov: sorry, what is a "DC"?16:34
vponomaryovdata center16:34
gansovponomaryov: oh, hehe, thanks16:35
gansovponomaryov: @ Vancouver we will discuss migrating from one protocol to another, but that feels like it would follow the same rule: generic migration should not change protocols, if driver knows where it is migrating to, it is free to do it16:36
gansovponomaryov: since as bswartz once said that cloud providers usually have several storage / share backends from the same vendors (although not all of them may be from the same vendors), the driver migration approach may be used a lot, if it is implemented by vendor16:37
gansovponomaryov: and the generic approach may be less used, like when share type to a very different one16:38
gansovponomaryov: * like when changing share type16:38
gansovponomaryov: overall I am pretty sure a lot will change over time in this share_migration subject, there is still a lot to be improved16:39
openstackgerritValeriy Ponomaryov proposed openstack/manila: [WIP] Debug no-share-servers tempest job  https://review.openstack.org/18226316:43
*** dustins has joined #openstack-manila16:43
*** dustins has quit IRC16:43
vponomaryovganso: thanks for interesting discussion16:44
gansovponomaryov: np! feel free to add more suggestions to share migration :)16:46
*** timcl has joined #openstack-manila16:48
openstackgerritChuck Fouts proposed openstack/manila: NetApp cDOT driver fails Tempest cleanup on clone workflows  https://review.openstack.org/17882516:49
cknightvponomaryov: ^^ This is the patch we need to get our Manila CI reporting to upstream Gerrit.  We'd like to do that before the summit.16:51
openstackgerritIgor Malinovskiy proposed openstack/manila: Implement extend_share() method in Generic driver  https://review.openstack.org/18238316:54
vponomaryovcknight: LGTM, +2'd17:00
cknightvponomaryov: Excellent, thanks!17:01
*** esker has quit IRC17:02
*** vponomaryov has quit IRC17:02
*** csaba1 has quit IRC17:02
*** csaba1 has joined #openstack-manila17:02
*** esker has joined #openstack-manila17:03
*** marcusvrn has quit IRC17:03
*** vponomaryov has joined #openstack-manila17:03
*** juzuluag has quit IRC17:07
*** rushil has joined #openstack-manila17:17
*** marcusvrn has joined #openstack-manila17:22
*** timcl has quit IRC17:25
*** vbellur has joined #openstack-manila17:25
*** jasonsb has joined #openstack-manila17:28
*** ganso has quit IRC17:31
*** timcl has joined #openstack-manila17:42
*** juzuluag has joined #openstack-manila17:42
*** vbellur has quit IRC17:43
*** chlong has quit IRC17:46
*** chlong has joined #openstack-manila17:59
*** timcl1 has joined #openstack-manila17:59
*** timcl has quit IRC18:01
*** fthiagogv has quit IRC18:04
*** rhagarty has quit IRC18:20
*** ganso has joined #openstack-manila18:25
*** ganso has quit IRC18:29
*** rhagarty has joined #openstack-manila18:29
openstackgerritMerged openstack/manila: NetApp cDOT driver fails Tempest cleanup on clone workflows  https://review.openstack.org/17882518:44
*** rushil has quit IRC18:48
*** juzuluag has quit IRC18:48
*** rushil has joined #openstack-manila18:49
*** rraja has quit IRC18:49
*** jasonsb has quit IRC18:56
*** jasonsb has joined #openstack-manila18:59
openstackgerritValeriy Ponomaryov proposed openstack/manila: [WIP] Debug no-share-servers tempest job  https://review.openstack.org/18226319:00
*** timcl1 has quit IRC19:05
*** ganso has joined #openstack-manila19:06
*** timcl has joined #openstack-manila19:10
*** rushil has quit IRC19:10
*** openstackgerrit_ has joined #openstack-manila19:16
*** rushil has joined #openstack-manila19:19
*** openstackgerrit_ has quit IRC19:25
openstackgerritValeriy Ponomaryov proposed openstack/manila: [WIP] Debug no-share-servers tempest job  https://review.openstack.org/18226319:29
*** rcallawa_ has joined #openstack-manila19:30
*** ganso has quit IRC19:33
*** ganso has joined #openstack-manila19:33
*** rcallawa has quit IRC19:34
*** marcusvrn has quit IRC19:37
*** marcusvrn has joined #openstack-manila19:46
*** timcl has quit IRC19:48
*** timcl has joined #openstack-manila19:49
*** rcallawa_ has quit IRC19:49
*** rcallawa has joined #openstack-manila19:51
*** ganso has quit IRC19:57
*** ganso has joined #openstack-manila19:57
*** rcallawa has quit IRC20:05
*** lpetrut has joined #openstack-manila20:06
*** rcallawa has joined #openstack-manila20:07
*** lpetrut has quit IRC20:09
openstackgerritBen Swartzlander proposed openstack/manila: Update Quickstart guide  https://review.openstack.org/18244020:18
*** rcallawa has quit IRC20:26
*** timcl has quit IRC20:28
*** logan2 has quit IRC20:33
*** openstackgerrit has quit IRC20:37
*** openstackgerrit has joined #openstack-manila20:37
*** dustins has joined #openstack-manila20:45
*** sgotliv has quit IRC20:49
*** ganso has quit IRC20:57
*** cknight has quit IRC20:58
*** rcallawa has joined #openstack-manila21:00
*** dustins has quit IRC21:06
*** akerr has quit IRC21:11
*** vbellur has joined #openstack-manila21:14
*** bswartz has quit IRC21:15
*** rcallawa has quit IRC21:21
*** rcallawa has joined #openstack-manila21:21
*** chlong has quit IRC21:24
*** rushil has quit IRC21:30
*** rushil has joined #openstack-manila21:32
*** cknight has joined #openstack-manila21:43
*** cknight has quit IRC21:43
*** cknight has joined #openstack-manila21:44
*** rushil has quit IRC22:10
*** cknight has quit IRC22:12
*** logan2 has joined #openstack-manila22:18
*** esker has quit IRC22:29
*** cknight has joined #openstack-manila22:29
*** cknight has quit IRC22:30
*** cknight has joined #openstack-manila22:31
*** cknight has quit IRC22:43
*** chlong has joined #openstack-manila23:15
*** esker has joined #openstack-manila23:16
*** esker has quit IRC23:22
*** bswartz has joined #openstack-manila23:33
*** akerr has joined #openstack-manila23:36
*** akerr_ has joined #openstack-manila23:38
*** akerr has quit IRC23:41
*** jasonsb has quit IRC23:42

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!