Friday, 2016-11-18

*** tinwood has quit IRC00:00
*** tinwood has joined #openstack-manila00:02
*** xyang_ has quit IRC00:08
*** alyson_ has joined #openstack-manila00:10
*** catintheroof has joined #openstack-manila00:11
*** tuanluong has joined #openstack-manila00:35
TommyLikeHuping00:42
*** catintheroof has quit IRC00:54
marksturHi Tommy00:55
*** chlong has quit IRC01:11
*** akapil has joined #openstack-manila01:39
*** akapil has quit IRC01:44
TommyLikeHuping markstur, tbarron, zengyingzhe_, bswartz01:47
TommyLikeHuIf we add extra_specs 'ip_support' in share type, I am confused which one should be the default value without declaratiom01:47
*** zhugaoxiao has quit IRC01:47
TommyLikeHunone or 4, which one is more reasonable, do you have any suggestion?01:48
bswartzTommyLikeHu: I propose ipv4_support and ipv6_support01:52
bswartznot ip_support01:53
TommyLikeHubswartz: I am ok with it01:54
TommyLikeHuhow about the default value (used for the existed share type..)01:54
*** xyang_ has joined #openstack-manila01:55
*** xyang_ has quit IRC01:57
zengyingzhe_TommyLikeHu, so we'll have two individual extra specs, ipv4_support and ipv6_support?02:17
TommyLikeHuyes02:17
zengyingzhe_TommyLikeHu, that's OK to me.02:17
TommyLikeHuand this is not the main concern around this spec02:18
bswartzTommyLikeHu: existing drivers should report capabilities ipv4_support=True and ipv6_support=False02:21
bswartzthe extra specs should have no default value02:21
TommyLikeHuok02:22
TommyLikeHuwhat should we do if I have a share type which created months ago and no extra_spec about ip version02:24
TommyLikeHuwhen create share with this one02:24
TommyLikeHualso mark mentioned we have native-glusterfs and native-cephfs driver which do not support IP access02:27
zengyingzhe_TommyLikeHu, if  ipv4_support and ipv6_support have no default value, I think it'll be OK to the drivers that don't support IP access.02:28
zengyingzhe_then the scheduler won't filter the backends by those capabilities.02:29
TommyLikeHuoh~ got you02:29
zengyingzhe_but for the drivers that do have IP support capabilities, for instance, if a driver reports it supports both v4&v6, then which version will be used if we don't specify the spec in share type?02:31
TommyLikeHuaccording to the share-network when creating share02:36
TommyLikeHuif it has02:36
bswartzzengyingzhe_: +102:49
*** kaisers_ has joined #openstack-manila02:52
*** kaisers__ has quit IRC02:55
*** alyson_ has quit IRC03:07
*** tuanluong has quit IRC03:10
openstackgerritzhongjun proposed openstack/manila-specs: Add spec for enable IPv6 in manila  https://review.openstack.org/36278603:11
*** tuanluong has joined #openstack-manila03:15
openstackgerritXiaoyang Zhang proposed openstack/manila: Fix extend operation of shrinked share in generic driver  https://review.openstack.org/39358903:26
*** zengyingzhe_ has quit IRC04:28
*** zengyingzhe_ has joined #openstack-manila04:28
*** wiebalck has joined #openstack-manila04:58
*** lpetrut has joined #openstack-manila05:01
*** shausy has joined #openstack-manila05:08
openstackgerritMerged openstack/manila-specs: Add detail API to quota-set API collection  https://review.openstack.org/39005205:22
*** akapil has joined #openstack-manila05:56
*** digvijay2016 has joined #openstack-manila05:59
*** akapil has quit IRC06:00
*** sandanar has joined #openstack-manila06:07
*** sandanar_ has joined #openstack-manila06:08
*** sandanar has quit IRC06:08
*** sandanar_ has quit IRC06:08
*** sandanar has joined #openstack-manila06:09
*** wiebalck has quit IRC06:12
TommyLikeHuping zengyingzhe_06:13
*** dsariel has joined #openstack-manila06:55
*** lpetrut has quit IRC07:08
*** nkrinner_afk is now known as nkrinner07:24
*** nherciu has joined #openstack-manila07:24
zengyingzhe_TommyLikeHu, hi07:26
TommyLikeHuthanks, I uploaded an new patch on IPv6,could you take a look?https://review.openstack.org/#/c/362786/07:28
openstackgerritzhongjun proposed openstack/manila-specs: Add spec for enable IPv6 in manila  https://review.openstack.org/36278607:34
zengyingzhe_TommyLikeHu, sure07:36
*** zhongjun_ has joined #openstack-manila07:40
*** pcaruana has joined #openstack-manila07:45
*** belmoreira has joined #openstack-manila07:51
*** sticker_ has joined #openstack-manila07:57
*** sticker has quit IRC08:00
*** tuanluong has quit IRC08:01
*** openstackgerrit has quit IRC08:03
*** openstackgerrit has joined #openstack-manila08:04
*** jprovazn has joined #openstack-manila08:28
*** sandanar has quit IRC08:49
*** sandanar has joined #openstack-manila08:51
*** belmoreira has quit IRC09:03
*** akapil has joined #openstack-manila09:06
*** akapil has quit IRC09:06
*** akapil has joined #openstack-manila09:06
*** akapil has quit IRC09:11
*** akapil has joined #openstack-manila09:13
*** ganso has joined #openstack-manila09:49
*** rraja has joined #openstack-manila09:55
*** rraja has quit IRC09:55
openstackgerritXiaoyang Zhang proposed openstack/manila: Fix share-service VM restart problem  https://review.openstack.org/39359409:58
*** belmoreira has joined #openstack-manila10:17
gansobswartz: ping10:32
*** ociuhandu has joined #openstack-manila10:38
*** senk has joined #openstack-manila10:44
openstackgerritMerged openstack/python-manilaclient: Updated from global requirements  https://review.openstack.org/39536810:46
*** nkrinner is now known as nkrinner_trainin10:47
*** lpetrut has joined #openstack-manila10:49
openstackgerritCedric Zhuang proposed openstack/manila: Add "update_access" interface support for VNX.  https://review.openstack.org/39540410:54
*** akapil has quit IRC10:55
*** ociuhandu has quit IRC10:56
*** lpetrut1 has joined #openstack-manila11:01
*** lpetrut has quit IRC11:01
*** lpetrut1 is now known as lpetrut11:01
*** rraja has joined #openstack-manila11:07
*** akapil has joined #openstack-manila11:07
gansovponomaryov, toabctl, tbarron: Hello guys, could you please take a look at https://review.openstack.org/#/c/392291/ ? Thanks in advance11:08
*** ociuhandu has joined #openstack-manila11:08
*** tpsilva has joined #openstack-manila11:17
*** akapil has quit IRC11:20
*** lpetrut has quit IRC11:27
*** akapil has joined #openstack-manila11:30
*** shausy has quit IRC11:32
*** lpetrut has joined #openstack-manila11:40
*** digvijay2016 has quit IRC11:48
openstackgerritMauricio Lima proposed openstack/manila-specs: Spec for openstack client support  https://review.openstack.org/39577511:49
*** lpetrut has quit IRC11:56
*** dsariel has quit IRC12:05
openstackgerritzhongjun proposed openstack/manila-specs: Add spec for enable IPv6 in manila  https://review.openstack.org/36278612:06
openstackgerritMerged openstack/manila: [Tempest] Make share size configurable in scenario tests  https://review.openstack.org/39911612:08
openstackgerritzhongjun proposed openstack/manila-specs: Add spec for enable IPv6 in manila  https://review.openstack.org/36278612:11
openstackgerritMauricio Lima proposed openstack/manila-specs: Spec for openstack client support  https://review.openstack.org/39577512:27
*** mliima has joined #openstack-manila12:27
mliimavponomaryov, i still don't know much about microversions, im trying to better understand it :/12:29
mliimahttps://review.openstack.org/#/c/395775/12:29
vponomaryovmliima: https://www.openstack.org/videos/barcelona-2016/api-microversions-for-operators-what-why-and-how12:35
vponomaryovmliima: its support is a must12:36
vponomaryovmliima: nova and cinder use microversions as well as manila12:36
gansomliima: you could take a look at how Cinder and Nova are handling it in their openstack client12:39
*** gcb has quit IRC12:40
*** porrua has joined #openstack-manila12:43
*** alyson_ has joined #openstack-manila12:50
mliimaok vponomaryov, ganso12:56
*** senk has quit IRC13:07
*** akapil_ has joined #openstack-manila13:30
*** akapil_ has quit IRC13:31
*** akapil_ has joined #openstack-manila13:31
*** akapil has quit IRC13:34
*** timcl has joined #openstack-manila13:41
openstackgerritzhongjun proposed openstack/manila-specs: Add spec for enable IPv6 in manila  https://review.openstack.org/36278613:41
*** porrua has quit IRC13:42
*** tpatzig_1 has quit IRC13:43
*** mkoderer_ has quit IRC13:43
*** sapcc-bot1 has quit IRC13:43
*** david_1 has joined #openstack-manila13:44
*** sapcc-bot has joined #openstack-manila13:44
*** tpatzig_ has joined #openstack-manila13:44
*** tommy_ has joined #openstack-manila13:44
*** dgonzalez_ has joined #openstack-manila13:44
*** tommy_ is now known as Guest6700513:44
*** Guest67005 has quit IRC13:46
*** dgonzalez_ has quit IRC13:46
*** david_1 has quit IRC13:46
*** dmellado is now known as dmellado|lunch13:50
*** senk has joined #openstack-manila13:51
*** dmellado|lunch is now known as dmellado14:12
*** senk has quit IRC14:15
*** dsariel has joined #openstack-manila14:20
*** jcsp has joined #openstack-manila14:26
*** porrua has joined #openstack-manila14:26
*** akapil_ has quit IRC14:35
*** zengyingzhe has joined #openstack-manila14:36
*** akapil has joined #openstack-manila14:36
*** akapil has joined #openstack-manila14:47
bswartzganso: https://review.openstack.org/#/c/39850814:49
gansobswartz: I did read not the bug report in the detail, according to the patch description it seemed like a minor bugfix and not critical14:52
bswartzganso: after reading the bug report do you still think it's not critical?14:52
*** chlong has joined #openstack-manila14:53
bswartzit's easy to write off UI issues as not-critical because they don't affect the server, but within the UI project, broken pages seem critical14:53
gansobswartz: I am looking for the attached screenshot "See attached screenshot. All limits are expected to be located in a row, but now they are located one-by-line."14:53
gansobswartz: found it14:53
gansobswartz: ok, seems critical14:54
bswartzI also feel it's pretty low risk to backport it14:54
bswartzdefinitely not someone trying to sneak in a new feature as a bugfix14:54
TommyLikeHulol14:55
openstackgerritValeriy Ponomaryov proposed openstack/manila-specs: Add spec for Manila share groups  https://review.openstack.org/31573014:56
gansobswartz: definitely not trying to sneak in a feature. As I said, according to the patch description and code it did not seem like a critical bugfix14:57
gansobswartz: anyway14:57
gansobswartz: I +A'e14:57
gansobswartz: +A'ed14:57
gansobswartz: Could you please take a look at the Data Jobs spec? that is one last concern that I think you are more familiar with to comment on14:59
gansobswartz: it seems that the approach proposed would depend on tooz to prevent race conditions14:59
*** eharney has joined #openstack-manila15:00
bswartzeverything depends on tooz to prevent race conditions15:05
bswartzonly other solution is to avoid races altogether15:05
gansobswartz: yes, so if we have tooz in Ocata, the feature can be implemented without problems. If we don't, either we have more race conditions, or we need to figure out another approach15:06
*** zengyingzhe has quit IRC15:20
*** nkrinner_trainin is now known as nkrinner15:22
openstackgerritzhongjun proposed openstack/manila-specs: Add spec for enable IPv6 in manila  https://review.openstack.org/36278615:23
*** lpetrut has joined #openstack-manila15:25
openstackgerritTiago Pasqualini da Silva proposed openstack/manila-specs: Add spec for mountable snapshots  https://review.openstack.org/32121315:26
tpsilvavponomaryov: please see my answers ^15:26
tbarronganso: on the Data Jobs spec I wasn't asking you to solve the general races problem, but rather to indicate that a race will need to be avoided, which service will take care of it, what will be the critical region, scope of potential race (threads, processes within a node, processes on multiple nodes, ...)15:26
vponomaryovtpsilva: let's talk here15:27
vponomaryovtpsilva: your comment "And how are old ones going to get the export location?" - who old ones?15:27
tpsilvavponomaryov: the existing snapshots15:28
tpsilvavponomaryov: when you happen to update manila15:28
vponomaryovtpsilva: nohow, that feature was not supported15:29
*** sandanar has quit IRC15:29
tpsilvavponomaryov: makes sense... new share type is needed also15:30
tpsilvavponomaryov: ok, now I get it15:30
tpsilvavponomaryov: for the extra API calls, do you think they are needed?15:31
vponomaryovtpsilva: what "extra" API calls?15:31
tpsilvavponomaryov: export location show for snapshots and snapshot instances15:31
vponomaryovoh, those15:31
vponomaryovwhy extra? )15:31
tpsilvavponomaryov: because they're not on the original proposal :)15:32
vponomaryovtpsilva: using this APi you see all details of an EL15:32
vponomaryovtpsilva: that you do not see using "list" API15:32
vponomaryovtpsilva: the fact that you do not use does not mean other do not use15:32
tpsilvavponomaryov: it makes sense for shares, since EL has a lot of metadata, but snapshot EL only has paths15:32
*** nherciu has quit IRC15:32
vponomaryovtpsilva: "is_admin_only" will be only there15:33
vponomaryovtpsilva: "preffered"15:33
vponomaryov^ attributes of an export location15:33
tpsilvavponomaryov: those were not on my original implementation, but I probably should add them15:34
tpsilvavponomaryov: alright, I'll make those changes15:34
gansotbarron: thanks for the clarification, I am thinking on a possible approach that does not run into race conditions before sending an update that states that we depend on tooz15:34
tpsilvavponomaryov: anything else to achieve your +2? :)15:35
vponomaryovtpsilva: yes15:37
vponomaryovtpsilva: link https://review.openstack.org/#/c/321213/15/specs/ocata/mountable-snapshots.rst@194 refers to wrong spec15:37
vponomaryovtpsilva: or description is wrong15:37
tpsilvavponomaryov: lol, not sure why I keep linking it to the wrong spec15:37
tpsilvavponomaryov: brain fart15:37
*** senk has joined #openstack-manila15:41
openstackgerritTiago Pasqualini da Silva proposed openstack/manila-specs: Add spec for mountable snapshots  https://review.openstack.org/32121315:43
tbarronganso: a design that doesn't require locks is even better.15:44
tpsilvavponomaryov: thank you, also ^15:44
gansotbarron: yes, I am trying to figure that out... :\15:44
*** senk has quit IRC15:44
*** senk has joined #openstack-manila15:45
*** senk has quit IRC15:45
gansotbarron: anytime there are more than 1 consumir this is bound to happen15:45
openstackgerritTiago Pasqualini da Silva proposed openstack/manila-specs: Add spec for mountable snapshots  https://review.openstack.org/32121315:45
tpsilvathere was a minor formatting error15:46
gansotbarron: I am thinking about using the rabbit RPCs to sort this out, it already addresses this problem when one service reads the message first15:46
gansotbarron: but then we need a single entity to produce this RPC message, which is now another problem15:47
gansotbarron: as we may have several manila-shr or several data services that could create this message, and would need locking to do so as well... unless all jobs are started manually15:47
gansotbarron: but it would need an API and it kinda defeats the purpose15:48
*** pcaruana has quit IRC15:50
tbarronganso: ack15:51
TommyLikeHuhey manila members, if the IPv6 spec can't manage to merge in O-1, can we keep on this and reach an agreement on this spec in Ocata? with this we can shift some framework code and debug jobs in Ocata, and may reduce some risk.15:56
bswartzTommyLikeHu: as long as you keep working on it we can get it done in ocata -- we've designated this effort high priority so we'll make sure the reviews happen15:57
*** belmoreira has quit IRC15:57
gansobswartz: doesn't it have to merge to be designated as hi-pri?15:58
gansobswartz: ^ the patch that marks it hi-pri15:58
bswartzganso: yes and I just workflowed that chain of patches15:59
gansobswartz: oh ok, it is hi-pri now15:59
bswartzthe important part of the discussion happened in the weekly meeting15:59
bswartzI wanted to wait 24 hours before workflowing in case someone had objections they didn't get a chance to share16:00
*** jprovazn has quit IRC16:01
openstackgerritMerged openstack/manila-specs: Mark Eliminate Race Conditions high priority  https://review.openstack.org/39913516:01
openstackgerritMerged openstack/manila-specs: Mark Fix and improve Access Rules high priority  https://review.openstack.org/39913816:01
openstackgerritMerged openstack/manila-specs: Mark Enable IPv6 high priority  https://review.openstack.org/39914016:01
openstackgerritMerged openstack/manila-specs: Add spec for Share Migration Ocata improvements  https://review.openstack.org/39229116:04
openstackgerritBen Swartzlander proposed openstack/manila-specs: Fix table of Ocata priorities  https://review.openstack.org/39966916:14
bswartz^ this fixes a dumb error in the priorities table16:16
bswartzI didn't check how the rst would render before committing...16:16
tbarrontpsilva: ganso bswartz on the moutable snapshot spec https://review.openstack.org/#/c/321213 did we settle the question gouthamr posed in the review of PS11: should spec state explicitly that if driver cannot support separate export locations for share and snapshot, then it shold not set ''mouont_snapshot_support'' capability True (even if it could allow mounts but only with no separation of export locations from those of the16:18
tbarronoriginal shares) ?16:18
tbarrontpsilva: I think we implicitly decided +1 on that, but is it said explicitly in the spec, I'm not seeing it.16:18
*** nherciu has joined #openstack-manila16:19
tbarrontpsilva: bswartz ganso I'm ready to +2 except that I don't want to re-visiit/re-argue that issue during implementation, or worse, when drivers implement the capabiltiy16:19
tpsilvatbarron: Some users or systems that do not have access to the parent share might need access to the snapshot, so the access rules for the snapshot must be separated from its parent share.16:20
tbarrontpsilva: +116:20
tpsilvatbarron: is this what you mean?16:20
tbarrontpsilva: there are real use cases16:20
tpsilvatbarron: that part is on the proposal section of the spec16:20
tbarrontpsilva: that is clear16:20
tbarrontpsilva: look at gouthamr's remarks is PS11, he asked whether you should explicitly state that in order for a driver to claim support of this capability they must genuinely be able to support this separation.16:21
tbarrontpsilva: they must not e.g. just fake it, cloing form the share, and erroring if you thry to set difft export locations on the snapshot16:22
tbarroncloning export locatioonns16:22
* tbarron can't type16:22
bswartztbarron: drivers need to match the semantics manila expects to advertise the capability16:23
tpsilvatbarron: but doesn't that part that I copied already states that?16:23
bswartzit's irrelevant if they can do something similar but not what's expected16:23
bswartzIdeally test code would verify that the behavior was correct16:24
tbarronbswartz: tpsilva ok, I'll plus 2 and cite this IRC convo.  Just want something in the spec, or at least the review, that can be pointed to.16:25
tbarronbswartz: tpsilva one purpose of specs is to avoid ambiguity and rehash later16:26
tpsilvatbarron: it's better to add this then... just a sec16:27
tbarrontpsilva: thanks for indulging me16:29
*** surabujin has quit IRC16:29
openstackgerritTiago Pasqualini da Silva proposed openstack/manila-specs: Add spec for mountable snapshots  https://review.openstack.org/32121316:30
tpsilvatbarron: does this look ok? ^16:30
tbarrontpsilva: perfect16:31
tbarronbswartz: ganso your +2s are needed again16:31
tpsilvaand also vponomaryov's :D16:31
tbarronbswartz: ganso vponomaryov https://review.openstack.org/#/c/321213/1816:31
openstackgerritMerged openstack/manila-specs: Fix table of Ocata priorities  https://review.openstack.org/39966916:36
*** ChanServ changes topic to "OpenStack Shared File Systems | Manila | Spec freeze 11/18"16:36
*** akapil has quit IRC16:40
*** dsariel has quit IRC16:41
gansotbarron: are you familiar with how the manila-scheduler is deployed in HA envs?16:47
gansotbarron: I am thinking about it as the single entity that takes the decisions16:47
bswartzganso: very carefully16:48
tbarronganso: we deploy both scheduler and api today active-active, managed by systemd rather than pacemaker16:48
bswartzganso: and it's not a single decider -- each scheduler makes decisions independently16:48
tbarronganso: there are races (in api) but so far they are more bad-user-experience problems than data corruption16:48
gansobswartz: hmmm, ok, so it does not solve our problems if we have 2 or more schedulers making decisions16:49
tbarronganso: sheduler likely not so much subject to races as api16:49
*** surabujin has joined #openstack-manila16:49
bswartzsolve what problems?16:49
*** makowals has quit IRC16:49
gansobswartz: the one in data jobs table spec16:49
bswartzoh16:49
tbarronganso: the default HA deployment is with three controllers running API and scheduleers16:50
*** makowals has joined #openstack-manila16:50
gansotbarron: I wasn't sure if schedulers were Active/Active and if there was more than one. My lab production deployment does not have redundant schedulers I think16:51
tbarronbswartz: I realized the reason for 3 is probably less load-sharing than that some of the services (non-manila) that run on controllers in this deployment need to do quorum among themselves16:51
bswartztbarron: that's ridiculously dangerous if you don't do it right16:51
tbarronganso: yeah, we standardly do either 3 of api and scheduler or just 1 (non-HA deployment).  in psp-10 (our newton based release) we'll have 'composable roles' that allow more mix and match16:52
tbarronbswartz: what is "that' - deployinng 3 schedulers, 3 apis, or a more general issue?16:53
bswartzhow do services know when they're out of quorum?16:53
*** makowals has quit IRC16:53
*** makowals has joined #openstack-manila16:54
tbarronbswartz: oh, *that* - I dunno offhand, but for the services in question I think it's old territory.16:54
bswartzthe idea that simply supporting active/active HA and then making lots of copies protects you from Bad Things (tm)16:54
tbarronbswartz: I don't think that's the general idea16:54
bswartzactive/active configurations actually opens you up to more problems than active/passive16:55
tbarronbswartz: some services (mongodb as ex I've heard) quite apart from openstack know how to do their own quorum, etc.16:55
tbarronbswartz: ceph services do that stuff themselves16:55
bswartzI hope the people designing this stuff have thought through the netsplit scenarios16:55
tbarronbswartz: well that's what **I** keep sayign when we say we'll just solve all the issues for DLM by running tooz !!16:56
bswartzyou have to have quorum at every level of the stack though and the different levels need to agree with eachother16:56
tbarronbswartz: tooz is nice abstraction, but the devil is in the details with its backends and deployment of same16:57
openstackgerritTiago Pasqualini da Silva proposed openstack/manila-specs: Add spec for mountable snapshots  https://review.openstack.org/32121316:57
tpsilvabswartz, ganso, tbarron, gouthamr, vponomaryov, markstur: hopefully last one ^16:57
bswartzif you have 3 DBs and 3 services, and DBs A+B are in quorum but services B+C are in quorum then when service C talk to DB C you get breakage16:57
*** makowals has quit IRC16:58
tbarronbswartz: to be clear, I'm **not** saying that all services that run on our 3 controllers are determiinging quorum, only some special ones, and that until osp-10 the three-controller arch is the standard HA arch.16:59
bswartzk16:59
tbarronthe other  services are supposed to be safe (enough) to run active-active on their own right16:59
bswartzI hope there's some kind of stonith mechanism to prevent surviving out-of-quorum services from doing evil things17:00
tbarronbswartz: as I say, for those services that do quorum stuff, I think they implement well-known design patterns, but I'm no expert in those areas.17:01
tbarronbswartz: was just remembering you asking "why three, api isn't really that likely to require 3 just to handle load"17:01
bswartzmy point was that manila doesn't have anything like that -- so unless it exists externally, we'll have problems17:01
tbarrontpsilva: looking17:01
tbarronbswartz: maniila is right now being deployed like cinder, with hand-waving for api17:02
tbarronbswartz: with the thought that there are already races there even with one node, but they don't kill us17:02
bswartzyeah I presume someone has thought about this stuff but it's so complex that I'm not confident that all necessary precautions are being taken17:02
tbarronbswartz: but with enough worry about consequences of races in the share/volume services that they are put under pacemaker control and run active/passive17:03
gansovponomaryov: are you here?17:04
vponomaryovganso: yes17:04
gansovponomaryov: just saw the change in tpsilva's latest patch17:04
gansovponomaryov: not sure if I agree, because I am thinking of a case where it is best to have the other way around17:04
vponomaryovganso: ?17:05
gansovponomaryov: I think it is best if backends provide the export location for the snapshot during allow17:05
vponomaryovganso: then let's return export locations via allow17:06
*** rraja has quit IRC17:06
vponomaryovganso: still no need to have third driver interface17:07
gansovponomaryov: in case a share is created in a backend that supports mountable snapshots, but using a share type that says mountable_snapshots=False, creates a snapshot, but then it is retyped to a type that says mountable_snapshot=True, then it should be able to provide the export_locations, but it is unable to do so now because that was defined only at17:07
gansocreation time17:07
vponomaryovganso: (19:07:08) vponomaryov: ganso: still no need to have third driver interface17:08
gansovponomaryov: I don't see this third driver interface anywhere17:09
gansovponomaryov: which PS was it introduced?17:09
marksturganso: I wonder if any driver would provide export location at creation and not be able to afterwords.  Just wonder.17:10
gansomarkstur: but share manager would need something to invoke it17:10
gansomarkstur: drivers would certainly be able17:10
gansomarkstur: but I am concerned with the workflow, it is only invoked by share manager like "snap_exports =  driver.create_snapshot..." then at what other point after a retype will this be invoked again?17:11
marksturganso: probably.  It's kind of rare for new features to work retroactively on old entities.  Might expose problems.  I'm not very concerned in this case.17:11
vponomaryovganso: if drivers return export locations from "create_snapshot" and "allow_snapshot_access" methods, what problem are you expecting?17:11
vponomaryovganso: without access it is useless to have export location17:12
marksturSo if we follow the share model and export locations are done at creation (and retype? and migration) there is less adhoc asking for them17:12
gansovponomaryov: exactly, it must the return value of snapshot_allow_access17:13
marksturI'm not seeing real concerns -- but the more it aligns w/ our current share impl the better (probably)17:13
marksturSo should shares only return and export_loc after allow access?   Probably.17:14
marksturoops17:14
gansomarkstur: yes, I am thinking in a bit of advance because the design decision here may be less significant looking just at the mountable_snapshots implementation but later for retype it would complicate things17:14
gansomarkstur: lol we are almost walking into a different discussion17:15
marksturI worry less about retype because when you do that it is more of a free-for-all to change stuff17:15
marksturBut you are more "into" retype. So I'll trust you on that17:15
marksturOK.  Let's stop looking at today's specs and argue about retype  :)17:16
vponomaryovretype "snapshot"?17:16
vponomaryovreally?17:16
gansovponomaryov: no, retype share lol17:17
vponomaryovthen we have more questions here, what to do with all the snapshots retyping share?17:17
vponomaryovaccess for them, when we change network?17:17
gansovponomaryov: retype shares that have previous snapshots, in this case it would be just changing a flag, by retyping from a type that does not have mountable_snapshots extra spec to one that does and set to True17:17
vponomaryovRodrigo, I guess it is question of "retype" spec17:18
vponomaryovnot this one17:18
gansovponomaryov: depending on this design, it can either be hell for retype feature, or just easily manageable change17:18
bswartzretype will need all of the flags that migration needs17:19
vponomaryovhell? It is heaven compared to real coding hell that may be faced ))17:19
bswartzincluding stuff like --preserve-snapshots which won't work in the default case17:19
gansobswartz: problem is not API, it is driver interface17:19
gansobswartz: share manager needs to be able to ask for snapshot export locations even after snapshot has been already created17:20
gansobswartz: if it is only at creation time, then it is more complicated for retype. I don't see why it cannot be on snapshot_allow_access17:20
bswartzganso: don't we just store it in the DB?17:21
bswartzwhen the driver returns from snasphot creation?17:21
vponomaryovbswartz: ganso is talking about upgrade existing cloud and retping share17:21
marksturPoor man's retype feature:  Click retype. Get user notification that says your share was unfortunately deleted. Please start over.17:21
gansobswartz: yes, but if this snapshot has been created before the retype, when the mountable_snapshot extra spec was not present in the share type when the snapshot was created17:22
bswartzokay I see a flaw in the design then17:22
marksturOK. User notification should not be part of "poor man's" feature so I guess it would just be logged17:22
vponomaryovmarkstur: even worse, we do not have user notifications ^_^17:22
bswartzsnapshots should *always* return export locations at creation time17:22
gansobswartz: ok, what about after?17:22
bswartzand those export locations need to be updated by any migrations (including retypes) that are able to preserve snapshots17:23
*** adrianofr_ has quit IRC17:23
markstur+117:23
bswartzganso: export locations never change17:23
marksturwait17:23
vponomaryovbswartz: actually, they can17:23
vponomaryovbswartz: when IP of a host changes17:23
bswartztechnically a migration that preserve snapshots actually creates new instances17:24
vponomaryovand configuration of a driver17:24
marksturHe bswartz just said updated them and then said they never change17:24
gansobswartz: in this case he retype does not move the share or the snapshots17:24
bswartzmarkstur: I meant 1 instance never changes, and if it moves the new instance has a new export location17:24
marksturAhhh17:24
bswartzand the snapshot should get its export location from the active snapshot instance17:24
bswartzbut vponomaryov has a point17:25
gansobswartz: what retype would do in this case is notice that it is only mountable_snapshots that is changed from "dont care" to True, and then it needs to return the export locations to the share manager for update17:25
bswartzvponomaryov: how does manila discover changed export locations for shares?17:25
vponomaryovbswartz: checking shares on restart of a manila-share service17:26
gansobswartz: but if the design of mountable_snapshot was different, as I am suggesting, then it would not need to do that, so when allow_snapshot_access is invoked, it would return/update the export_location17:26
marksturensure17:26
vponomaryovbswartz: but it is up-to-the-driver to just mock it17:26
bswartzvponomaryov: that's something we planned to remove17:26
vponomaryovbswartz: I faced such problem when was coding ZFSonLinux driver17:26
bswartzit was a topic we didn't get to in BCN17:26
bswartzensure share must die17:27
gansobswartz: we planned to remove ensure because it is "jack-of-all-trades" but replace it with functionality that actually focuses on doing one thing specifically17:27
marksturWhen we do retype. A retype could allow retype to same share-type just to refresh stuff including share type changes and also things like IP changes I s'pose17:27
bswartzganso: I still don't like the idea of going back to the driver to get information the manager should already know17:28
bswartzit's a scalability nightmare17:28
marksturAnd I guess a future ensure_share_v2() could do that also -- but only after it is really defined what it should/shouldn't do17:28
bswartzmarkstur ganso: we NEED to have the discussion about ensure share soon it sounds like17:29
markstursoon as in later.  not now17:29
gansobswartz: we did not get a spec for it... so I guess it is not changing in Ocata anymore17:29
bswartzif correctness of features going into ocata depends on it then we have a problem17:30
tpsilvawhat about my spec? will it be merged as is? do I need address rodrigo's concerns?17:30
marksturIf any of you are looking at IPv6 now -- I have questioned in there the whole optional spec vs. in-the-model spec.17:30
bswartzwe either have to postpone those features or solve the issues now17:30
bswartzmarkstur: where? they should be ordinary extra specs17:30
marksturThe IPv6 spec is adding ipv4 and ipv6 to the share model17:31
bswartzokay that I don't agree with17:31
marksturI'm hoping it is more like dedup and less like snapshot_support17:31
bswartzyes17:31
bswartzparticularly because it can change over time17:31
marksturGood.  So I commented in there, but don't want TommyLikeHu or whoever is rewriting to have to go back and forth17:32
bswartza backend that was ipv4 only can gain ipv6 support quite easily17:32
gansobswartz: it kinda suffers from the same problem, needs to refresh after retype17:32
marksturretype retype retype17:32
markstureveryone wants retype.  Where's ganso?17:32
gansobswartz: but vponomaryov's point is important as well, if it changes IP, needs to refresh, so we would need ensure17:32
marksturUgh17:33
bswartzganso: the theory there is that you shouldn't change IPs17:33
bswartzchanging a backend's IP will break all ongoing access17:33
bswartzadding a new IP is less dangerous, but you really can never take one away without breaking somebody17:33
tpsilvawe can try to support everything and have a whole lot of broken features, or we can have limited  but solid features17:34
tpsilvayou can't have both17:34
gansobswartz, markstur: I am also thinking about how we can migrate to new features without having to re-create all the resources. The IPv6 case is probably the best one. We have several existing IPv4 shares and now we want them to support IPv6 as well, how do we do that?17:34
marksturSafest it so say new feature apply to new entities17:34
marksturOld features don't get them17:34
bswartzganso: in that case it would be ideal for new export location to magically appear17:34
gansobswartz: yes17:35
marksturDoing retroactive features is awesome, but it leads to cases that just can't.17:35
tpsilvamarkstur: +117:35
gansobswartz: if share is in a backend that already supports the feature, but it needs to have its share-type changed accordingly17:35
tpsilvaI'm always in favor of limited features that work as they should, instead of features that promise to do evertyhing but simply don't17:36
marksturAnother safety thing is to say we can retrofix, but you need to use retype to do it.  OK I said 'retype' again.  Everybody drink.17:36
gansomarkstur: lol17:36
bswartzthe main question is how do you know if you can add a v6 access rule17:36
* markstur takes a couple more huge gulps of coffee17:37
bswartzor a v4 access rule if you started out with a v6-only share17:37
gansobswartz: according to the spec, the validation is by checking the share's export location17:37
bswartzoh, I like that17:37
gansobswartz: if it has IPv4 EL you can accept IPv4 rules17:37
bswartz+117:38
marksturDoes that mean just looking for colons vs dots in EL?17:38
bswartzso the only challenge then is how does the manager become aware that new export locations are available17:38
gansomarkstur: using a library that properly parses it, yes17:39
bswartzmarkstur: we'd add a column to the table17:39
bswartzNFS export locations always have colons17:39
bswartzand IPv6 addresses technically can have dots17:39
marksturok.  so we'll have a is_v6() is_v4() and don't need metadata that says what it is17:39
gansobswartz: we would need ensure_share?17:40
marksturbswartz: yeah but you knew what I meant I think.  Parsing to detect vs. metadata.17:40
bswartzganso: NO!17:40
gansobswartz: lol17:40
bswartz#die_ensure_share_die17:40
marksturLOL17:40
markstur#ImWithEnsure17:40
marksturBen just walked out mad17:41
bswartz#feeltheretype17:41
ganso#makeManilaGreatAgain17:41
bswartzokay on that note, I think I will get lunch17:41
marksturI hope no one reading this thought I actually saw you stomp out.  I can't see Ben.  It was just awkward silence.17:41
vponomaryovand only tpsilva crying in the corner having -1 on his spec befor edeadline )17:42
tpsilva:(17:42
marksturYeah.  tpsilva is saying "Lunch?  You can't go to lunch!"17:42
tpsilvamore like weekend :P17:43
tpsilvaon a serious note? did you come to any conclusions? all I saw was "this is retype issue", but the -1 is still there17:44
*** nkrinner is now known as nkrinner_afk17:44
vponomaryovtpsivla: hack ganso's ack and change his mark ^_^ or you can threat him ))17:44
marksturganso: How do we make this an Ocata feature and maybe make it better later?  Do you think we're really stuck?17:45
marksturvponomaryov: No hacking allowed.17:45
tpsilvavponomaryov: just waiting for him to leave his laptop unattended17:45
gansomarkstur: well, since it is driver interface, we can improve it later... if everybody acknowledges what the problem is and what the path of solution is (and we can get there), we can merge as-is and improve later...17:46
gansowe just need a way to refresh the export location17:46
gansowe just noticed we have the same problem for IPv6 and mountable_snapshots17:46
marksturganso: Yes. If you don't' think we're "painting ourselves into a corner", then it is time to spec what we can do in O and merge17:46
vponomaryovespecially when "retype" is out of O17:47
gansovponomaryov: yes, I am about to change the vote mostly because of that fact17:47
marksturThat and the fact that he knows he'll forget to lock his computer17:48
marksturganso: Where's that retype spec.  Maybe we can cram it in  :)17:49
vponomaryovtpsilva: at least, you have a reason now to call ganso in the middle of the night and breathe into the phone17:49
marksturLOL17:49
tpsilvaslow movements everyone, he's about to do it... i saw him alt-tabbing to gerrit17:49
marksturthat's just wrong17:49
* markstur "wrong" was re: vponomaryov's comment not re: ganso abs(-1)17:50
gansotpsilva: there you go17:52
gansovponomaryov: btw that's a very creepy idea17:54
* tpsilva is happy17:54
*** eharney has quit IRC17:56
vponomaryovganso: are you afraid of th dark? ))17:57
bswartzokay I got my sandwich and I'm not sure what happened while I was gone17:57
marksturOh. Nothing. We didn't talk about you.17:58
* ganso wonders if the Data Jobs Table spec still has any chance of merging18:00
marksturganso: I was wondering if you still wanted that in O18:02
gansomarkstur: I am still thinking on a mechanism that would not be victim of race conditions18:02
marksturganso: That is sounding like a "P" thing then.18:04
bswartzganso: given everything else we're signing up for, I'm not in favor of it merging because I think we're overcommiting this short release18:05
bswartzganso: that doesn't mean we can't review and merge a p-targeted spec and get a lot of the coding done during ocata18:05
bswartzthis is a case where we need to use the specs system to express the core team's priorities and limited bandwidth18:06
marksturIf you code it and it is the most awesome thing ever, then you could force us to implement an emergency exception process.18:07
*** ociuhandu has quit IRC18:07
marksturbut it is feeling like we are overcommitting18:07
bswartzremember the specs process isn't about controlling what contributors work on, it's about controlling what reviewers review18:08
bswartzmany of us are both contributors and reviewers18:08
gansoI am confident about not overcommitting because those 2 features (share migration improvements and data jobs table proposed) are small in amount of code and effort18:08
*** lpetrut has quit IRC18:09
bswartzganso: you might be overlooking the testing impacts18:09
marksturI also think we could use less last-minute feature merges and more got-it-ready-last-release-will-merge-early-this-release features. Although I know the owner (anyone) usually doesn't like sitting on finished work.18:09
bswartzmarkstur: that's the part of the culture I'm trying to change18:10
gansoif I update the spec saying that we depend on tooz, and we do not have proper tooz by the FF, then I would -2 my code as I don't want a feature that suffers from race conditions18:10
bswartzI ran for the TC and got pretty low votes :-(18:10
gansomarkstur: specs merged don't mean code merged18:11
marksturbswartz: The system is rigged.18:11
tbarronganso: toabctl and I want the spec to show that we're not doinng Not Invented Here solution and there's no time to do that before the merge deadline.  That doesn't mean we can't do that work with you strarting now ...18:12
bswartzmarkstur: indeed18:12
bswartztbarron: that doesn't worry me at all18:13
tbarronbswartz: not you, but two other cores it does18:13
gansotbarron: there is a paragraph stating that we are not reinventing the wheel18:13
tbarronganso: stating that we're not and not are two different things18:13
*** nherciu has quit IRC18:14
bswartzmarkstur: should we start a #notmytc movement?18:14
marksturbswartz: Don't start18:15
bswartzlol18:15
tbarronganso: so maybe i'm wrong but I just think there's more to think about before approval of a spec.  doesn't mean prototype coding can't be done and as markstur says if something compellling develops then maybe it can still happen in O.18:16
* markstur said "awesome" not "compellling" (sic)18:16
* tbarron misquotes markstur again18:17
tbarronganso: if i'm the only holdout, I won't block though18:17
* tbarron runs out for lunch for an hour, coward that he is18:17
marksturIf working out the spec issues takes time, then it's good to keep working on that instead of landing the spec today. But it means code is unlikely to land in O18:18
*** senk has joined #openstack-manila18:19
openstackgerritRodrigo Barbieri proposed openstack/manila-specs: Add spec for Data Jobs table  https://review.openstack.org/39226218:20
*** tpatzig_ has quit IRC18:25
*** sapcc-bot has quit IRC18:25
openstackgerritRodrigo Barbieri proposed openstack/manila-specs: Add spec for Data Jobs table  https://review.openstack.org/39226218:25
*** sapcc-bot has joined #openstack-manila18:25
*** tpatzig_ has joined #openstack-manila18:26
*** david_1 has joined #openstack-manila18:26
*** tpatzig_ has quit IRC18:27
*** david_1 has quit IRC18:27
gansobswartz: is there anything left to discuss prior to merging tpsilva's spec?18:29
openstackgerritVictoria Martinez de la Cruz proposed openstack/manila-ui: Moves OPENSTACK_MANILA_SETTINGS TO local_settings.d/  https://review.openstack.org/39792618:29
bswartzganso: my +2 got clobbered by the last patch18:30
bswartzI was going to wait until discussion settled down before looking at the diff18:30
bswartzlooking now18:30
bswartzbtw I suspect several specs that are merging at not updating the appropriate index files -- I don't want to block any specs on that issue but someone will need to go clean up the indices in the specs repo18:31
bswartzI'm not sure if we'll get votes from cknight or gouthamr -- AFAIK they're both on airplanes or sleeping in weird timezones18:32
tpsilvagouthamr already +2'ed a patch ago18:33
bswartzxyang did too18:33
*** tpatzig_ has joined #openstack-manila18:34
bswartzI'll workflow now18:35
bswartzhttps://review.openstack.org/#/c/395775/18:37
bswartz^ this going anywhere?18:37
gansobswartz: seems like not before the deadline, mliima is still researching what needs to be done so it can be included in the spec18:38
openstackgerritMerged openstack/manila-specs: Add spec for mountable snapshots  https://review.openstack.org/32121318:38
bswartzI'm glad we focused on specs so well the last 2 weeks18:40
bswartzit gives me a good feeling about the next 10 weeks18:40
bswartzmaybe there will be fewer surprises18:40
openstackgerritMerged openstack/manila-specs: Add spec for Manila share groups  https://review.openstack.org/31573018:40
openstackgerritMerged openstack/manila-specs: Add Stochastic Weighing Scheduler  https://review.openstack.org/39577718:40
openstackgerritMerged openstack/manila-specs: Add share_type filter support to pool_list  https://review.openstack.org/39003418:41
*** eharney has joined #openstack-manila18:53
*** lpetrut has joined #openstack-manila18:56
mliimawhat is deadline? bswartz ganso18:58
bswartzmliima: today18:59
mliimawell, I missed this deadline. :/19:03
bswartzmliima: it's a short cycle -- we'll be working on pike very soon19:03
mliimabswartz, regarding the next deadline19:05
mliimawe have any definition?19:05
bswartzmliima: definition of what?19:06
bswartzyou mean future deadlines for specs?19:06
mliimayes19:06
bswartzit's the milestone-1 date according to current policies19:06
bswartzfor ocata we granted a 1-day blanket extension because things were not in good shape yesterday19:06
mliimaoh, ok bswartz19:08
*** senk has quit IRC19:09
*** mliima has quit IRC19:23
*** dsariel has joined #openstack-manila19:24
*** nherciu has joined #openstack-manila19:26
vkmchey all, https://review.openstack.org/#/c/388859/ I'd appreciate a few more eyes on this patch set19:31
*** nherciu has quit IRC19:38
vkmcbswartz, ganso ^19:40
*** nherciu has joined #openstack-manila19:41
vkmctbarron, if you are around as well ^19:42
bswartzvkmc: I talked to vponomaryov about this earlier in the week19:42
bswartzI think his argument was that an experimental job will tell us if there are any gate-affecting bugs in this change, and if there are, then we can fix them in the same change19:42
bswartzyour suggestion is to test it after it merges and bugfix anything that breaks19:43
bswartzI think vponomaryov's approach is safer19:43
bswartzI hope he volunteered to help get that job created -- knowledge of creating new jobs is something that not enough people have19:44
vkmcnot really, my approach is to add it because it's not a breaking change19:46
bswartzvkmc: but we have no way to test the new code19:47
bswartzother than manually19:47
vkmcright19:47
vkmcManila UI as is has a DevStack plugin that doesn't work19:47
vkmcthat was not tested19:48
*** alyson_ has quit IRC19:48
vkmcthis patch set fixes that19:48
tbarronbswartz: i'm confused, we've been doing all kinds of ui changes till now without this job, what makes this patch0-set special?19:48
vkmcthe only thing we can test on that patch if it actually enabled or not Manila UI19:48
tbarronbswartz: i'll commit my team's resources to working on that experimental job19:48
*** porrua has quit IRC19:48
bswartztbarron: manila-ui currently has NO dsvm jobs at all19:48
tbarronbswartz: yes, and we've been meerging manila-ui bug fixes all along, so why this change set has the particular burden before it can merge19:49
bswartzall of the testing of the devstack plugin happen in the manila project19:49
bswartzafter this change, it will become possible to check in a breaking change to manila-ui's devstack plugin and for it not to be caught19:50
bswartztoday it would be caught, because it would go into the manila project, where we do have a dsvm job19:50
bswartzI'm only trying to explain vponomaryov's logic since he's not here19:51
vkmcnow... something I'm not entirely sure about19:51
vkmchow are we planning to add the non-voting gate if the code is not merged?19:51
bswartzvkmc: it would go like this19:51
bswartz1) submit experimental job to project-config19:52
bswartz2) update manila-ui change to depend on (1)19:52
vkmc...19:52
vkmcok19:52
vkmcthanks19:53
bswartz3) run experimental job  before (2) merges19:53
bswartzworkflow (1) and (2)19:53
bswartz4) change experimental job to nonvoting check job19:53
bswartz5) change job to gate job19:53
bswartzvponomaryov: could probably explain the details better19:54
bswartzI've created new jobs before so I can help19:54
vkmcall right19:55
bswartzI think having a dsvm job running for manila-ui will be a positive thing19:55
vkmcof course19:55
bswartzit will slow down merge times, but catch more issues19:55
vkmcwill work on that19:55
tbarronvkmc: i'll learn how to do it along with you19:56
tbarronbswartz: thanks for volunteering yourself and valeriy as tutors :)19:56
vkmcI want to see the DevStack plugin working, that's my main concern19:57
vkmcI have been trying to contribute to Manila UI when I just started and the whole process if painful19:57
bswartztbarron: just trying to spread the knowledge19:58
*** jcsp has quit IRC20:09
*** dsariel has quit IRC20:16
*** porrua has joined #openstack-manila20:21
*** timcl1 has joined #openstack-manila20:30
*** timcl1 has left #openstack-manila20:31
*** timcl has quit IRC20:33
*** xyang1 has joined #openstack-manila20:33
*** akapil has joined #openstack-manila20:50
*** xyang_ has joined #openstack-manila20:52
*** chlong has quit IRC20:53
*** akapil has quit IRC20:54
*** lpetrut has quit IRC21:08
*** lpetrut has joined #openstack-manila21:17
*** ChanServ changes topic to "OpenStack Shared File Systems | Manila"21:21
*** catintheroof has joined #openstack-manila21:31
*** xyang_ has quit IRC21:34
*** tpsilva has quit IRC21:35
*** xyang_ has joined #openstack-manila21:36
*** lpetrut has quit IRC21:39
*** xyang_ has quit IRC21:40
*** xyang_ has joined #openstack-manila21:45
*** xyang_ has quit IRC21:49
*** xyang_ has joined #openstack-manila21:58
*** xyang_ has quit IRC22:00
*** ganso has quit IRC22:06
*** xyang_ has joined #openstack-manila22:06
*** xyang_ has quit IRC22:09
*** xyang_ has joined #openstack-manila22:12
*** xyang_ has quit IRC22:17
*** xyang_ has joined #openstack-manila22:36
*** xyang_ has quit IRC22:36
*** xyang1 has quit IRC23:01
*** erlon-airlong has quit IRC23:22
*** eharney has quit IRC23:49

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!