| *** annashen has joined #openstack-cinder | 00:00 | |
| *** emagana has quit IRC | 00:02 | |
| *** markvoelker has quit IRC | 00:03 | |
| openstackgerrit | Mitsuhiro Tanino proposed openstack/cinder: Refactoring for export functions in Target object https://review.openstack.org/148038 | 00:03 |
|---|---|---|
| *** emagana has joined #openstack-cinder | 00:08 | |
| *** bswartz has joined #openstack-cinder | 00:09 | |
| *** emagana has quit IRC | 00:12 | |
| *** smoriya has joined #openstack-cinder | 00:13 | |
| *** lcurtis has quit IRC | 00:13 | |
| jgriffith | thingee: yo | 00:15 |
| *** mriedem has joined #openstack-cinder | 00:15 | |
| *** smoriya has left #openstack-cinder | 00:16 | |
| *** afazekas has quit IRC | 00:16 | |
| *** smoriya has joined #openstack-cinder | 00:16 | |
| *** dalgaaf has quit IRC | 00:17 | |
| *** bitblt has quit IRC | 00:18 | |
| thingee | jgriffith: I was writing the spec for capabilities as discussed at the midcycle meetup | 00:19 |
| thingee | jgriffith: https://etherpad.openstack.org/p/cinder-meetup-winter-2015 | 00:19 |
| thingee | jgriffith: if you do a search for "continued discussion from thursday" | 00:20 |
| jgriffith | thingee: got it | 00:20 |
| thingee | jgriffith: I was trying to understand again how we would represent QOS with this model. | 00:20 |
| jgriffith | thingee: too bad we didn't write that down eh :) | 00:20 |
| jgriffith | thingee: so wouldn't it just be along the same lines: | 00:21 |
| jgriffith | {qos:{default=True, available=True, type=guaranteed}} | 00:22 |
| jgriffith | etc | 00:22 |
| jgriffith | thingee: so the well defined keys are kinda like "do you or don't you" support this | 00:22 |
| jgriffith | thingee: then the vendor specific keys come into play | 00:23 |
| jgriffith | {qos:{default=True, available=True, type=guaranteed}{vendor-keys:[minIOPS, maxIOPS, burstIOPS]} | 00:23 |
| jgriffith | etc | 00:23 |
| thingee | jgriffith: thank you | 00:24 |
| thingee | jgriffith: and from the scheduler perspective | 00:24 |
| jgriffith | the data structure itself of course might be different but I think that was a rough summary of what I wrote on the board | 00:24 |
| jgriffith | thingee: so the scheduler side is the part I've never quite agreed with in all of this | 00:24 |
| jgriffith | thingee: IMO the scheduler should care about the "well defined" keys only | 00:25 |
| jgriffith | thingee: the vendor-keys are there just to help with what the driver wants specifically on things | 00:25 |
| jgriffith | hemna: ^^ does that align with what we agreed upon in the end? | 00:25 |
| *** emagana has joined #openstack-cinder | 00:26 | |
| *** Mandell has quit IRC | 00:26 | |
| thingee | jgriffith: makes sense to me. Are we then relying on the data placement to the storage backend? It makes things complicated with multiple pools in a backend exposed to Cinder. | 00:26 |
| jgriffith | thingee: so honestly I've said before if you're stuck with pools then sucks to be you :) | 00:27 |
| jgriffith | thingee: ok, seriously.... | 00:27 |
| jgriffith | thingee: no, I dont' think so | 00:27 |
| jgriffith | thingee: remember each pool is presented as a backend now for the most part | 00:27 |
| jgriffith | thingee: so if someobdy has a device with a pool that has compression=False and another with compression=True | 00:27 |
| jgriffith | things still work | 00:27 |
| *** r-daneel has joined #openstack-cinder | 00:28 | |
| jgriffith | and details on any compression options that are vendor-unique go in those vendor keys | 00:28 |
| thingee | jgriffith: I was getting at it more that it becomes complicated with the vendor specific keys. If you don't want it in the scheduler, the backend itself has to deal with it | 00:28 |
| jgriffith | but they don't impact the scheduler | 00:28 |
| jgriffith | thingee: as it should | 00:28 |
| jgriffith | thingee: why should the scheduler deal with 20+ iterations of QoS keys for example? | 00:28 |
| jgriffith | thingee: IMO that's awful | 00:28 |
| jgriffith | thingee: they're vendor/driver unique keys, that's where they should be dealt with | 00:29 |
| jgriffith | thingee: but maybe I'm not following? | 00:29 |
| thingee | jgriffith: I completely agree with you. Thank you so much for helping me with this. I'll make sure to reflect this in the spec. | 00:29 |
| jgriffith | Ok, cool | 00:29 |
| jgriffith | lemme know if there are other details we forgot (I'm sure there are) | 00:29 |
| hemna | just a sec... | 00:29 |
| *** Longgeek has quit IRC | 00:30 | |
| jgriffith | hemna: sorry, you're too late LOL | 00:30 |
| *** Mandell has joined #openstack-cinder | 00:30 | |
| *** Mandell has quit IRC | 00:30 | |
| thingee | jgriffith, DuncanT: I know I started this thread, but I haven't had a chance to respond back yet. There appears to be confusion that the scheduler today could solve the problems raised http://lists.openstack.org/pipermail/openstack-operators/2015-February/006218.html | 00:30 |
| jgriffith | thingee: oh, yeah I meant to respond to that actually | 00:31 |
| thingee | rather, I think what were talking about *now* solves these problems | 00:31 |
| thingee | hemna: ^ | 00:31 |
| thingee | so I think if anything, operators don't really understand the feature. Now I didn't exactly explain the feature, and for good reason. The documentation is all I left for people to read. | 00:32 |
| gary-smith | he's yapping right now. give him a sec | 00:32 |
| jgriffith | thingee: so the problem in the example Christian gives is it is addressed by the specs change we just talked about | 00:32 |
| openstackgerrit | Anthony Lee proposed openstack/cinder: Adding manage/unmanage support for LeftHand driver https://review.openstack.org/155127 | 00:32 |
| thingee | jgriffith: yup, same with marc | 00:32 |
| *** Mandell has joined #openstack-cinder | 00:32 | |
| thingee | and richard | 00:32 |
| thingee | leeantho: ^ | 00:32 |
| jgriffith | thingee: I see zero tie in to the goodness filter really | 00:32 |
| *** Mandell has quit IRC | 00:33 | |
| jgriffith | thingee: so to clarify my comments yesterday; I'm not opposed to a goodness filter (although I don't see much value in it) | 00:33 |
| jgriffith | thingee: I was just hoping to get some info on how the evaluator worked etc | 00:33 |
| jgriffith | thingee: but I also sympathize with folks that their patch was up for 8 months with little feedback (and zero feedback for me) | 00:34 |
| thingee | leeantho, hemna: The point I'm making, is this initial documentation isn't making much sense to people, and is kind of conflicting with this other work coming from standard capabilities. | 00:34 |
| thingee | I'll admit I don't really understand the usecase of an array that can only handle 1000 volumes. | 00:34 |
| *** Mandell has joined #openstack-cinder | 00:34 | |
| thingee | do we have a real example of that? And why are they in a cloud environment? :P | 00:34 |
| jgriffith | lol | 00:34 |
| jgriffith | well... I don't know I think that's fine; although I'd say again all of the tools needed to deal with that are already in place | 00:35 |
| hemna | so the vendor specific keys can be used during the scheduler though | 00:35 |
| hemna | if you are using the capabilities filter | 00:35 |
| hemna | err capabilities scheduler | 00:35 |
| jgriffith | hemna: hmm, how and why? | 00:35 |
| hemna | which is the entire point of the capabilities scheduler | 00:35 |
| jgriffith | hemna: wouldn't you just want the scheduler to do the high level placement? | 00:36 |
| jgriffith | and let the driver handle details? | 00:36 |
| hemna | the capabilities scheduler allow you to even specify ranges in values | 00:36 |
| thingee | hemna: I agree with jgriffith that it should just be the standard capabilities we filter on. Leave it to the backend to choose where based on the vendor specific keys. | 00:36 |
| jgriffith | hemna: seems like a ton of extra work and complexity fo rno real gain | 00:36 |
| thingee | I think a lot of vendors would want that control | 00:36 |
| hemna | well then you need to remove the capabilities scheduler from cinder | 00:36 |
| hemna | because that's how it works today. | 00:36 |
| jgriffith | hemna: I think we might be talking passed each other on something... | 00:37 |
| hemna | ok | 00:37 |
| hemna | might me | 00:37 |
| hemna | be | 00:37 |
| hemna | :P | 00:37 |
| thingee | Don't need to. we still have *standard capabilities* | 00:37 |
| jgriffith | hemna: so what I had though (and I might be wrong) | 00:37 |
| thingee | that need to be filtered on | 00:37 |
| jgriffith | is that having the well-defined keys improves our scheduler and still does capability filtering | 00:37 |
| jgriffith | in fact does it MUCH better | 00:37 |
| jgriffith | but vendor unique keys on how that's set are handled in the driver | 00:38 |
| jgriffith | for example QoS | 00:38 |
| jgriffith | How/Why should the scheduler care that SF uses keys "minIOPS, maxIOPS and burstIOPS" | 00:38 |
| thingee | jgriffith: have another thought with pools, but we can get back to it after this. | 00:38 |
| jgriffith | that means nothing in terms of filter scheduler and probably shouldn't is what i think | 00:38 |
| jgriffith | thingee: ok... don't confuse me :) | 00:38 |
| jgriffith | hemna: is there another use case I'm missing on that? | 00:39 |
| thingee | jgriffith: don't worry, I'm getting better with communication on irc, I hope :) | 00:39 |
| jgriffith | haha.. "it's not you, it's me" :) | 00:39 |
| hemna | hehe | 00:39 |
| thingee | I think this is awesome. | 00:39 |
| hemna | so yah the vendor specific keys are scoped | 00:39 |
| jgriffith | hemna: Right | 00:39 |
| jgriffith | hemna: so ignored by the scheduler anyway, which I think is "ok" | 00:40 |
| jgriffith | hemna: and yeah, I think maybe down the road that changes | 00:40 |
| thingee | it gives vendors more freedom on placement, and leaves the capabilities simple. | 00:40 |
| jgriffith | but for now I see no real reason to do so | 00:40 |
| jgriffith | thingee: +1 | 00:40 |
| hemna | which are bypassed by the capabilities filter today | 00:40 |
| hemna | so the well defined keys are there on purpose so that the scheduler can use them for filtering | 00:41 |
| jgriffith | hemna: right, but my question is "is that a problem" and if yes, "why" | 00:41 |
| hemna | so the answer from me is no. | 00:41 |
| hemna | it's not a problem afaik | 00:41 |
| jgriffith | hemna: yes (WRT well defined keys) | 00:41 |
| jgriffith | My proposal there was to provide a mechanism to increase the power of the filter scheduler | 00:41 |
| jgriffith | AND to allow you to do your "hints" thing for keys | 00:41 |
| jgriffith | so sort of a win win compromise | 00:41 |
| hemna | to add the categories? | 00:42 |
| *** scottda_ has quit IRC | 00:42 | |
| jgriffith | hemna: the "vendor-unique-keys" | 00:42 |
| hemna | ok what's the hints thing ? | 00:42 |
| hemna | I'm not following that part. sorry, I'm dumb | 00:42 |
| jgriffith | hemna: not used by the sched, but they're presented as hints / capablities to the admin | 00:43 |
| leeantho | thingee, yes I plan on improving the documentation more in the areas that are unclear/missing, I've been trying to finish a few other things at the same time (just saw your msg) | 00:43 |
| hemna | ok | 00:43 |
| jgriffith | hemna: so the I thought the whole thing driving this for you guys was tha it wsa "hard" to know all the valid vendor keys in types | 00:43 |
| jgriffith | and you wanted to present that | 00:43 |
| hemna | yah that was part of what was driving this. | 00:43 |
| jgriffith | so my proposal was "ok" do that but be sure they're labelled as what they are | 00:43 |
| jgriffith | don't just throw out a big ol bag o'keys | 00:44 |
| jgriffith | and make sure they tie into something that is relevant | 00:44 |
| jgriffith | when applicable | 00:44 |
| hemna | we wanted to have a json dict that 1) shows what keys are supported by the vendor and 2) the user viewable information/metadata/description about those keys and their possible values/types, etc. | 00:44 |
| hemna | hence the json schema | 00:44 |
| *** annashen has quit IRC | 00:45 | |
| jgriffith | so this still give you that | 00:45 |
| gary-smith | doesn't thingee's category proposal address the 'big ol bag o'keys' ? | 00:45 |
| thingee | gary-smith: sort of | 00:45 |
| jgriffith | gary-smith: oh boy, you're trying to side track me aren't you | 00:45 |
| thingee | gary-smith: hang tight...I'll have a spec update soon | 00:45 |
| hemna | so I see the reporting of the schema as a side to the reporting of the capabilities though no? | 00:45 |
| gary-smith | :-) | 00:45 |
| jgriffith | gary-smith: I'm reiterating the proposal and our discussions as there seems to be some confusion | 00:46 |
| hemna | we just happened to lump them all into the capabilities today in get_volume_stats() | 00:46 |
| hemna | with the bad name of "extra_specs" for the key schema | 00:46 |
| thingee | hemna: don't hate me, but my spec proposes to just change that to capabilities | 00:46 |
| jgriffith | not sure why you say that's a "bad name" but ok | 00:46 |
| hemna | jgriffith, I think we are close though | 00:46 |
| jgriffith | hemna: agreed | 00:47 |
| jgriffith | thingee: I say run with it | 00:47 |
| hemna | well, because extra_specs are capabilities | 00:47 |
| *** patrickeast has quit IRC | 00:47 | |
| jgriffith | if we need to iterate slightly we can, but honestly if it turns out the way I'm envisioning everybody gets what they want here | 00:47 |
| hemna | and the purpose of that key name was simply to contain the schema of supported keys and their metadata | 00:47 |
| hemna | but not provide the actual capabilities for that pool | 00:47 |
| hemna | which I still don't like | 00:47 |
| thingee | jgriffith: let me know when I ask my question about pools :) | 00:48 |
| thingee | I can ask* | 00:48 |
| jgriffith | hemna: so curious... what are you using extra-specs for if not capabilities? | 00:48 |
| jgriffith | hemna: as in, if they don't indicate things you can do or behaviors then "why are they even there"? | 00:48 |
| hemna | personally I'd rather have a separate driver API that returns the schema itself when someone asks for it, instead of returning that as part of the capabilities in get_volume_stats() EVERY time. | 00:48 |
| jgriffith | who cares | 00:48 |
| jgriffith | hemna: you know you can do that right? | 00:48 |
| hemna | yes I do know that | 00:49 |
| hemna | we just haven't been doing that. | 00:49 |
| jgriffith | hemna: I have some code on my github that does that via extension | 00:49 |
| hemna | which was my fault | 00:49 |
| jgriffith | hemna: at least I used to.... | 00:49 |
| hemna | we filed a BP in the last week to update our driver to provide pool specific capabilities, that we hope can be scheduled against. | 00:49 |
| jgriffith | hemna: I'll see if i can dig it up, have a customer using it | 00:49 |
| jgriffith | hemna: so that's where i'm now kinda confused | 00:50 |
| hemna | ok | 00:50 |
| jgriffith | pools are treated as backends, so again; what's the difference? | 00:50 |
| hemna | not much really | 00:50 |
| jgriffith | so why are we bringing it up here again? | 00:50 |
| hemna | except each of our pools has different capabilities tied to them | 00:50 |
| jgriffith | sure, that's fine | 00:50 |
| jgriffith | hemna: now you're back to capabilities :) | 00:51 |
| hemna | just saying that we are going to add more to ours, because we haven't been reporting specific capabilities up to now. | 00:51 |
| jgriffith | hemna: which we already stated def goes in the well-def keys | 00:51 |
| hemna | so for example pool1 has raid5, supports thin provisioning, etc | 00:51 |
| jgriffith | hemna: ahhh... I think I see where you're going now | 00:51 |
| hemna | pool2 is raid0, on 15k drives | 00:52 |
| hemna | we aren't reporting that now | 00:52 |
| hemna | but want to | 00:52 |
| jgriffith | hemna: sure, I drew out that exact example in Austin | 00:52 |
| hemna | I probably missed it, sorry | 00:52 |
| hemna | I'm slow | 00:52 |
| *** nellysmitt has joined #openstack-cinder | 00:52 | |
| jgriffith | damn you... you were playing on the internet weren't you!!! | 00:52 |
| jgriffith | :) | 00:52 |
| *** markvoelker has joined #openstack-cinder | 00:52 | |
| hemna | you guys know this stuff way better than I do. but I hope I'm coming around :) | 00:52 |
| hemna | heh | 00:52 |
| jgriffith | hemna: so let's take small steps if that's cool | 00:53 |
| hemna | so | 00:53 |
| hemna | don't you think the capabilities like raid level should be a well defined key ? | 00:53 |
| jgriffith | hemna: start with the capability improvements with the well-defined keys | 00:53 |
| jgriffith | hemna: yes | 00:53 |
| jgriffith | WRT raid level | 00:53 |
| hemna | it's not really vendor specific | 00:53 |
| jgriffith | and disk rpms even | 00:53 |
| hemna | yup | 00:53 |
| hemna | we can report that up as well and plan on it | 00:53 |
| jgriffith | that being said, I do think it adds way more complication than is needed | 00:54 |
| gary-smith | how does disk rpms become a "well-defined key" | 00:54 |
| jgriffith | ie; adming creates and maps types using those gory details and the rest of us move on with life :) | 00:54 |
| gary-smith | is there a list somewhere? | 00:54 |
| jgriffith | gary-smith: thingee is working a spec | 00:54 |
| jgriffith | gary-smith: hemna also keep in mind that you can still just use the vendor keys for that as well | 00:55 |
| *** ebalduf has joined #openstack-cinder | 00:55 | |
| gary-smith | jgriffith: I thought his spec was just defining categories, didn't know it covered keys, too | 00:55 |
| jgriffith | gary-smith: that's part of it, categories aren't "well defined" without the keys IMO :) | 00:55 |
| gary-smith | jgriffith: vendor keys won't work if they're scoped, since the schduler ignores them | 00:56 |
| jgriffith | gary-smith: that's the bag o'stuff approach IMO | 00:56 |
| jgriffith | gary-smith: and I'm saying who cares :) | 00:56 |
| jgriffith | gary-smith: seriously... | 00:56 |
| jgriffith | I'm saying we can address that | 00:56 |
| thingee | jgriffith: so the question with pools, if a storage backend has three pools that fulfill all capabilities for the volume being created, the scheduler is just going to pick one of them based on the weigher | 00:57 |
| jgriffith | gary-smith: you don't have to boil the ocean all at once | 00:57 |
| *** nellysmitt has quit IRC | 00:57 | |
| gary-smith | jgriffith: not trying to, just trying to understand | 00:57 |
| jgriffith | thingee: correct, which is where gary-smith 's point comes in | 00:57 |
| *** markvoelker has quit IRC | 00:57 | |
| jgriffith | thingee: but I still argue, "ok" let the admin create types that map to the criteria they want | 00:58 |
| jgriffith | thingee: I think tackling this as "EVERY availalbe option from every backend filtered through the scheduler" as a first pass is a really really bad idea | 00:58 |
| hemna | thingee, correct | 00:58 |
| hemna | jgriffith, +1 | 00:59 |
| jgriffith | start with the well-defined stuff, and build on it | 00:59 |
| hemna | that's exactly what we were thinking as well. | 00:59 |
| hemna | gary-smith, and I have been churning on this | 00:59 |
| jgriffith | gary-smith: yeah, you might have pools that are differentiated by vendor unique things... that's fine | 00:59 |
| *** markvoelker has joined #openstack-cinder | 00:59 | |
| jgriffith | admin creates types/filters to deal with that (for now) | 00:59 |
| jgriffith | in L we revisit and build on it | 00:59 |
| jgriffith | but we really NEED to get some standards started at some point | 01:00 |
| jgriffith | and if you insist that we have to have every 3par pool option included in scheduling I'll guarantee we'll never get anywhere | 01:00 |
| *** ebalduf has quit IRC | 01:00 | |
| jgriffith | hemna: gary-smith this is the part I said was a compromise and win/win | 01:00 |
| *** davechen has joined #openstack-cinder | 01:00 | |
| jgriffith | we move forward on some standardization (what i want) | 01:01 |
| jgriffith | we present the info to the admins to help them (part of what you want) | 01:01 |
| hemna | jgriffith, perfect | 01:01 |
| jgriffith | and we have an extenable foundation we can build on going forward | 01:01 |
| jgriffith | oh.. and the operator wins in all of this as well | 01:01 |
| hemna | yah sounds great man. I think I'm good with it. | 01:02 |
| gary-smith | me too | 01:02 |
| jgriffith | cool... thingee we all good? | 01:02 |
| *** alex_xu has joined #openstack-cinder | 01:03 | |
| *** markvoelker has quit IRC | 01:04 | |
| jgriffith | gary-smith: hemna so here's something to chew on as well... | 01:05 |
| jgriffith | gary-smith: hemna vendors can write their own specific filter | 01:06 |
| jgriffith | gary-smith: hemna there's a documented process for creating your own filter | 01:06 |
| jgriffith | gary-smith: hemna you could ship it as an add on with your driver, or maybe there's something clever to be done like putting it "in" your driver | 01:06 |
| hemna | so if you wanted to filter on vendor specific keys you could then | 01:06 |
| jgriffith | hemna: exactly | 01:07 |
| jgriffith | I thought about that a while back, wrote one that sat between the scheduler and my driver | 01:07 |
| gary-smith | basically extend the CapabilitiesFilter to look for the things you care about. interesting | 01:07 |
| jgriffith | gary-smith: so that's one way... but yeah | 01:07 |
| gugl2 | ping thingee | 01:08 |
| jgriffith | my use case was I aggregated multiple SF clusters into a single Cinder driver | 01:08 |
| *** scottda_ has joined #openstack-cinder | 01:08 | |
| jgriffith | and had my own scheduling logic there... but in my case it was kinda stupid | 01:08 |
| jgriffith | it was for one specific problem I wanted to solve, and as the filter scheduler matured I didn't need it any longer | 01:08 |
| jgriffith | hemna: gary-smith FWIW I don't recommend the shim version I did, but you're own filter scheduler | 01:09 |
| hemna | coolio | 01:10 |
| hemna | so thingee, I hate to pressure you, but the sooner we can get the spec in, we can work on the cinder/horizon changes need to try and get this in for K | 01:10 |
| hemna | as we want to try and do validation as well, but we can push that to L if need be. | 01:11 |
| *** scottda_ has joined #openstack-cinder | 01:12 | |
| *** scottda_ has quit IRC | 01:14 | |
| *** scottda_ has joined #openstack-cinder | 01:15 | |
| *** Mandell has quit IRC | 01:16 | |
| *** hemna is now known as hemnaf | 01:17 | |
| *** hemnaf is now known as hemnafk | 01:17 | |
| *** scottda_ has quit IRC | 01:19 | |
| *** Mandell has joined #openstack-cinder | 01:20 | |
| openstackgerrit | Kurt Martin proposed openstack/cinder: Add dedup provisioning to 3PAR drivers https://review.openstack.org/151802 | 01:22 |
| *** leeantho has quit IRC | 01:22 | |
| *** tsekiyam_ has joined #openstack-cinder | 01:26 | |
| *** Lee1092 has joined #openstack-cinder | 01:28 | |
| *** tsekiyama has quit IRC | 01:28 | |
| *** tsekiyam_ has quit IRC | 01:30 | |
| openstackgerrit | Gloria Gu proposed openstack/cinder: HP 3par driver filter and evaluator function https://review.openstack.org/151353 | 01:33 |
| *** Mandell has quit IRC | 01:39 | |
| *** markvoelker has joined #openstack-cinder | 01:40 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 01:43 | |
| *** r-daneel has quit IRC | 01:46 | |
| *** _cjones_ has quit IRC | 01:48 | |
| openstackgerrit | Gloria Gu proposed openstack/cinder: HP 3par driver filter and evaluator function https://review.openstack.org/151353 | 01:55 |
| *** dannywilson has quit IRC | 01:58 | |
| *** dannywilson has joined #openstack-cinder | 01:58 | |
| *** r-daneel has joined #openstack-cinder | 02:03 | |
| *** mtanino has quit IRC | 02:04 | |
| *** chenleji has joined #openstack-cinder | 02:14 | |
| *** Longgeek has joined #openstack-cinder | 02:15 | |
| *** bill_az_ has quit IRC | 02:17 | |
| *** MasterPiece has quit IRC | 02:19 | |
| *** dannywilson has quit IRC | 02:23 | |
| *** MasterPiece has joined #openstack-cinder | 02:28 | |
| *** MasterPiece| has joined #openstack-cinder | 02:29 | |
| *** lcurtis has joined #openstack-cinder | 02:31 | |
| *** MasterPiece has quit IRC | 02:33 | |
| *** rmesta has quit IRC | 02:35 | |
| *** tsekiyama has joined #openstack-cinder | 02:36 | |
| *** davechen_ has joined #openstack-cinder | 02:37 | |
| thingee | jgriffith: sorry got pulled into a meeting | 02:38 |
| *** Apoorva_ has joined #openstack-cinder | 02:38 | |
| thingee | jgriffith: I get what you're saying. I guess what I'm considering the idea that you have one backend, with three pools. Say they all report the same capabilities, so it comes to the weigher on the three. | 02:39 |
| jgriffith | thingee: yep | 02:40 |
| *** davechen has quit IRC | 02:40 | |
| jgriffith | if they all report the same thing then yeah, it should | 02:40 |
| thingee | so I guess eventually we can talk about how we can do mutal exclusive? | 02:40 |
| thingee | three volume creations, separate pools | 02:40 |
| thingee | I guess today with this model, you can have some capability pushed from the backend to support passing a hint. | 02:41 |
| *** tsekiyama has quit IRC | 02:41 | |
| jgriffith | thingee: so I don't understand the concern, if the pools are all identical in capabilites who cares | 02:41 |
| jgriffith | if theyre' not... then they'll either report as such in their capabilites | 02:42 |
| thingee | thinking of pool affinity cases like hadoop. | 02:42 |
| *** Apoorva has quit IRC | 02:42 | |
| jgriffith | or you use the the vendor keys you get back to create a type for them appropriately | 02:42 |
| jgriffith | thingee: that isn't solved by this proposal either though | 02:42 |
| *** Apoorva_ has quit IRC | 02:43 | |
| jgriffith | thingee: IMO things like that you really SHOULD build a custom type/extra-spec for and do it right | 02:43 |
| jgriffith | or custom filter as I suggested before | 02:43 |
| jgriffith | thingee: note that an affinity/anti-affinity filter is a whole different thing | 02:44 |
| thingee | jgriffith: it's just a use case I hear. When I hear custom filter, I'm not sure what's going to be easy for the cloud admin to act on that. | 02:44 |
| jgriffith | nothing to do with capabilities | 02:44 |
| thingee | jgriffith: sure | 02:44 |
| jgriffith | thingee: so IMO that's yet another whole seperate filter and use case | 02:44 |
| thingee | jgriffith: sure | 02:44 |
| *** bill_ibm has joined #openstack-cinder | 02:45 | |
| thingee | jgriffith, hemnafk: ok, well I'll try to get a spec posted tonight. I've had too many meetings today :( | 02:45 |
| jgriffith | thingee: I'm not certain on that use case anyway though... the affinity rules in hadoop are mostly around VM's | 02:45 |
| jgriffith | and it's usually anti-affinity that you want IIRC | 02:45 |
| jgriffith | but I'm not a Hadoop expert | 02:45 |
| thingee | gugl2: hi | 02:46 |
| *** smcginni1 has joined #openstack-cinder | 02:47 | |
| *** Longgeek has quit IRC | 02:48 | |
| thingee | jgriffith: thanks for the help | 02:49 |
| *** lcurtis has quit IRC | 02:49 | |
| *** shakamunyi has joined #openstack-cinder | 02:50 | |
| *** thingee has quit IRC | 02:50 | |
| *** rodrigod` has joined #openstack-cinder | 02:50 | |
| *** smcginnis has quit IRC | 02:52 | |
| *** rwsu has quit IRC | 02:52 | |
| *** scottda has quit IRC | 02:52 | |
| *** bill_az has quit IRC | 02:52 | |
| *** rodrigods has quit IRC | 02:52 | |
| jgriffith | thingee... you betya | 02:52 |
| * jgriffith goes to eat dinner | 02:52 | |
| *** nellysmitt has joined #openstack-cinder | 02:53 | |
| *** emagana has quit IRC | 02:53 | |
| *** emagana has joined #openstack-cinder | 02:54 | |
| *** Longgeek has joined #openstack-cinder | 02:55 | |
| *** scottda has joined #openstack-cinder | 02:57 | |
| *** rwsu has joined #openstack-cinder | 02:58 | |
| *** vilobhmm has quit IRC | 02:58 | |
| *** emagana has quit IRC | 02:58 | |
| *** david-lyle is now known as david-lyle_afk | 02:59 | |
| *** kaisers1 has joined #openstack-cinder | 03:00 | |
| *** kaisers has quit IRC | 03:01 | |
| *** mberlin has joined #openstack-cinder | 03:01 | |
| *** nellysmitt has quit IRC | 03:01 | |
| *** mberlin1 has quit IRC | 03:01 | |
| *** lcurtis has joined #openstack-cinder | 03:05 | |
| *** Yogi1 has joined #openstack-cinder | 03:09 | |
| *** ebalduf has joined #openstack-cinder | 03:11 | |
| jgriffith | hemnafk: you might want to look at this in your lib work for brick: https://bugs.launchpad.net/cinder/+bug/1216051 | 03:14 |
| openstack | Launchpad bug 1216051 in Cinder "exception handling makes bad assumptions" [Undecided,Triaged] | 03:14 |
| *** Yogi1 has quit IRC | 03:14 | |
| *** takedakn has joined #openstack-cinder | 03:14 | |
| *** ebalduf has quit IRC | 03:15 | |
| *** MasterPiece| has quit IRC | 03:21 | |
| *** scottda_ has joined #openstack-cinder | 03:27 | |
| *** scottda_ has quit IRC | 03:27 | |
| *** EmilienM is now known as EmilienM|afk | 03:28 | |
| *** bkopilov has quit IRC | 03:34 | |
| *** enterprisedc has quit IRC | 03:35 | |
| *** enterprisedc has joined #openstack-cinder | 03:36 | |
| *** ebalduf has joined #openstack-cinder | 03:50 | |
| *** MasterPiece has joined #openstack-cinder | 03:51 | |
| *** ebalduf has quit IRC | 03:51 | |
| *** takedakn has quit IRC | 03:53 | |
| *** mriedem has quit IRC | 03:55 | |
| *** hemna has joined #openstack-cinder | 03:56 | |
| *** rushiagr_away is now known as rushiagr | 04:06 | |
| *** hemna has quit IRC | 04:06 | |
| *** harlowja is now known as harlowja_away | 04:08 | |
| *** Longgeek has quit IRC | 04:10 | |
| *** BharatK has joined #openstack-cinder | 04:17 | |
| *** Mandell has joined #openstack-cinder | 04:21 | |
| *** Longgeek has joined #openstack-cinder | 04:25 | |
| *** Longgeek has quit IRC | 04:26 | |
| *** lcurtis has quit IRC | 04:27 | |
| *** barra204 has joined #openstack-cinder | 04:35 | |
| *** MasterPiece| has joined #openstack-cinder | 04:38 | |
| *** shakamunyi has quit IRC | 04:39 | |
| *** sileht has quit IRC | 04:40 | |
| *** MasterPiece has quit IRC | 04:40 | |
| *** lcurtis has joined #openstack-cinder | 04:41 | |
| *** rushiagr is now known as rushiagr_away | 04:48 | |
| *** harlowja_at_home has joined #openstack-cinder | 04:49 | |
| *** deepakcs has joined #openstack-cinder | 04:52 | |
| *** BharatK has quit IRC | 04:52 | |
| *** barra204 has quit IRC | 04:53 | |
| *** r-daneel has quit IRC | 04:54 | |
| *** nellysmitt has joined #openstack-cinder | 04:58 | |
| *** hflai has quit IRC | 05:02 | |
| *** nellysmitt has quit IRC | 05:03 | |
| openstackgerrit | Tina Tang proposed openstack/cinder: Attach/detach batch processing in VNX driver https://review.openstack.org/154350 | 05:03 |
| *** bkopilov has joined #openstack-cinder | 05:06 | |
| *** barra204 has joined #openstack-cinder | 05:07 | |
| *** BharatK has joined #openstack-cinder | 05:08 | |
| *** lcurtis has quit IRC | 05:12 | |
| *** harlowja_at_home has quit IRC | 05:18 | |
| *** coolsvap has joined #openstack-cinder | 05:19 | |
| *** coolsvap has quit IRC | 05:21 | |
| *** coolsvap has joined #openstack-cinder | 05:23 | |
| *** ankit_ag has joined #openstack-cinder | 05:25 | |
| *** ankit_ag has quit IRC | 05:25 | |
| *** ankit_ag has joined #openstack-cinder | 05:26 | |
| openstackgerrit | Xi Yang proposed openstack/cinder: EMC VNX Cinder Driver iSCSI multipath enhancement https://review.openstack.org/154772 | 05:28 |
| *** Ilja has joined #openstack-cinder | 05:32 | |
| *** lcurtis has joined #openstack-cinder | 05:35 | |
| *** nikesh_vedams has joined #openstack-cinder | 05:39 | |
| *** anshul has joined #openstack-cinder | 05:41 | |
| *** anshul has quit IRC | 05:41 | |
| *** anshul has joined #openstack-cinder | 05:42 | |
| *** nkrinner has joined #openstack-cinder | 05:46 | |
| *** nellysmitt has joined #openstack-cinder | 05:50 | |
| *** MasterPiece| has quit IRC | 05:51 | |
| *** BharatK has quit IRC | 05:52 | |
| *** sileht has joined #openstack-cinder | 06:04 | |
| *** Mandell has quit IRC | 06:07 | |
| *** Longgeek has joined #openstack-cinder | 06:07 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/cinder: Imported Translations from Transifex https://review.openstack.org/152401 | 06:09 |
| *** lpetrut has joined #openstack-cinder | 06:11 | |
| *** BharatK has joined #openstack-cinder | 06:14 | |
| *** BharatK has quit IRC | 06:18 | |
| *** BharatK has joined #openstack-cinder | 06:30 | |
| *** Mandell has joined #openstack-cinder | 06:30 | |
| *** boris-42 has joined #openstack-cinder | 06:33 | |
| *** barra204 has quit IRC | 06:36 | |
| openstackgerrit | Liu Xinguo proposed openstack/cinder: Huawei driver check before associating LUN to a LUN group https://review.openstack.org/148144 | 06:36 |
| *** ronenkat has joined #openstack-cinder | 06:38 | |
| *** sgotliv has joined #openstack-cinder | 06:44 | |
| openstackgerrit | Liu Xinguo proposed openstack/cinder: Huawei driver fix problems under multipath https://review.openstack.org/150767 | 06:46 |
| *** wanghao has joined #openstack-cinder | 06:50 | |
| openstackgerrit | Liu Xinguo proposed openstack/cinder: Huawei driver remove LUN controller change https://review.openstack.org/152116 | 06:56 |
| openstackgerrit | yogeshprasad proposed openstack/cinder: Fixes total_capacity_gb value in CloudByte driver. https://review.openstack.org/154878 | 07:02 |
| *** nellysmitt has quit IRC | 07:04 | |
| *** afazekas has joined #openstack-cinder | 07:06 | |
| *** davechen_ has quit IRC | 07:07 | |
| *** davechen has joined #openstack-cinder | 07:07 | |
| *** vukcrni has quit IRC | 07:12 | |
| *** vukcrni has joined #openstack-cinder | 07:15 | |
| *** lcurtis has quit IRC | 07:20 | |
| *** takedakn has joined #openstack-cinder | 07:29 | |
| *** ronenkat has quit IRC | 07:32 | |
| *** ronis has joined #openstack-cinder | 07:34 | |
| openstackgerrit | Amit Saha proposed openstack/cinder: Fixed typo https://review.openstack.org/155213 | 07:35 |
| *** Miouge has joined #openstack-cinder | 07:35 | |
| *** lpetrut has quit IRC | 07:38 | |
| *** e0ne has joined #openstack-cinder | 07:40 | |
| *** TobiasE has joined #openstack-cinder | 07:47 | |
| *** deepakcs has quit IRC | 07:48 | |
| *** deepakcs has joined #openstack-cinder | 07:48 | |
| *** bkopilov has quit IRC | 07:48 | |
| *** bkopilov has joined #openstack-cinder | 07:48 | |
| *** coolsvap has quit IRC | 07:48 | |
| *** coolsvap has joined #openstack-cinder | 07:48 | |
| *** nikesh_vedams has quit IRC | 07:48 | |
| *** nikesh_vedams has joined #openstack-cinder | 07:48 | |
| *** anshul has quit IRC | 07:48 | |
| *** anshul has joined #openstack-cinder | 07:48 | |
| *** nkrinner has quit IRC | 07:48 | |
| *** nkrinner has joined #openstack-cinder | 07:48 | |
| *** BharatK has quit IRC | 07:49 | |
| *** BharatK has joined #openstack-cinder | 07:49 | |
| *** boris-42 has quit IRC | 07:49 | |
| *** boris-42 has joined #openstack-cinder | 07:49 | |
| *** afazekas has quit IRC | 07:49 | |
| *** afazekas has joined #openstack-cinder | 07:49 | |
| *** Longgeek has quit IRC | 07:53 | |
| *** Longgeek has joined #openstack-cinder | 07:53 | |
| *** sandywalsh_ has joined #openstack-cinder | 07:53 | |
| *** Longgeek has quit IRC | 07:53 | |
| *** sandywalsh has quit IRC | 07:55 | |
| *** sandywalsh_ has quit IRC | 08:04 | |
| *** Miouge_ has joined #openstack-cinder | 08:05 | |
| *** sandywalsh has joined #openstack-cinder | 08:06 | |
| *** Miouge has quit IRC | 08:06 | |
| *** Miouge_ is now known as Miouge | 08:06 | |
| *** nkrinner has quit IRC | 08:11 | |
| *** nkrinner has joined #openstack-cinder | 08:14 | |
| *** ronenkat has joined #openstack-cinder | 08:15 | |
| *** ronenkat_ has joined #openstack-cinder | 08:16 | |
| *** e0ne has quit IRC | 08:17 | |
| *** karimb has joined #openstack-cinder | 08:18 | |
| *** ronenkat has quit IRC | 08:20 | |
| *** openstackgerrit has quit IRC | 08:21 | |
| *** openstackgerrit has joined #openstack-cinder | 08:22 | |
| *** dulek has joined #openstack-cinder | 08:29 | |
| *** alecv has joined #openstack-cinder | 08:39 | |
| openstackgerrit | Michal Dulko proposed openstack/cinder: Fix allocated_capacity tracking when rescheduling https://review.openstack.org/154920 | 08:39 |
| *** chlong has quit IRC | 08:42 | |
| *** bkopilov has quit IRC | 08:44 | |
| *** bkopilov has joined #openstack-cinder | 08:45 | |
| *** Longgeek has joined #openstack-cinder | 08:54 | |
| *** jistr|off is now known as jistr | 08:54 | |
| *** ronenkat__ has joined #openstack-cinder | 08:55 | |
| *** ronenkat_ has quit IRC | 08:58 | |
| *** lpetrut has joined #openstack-cinder | 08:59 | |
| *** sgotliv_ has joined #openstack-cinder | 09:01 | |
| *** sgotliv has quit IRC | 09:04 | |
| openstackgerrit | Mike Perez proposed openstack/cinder-specs: Standard Capabilities https://review.openstack.org/150511 | 09:04 |
| *** nellysmitt has joined #openstack-cinder | 09:05 | |
| *** jpich has joined #openstack-cinder | 09:06 | |
| *** jordanP has joined #openstack-cinder | 09:06 | |
| *** Longgeek has quit IRC | 09:07 | |
| *** jistr has quit IRC | 09:08 | |
| *** nellysmitt has quit IRC | 09:10 | |
| *** sgotliv__ has joined #openstack-cinder | 09:10 | |
| *** jistr has joined #openstack-cinder | 09:11 | |
| *** Mandell has quit IRC | 09:11 | |
| *** sgotliv_ has quit IRC | 09:13 | |
| *** nileshb has joined #openstack-cinder | 09:15 | |
| *** BharatK has quit IRC | 09:16 | |
| *** takedakn has quit IRC | 09:24 | |
| *** nshaikh has joined #openstack-cinder | 09:28 | |
| *** BharatK has joined #openstack-cinder | 09:30 | |
| *** e0ne has joined #openstack-cinder | 09:31 | |
| *** nileshb has quit IRC | 09:34 | |
| *** xyang1 has quit IRC | 09:34 | |
| *** Miouge has quit IRC | 09:37 | |
| *** davechen_ has joined #openstack-cinder | 09:39 | |
| *** davechen has quit IRC | 09:41 | |
| *** Miouge has joined #openstack-cinder | 09:43 | |
| *** alex_xu has quit IRC | 09:47 | |
| *** yuriy_n17 has joined #openstack-cinder | 09:47 | |
| *** Miouge has quit IRC | 09:48 | |
| *** aarefiev has quit IRC | 09:49 | |
| nikesh_vedams | thingee: still online :) | 09:51 |
| *** aarefiev has joined #openstack-cinder | 10:00 | |
| *** Miouge has joined #openstack-cinder | 10:00 | |
| *** ronenkat has joined #openstack-cinder | 10:03 | |
| *** Longgeek has joined #openstack-cinder | 10:04 | |
| *** ronenkat__ has quit IRC | 10:07 | |
| ondergetekende_ | Can someone help me? One of my SANs is reported as down, even though it's update_service_capabilities is properly delivered by the MQ. | 10:14 |
| ondergetekende_ | All of my other SANs are online, and their messages are extremely similar. | 10:14 |
| *** e0ne is now known as e0ne_ | 10:21 | |
| nikesh_vedams | aarefiev:hi | 10:23 |
| nikesh_vedams | we addressed your reviews | 10:24 |
| nikesh_vedams | https://review.openstack.org/#/c/145778/17/cinder/volume/targets/scst.py | 10:24 |
| nikesh_vedams | so +1 ? :) | 10:24 |
| aarefiev | nikesh_vedams: ok, thx, I'l see later | 10:25 |
| nikesh_vedams | ya sure thanks | 10:25 |
| *** e0ne_ is now known as e0ne | 10:30 | |
| *** ndipanov has joined #openstack-cinder | 10:30 | |
| *** Longgeek has quit IRC | 10:38 | |
| *** leopoldj has joined #openstack-cinder | 10:40 | |
| openstackgerrit | Vincent Hou proposed openstack/cinder: Set the request_spec with the value of the new type in migration https://review.openstack.org/155243 | 10:41 |
| *** Longgeek has joined #openstack-cinder | 10:44 | |
| *** wanghao has quit IRC | 10:45 | |
| *** wanghao has joined #openstack-cinder | 10:45 | |
| openstackgerrit | Amit Saha proposed openstack/cinder: Fixed typo https://review.openstack.org/155213 | 10:58 |
| *** nellysmitt has joined #openstack-cinder | 11:06 | |
| *** nellysmitt has quit IRC | 11:10 | |
| openstackgerrit | Jordan Pittier proposed openstack/cinder: Fix Scality SRB driver security concerns https://review.openstack.org/152117 | 11:11 |
| *** kmartin has quit IRC | 11:16 | |
| *** mdenny has quit IRC | 11:17 | |
| *** dobson has quit IRC | 11:27 | |
| *** pschaef has joined #openstack-cinder | 11:27 | |
| *** ndipanov has quit IRC | 11:29 | |
| *** smoriya has quit IRC | 11:30 | |
| *** BharatK has quit IRC | 11:30 | |
| *** dobson has joined #openstack-cinder | 11:34 | |
| *** markvoelker has quit IRC | 11:34 | |
| *** BharatK has joined #openstack-cinder | 11:35 | |
| *** ndipanov has joined #openstack-cinder | 11:41 | |
| *** e0ne is now known as e0ne_ | 11:48 | |
| *** rodrigod` is now known as rodrigods | 11:49 | |
| *** asselin__ has quit IRC | 11:52 | |
| *** e0ne_ has quit IRC | 11:58 | |
| *** aix has quit IRC | 12:01 | |
| *** BharatK has quit IRC | 12:02 | |
| *** MasterPiece has joined #openstack-cinder | 12:05 | |
| openstackgerrit | Rushi Agrawal proposed openstack/cinder-specs: Kilo: Support public snapshot https://review.openstack.org/125045 | 12:06 |
| *** MasterPiece has quit IRC | 12:12 | |
| *** BharatK has joined #openstack-cinder | 12:17 | |
| *** TobiasE1 has joined #openstack-cinder | 12:19 | |
| *** karimb has quit IRC | 12:20 | |
| *** MasterPiece has joined #openstack-cinder | 12:22 | |
| *** TobiasE has quit IRC | 12:22 | |
| *** bswartz has quit IRC | 12:23 | |
| openstackgerrit | Rushi Agrawal proposed openstack/cinder: Hitachi: Remove duplicate CHAP opts https://review.openstack.org/149542 | 12:26 |
| openstackgerrit | Rushi Agrawal proposed openstack/cinder: EQLX: Consolidate CHAP config options https://review.openstack.org/148091 | 12:26 |
| *** nellysmitt has joined #openstack-cinder | 12:27 | |
| *** markvoelker has joined #openstack-cinder | 12:35 | |
| *** tellesnobrega_ has joined #openstack-cinder | 12:36 | |
| *** markvoelker has quit IRC | 12:40 | |
| *** deepakcs has quit IRC | 12:40 | |
| *** IanGovett has joined #openstack-cinder | 12:41 | |
| *** nkrinner has quit IRC | 12:49 | |
| *** nkrinner has joined #openstack-cinder | 12:53 | |
| *** markstur_ has joined #openstack-cinder | 12:55 | |
| *** markstur_ has left #openstack-cinder | 12:55 | |
| *** TobiasE has joined #openstack-cinder | 12:56 | |
| *** aix has joined #openstack-cinder | 12:57 | |
| *** TobiasE1 has quit IRC | 12:57 | |
| *** tellesnobrega_ has quit IRC | 12:58 | |
| *** bkopilov has quit IRC | 12:58 | |
| *** kaufer has joined #openstack-cinder | 12:59 | |
| *** markvoelker has joined #openstack-cinder | 12:59 | |
| *** bswartz has joined #openstack-cinder | 13:02 | |
| *** markvoelker has quit IRC | 13:05 | |
| *** e0ne has joined #openstack-cinder | 13:05 | |
| *** eharney has joined #openstack-cinder | 13:05 | |
| *** nkrinner has quit IRC | 13:07 | |
| *** lcurtis has joined #openstack-cinder | 13:08 | |
| *** alexpilotti has joined #openstack-cinder | 13:09 | |
| *** nkrinner has joined #openstack-cinder | 13:10 | |
| *** EmilienM|afk is now known as EmilienM | 13:11 | |
| *** tellesnobrega has quit IRC | 13:11 | |
| *** Mandell has joined #openstack-cinder | 13:12 | |
| *** lcurtis has quit IRC | 13:14 | |
| *** Mandell has quit IRC | 13:16 | |
| *** pschaef has quit IRC | 13:17 | |
| *** tbarron has joined #openstack-cinder | 13:20 | |
| *** bill_az has joined #openstack-cinder | 13:24 | |
| openstackgerrit | Vipin Balachandran proposed openstack/cinder: VMware: Refactor initialize_connection unit tests https://review.openstack.org/155300 | 13:26 |
| *** karimb has joined #openstack-cinder | 13:31 | |
| *** Ilja has quit IRC | 13:33 | |
| *** e0ne is now known as e0ne_ | 13:35 | |
| *** timcl has joined #openstack-cinder | 13:35 | |
| *** tellesnobrega has joined #openstack-cinder | 13:37 | |
| *** eharney has quit IRC | 13:39 | |
| *** crose has joined #openstack-cinder | 13:39 | |
| *** akerr has joined #openstack-cinder | 13:40 | |
| *** nshaikh has left #openstack-cinder | 13:40 | |
| *** avishay has joined #openstack-cinder | 13:45 | |
| *** Yogi1 has joined #openstack-cinder | 13:48 | |
| *** e0ne_ is now known as e0ne | 13:48 | |
| openstackgerrit | Vipin Balachandran proposed openstack/cinder: VMware:Use datastore selection logic in new module https://review.openstack.org/155313 | 13:49 |
| openstackgerrit | Vipin Balachandran proposed openstack/cinder: VMware:Use datastore selection logic in new module https://review.openstack.org/155313 | 13:51 |
| openstackgerrit | xing-yang proposed openstack/cinder: EMC VMAX driver Kilo update https://review.openstack.org/141729 | 13:52 |
| *** eharney has joined #openstack-cinder | 13:53 | |
| openstackgerrit | Kallebe Monteiro proposed openstack/python-cinderclient: Add -d short option for --debug https://review.openstack.org/155315 | 13:54 |
| *** anshul has quit IRC | 13:55 | |
| *** crose has quit IRC | 13:59 | |
| *** TobiasE1 has joined #openstack-cinder | 14:00 | |
| *** sigmavirus24_awa is now known as sigmavirus24 | 14:01 | |
| *** TobiasE has quit IRC | 14:01 | |
| *** nkrinner has quit IRC | 14:05 | |
| *** primechuck has joined #openstack-cinder | 14:06 | |
| *** nkrinner has joined #openstack-cinder | 14:08 | |
| *** dalgaaf has joined #openstack-cinder | 14:13 | |
| dulek | e0ne: Still working on https://bugs.launchpad.net/cinder/+bug/1409012 | 14:13 |
| openstack | Launchpad bug 1409012 in Cinder "Volume becomes in 'error' state after scheduler starts" [High,In progress] - Assigned to Ivan Kolodyazhny (e0ne) | 14:13 |
| dulek | e0ne: ? | 14:13 |
| e0ne | dulek: hi. looks like it needs dome discussion in a mailing list or a meeting | 14:14 |
| e0ne | dulek: i didn't find easy solution for it:( | 14:15 |
| e0ne | did you se my comment? | 14:15 |
| dulek | Yup. | 14:15 |
| dulek | So you don't mind if I take a look at it as I have some free cycles? :) | 14:15 |
| dulek | Maybe fresh look at it will help. | 14:15 |
| e0ne | dulek: sure! thanks for help | 14:16 |
| e0ne | dulek: do you have an idea how to fix it? | 14:17 |
| dulek | e0ne: Not yet but I'll see if I can come up with an idea | 14:18 |
| e0ne | :) | 14:19 |
| *** lpetrut has quit IRC | 14:24 | |
| *** david-lyle_afk is now known as david-lyle | 14:25 | |
| *** ankit8188 has joined #openstack-cinder | 14:27 | |
| *** alexpilotti has quit IRC | 14:28 | |
| *** alexpilotti has joined #openstack-cinder | 14:29 | |
| *** ankit_ag has quit IRC | 14:29 | |
| *** jungleboyj has quit IRC | 14:29 | |
| *** humble_ has joined #openstack-cinder | 14:31 | |
| *** boris-42 has quit IRC | 14:32 | |
| *** thangp has joined #openstack-cinder | 14:34 | |
| *** aagrawal has joined #openstack-cinder | 14:35 | |
| *** aagrawal has quit IRC | 14:36 | |
| *** r-daneel has joined #openstack-cinder | 14:36 | |
| *** ankit8188 has quit IRC | 14:39 | |
| *** mriedem has joined #openstack-cinder | 14:39 | |
| *** boris-42 has joined #openstack-cinder | 14:42 | |
| *** smcginni1 is now known as smcginnis | 14:42 | |
| *** jcru has joined #openstack-cinder | 14:44 | |
| *** nshaikh has joined #openstack-cinder | 14:46 | |
| *** mtanino has joined #openstack-cinder | 14:50 | |
| *** nshaikh has quit IRC | 14:51 | |
| *** tellesnobrega has quit IRC | 14:51 | |
| *** tellesnobrega has joined #openstack-cinder | 14:54 | |
| *** tellesnobrega_ has joined #openstack-cinder | 14:54 | |
| *** tellesnobrega_ has quit IRC | 14:55 | |
| *** ronenkat_ has joined #openstack-cinder | 15:00 | |
| *** ronenkat has quit IRC | 15:03 | |
| *** bkopilov has joined #openstack-cinder | 15:04 | |
| dulek | thangp: ping | 15:05 |
| openstackgerrit | Steven Kaufer proposed openstack/cinder: WIP Generic filter support for volume queries https://review.openstack.org/155343 | 15:05 |
| *** nkrinner has quit IRC | 15:06 | |
| *** hemna has joined #openstack-cinder | 15:19 | |
| *** Mandell has joined #openstack-cinder | 15:19 | |
| smcginnis | I noticed in cinder/exception.py there is a note for Duplicate stating "EOL this exception!" | 15:20 |
| smcginnis | Any reason why we should get rid of that exception? | 15:20 |
| smcginnis | It's only used in hp_3par_common, but I don't see why we need to get rid of it. | 15:20 |
| smcginnis | Anyone have any opinions? Seems like we should either updated hp_3par_common and remove it, or get rid of that comment. | 15:21 |
| *** TobiasE has joined #openstack-cinder | 15:21 | |
| *** kaufer has quit IRC | 15:21 | |
| *** TobiasE1 has quit IRC | 15:22 | |
| *** e0ne is now known as e0ne_ | 15:23 | |
| eharney | smcginnis: not sure on the note, but looking at the usage, i'd think it could be a VolumeBackendAPIException instead | 15:24 |
| eharney | smcginnis: it is used as a base type for other exceptions... | 15:24 |
| *** rushil has joined #openstack-cinder | 15:25 | |
| smcginnis | eharney: Do you think we should refactor to remove it? I don't really see any harm in having it. | 15:25 |
| *** mdenny has joined #openstack-cinder | 15:28 | |
| *** karimb has quit IRC | 15:28 | |
| eharney | smcginnis: it's probably ok, unless there is is some special error handling for a more specific exception | 15:29 |
| dulek | thangp: Do you plan to implement more Cinder resources as versionedobjects for Kilo? | 15:30 |
| *** asselin has joined #openstack-cinder | 15:30 | |
| *** jpich has quit IRC | 15:30 | |
| dulek | thangp: I have some free cycles once persitence of workflows was deferred. | 15:31 |
| thangp | dulek: not for kilo, since we kind of have a short time period to get it done | 15:31 |
| thangp | dulek: but for liberty...yes | 15:31 |
| thangp | dulek: but you are welcome to start any other resources :) | 15:31 |
| thangp | dulek: there are a bunch | 15:32 |
| smcginnis | eharney: I guess I'll leave it for now. Primarily since other duplicate-related exceptions use it as their base. Wouldn't be hard to remove it, but I like the logic of them having that common base. And doesn't seem like worth doing a patch solely to remove that comment. :) | 15:32 |
| dulek | thangp: I wonder if I could start with backups and try to get them into Kilo. What do you think? | 15:32 |
| thangp | dulek: sure, sounds fine | 15:32 |
| dulek | thangp: Or maybe there's better candidate? | 15:32 |
| thangp | dulek: backup sounds good | 15:32 |
| thangp | dulek: there's also service | 15:33 |
| dulek | thangp: Okay, great. :) | 15:33 |
| thangp | dulek: the largest "object" is probably volume...that's going to take a lot of time to do | 15:33 |
| dulek | thangp: Oh, I thought that you've implemented it in snapshots patch? | 15:34 |
| thangp | dulek: only the skeleton | 15:34 |
| thangp | dulek: i plan to finish it up | 15:34 |
| thangp | dulek: in liberty | 15:34 |
| *** jungleboyj has joined #openstack-cinder | 15:34 | |
| dulek | thangp: Okay, code still uses SQLAlchemy objects | 15:34 |
| thangp | dulek: that's because snapshots references volume | 15:34 |
| thangp | dulek: yup | 15:34 |
| dulek | thangp: I get it. | 15:34 |
| *** e0ne_ is now known as e0ne | 15:35 | |
| thangp | dulek: could you base it off of the snapshot object patch? https://review.openstack.org/#/c/133566/ | 15:35 |
| dulek | thangp: Okay, another thing is if you plan to move to oslo.versionedobjects | 15:35 |
| *** hemna has quit IRC | 15:35 | |
| thangp | dulek: yes...i'm not sure of the state of it | 15:35 |
| *** nellysmitt has quit IRC | 15:35 | |
| thangp | dulek: I see the github repo | 15:35 |
| thangp | dulek: but there are still changes coming in | 15:36 |
| thangp | dulek: e.g. it still has NovaObject as a name in base.py | 15:36 |
| thangp | dulek: I can follow up with dansmith on it | 15:36 |
| dulek | thangp: Two of my colleagues are working on that repo. | 15:36 |
| thangp | dulek: ok...it would be good to know when they have a initial version ready | 15:37 |
| dulek | thangp: OpenStack project is ready, code is forked from Nova and guys are working to get it generic. | 15:37 |
| *** kaufer has joined #openstack-cinder | 15:37 | |
| dulek | thangp: They were able to make Heat objectification functional depending on versionedobjects package. | 15:38 |
| dulek | thangp: So I guess initial version is ready. :) | 15:38 |
| dulek | thangp: Let me find their patchset... | 15:38 |
| *** hemna has joined #openstack-cinder | 15:40 | |
| dulek | thangp: "ImportError: No module named oslo_versionedobjects", cool, they forgot to add it to requirements.txt ;) | 15:43 |
| dulek | thangp: https://review.openstack.org/#/c/146841/11 | 15:43 |
| *** nellysmitt has joined #openstack-cinder | 15:43 | |
| dulek | thangp: Anyway you can take a look, they claim this should work after this change. | 15:43 |
| thangp | dulek: :) | 15:43 |
| thangp | dulek: wow...the jenkins build failed | 15:44 |
| dulek | thangp: Yeah, I see they haven't added dependency for the package. Anyway they claim that this is working locally. You can monitor the patch. I'll try to keep you updated as well. | 15:45 |
| thangp | dulek: ok thx...the change should be pretty straight forward to import oslo_versionedobject | 15:46 |
| dulek | thangp: I hope that too. Okay, thanks for clarifying, I'll start with another patch tomorrow. Have a nice day! | 15:48 |
| thangp | dulek: welcome | 15:48 |
| *** hemna has quit IRC | 15:52 | |
| thangp | dulek: so i pinged dansmith, and he says there is still on going work for oslo_versionedobjects | 15:54 |
| thangp | dulek: we should wait until they have a release | 15:54 |
| *** BharatK has quit IRC | 15:55 | |
| dulek | thangp: Yeah, definitely. I've also noticed that there's no pip package. | 15:55 |
| dansmith | we have a bunch of work items to chew through before we'll be ready | 15:55 |
| dansmith | it's only been up for two days :) | 15:55 |
| dulek | dansmith: yeah, inc0 got me a little confused | 15:56 |
| dulek | dansmith: thanks for clarifying | 15:56 |
| *** number80 has joined #openstack-cinder | 15:56 | |
| dansmith | np | 15:56 |
| *** rajinir has joined #openstack-cinder | 16:00 | |
| *** rajinir_r has quit IRC | 16:01 | |
| *** marcusvrn1 has joined #openstack-cinder | 16:03 | |
| *** marcusvrn has quit IRC | 16:04 | |
| *** BharatK has joined #openstack-cinder | 16:07 | |
| *** rmesta has joined #openstack-cinder | 16:13 | |
| *** kmartin has joined #openstack-cinder | 16:14 | |
| openstackgerrit | Steven Kaufer proposed openstack/cinder: WIP Generic filter support for volume queries https://review.openstack.org/155343 | 16:14 |
| *** laudo has joined #openstack-cinder | 16:16 | |
| *** nshaikh has joined #openstack-cinder | 16:17 | |
| *** rushil has quit IRC | 16:18 | |
| *** dulek has quit IRC | 16:20 | |
| *** rmesta1 has joined #openstack-cinder | 16:23 | |
| *** rmesta has quit IRC | 16:24 | |
| *** rmesta1 is now known as rmesta | 16:25 | |
| *** Mandell has quit IRC | 16:26 | |
| *** j_king has quit IRC | 16:29 | |
| *** j_king has joined #openstack-cinder | 16:29 | |
| *** xyang has joined #openstack-cinder | 16:29 | |
| *** markstur_ has joined #openstack-cinder | 16:30 | |
| *** markstur has quit IRC | 16:30 | |
| laudo | Can I do snapshot between pools in Juno? | 16:31 |
| *** jdurgin1 has joined #openstack-cinder | 16:31 | |
| jgriffith | laudo: you mean snap a volume in one pool, expecting the snap to be created in another pool? | 16:32 |
| laudo | jgriffith: yes | 16:32 |
| *** tsekiyama has joined #openstack-cinder | 16:33 | |
| jgriffith | laudo: No, I don't think you can do that, unless there are some backends that have some "trickery" going on | 16:33 |
| openstackgerrit | Adrien Vergé proposed openstack/cinder: Pass region name to Nova client https://review.openstack.org/155394 | 16:33 |
| jbernard | laudo, jgriffith: rbd is not one of those | 16:33 |
| jgriffith | jbernard: ahhh | 16:33 |
| jgriffith | jbernard: laudo didn't know we were talking RBD | 16:33 |
| * jgriffith should always first ask "what backend" these days :) | 16:34 | |
| laudo | jgriffith: we do :-) | 16:34 |
| *** dannywilson has joined #openstack-cinder | 16:35 | |
| jbernard | laudo: im not certain it couldn't be supported, but it isn't at the moment | 16:35 |
| laudo | jgriffith: That means the snapshot have to be on the same backend as the actual snapshotted data correct? | 16:36 |
| jgriffith | laudo: yeah, the scheduler directs that | 16:36 |
| jgriffith | laudo: even if you backend doesn't require it | 16:37 |
| jgriffith | laudo: I used to allow retype on snap which would do what you want | 16:37 |
| jgriffith | laudo: but DuncanT hated it and you can't do it any more | 16:37 |
| *** tsekiyama has quit IRC | 16:37 | |
| laudo | :-( | 16:37 |
| *** tsekiyama has joined #openstack-cinder | 16:38 | |
| DuncanT | What did I hate? | 16:38 |
| *** dannywilson has quit IRC | 16:38 | |
| jgriffith | laudo: so curious though... what's the reasoning for ensuring it's not in the same pool? | 16:38 |
| jgriffith | DuncanT: LOL | 16:38 |
| DuncanT | Oh, that. When it works on LVM, I'll hate it less | 16:38 |
| jgriffith | DuncanT: the snapshot to a different type | 16:38 |
| jgriffith | LOL | 16:38 |
| jgriffith | fair point | 16:38 |
| *** dannywilson has joined #openstack-cinder | 16:38 | |
| *** tellesnobrega_ has joined #openstack-cinder | 16:39 | |
| jgriffith | DuncanT: for the record, I've moved on and work around it quite easily. So it's a "don't care" for me now | 16:39 |
| *** tellesnobrega_ has quit IRC | 16:39 | |
| jgriffith | DuncanT: but I'm lucky, I don't deal with that shit show they call pools :) | 16:39 |
| *** patrickeast has joined #openstack-cinder | 16:39 | |
| jgriffith | DuncanT: Pools are for swimming, we shoudl keep it that way | 16:40 |
| DuncanT | jgriffith: Me neither :-) I really don't care about pools, just types | 16:40 |
| DuncanT | They're good for fishing too | 16:40 |
| jgriffith | Indeed! | 16:40 |
| *** ronenkat_ has quit IRC | 16:40 | |
| jgriffith | floating in an old inner tube as well | 16:40 |
| laudo | jgriffith: bascally to get around cinder backups. They want to have a live snapshot which they could restore but don't want to put it not the same ceph backend in case they would loose the backend. | 16:41 |
| jgriffith | laudo: ahh... makes sense | 16:42 |
| jgriffith | laudo: the old "snapshot's as backups" | 16:42 |
| jgriffith | laudo: there's a long history there FWIW | 16:43 |
| laudo | jgriffith: correct | 16:43 |
| jgriffith | laudo: at the end of the day it always came back to exactly what you describe as the problem (same backend) | 16:43 |
| jgriffith | laudo: so I know this might be an awful idea, but why not do somethig custom here? | 16:44 |
| *** dustins has joined #openstack-cinder | 16:44 | |
| jgriffith | laudo: or cheat and do somehting replicate to another pool? | 16:44 |
| laudo | jgriffith: hmm have not tought about that. But might be a good idea. | 16:45 |
| jgriffith | laudo: depends on the customer... and depends who you ask | 16:45 |
| *** erlon has joined #openstack-cinder | 16:45 | |
| jgriffith | some see that sort of thing as blasphemous :) | 16:45 |
| *** afazekas has quit IRC | 16:46 | |
| *** Yogi1 has quit IRC | 16:46 | |
| *** anshul has joined #openstack-cinder | 16:48 | |
| *** tellesnobrega_ has joined #openstack-cinder | 16:52 | |
| *** leopoldj has quit IRC | 16:52 | |
| *** e0ne has quit IRC | 16:54 | |
| *** Apoorva has joined #openstack-cinder | 16:54 | |
| laudo | jgriffith: Can you replicate snapshots? Never did it. | 16:55 |
| *** e0ne has joined #openstack-cinder | 16:55 | |
| laudo | https://blueprints.launchpad.net/cinder/+spec/snapshot-replicate. Is this implemented? | 16:56 |
| *** blinky_ghost has joined #openstack-cinder | 16:57 | |
| blinky_ghost | hi all, I have an openstack deployment with ceph for image and cinder storage. When I try to copy an image to a volume I get this error: "computeFault": {"message": "The server has either erred or is incapable of performing the requested operation.", "code": 500" Any hint? thanks | 16:57 |
| *** avishay has quit IRC | 16:58 | |
| openstackgerrit | Yuriy Nesenenko proposed openstack/cinder: Fix comments style according to the Hacking Rules https://review.openstack.org/145821 | 16:58 |
| *** alecv has quit IRC | 17:00 | |
| openstackgerrit | Adrien Vergé proposed openstack/cinder: Pass region name to Nova client https://review.openstack.org/155394 | 17:01 |
| *** _cjones_ has joined #openstack-cinder | 17:04 | |
| *** e0ne has quit IRC | 17:05 | |
| *** e0ne has joined #openstack-cinder | 17:06 | |
| *** rajinir has quit IRC | 17:07 | |
| jgriffith | blinky_ghost: usually means the service isn't running right, but you can do other things.... | 17:09 |
| jgriffith | blinky_ghost: check cinder-api logs; might be your cinder node can't talk to your image store | 17:09 |
| jgriffith | blinky_ghost: but that's just a guess | 17:09 |
| jgriffith | cinder-scheduler logs would be next | 17:09 |
| jgriffith | blinky_ghost: search on "ERROR" or "TRACE" | 17:10 |
| blinky_ghost | jgriffith: I can create volumes, and launch instances, I just cannot copy from glance to cinder volume. | 17:10 |
| blinky_ghost | jgriffith: ok, checking | 17:10 |
| jgriffith | blinky_ghost: right, that's what I mean when I said "can do other things..." | 17:10 |
| jgriffith | blinky_ghost: make sure cinder node can access Glance endpoint too of course | 17:11 |
| *** coolsvap is now known as coolsvap_ | 17:12 | |
| *** fischerw has joined #openstack-cinder | 17:13 | |
| *** nshaikh has quit IRC | 17:14 | |
| blinky_ghost | jgriffith: nothing gets to the logs, I think it fails before the request getting to api | 17:16 |
| jgriffith | blinky_ghost: hmmm | 17:16 |
| jgriffith | blinky_ghost: you're doing "create --image-id xxxx"? | 17:17 |
| blinky_ghost | jgriffith: cinder --debug create --image-id 0a4240f5-37a0-44a2-bd80-2f3547090abb --volume-type iscsi 10 | 17:17 |
| jgriffith | should be something in the logs.... | 17:17 |
| guitarzan | then grep all over the place for that request id | 17:18 |
| jgriffith | since 500 is "unknown" general cinder exception it's kinda useless | 17:18 |
| guitarzan | if you don't get one, then something is busted with the wsgi server | 17:18 |
| jgriffith | blinky_ghost: yeah.... what guitarzan said! :) | 17:18 |
| guitarzan | if you don't find it in cinder-api.log something is really busted :) | 17:18 |
| jgriffith | blinky_ghost: yeah, but if you can do regular create as you say that's what's odd about that | 17:19 |
| jgriffith | has to be something in the logs for the request | 17:19 |
| guitarzan | I'd make that assumption too | 17:19 |
| *** hemnafk is now known as hemna | 17:19 | |
| blinky_ghost | wait I got something | 17:20 |
| blinky_ghost | :) | 17:20 |
| blinky_ghost | jgriffith guitarzan http://paste.openstack.org/show/172211/ | 17:20 |
| jgriffith | blinky_ghost: this is where you're likely going ot end up: https://github.com/openstack/cinder/blob/master/cinder/volume/manager.py#L791 | 17:21 |
| jgriffith | blinky_ghost: 2.6? Warlock? What are you running? | 17:21 |
| jgriffith | blinky_ghost: regardless... it's clearly your glancecient that fails there | 17:22 |
| blinky_ghost | jgriffith: 2.6? cinder? | 17:22 |
| jgriffith | python 2.6 | 17:22 |
| jgriffith | doesn't matter | 17:22 |
| jgriffith | well... assuming your on an older version of openstack | 17:22 |
| jgriffith | ie not K | 17:22 |
| guitarzan | it's got the create volume api flow | 17:23 |
| guitarzan | so it's not super old | 17:23 |
| jgriffith | guitarzan: good point | 17:23 |
| jgriffith | blinky_ghost: bottom line, your glance client calls are failing | 17:23 |
| guitarzan | but that's definitely an odd stack trace | 17:23 |
| jgriffith | blinky_ghost: for something in the 'warlock' module it appears to me | 17:23 |
| guitarzan | blinky_ghost: jgriffith or maybe a super old glance? | 17:23 |
| jgriffith | or something passed in to it | 17:23 |
| blinky_ghost | jgriffith, guitarzan maybe because I use ceph to store my images? | 17:24 |
| jgriffith | blinky_ghost: afraid I don't know | 17:24 |
| jgriffith | blinky_ghost: might want to try #openstack for support help | 17:24 |
| blinky_ghost | openstack-glance-2014.1-2.el6.noarch python-glanceclient-0.12.0-1.el6.noarch | 17:24 |
| guitarzan | the 'deleted' attribute not being there looks really suspicious to me | 17:25 |
| guitarzan | although even my ancient havana version has a default value for that getattr call | 17:25 |
| *** EmilienM is now known as EmilienM|afk | 17:25 | |
| *** jistr has quit IRC | 17:27 | |
| guitarzan | icehouse has the default value too | 17:27 |
| guitarzan | blinky_ghost: I have no idea what cinder version you're running :) | 17:28 |
| blinky_ghost | openstack-cinder-2014.1-4.el6.noarch | 17:28 |
| blinky_ghost | python-cinderclient-1.0.9-1.el6.noarch | 17:28 |
| blinky_ghost | python-cinder-2014.1-4.el6.noarch | 17:28 |
| guitarzan | blinky_ghost: ah, I guess maybe the getattr default value was put in a later patch? maybe | 17:29 |
| blinky_ghost | guitarzan: I have an update available, testing | 17:29 |
| guitarzan | 66afa155 (Josh Durgin 2012-08-12 02:21:00 | 17:30 |
| guitarzan | that's old :) | 17:30 |
| guitarzan | I'm a little confused | 17:30 |
| blinky_ghost | guitarzan: I use Icehouse, RDO repos | 17:30 |
| guitarzan | blinky_ghost: ok, cool, that's a start | 17:31 |
| guitarzan | aha | 17:32 |
| guitarzan | 1e488339 (Mike Perez 2014-04-17 18:46:36 -0700 434) | 17:32 |
| guitarzan | thingee had to fix it | 17:32 |
| blinky_ghost | guitarzan: it seems to work now :) | 17:32 |
| guitarzan | blinky_ghost: excellent | 17:32 |
| jgriffith | LOL | 17:32 |
| jgriffith | timing on that was priceless | 17:32 |
| blinky_ghost | guitarzan: I've updated glance and cinder | 17:32 |
| guitarzan | here you go: https://review.openstack.org/#/c/90644/ | 17:32 |
| guitarzan | still seems weird to not have a deleted attr :) | 17:33 |
| blinky_ghost | thanks for the help :) | 17:33 |
| guitarzan | blinky_ghost: you're welcome | 17:33 |
| blinky_ghost | now I have to debug my horrible ceph performance :) | 17:34 |
| guitarzan | I am zero help there, good luck :) | 17:34 |
| *** leeantho has joined #openstack-cinder | 17:34 | |
| *** rushil has joined #openstack-cinder | 17:37 | |
| jbernard | blinky_ghost: the cmdline tools have some benchmark options baked in | 17:37 |
| jbernard | blinky_ghost: if you're issues are with ceph itself | 17:38 |
| blinky_ghost | jbernard: I have terrible write performance | 17:38 |
| jgriffith | WTF.. that's less than useful: ERROR (Conflict): Cannot 'unpause' while instance is in vm_state active (HTTP 409) | 17:38 |
| *** jdurgin1 has quit IRC | 17:38 | |
| *** Yogi1 has joined #openstack-cinder | 17:40 | |
| guitarzan | jgriffith: oh? what else do you need to know? | 17:41 |
| blinky_ghost | jbernard: testing iscsi volume with this command: dd if=/dev/zero of=tempfile bs=1M count=1024 oflag=direct I get about 97 MB/s with ceph I get about 7MB/s | 17:42 |
| jgriffith | guitarzan: well.... what I mean is; | 17:42 |
| jgriffith | something caused all my instance to "pause" | 17:42 |
| guitarzan | it doesn't *read* well for sure :) | 17:42 |
| *** emagana has joined #openstack-cinder | 17:42 | |
| jgriffith | no big deal | 17:42 |
| jgriffith | I'll just "unpause" them with this handy "nova unpause" command | 17:42 |
| jgriffith | Oh... wait, that doesn't really work with paused instances | 17:42 |
| guitarzan | jgriffith: crazy hypervisor hijinks outside of nova perhaps? | 17:42 |
| jgriffith | guitarzan: yeah, I think I know what caused it :) | 17:43 |
| jgriffith | guitarzan: I ran virt-sparsify on an image | 17:43 |
| guitarzan | it sounds to me like nova doesn't know it's paused | 17:43 |
| jgriffith | and installed some virtfs tools | 17:43 |
| guitarzan | so it won't unpause it | 17:43 |
| jgriffith | guitarzan: Ahh.... ya know what I think you're right | 17:43 |
| jgriffith | guitarzan: lemme try something.... | 17:43 |
| guitarzan | db state vs hypervisor reality is a nasty beast | 17:43 |
| jgriffith | Yeah | 17:44 |
| guitarzan | so you should just unpause it in the hypervisor itself | 17:44 |
| jbernard | blinky_ghost: take a look at rados' bench flag | 17:44 |
| jgriffith | guitarzan: so my bad... I didn't realize the "real" workflow is to pause in KVM AND set Status to Paused | 17:44 |
| jbernard | blinky_ghost: you can benchmark each osd individually (i believe) as well as an entire pool | 17:44 |
| jgriffith | that makes sense then | 17:44 |
| jbernard | blinky_ghost: this might give some context: https://github.com/enovance/ceph-benchmark-procedure | 17:44 |
| blinky_ghost | jbernard: I can run this on my mon hosts, right? | 17:46 |
| jbernard | blinky_ghost: as long as the hostname resolves and rados client is install, i believe so | 17:47 |
| blinky_ghost | jbernard: thanks | 17:47 |
| jbernard | blinky_ghost: no problem, hope it helps. let me know how it goes | 17:48 |
| jbernard | blinky_ghost: i only found those options recently, so im still learning as well | 17:48 |
| *** mdbooth has quit IRC | 17:51 | |
| *** ndipanov has quit IRC | 17:51 | |
| *** humble_ has quit IRC | 17:53 | |
| *** tellesnobrega_ has quit IRC | 17:53 | |
| jgriffith | guitarzan: huh... well that's cool. I have to take back everything bad I ever said about Nova :) | 17:54 |
| jgriffith | guitarzan: ok, maybe that's an exageration | 17:54 |
| *** vmtyler has quit IRC | 17:54 | |
| guitarzan | jgriffith: haha! | 17:55 |
| *** jwang has quit IRC | 17:55 | |
| *** coolsvap_ is now known as coolsvap | 17:55 | |
| guitarzan | jgriffith: wouldn't the "real workflow" be to pause in nova? | 17:55 |
| jgriffith | guitarzan: yeah :) | 17:55 |
| guitarzan | ok, just making sure I didn't miss something :) | 17:56 |
| jgriffith | guitarzan: so what I wasn't aware of (stupid me) was that it wasn't Nova that paused things | 17:56 |
| jgriffith | and that there was a vm_state of "paused" in Nova | 17:56 |
| guitarzan | to be honest, i was making an educated guess :) | 17:56 |
| jgriffith | so when I did a list and saw everythign paused I was like "that's weird, ok, just unpause" | 17:56 |
| jgriffith | but that failed | 17:56 |
| guitarzan | off of that excellent error message :D | 17:57 |
| *** mdbooth has joined #openstack-cinder | 17:57 | |
| jgriffith | so I was like WTF? why have an unpause if you can't unpause :) | 17:57 |
| guitarzan | oh, your nova list said something about paused? | 17:57 |
| jgriffith | Now I know better | 17:57 |
| jgriffith | guitarzan: yeah! | 17:57 |
| guitarzan | that surprises me a bit | 17:57 |
| jgriffith | guitarzan: that was the whole thing | 17:57 |
| guitarzan | oh, the power state | 17:57 |
| jgriffith | So PowerState was paused | 17:57 |
| jgriffith | yep | 17:57 |
| guitarzan | ya, got it | 17:57 |
| jgriffith | now that I know there's an equiv vm_state it all makes sense | 17:58 |
| *** yuriy_n17 has quit IRC | 17:58 | |
| guitarzan | nova could be smarter about that if it wanted to, but there are probably a lot of ugly edge cases | 17:58 |
| blinky_ghost | jbernard: I want to change my public network to a different Vlan/address in ceph. Is it safe to do it? Thanks | 17:58 |
| jgriffith | guitarzan: btw.. neat trick if you ever have the need: | 17:58 |
| jgriffith | guitarzan: just go through and pause all of the VM's through nova | 17:58 |
| *** tellesnobrega_ has joined #openstack-cinder | 17:58 | |
| jgriffith | it'll set the vm_state and power_state appropriately | 17:58 |
| guitarzan | jgriffith: yeah, that seems smart | 17:58 |
| jgriffith | then you can just do unpause on all of them and voila | 17:58 |
| jgriffith | guitarzan: yeah... pretty cool | 17:59 |
| jgriffith | but I'm easily impressed/entertained :) | 17:59 |
| guitarzan | :D | 17:59 |
| jbernard | blinky_ghost: it should be, many deployments configure storage traffic (and others) on isolated networks | 17:59 |
| *** _cjones_ has quit IRC | 17:59 | |
| blinky_ghost | jbernard: I think I misunderstand the network concept, so I'm running public network in same network that I use for openstack management | 17:59 |
| jgriffith | and after that sparsify only took myimage from 5 Gig to 4 Gig | 17:59 |
| jgriffith | so it really wasn't worth the trouble AT ALL | 17:59 |
| guitarzan | you have an extra gig now | 17:59 |
| blinky_ghost | jbernard: maybe that's because in I'm in pain now :) | 18:00 |
| jbernard | blinky_ghost: i assume you've discovered the source of your poor write performance | 18:00 |
| jgriffith | guitarzan: is the eternal optimist! | 18:00 |
| *** anshul has quit IRC | 18:00 | |
| *** jordanP has quit IRC | 18:00 | |
| *** aix has quit IRC | 18:00 | |
| jgriffith | guitarzan: I wanted something under a gig, but not sure why I care TBH | 18:00 |
| jgriffith | just something to obsess about this AM | 18:01 |
| jgriffith | given the fact now that I look at it and the binary I installed is 3Gig not sure WTF I was expecting :) | 18:01 |
| blinky_ghost | jbernard: I hope so :) | 18:02 |
| guitarzan | jgriffith: haha :D | 18:02 |
| jgriffith | LOL! | 18:02 |
| * jgriffith is silly | 18:02 | |
| guitarzan | jgriffith: so now that we're all multiple volume managered, has there been any work on volume-manager maintenance mode stuff? | 18:03 |
| guitarzan | I haven't been able to pay much attention lately | 18:04 |
| guitarzan | I think it's been brought up for a while, but the ability to not perform any new actions, but finish anything in progress | 18:04 |
| *** rushil has quit IRC | 18:06 | |
| jgriffith | guitarzan: not really... | 18:06 |
| jgriffith | guitarzan: good deal of effor going on for things like objects and taskflow | 18:06 |
| guitarzan | jgriffith: task persistence too? | 18:07 |
| jgriffith | guitarzan: some craziness to bubble up all available extra-specs | 18:07 |
| jgriffith | guitarzan: that hit some snags | 18:07 |
| jgriffith | guitarzan: DuncanT I believe discovered it falls apart in a multi-node env | 18:07 |
| jgriffith | guitarzan: but I'm not completely in the loop on that conversation | 18:07 |
| guitarzan | multiple nodes for the same 'host' | 18:07 |
| jgriffith | guitarzan: I believe so yes | 18:07 |
| guitarzan | ah, well, initially I'm thinking much smaller | 18:08 |
| jgriffith | guitarzan: I made a simple proposal for persistence in Austin using a queue | 18:08 |
| jgriffith | guitarzan: but honestly I know I will not have time to work on that | 18:08 |
| guitarzan | simple signal handler to shutdown the incoming rabbit connections | 18:08 |
| *** rushil has joined #openstack-cinder | 18:08 | |
| guitarzan | I'll let you know how it works out :) | 18:08 |
| jgriffith | guitarzan: nice! | 18:08 |
| guitarzan | tha way we can maintenance the old managers, upgrade, bring up new ones | 18:09 |
| guitarzan | might have to nuke some pidfiles or something | 18:09 |
| guitarzan | I'm not sure about that | 18:09 |
| guitarzan | but restarting volume managers is a problem for us | 18:09 |
| guitarzan | since a lot of our things take a while | 18:10 |
| jgriffith | guitarzan: yeah, I don't think you're alone on that | 18:10 |
| *** sgotliv__ has quit IRC | 18:10 | |
| guitarzan | we sit and spin in our driver :) | 18:10 |
| guitarzan | our biggest problem is all of the stuff that happens *after* a create from image | 18:11 |
| jgriffith | guitarzan: there are very few who actually operate at real scale like you providers tdo | 18:11 |
| guitarzan | I'm not sure why that stuff doesn't happen before | 18:11 |
| jgriffith | guitarzan: oh? | 18:11 |
| guitarzan | we can't just reset-state and be done with it | 18:11 |
| guitarzan | yeah, the bootable flag and glance meta happens *after* the driver call to clone image | 18:11 |
| jgriffith | guitarzan: that seemed reasonable to me, but I guess it jacks things up if you resart after the download eh? | 18:12 |
| guitarzan | or during | 18:12 |
| guitarzan | but yeah, since we use clone and not the built in copy image | 18:12 |
| jgriffith | guitarzan: well... during you just need to hang it up and start over IMO | 18:12 |
| guitarzan | our driver is waiting for the backend to be done making the copy | 18:13 |
| jgriffith | guitarzan: but after that, we should be able to break out the remaining tasks | 18:13 |
| guitarzan | everything ends up finishing in lunr, but the volume manager that's polling for us to be done dies off | 18:13 |
| laudo | what version was retyping added to cinder? I cant find it in 1.0.9 | 18:13 |
| patrickeast | hemna: ping | 18:14 |
| hemna | yough | 18:14 |
| *** vilobhmm has joined #openstack-cinder | 18:14 | |
| patrickeast | hemna: hey, have you had a chance to read through my replies on https://review.openstack.org/#/c/153333/ ? | 18:14 |
| hemna | not yet | 18:15 |
| patrickeast | i wanted to make sure i’m on the same page as you wrt to the 2 way chap | 18:15 |
| hemna | ok I'll take a look | 18:15 |
| patrickeast | thanks! | 18:15 |
| *** afazekas has joined #openstack-cinder | 18:17 | |
| *** _cjones_ has joined #openstack-cinder | 18:17 | |
| e0ne | hi all! | 18:17 |
| hemna | patrickeast, so my initial -1 was based upon the names being used for the CHAP that you had planned on storing | 18:18 |
| e0ne | does anybody know why we are using 'detailed=True' by defaulft for api calls from client? | 18:18 |
| hemna | you used initiator, when in fact what you were storing are target CHAP creds. | 18:18 |
| hemna | I don't think we even support 2 way CHAP at the moment. I could be wrong though | 18:18 |
| patrickeast | hemna: yea i don’t think we do, but i remember seeing it mentioned before | 18:19 |
| hemna | I know nova doesn't send the initiator CHAP creds in the connector at initialize_connection time | 18:19 |
| hemna | it's something we could eventually do | 18:19 |
| *** thingee has joined #openstack-cinder | 18:19 | |
| patrickeast | longer term it is something i would even be interested in looking into | 18:19 |
| patrickeast | so i figure its worth making sure this thing can handle it | 18:19 |
| hemna | even if we do, I'm not sure the initiator chap creds even need to be stored in that db table in cinder | 18:20 |
| hemna | they should go into the array at initialize_connection time | 18:20 |
| hemna | so I think short term for your patch, just change the names | 18:20 |
| *** asmith_brcd has joined #openstack-cinder | 18:20 | |
| hemna | as you are trying to store the target CHAP creds | 18:20 |
| *** harlowja_away is now known as harlowja | 18:21 | |
| patrickeast | hmm ok, but then for the table the key still needs to be per initiator so it can be queried and passed in to the driver for initialize_connection, unless we want to grab them all and let the driver figure out what the target is | 18:22 |
| *** EmilienM|afk is now known as EmilienM | 18:22 | |
| patrickeast | i can change around the wording in the spec to be more clear that it is the target credentials in my chap use case | 18:23 |
| hemna | ok I posted a few comments | 18:23 |
| *** MasterPiece has quit IRC | 18:23 | |
| hemna | hopefully to clear things up. | 18:23 |
| patrickeast | cool, thanks! | 18:23 |
| hemna | np! thanks for working on this. | 18:23 |
| guitarzan | wow, there's chap creds for the initiator? | 18:24 |
| guitarzan | TIL | 18:24 |
| laudo | any doc on howto cet cinder policyes for retyping? | 18:26 |
| openstackgerrit | Gloria Gu proposed openstack/cinder: HP 3par driver filter and evaluator function https://review.openstack.org/151353 | 18:27 |
| *** emagana has quit IRC | 18:29 | |
| openstackgerrit | Patrick East proposed openstack/cinder-specs: Add DB table for driver private data https://review.openstack.org/153333 | 18:29 |
| *** emagana has joined #openstack-cinder | 18:29 | |
| *** emagana has quit IRC | 18:30 | |
| *** emagana has joined #openstack-cinder | 18:30 | |
| *** tellesnobrega_ has quit IRC | 18:31 | |
| *** annegent_ has joined #openstack-cinder | 18:32 | |
| *** boris-42 has quit IRC | 18:32 | |
| kaufer | jgriffith: Do you have a minute to discuss your comments on this? https://review.openstack.org/#/c/154673/ | 18:32 |
| jgriffith | kaufer: for you... certainly :) | 18:33 |
| *** e0ne is now known as e0ne_ | 18:33 | |
| laudo | does someone know when rbd is going to get implemented for retyping? Is there a roadmap? | 18:33 |
| kaufer | jgriffith: Thanks, first did my rational for breaking up the fix into 2 "phases" make sense? | 18:34 |
| jgriffith | Not following the two phases part? | 18:34 |
| jgriffith | reading | 18:35 |
| jgriffith | kaufer: yeah | 18:35 |
| jgriffith | kaufer: so that addresses what i asked for | 18:35 |
| jgriffith | kaufer: you see my point though? Without that second part this doesn't really "change" much of anything | 18:35 |
| *** e0ne_ is now known as e0ne | 18:35 | |
| *** tellesnobrega_ has joined #openstack-cinder | 18:35 | |
| *** jaypipes has quit IRC | 18:36 | |
| jgriffith | kaufer: sure it keeps you from looping on backends that don't support replication (that's a win) | 18:36 |
| jgriffith | but it's kinda minor in the big scheme of things.... | 18:36 |
| kaufer | jgriffith: Yep, but I thought that there was still value in no-oping the periodic task for drivers that don't support it | 18:36 |
| kaufer | sure | 18:36 |
| jgriffith | sayI have a backend that supports it, but isn't using it | 18:36 |
| jgriffith | and I have 5000 volumes on that backend (not unusual) | 18:37 |
| jgriffith | I do a "for v in volumes_all:" | 18:37 |
| jgriffith | that sucks | 18:37 |
| jgriffith | throw in a db.volume_update for each one... | 18:37 |
| jgriffith | that sucks even more | 18:37 |
| kaufer | jgriffith: It seemed (to me at least) that doing an update to the DB API wasn't appropriate for a bug fix, hence the new BP and 2 commits for this bug | 18:38 |
| jgriffith | well... that last part isn't the same but you see what I mean | 18:38 |
| jgriffith | kaufer: suppose that's fine, but I don't know if I agree on the "db change" not acceptable for a bug fix | 18:38 |
| jgriffith | it surely won't be backported | 18:38 |
| jgriffith | but I wouldn't bother backporting this anyway I don't think | 18:38 |
| jgriffith | as I said, I don't really see that it changes much | 18:38 |
| jgriffith | kaufer: now... what might be more interesting: | 18:39 |
| kaufer | jgriffith: Yep, totally understand, I'm hoping that the "phase 2" work will help in that area, since then the DB API will filter out volumes that have replication disabled | 18:39 |
| kaufer | Ok, sorry, maybe I created the BP too quickly | 18:39 |
| *** asmith_brcd has quit IRC | 18:39 | |
| jgriffith | meh... forget that idea | 18:39 |
| jgriffith | kaufer: nah... you didn't | 18:39 |
| jgriffith | kaufer: you're good | 18:39 |
| *** mriedem has quit IRC | 18:40 | |
| jgriffith | kaufer: so my real problem here is the looping through all volumes and updating part | 18:40 |
| jgriffith | kaufer: that's "the bug" IMO | 18:40 |
| jgriffith | it *will* come back and bight us, I can pretty much guarantee it | 18:41 |
| patrickeast | so one thing slightly related to this i’ve been wondering about is if it would be worth adding a bulk get_replication_status method on the driver that takes a list of volumes… right now i’ve got some concerns that when we switch on replication if there are too many volumes it will just assult our rest api with 5000 requests where we could just do a single one | 18:41 |
| kaufer | jgriffith: Ok, so filtering on the DB query will help with that, but you don't think that that is sufficient? | 18:41 |
| kaufer | jungleboyj: ^ FYI | 18:41 |
| jgriffith | kaufer: I think that is much better than what we have | 18:42 |
| jgriffith | kaufer: but I think the design is flawed when the manager needs to do this at all | 18:42 |
| *** rushil_ has joined #openstack-cinder | 18:42 | |
| jgriffith | kaufer: polling in a large scale distributed system isn't such a good thing IMO | 18:43 |
| * jungleboyj scrolls back up. | 18:43 | |
| jgriffith | kaufer: when you're doing that polling on a resource like "volumes" | 18:43 |
| jgriffith | kaufer: I guess I'm not offering a better suggestion (other than rewrite of the code) | 18:44 |
| kaufer | jgriffith: Yep, it is doing this work for every volume in a periodic task that runs every min | 18:44 |
| jgriffith | so you probably shouldn't get too wrapped up in what i say here :) | 18:44 |
| kaufer | jgriffith: :) | 18:44 |
| *** e0ne has quit IRC | 18:44 | |
| jgriffith | kaufer: exactly... that's a pretty bad idea IMO | 18:44 |
| *** rushil has quit IRC | 18:44 | |
| jgriffith | kaufer: I wonder if there's a way to convert this to some sort of a notification update? | 18:45 |
| jgriffith | so don't poll... but send a notification from the backend if something changes | 18:45 |
| jgriffith | assuming of course the backend should *know* this | 18:46 |
| jgriffith | kaufer: so let's think about this... | 18:46 |
| kaufer | jgriffith: it's a good idea, i'll do some investigation, not sure what is possible | 18:46 |
| jgriffith | kaufer: the whole point of this periodic is to enable a fail over right? | 18:46 |
| jgriffith | kaufer: an "auto" fail over that is | 18:47 |
| jgriffith | kaufer: ping the driver, see if rep status has changed, acting as a message that says "hey, change the model info so you point to the other volume/backend" | 18:47 |
| jgriffith | kaufer: does that jive with you? | 18:48 |
| jungleboyj | jgriffith: That was not how I interpreted this. Is that future work? Right now the promotion is a manual process. | 18:49 |
| kaufer | jgriffith: AKAIK, but TBH I don't have all of the background here, jungleboyj do you know? | 18:49 |
| jungleboyj | jgriffith: This is just to keep the status of the replica updated. Is it consistent or not. | 18:49 |
| *** MasterPiece has joined #openstack-cinder | 18:49 | |
| patrickeast | right now iirc it just updates the status so if you look at the command line it is ok, and the promote command works | 18:49 |
| jgriffith | jungleboyj: so why is this check even here? | 18:49 |
| jgriffith | jungleboyj: in the model update? | 18:49 |
| jgriffith | jungleboyj: and honestly, if it's just a status update... who cares | 18:50 |
| jgriffith | jungleboyj: just provide it if/when asked for | 18:50 |
| jgriffith | we don't poll volumes for anything else | 18:50 |
| jgriffith | why should we poll in this case? | 18:50 |
| jungleboyj | jgriffith: Good question. | 18:50 |
| jungleboyj | Let me look here. | 18:51 |
| *** Longgeek has quit IRC | 18:51 | |
| laudo | what is the best way to download an image from cinder backend? | 18:51 |
| *** Longgeek has joined #openstack-cinder | 18:52 | |
| hemna | laudo, image from cinder ? | 18:52 |
| jgriffith | jungleboyj: you're doing a bunch of shit in there BTW | 18:53 |
| *** cdelatte has quit IRC | 18:53 | |
| jungleboyj | jgriffith: What do you mean? | 18:53 |
| laudo | there is cinder upload-to-image is there download-to-disk? | 18:54 |
| hemna | that image gets put into the image service configured in your deployment | 18:55 |
| jgriffith | jungleboyj: check out your driver | 18:55 |
| jungleboyj | jgriffith: Yeah, that is where I am looking now. | 18:55 |
| hemna | laudo, cinder doesn't have it at that point. most likely in glance | 18:55 |
| hemna | laudo, nova image-list | 18:55 |
| laudo | hemna: then export it from glance? | 18:55 |
| hemna | laudo, or glance image-list | 18:55 |
| jgriffith | jungleboyj: extended2 Secondary copy status... and synchronized... sync progress is..... | 18:56 |
| jgriffith | WTF? | 18:56 |
| hemna | laudo, if you need the image file, then yah, you can download it from glance | 18:56 |
| *** cdelatte has joined #openstack-cinder | 18:56 | |
| jgriffith | shove that into a model update and stick it in the DB.... why? | 18:56 |
| *** cdelatte has quit IRC | 18:56 | |
| *** cdelatte has joined #openstack-cinder | 18:56 | |
| *** Longgeek has quit IRC | 18:56 | |
| jgriffith | jungleboyj: kaufer you shouldn't have asked me questions... now I'll file more bugs :) | 18:56 |
| kaufer | oops | 18:57 |
| jgriffith | kaufer: :) | 18:57 |
| *** coolsvap is now known as coolsvap_ | 18:57 | |
| jgriffith | kaufer: jungleboyj you guys see what I'm saying though? | 18:58 |
| jungleboyj | Yeah, that looks much more heavyweight than I realized. | 18:58 |
| jgriffith | kaufer: jungleboyj we're jus polluting the DB every 60 seconds with free form strings | 18:58 |
| hemna | jgriffith, where ? url? | 18:58 |
| jgriffith | that honestly I have no idea "why" we even need it | 18:58 |
| laudo | hemna: thanks | 18:59 |
| hemna | laudo, no problemo! | 18:59 |
| jgriffith | I know you guys think I'm a total A-hole, but sorry | 18:59 |
| jungleboyj | jgriffith:I didn't say that, I think you have a valid concern here. | 18:59 |
| *** _cjones_ has quit IRC | 19:00 | |
| kaufer | jgriffith: Nope, you make valid points, I just don't know how to address them at the moment | 19:00 |
| jgriffith | hemna: https://github.com/openstack/cinder/blob/master/cinder/volume/drivers/ibm/storwize_svc/replication.py#L125 | 19:00 |
| jungleboyj | jgriffith: Let us regroup here. | 19:00 |
| *** blinky_ghost has quit IRC | 19:00 | |
| jgriffith | hemna: which is called by a periodic here: https://review.openstack.org/#/c/154673/2/cinder/volume/manager.py | 19:00 |
| hemna | oh that's the periodic task for updating the db record from the backend | 19:00 |
| jgriffith | at line 1636 | 19:00 |
| laudo | Can somone point me to a doc which explainse how to setup hints/ policies for retyping? | 19:00 |
| laudo | cant really find anything when googling | 19:01 |
| jgriffith | hemna: yeah... my first issue was iterating through all volumes on a periodic (bug 1) | 19:01 |
| openstack | bug 1 in Ubuntu Malaysia LoCo Team "Microsoft has a majority market share" [Critical,In progress] https://launchpad.net/bugs/1 - Assigned to MFauzilkamil Zainuddin (apogee) | 19:01 |
| *** eharney has quit IRC | 19:01 | |
| jgriffith | hemna: but then looking at what's happening on the backend I am also concerned about what that "status" being sent in the udpate is | 19:01 |
| *** dustins has quit IRC | 19:01 | |
| jgriffith | hemna: and finally... I ask "why we even need it" | 19:01 |
| patrickeast | we had talked about discussing replication at the next summit… do we have a etherpad or something to capture these kind of issues we want to tackle? | 19:01 |
| jgriffith | hemna: implement a "cinder show-repstatus xxxxxx" | 19:02 |
| hemna | oh yah, it's looping through every volume associated with a host | 19:02 |
| jgriffith | yes | 19:02 |
| hemna | ouch | 19:02 |
| jgriffith | yes | 19:02 |
| hemna | so can't we only loop through the volumes that are replicated instead ? | 19:02 |
| *** katco has joined #openstack-cinder | 19:02 | |
| hemna | at a minimum | 19:02 |
| jgriffith | hemna: that was what kaufer and I have been talking about (see my comments and his in the patch) | 19:02 |
| hemna | ok sorry, wasn't following that. was working on brick stuffs. | 19:03 |
| hemna | just trying to catch up | 19:03 |
| jgriffith | while that's def better... I still question why this is even here? | 19:03 |
| jungleboyj | patrickeast: We do! | 19:03 |
| *** _cjones_ has joined #openstack-cinder | 19:03 | |
| katco | i need some assistance with parsing the storage wadl file. i'm not that familiar with the format, but the wadl file seems to contradict the specification? is anyone familiar? | 19:03 |
| jgriffith | and frankly using free form strings to store status isn't kosher either | 19:03 |
| *** dustins has joined #openstack-cinder | 19:03 | |
| hemna | so I guess the question I have is, who even looks at the status | 19:04 |
| jungleboyj | patrickeast: Actually, we have one for getting CGs and Replication together. | 19:04 |
| jungleboyj | Not one for just replication. I should maybew start that. | 19:04 |
| hemna | jgriffith, except we use free form strings for volume['status'] | 19:05 |
| hemna | and volume['attach-status'] | 19:05 |
| hemna | anyway, that's probably a minor point though | 19:05 |
| kaufer | jgriffith: Are you referring to the format of 'replication_extended_status' | 19:05 |
| jgriffith | hemna: not really | 19:05 |
| hemna | who needs the replication status updated every n seconds ? | 19:05 |
| jgriffith | hemna: there's a big diff between: "Available" | 19:05 |
| katco | i.e. the WADL spec states regarding response elements: "Zero or more param elements (see section 2.12 ) with a value of 'header' for their style attribute, each of which specifies the details of a HTTP header for the response" | 19:06 |
| jgriffith | and a custom joined string that's 30+ chars long and is actually a sentence | 19:06 |
| hemna | isn't the replication_extended_status supposed to be a driver only thing ? | 19:06 |
| jgriffith | hemna: look at the code | 19:06 |
| katco | but the response parameters for creating a volume have styles of "plain" | 19:06 |
| jgriffith | if it was "Replicated", "Good" "meh" | 19:06 |
| jgriffith | I probably wouldn't care | 19:06 |
| katco | further, some responses don't list their parameters? | 19:06 |
| jungleboyj | jgriffith: So, the part I expected to see in here is the sync_progress updates and status updates. | 19:06 |
| jgriffith | hemna: but really??? "Primary copy status xxx and synchronized: xxx" | 19:07 |
| hemna | jgriffith, ok I see what you are talking about | 19:07 |
| hemna | yuk | 19:07 |
| kaufer | jgriffith: so 'replication_status' seems to be a single string (ie, 'error', 'active', 'copying'), it's the 'replication_extended_status' that is a bit crazy | 19:07 |
| jgriffith | kaufer: yes, and that's fine | 19:07 |
| jgriffith | kaufer: the extended status is stupid though | 19:07 |
| jungleboyj | jgriffith: Regardless, it doesn't seem that all this needs to be updated in a periodic task if we are not doing automatic promotion. | 19:08 |
| hemna | according to the updated spec on replication | 19:08 |
| jgriffith | anyway.... | 19:08 |
| kaufer | agreed | 19:08 |
| hemna | the replication_extended_status is for each driver to consume | 19:08 |
| jgriffith | I don't want to rat hole on this, it's kind of a tangent | 19:08 |
| hemna | and if that's the case, then why not store a dict instead of a big ass string? | 19:08 |
| jungleboyj | hemna: Right. | 19:08 |
| jgriffith | hemna: in which case they should store it themeselves IMO :) | 19:08 |
| jgriffith | but wait... this goes back to free form data in the DB | 19:09 |
| hemna | but still I haven't heard what's the point of the status periodic task is for | 19:09 |
| hemna | ok, it's updating some status | 19:09 |
| jgriffith | and the fact that your doing it every minute for no apparant good reason | 19:09 |
| jgriffith | AND WTF!!! | 19:09 |
| hemna | but who uses that? and for what reason? | 19:09 |
| jgriffith | If it's for the driver to use, the driver is what gets called to build it | 19:09 |
| jgriffith | so why would you periodic and put it in the db? | 19:10 |
| *** asmith_brcd has joined #openstack-cinder | 19:10 | |
| hemna | why not fetch it when you need it | 19:10 |
| jgriffith | hemna: retype uses status | 19:10 |
| jgriffith | but that's ugly as well | 19:10 |
| hemna | and by that you mean the volume manager uses it ? | 19:10 |
| jgriffith | retype call in teh volume-manager yes | 19:10 |
| *** lpetrut has joined #openstack-cinder | 19:11 | |
| jgriffith | hemna: honeslty I propose we just revert it | 19:11 |
| jgriffith | nobody implements it anyway | 19:11 |
| *** alexpilotti has quit IRC | 19:11 | |
| jgriffith | do-over | 19:11 |
| hemna | we just looked at implementing replication | 19:11 |
| hemna | and would like to do so for L | 19:12 |
| jgriffith | sure | 19:12 |
| hemna | gary-smith, and I looked deeply into it | 19:12 |
| jgriffith | I would have like to have seen us all do it for K | 19:12 |
| jgriffith | hemna: oh... | 19:12 |
| hemna | and are still wrapping our heads around it | 19:12 |
| jgriffith | ok, well then I guess it's good and works | 19:12 |
| hemna | but I still didn't understand the point of the periodic task | 19:12 |
| jungleboyj | jgriffith: Lets break this into bite size pieces. | 19:12 |
| hemna | jgriffith, well I didn't say that :) | 19:12 |
| jgriffith | jungleboyj: sure | 19:12 |
| *** bswartz has quit IRC | 19:13 | |
| jungleboyj | jgriffith: If you do't like what storwize is doing we can address that, that, however is not the point of the immediate discussion. | 19:13 |
| jgriffith | jungleboyj: honestly I don't have much more to say | 19:13 |
| jgriffith | jungleboyj: and you're correct that wasn't really my point | 19:13 |
| jungleboyj | jgriffith: The item under question is the efficacy of the periodic task. | 19:14 |
| hemna | ok so I see in the volume manager where it looks for a value in replication_status | 19:14 |
| jgriffith | jungleboyj: and yes, you're correct I made the mistake of pushing this through on that last code review after the meetup | 19:14 |
| jgriffith | sigh | 19:14 |
| jungleboyj | jgriffith: No, I didn't say that either. | 19:14 |
| hemna | and looking at the storewize driver | 19:14 |
| jungleboyj | jgriffith: I need to figure out if that task makes sense. If not, lets fix it. | 19:15 |
| hemna | if it's broken it sets a status of 'error' | 19:15 |
| hemna | which is ignored by the retype code in the volume manager | 19:15 |
| hemna | it would allow that volume to be retyped | 19:15 |
| hemna | because the status isn't set to "disabled" | 19:15 |
| hemna | instead of 'error', which is in the storewize driver | 19:15 |
| hemna | so that's broken | 19:15 |
| *** chenleji has quit IRC | 19:16 | |
| jgriffith | jungleboyj: so here's my proposal.... | 19:16 |
| * jungleboyj is starting an etherpad | 19:16 | |
| jgriffith | jungleboyj: we have one vendor with it implemented, and it seems to work fine for them | 19:16 |
| jgriffith | jungleboyj: so maybe we just leave it as is like that for now | 19:16 |
| hemna | https://github.com/openstack/cinder/blob/master/cinder/volume/manager.py#L1487 | 19:16 |
| hemna | note: 'disabled' | 19:17 |
| jgriffith | jungleboyj: don't allow any more submissions using it (which based on timing of release we're not going to anyway) | 19:17 |
| jgriffith | and for K, first thing we do is rework the thing and fix it up | 19:17 |
| hemna | jgriffith, except I think it's not working for them. in this case retype will be allowed in a broken replication status. | 19:17 |
| jgriffith | hemna: not my problem quite frankly, and if they need to test/fix they can | 19:18 |
| hemna | jgriffith, at a minimum we need to fix the periodic task | 19:18 |
| *** eharney has joined #openstack-cinder | 19:18 | |
| jungleboyj | jgriffith: I have no qualms with that statement at all. | 19:18 |
| patrickeast | for reference we have an impl up for review right now, https://review.openstack.org/#/c/145090/ not saying it needs to go in, but primarily as a discussion point for another interpretation of the current state of things | 19:18 |
| thingee | jgriffith: I have a question for you in the standard capabilities spec https://review.openstack.org/#/c/150511/ | 19:18 |
| hemna | fetching every volume for a host every 60 seconds | 19:18 |
| thingee | hemna, gary-smith: https://review.openstack.org/#/c/150511/ | 19:18 |
| hemna | that's bad mmmkay | 19:18 |
| thingee | replied back | 19:18 |
| jgriffith | hemna: jungleboyj yeah, well there's only one backend (2) this effecs to maybe I don't care | 19:18 |
| jungleboyj | jgriffith: That fits in line with what I have been trying to do. Trying to get the documents fixed up right. Find bugs and fix it. | 19:18 |
| gary-smith | thingee: will read... | 19:18 |
| jgriffith | hemna: it's not every host though, only those the report replicaton support in their capabilities | 19:18 |
| jgriffith | jungleboyj: no.... | 19:19 |
| jgriffith | jungleboyj: don't mess with docs or antyhing | 19:19 |
| jgriffith | jungleboyj: the impl is broken IMO | 19:19 |
| jungleboyj | jgriffith: Also, this matches with what we said in Paris, poke at this and try to fix it. | 19:19 |
| jgriffith | jungleboyj: needs rewritten, shouldn't have more people try and use it or implement it in their drivers | 19:19 |
| jungleboyj | jgriffith: Ok ... | 19:19 |
| hemna | jgriffith, well if kaufer's patch lands then yes, it only does this for the 1 host that supports replication | 19:19 |
| hemna | which I think currently isn't the case. | 19:19 |
| thingee | gary-smith: spelling issue going to happen. I haven't been home for three weeks and traveling and had to deal with k-2 cut recently ;) | 19:20 |
| jgriffith | hemna: yeah... sorry, you're correct | 19:20 |
| hemna | so, we need kaufer's patch to land or some form of it. | 19:20 |
| jungleboyj | hemna: That makes sense. | 19:20 |
| hemna | I think we shouldn't even setup the periodic task | 19:20 |
| jgriffith | hemna: +1 | 19:20 |
| hemna | right now there will be a periodic task that exits, every n seconds | 19:20 |
| hemna | :( | 19:20 |
| thingee | have a meeting, bbl | 19:22 |
| hemna | thingee, thanks | 19:22 |
| jungleboyj | hemna: We can't just disable the periodic task though. That is going to mean that status for those of us that have this implemented will not be updated. | 19:22 |
| hemna | jungleboyj, well, what I'm trying to say (poorly) is that the periodic task should only be setup for those that are using it. | 19:23 |
| jungleboyj | hemna: Doesn't really matter if the task runs and skips doing anything. | 19:23 |
| jungleboyj | hemna: Ok. That is better. | 19:23 |
| hemna | otherwise it's just a task that runs every N seconds and does nothing. | 19:23 |
| hemna | that has FAIL written all over it IMO | 19:23 |
| *** eharney has quit IRC | 19:23 | |
| jungleboyj | kaufer ^^ thoughts on that? | 19:24 |
| thingee | hemna, gary-smith, jgriffith: thanks for the help! | 19:24 |
| thingee | DuncanT: you too! | 19:24 |
| openstackgerrit | Rodrigo Barbieri proposed openstack/cinder: Fix exception error on HNAS drivers https://review.openstack.org/153537 | 19:25 |
| kaufer | Yes, my patches addresses that. It makes it no-op for drivers that do not support replication. | 19:25 |
| *** emagana has quit IRC | 19:26 | |
| openstackgerrit | nikeshmahalka proposed openstack/cinder: Add iSCSI SCST Target support to cinder https://review.openstack.org/145778 | 19:26 |
| jungleboyj | kaufer: Right, but is there a way to back that out a level so that the task isn't set up at all? | 19:26 |
| hemna | kaufer, no | 19:26 |
| hemna | kaufer, your patch still allows the periodic task to get created | 19:26 |
| *** emagana has joined #openstack-cinder | 19:26 | |
| jungleboyj | That is what hemna is asking. | 19:26 |
| hemna | we need to prevent the task from being created if a driver doesn't support replication | 19:27 |
| kaufer | jungleboyj, herma: I see, I know that there is a enabled (or disabled) kwarg on the period task | 19:27 |
| hemna | as there is no point in it running every N seconds just to tests and exit | 19:27 |
| gary-smith | thingee: gotta run. Sorry, I'll have to get back to the review in the afternoon | 19:27 |
| thingee | gary-smith: np | 19:28 |
| *** dustins has quit IRC | 19:28 | |
| kaufer | jungleboyj, herma: I will investigate how to disable it | 19:28 |
| *** Mandell has joined #openstack-cinder | 19:29 | |
| *** dustins has joined #openstack-cinder | 19:29 | |
| DuncanT | hemna: test and exit is way better than hitting the db, but still a band-aid at best | 19:29 |
| hemna | DuncanT, yah it's better than what it is now | 19:30 |
| hemna | I'm just saying that there isn't much point in a task that always tests and exits. | 19:30 |
| hemna | unless by some magic replication is a capability that shows up later after the driver is up. | 19:30 |
| kaufer | jungleboyj: ^ Happen to know? | 19:31 |
| *** emagana has quit IRC | 19:31 | |
| DuncanT | hemna: In theory drivers are able to change their capabilities dynamically as the backend gets reconfigured | 19:31 |
| hemna | yah I get that | 19:32 |
| DuncanT | hemna: We support that for everything else, it would be nice to support it for replication | 19:32 |
| hemna | DuncanT, in general yes | 19:32 |
| hemna | but currently | 19:32 |
| hemna | only 1 vendor supports replication | 19:32 |
| DuncanT | hemna: But we can just check at status time and start the task if it isn't going, and yes, that can be future work | 19:32 |
| hemna | so for everyone else, there will be a bogus periodic task setup | 19:32 |
| DuncanT | hemna: I'm fine with whatever bandaids make sense now, for sure | 19:32 |
| openstackgerrit | Mitsuhiro Tanino proposed openstack/cinder: Refactoring for export functions in Target object https://review.openstack.org/148038 | 19:32 |
| xyang | DuncanT: This is updated based on the discussion at the meetup: https://review.openstack.org/#/c/110068/ | 19:35 |
| xyang | DuncanT: can you please take a look? | 19:35 |
| nikesh_vedams | jgriffith thingee : morning | 19:35 |
| DuncanT | xyang: Sure | 19:36 |
| xyang | DuncanT: thanks | 19:36 |
| jungleboyj | kaufer hemna : It isn't something magic. It is done as part of do_setup | 19:37 |
| jungleboyj | So, that shouldn't change after the driver is initialized. | 19:38 |
| kaufer | jungleboyj: k, i'll update the patch | 19:39 |
| jungleboyj | kaufer: Sounds good. I am going to create an etherpad and document today's discussion. | 19:39 |
| nikesh_vedams | jgriffith: any update on rootwrap :) | 19:40 |
| jungleboyj | Use it as a starting point going forward. Put some proposals for how we tackle getting this fixed/re-written in K. | 19:40 |
| jungleboyj | In the mean time we are going to focus on getting migration issues resolved to knock that piece out. | 19:41 |
| DuncanT | jungleboyj: Can you PM the etherpad address, please? I don't want to loose it in my scrollback, and my weekend has technically already started | 19:41 |
| jungleboyj | DuncanT: :-) It doesn't exist yet. I will send a not to the ML after I have it created. | 19:41 |
| *** e0ne has joined #openstack-cinder | 19:41 | |
| jungleboyj | DuncanT: You still want me to PM you DuncanT ? | 19:41 |
| DuncanT | Please | 19:42 |
| jungleboyj | DuncanT: Will do. Hope you are doing something fun this weekend! | 19:43 |
| *** emagana has joined #openstack-cinder | 19:44 | |
| dannywilson | jungleboyj: Does this affect the tempest test work for replication? Should we hold off until it settles down? | 19:44 |
| jungleboyj | dannywilson: :-) Well, if w are talking about redesigning it ... | 19:45 |
| dannywilson | jungleboyj: exactly, okay, will move on for now and looking forward to helping with trying to fix up the current problems | 19:46 |
| jungleboyj | dannywilson: Sounds good. | 19:46 |
| jungleboyj | dannywilson: Are you interested as you are also hoping to implement it? | 19:47 |
| dannywilson | jungleboyj: yes, we actually have an implementation based on the current design https://review.openstack.org/#/c/145090/ | 19:47 |
| dannywilson | jungleboyj: but from the sound of things it probably isn't going anywhere :( | 19:48 |
| jungleboyj | Oh, you must work with patrickeast then? | 19:48 |
| dannywilson | yep | 19:48 |
| kaufer | dannywilson: If I'm reading https://review.openstack.org/#/c/145090/9/cinder/volume/drivers/pure.py correctly, it seems like the replication support can toggle after initialization -- is that correct? | 19:48 |
| jungleboyj | dannywilson: Excellent. | 19:48 |
| *** emagana has quit IRC | 19:49 | |
| *** emagana has joined #openstack-cinder | 19:49 | |
| dannywilson | kaufer: It is possible but I think we can start with disabling the task. We can document having to restart once replication is set up on the back end for now | 19:49 |
| kaufer | ok, thx | 19:50 |
| jungleboyj | Good deal. | 19:50 |
| jungleboyj | So, we have three Vendors that are interested/have looked into this. | 19:51 |
| jungleboyj | dannywilson: Have you looked at my spec updates at all? | 19:51 |
| dannywilson | jungleboyj: Yes. They look good to me and things are working with our implementation | 19:51 |
| *** _cjones_ has quit IRC | 19:52 | |
| jungleboyj | dannywilson: Great news. Thank you! | 19:52 |
| *** Longgeek has joined #openstack-cinder | 19:53 | |
| dannywilson | jungleboyj: there might be a bug with the current way of reporting support for replication. I think the spec says 'replication_support' but when I changed my code from 'replication' it stopped working, been meaning to bring that up | 19:53 |
| *** emagana has quit IRC | 19:54 | |
| *** thangp has quit IRC | 19:58 | |
| *** Lee1092 has quit IRC | 20:00 | |
| *** rmesta has quit IRC | 20:02 | |
| *** Longgeek has quit IRC | 20:02 | |
| katco | is anyone here responsible for the WADL specs? e.g.: https://github.com/openstack/api-site/blob/master/api-ref/src/wadls/volume-api/src/v2/volume-api-v2.wadl | 20:02 |
| *** Miouge has quit IRC | 20:03 | |
| *** briancurtin has quit IRC | 20:07 | |
| *** Mandell has quit IRC | 20:08 | |
| *** zhiyan has quit IRC | 20:08 | |
| *** emagana has joined #openstack-cinder | 20:09 | |
| *** thingee has quit IRC | 20:10 | |
| *** ameade has quit IRC | 20:10 | |
| *** TobiasE has quit IRC | 20:12 | |
| *** nellysmitt has quit IRC | 20:14 | |
| *** _cjones_ has joined #openstack-cinder | 20:16 | |
| *** briancurtin has joined #openstack-cinder | 20:17 | |
| jungleboyj | dannywilson: Yes, that is one of the things I need to fix in my next patch. | 20:17 |
| *** zhiyan has joined #openstack-cinder | 20:18 | |
| jungleboyj | dannywilson: ronenkat and xyang and I talked about that and since we already have drivers using 'replication'=true, we are going to stick with that. | 20:18 |
| *** ameade has joined #openstack-cinder | 20:18 | |
| *** ronis_ has joined #openstack-cinder | 20:20 | |
| *** ronis has quit IRC | 20:21 | |
| jgriffith | nikesh_vedams: I'm looking at that now | 20:22 |
| nikesh_vedams | ok | 20:25 |
| *** Mandell has joined #openstack-cinder | 20:28 | |
| *** jgravel_ has quit IRC | 20:28 | |
| *** annegent_ has quit IRC | 20:32 | |
| *** nellysmitt has joined #openstack-cinder | 20:35 | |
| *** laudo has quit IRC | 20:37 | |
| *** jgravel has joined #openstack-cinder | 20:39 | |
| *** Mandell has quit IRC | 20:39 | |
| *** tellesnobrega_ has quit IRC | 20:41 | |
| *** markvoelker has joined #openstack-cinder | 20:41 | |
| *** rmesta has joined #openstack-cinder | 20:42 | |
| *** BharatK has quit IRC | 20:42 | |
| *** Mandell has joined #openstack-cinder | 20:45 | |
| *** mriedem has joined #openstack-cinder | 20:46 | |
| *** enterprisedc has quit IRC | 20:53 | |
| *** enterprisedc has joined #openstack-cinder | 20:55 | |
| *** sgotliv__ has joined #openstack-cinder | 20:55 | |
| openstackgerrit | Sean McGinnis proposed openstack/cinder: WIP Dell Storage Center: Add retries to API calls https://review.openstack.org/155479 | 20:56 |
| *** tbarron has quit IRC | 20:57 | |
| *** thingee has joined #openstack-cinder | 20:57 | |
| *** annegent_ has joined #openstack-cinder | 20:58 | |
| *** tbarron has joined #openstack-cinder | 20:59 | |
| *** sgotliv__ has quit IRC | 21:00 | |
| *** xyang has quit IRC | 21:00 | |
| *** tbarron has quit IRC | 21:01 | |
| *** tbarron has joined #openstack-cinder | 21:01 | |
| *** e0ne has quit IRC | 21:03 | |
| *** tbarron has quit IRC | 21:05 | |
| *** mriedem has quit IRC | 21:07 | |
| *** mriedem has joined #openstack-cinder | 21:07 | |
| *** timcl has quit IRC | 21:07 | |
| *** Apoorva has quit IRC | 21:07 | |
| *** boris-42 has joined #openstack-cinder | 21:09 | |
| *** tbarron has joined #openstack-cinder | 21:14 | |
| *** tbarron has quit IRC | 21:15 | |
| *** MasterPiece has quit IRC | 21:20 | |
| *** thrawn01 has joined #openstack-cinder | 21:24 | |
| *** Apoorva has joined #openstack-cinder | 21:26 | |
| *** sgotliv__ has joined #openstack-cinder | 21:30 | |
| *** emagana has quit IRC | 21:30 | |
| *** emagana has joined #openstack-cinder | 21:31 | |
| *** rushil_ has quit IRC | 21:31 | |
| *** eharney has joined #openstack-cinder | 21:33 | |
| *** emagana has quit IRC | 21:34 | |
| *** emagana has joined #openstack-cinder | 21:35 | |
| *** e0ne has joined #openstack-cinder | 21:45 | |
| *** Longgeek has joined #openstack-cinder | 21:47 | |
| *** jaypipes has joined #openstack-cinder | 21:49 | |
| *** nikesh_vedams has quit IRC | 21:50 | |
| *** lpetrut has quit IRC | 21:54 | |
| *** Yogi1 has quit IRC | 21:55 | |
| *** sigmavirus24 is now known as sigmavirus24_awa | 21:55 | |
| *** nikesh_vedams has joined #openstack-cinder | 21:56 | |
| *** vilobhmm has quit IRC | 21:58 | |
| *** emagana has quit IRC | 22:01 | |
| jgriffith | nikesh_vedams: should probably just update the CommandFilter in volume filters to specify the path | 22:02 |
| jgriffith | nikesh_vedams: we *should* I believe pick up anything in system PATH, but that doesn't seem to work | 22:02 |
| jgriffith | not sure if anybody here is better with rootwrap than me? | 22:03 |
| *** nellysmitt has quit IRC | 22:03 | |
| jgriffith | maybe eharney ^^ ? | 22:03 |
| smcginnis | jgriffith: Do you mean keep what is in volume.filters but don't add the path in rootwrap.conf? | 22:05 |
| jgriffith | smcginnis: kinda.... so it was pointed out that we shouldn't need to add things like "/usr/local/sbin|bin" as they should be in system PATH and just picked up | 22:06 |
| jgriffith | smcginnis: but oddly, that doesn't seem to work for me | 22:06 |
| jgriffith | smcginnis: I put an executable "test.py" in /usr/local/sbin | 22:06 |
| jgriffith | remove local/sbin from rootwrap.conf | 22:07 |
| jgriffith | and add "test.py" command filter in the volumefilters | 22:07 |
| jgriffith | and the good thing is the rootwrap doesn't fail.... | 22:07 |
| jgriffith | the bad thing is "executable not found" | 22:07 |
| smcginnis | That seems odd. Like it's not picking up the addition of /usr/local/bin? | 22:08 |
| jgriffith | I know we did some work around this in the past becasue we had some distros installing things in one place, and others in another | 22:08 |
| *** sgotliv__ has quit IRC | 22:08 | |
| jgriffith | smcginnis: so it's a path thing, yeah... my filter looks like: | 22:08 |
| smcginnis | Assuming that were to work, is there something wrong with adding /usr/local/bin to the search path? | 22:08 |
| smcginnis | eharney has the patch to revert the other commit that added it. | 22:08 |
| jgriffith | test-py: CommandFilter, /usr/local/sbin/test.py, root | 22:08 |
| jgriffith | smcginnis: yeah, he was one up to revert mine as well :) | 22:09 |
| jgriffith | smcginnis: ahh... the adding /usr/local/bin | 22:09 |
| smcginnis | jgriffith: But is there a risk with adding it. Especially if it is at the end of the search paths? | 22:09 |
| jgriffith | so we used to do that... and I think it was actually eharney that fixed that all up | 22:09 |
| smcginnis | Ah | 22:09 |
| jgriffith | as some distros might install in diff location etc | 22:09 |
| jgriffith | so we just let it sort it out by looking in PATH | 22:10 |
| jgriffith | but it doesn't seem like that's working for some reason | 22:10 |
| smcginnis | smcginnis: Seems like it makes it more flexible to handle that case of distros putting things in different locations though. | 22:10 |
| jgriffith | I guess I'll put a debug line in there and see what it thinks PATH is | 22:10 |
| jgriffith | smcginnis: yeah, it's def the right idea IMO | 22:10 |
| jgriffith | just wondering where things went wrong or broke :) | 22:11 |
| jgriffith | To the git HUB!!! | 22:11 |
| smcginnis | Yeah, in your case it smells like PATH isn't getting updated correctly somehow. | 22:11 |
| * jgriffith doesn't have a bat cave | 22:11 | |
| smcginnis | To the horse barn just doesn't have the same ring to it. | 22:11 |
| jgriffith | LOL | 22:11 |
| *** emagana has joined #openstack-cinder | 22:12 | |
| jgriffith | so I wonder if there's something we missed when oslo's common rootwrap was added | 22:12 |
| jungleboyj | We need to get jgriffith a bat cave. :-) | 22:12 |
| smcginnis | Sounds like a likely candidate. | 22:12 |
| *** annegent_ has quit IRC | 22:13 | |
| smcginnis | jgriffith: Could be overwriting the cinder PATH? | 22:13 |
| thingee | jgriffith: so I think were blocked on the open question I still have for you in https://review.openstack.org/#/c/150511/ | 22:14 |
| thingee | with making the scheduler filtering simple | 22:14 |
| thingee | I like the idea, but I'm unsure how it will work. | 22:14 |
| jgriffith | smcginnis: mystery solved | 22:15 |
| *** annegent_ has joined #openstack-cinder | 22:15 | |
| jgriffith | smcginnis: /usr/local/sbin in NOT in sys.path when running as Cinder | 22:15 |
| jgriffith | thingee: ok... huh? Checking | 22:16 |
| *** _cjones_ has quit IRC | 22:16 | |
| jgriffith | thingee: where's the question for "me" | 22:16 |
| thingee | jgriffith: last set of comments on the spec, start's with "john," | 22:17 |
| *** dalgaaf has quit IRC | 22:17 | |
| jgriffith | haha :) | 22:17 |
| jgriffith | that's me | 22:17 |
| thingee | :) | 22:17 |
| *** harlowja_ has joined #openstack-cinder | 22:18 | |
| jgriffith | thingee: ahh... yeah I see | 22:18 |
| *** e0ne has quit IRC | 22:18 | |
| jgriffith | thingee: but now I'm VERY confused by DuncanT 's comment?? | 22:19 |
| thingee | jgriffith: we'll ignore DuncanT for now :) | 22:19 |
| jgriffith | although.... | 22:19 |
| jgriffith | actually, you know I forgot something.... | 22:19 |
| jgriffith | if that key isn't scoped the scheduler will in fact just try and use it | 22:19 |
| *** Longgeek has quit IRC | 22:19 | |
| *** _cjones_ has joined #openstack-cinder | 22:19 | |
| *** harlowja has quit IRC | 22:21 | |
| thingee | jgriffith: not following | 22:21 |
| nikesh_vedams | jgriffith: so since /usr/local/sbin in NOT in sys.path when running as Cinder so then we have to add this in rootwrap.conf or not | 22:21 |
| jgriffith | thingee: I updated the spec comment... but in a nut shell | 22:22 |
| thingee | checking | 22:22 |
| jgriffith | thingee: IIRC the scheduler will take any key you hand it, and if it's not scoped... | 22:22 |
| jgriffith | thingee: it tries to match it to the hosts capabilities | 22:22 |
| jgriffith | thingee: in other words if you typed in "3parspec" instead of "hp:3parspec" it will actually filter on that | 22:23 |
| jgriffith | thingee: it will say "ok, what hosts support "3parspec" | 22:23 |
| jgriffith | thingee: if you scope the key however it just says "I don't care about this in my decision making process" | 22:23 |
| thingee | the filter scheduler I don't think has the ability to handled nested capabilities like I'm doing right now. If you take a look at my example with compression under proposed change. | 22:23 |
| thingee | but maybe that's a problem with how I'm structuring things as being nested | 22:24 |
| jgriffith | thingee: perhaps... I'll have to look | 22:24 |
| *** xyang has joined #openstack-cinder | 22:25 | |
| thingee | jgriffith: ok yeah I think I get what you're saying | 22:25 |
| jgriffith | thingee: yeah, that's probalby not going to work without some mods somewhere | 22:25 |
| jgriffith | thingee: honestly that persona shit is a PITA :) | 22:25 |
| jgriffith | thingee: but it's just a POD at the end of the day | 22:25 |
| jgriffith | thingee: no reason the filter sched can't iterate through that stuff | 22:26 |
| jgriffith | thingee: that's why I was saying in Austin we need a solid header | 22:26 |
| thingee | in the compression and qos examples, do you agree? So compression for example is an enum, and the driver can push up a list it supports. In addition, the driver can have additional settings that it can push up to go with compression | 22:26 |
| jgriffith | thingee: so "other" doesn't cut it, but like "VendorUnique" | 22:26 |
| thingee | I have this example of a "super compression" as a proprietary feature | 22:26 |
| jgriffith | or "MyComplexCrazyShit" | 22:26 |
| jgriffith | thingee: and just have the filter check both sets of data | 22:27 |
| jgriffith | thingee: personally I like seperating them out cleanly and clearly | 22:27 |
| *** e0ne has joined #openstack-cinder | 22:27 | |
| jgriffith | thingee: so there's no question whats "standard" capabilities and what's vendor specific | 22:27 |
| jgriffith | thingee: right, that's no different than what I was getting at | 22:28 |
| jgriffith | I'll see if I can write it up in the spec and check out the format you have | 22:28 |
| thingee | ok, so if I'm following, a driver can still say for compression enum ['raw', 'dedup', 'proprietary feature']...and then the rest of the settings to "proprietary feature] go to other. | 22:29 |
| *** ronis_ has quit IRC | 22:32 | |
| *** jungleboyj has quit IRC | 22:33 | |
| gary-smith | thingee: then for presentation purposes, all vendor-specific capabilities get thrown into a big bucket: "other". I thought adding ca | 22:34 |
| gary-smith | tegories was intended to address that | 22:35 |
| gary-smith | or at least, that was one of the motivations behind it | 22:35 |
| *** Mandell has quit IRC | 22:35 | |
| jgriffith | thingee: I gave it a +1 :) | 22:35 |
| jgriffith | thingee: and a short novel to go with it | 22:36 |
| *** vilobhmm has joined #openstack-cinder | 22:38 | |
| *** tellesnobrega_ has joined #openstack-cinder | 22:39 | |
| *** Apoorva has quit IRC | 22:40 | |
| *** Apoorva has joined #openstack-cinder | 22:41 | |
| smcginnis | thingee: If we could get this targeted for K-3 it would be nice :) - https://blueprints.launchpad.net/cinder/+spec/dell-sc-driver-iscsi-multipath-enhancement | 22:42 |
| *** e0ne has quit IRC | 22:43 | |
| thrawn01 | anyone know if there is a gerrit review "help I'm having trouble updating my contact info" email or help ticket or some such? | 22:46 |
| thrawn01 | can't submit reviews because of it =( | 22:46 |
| *** Mandell has joined #openstack-cinder | 22:48 | |
| patrickeast | thrawn01: might want to ask over in #openstack-infra | 22:48 |
| *** kaufer has quit IRC | 22:48 | |
| thrawn01 | patrickeast: ah, thx | 22:49 |
| smcginnis | thrawn01: I seem to remember if you didn't actually sign the CLA it gives that weird error. | 22:49 |
| *** annegent_ has quit IRC | 22:49 | |
| thrawn01 | smcginnis: I signed the thing years ago, I log on today, and had to sign it again. perhaps data corruption of some sort =( | 22:51 |
| smcginnis | thrawn01: Wasn't my storage! :) | 22:51 |
| thingee | jgriffith: thanks | 22:53 |
| jgriffith | thingee: sure... | 22:53 |
| openstackgerrit | Derrick Wippler proposed openstack/python-cinderclient: Avoid _get_keystone_session() if auth_plugin https://review.openstack.org/155518 | 22:53 |
| jgriffith | thingee: and BTW DuncanT may be mistaken.. and my posts about "just adding the capabilities" might not work | 22:54 |
| jgriffith | thingee: but I don't see a technical reason we can't make it work that way | 22:54 |
| jgriffith | the good thins is if it doesn't work, we don't lose anything :) | 22:55 |
| thrawn01 | patrickeast: they got my squared away thanks! apparently I had to click the "Apply to be a Foundation Member" button. now it works =/ | 22:55 |
| jgriffith | thingee: so now that everyone side tracked me again :) | 22:55 |
| jgriffith | anybody have insight into rootwrap questions I was asking? | 22:56 |
| jgriffith | nikesh_vedams: so I need to figure out "why" it's not in system PATH | 22:56 |
| jgriffith | and add it | 22:56 |
| *** primechuck has quit IRC | 23:01 | |
| *** thingee has quit IRC | 23:03 | |
| *** Apoorva_ has joined #openstack-cinder | 23:04 | |
| *** Apoorva has quit IRC | 23:08 | |
| jgriffith | DuncanT: thingee, FYI I just verified it does in fact work the way I remembered WRT keys | 23:10 |
| jgriffith | nikesh_vedams: ok... now back to what I was doing with rootwrap | 23:11 |
| *** xyang has quit IRC | 23:13 | |
| *** thingee has joined #openstack-cinder | 23:13 | |
| jgriffith | nikesh_vedams: your stuff went to /usr/local/bin or sbin? | 23:14 |
| * jgriffith is far too lazy to open the patch :) | 23:14 | |
| cebruns | smcginnis: :) | 23:14 |
| nikesh_vedams | hi | 23:17 |
| *** akerr has quit IRC | 23:17 | |
| nikesh_vedams | hi | 23:17 |
| *** chlong has joined #openstack-cinder | 23:17 | |
| *** dustins has quit IRC | 23:17 | |
| openstackgerrit | Danny Wilson proposed openstack/cinder: Enabling volume replication on PureISCSIDriver https://review.openstack.org/145090 | 23:18 |
| nikesh_vedams | what happended to IRC chat | 23:18 |
| jgriffith | nikesh_vedams: I dunno... I've been here the whole time | 23:18 |
| nikesh_vedams | jgriffith: /usr/local/sbin | 23:19 |
| jgriffith | My recommendation is probably to just add the full path to the tool in the filter | 23:20 |
| nikesh_vedams | scstadmin: CommandFilter, /usr/loca/sbin/scstadmin, root | 23:24 |
| nikesh_vedams | like this | 23:24 |
| jgriffith | nikesh_vedams: that's what I'm thinking yes | 23:24 |
| jgriffith | nikesh_vedams: but I'm sure as soon as I say that somebody will -1 patch | 23:24 |
| jgriffith | nikesh_vedams: if they do ask them for the solution | 23:24 |
| jgriffith | :) | 23:24 |
| nikesh_vedams | if they say to put in rootwrap.conf then | 23:25 |
| jgriffith | nikesh_vedams: say no :) | 23:25 |
| nikesh_vedams | so shall i upload new patch | 23:26 |
| nikesh_vedams | with those changes | 23:26 |
| nikesh_vedams | removing path from rootwrap.conf and adding it in command filters | 23:27 |
| jgriffith | nikesh_vedams: your command itself in the code isn't specifying the path is it? | 23:27 |
| jgriffith | nikesh_vedams: ie, in your code you just do "scstadmin" IIRC | 23:28 |
| jgriffith | NOT "/usr/local/sbin/scstadmin" | 23:28 |
| *** scottda_ has joined #openstack-cinder | 23:35 | |
| nikesh_vedams | yaa | 23:35 |
| *** EmilienM is now known as EmilienM|afk | 23:35 | |
| nikesh_vedams | in tgt and lio also we are doing like this | 23:35 |
| nikesh_vedams | right | 23:36 |
| nikesh_vedams | utils.execute('tgt-admin', '--show', run_as_root=True) | 23:36 |
| nikesh_vedams | utils.execute('cinder-rtstool', 'delete', iqn, run_as_root=True) | 23:36 |
| nikesh_vedams | similarly, in scst also utils.execute('scstadmin', *args, run_as_root=True) | 23:37 |
| *** tellesnobrega_ has quit IRC | 23:39 | |
| *** openstack has joined #openstack-cinder | 23:41 | |
| nikesh_vedams | jgriffith: yes we are doing just scstadmin and not /usr/local/sbin/scstadmin | 23:43 |
| nikesh_vedams | jgriffith: but tgt and lio also following same trend | 23:44 |
| nikesh_vedams | pattern | 23:44 |
| nikesh_vedams | so like you recommended shall i upload a new patch with command path in volume.filters | 23:49 |
| nikesh_vedams | by the way what is problem to put in rootwrap.conf,you said eharney has the patch to revert the other commit that added it | 23:50 |
| vilobhmm | hemna : ping | 23:51 |
| hemna | hey | 23:51 |
| vilobhmm | in cinder + ceph (as a backing storage) how do we prevent user A from mounting the volume created by user B | 23:51 |
| vilobhmm | ceph or for that matter any backing storage | 23:52 |
| vilobhmm | as of now there is no such prevention and seems like anyone who belongs to same tenant | 23:52 |
| hemna | user A doesn't have visibility into user B's volumes | 23:52 |
| *** scottda_ has quit IRC | 23:52 | |
| hemna | yes | 23:52 |
| hemna | that's the definition of a tenant isn't it ? | 23:52 |
| vilobhmm | yup that is … so anyone who belongs to same tenant should be able to share (access one at a time since multiattach is not supported as of now) the volumes created | 23:53 |
| vilobhmm | ? | 23:54 |
| *** smoriya has joined #openstack-cinder | 23:54 | |
| hemna | yes I would presume so | 23:54 |
| vilobhmm | and does the idea of restricting access to volumes within a tenant makes sense to you ? I mean say user A and user B are part of tenant “xyz” but restricting user B to volumes created by user B (say volB) and not letting user B access volA (which was created by user A ? | 23:56 |
| hemna | maybe, I'm not sure what the use case is | 23:56 |
| *** krtaylor has quit IRC | 23:57 | |
| *** asmith_brcd has quit IRC | 23:57 | |
| vilobhmm | hmm | 23:57 |
| vilobhmm | alrite thanks for the input | 23:58 |
| *** annegent_ has joined #openstack-cinder | 23:59 | |
| *** _cjones_ has quit IRC | 23:59 | |
| vilobhmm | use case is simple restricting user to the volume he created and not letting him/her access anyone’s else’s volume even both the users belong to same tenant…aw wanted to know if we have anything of that sort coming in…since i was reviewing your multi-atatch thinge thought will talk to you | 23:59 |
| *** _cjones_ has joined #openstack-cinder | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!