Thursday, 2017-12-21

*** felipemonteiro__ has quit IRC00:53
*** iyamahat has quit IRC01:02
*** yamahata has quit IRC01:03
*** edmondsw has joined #openstack-meeting-cp01:21
*** edmondsw has quit IRC01:26
*** kmARC_ has joined #openstack-meeting-cp02:04
*** margaret_ has joined #openstack-meeting-cp02:04
*** hrybacki_ has joined #openstack-meeting-cp02:04
*** harlowja has quit IRC02:07
*** margaret has quit IRC02:07
*** hrybacki has quit IRC02:07
*** dhellmann has quit IRC02:07
*** dansmith has quit IRC02:07
*** kmARC has quit IRC02:07
*** margaret_ is now known as margaret02:07
*** hrybacki_ is now known as hrybacki02:07
*** kmARC_ is now known as kmARC02:07
*** dansmith has joined #openstack-meeting-cp02:08
*** dansmith is now known as Guest9968002:08
*** dhellmann has joined #openstack-meeting-cp02:08
*** aselius has quit IRC02:36
*** _pewp_ has quit IRC02:46
*** _pewp_ has joined #openstack-meeting-cp02:46
*** yamahata has joined #openstack-meeting-cp03:03
*** edmondsw has joined #openstack-meeting-cp03:09
*** edmondsw has quit IRC03:14
*** iyamahat has joined #openstack-meeting-cp03:20
*** coolsvap has joined #openstack-meeting-cp03:54
*** edmondsw has joined #openstack-meeting-cp04:57
*** edmondsw has quit IRC05:02
*** margaret has quit IRC06:26
*** robcresswell has quit IRC06:26
*** ameade has quit IRC06:26
*** TheJulia has quit IRC06:26
*** kencjohnston has quit IRC06:26
*** persia has quit IRC06:26
*** knikolla has quit IRC06:26
*** margaret has joined #openstack-meeting-cp06:31
*** robcresswell has joined #openstack-meeting-cp06:31
*** ameade has joined #openstack-meeting-cp06:31
*** TheJulia has joined #openstack-meeting-cp06:31
*** kencjohnston has joined #openstack-meeting-cp06:31
*** persia has joined #openstack-meeting-cp06:31
*** knikolla has joined #openstack-meeting-cp06:31
*** edmondsw has joined #openstack-meeting-cp06:45
*** margaret has quit IRC06:48
*** robcresswell has quit IRC06:48
*** ameade has quit IRC06:48
*** TheJulia has quit IRC06:48
*** kencjohnston has quit IRC06:48
*** persia has quit IRC06:48
*** knikolla has quit IRC06:48
*** edmondsw has quit IRC06:50
*** TheJulia has joined #openstack-meeting-cp07:24
*** margaret has joined #openstack-meeting-cp07:24
*** robcresswell has joined #openstack-meeting-cp07:24
*** kencjohnston has joined #openstack-meeting-cp07:25
*** persia has joined #openstack-meeting-cp07:25
*** knikolla has joined #openstack-meeting-cp07:25
*** ameade has joined #openstack-meeting-cp07:25
*** edmondsw has joined #openstack-meeting-cp08:33
*** edmondsw has quit IRC08:38
*** yamahata has quit IRC09:00
*** edmondsw has joined #openstack-meeting-cp10:22
*** edmondsw has quit IRC10:26
*** edmondsw has joined #openstack-meeting-cp12:10
*** edmondsw has quit IRC12:14
*** coolsvap has quit IRC13:44
*** edmondsw has joined #openstack-meeting-cp13:58
*** edmondsw has quit IRC14:02
*** mriedem has joined #openstack-meeting-cp15:58
ildikov#startmeeting cinder-nova-api-changes16:00
openstackMeeting started Thu Dec 21 16:00:22 2017 UTC and is due to finish in 60 minutes.  The chair is ildikov. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
*** openstack changes topic to " (Meeting topic: cinder-nova-api-changes)"16:00
openstackThe meeting name has been set to 'cinder_nova_api_changes'16:00
ildikovjohnthetubaguy jaypipes e0ne jgriffith hemna mriedem patrickeast smcginnis diablo_rojo xyang1 raj_singh lyarwood jungleboyj stvnoyes16:00
mriedemo/16:00
jungleboyj@!16:00
_pewp_jungleboyj (。・д・)ノ゙16:00
ildikovmriedem: jungleboyj: morning :)16:01
stvnoyeso/16:01
jungleboyjSnowy morning.  :-)16:01
ildikovI don't expect a crowd today and only have a few topics16:02
ildikovstvnoyes: hi :)16:02
stvnoyeshi :-)16:02
ildikovok, let's start16:03
ildikovso we need to stamp the Cinder spec on multi-attach: https://review.openstack.org/#/c/523608/16:03
ildikovI haven't seen an update from jgriffith as of yet since the last round of comments16:04
jungleboyjildikov:  Me either.  I looked at that earlier.  jgriffith seems to be AWOL.  ;-)16:04
ildikovI think we are kind of clear on most the items16:05
ildikovI hope we can clean up the shelved offloaded stuff at some point with a Nova microversion bump16:05
ildikovrunning this late in the cycle it won't happen now though16:06
mriedemthat's probably an easy cleanup for rocky16:06
ildikovI think the volume type aspect is clear now16:06
ildikovmriedem: +116:06
jungleboyjmriedem:  ++16:07
ildikovand we need some client clean up too on the Cinder side as pointed out by hemna16:07
jungleboyjYeah, the --multi-attach option?16:07
ildikovyep, I meant that one16:08
jungleboyjildikov:  Ok, will have to go through deprecation and stuff on that, but not a big deal.16:08
ildikovjungleboyj: sure, we can look into that16:09
ildikovjungleboyj: it's a bit of a corner case though, but we can figure out how to handle it once we get there16:09
ildikovjungleboyj: do you want to give it a try to update the spec?16:10
jungleboyjildikov:  Looking at it, I was really hoping that jgriffith would jump in there but I can try to address the comments and see if they satisfy people.16:10
ildikovjungleboyj: let's give it a try and hopefully we can get it in soon now16:11
ildikovwe can always update it later if needed16:11
jungleboyjOk.  I will give that a shot after the meeting here.16:12
ildikovjungleboyj: thank you16:12
jungleboyjildikov: Welcome.16:12
ildikovI will hunt down jgriffith after the spec lands to see where he got with the code parts in the meantime16:13
ildikovon the Nova side I cleaned up the libvirt patch: https://review.openstack.org/#/c/267587/16:14
ildikovI know that we have pseudo code in the Nova spec for the lock, but if someone would have a ton of time I could use some 'how to do locks' lessons16:15
ildikovas I'm not sure I got the full picture on how it should look like by the end...16:15
mriedemwell the first thing there is we need the shared_targets flag off the volume16:15
ildikovyeah, that'll decide on whether or not we will have to lock16:16
mriedemso we have to get the volume at the new microversion, i assume when we know we're detaching from a volume that has multiple attachments?16:16
mriedemwould have to look at the spec again16:16
ildikovdidn't we kind of want to have that lock for shared_targets overall?16:17
ildikovhttps://specs.openstack.org/openstack/nova-specs/specs/queens/approved/cinder-volume-multi-attach.html16:17
mriedemso that can be attachments from different volumes?16:18
mriedemi.e. it's an existing problem?16:18
jungleboyjildikov:  The locking was for shared_targets, yes.16:18
ildikovI think we said that there's an existing problem with shared_targets it's just gets worse with multi-attach16:18
mriedemok i missed that part16:18
ildikov*it16:19
jungleboyjRight.16:19
mriedemso if we're going to do that regardless of the volume saying it's multiattach or not, i guess that patch comes in before the multiattach one right?16:19
ildikovwe had a chat about this at the PTG with the Cinder guys saying that brick is smarter now, etc, but there's in general a shared_targets issue that locks would help with16:19
ildikovyeah, in that case it should16:20
ildikovjungleboyj: is there any bug report about this issue or it's just an urban legend that we believe is true?16:20
jungleboyjildikov:  Just a legend.16:21
ildikovjungleboyj: never mind then :)16:21
mriedemok, so i can maybe help a big here on the plumbing16:22
mriedem*bit16:22
ildikovI have very basic questions on how locks work in general16:23
ildikovlike I saw instance lock in the code but that doesn't fully answer my how exactly can I lock the host16:23
mriedemdepends on if the lock is external or not16:24
ildikovor well, the attach/detach volume operations to get them serialized16:24
mriedemwe use https://github.com/openstack/nova/blob/master/nova/utils.py#L7116:24
jgriffithYes, that mv bump to expose shared_targets and lock name should be before multiattach16:24
jgriffith(sorry, joining the party late)16:24
mriedemhttps://github.com/openstack/oslo.concurrency/blob/master/oslo_concurrency/lockutils.py#L29116:24
mriedemyou can pass external=True here https://github.com/openstack/oslo.concurrency/blob/master/oslo_concurrency/lockutils.py#L23116:24
ildikovexternal from what perspective?16:24
mriedemby default, the lock is just per-process16:25
mriedeman external lock is on the file system16:25
* ildikov hides after that question now...16:25
mriedemso across processes16:25
ildikovoh, ok, makes sense16:25
mriedemthat's only per-host though,16:25
mriedemnot across all hosts, that would be a DLM16:25
mriedemlike etd16:25
mriedem*etcd16:25
ildikovwe want it per host, so that's fine16:25
mriedemnow,16:25
mriedemyou can only run one nova-compute worker,16:25
mriedemso i'm not sure we need an external lock,16:26
mriedemunless someone is running multiple nova-compute processes on the same host16:26
mriedemwhich is possible, but i'm not sure how many people actually do that16:26
ildikovis it a huge extra burden to add 'external'?16:26
mriedemno, but it could unnecessarily impose a semaphore where one isn't needed16:27
mriedemwhich would impact performance16:27
mriedemi think starting with a non-external lock is fine,16:27
ildikovjgriffith: we were wondering if there's any explanation on the shared targets issue that exists independently from multi-attach that we discussed at the PTG16:27
jgriffithmy 2 cents is that I didn't think we needed the external in this case16:27
mriedemif someone comes forward saying "omfg this breaks my crazy multi-nova-compute on single host deployment" then we can change it16:28
ildikovok, fair enough16:28
ildikovjust wanted to see the options here16:28
mriedemok so i could probably wip something up16:28
jgriffithildikov: the shared-targets issues outside of multi-attach?  Just the "unsafe" removal of a target that's still in use16:29
jgriffithbrick deals with it today but there are races there that can be problematic16:29
ildikovmriedem: that would be pretty great :)16:29
jgriffithalthough currently my understanding from folks is that it's pretty solid now16:29
ildikovjgriffith: I think I remembered the races discussion16:29
jgriffithildikov: the conclusion we came to was that it was a nice improvement/enhancement for the non-multiattach world, and a requirements for multiattach16:30
ildikovjgriffith: thanks for confirming16:30
jungleboyjjgriffith:  Welcome!16:30
ildikovjgriffith: I guess there isn't anything that would describe the need for this nice improvement/enhancement? :)16:31
mriedemhttps://specs.openstack.org/openstack/cinder-specs/specs/queens/add-shared-targets-to-volume-ref.html16:32
mriedemprobably there ^16:32
ildikovmriedem: ah, right, I forgot that it was written without any multi-attach poisoning in it...16:33
ildikovthen we can document that change as well16:33
mriedemwe should get this updated https://developer.openstack.org/api-ref/block-storage/v3/#show-a-volume-s-details16:34
mriedemfor the new fields16:34
ildikovI can look into that16:34
ildikovmriedem: if you upload a WIP on the lock stuff, I will look into the API microversion bump and the needed Cinder changes16:35
mriedemhttps://bugs.launchpad.net/cinder/+bug/173964016:35
openstackLaunchpad bug 1739640 in Cinder "3.48 volume response parameters are not in the v3 API reference" [Undecided,New]16:35
mriedemhere you go16:35
mriedemi'll crank something out quick on the lock thing16:35
ildikovmriedem: sweet, tnx16:35
ildikovmriedem: is there anything in the libvirt patch that I should add/change?16:36
mriedemi haven't looked at it lately16:37
ildikovjgriffith: jungleboyj will update your spec on multi-attach; will you be around to answer questions and/or check the updated version?16:37
ildikovmriedem: no problem, I was just wondering16:38
jungleboyjjgriffith:  Or can you make the updates so I can then approve it?16:38
jgriffithjungleboyj: will do16:38
jungleboyjjgriffith:  You will make updates?  If so, can we do that today?16:38
jgriffithjungleboyj: yes and yes16:39
ildikovjgriffith: even better, thank you so much16:39
jungleboyjjgriffith:  You the man!  Thank you.16:39
ildikovI haven't gotten to the Tempest test yet16:40
*** iyamahat has quit IRC16:40
ildikovI hope our expert, stvnoyes will be able to help out with that part in January :)16:40
mriedemi assume stvnoyes is frantically working on backporting all of this to kilo for oracle16:41
ildikovI hope he found slaves for that :)16:41
mriedemmotion to adjourn16:41
jgriffithI second16:42
jungleboyjI third16:42
ildikovI give up :)16:42
jgriffithjungleboyj: no no no, procedure after a second is "all in favor"16:42
jgriffith:)16:42
jungleboyjall in favor?16:42
mriedemaye16:42
ildikovfor today only though :)16:42
jgriffithaye16:42
jungleboyjThey aye's have it.16:42
ildikovHappy Holidays All!16:43
ildikovthat was my last topic16:43
ildikovno meeting next week16:43
jungleboyjHope everyone has a Merry Christmas and a safe New Year.16:43
jgriffithIndeed Merry Christmas everyone16:43
ildikovI will check who's around on the 4th16:43
jungleboyjjgriffith:  give me a ping when the spec is ready in case I don't see that come through.16:43
jungleboyjildikov: I am in Workshops in Raleigh so I will probably only be peripherally there.16:44
ildikovjungleboyj: no worries, I'm an expert in talking to myself16:44
* jungleboyj laughs16:44
ildikovwith all that said16:45
ildikovThank You All for everything!16:45
jungleboyjildikov:  Thank you!16:45
ildikovit's a hell of a ride, but hopefully we will get there now16:45
* jungleboyj sings "All I want for Christmas is multi-attach"16:46
ildikovhave fun and some rest and whatever makes you happy with family, friends, cats, etc next week(s)16:46
ildikovjungleboyj: that makes me nauseous...16:47
ildikovThat's all Folks!16:47
ildikov:)16:47
ildikov#endmeeting16:47
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"16:47
openstackMeeting ended Thu Dec 21 16:47:41 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:47
openstackMinutes:        http://eavesdrop.openstack.org/meetings/cinder_nova_api_changes/2017/cinder_nova_api_changes.2017-12-21-16.00.html16:47
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/cinder_nova_api_changes/2017/cinder_nova_api_changes.2017-12-21-16.00.txt16:47
openstackLog:            http://eavesdrop.openstack.org/meetings/cinder_nova_api_changes/2017/cinder_nova_api_changes.2017-12-21-16.00.log.html16:47
*** nhelgeson has joined #openstack-meeting-cp17:01
*** mriedem has left #openstack-meeting-cp17:03
*** kmalloc has joined #openstack-meeting-cp17:13
*** aselius has joined #openstack-meeting-cp17:21
*** iyamahat has joined #openstack-meeting-cp17:29
*** iyamahat has quit IRC17:29
*** yamahata has joined #openstack-meeting-cp17:31
*** edmondsw has joined #openstack-meeting-cp17:39
*** edmondsw has quit IRC17:44
*** iyamahat has joined #openstack-meeting-cp17:45
*** harlowja has joined #openstack-meeting-cp18:16
*** iyamahat has quit IRC18:29
*** yamahata has quit IRC18:32
*** iyamahat has joined #openstack-meeting-cp18:49
*** yamahata has joined #openstack-meeting-cp19:07
*** edmondsw has joined #openstack-meeting-cp19:28
*** edmondsw has quit IRC19:33
*** diablo_rojo has quit IRC19:51
*** diablo_rojo has joined #openstack-meeting-cp20:51
*** andreaf has quit IRC21:55
*** andreaf has joined #openstack-meeting-cp21:56
*** diablo_rojo has quit IRC22:07
*** diablo_rojo has joined #openstack-meeting-cp22:13
*** diablo_rojo has quit IRC22:49
*** edmondsw has joined #openstack-meeting-cp23:04
*** stvnoyes has quit IRC23:06
*** edmondsw has quit IRC23:08
*** kbyrne has quit IRC23:33
*** kbyrne has joined #openstack-meeting-cp23:39

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!