Tuesday, 2017-05-23

*** felipemonteiro has quit IRC00:13
*** hongbin has quit IRC00:22
*** edmondsw has quit IRC01:45
*** lamt has joined #openstack-meeting-cp01:57
*** brault has quit IRC02:03
*** hongbin_ has joined #openstack-meeting-cp02:48
*** lamt has quit IRC02:49
*** hongbin_ has quit IRC02:56
*** lamt has joined #openstack-meeting-cp02:56
*** edmondsw has joined #openstack-meeting-cp02:56
*** hongbin has joined #openstack-meeting-cp02:56
*** edmondsw has quit IRC03:01
*** lamt has quit IRC03:41
*** lamt has joined #openstack-meeting-cp03:46
*** david-lyle has quit IRC04:14
*** hongbin has quit IRC04:20
*** edmondsw has joined #openstack-meeting-cp04:44
*** edmondsw has quit IRC04:49
*** mtreinish has quit IRC05:38
*** brault has joined #openstack-meeting-cp05:47
*** rarcea has joined #openstack-meeting-cp05:57
*** rarcea has quit IRC06:20
*** edmondsw has joined #openstack-meeting-cp06:32
*** rarcea has joined #openstack-meeting-cp06:33
*** mtreinish has joined #openstack-meeting-cp06:33
*** edmondsw has quit IRC06:37
*** lamt has quit IRC06:48
*** brault has quit IRC08:05
*** edmondsw has joined #openstack-meeting-cp08:20
*** edmondsw has quit IRC08:25
*** raj_sing- has quit IRC08:48
*** raj_singh has joined #openstack-meeting-cp08:50
*** MarkBaker has quit IRC09:20
*** MarkBaker has joined #openstack-meeting-cp09:32
*** brault has joined #openstack-meeting-cp10:03
*** sdague has joined #openstack-meeting-cp10:03
*** MarkBaker has quit IRC10:08
*** edmondsw has joined #openstack-meeting-cp10:09
*** edmondsw has quit IRC10:13
*** MarkBaker has joined #openstack-meeting-cp10:24
*** lamt has joined #openstack-meeting-cp10:40
*** brault has quit IRC10:56
*** brault has joined #openstack-meeting-cp10:57
*** gouthamr has joined #openstack-meeting-cp11:35
*** gouthamr has quit IRC11:35
*** gouthamr_ has joined #openstack-meeting-cp11:35
*** gouthamr_ has quit IRC12:02
*** lamt has quit IRC12:18
*** zengchen has joined #openstack-meeting-cp12:23
*** edmondsw has joined #openstack-meeting-cp12:25
*** edmondsw_ has joined #openstack-meeting-cp12:27
*** edmondsw has quit IRC12:29
*** edmondsw_ has quit IRC12:31
*** edmondsw has joined #openstack-meeting-cp12:33
*** edmondsw has quit IRC12:37
*** edmondsw has joined #openstack-meeting-cp12:39
*** edmondsw has quit IRC12:44
*** edmondsw has joined #openstack-meeting-cp12:47
*** edmondsw has quit IRC12:51
*** edmondsw has joined #openstack-meeting-cp12:53
*** edmondsw has quit IRC12:55
*** edmondsw has joined #openstack-meeting-cp12:56
*** lamt has joined #openstack-meeting-cp13:00
*** lamt has quit IRC13:04
*** lamt has joined #openstack-meeting-cp13:04
*** zengche has joined #openstack-meeting-cp13:28
*** hongbin has joined #openstack-meeting-cp13:51
*** zhonghuali has joined #openstack-meeting-cp13:53
*** brault has quit IRC13:54
*** brault has joined #openstack-meeting-cp13:55
*** feisky has joined #openstack-meeting-cp13:58
*** brault has quit IRC13:59
*** zhonghuali has quit IRC13:59
*** apuimedo has joined #openstack-meeting-cp14:00
hongbinfeisky: apuimedo dims ready for the meeting?14:00
apuimedoI am14:00
hongbinjgriffith: ^^14:01
*** brault has joined #openstack-meeting-cp14:01
*** zhonghuali has joined #openstack-meeting-cp14:01
hongbinapuimedo: pause for a second to wait for other people14:02
*** zhonghuali has quit IRC14:02
feiskyšŸ˜€14:02
apuimedovery well14:02
hongbinok, then let's get started14:02
hongbin#startmeeting fuxi_stackube_k8s_storage14:02
openstackMeeting started Tue May 23 14:02:50 2017 UTC and is due to finish in 60 minutes.  The chair is hongbin. Information about MeetBot at http://wiki.debian.org/MeetBot.14:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:02
*** openstack changes topic to " (Meeting topic: fuxi_stackube_k8s_storage)"14:02
openstackThe meeting name has been set to 'fuxi_stackube_k8s_storage'14:02
hongbin#topic Roll Call14:02
*** openstack changes topic to "Roll Call (Meeting topic: fuxi_stackube_k8s_storage)"14:02
dimso/ (listening mostly)14:03
hongbinHongbin Lu14:03
*** zhonghuali has joined #openstack-meeting-cp14:03
hongbin#topic Introduction14:04
*** openstack changes topic to "Introduction (Meeting topic: fuxi_stackube_k8s_storage)"14:04
hongbinHi all14:04
apuimedoHi14:04
feiskyhi14:04
hongbinI would get started to do a brief introduction14:04
zhonghualihi14:04
zengchehello14:05
hongbinThe purpose of this meeting is to let everyone who interest in k8s storage integration to get together to figure out a development plan14:05
apuimedosounds good14:05
hongbinThis effort was started by fuxi, then we have a couple of people who expressed interest to work on this area14:05
hongbinThis includes another team: stackube, and feisky is hte initialior14:06
*** zhonghuali has quit IRC14:06
*** brault has quit IRC14:06
*** zhonghuali has joined #openstack-meeting-cp14:06
hongbinTherefore, I proposed to schedule a meeting to let all of us to discuss14:06
hongbinIdeally, we could leverage this meeting to understand what are the interests of each other, and figure out a common ground to work on this area14:07
hongbinThat is all from my side14:07
hongbinapuimedo: feisky you have anything to add?14:07
zengchehongbin:is the purpose that develop a plugin to supply storage offered by openstack for k8s?14:07
apuimedono. You described the goals very well14:07
feiskyno14:08
apuimedohongbin: it would be nice if you could list the current k8s goals of fuxi-k8s14:08
apuimedoand then feisky could do the same14:08
apuimedoso we can figure out common ground14:08
hongbinapuimedo: sure14:08
hongbin#link https://docs.openstack.org/developer/kuryr-kubernetes/specs/pike/fuxi_kubernetes.html the proposal14:08
hongbinThe idea is to develop two components: the volume provisioner and the flexvolume plugin14:09
hongbinThe volume provisioner is to listen to k8s api for pvc, and create pv and cinder/manila volume in occurance of event14:09
hongbinThe flexvolume plugin is for kubelet to conecting to cinder/manila volume14:09
hongbinThat is a brief summarize of hte design spec from fuxi14:10
hongbinI believe there are some room to modify the design if necessary14:10
hongbinWe could discuss it based on feedback14:10
feiskycool. let me make an introduction of stackube14:10
feiskystackube aims to provide a kubernetes cluster with openstack components with both soft and hard multi-tenancy.14:11
feiskyIt support all k8s volumes , including flex volumes14:12
feiskybut one main issue is that k8s mounts the volume on the host regardless of runtime14:12
feiskye.g. for hypervisors, pass the volume to VM has much more performance14:13
feiskythat is one issue we should resolve in stackube14:14
feiskyAnd I wonder whether fuxi could help on this issue14:14
hongbinfeisky: could you clarify "k8s mounts volume on the host regardless of runtime"14:15
feiskyyep14:15
feiskyfor all volumes (including flex), kubelet will attach it to the host first and then mount the volume to a host path14:16
feiskythen kubelet set container volumes based on this mountpoint14:16
feiskythe process is independent of container runtime14:17
hongbinthat is true14:17
hongbinhyper will do something that is differently?14:17
jgriffithfeisky stack cube?  Link?14:17
feiskyhttps://github.com/openstack/stackube14:18
jgriffithIMO K8ā€™s distort/model should be completely independent14:18
jgriffithI think thereā€™s more value in providing an independent plugin that only cares about upstream k8ā€™s integration14:18
*** jaugustine has joined #openstack-meeting-cp14:18
jgriffithIf that makes sense?14:18
*** brault has joined #openstack-meeting-cp14:18
apuimedodistort/model?14:19
jgriffithDistribution/modelā€¦ sorry typo14:19
apuimedoah14:19
jgriffith:)14:19
jgriffithSilly auto correct14:19
apuimedo:-)14:20
jgriffithSo think libstorageā€¦. Thereā€™s no reason Cinder shouldnā€™t actually be ā€œlibstorageā€ just needs the integration layer from Fuxi to make that work14:21
*** zhonghuali has quit IRC14:21
*** zhonghuali has joined #openstack-meeting-cp14:21
jgriffithNot sure if anybody agrees, or maybe not sure what Iā€™m referring to there?14:22
zengchejgriffith:sorry, what will  independent plugin do?14:22
*** zhipeng has joined #openstack-meeting-cp14:22
hongbinjgriffith: yes, i think the process of mounting volumes to host should be all the same, I try to figure out how hyper will do it differently14:23
jgriffithzengche so the idea IMO would be that you have a K8ā€™s deploymentā€¦ deploy Cinderā€¦ install Fujiā€¦ consume cinder from fuxi14:23
jgriffitherr.. K8ā€™s14:23
jgriffithAnd I shouldnā€™t care what K8ā€™s deployment youā€™re using14:23
jgriffithIdeally the Fuxi code runs in a pod as well14:23
apuimedohongbin: for hyper runtime it would probably be mounted to qemu, wouldn't it feisky ?14:23
feiskyqpuimedo: that's prefered way14:24
jgriffithapuimedo hongbin so the other thing is that if youā€™re using that model you can use the open stack provider in K8ā€™s then no?14:24
apuimedojgriffith: it's not pods running on VMs, the "VMs" are the pods14:25
hongbinjgriffith: i am not faimilar with k8s cloud provider, dims , you can comment on that?14:25
apuimedoso I'm doubtful that would work with hyper runtime14:25
jgriffithapuimedo yeah, I donā€™t know anything about hyper14:26
dimscloud provider assumes that the volume will be attached to something that was started by Nova14:26
feiskyas I said, k8s doesn't care about runtime now, so it's impossible to mount the volume to hyperVM now14:27
apuimedojgriffith: simplifying. It is a qemu-kvm accelerated VM managed by the hyper runtime that only runs the pod14:27
feiskyand by the way, stackube doesn't require a cloud provider14:27
feiskyqpuimedo: right. the vm is managed by hyperd14:27
jgriffithfeisky sure, not pretending to know about those two products14:28
apuimedofeisky: I'm glad the effort I put into reading the code two years ago keeps fresh in my mind14:28
hongbinfeisky: it sounds like hyper would like to develop your own volume plugin instead of using flexvolume?14:28
apuimedo:P14:29
jgriffithhongbin +114:29
feiskyhongbin: no, we will still confirm to kubernetes volume plugin.14:30
hongbinfeisky: then, you would like to develop a custom hyper flexvolume plugin for hyper?14:30
feiskybut at now, since it is impossible, we will extract volume metadata and pass it to runtime directly14:30
hongbinfeisky: could you elaborate that?14:31
feiskyit's not a flex plugin14:31
feiskye.g. we could take the info via annotations14:31
apuimedofeisky: that's the best approach14:31
feiskyand CRI already support set annotations for runtimes14:31
jgriffithfeisky do you have a link to this hyper project that youā€™re referring to?14:32
feiskyjgriffith: do you mean stackube link?14:32
feiskyoh, sorry, hyper is here https://github.com/hyperhq/hyperd14:33
jgriffithfeisky :). thanks14:33
zengchefeisky:what's the next when runtime got the volume metadata? does runtime can use volume directly?14:33
feiskyand we have a runtime in kubernetes: https://github.com/kubernetes/frakti14:33
feiskyzengche: yep, runtime will set the volume to VM14:34
zengchefeisky:got it. it is better if you five me more details. thanks.14:34
zengchefeisky:s/five/give14:35
feiskyzengche: please take an eye on the stackube project, will make the design docs later14:35
feiskys/make/add14:35
zhipengfeisky any timeline on that ?14:35
zengchefeisky:ok, i have seen your project.14:35
jgriffithI think it might be good to define and narrow scope here a bit14:36
jgriffithThereā€™s a lot going on in this conversation14:36
apuimedojgriffith: +114:36
jgriffithFuxi currently provides a way to consume Cinder from Dockerā€¦ thatā€™s great14:36
jgriffithIIRC it also allows either non-nova or nova configurations14:37
feiskyjgriffith: sorry, let's focus on the volume itself14:37
hongbinjgriffith: yes, that is correct14:37
jgriffithhongbin correct me if Iā€™m wrong on any of this?14:37
jgriffithhongbin :)14:37
jgriffithSoā€¦ what I wanted to propose was two things:14:37
jgriffith1. Convert the existing Fuxi python code to golang14:38
jgriffith2. Create a kubernetes integration14:38
hongbin++14:38
zhonghualijgriffith: +114:38
jgriffithThose two things are a lot of work, and #2 has a lot of details14:38
feiskyhongbin: jgriffith: stackube will support fuxi intrinsically (stackube support all existing kubernetes volumes)14:39
hongbinjgriffith: for #1, i guess we need to port os-brick to golang?14:39
hongbinfeisky: ack14:39
jgriffithhongbin did a good job of outlining the use of flex volume with a K8 watcher/listener for provisioning14:39
smcginnisThat will be a lot of work: https://governance.openstack.org/tc/resolutions/20170329-golang-use-case.html14:40
*** zhipeng has quit IRC14:40
jgriffithKeep in mind that flexvol will (hopefully soon) eventually have the ability to do provisioning as well so the listener would be temporary14:40
jgriffithsmcginnis indeed :)14:40
hongbini see14:40
jgriffithBut dims has blazed a trail for us that I think will help14:40
smcginnisjgriffith: +1 I would love to see some more movement on the golang front.14:41
jgriffithThereā€™s one other aspect of this as wellā€¦.14:41
apuimedosmcginnis: you mean that at some point there will not be a need for watching the k8s volume resources?14:41
jgriffithdims showed me some work that splits cinder in the existing cloud provider in K8ā€™s, so it may be possible to use that plugin with or without nova14:42
jgriffithIn which case you get dynamic provisioning and attach etc14:42
jgriffithThis is where things get interesting IMO, but itā€™s also why I say thereā€™s a LOT of work to be done14:42
smcginnisapuimedo: No, just pointing out rewriting in go is more than just taking the existing code and redoing it in another language.14:43
jgriffithAnd if we can all agree as a team and work on it together it could be pretty cool14:43
jgriffithLuckily the go part of Fuxi we have an example we can use:  https://github.com/j-griffith/cinder-docker-driver14:44
jgriffithBut we need to decide on things like gophercloud vs openstack-golang...14:44
hongbin#link https://github.com/j-griffith/cinder-docker-driver14:44
jgriffithAnd most of all infra testing14:44
apuimedodoes everybody agree to have the docker volume driver as a base (like j-griffith/cinder-docker-driver and openstack/fuxi do)?14:45
dimsjgriffith : use gophercloud, let's settle on that14:45
hongbini have no problem fo rthat14:45
apuimedojust mentioning cause it feels very runtime specific14:45
jgriffithdims works for me14:45
*** zhipeng has joined #openstack-meeting-cp14:45
jgriffithapuimedo how so?14:45
apuimedothey are docker volume API drivers14:46
apuimedoso I won't expect them to work with rkt/hyper14:46
jgriffithapuimedo ahh.. got ya14:46
jgriffithapuimedo so thatā€™s a fair point, but there are two aspect to Fuxi and that driver layer14:46
apuimedoI would like to separate the consolidation of the docker driver14:47
jgriffithapuimedo yeah, that might work.14:47
apuimedoand the effort on having k8s cinder/manila support for baremetal/pod-in-vm14:47
jgriffithapuimedo What I was hoping to do is have a single package/sdk to talk to Cinder and issue the calls14:47
jgriffithThatā€™s all14:47
apuimedojgriffith: that's what fuxi-k8s proposes for now. And kuryr accepted it14:48
apuimedoI just want to make sure that we are fine with the runtime lock-in it brings14:48
*** zhonghuali has quit IRC14:48
jgriffithapuimedo I think there are ways to address that14:48
*** zhonghuali has joined #openstack-meeting-cp14:48
jgriffithI agree with you that Iā€™d love to see support for things like rkt14:48
hongbinwe could modify the spec to make it runtime agnostic in the future14:49
apuimedojgriffith: sure, you can have drivers both in the k8s watcher and in the flexvolume14:49
apuimedofor different runtimes14:49
jgriffithhongbin apuimedo we could also layer packages to make it flexible enough14:49
apuimedobut we need to scope and define the steps14:49
hongbinjgriffith: sounds reasonable14:50
apuimedojgriffith: kuryr-k8s already supports drivers, so that a same event handler could talk to a docker volume api or to something else14:50
jgriffithhongbin apuimedo so maybe a few of us could work on defining this a bit over the next week and we can reconvene next week to see what people like/dislike etc?14:50
apuimedo(although, tbh, I think it is cleaner that the k8s watcher talks directly to cinder and manila without going via the docker volume api)14:50
apuimedofor the flexvolume part, talking to the docker volume API or another driver looks good though14:51
jgriffithapuimedo I donā€™t disagree with thatā€¦ but the existing cinderclient is not a great fit for this IMO14:51
apuimedojgriffith: how so?14:51
jgriffithThatā€™s where the desire for another layer comes into play14:51
apuimedoyou mean python-cinderclient?14:51
jgriffithapuimedo yes14:51
apuimedojgriffith: does your docker driver use plain HTTP requests or does it use gophercloud?14:52
jgriffithapuimedo to be clear, thatā€™s the base layer regardlessā€¦ but thereā€™s extra logic youā€™re likely going to want on top of it14:52
jgriffithapuimedo gopher cloudā€¦. So just goes down to cinderclient14:53
apuimedojgriffith: ok14:53
apuimedoAre we going to use the kuryr-k8s watcher (python) or are we going to make a new one in golang?14:53
apuimedofor the flexvolume and docker driver there seems to be a big agreement to move it to golang14:54
jgriffithapuimedo I donā€™t know :). I guess if thereā€™s a watcher that works thereā€™s no good reason to reinvent one14:54
hongbin+114:54
jgriffithBut I donā€™t know anything about it Iā€™m afraid :(14:54
apuimedojgriffith: it simply allows you to have pluggable handlers for K8s API objects14:55
apuimedoand in the handlers you do whatever you like14:55
jgriffithCool, Iā€™ll check it out14:56
apuimedoIt will probably move to use the new kubernetes python client14:56
apuimedo#link https://github.com/openstack/kuryr-kubernetes14:56
hongbinok, we are almost run out of time14:56
hongbinin the last 4 minutes, could we briefly summarize hte next step?14:57
apuimedojgriffith: hongbin: Obviously, when we wanted to start doing the watcher, we would have had a much easier time in Golang, since then we could use k8s official golang client, but at the time the TC was still against golang14:57
*** diablo_rojo has joined #openstack-meeting-cp14:57
hongbinapuimedo: yes, in addition, converting everything to goland is a lot of work :)14:58
dimsapuimedo : jgriffith : folks, sent an email out on gophercloud (and stop the golang client thingy) http://lists.openstack.org/pipermail/openstack-dev/2017-May/117284.html14:58
apuimedofuxi currently is at 0.1.0 release. I wonder if it is possible that the next step is to move it to golang taking in code from jgriffith with the API and options it currently exposes14:58
apuimedohongbin: would you agree to that?14:59
hongbinapuimedo: yes, we can do that, i would try to figure out how to do it step-by-step14:59
apuimedodims will probably be able to help on how to do that infra wise15:00
hongbinapuimedo: possibly, we would convert part of hte code as flexvolume plugin first15:00
dimsyep, count me in15:00
apuimedohongbin: where should the flexvolume adapter live? In openstack/fuxi ?15:01
hongbinapuimedo: i don't have specific idea for now, we could discuss it later15:01
hongbinok, overflow on openstack-kuryr channel15:02
hongbin#endmeeting15:02
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"15:02
openstackMeeting ended Tue May 23 15:02:23 2017 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:02
openstackMinutes:        http://eavesdrop.openstack.org/meetings/fuxi_stackube_k8s_storage/2017/fuxi_stackube_k8s_storage.2017-05-23-14.02.html15:02
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/fuxi_stackube_k8s_storage/2017/fuxi_stackube_k8s_storage.2017-05-23-14.02.txt15:02
openstackLog:            http://eavesdrop.openstack.org/meetings/fuxi_stackube_k8s_storage/2017/fuxi_stackube_k8s_storage.2017-05-23-14.02.log.html15:02
*** zhipeng has quit IRC15:03
*** zhonghuali has quit IRC15:03
*** hongbin has quit IRC15:36
*** zengche has quit IRC15:42
*** gouthamr has joined #openstack-meeting-cp16:35
*** harlowja has joined #openstack-meeting-cp16:56
*** feisky has quit IRC17:14
*** aselius has joined #openstack-meeting-cp17:33
*** lbragstad has joined #openstack-meeting-cp17:49
*** brault has quit IRC17:57
*** brault has joined #openstack-meeting-cp17:58
*** brault has quit IRC17:58
*** brault has joined #openstack-meeting-cp17:58
*** brault has quit IRC17:59
*** brault has joined #openstack-meeting-cp17:59
*** brault has quit IRC18:03
*** felipemonteiro has joined #openstack-meeting-cp18:27
*** felipemonteiro_ has joined #openstack-meeting-cp18:28
*** felipemonteiro has quit IRC18:33
*** rockyg has joined #openstack-meeting-cp18:48
*** rarcea has quit IRC19:19
*** harlowja_ has joined #openstack-meeting-cp20:32
*** harlowja has quit IRC20:33
*** rockyg has quit IRC20:37
*** david-lyle has joined #openstack-meeting-cp20:54
*** harlowja_ has quit IRC21:05
*** gouthamr has quit IRC21:05
*** harlowja has joined #openstack-meeting-cp21:08
*** david-lyle has quit IRC21:10
*** david-lyle has joined #openstack-meeting-cp21:22
*** brault has joined #openstack-meeting-cp21:44
*** jroll has quit IRC21:47
*** jroll has joined #openstack-meeting-cp21:47
*** edmondsw has quit IRC21:48
*** edmondsw has joined #openstack-meeting-cp21:48
*** jroll has quit IRC21:49
*** brault has quit IRC21:49
*** lamt has quit IRC21:51
*** edmondsw has quit IRC21:53
*** jroll has joined #openstack-meeting-cp21:53
*** david-lyle has quit IRC22:01
*** jaugustine has quit IRC22:01
*** gouthamr has joined #openstack-meeting-cp22:21
*** felipemonteiro_ has quit IRC22:22
*** sdague has quit IRC22:24
*** edmondsw has joined #openstack-meeting-cp22:59
*** edmondsw has quit IRC23:04
*** jungleboyj has quit IRC23:26
*** jungleboyj has joined #openstack-meeting-cp23:26

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!