Thursday, 2014-01-09

*** yamahata has joined #openstack-meeting-alt00:01
*** balajiiyer1 has quit IRC00:04
*** balajiiyer1 has joined #openstack-meeting-alt00:11
*** sarob has quit IRC00:17
*** sarob has joined #openstack-meeting-alt00:17
*** cweid has quit IRC00:18
*** jmontemayor has quit IRC00:18
*** sarob has quit IRC00:22
*** tanisdl has quit IRC00:31
*** sacharya has joined #openstack-meeting-alt00:33
*** amytron has quit IRC00:40
*** pdmars has quit IRC00:43
*** ViswaV has joined #openstack-meeting-alt00:44
*** IlyaE has joined #openstack-meeting-alt00:46
*** alazarev has joined #openstack-meeting-alt00:46
*** ViswaV has quit IRC00:49
*** rwsu has quit IRC01:00
*** yogesh has joined #openstack-meeting-alt01:06
*** amytron has joined #openstack-meeting-alt01:09
*** jjmb has joined #openstack-meeting-alt01:16
*** venkatesh has joined #openstack-meeting-alt01:24
*** nosnos has joined #openstack-meeting-alt01:29
*** mozawa has joined #openstack-meeting-alt01:31
*** venkatesh has quit IRC01:31
*** amotoki has quit IRC01:31
*** yogesh has quit IRC01:34
*** yogesh has joined #openstack-meeting-alt01:35
*** kebray_ has quit IRC01:37
*** yogesh has quit IRC01:39
*** venkatesh has joined #openstack-meeting-alt01:40
*** venkatesh has quit IRC01:41
*** xuhanp has joined #openstack-meeting-alt01:42
*** alazarev has quit IRC01:45
*** sballe has quit IRC01:47
*** sballe has joined #openstack-meeting-alt01:47
*** sballe has quit IRC01:55
*** sacharya has quit IRC01:57
*** bdpayne has quit IRC01:58
*** IlyaE has quit IRC02:12
*** GheRiver1 has joined #openstack-meeting-alt02:13
*** plomakin_ has joined #openstack-meeting-alt02:14
*** dkehn_ has joined #openstack-meeting-alt02:14
*** dkehn has quit IRC02:15
*** plomakin has quit IRC02:15
*** GheRivero has quit IRC02:15
*** julim has quit IRC02:15
*** DennyZhang has joined #openstack-meeting-alt02:20
*** dkehn_ is now known as dkehn02:23
*** gduan has quit IRC02:28
*** amcrn has quit IRC02:29
*** garyduan has joined #openstack-meeting-alt02:33
*** sc68cal has quit IRC02:33
*** eankutse has joined #openstack-meeting-alt02:35
*** sc68cal has joined #openstack-meeting-alt02:36
*** alazarev has joined #openstack-meeting-alt02:43
*** alazarev has quit IRC02:43
*** julim has joined #openstack-meeting-alt02:43
*** sc68cal has quit IRC02:45
*** yogesh has joined #openstack-meeting-alt02:45
*** sc68cal has joined #openstack-meeting-alt02:46
*** sc68cal has quit IRC02:48
*** nati_ueno has quit IRC02:50
*** yogesh has quit IRC02:50
*** balajiiyer1 has quit IRC02:52
*** sc68cal_ has joined #openstack-meeting-alt02:54
*** sc68cal_ has quit IRC02:54
*** sc68cal_ has joined #openstack-meeting-alt02:56
*** sarob has joined #openstack-meeting-alt03:02
*** doug_shelley66 has quit IRC03:07
*** kebray_ has joined #openstack-meeting-alt03:11
*** NehaV has joined #openstack-meeting-alt03:13
*** banix has quit IRC03:24
*** sarob has quit IRC03:25
*** sarob has joined #openstack-meeting-alt03:26
*** gokrokve has joined #openstack-meeting-alt03:29
*** arnaud___ has quit IRC03:30
*** arnaud__ has quit IRC03:31
*** julim has quit IRC03:35
*** balajiiyer has joined #openstack-meeting-alt03:37
*** sarob has quit IRC03:38
*** kebray_ has quit IRC03:38
*** sarob has joined #openstack-meeting-alt03:39
*** kebray_ has joined #openstack-meeting-alt03:40
*** coolsvap has quit IRC03:46
*** sarob has quit IRC03:50
*** csaba|afk is now known as csaba03:51
*** mat-lowery has joined #openstack-meeting-alt03:51
*** kebray_ has quit IRC03:55
*** banix has joined #openstack-meeting-alt03:56
*** DennyZhang has quit IRC03:56
*** sarob has joined #openstack-meeting-alt04:02
*** kebray_ has joined #openstack-meeting-alt04:03
*** kebray_ has quit IRC04:04
*** sarob has quit IRC04:07
*** amotoki has joined #openstack-meeting-alt04:07
*** harlowja is now known as harlowja_away04:07
*** vipul has quit IRC04:08
*** vipul has joined #openstack-meeting-alt04:08
*** mat-lowery_ has joined #openstack-meeting-alt04:12
*** mat-lowery has quit IRC04:13
*** mat-lowery_ is now known as mat-lowery04:13
*** harlowja_away is now known as harlowja04:14
*** SushilKM has joined #openstack-meeting-alt04:14
*** eankutse has quit IRC04:17
*** cody-somerville has quit IRC04:17
*** kebray_ has joined #openstack-meeting-alt04:19
*** kebray_ has quit IRC04:30
*** cody-somerville has joined #openstack-meeting-alt04:31
*** kebray_ has joined #openstack-meeting-alt04:32
*** kebray_ has quit IRC04:38
*** ijw has quit IRC04:40
*** NehaV has quit IRC04:42
*** SushilKM has quit IRC04:43
*** banix has quit IRC04:45
*** doude has joined #openstack-meeting-alt04:46
*** nosnos_ has joined #openstack-meeting-alt04:47
*** bdpayne has joined #openstack-meeting-alt04:49
*** cody-somerville_ has joined #openstack-meeting-alt04:49
*** banix has joined #openstack-meeting-alt04:50
*** vipuls has joined #openstack-meeting-alt04:50
*** mat-lowery has quit IRC04:53
*** cody-somerville has quit IRC04:55
*** vipul has quit IRC04:55
*** nosnos has quit IRC04:55
*** krtaylor has quit IRC04:55
*** doude_ has quit IRC04:55
*** nadya_ has joined #openstack-meeting-alt04:58
*** krtaylor has joined #openstack-meeting-alt05:03
*** nadya_ has quit IRC05:03
*** banix has quit IRC05:06
*** balajiiyer has quit IRC05:08
*** kebray_ has joined #openstack-meeting-alt05:19
*** bdpayne has quit IRC05:25
*** chandankumar has joined #openstack-meeting-alt05:27
*** gokrokve has quit IRC05:38
*** chandankumar_ has joined #openstack-meeting-alt05:39
*** nati_ueno has joined #openstack-meeting-alt05:43
*** kebray_ has quit IRC05:44
*** bdpayne has joined #openstack-meeting-alt05:51
*** coolsvap has joined #openstack-meeting-alt05:53
*** chandankumar has quit IRC06:25
*** harlowja is now known as harlowja_away06:25
*** balajiiyer1 has joined #openstack-meeting-alt06:37
*** bdpayne has quit IRC06:40
*** balajiiyer1 has quit IRC06:41
*** gokrokve has joined #openstack-meeting-alt06:49
*** gokrokve has quit IRC06:54
*** markwash has quit IRC07:08
*** sergmelikyan has joined #openstack-meeting-alt07:09
*** ityaptin has joined #openstack-meeting-alt07:09
*** markwash has joined #openstack-meeting-alt07:11
*** SergeyLukjanov has joined #openstack-meeting-alt07:18
*** NikitaKonovalov has joined #openstack-meeting-alt07:21
*** dguitarbite has joined #openstack-meeting-alt07:23
*** SushilKM has joined #openstack-meeting-alt07:29
*** SushilKM has quit IRC07:29
*** coolsvap has quit IRC07:33
*** katyafervent has joined #openstack-meeting-alt07:33
*** balajiiyer1 has joined #openstack-meeting-alt07:38
*** balajiiyer1 has quit IRC07:42
*** pnavarro has joined #openstack-meeting-alt07:42
*** coolsvap has joined #openstack-meeting-alt07:44
*** doug_shelley66 has joined #openstack-meeting-alt07:46
*** SergeyLukjanov has quit IRC07:47
*** dguitarbite has quit IRC07:48
*** SergeyLukjanov has joined #openstack-meeting-alt07:48
*** dguitarbite has joined #openstack-meeting-alt07:48
*** sergmelikyan has quit IRC07:49
*** jcoufal has joined #openstack-meeting-alt07:50
*** sergmelikyan has joined #openstack-meeting-alt07:54
*** dguitarbite has quit IRC08:10
*** tnurlygayanov has joined #openstack-meeting-alt08:26
*** doude has left #openstack-meeting-alt08:29
*** balajiiyer1 has joined #openstack-meeting-alt08:38
*** early has quit IRC08:40
*** llu-laptop has joined #openstack-meeting-alt08:42
*** tian has joined #openstack-meeting-alt08:42
*** early has joined #openstack-meeting-alt08:42
*** tsufiev_ has joined #openstack-meeting-alt08:42
*** flaper87|afk is now known as flaper8708:43
*** balajiiyer1 has quit IRC08:43
*** SergeyLukjanov has quit IRC08:44
*** csaba is now known as csaba|afk08:46
*** nati_ueno has quit IRC08:47
*** rsblendido has joined #openstack-meeting-alt08:48
*** rossella_s has joined #openstack-meeting-alt08:48
*** llu-laptop has left #openstack-meeting-alt08:48
*** aignatov has joined #openstack-meeting-alt08:49
*** shanewang has joined #openstack-meeting-alt08:50
*** shanewang has quit IRC08:51
*** safchain has joined #openstack-meeting-alt08:56
*** _ruhe is now known as ruhe09:04
*** pnavarro has quit IRC09:21
*** SergeyLukjanov has joined #openstack-meeting-alt09:25
*** johnthetubaguy has joined #openstack-meeting-alt09:30
*** sergmelikyan has quit IRC09:32
*** pnavarro has joined #openstack-meeting-alt09:33
*** SushilKM has joined #openstack-meeting-alt09:36
*** johnthetubaguy has quit IRC09:38
*** johnthetubaguy1 has joined #openstack-meeting-alt09:38
*** balajiiyer1 has joined #openstack-meeting-alt09:39
*** SushilKM has quit IRC09:41
*** balajiiyer2 has joined #openstack-meeting-alt09:41
*** balajiiyer1 has quit IRC09:44
*** balajiiyer2 has quit IRC09:45
*** coolsvap has quit IRC09:46
*** derekh has joined #openstack-meeting-alt09:52
*** julienvey has quit IRC09:53
*** nati_ueno has joined #openstack-meeting-alt09:58
*** jtomasek has joined #openstack-meeting-alt10:00
*** plomakin_ has quit IRC10:01
*** plomakin has joined #openstack-meeting-alt10:01
*** nati_ueno has quit IRC10:02
*** mozawa has quit IRC10:02
*** venkatesh has joined #openstack-meeting-alt10:05
*** sergmelikyan has joined #openstack-meeting-alt10:05
*** coolsvap has joined #openstack-meeting-alt10:10
*** SushilKM has joined #openstack-meeting-alt10:13
*** xuhanp has quit IRC10:20
*** SergeyLukjanov has quit IRC10:30
*** jtomasek has quit IRC10:34
*** SushilKM has quit IRC10:35
*** aignatov has quit IRC10:37
*** boris-42 has quit IRC10:39
*** ruhe is now known as _ruhe10:42
*** balajiiyer1 has joined #openstack-meeting-alt10:42
*** nosnos_ has quit IRC10:46
*** balajiiyer1 has quit IRC10:46
*** boris-42 has joined #openstack-meeting-alt10:50
*** venkatesh_ has joined #openstack-meeting-alt10:56
*** jasonb365 has joined #openstack-meeting-alt10:57
*** venkatesh has quit IRC10:57
*** aignatov has joined #openstack-meeting-alt11:05
*** _ruhe is now known as ruhe11:06
*** jprovazn has joined #openstack-meeting-alt11:11
*** jcoufal has quit IRC11:14
*** jcoufal has joined #openstack-meeting-alt11:15
*** venkatesh_ has quit IRC11:15
*** ruhe is now known as _ruhe11:18
*** _ruhe is now known as ruhe11:23
*** boris-42 has quit IRC11:29
*** boris-42 has joined #openstack-meeting-alt11:38
*** csaba|afk is now known as csaba11:39
*** balajiiyer has joined #openstack-meeting-alt11:43
*** yamahata has quit IRC11:43
*** jtomasek has joined #openstack-meeting-alt11:46
*** balajiiyer has quit IRC11:47
*** cody-somerville_ has quit IRC11:52
*** safchain has quit IRC11:58
*** coolsvap has quit IRC12:02
*** ruhe is now known as ruhe_away12:05
*** cody-somerville_ has joined #openstack-meeting-alt12:06
*** ruhe_away is now known as ruhe12:08
*** cody-somerville_ is now known as cody-somerville12:10
*** jasonb365 has quit IRC12:16
*** derekh has quit IRC12:23
*** ruhe is now known as _ruhe12:23
*** balajiiyer1 has joined #openstack-meeting-alt12:43
*** balajiiyer1 has quit IRC12:48
*** _ruhe is now known as ruhe12:50
*** heyongli has joined #openstack-meeting-alt12:54
*** eankutse has joined #openstack-meeting-alt12:54
*** mozawa has joined #openstack-meeting-alt12:55
*** eankutse has quit IRC12:56
*** eankutse has joined #openstack-meeting-alt12:56
*** NikitaKonovalov has quit IRC12:57
*** irenab__ has joined #openstack-meeting-alt12:57
*** derekh has joined #openstack-meeting-alt12:57
*** baoli has joined #openstack-meeting-alt12:58
*** irenab__ is now known as irenab12:58
baoli#startmeeting PCI passthrough13:00
openstackMeeting started Thu Jan  9 13:00:04 2014 UTC and is due to finish in 60 minutes.  The chair is baoli. Information about MeetBot at http://wiki.debian.org/MeetBot.13:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.13:00
*** openstack changes topic to " (Meeting topic: PCI passthrough)"13:00
openstackThe meeting name has been set to 'pci_passthrough'13:00
baoliHi everyone13:00
irenabhi13:00
johnthetubaguy1hi13:00
*** bcrochet|bbl is now known as bcrochet13:00
heyonglihello13:00
*** johnthetubaguy1 is now known as johnthetubaguy13:00
baoliJohn, can you lead the discussion today?13:00
johnthetubaguyif you want13:01
johnthetubaguyI would love to talk about this:13:01
johnthetubaguyhttps://wiki.openstack.org/wiki/Meetings/Passthrough#The_user_view_of_requesting_things13:01
johnthetubaguywhat would the nova CLI calls look like13:01
johnthetubaguywhen requesting gpu passthrough first13:01
*** sadasu has joined #openstack-meeting-alt13:02
*** NikitaKonovalov has joined #openstack-meeting-alt13:02
johnthetubaguyanyone want to suggest a proposal?13:03
irenabjohn, I guess it requires flavor creation with extra_spec for GPU device and then regular 'nova boot'13:03
*** markvoelker1 has joined #openstack-meeting-alt13:03
johnthetubaguy+1 on that I think13:03
heyonglicurrent is: nova flavor-key  m1.large set  "pci_passthrough:alias"="a1:2"13:03
heyonglinova boot --image new1 --key_name test --flavor m1.large 12313:03
johnthetubaguyright13:03
*** BrianB_ has joined #openstack-meeting-alt13:04
johnthetubaguyI will add that in the wiki13:04
irenabheyongli: and its already supported, right?13:04
*** jtomasek has quit IRC13:04
heyongliyes13:04
*** jtomasek has joined #openstack-meeting-alt13:05
johnthetubaguyso there is a limitation there13:05
johnthetubaguyyou only get one PCI passthrough device13:05
johnthetubaguydo we care about that for GPU etc, I think the answer is yet13:05
johnthetubaguyI mean yes13:05
irenabjohn: you can request number of devices13:06
johnthetubaguyirenab: how?13:06
johnthetubaguyoh, I see13:06
irenaba1:2 => 2 devices13:06
heyonglia1:2, a2:313:06
johnthetubaguybut there are all from the same alias13:06
heyongliis also ok13:06
johnthetubaguyah, so thats a better example13:07
johnthetubaguywe support this today then: a1:2, a2:313:07
heyongliand alias support a mixer spec: two 2 type of device13:07
irenabI think you can add another alias too13:07
heyongliyou can defien alias:13:08
irenabmy feeling is GPU case is quite sovled and we just need to keep it working when adding netowrking case, agree?13:08
heyonglia1={type1}13:08
heyonglithen write same: a1={type2}13:08
*** eankutse1 has joined #openstack-meeting-alt13:08
heyonglithen you requied a1:2 ,means both type1,and typ2 is ok13:08
johnthetubaguyheyongli: what are the CLI commands for that, I am a bit confused13:09
heyongliin nova configuration now.13:09
johnthetubaguyI added the GPU case here:13:09
johnthetubaguyhttps://wiki.openstack.org/wiki/Meetings/Passthrough#The_user_view_of_requesting_things13:09
heyonglino API yet13:09
johnthetubaguyI agree we just need to keep it working13:09
johnthetubaguyheyongli: I am talking about the flavor, and what we already have today13:09
sadasuheyongli: cli is confusing ... "x:y"="a:b" would be interpreted as x = a and y = b which is not the case in your CLI13:10
heyonglisadasu: where you see x:y = a:b?13:11
johnthetubaguyhang on, hang on13:11
johnthetubaguyis this valid today13:11
johnthetubaguynova flavor-key  m1.large set  "pci_passthrough:alias"=" large_GPU:1,small_GPU:1"13:11
sadasu"pci_passthrough:alias"="a1:2"13:11
*** eankutse has quit IRC13:11
baolipci_alias='{"name":"Cisco.VIC","vendor_id":"1137","product_id":"0071"}'13:11
baolithis is how it's defined today13:11
heyonglisadasu: this is another problem, john: right ,it works today13:11
johnthetubaguyI don't mind about the alias13:11
*** jcoufal has quit IRC13:11
johnthetubaguyI am trying to ask how the flavor extra specs work today13:12
johnthetubaguyis this valid?13:12
johnthetubaguynova flavor-key  m1.large set  "pci_passthrough:alias"=" large_GPU:1,small_GPU:1"13:12
*** SushilKM has joined #openstack-meeting-alt13:12
heyonglijohnthetubaguy, it works13:12
johnthetubaguycool13:12
*** SushilKM has left #openstack-meeting-alt13:12
johnthetubaguyso, we have the user request for vGPU13:12
sadasuI am sure it works...you can make it work...I am just suggesting that it is not very self explanatory13:12
johnthetubaguynow...13:12
johnthetubaguySRIOV13:12
*** eankutse1 has quit IRC13:13
johnthetubaguysadasu: it could be better, it could be worse, but I vote we try not to worry about that right now13:13
sadasuok...get it...lets move to SRIOV13:13
heyonglisadasu: the pci_passthrough:alias, should be this sytle because the scheduler history reason.13:13
johnthetubaguyso first, nova boot direct13:14
irenabSRIOV + neutron, ok?13:14
johnthetubaguyyep13:14
irenabjohn: suggestion is to add attributes to --nic13:15
johnthetubaguyyep, can we give an example13:15
johnthetubaguyI am trying to type one up and not likeing any of them13:15
baoliCan we go over the jan 8th agenda I posted yesterday?13:15
baoliIt contains all the details we have been workign so far13:16
johnthetubaguyOK, we can reference it for sure, I just would love to aggree this user end bit first13:16
irenabbaoli: lest go to the last use case13:16
*** pdmars has joined #openstack-meeting-alt13:17
irenabjohn: do you agree with nova boot format?13:17
johnthetubaguyI can't easily see an example in that text13:17
johnthetubaguyoh wait13:17
johnthetubaguysorry13:17
baoli  nova boot --flavor m1.large --image <image_id>                     --nic net-id=<net-id>,vnic-type=macvtap,pci-group=<group-name> <vm-name>13:17
johnthetubaguyI am blind13:17
johnthetubaguymacvtap?13:17
johnthetubaguyvs direct vs vnic13:17
irenabor direct or virtio13:17
johnthetubaguywhy do we need that?13:18
johnthetubaguyI mean, why do we have three here?13:18
baoliFor SRIOV, there is both macvtap and direct13:18
*** jtomasek_ has joined #openstack-meeting-alt13:18
*** jcoufal has joined #openstack-meeting-alt13:18
johnthetubaguyOK, is that not implied by the device type and vif driver config?13:18
baoliWith macvtap, it's still pci passthrough but a host macvtap device is involved13:19
baoliWell, the device type and vif driver can support both at the same time on the same device13:19
johnthetubaguyhmm, OK13:20
johnthetubaguymacvtap doesn't look like passthrough13:20
johnthetubaguyit looks like an alternative type of vnic13:20
baoliJohn, it's one form of PCI passthrough13:20
irenabjohn, the idea is to work with neutron ML2 plugin that will enable different typpes of vnics13:20
baoliI mean one type13:20
*** jtomasek has quit IRC13:20
johnthetubaguyOK...13:21
johnthetubaguydoes the PCI device get attached to the VM?13:21
baoliJohn, yes.13:21
johnthetubaguyhmm, OK13:21
irenabjohn: both macvtap and direct are network interfaces on PCI device13:21
johnthetubaguyOK13:21
johnthetubaguyseems like we need that then13:22
irenabdirect required vendor driver in the VM and macvtap doesn't13:22
baoliirenab, I think it's the opposite13:22
baoliIrenab, sorry,. you are right13:22
johnthetubaguyso, as a user, I don't want to type all this stuff in, let me suggest something...13:22
johnthetubaguythe user wants a nic-flavor right?13:23
johnthetubaguydefaults to whatever makes sense in your cloud setup13:23
baoliJohn, we have a special case in which th euser doesn't need to type it13:23
irenabjohn: exactly13:23
johnthetubaguybut if there are options, the user picks "slow" or "fast" or something like that13:23
johnthetubaguyso I would expect to see...13:24
johnthetubaguynova boot --flavor m1.large --image <image_id>13:24
johnthetubaguy                          --nic net-id=<net-id>,vnic-flavor=<slow | fast | foobar> <vm-name>13:24
johnthetubaguyvnic-type is probably better than flavor I guess13:25
baoliJohn, we don't want to add QoS to this yet, which is a separate effort13:25
johnthetubaguynova boot --flavor m1.large --image <image_id>13:25
johnthetubaguy                          --nic net-id=<net-id>,vnic-type=<slow | fast | foobar> <vm-name>13:25
baoliBut I guess that you can do that13:26
johnthetubaguythis isn't QoS...13:26
johnthetubaguyslow = virtual13:26
johnthetubaguyfast = PCI passthrough13:26
heyonglithis mean vnic-type contain vnic-type=macvtap in it?13:26
*** safchain has joined #openstack-meeting-alt13:26
irenabjohn: agree on this13:26
johnthetubaguyheyongli, the concept represented by vnic-type would include such settings, yes13:27
johnthetubaguyso do we all agree on this:13:27
johnthetubaguynova boot --flavor m1.large --image <image_id>13:27
johnthetubaguy                          --nic net-id=<net-id>,vnic-type=<slow | fast | foobar> <vm-name>13:27
heyonglii'm ok with it.13:27
irenabjohn: missing here the 'pointer' to the pool of  PCI devices13:27
*** jcoufal_ has joined #openstack-meeting-alt13:28
baoliJohn, how do you define vnic-type?13:28
*** jcoufal has quit IRC13:28
johnthetubaguywell, thats the question13:28
johnthetubaguyvnic-type is the user concept13:28
johnthetubaguywe need to map that to concrete settings13:28
johnthetubaguybut before we get there, are we OK with the theory of that user facing command?13:28
baoliour original idea was to define a type of vnic that a user would attach its VM to13:29
johnthetubaguyright, thats what I am suggesting here I think...13:29
baoliCan we classify the VNICs to have types of virtio, pci-passthorugh without macvtap, pci-passthourgh with macvta[13:30
baolisorry, macvtap13:30
johnthetubaguythe user doesn't care about all that, thats an admin thing, I think13:30
johnthetubaguythe user cares about the offerings, not the implementation13:30
johnthetubaguyat least, thats our general assumption in the current APIs13:31
irenabjohn: I guess user will be charged differently depending what vnic he has, so probably he should be aware13:31
irenabbut logically it should have names meaningful to the user and not technical13:31
johnthetubaguyexactly13:31
baoli#agreed13:32
johnthetubaguylogical names, the users case which one, but they care about the logical name13:32
johnthetubaguycool… I don't really care what that is, but this works for now I think...13:32
johnthetubaguyboot --flavor m1.large --image <image_id> --nic net-id=<net-id>,nic-type=<slow | fast | foobar> <vm-name>13:32
johnthetubaguyI removed the "v" bit, it seems out of place, but we can have that argument laters13:33
irenabstill missing here binding to the PCI devices that allowed for this nic13:33
baoli#agreed13:33
johnthetubaguyirenab: yes, lets do that in a second13:33
johnthetubaguynow one more question...13:33
johnthetubaguyif we have the above, I think we also need this...13:34
johnthetubaguynova boot --flavor m1.large --image <image_id> --nic port-id=<port-id>13:34
johnthetubaguyi.e. all the port settings come from neutron13:34
johnthetubaguywhich means...13:34
baoliJohn, yes.13:34
johnthetubaguywe probably need this13:34
*** xuhanp has joined #openstack-meeting-alt13:34
johnthetubaguyquantum port-create --fixed-ip subnet_id=<subnet-id>,ip_address=192.168.57.101 <net-id> --nic-type=<slow | fast | foobar>13:34
baoliwe had it described in our doc13:34
irenabjohn: yes, it will be added with the same nic-type attribute13:35
johnthetubaguycool, appolgies for repeating the obvious13:35
johnthetubaguyjust want to get agreement13:35
irenabagree13:35
heyongliagree13:35
johnthetubaguycool, so does this look correct:13:35
johnthetubaguyhttps://wiki.openstack.org/wiki/Meetings/Passthrough#The_user_view_of_requesting_things13:35
irenabjohn: its neutron :)13:36
johnthetubaguyagree, just want to make sure13:36
johnthetubaguyI have little knowlege of neutron these days, but that seems to make sense13:36
johnthetubaguycool13:36
baolioverall, it looks good13:37
johnthetubaguyso how do we get a mapping from nic-type to macvtap and pci devices13:37
johnthetubaguyI vote macvtap goes into the alias13:37
johnthetubaguyis that crazy?13:37
heyongli+113:37
irenabjohn: do you suggest it to work with flavor?13:37
johnthetubaguyirenab: not really, at least I don't think so13:38
johnthetubaguyirenab: sounds like info that the VIF driver needs13:38
irenabso what do you mean by goes into alias?13:38
johnthetubaguya good question...13:38
heyonglialias map the nic-type to contain information needed.13:39
heyonglithis means the vnic type is one kind of alias13:39
*** jtomasek_ has quit IRC13:39
johnthetubaguypci_alias='{"name":"Cisco.VIC","vendor_id":"1137","product_id":"0071", "nic-type":"fast", "attach-type":"macvtap"}'13:39
heyongli+113:40
johnthetubaguywith nic-type and attach-type as optional, its not that sexy, but could work I think...13:40
irenabnot good...13:40
baolino good13:40
irenabthis definition makes it static13:40
johnthetubaguypci_alias_2='{"name":"Cisco.VIC.Fast","vendor_id":"1137","product_id":"0071", "nic-type":"faster", "attach-type":"direct"}'13:40
heyongliwhat do you mean static?13:40
johnthetubaguyuser chooses "fast" or "faster"13:41
irenabit comes to my previous question regarding pool of available PCI devies for the vnic13:41
johnthetubaguydoes that work?13:41
irenabseems you define all of this as part of the alias13:41
johnthetubaguyat the moment, yes13:41
baoliJohn, if we have done the user's point of view, can we go over the the original post?13:42
*** jtomasek has joined #openstack-meeting-alt13:42
johnthetubaguybaoli: sure, that probably makes sense13:42
baoliThanks, john13:43
irenabIf we want a VM be connected to 3 networks: one via SRIOV direct, one with SRIOV macvtap and one with virtio, how it will be done?13:43
johnthetubaguythis is now13:44
johnthetubaguyone sec...13:44
baoliThanks Irenab to bring that up13:44
*** balajiiyer1 has joined #openstack-meeting-alt13:44
johnthetubaguynova boot --flavor m1.large --image <image_id> --nic net-id=<net-id>,nic-type=fast --nic net-id=<net-id>,nic-type=faster  <vm-name>13:45
johnthetubaguy•pci_alias='{"name":"Cisco.VIC", devices:[{"vendor_id":"1137","product_id":"0071", address:"*"}],"nic-type":"fast", "attach-type":"macvtap"}'13:45
johnthetubaguy•pci_alias_2='{"name":"Cisco.VIC.Fast",devices:[{"vendor_id":"1137","product_id":"0071", address:"*"}],"nic-type":"faster", "attach-type":"direct"}'13:45
heyonglijohn, agree13:45
johnthetubaguyhang on, we missed regular...13:45
johnthetubaguynova boot --flavor m1.large --image <image_id> —nic net-id=<net-id-1> —nic net-id=<net-id-2>,nic-type=fast --nic net-id=<net-id-3>,nic-type=faster  <vm-name>13:46
irenabjohn: we need the devices that provide network connectivity, how it is going to happen?13:47
johnthetubaguyright, we haven't covered how we implement it13:47
johnthetubaguyjust how the user requests it13:47
johnthetubaguyirenab: is that OK for the user request?13:48
heyonglithis will works smooth for pci,  per my opinion,  and the connectivity is also can be a spec of alias13:48
irenabjohn: if youer has both cisco and mellanox nics, it will have to define cisco_fast and mellanox_fast ...13:48
johnthetubaguyirenab: correct13:48
*** balajiiyer1 has quit IRC13:48
johnthetubaguyunless13:48
johnthetubaguyyou want them to share...13:48
baoliJohn, when you say user, you mean the final user or someone providing the service13:48
*** yamahata has joined #openstack-meeting-alt13:49
johnthetubaguywell we are only really doing the end user at the moment13:49
johnthetubaguybe we should do the PCI alias stuff for the deployer13:49
johnthetubaguyhmm...13:49
*** yamahata has quit IRC13:50
johnthetubaguypci_alias_2='{"name":"Fast",devices:[{"vendor_id":"1137","product_id":"0071", address:"*","attach-type":"direct"}, {"vendor_id":"123","product_id":"0081", address:"*","attach-type":"macvtap"}],"nic-type":"faster", }'13:50
johnthetubaguydoes that work better?13:50
*** yamahata has joined #openstack-meeting-alt13:51
irenabI am not the fan of this alias defintions, but waiting to see how we resolve the network connectivity to agree13:51
heyonglijohn: just define the pci_alias_2 2 time is works now13:51
johnthetubaguyirenab: what do you mean: "resolve network connectivity"?13:51
baoliJohn, we are trying to avoid alias on the controller node13:51
baolifirst of all13:51
sadasujohn: the cisco vic and the mellanox vic could be connected to diff networks13:51
sadasuso they cannot be part of the same alias13:52
*** doug_shelley66 has quit IRC13:52
johnthetubaguyright, thats OK still though, I think13:52
baoliI don't think anyone using pci cares about vendor id, whatsoever13:52
sadasuthen both of them would seem equivalent at the time of nova boot13:52
johnthetubaguybaoli: that is a deployer option13:52
irenabhow do we make VM  to land on the node with PCI devices connecting to the correct provider-network and correct  PCI device be allocated13:52
*** sballe has joined #openstack-meeting-alt13:52
johnthetubaguyirenab: OK, thats the scheduling issue then?13:53
*** lblanchard has joined #openstack-meeting-alt13:53
irenabjohn: agree, but I think that input comes from the nova boot command13:53
irenabeither in flavor or --nic13:54
johnthetubaguyright, so let me ramble on about how I see this working… I know its not ideal13:54
johnthetubaguyso, user makes request13:54
*** llu-laptop has joined #openstack-meeting-alt13:54
johnthetubaguynova looks for required pci devices13:54
johnthetubaguyflavor extra specs or network_info might have them13:55
irenabjohn: missing scheduler13:55
johnthetubaguywe get a list of required alias13:55
*** tianst has joined #openstack-meeting-alt13:55
johnthetubaguythe scheduler can look at the required alias13:55
johnthetubaguyand filters out hosts that can't meet the requests for all the requested devices13:56
johnthetubaguyi.e. thats some scheduler filter kicking in13:56
johnthetubaguywhen the requests gets to the compute node13:56
johnthetubaguytalks to resource manager to claim the resource as normal13:56
*** hartsocks has joined #openstack-meeting-alt13:57
johnthetubaguycompute node sends updates the the scheudler on what devices are available (we can sort out format later)13:57
johnthetubaguywhen VM is setup...13:57
johnthetubaguycreate domain13:57
johnthetubaguyadd any requested devices in the flavor extra specs13:57
johnthetubaguywhen plugging vifs13:57
johnthetubaguyvif driver gets extra PCI device info13:57
johnthetubaguyit also gets some lib that points back to nova driver specific ways of plugging PCI devices, and does what it wants to do13:58
johnthetubaguymaybe13:58
johnthetubaguyanyways, that was my general thinking13:58
*** shanewang has joined #openstack-meeting-alt13:58
heyonglijohn: currently pci works in this way, almost13:59
irenabjohn: I have to admit I do not see how networking part is resolved ...13:59
baoliHi John, I think that's how it works today. But we need to resolve network connectivity issue as Irenab has pointed out. We need a PCI device that connects to a physical net13:59
johnthetubaguywell VIF driver gets its config from neutron in regular way13:59
johnthetubaguycombined with PCI alias info from nova14:00
johnthetubaguyit should be able to do what it needs to do14:00
johnthetubaguyat least thats my suggestion14:00
heyonglijohn: yep, this is also can reslove connectivity problem14:00
*** dprince has joined #openstack-meeting-alt14:00
*** balajiiyer1 has joined #openstack-meeting-alt14:00
johnthetubaguyanyways14:01
*** dripton has joined #openstack-meeting-alt14:01
johnthetubaguyits probably the nova meeting on here now14:01
baoliTime is up. Do you guys want to end the meeting soon?14:01
*** PaulMurray has joined #openstack-meeting-alt14:01
irenabjohn: PCI alias does not put any info regarding connectivity according to waht you defined previously14:01
*** jdob has joined #openstack-meeting-alt14:01
heyongliirenab: we can extend it14:01
*** ndipanov has joined #openstack-meeting-alt14:01
johnthetubaguyirenab: agreed, that has to come from neutron, in my model14:01
shanewangyes, nova meeting14:01
johnthetubaguyhyongli: its the nova meeting14:01
irenabit can be several mellanox NICs but only one conecting to the physicla network14:01
*** gilliard has joined #openstack-meeting-alt14:01
baoli#endmeeting14:01
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"14:01
openstackMeeting ended Thu Jan  9 14:01:54 2014 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)14:01
openstackMinutes:        http://eavesdrop.openstack.org/meetings/pci_passthrough/2014/pci_passthrough.2014-01-09-13.00.html14:01
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/pci_passthrough/2014/pci_passthrough.2014-01-09-13.00.txt14:01
openstackLog:            http://eavesdrop.openstack.org/meetings/pci_passthrough/2014/pci_passthrough.2014-01-09-13.00.log.html14:02
russellb#startmeeting nova14:02
irenabcan we discuss on openstack-dev next steps for few mins?14:02
openstackMeeting started Thu Jan  9 14:02:27 2014 UTC and is due to finish in 60 minutes.  The chair is russellb. Information about MeetBot at http://wiki.debian.org/MeetBot.14:02
*** jtomasek_ has joined #openstack-meeting-alt14:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.14:02
*** openstack changes topic to " (Meeting topic: nova)"14:02
openstackThe meeting name has been set to 'nova'14:02
russellbHello everyone!14:02
*** jtomasek has quit IRC14:02
*** garyk has joined #openstack-meeting-alt14:02
hartsockswhee!14:02
russellband welcome to the first 1400 UTC nova meeting14:02
llu-laptopah, nova is here :)14:02
johnthetubaguyhi14:02
driptonhi14:02
garykhi14:02
PaulMurrayhi14:03
russellb#topic general14:03
shanewanghi14:03
*** openstack changes topic to "general (Meeting topic: nova)"14:03
llu-laptophi14:03
russellbso, we're alternating meeting times for now14:03
*** mriedem has joined #openstack-meeting-alt14:03
mriedemhi14:03
russellbwe'll see how it goes.  as long as this is attended well, we'll keep it14:03
shanewangand meeting channel.14:03
russellbyeah and channel, oops14:03
russellbi'll update the wiki about that14:03
russellbsome general things first ...14:03
russellbnova meetup next month14:04
russellb#link https://wiki.openstack.org/wiki/Nova/IcehouseCycleMeetup14:04
russellbbe sure to sign up so we know you're coming14:04
*** balajiiyer1 has quit IRC14:04
russellbif you're able14:04
* johnthetubaguy is looking forward to it14:04
russellbmy thinking on the schedule for that was to ... not really have a strict one14:04
russellbperhaps having unconference in the mornings, and open afternoons to just hack on things together14:04
russellbthat could be working through tough bugs, design, whatever14:04
johnthetubaguythat sounds quite good14:05
hartsocksI like that.14:05
*** noslzzp has joined #openstack-meeting-alt14:05
russellbok great14:05
russellbso we'll plan on that for now then14:05
russellbwhich isn't much of a plan14:05
russellbmore of a plan to not plan too much14:05
johnthetubaguyin unconference u can gather friends for the afternoon I guess14:05
russellbsure14:05
johnthetubaguymaybe an etherpad to collect ideas?14:05
russellbthat's be good14:05
russellbif anyone creates one before me, just link it from that wiki page14:05
*** mspreitz has joined #openstack-meeting-alt14:05
mriedemyeah, i could move my notes to etherpad14:05
russellbmriedem: perfect14:06
garykhow many people are expected?14:06
russellbi'll check14:06
russellb20 registered so far14:07
*** BrianB_ has quit IRC14:07
*** ndipanov has quit IRC14:07
mriedem+1 hopefully soon14:07
russellbwe have space for a lot more than that :)14:07
russellbshould be fun14:07
russellbok, another thing ....14:07
russellbplease put january 20th on your schedule14:07
russellbgate bug fix day14:07
garykthanks, and one last question: will there be any chance to connect from remote?14:07
russellbwe really, really, really need to step it up on that front14:07
russellbgaryk: maybe ... hadn't thought about it.  we could try hangouts or something14:08
shanewanggaryk:+114:08
garyka hangout is a great idea14:08
russellbwe can do that at least for the unconference part14:08
russellbthe rest may not work well14:08
johnthetubaguywell, should be on IRC for the rest I guess14:08
russellbtrue14:08
hartsocksIs this Foo Camp (or Bar Camp) style unconference?14:08
russellbwell ...14:09
*** amotoki has quit IRC14:09
russellbi don't know about doing pitches and voting14:09
russellbother than maybe on etherpad14:09
hartsocksokay.14:09
russellbi'm not sure we'll have *that* much demand for the time that we have to formally rank stuff14:09
*** eankutse has joined #openstack-meeting-alt14:09
*** irenab has quit IRC14:09
russellbjust a guess though14:09
russellbi may just be a dictator on the schedule based on proposals14:09
russellb:-p14:09
johnthetubaguy+1 we give you a veto on a session14:10
russellbheh14:10
russellbok onward14:10
russellb#topic sub-teams14:10
*** openstack changes topic to "sub-teams (Meeting topic: nova)"14:10
llu-laptopis Jan 20th appropriate for gate bug squash? is  23rd the icehouse-2?14:10
russellbanyone want to give a report on what a sub-group has been working on?14:10
*** luqas has joined #openstack-meeting-alt14:10
russellbllu-laptop: we'll come back to that in a bit14:10
* johnthetubaguy raises hand a little14:10
russellbjohnthetubaguy: go for it14:11
*** eankutse has quit IRC14:11
garykwill you bring denis rodman as a side kick?14:11
johnthetubaguySo we are working on getting XenServer images into the node pool14:11
*** heyongli has quit IRC14:11
johnthetubaguythen getting Zuul testing stuff on XenServer14:11
*** coolsvap has joined #openstack-meeting-alt14:11
russellbjohnthetubaguy: that's great to hear, good progress?14:11
johnthetubaguyslow progress, and infra-review welcome14:11
johnthetubaguyyeah, its really just not getting reviewed at the moment, but it was over christmas I guess14:12
russellbconfident that it's still good icehouse timeframe material?14:12
johnthetubaguymatel is working on it14:12
russellbok, yeah, holidays put a big delay on everything14:12
russellbnova queue is still recovering from holidays, too14:12
johnthetubaguyrussellb: it should be / better be14:12
*** ndipanov has joined #openstack-meeting-alt14:12
*** antigluk has joined #openstack-meeting-alt14:12
russellbcool14:12
johnthetubaguyat least tempest is running well on XenServer14:12
russellbexcellent14:13
johnthetubaguyCitrix did some good work on that14:13
johnthetubaguyso, its more a wire up into Zuul exercise14:13
*** julim has joined #openstack-meeting-alt14:13
johnthetubaguyand get an image in rackspace that has XenServer + Devstack domu14:13
johnthetubaguywhich is done, just needs more testing, etc14:13
russellbi think that's a cool approach btw, hooking your nodes into infra14:13
russellbinstead of running your own zuul/jenkins/etc14:14
johnthetubaguyyeah, fingers crossed14:14
russellbso, i saw you in a PCI discussion before this meeting :)14:14
johnthetubaguyyeah, thats true14:15
russellbwhat's going on with that14:15
johnthetubaguyI think we agreed on what the user requests could be14:15
johnthetubaguywaiting to here from ijw on confirming that though14:15
johnthetubaguyI wrote up some stuff here:14:15
*** eankutse has joined #openstack-meeting-alt14:15
johnthetubaguyhttps://wiki.openstack.org/wiki/Meetings/Passthrough#New_Proposal_for_admin_view14:15
*** eankutse has quit IRC14:15
*** eankutse has joined #openstack-meeting-alt14:15
johnthetubaguyThe final interactions between Nova and Neutron are less clear to be honest14:15
johnthetubaguybasically we keep this:14:16
johnthetubaguynova boot --image some_image --flavor flavor_that_has_big_GPU_attached some_name14:16
johnthetubaguywe add this:14:16
garykare there people from neutron involved here?14:16
johnthetubaguynova boot --flavor m1.large --image <image_id> --nic net-id=<net-id>,nic-type=<slow | fast | foobar> <vm-name>14:16
johnthetubaguygaryk: possible, but not enough I don't think14:16
johnthetubaguy(where slow is a virtual connection, fast is a PCI passthrough, and foobar is some other type of PCI passthrough)14:17
garyki know that there are a lot of dicussion that the melanox, intel, cisco etc are having14:17
johnthetubaguyI kinda see it like nova volumes14:17
shanewangI believe cisco guys are from neutron?14:17
johnthetubaguygaryk: those are the folks I was talking14:17
johnthetubaguyjust didn't see any non-vendor types14:17
garykjohnthetubaguy: thanks.14:17
garykwill the nic_type have a 'type of service' or be a set of k,v pairs?14:18
johnthetubaguythats all TBC14:18
garykok, thanks14:18
johnthetubaguyjust wanted to make sure the user didn't need to know about macvtap, or whatever it is14:18
johnthetubaguyI see it like the user requesting volume types14:18
russellbglad to see some stuff written down, and thanks a bunch for helping with this14:18
garykmaybe it is something worth looking into placing it in a flavor - for example someo gets gold service14:19
johnthetubaguyno worries, seems to be getting somewhere14:19
garykthey could have better connectivity, storage etc.14:19
johnthetubaguywe have some guys from bull.net working on adding PCI passthrough into XenAPI too14:19
johnthetubaguythe reaon I don't like flavor is due to this:14:19
johnthetubaguynova boot --flavor m1.large --image <image_id> --nic net-id=<net-id-1> --nic net-id=<net-id-2>,nic-type=fast --nic net-id=<net-id-3>,nic-type=faster <vm-name>14:19
garykthat is, we introduce a notion of service levels14:19
johnthetubaguyyeah, I flip flop on this14:20
johnthetubaguyI like flavor being the main thing that gives you what you charge14:20
*** tomblank has joined #openstack-meeting-alt14:20
johnthetubaguybut you can dymanically pick how many nics you want anyways14:20
johnthetubaguylets see how it works out anyways14:20
johnthetubaguyone question on all this...14:21
russellbok, any other sub-team reports?14:21
* russellb waits14:21
hartsocksI have a short one.14:21
johnthetubaguyI wonder about moving PCI alias to host aggregates14:21
johnthetubaguyso its more dynamic, rather than in nova.conf14:21
russellbyeah, definitely prefer things to be API driven than config driven where we can14:21
johnthetubaguyOK, I was thinking the same, just wanted to check14:22
russellbsometimes config is a much easier first revision14:22
russellband that's OK14:22
garykit could be: nova boot --flavor m1.large … —service_type gold14:22
garykthen the scheduler could take this into account and assign a host that can provide that service14:22
garykyeah, i can give a scjedulre update14:22
garykscheduler update if n0nao is not around14:22
garykjohnthetubaguy: yeah, host aggregates could be a soln14:22
russellbbut makes sense to move to an API later14:22
johnthetubaguyyeah, they have some stuff on config already14:22
garyki am in favor of the api.14:23
johnthetubaguyI am kinda trying to just agree what the config should be yet, so thats not a big deal just yet :)14:23
* russellb nods14:23
russellbok, hartsocks go for it14:23
johnthetubaguycool, sorry14:23
johnthetubaguyI am all done...14:23
russellball good :)14:23
russellbgood stuff14:23
*** SergeyLukjanov has joined #openstack-meeting-alt14:23
hartsocksJust wanted to say we're looking to get a few bug fixes in for our driver.14:24
hartsocksThose affect the CI stability on Minesweeper.14:24
hartsocksI've spammed the ML about priority order on these.14:24
hartsocksAlso14:24
hartsocks http://162.209.83.206/logs/58598/7/14:24
russellblogs!14:25
hartsockstada14:25
hartsockshttp://162.209.83.206/logs/14:25
russellbexcellent14:25
*** matty_dubs|gone is now known as matty_dubs14:25
garykThere is a etherpad that has all of the vmware I2 issues - https://etherpad.openstack.org/p/vmware-subteam-icehouse-214:25
hartsocksWe're not confident in the infra's stability yet to do the −1 votes.14:25
hartsocksgaryk: thank you, I posted those in the ML post earlier too.14:26
russellbhartsocks: are you planning to move to testing all nova changes at some point?14:26
hartsocksWhen we can plug the session management issues...14:26
russellbok, so eventually, that's fine14:26
hartsocks… and an inventory issue we have when adding ESX hosts.14:27
johnthetubaguyis it worth targeting those bugs at I-2, or did you do that already?14:27
hartsocksEventually will be sooner if we can get more reviews?14:27
russellbheh14:27
mriedemthe donkey and the carrot14:27
russellblike i said earlier, nova queue seems to be still recovering from the holidays14:27
hartsocksI'll double check all the listed bugs today.14:27
hartsocks:-)14:27
hartsocksI've said my bit.14:27
garykminesweeper is doing the following: nova and neutron14:27
garykhere is a list - https://review.openstack.org/#/dashboard/900814:27
russellbyou guys do seem to be high on these lists ... http://russellbryant.net/openstack-stats/nova-openreviews.html14:28
russellbok, garyk did you have scheduler notes?14:28
hartsocksyeah, kind of aware of that.14:28
garykrussellb: yes14:29
garyk1. the gantt tree  for the forklift is ready but still are waiting to do development there14:29
garykthe goal will be to cherry pick changes14:29
russellbgreat14:30
garykfir all those that are not aware gantt is the forklift of the scheduler nova code to a sperate tree14:30
garyk2. we spoke yestertday to move the existing scheduler code to support objects (i am posting patches on this) so that the transition to an external scheduler may be easirer14:30
russellbso priorities: 1) keep in sync with nova, 2) get it running as a replacement for nova-scheduler, with n o new features14:30
russellbyeah that'd be nice14:31
*** jecarey has quit IRC14:31
garykthats about it at the moment.14:32
garykdon dugger did great work with gantt and all the others in infra. kudos to them14:32
johnthetubaguyor use object support to test (1) keep in sync with nova?14:32
*** vponomaryov has joined #openstack-meeting-alt14:32
garykyeah. hopefully. we still have instance groups in deveopment - pending API support and a few extra filters in the works14:32
garykthe idea of the object support is to remove the db access from the scheduler. this can hopefully leverage the objects that can work with deifferent versions14:32
*** doug_shelley66 has joined #openstack-meeting-alt14:33
russellbdirect use of the db API at least?14:33
garykat the moment the changes we are making is in nova. hopefully these few patches may be approved and then cherry picked14:33
russellbnot using objects to talk to db through conductor right?14:33
* russellb assumes so14:34
garykyes, to talk to the db via conductor.14:34
russellbwell, we don't want gantt calling back to nova14:34
russellbso that won't work ...14:34
shanewanggaryk: can you point me the patchset?14:34
russellbbesides, i thought we were going with the no-db-scheduler blueprint for that14:34
russellbbasically not using the db at all anymore14:35
russellband just giving it a cache and sending it data to update the cache over time14:35
shanewangthat is what boris-42 is doing.14:35
russellbright14:35
russellbok, onward for now14:36
russellb#topic bugs14:36
*** openstack changes topic to "bugs (Meeting topic: nova)"14:36
russellb193 new bugs14:36
russellbbeen staying roughly level lately14:36
johnthetubaguydo we have any cool stats of the bugs yet?14:37
russellbwell, last month or so anyway14:37
russellbhttp://webnumbr.com/untouched-nova-bugs14:37
garykwhy? can you please clarify14:37
garykthose patch sets for the 'no db' support have drivers where the one example is a sql alchemy one (unless i am misunderstanding)14:37
garykthat is for the host data.14:37
garykthere is the instance data that needs to be updated14:37
ndipanovrussellb, so we are cool with those patches14:37
ndipanovrussellb, oookay14:37
russellbnot sure if my connection is messed up or what, i just caught a bunch of stuff from garyk and ndipanov ... sorry, wasn't trying to ignore you guys14:37
johnthetubaguy+114:38
russellbso, also on bugs, https://launchpad.net/nova/+milestone/icehouse-214:38
russellblots of stuff targeted to icehouse-214:38
russellbthe most concerning parts are all of the critical ones14:38
russellbwe're the biggest gate failure offender right now14:38
russellband pitchforks are coming out14:38
russellbso we really need to put time into this14:39
*** markmcclain has quit IRC14:39
russellbjanuary 20 was proposed as a gate bug fix day by sdague14:39
russellbwhich is great, but we shouldn't wait until then14:39
russellbi'm trying to clear off my plate so i can start focusing on these bugs14:39
russellbanyone interested in working with me and others on these?14:40
johnthetubaguyI am traveling next week I am afraid :(14:40
russellbi'll allow it :)14:40
russellbwell if anyone has some time available, please talk to me14:40
russellbi'm going to try to start organizing a team around these bugs14:40
garyki am happy to work on bugs14:41
russellbthese gate bugs are starting to *massively* impact the gate for everyone14:41
russellbgate queue got over 100 yesterday, approaching over 24 hours for patches to go through14:41
russellbbecause of so many resets14:41
*** eharney has joined #openstack-meeting-alt14:41
russellb65 patches deep right now14:41
russellb#link http://lists.openstack.org/pipermail/openstack-dev/2014-January/023785.html14:42
russellbgaryk: great, i'll be in touch14:42
ndipanovI'll look into some too next week I hope14:42
garykregarding the bugs - i wanted us to try and formalize the VM diagnostics and then try and log this information when there is a gate failure - https://wiki.openstack.org/wiki/Nova_VM_Diagnostics14:43
*** matty_dubs has left #openstack-meeting-alt14:43
*** GheRiver1 is now known as GheRivero14:43
mriedemwell, any tempest failure14:43
garykthat is, looking at VM diagnostics may help isolate the cause of issues - at least let us know if it was related to the VM, network ir storage14:43
garykyeah, tempest failures14:43
russellbgaryk: that's a good idea14:43
russellbthe more data we can collect on failures the better, really14:43
russellbok, next topic14:44
mriedemdansmith had some ideas on debugging the nova-network related large ops one yesterday14:44
mriedemwe should talk to him today about that14:44
russellbmriedem: sounds good!14:44
russellb#topic blueprints14:45
*** openstack changes topic to "blueprints (Meeting topic: nova)"14:45
russellb#link https://launchpad.net/nova/+milestone/icehouse-214:45
russellbif you have a blueprint on that list, please make sure the status is accurate14:45
russellbor rather, "Delivery"14:45
mriedeminstance type -> flavor will move to i314:45
russellbwe're going to start deferring "Not Started" blueprints soon to icehouse-314:45
russellbmriedem: ok go ahead and bump it14:45
mriedemdone14:46
*** balajiiyer has joined #openstack-meeting-alt14:46
russellbso another blueprint issue ... i've greatly appreciated the team effort on blueprint reviews, that has worked well14:46
russellbhowever, our idea for doing nova-core sponsors for blueprints has been a flop14:46
russellbnobody is doing it14:46
russellband so virtually everything is Low14:46
russellband that's not really much better than before14:46
ndipanovrussellb, what if the status is inaccurate?14:46
russellbndipanov: change it :-)14:46
russellbif it's yours you should be able to change it, if not, ask me (or someone on nova-drivers)14:47
*** balajiiyer has quit IRC14:47
mriedemit takes 2 cores to move from Low, i see some bps with 1 sponsor - maybe move to 1 sponsor?14:47
ndipanovrussellb, done thanks14:47
*** balajiiyer has joined #openstack-meeting-alt14:47
mriedem1 +2 doesn't get the patches merged though14:47
russellbright14:47
russellbthat's why we were requiring 214:47
johnthetubaguyyeah, I think 2 is correct14:47
*** hagarth has joined #openstack-meeting-alt14:48
johnthetubaguyI sponsor the odd patch in the hope someone else joins me14:48
russellbwe can either stick with this plan, and try to promote it better14:48
russellbor just punt the whole thing and start trying to sort them based on opinion14:48
*** hagarth has left #openstack-meeting-alt14:48
russellbjohnthetubaguy: yeah, i think you and dansmith have done some of that, not many others14:48
*** jecarey has joined #openstack-meeting-alt14:48
*** vbellur has joined #openstack-meeting-alt14:48
garykhow can we get core people interested in blueprints? there are ~25 bp's that are waiting review and are all low.14:48
johnthetubaguywell, I think it reflects the current reality of the review rate though14:49
garykso that means none are sponsored…. i just feel that a very small percentage of these may even get review cyces14:49
russellbjohnthetubaguy: perhaps14:49
*** xyang1 has joined #openstack-meeting-alt14:49
russellbif the vast amount of Low is actually a reflection of our review bandwidth, then we have a whole different problem14:49
russellbi guess the question is ... how many Low blueprints land14:49
johnthetubaguymaybe worth a quick reminder email to nova-core?14:49
russellbhere's the icehouse-1 list https://launchpad.net/nova/+milestone/icehouse-114:49
russellbjohnthetubaguy: yeah, guess we can try that and see14:50
russellbbecause i still really like the theory behind it :)14:50
*** NehaV has joined #openstack-meeting-alt14:50
russellbbetter tooling could help too14:50
russellbif looking over these was a more natural part of dev workflow14:50
russellbbut that's not a short term fix14:50
johnthetubaguyyeah, to tools could be a lot better, auto adding people to reviews, etc14:51
mriedemi wish the gd whiteboard textarea had timestamps14:51
mriedemand audited for who left the comment14:51
russellbyes the whiteboard sucks14:51
garyki must be honest it is concerning. ~10 landed and some were just minor issues like configration options14:51
johnthetubaguy+114:51
johnthetubaguy+1 to the whiteboard14:51
russellbicehouse-1 isn't the best example ... icehouse-1 snuck up really fast14:51
russellbso it just happened to be what could land very fast14:51
johnthetubaguytrue, it was short14:51
mriedemi1 was also summit time14:51
johnthetubaguyhavana-2?14:51
russellbright14:51
mriedemh2 didn't have the new model14:52
russellbwell havana wasn't using this approach, yeah14:52
garykand i-2 had xmas and new years. i guess that also has a part. but we are a couple of weeks away and there is a meetup in the middle14:52
russellbthat was prioritized based on my opinion largely :-)14:52
johnthetubaguyindeed, just curious on general throughput14:52
*** jtomasek_ has quit IRC14:52
hartsockspersonally, my excuse is we had a baby.14:52
hartsocks:-)14:52
russellbhartsocks: heh, that'll be me for Juno14:52
mriedemhartsocks: plan  9 months ahead next time14:53
russellblife happens14:53
*** banix has joined #openstack-meeting-alt14:53
hartsocksmriedem: lol14:53
mriedemsorry honey....14:53
russellbjohnthetubaguy: unfortunately we can't see the h2 list now ...14:53
russellbjohnthetubaguy: after the final release everything gets moved to the big havana list14:53
johnthetubaguyyeah, didn't work for me either, old reassignment thing14:53
mriedemi think to get eyes on blueprints, and sponsors, people need to show up to the meeting and bring them up14:53
*** jtomasek has joined #openstack-meeting-alt14:54
russellbheh14:54
russellbwell on that note ...14:54
mriedemthe new meeting time should help that14:54
russellb#topic open discussion14:54
*** openstack changes topic to "open discussion (Meeting topic: nova)"14:54
russellbopen discussion is a good time to ask for eyes on things14:54
mriedemmeetup etherpad: https://etherpad.openstack.org/p/nova-icehouse-mid-cycle-meetup-items14:54
russellb mriedem great, add it to the wiki?14:54
mriedemsounds like hyper-v CI is coming along: http://eavesdrop.openstack.org/meetings/hyper_v/2014/hyper_v.2014-01-07-16.01.log.html14:54
mriedemrussellb: sure14:54
garykIf possible could people please comment on https://wiki.openstack.org/wiki/Nova_VM_Diagnostics14:54
mriedemi also posted to the ML14:54
russellbthanks14:54
russellbcool14:54
mriedemi'd like eyes on the 3 patches i have in this i2 bp that is moving to i3, these just need another +2: https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bp/flavor-instance-type-dedup,n,z14:55
mriedemwell, 2 patches, one is approved14:55
mriedemthey are just refactor14:55
russellbwonder how many blueprints aren't approved yet ... *looks*14:55
russellbhttps://blueprints.launchpad.net/nova/icehouse14:55
garykregarding the meetup - would it be possible that a day bew devoted to reviews of BP's? that is there will be a bunch of people together. Why not all get heads down and review BP's14:55
russellbnot bad, 7 waiting on a blueprint reviewer14:56
mriedemgaryk: i have bp review on the etherpad14:56
garyknot the proposed BP but the code14:56
garykmriedem: thanks!14:56
mriedemrussellb: also looking for approval on this https://blueprints.launchpad.net/nova/+spec/aggregate-api-policy14:56
mriedemcode looks ready14:56
russellbah, group code reviews, that could work14:56
*** Barker has joined #openstack-meeting-alt14:56
russellbmriedem: seems fine, approved14:57
*** jcorbin has joined #openstack-meeting-alt14:57
mriedemthanks14:57
mriedemanyone hear any status/progress on docker CI?14:57
johnthetubaguymaybe in utar we could get through the backlog a little?14:57
*** rraja has joined #openstack-meeting-alt14:57
mriedemsince they are adding sub-driver for LXC14:57
russellbwell, docker folks are not adding that14:58
russellbthat's zul14:58
*** achirko has joined #openstack-meeting-alt14:58
russellbjohnthetubaguy: yeah hope so, that'd be cool14:58
russellbre: docker CI, i've been in touch with them14:58
russellbthey are fully aware of the requirement14:58
russellband want to meet it, but haven't seen movement yet14:58
*** aostapenko has joined #openstack-meeting-alt14:58
russellbsounds like eric w. is taking over maintaining the docker driver in nova14:58
russellbdon't see him here14:58
mriedemok, i'm hoping to be pleasantly surprised with the hyper-v CI since it's been so quiet14:59
*** gregsfortytwo1 has joined #openstack-meeting-alt14:59
russellbyeah, but it was a nice surprise to see something get spun up14:59
mriedemyup14:59
garyka change in neutron broke their ci - they are out there :)14:59
russellbnice to see this all seem to come together14:59
*** bswartz has joined #openstack-meeting-alt14:59
russellboh right, i saw that email14:59
russellbdarn windows15:00
mriedemgaryk: yeah, i saw alex in -neutron the other day15:00
mriedemtalking about it15:00
*** scottda has joined #openstack-meeting-alt15:00
*** caitlin56 has joined #openstack-meeting-alt15:00
russellbalright we're out of time15:00
russellb#openstack-nova is always open for nova chatter :)15:00
russellbthank you everyone!15:00
*** akerr has joined #openstack-meeting-alt15:01
russellbnext week we'll be back to 2100 UTC15:01
garykthanks for time! have a good weekend15:01
russellband alternating from there15:01
russellb#endmeeting15:01
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"15:01
openstackMeeting ended Thu Jan  9 15:01:13 2014 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:01
openstackMinutes:        http://eavesdrop.openstack.org/meetings/nova/2014/nova.2014-01-09-14.02.html15:01
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/nova/2014/nova.2014-01-09-14.02.txt15:01
openstackLog:            http://eavesdrop.openstack.org/meetings/nova/2014/nova.2014-01-09-14.02.log.html15:01
*** shanewang has quit IRC15:01
*** yportnova has joined #openstack-meeting-alt15:01
*** llu-laptop has left #openstack-meeting-alt15:01
*** mriedem has left #openstack-meeting-alt15:01
*** tianst has quit IRC15:01
bswartz#startmeeting manila15:01
openstackMeeting started Thu Jan  9 15:01:54 2014 UTC and is due to finish in 60 minutes.  The chair is bswartz. Information about MeetBot at http://wiki.debian.org/MeetBot.15:01
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.15:01
*** openstack changes topic to " (Meeting topic: manila)"15:01
openstackThe meeting name has been set to 'manila'15:01
*** yportnova__ has joined #openstack-meeting-alt15:02
bswartzgood morning/evening everyone15:02
*** yportnova__ has quit IRC15:02
caitlin56morning15:02
yportnovahi15:02
*** markmcclain has joined #openstack-meeting-alt15:02
vbellurhello15:02
achirkohello15:02
aostapenkoevening)15:02
vponomaryovhi15:02
rrajahi15:02
csabahi15:02
bswartzI can't wait until DST starts up again so this meeting can be later in the day15:02
scottdahello, and nice to meet you15:02
bswartzscottda: welcome!15:02
*** mspreitz has left #openstack-meeting-alt15:03
scottdathanks15:03
xyang1hi15:03
bswartzi hope everyone had an excellent holiday/new year15:03
bswartzsince we cancelled the last 2 meetings, it's been a while since we met15:03
vbellurbswartz: thanks, hope you had a good one too15:04
bswartzI had really hoped to have my illustrations/diagrams of manila ready before this meeting but sadly they're still at the stage of being a giant mess on my whiteboard15:04
*** betsy has joined #openstack-meeting-alt15:05
bswartzso that's something I'm working on resolving later today15:05
bswartzcaitlin56: I got your messages last week and I saw the diagram you drew up15:05
bswartzcaitlin56: unforatunately I didn't understand it :-(15:05
* caitlin56 volunteers to help with diagrams15:06
caitlin56Maybe we can go through it later in the day, or as on open topic.15:06
*** amytron has quit IRC15:06
bswartzanyways since the stuff I'm working on isn't ready yet, let's discuss the stuff that is actually going on15:06
bswartzcaitlin56: I definitely want to discuss with you -- possibly later in this meeting if there is any interest/time15:06
bswartz#topic development status15:07
*** openstack changes topic to "development status (Meeting topic: manila)"15:07
caitlin56bswartz: make sense, like you said dealing with already in progress development first makes sense.15:07
*** SushilKM has joined #openstack-meeting-alt15:07
bswartzyportnova: can you summarize the progress of the last few weeks for the team15:07
vponomaryovWe have two updates: (1) about network-API and (2) generic multitenant lvm driver15:07
yportnovabswartz: sure15:07
bswartzvponomaryov: or you can provide the update too15:08
*** SushilKM has left #openstack-meeting-alt15:08
vponomaryov1) https://blueprints.launchpad.net/manila/+spec/join-tenant-network:15:08
vponomaryovAfter testing realese candidate of network-API for manila, we found out, that it has lots of restrictions due to architecture of API.15:08
vponomaryovFor example, security services used to be set depending on protocol (nfs/cifs), but should be based on security service itself (ad, ldap, kerberos).15:08
vponomaryovAlso network-info entity used to have only one set of security service, but should be possible to set several, that will be used during share creation, when we choose protocol.15:08
vponomaryovSo, all of this leads us to change network API.15:09
vponomaryovSecurity service entity prototype described here:15:09
vponomaryovhttps://docs.google.com/a/mirantis.com/document/d/1KIFlOvI_o_641JWIIDIXevuke9IKmun34s4z1VptGPY15:09
vponomaryovThen, we will remake network-info to have multiple security-service entities15:09
vponomaryovEstimation for this: this and all next weak + testing and bugfixing.15:09
vponomaryovAfter successfull implementation, Manila will have relatively stable API.15:09
vponomaryov2) https://blueprints.launchpad.net/manila/+spec/generic-driver15:09
vponomaryovbefore incubation we need working multitenant generic driver, so this can be separated to 3 (three) parts:15:09
vponomaryov- cinder api (DONE) - https://review.openstack.org/#/c/65658/15:09
vponomaryov- nova api (TODO: Fast to do basing on cinder api)15:09
vponomaryov- driver, that uses methods, which speaks with cinder and nova (TODO)15:09
vbellurwhen we get to an important change in implementation, like changing the API, can we  start communicating on openstack-dev ML?15:10
bswartzvbellur: that's a good idea15:11
*** bill_az has joined #openstack-meeting-alt15:11
bswartzhowever I wouldn't want to update the ML until after the change has stabilized15:11
caitlin56yponomaryov: how do you associate a share with a security service?15:11
bswartzcaitlin56: you have to create the "network-info" first15:12
vponomaryovcaitlin56: security-service -> network-info -> share15:12
bswartzcaitlin56: and then you specify the ID of that when you create teh share15:12
*** bill_az_ has joined #openstack-meeting-alt15:12
bswartzevery share must have a network-info associated with it, even if the network info implies wide-open/no-security15:12
caitlin56So each share is part of a "network", each network has one security service?15:12
vponomaryovnetwork info can have sec services, but not mandatory15:13
vponomaryovfor neutron plugin, mandatory are net id and subnet id15:13
caitlin56network_info has 0 or 1 security service? or 0..N security services?15:13
vponomaryovnot 0_1, we plan do it 0_N15:14
vponomaryovas for security groups in nova15:14
vponomaryovs/not/now15:14
caitlin56So then how do you know which security service to use? One per protocol?15:14
vponomaryovshare creates with protocol15:14
vponomaryovfor protocol purposes will be choosen sec service15:15
*** bill_az has left #openstack-meeting-alt15:15
caitlin56So there is 0 or 1 security services for each network *and* protocol. right?15:15
vponomaryovfor now, yes15:15
jcorbinIs there a work flow diagram for configuring a share from start to finish?15:16
bswartzokay so this is where some documentation and a working example would be helpful15:16
bswartzplus i'm not convinced that "network-info" is the best term to use for what these things are15:16
*** sc68cal_ is now known as sc68cal15:17
*** sc68cal has joined #openstack-meeting-alt15:17
bill_az_diagram showing class relationships / cardinality would be helpful15:17
bswartzit's very hard to have an intelligent discussion about this stuff if we don't agree on terms15:17
caitlin56bswartz: agreed, network-info sounds like the logical network (vlan or whatever).15:17
caitlin56bill_az: ++15:17
jcorbinbswartz: +115:18
bswartzfor now, just understand that network-infos are things that exist in manila, and networks/subnets are things that exist in neutron15:18
caitlin56And there can be multiple manila "networks" within a single neutron network, correct?15:18
vponomaryovwe have choosen network-info, because we should choose some name15:18
bswartzmanila can associate 0-N network-infos with each subnet in neutron15:18
bswartzand each share has exactly 1 network-info15:19
vponomaryovcaitlin56: yes15:19
caitlin56What you are enabling is the mappping of a corporate intranet that has one network but different windows domains (one for HR, one for Engineering, etc.)15:20
bswartzcaitlin56: actually a VLAN corresponds to a neutron subnet15:20
bswartzwe could in principle have several network-infos for a single VLAN or subnet15:20
vponomaryovyes, but it is not good in architecture view15:20
bswartzimagine 2 AD domains running on the same subnet15:20
caitlin56Everyone in a manila-network uses the same security servcie to access shares (for a given protocol).15:21
bswartzcaitlin56: I'm not sure that's true15:21
bswartzin my above example (2 AD domains) you could have 2 vservers on the same subnet for a single tenant -- 1 part of each AD domain15:22
caitlin56bswartz: that's what I'm trying to nail down. What's the wildest configuration a customer can throw at me that I'll be expected to support.15:22
bswartzI ultimately expect that network-infos and vservers will correlate more or less 1-to-115:23
*** rwsu has joined #openstack-meeting-alt15:23
caitlin56But aren't those 2 separate AD domains a "manila-network"?15:23
bswartzexceptions will exist in 2 cases that I can imagine:15:23
bswartz1) if a vserver runs out of space and a second one is needed for capacity reasons15:23
vponomaryovcaitlin56: it is manila-network with two security services15:24
vponomaryovin view of entities in manila15:24
*** NehaV has quit IRC15:24
bswartz2) if vservers can be shared across 2 networks because the security settings for those 2 networks are "equivalent" insofar as the backend can tell15:24
caitlin56yponomaryov: then wouldn't you have to specify the security service for each share?15:24
*** tsufiev_ has quit IRC15:25
vponomaryovcaitlin56: ids of security services should be linked into netwrok-info entity15:25
caitlin56That's what I presumed in advance, but you wanted to hang this off of the manila-network.15:25
bswartzcaitlin56: I think you're using words that we don't have an agreed definition for15:25
bswartzwhat do you mean when you say manila-network?15:25
caitlin56The set of file servers and clients that share common security.15:26
caitlin56My assumption had been that this was not an object, that you specified the security service for each share. But you said that was not the case. So I'm trying to understand the rules.15:26
*** IlyaE has joined #openstack-meeting-alt15:27
bswartzthe network-info is the object inside manila that contains all this info15:27
bswartznetwork-infos are actually rows in a table, each one has an ID and a bunch of metadata15:27
bswartzThe API vponomaryov mentioned manages these new objects15:28
caitlin56bswartz: so "network-info in manila context" probably should 'manila' as part of its name. Otherwise folks will get confused vs neutron defined networks.15:28
*** hartsocks has left #openstack-meeting-alt15:28
bswartzcaitlin56: I agree the name is confusing15:28
bswartzcaitlin56: my concern with the term "manila-network" is that I don't want to give people the impression that manila is managing networks (ala nova-network)15:29
vponomaryovbswartz: +115:29
bswartzwe need a better name15:29
vponomaryovit should describe it as something with needed list of data15:29
caitlin56Maybe manila-network-context? or manila-secfurity-domain?15:29
bswartz#topic better name for network-infos15:29
*** openstack changes topic to "better name for network-infos (Meeting topic: manila)"15:30
*** SushilKM has joined #openstack-meeting-alt15:30
*** NehaV has joined #openstack-meeting-alt15:30
bswartzanyone want to make some suggestions for a better term?15:30
*** SushilKM has left #openstack-meeting-alt15:30
bswartzjust remember that these objects are each directly mapped to neutron subnets15:30
vbellurmaybe network-context15:31
achirkosecfurity-domain sounds good15:31
vponomaryovneutron is a plugin for this15:31
vponomaryovpotentially, it can be something else15:31
achirkowith --network argument to specify neutron parameters15:31
jcorbinCan a share only have one of these or multiple of these network-infos?15:32
caitlin56yponomaryov: what is the name of the handle within maniala that selects neutron typically?15:32
bswartzjcorbin: every share has exactly 1 of these15:32
vponomaryovcaitlin56: with config15:33
caitlin56And this thing defines a *set* of servers, correct? It's not just your LDAP/AD, it is the associated DNS, etc.15:33
vponomaryovyes, "ip for dns" string present too15:34
caitlin56yponomaryov: what is the configurable's name? That is the name we should use to refer to "neutron".15:34
jcorbinDoes this thing define 'connectivity', what the share talks to?15:34
*** kevinconway has joined #openstack-meeting-alt15:35
*** rnirmal has joined #openstack-meeting-alt15:35
*** jdob has quit IRC15:35
*** scottda_mobile has joined #openstack-meeting-alt15:36
*** gregsfortytwo1 has quit IRC15:36
*** dimasicv has joined #openstack-meeting-alt15:36
*** jdob has joined #openstack-meeting-alt15:36
yportnovacailtlin56: "network_plugin" is the name of config option15:37
*** amytron has joined #openstack-meeting-alt15:37
bswartzjcorbin: yes15:37
bswartzthe network-info object includes a mapping to a subnet (VLAN) which teh backend can use to provision an IP address if it needs to create a vserver to conenct to that VLAN15:37
bswartznetwork-context is sounding good to me15:37
bswartzsecfurity-domain is the other suggestion I've heard15:37
caitlin56jcorbin: I believe this thing defines the set of clients that can *successfully* talk to these servers.15:38
caitlin56I could have a client that does not know what AD/LDAP server to talk to. It can connect to my vserver, but it will not be able to mount a share.15:38
*** xuhanp has quit IRC15:38
bswartzwhat about "network-security-context"15:38
bswartzor "manila-network-context"?15:38
caitlin56network-context still sounds like something that belongs to neutron.15:38
*** sadasu has quit IRC15:38
caitlin56Either of the last two are better.15:38
bswartzany other suggestions?15:39
scottdashare-network-context?15:39
bswartzI'd like to call a vote on this15:39
caitlin56scottda: +115:39
vponomaryovnetwork-environment-data15:39
bswartzshare-network-context sounds good15:39
achirkonetwork-context and security-domain looks equally  good to me15:40
*** gregsfortytwo1 has joined #openstack-meeting-alt15:40
jcorbinI think having the project name in the term is not a good idea.15:40
jcorbinshare-network-context +115:40
caitlin56The 'share' makes it clear that we are talking about something more specific than a VLAN.15:40
vbellurshare-network-context +115:40
xyang1+1 share-network-context15:40
bswartzshare-network-context +115:41
bswartzany opposed to share-network-context?15:41
bill_az_share-network-context +115:41
vponomaryovand we will have command like "manila share-network-context-create ..." ? Right?15:41
achirkoshare-network-context-security-service-add (command which we will support) looks terifying15:42
yportnovaMaybe make it shorter like "share-network"?15:42
achirkomaybe network-context?15:42
bswartzhmm15:42
bswartzachirko: I agree with caitlin56 that network-context sounds like it should belong to neutron15:42
achirkoor security-domain? :)15:43
bill_az_share-context  - it is about more than just network15:43
scottda"share" makes it explicit that we are referring to share management15:43
xyang1share-netcontext?15:43
caitlin56It's not like any human will be typing these commands. Everything is going to be scripts.15:43
bswartzI prefer something with the name "share" or "manila" in the name15:43
bswartzI agree that a long name such as share-network-context is a bit painful to read/type15:43
caitlin56If you are typing it a lot you will be putting it in a script anyway.15:44
bswartzcaitlin56: not really -- us poor developers have to type this stuff, and the docs will have to include the full names15:44
vbellurshare-nw-context ?15:44
*** tomblank has quit IRC15:44
*** tomblank has joined #openstack-meeting-alt15:45
achirkoI don't think we should prepend 'share' - at the end everything in manila is about shares15:45
caitlin56share-net-context?15:46
caitlin56or share-net-ctx?15:46
vponomaryovnet-ctx and we are deal =)15:46
bswartzshare-netcontext seems to be the simplest shortening15:46
bswartzor share-network15:46
bswartzI don't like "nw" or "ctx" they're too short15:46
*** alagalah has joined #openstack-meeting-alt15:47
bswartzhow do people feel about share-network-context vs share-network vs share-net-context15:47
caitlin56achirko: I disagree. When you are writing code this is obvious, but an admin can easily be confused about whether they are being asked to configure manila's use of a neutron object or a manila object.15:47
achirkoI like share-network15:47
jcorbinshare-network +115:48
bswartzshare-network +115:48
vbellurshare-network +115:48
scottdashare-network +115:48
yportnovashare-network +115:48
bswartzokay that's a bit less terrifying, and still pretty clear what it refers to15:48
vponomaryovshare-network +115:48
caitlin56context is almost like "handle", so leaving it off is not terribly confusing.15:48
*** dimasicv has quit IRC15:48
bswartz#agreed network-info will be renamed to share-network15:49
bswartz#topic open-discussion15:49
*** openstack changes topic to "open-discussion (Meeting topic: manila)"15:49
*** tomblank1 has joined #openstack-meeting-alt15:50
bswartzokay so it's my fault that we still don't have clear diagrams/documents explaining what manila is/how it works15:50
bswartzI relaxed too much on vacation :-(15:50
bswartzI'm going to work on that today15:50
caitlin56Do we want to start discussing object relationships?15:50
bswartzcaitlin56: are you available later today?15:51
*** PaulMurray has left #openstack-meeting-alt15:51
jcorbinbwartz: If you need any help let me know.15:51
bswartzI guess I forgot to mention that in case it's no clear from vponomaryov's updates, we're really close to having a fully working implementation of manila with multitenancy15:51
caitlin56Yes, I'm still at home, so I have to actually finish walking the dog and then go into the office first thought (it not yet 8:00 AM here).15:51
*** pballand has joined #openstack-meeting-alt15:52
bswartzcaitlin56: I will ping you after the meeting ends15:52
xyang1what about NetApp's multitenancy driver?15:52
*** tomblank has quit IRC15:52
vponomaryovxyang1: it is inprogress15:52
xyang1ok, thanks15:52
bswartzxyang1: it's in gerrit, as a WIP15:53
vponomaryovwe should make it work with kerberos and ldap and network-API15:53
*** allyn has joined #openstack-meeting-alt15:53
bswartzvponomaryov: is that change viewable by the public?15:53
xyang1bswartz: ok, I'll take a look15:53
vponomaryovdriver is in gerrit15:54
bswartzin any case I can add xyang115:54
*** chandankumar_ has quit IRC15:54
*** jmontemayor has joined #openstack-meeting-alt15:55
*** scottda_mobile has quit IRC15:56
*** nam_nguyen has joined #openstack-meeting-alt15:56
bswartzokay if nobody else has anything we can wrap up15:56
bswartzthanks everyone15:56
bswartz#endmeeting15:56
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"15:56
openstackMeeting ended Thu Jan  9 15:56:20 2014 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)15:56
openstackMinutes:        http://eavesdrop.openstack.org/meetings/manila/2014/manila.2014-01-09-15.01.html15:56
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/manila/2014/manila.2014-01-09-15.01.txt15:56
openstackLog:            http://eavesdrop.openstack.org/meetings/manila/2014/manila.2014-01-09-15.01.log.html15:56
*** gregsfortytwo1 has left #openstack-meeting-alt15:56
*** jcorbin has left #openstack-meeting-alt15:56
vbellurthanks15:56
*** vbellur has left #openstack-meeting-alt15:56
*** achirko has quit IRC15:56
*** akerr has left #openstack-meeting-alt15:56
*** aostapenko has left #openstack-meeting-alt15:56
bswartzuh oh15:57
bswartz#endmeeting15:57
bswartzwhew15:57
bswartzlaggy IRC15:57
caitlin56bswartz: I should be available to chat on data structuring in about an hour and a half.15:57
*** thinrichs has joined #openstack-meeting-alt15:57
caitlin56bswartz: or would you prefer after your lunch?15:58
*** funzo has quit IRC15:59
*** markmcclain has quit IRC16:00
mesteryhi16:00
banixhi16:00
thinrichsHi all16:00
mestery#startmeeting networking_policy16:00
openstackMeeting started Thu Jan  9 16:00:36 2014 UTC and is due to finish in 60 minutes.  The chair is mestery. Information about MeetBot at http://wiki.debian.org/MeetBot.16:00
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:00
*** openstack changes topic to " (Meeting topic: networking_policy)"16:00
openstackThe meeting name has been set to 'networking_policy'16:00
mesteryHi banix thinrichs16:00
*** michsmit has joined #openstack-meeting-alt16:00
mestery#link https://wiki.openstack.org/wiki/Meetings/Neutron_Group_Policy Agenda16:00
*** bswartz has left #openstack-meeting-alt16:01
mesterySo, we have a light agenda for today I believe, which will leave lots of time for questions/comments at the end. :)16:01
*** funzo has joined #openstack-meeting-alt16:01
mestery#topic PoC Discussion and Planning16:01
*** openstack changes topic to "PoC Discussion and Planning (Meeting topic: networking_policy)"16:01
mesterySo, banix and I had an AI to start writing this up, which we've done.16:01
mesteryIt's in very early stages, but covers the high level points banix s3wong and myself have been discussing this week.16:01
*** prasadv has joined #openstack-meeting-alt16:02
mestery#link https://docs.google.com/document/d/14UyvBkptmrxB9FsWEP8PEGv9kLqTQbsmlRxnqeF9Be8/edit?usp=sharing Group Policy PoC document16:02
*** s3wong has joined #openstack-meeting-alt16:02
alagalahMorning16:02
mesterys3wong: Hi!16:02
s3wongHello16:02
mesteryalagalah: Morning!16:02
alagalahmestery:  hi16:02
*** rraja has quit IRC16:02
mesterySo, for those who just joined, were discussing the PoC document now, which is in it's early stages.16:02
mesteryhttps://docs.google.com/document/d/14UyvBkptmrxB9FsWEP8PEGv9kLqTQbsmlRxnqeF9Be8/edit?usp=sharing <--- Link to PoC document (also on Meeting page)16:02
*** songole has joined #openstack-meeting-alt16:02
*** FlorianOtel has joined #openstack-meeting-alt16:03
*** vponomaryov has left #openstack-meeting-alt16:03
nam_nguyenHi, I'm new here and listening first.16:03
*** ilyashakhat has joined #openstack-meeting-alt16:03
mesterybanix s3wong and myself will finish fleshing this out the rest of this week.16:03
mesterynam_nguyen: Welcome to the team!16:03
banixwelkome Nam16:03
*** caitlin56 has quit IRC16:03
songoleHi all16:04
banixI should introduce Nam, as one of my colleagues who will be joint us16:04
mesterybanix s3wong: Anything to add on PoC at this time?16:04
banixjoining us that is16:04
mesterybanix: Cool, glad to have more people joining the team!16:04
alagalahnam_nguyen:  welcome16:04
s3wongname_nguyen: welcome to the team!16:04
nam_nguyenthx!16:04
FlorianOtelalagalah, mestery Hello boys16:04
FlorianOteland all :)16:04
mesteryFlorianOtel: Great to see you here my friend. :)16:04
prasadvhi this is prasad16:04
banixmestery: No, I think the main issue is how we go about starting the work16:04
alagalahprasadv:  hi16:04
mesterybanix: I agree. :)16:05
FlorianOtelis this on IRC only, or you guys on hangout / smth else as well ?16:05
mesteryprasadv: Good morning!16:05
mesteryFlorianOtel: IRC only, we're not as advanced as the ODL stuff. ;)16:05
* mestery ducks.16:05
FlorianOtelha ;)16:05
s3wongmestery: the document captures in the high level what we need to do now16:06
s3wongthough once this is done we would like to test it against a use case, such as three-tier app using Heat template16:06
alagalahAre we planning on assigning each of the 4 bullets out, do like a mini lead per bullet with teams?16:06
mesterys3wong: Lets add the use case to the document, sound good?16:07
mesteryalagalah: We haven't decided on the division of labor yet, but if you want to help, that would be great!16:07
banixs3wong: we need to also think about what we need to do on the Heat side; I presume it will be minimal at least to start with16:07
alagalahmestery:  yes I do16:07
thinrichsI'm not super familiar with ML2.  I have a question or two about the plans.16:07
prasadvwe internally built a heat template based on the discussions so far16:07
mesterythinrichs: Shoot!16:08
mesteryprasadv: Awesome! We'll lean on you folks for that portion. Sound good banix?16:08
s3wongmestery: banix: sure16:08
banixprasadv: great; share when/if you can16:08
thinrichsFor the allow/drop case, I see how we can implement the policy via OVS.  But when we start getting to QOS, or some of the other actions, how will that work?16:08
prasadvok will do. we can put it into poc document16:08
banixmestery: agree16:08
thinrichsDo we only select actions that are implementable in OVS?16:09
s3wongprasadv: wow, that is great!16:09
mesterythinrichs: For QoS in particular, we need to work with scal68 (Sean Collins) who is doing QoS support for ML2+OVS.16:09
*** markmcclain has joined #openstack-meeting-alt16:10
alagalahmestery:  et al ... sorry , silly question but is OVS the initial use case with this to be extensible to other platforms later? Or limited? That will change the decisions16:10
thinrichsalagalah: maybe I'm wondering the same kind of thing.16:11
banixinitial PoC16:11
s3wongalagalah: ovs is selected as initial PoC ref. impl.16:11
mesterySimilar to how the existing Neutron APIs work in ML2, we'll want to make these new extension APIs work the same.16:11
*** ashaikh has joined #openstack-meeting-alt16:11
alagalahI think its ok to limit actions to OVS supported functions but to push features to rely on OVS would mean they would have to be written back in for other platforms16:11
mesterye.g. if you look, they have pre/post methods for both so DB transactions are done in one place.16:11
banixalagalah: thinrichs: Just a PoC; would like to see it used by others16:11
alagalahmestery:  thanks, that helps... so it will be more extensible that way16:12
*** tomblank has joined #openstack-meeting-alt16:12
*** hemanthravi has joined #openstack-meeting-alt16:12
thinrichsWhat if we don't actually have OVS underneath the hood, and instead we are using something that doesn't support QOS?  Is the policy just not enforceable?16:12
s3wongalagalah: yes - even the APIs and optional action types will be expanded in the future, I am sure16:13
mesterythinrichs: I think we decided that each MechanismDriver can fail the calls, similar to how it works today in ML2 for existing API calls.16:13
alagalahthinrichs:  That was my understanding. Thanks mestery16:13
banixthinrichs: depends on the mechanism driver; can "not" support16:13
alagalahs3wong:  thanks16:13
thinrichsAnd I'm not concerned so much about the PoC--it's that we're defining the language to have actions that are known to not be supported for some technology.16:14
*** tomblank1 has quit IRC16:14
thinrichsBut I suppose that some underlying architectures can simply render some policies unenforceable and so the users ought to know not to write those policies.  Is that right?16:14
s3wongthinrichs: ha - we talked about that. We will add an API for users to query a set of action capabilities that is supported by a particular plugin16:14
*** jasonb365 has joined #openstack-meeting-alt16:14
alagalahThat was my understanding s3wong16:15
* mestery nods in agreement.16:15
thinrichss3wong: but do we expect Heat to utilize that API before writing policy statements?16:15
banixthinrichs: for QoS we haven't really worked out specifics; can discuss in parallel16:15
thinrichsbanix: the details of QoS aren't so important--it's just an example of something that isn't so easy to implement.16:15
s3wongthinrichs: interesting question - how dynamic can a Heat template be?16:15
banixI think we want the infrastructure setup first16:15
prasadvthinrichs: Heat can call and do validation of a template if there is such a call16:16
*** markmcclain has quit IRC16:16
thinrichsWould Heat change the templates it accepts based on whether or not Neutron accepts Qos policies?16:16
s3wongprasadv: Thank You!16:16
prasadvwherein the plugin cannot support16:16
thinrichsSo before Heat (or whatever) even generates a UI to accept a template, it calls out to Neutron to figure out what policies it accepts and then customizes the UI so the user doesn't specify things that aren't implementable?16:17
prasadvthinrichs: Instead of changing templates, wouldnt it be better to return error16:17
* alagalah nods16:18
banixI think Heat as is today won't change things dynamically16:18
prasadvthinrichs:THat was original thought to have an query api16:18
alagalahI think the application should re-request16:18
thinrichsprasadv: But suppose the user spends a bunch of time writing a template, and then just gets an error in response?  Wouldn't that irritate her?16:18
alagalahSend back an error16:18
banixThere is talk of extending Heat to do a lot more but as is it simply tries to create resources specified in template through calls to underlying services16:18
s3wongthinrichs: the user should then consider having a different plugin16:19
alagalahWell we talked about an API to query capabilities, so they should use that to make a template and if a template comes in that cant be fulfilled, we should return error16:19
thinrichss3wong: the user here doesn't get to change how the cloud is set up--they're just describing an app template.16:19
mesterys3wong: In the case of a public cloud, the user doesn't have control over the plugins.16:19
*** tomblank has quit IRC16:19
prasadvthinrichs: I think plugin can also document what it supports right? though this requires the person to know which plugin is being used.16:20
s3wongin that case, it is up to the cloud provider to publish what it can support16:20
ashaikhthinrichs: i don't think there is an expectation today that every template would just work -- e.g., the public cloud would make clear what it can/can't do16:20
thinrichss3wong/ashaikh: but there must be UIs for creating templates, right?  So suppose the UI tells you you've got 10 different actions you can use but in actuality, there is only allow/drop.16:21
alagalahthinrichs:  Teh capability API should handle that shouldn't it ?16:21
alagalahA UI should use that shouldn't it ? Or am I missing something ?16:21
mesterythinrichs: Would it really be hard for the UI to query the plugin and ghost out which ones aren't supported by the underlying plugin?16:22
thinrichsMaybe I'm wondering whether the right interface for Heat is to just say "and give me a policy using actions 1,2,3,4".16:23
s3wongthinrichs: can you apply a Heat template in Horizon today? If so, if there is something within the Heat template that is not supported, would an error show up on Horizon?16:23
mesterythinrichs: Since there is no requirement to use cinder, for example, what if cinder isn't running and the user tries to create volumes in a Heat template? What happens in that case now?16:24
mesteryBecause there is no "official" definition of what OpenStack is.16:24
songoles3wong: it does. stack creation fails16:24
thinrichsI'm wondering if we would want to hide the details of the actions within higher-level concepts, and those concepts would be hard to define if the set of available actions were different for each plugin.16:24
mesteryI think we're solving a problem which is not just related to policy actions IMHO.16:24
mesteryOR rather, trying to solve.16:24
banixAs prasadv shares with us what they have done on the Heat front, we can discuss further16:24
*** IlyaE has quit IRC16:25
s3wongsongole: Thanks! so for thinrichs: it would just fails as you apply the template from get-go16:25
thinrichsMaybe this is all okay.  I'll think more and see if anything pops to mind.16:25
*** kebray_ has joined #openstack-meeting-alt16:25
mesterythinrichs banix: Sounds good.16:25
banixmestery: agree. For now the Heat extension for us would be simply capable of creating newly defined Neutron objects16:25
*** tomblank has joined #openstack-meeting-alt16:25
mesteryBut good to bring these points up thinrichs!16:25
prasadvi agree with mestery. Policy is provding a query api and that help it quite a bit16:25
* alagalah agrees with mestery16:25
*** garyk has quit IRC16:26
s3wongprasadv: Good to have you here to give us actual API consumer to come up with the required APIs16:26
mesteryOK, anything else related to the PoC to discuss right now?16:26
mesteryLet me assign a few actions:16:26
mestery#action prasadv to add heat details to the PoC document16:26
s3wongmestery: so who is doing what?16:27
mestery#action mestery s3wong banix to flesh out more details in the document and assign tasks to interested parties16:27
*** eankutse has quit IRC16:27
mesterys3wong: Just added that. :)16:27
s3wongmestery: cool :-)16:27
*** eankutse has joined #openstack-meeting-alt16:27
mesteryIf nothing else on PoC, I'll move the topic to Open Discussion in a minute.16:27
banixSounds good16:27
s3wongmestery: sure16:28
mestery#topic Open Discussion16:28
*** openstack changes topic to "Open Discussion (Meeting topic: networking_policy)"16:28
alagalahHi guys, just a nit, but a change was made to the taxonomy document to reflect "1 or more" when it accurately reflected that with a "+" as per the key16:28
banixI will cleanup the original design doc this week.16:28
mesteryalagalah: Thanks for the update!16:28
mesterybanix: Thank you!16:28
alagalahFor classifiers16:29
s3wongalaglah: Thanks!16:29
alagalahWell actually.....16:29
alagalahThe update made was wrong... it should be put back to a "+"16:29
banixWon't make any changes as such just a cleanup.16:29
alagalahAny objections to me changing it back?16:29
prasadvI still have an issue with classifiers for cases like L2 firewall not including IP addresses16:30
*** sacharya has joined #openstack-meeting-alt16:31
mesteryprasadv: Dually noted, should we flesh that out during the PoC?16:31
prasadvmismith had issues with including them last time. How should we resolve that16:31
alagalahprasadv:  Mine was more a cosmetic thing. the taxonom originally had + between policy rule and classifiers which means "1 or more" and it was changed to "1" to reflect "1 or more"16:31
s3wongprasadv: sure, that was never finalized16:31
mesterymichsmit: You here?16:31
michsmityes16:31
*** jcoufal_ has quit IRC16:31
prasadvi am fine with that. we can resolve during PoC16:31
mesterymichsmit: Hi. See prasadv comment ^^^^16:31
mesterymichsmit prasadv: OK, cool.16:31
michsmitmy assumption was that IP addresses would be limited to external networks16:31
s3wongalagalah: there should only be one classifier per policy-rule, so the '1' looks good16:32
michsmitmeaning that policies between groups should avoid IP addresses if at all possible16:32
alagalahOh!16:32
alagalahs3wong:  Thanks!16:32
alagalahs3wong:  Is it 0 or 1 ???16:32
alagalahs3wong:  In that case it should be a "?" as per the key16:33
s3wongalagalah: has to be 1, can't be 016:33
banixmichsmith: agree16:33
alagalahIn that case I apologize and I will leave it16:33
alagalahThank you all for the clarification16:33
s3wongmichsmith: agree - never a fan in adding IP address in classifier16:33
prasadvmichsmit: I want to see if L2 scenario can be supported with you are saying and get back on that16:33
mesteryprasadv: Sounds good!16:33
michsmitprasadv: sure16:33
*** mozawa has quit IRC16:34
mesteryOK, anything else to discuss here?16:34
*** hemanthravi has quit IRC16:34
s3wongwow, short meeting :-)16:34
mesteryYay to short meetings!16:34
michsmit+1 to that16:34
* alagalah cheers16:34
prasadv+1 to that16:34
banixThanks everyone16:35
thinrichs+116:35
*** hemanthravi has joined #openstack-meeting-alt16:35
mesteryOK, thanks everyone! Looking forward to seeing some PoC action now! :)16:35
s3wongThanks!16:35
mestery#endmeeting16:35
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"16:35
nam_nguyenthx!16:35
alagalahThanks all16:35
openstackMeeting ended Thu Jan  9 16:35:10 2014 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)16:35
openstackMinutes:        http://eavesdrop.openstack.org/meetings/networking_policy/2014/networking_policy.2014-01-09-16.00.html16:35
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/networking_policy/2014/networking_policy.2014-01-09-16.00.txt16:35
openstackLog:            http://eavesdrop.openstack.org/meetings/networking_policy/2014/networking_policy.2014-01-09-16.00.log.html16:35
*** prasadv has quit IRC16:35
*** alagalah has quit IRC16:35
*** songole has quit IRC16:35
*** thinrichs has quit IRC16:35
*** ashaikh has left #openstack-meeting-alt16:35
*** nam_nguyen has left #openstack-meeting-alt16:35
*** venkatesh has joined #openstack-meeting-alt16:35
*** hemanthravi has quit IRC16:36
*** venkatesh has quit IRC16:36
*** FlorianOtel has quit IRC16:36
*** csaba is now known as csaba|afk16:37
*** michsmit has left #openstack-meeting-alt16:37
*** allyn has quit IRC16:38
*** balajiiyer has quit IRC16:39
*** mozawa has joined #openstack-meeting-alt16:39
*** s3wong has quit IRC16:40
*** aignatov has quit IRC16:51
*** pballand has quit IRC16:53
*** hartsocks has joined #openstack-meeting-alt17:00
*** derekh has quit IRC17:02
*** gokrokve has joined #openstack-meeting-alt17:03
*** jasonb365 has quit IRC17:03
*** jtomasek has quit IRC17:03
*** garyk has joined #openstack-meeting-alt17:03
*** NikitaKonovalov has quit IRC17:04
*** BrianB_ has joined #openstack-meeting-alt17:09
*** balajiiyer has joined #openstack-meeting-alt17:11
*** jasonb365 has joined #openstack-meeting-alt17:12
*** tomblank has quit IRC17:12
*** pballand has joined #openstack-meeting-alt17:13
*** eankutse has quit IRC17:21
*** markmcclain has joined #openstack-meeting-alt17:21
*** glucas has left #openstack-meeting-alt17:24
*** arnaud__ has joined #openstack-meeting-alt17:25
*** arnaud has joined #openstack-meeting-alt17:25
*** bdpayne has joined #openstack-meeting-alt17:25
*** ruhe is now known as _ruhe17:27
*** ilyashakhat has quit IRC17:36
*** NikitaKonovalov has joined #openstack-meeting-alt17:37
*** nati_ueno has joined #openstack-meeting-alt17:42
*** ViswaV has joined #openstack-meeting-alt17:43
*** ViswaV has left #openstack-meeting-alt17:46
*** gokrokve has quit IRC17:49
*** paulmo has joined #openstack-meeting-alt17:49
*** safchain has quit IRC17:49
*** balajiiyer has quit IRC17:50
*** BrianB_ has quit IRC17:51
*** eankutse has joined #openstack-meeting-alt17:51
*** luqas has quit IRC17:54
SergeyLukjanovsavanna team meeting will be here in 10 minutes17:55
*** mattf has joined #openstack-meeting-alt17:55
*** bob_nettleton has joined #openstack-meeting-alt17:56
*** NikitaKonovalov has quit IRC17:56
*** ViswaV has joined #openstack-meeting-alt17:57
*** dmitryme has joined #openstack-meeting-alt17:58
*** eankutse has quit IRC18:00
*** crobertsrh has joined #openstack-meeting-alt18:00
*** alazarev has joined #openstack-meeting-alt18:00
*** gokrokve has joined #openstack-meeting-alt18:01
*** NikitaKonovalov has joined #openstack-meeting-alt18:01
*** gokrokve has quit IRC18:03
*** lblanchard has quit IRC18:03
*** baoli has quit IRC18:04
*** jasonb365 has quit IRC18:05
*** aignatov has joined #openstack-meeting-alt18:05
*** jmaron has joined #openstack-meeting-alt18:05
*** harlowja_away is now known as harlowja18:07
*** jspeidel has joined #openstack-meeting-alt18:08
*** Duane has joined #openstack-meeting-alt18:08
SergeyLukjanovsavanna folks, are you here?18:09
dmitrymeyep18:09
aignatovo/18:09
jspeidelyes18:09
crobertsrhyessir18:09
alazarevo/18:09
SergeyLukjanov#startmeeting savanna18:10
openstackMeeting started Thu Jan  9 18:10:37 2014 UTC and is due to finish in 60 minutes.  The chair is SergeyLukjanov. Information about MeetBot at http://wiki.debian.org/MeetBot.18:10
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.18:10
*** openstack changes topic to " (Meeting topic: savanna)"18:10
openstackThe meeting name has been set to 'savanna'18:10
jmaronyep18:10
SergeyLukjanovopenstack, thank you sir18:10
SergeyLukjanov#topic Agenda18:10
*** openstack changes topic to "Agenda (Meeting topic: savanna)"18:10
SergeyLukjanov#link https://wiki.openstack.org/wiki/Meetings/SavannaAgenda18:10
SergeyLukjanov#topic Action items from the last meeting18:11
*** openstack changes topic to "Action items from the last meeting (Meeting topic: savanna)"18:11
SergeyLukjanovroadmap improvements are still in my backlog18:11
SergeyLukjanovheh18:11
SergeyLukjanov#action SergeyLukjanov to check that all blueprints created and ping guys to make them if not18:11
SergeyLukjanov#action SergeyLukjanov add links to the blueprints to roadmap18:12
SergeyLukjanov#topic News / updates18:12
*** openstack changes topic to "News / updates (Meeting topic: savanna)"18:12
SergeyLukjanovguys, please18:12
SergeyLukjanovI'm still in vacation, so, not so many news from my side18:12
aignatovnothing specific from me, just reviewed some code today and continue working on adding anti affinity to scaling with heat18:12
crobertsrhI'm currently working on putting the "Java" job type into the dashboard (based on tmckay's Oozie Java action work).18:13
aignatovthe first day after holidays :)18:13
jspeidelany update regarding HBASE  support?18:13
mattfi've been chipping away at the savanna cli. comments still welcome on https://blueprints.launchpad.net/python-savannaclient/+spec/python-savannaclient-cli - especially around how to handle template creation.18:13
alazarevI've finished IDH plugin initial version: https://review.openstack.org/#/c/56105/18:13
SergeyLukjanovjspeidel, not yet, I was on holidays/vacation, we'll continue at Monday18:13
jspeidel@SergeyLukjanov ok, thanks18:14
SergeyLukjanovjspeidel, and it's still -1'ed18:14
alazarevjspeidel: as I see IDH waits for your review :)18:14
jspeidelyep, I know :)18:14
aignatovyeh, I see that this patch is WIP18:14
* mattf jumps on jspeidel too18:14
* mattf smiles18:14
*** tomblank has joined #openstack-meeting-alt18:14
SergeyLukjanovany other updates?18:15
aignatovalazarev: patch lgtm to be merged ;)18:15
jmaronedp over neutron private nets is paused while I wait on our neutron setup to resurrect from the dead so I can perform functional testing18:15
alazarevalso, I was able to run Pig job via EDP on IDH cluster (https://review.openstack.org/#/c/64323/)18:15
mattfjmaron, neutron issues?18:15
mattfalazarev, awesome18:15
jmaronIT/host issues18:15
*** johnthetubaguy has quit IRC18:15
SergeyLukjanovalso I'd like to mention Spark plugin efforts in ML18:15
*** paulmo has left #openstack-meeting-alt18:16
SergeyLukjanovlet me find the link18:16
jspeidel@mattf #link https://review.openstack.org/#/c/56105/18:16
mattfhttps://blueprints.launchpad.net/savanna/+spec/spark-plugin18:16
*** mat-lowery has joined #openstack-meeting-alt18:16
aignatov#link https://blueprints.launchpad.net/savanna/+spec/spark-plugin18:16
SergeyLukjanov#link http://lists.openstack.org/pipermail/openstack-dev/2014-January/thread.html#2380618:16
aignatovcorrected you mattf  :P18:16
mattfaignatov, not the first, won't be the last!18:17
SergeyLukjanov#topic Roadmap update/cleanup18:17
*** openstack changes topic to "Roadmap update/cleanup (Meeting topic: savanna)"18:17
SergeyLukjanovaction items are on me18:17
SergeyLukjanovI don't think that we have any updates to roadmap so far18:17
aignatovSergeyLukjanov: these is awesome news, one more plugin, i'm impressed18:17
mattfshould we scan the roadmap and give feedback? i've not looked at it since summit.18:18
SergeyLukjanovmattf, I'm afraid that nothing changed18:18
*** tmckay has joined #openstack-meeting-alt18:18
SergeyLukjanovmattf, but it should, I still hope to return back to it and ensure blueprints existence18:18
mattfack18:19
SergeyLukjanov#topic General discussion18:19
*** openstack changes topic to "General discussion (Meeting topic: savanna)"18:19
SergeyLukjanov#info the icehouse-2 release will be Jan 2418:19
mattfanyone have suggestions on how to create node group / cluster templates from the cli?18:19
SergeyLukjanovso, be prepared for the code freeze Jan 2218:19
alazarevmattf: request json? :)18:20
mattfSergeyLukjanov, i'll do another oslo sync for next week, please add an action for me (remind me to do it next thurs)18:20
*** balajiiyer has joined #openstack-meeting-alt18:20
aignatovmattf, not atm, the first thing is yes -json18:20
SergeyLukjanovmattf, you can find some of my thoughts in the CLI blueprint18:20
jmaronsavanna template-create < template.json ?18:20
mattfalazarev, i was thinking about that actually. maybe creating only by piping in a json file?18:20
jspeidelalazarev +1 for json request bodhy18:20
jspeidelbody18:20
aignatovjmaron: smthg like this18:20
mattfafaict, it's complicated by the fact that template json is plugin specific18:21
aignatovmattf: you can get an idea from heat ;)18:21
SergeyLukjanov#action mattf to sync oslo right before the i2 code freeze18:21
mattffor instance, process names aren't consistent between plugins18:21
mattfand hdp supports more processes than vanilla18:22
SergeyLukjanovI'm ok with piping json template for the first time at least18:22
alazarevmattf: and they will not be consistent because different distros have different namings18:22
mattfi've an action on myself to work out the best way to list processes to help in contructing json, but...that's not very userfiendly18:22
SergeyLukjanov#action SergeyLukjanov to unsure that we'rein sync with global requirements18:22
jmaronthere's a precedent for plugin specific template processing in the plugin SPI18:22
SergeyLukjanov#undo18:22
openstackRemoving item from minutes: <ircmeeting.items.Action object at 0x30f5350>18:22
mattfalazarev, we could have some consistency tho, NameNode vs NAMENODE etc18:22
SergeyLukjanov#action SergeyLukjanov to ensure that we're in sync with global requirements18:23
mattf(someone needs to fix #undo to print the object string018:23
mattfnot it18:23
SergeyLukjanovmattf, alazarev, that's a problem of choosing vendor names vs. our common names18:23
mattfseems plugins could maintain a simple map from common name to vendor name18:24
jspeidelmattf, I don't think that we can expect consistency across providers.  Each provider should expose names that are meaningful for their stack18:24
mattfset of common names would have to be union of all vendor features tho18:24
aignatovjspeidel: +118:24
*** yogesh has joined #openstack-meeting-alt18:24
*** lblanchard has joined #openstack-meeting-alt18:25
jmaronvendor CLI plugins for template processing (akin to SPI)?18:25
alazarevsome services could be splited into severel processes, some services are specific for distro, I don't think we need to force namings18:25
mattfjspeidel, so far the examples are somewhat silly tho, the primary difference is all caps for HDP18:25
alazarevmattf: this is because we have only HDP and vanilla18:25
jmaronvanilla:  "oozie"  HDP:  OOZiE_SERVER, OOZIE_CLIENT18:25
mattfso the proposal (well liked) is currently to simple accept json files. that means to actually create a template the user must essentially use horizon and then export it.18:26
jspeidelmattf, agreed that the current differences are simple, but I think that assuming a consistency is a slippery slope18:26
mattfjmaron, thanks for finding a nice example. in this case it seems like the vanilla is simply being less specific18:26
alazarevif we have vanilla, HDP, IDH, cloudera, etc - there will be much more differences18:27
jmaron(to point out less trivial differences)18:27
aignatovdon't forget about incoming Spark plugin, I think there will be another set of processes :)18:27
mattfmy view on this is we should make using savanna simple and consistent for users, no matter what plugin they are using on the backend18:27
mattf^^ my guiding rule, which eventually has exceptions18:27
*** jasonb365 has joined #openstack-meeting-alt18:28
mattfaignatov, yeah, set would have to be union of all plugins18:28
jspeidelmattf, agree with usability but don't think the we can dictate to providers what to call components18:28
jspeidelmattf, each plugins users know the names of the components associated with the vendors stack18:28
mattfjspeidel, the vendor would not have to call them something internally, only when representing them out to savanna18:28
jmaronwe could follow this already established precedent/convention:  https://savanna.readthedocs.org/en/latest/devref/plugin.spi.html#convert-config-plugin-name-version-template-name-cluster-template-create18:29
*** ViswaV has quit IRC18:30
mattfimho, no need to make a decision here. seems to me the pressure is for no change to how the plugins work at the moment. i want to make sure folks are aware of the differences and that they can impact usability.18:30
mattf(they're impacting usability in how i can make the cli already!)18:30
jspeidelmattf, agreed18:30
alazarevmattf: +118:30
*** xyang1 has quit IRC18:31
* mattf gets off soapbox18:31
*** ViswaV has joined #openstack-meeting-alt18:31
mattfanother related topic - destroy or delete - what's the proper verb for our cli?18:32
*** ViswaV has quit IRC18:32
mattfimho we should just be consistent w/ other clis18:32
*** ViswaV has joined #openstack-meeting-alt18:32
jmaronannihilate18:32
mattfe.g. cluster-destroy or cluster-delete, node-group-template-destroy or node-group-template-delete18:32
mattfobliterate?18:32
aignatovjmaron: lol!18:32
*** ViswaV has quit IRC18:32
aignatovmattf, +1 to be consistent with other clis18:33
alazarevI vote on delete18:33
*** ViswaV has joined #openstack-meeting-alt18:33
mattfaignatov, clis aren't consistent, how would you rank them (nova then keystone then cinder?)18:33
aignatovcluster-delete and node-group-template-delete my vote18:33
jmaron+1 for delete18:34
jspeidelmattf, +1 for delete18:34
* mattf starts to see himself s/destroy/delete/g'ing18:34
jspeidelmattf, should have asked sooner ;)18:34
jmarons/destroy/euthanize/g18:34
* mattf hangs head in shame18:34
mattfjmaron, you're on fire18:34
jmaron:)18:35
mattfok, i'll tend to delete and do another pass over other clis18:35
tmckayjust checked the REST apis, looks like it is all "delete" there too18:35
aignatovmattf, yep, rely on nova first, imo18:35
tmckay+1 delete18:35
mattftmckay, delete is the REST verb18:35
SergeyLukjanovI'm ok with both destoy and delete ;)18:35
mattfok, thanks for the input folks!18:36
tmckaywell, true.  I was looking at method names.  Doubly consistent :)18:36
jmaronSergeyLukjanov: node-template-destroy-and-delete?18:36
mattffyi - i'm finding all sorts of rough edges in the client, so i'll start writing them up for client v218:36
mattf(kinda glad i'm finding rough edges, one reason for doing the cli was to evaluate the usability of the api!)18:37
alazarevdestroy-delete-and-remove-completely18:37
* mattf hopes someone brings up another topic before we get to exterminate18:37
aignatovdestroy-delete-and-remove-completely-and-run-away18:37
* mattf waits for Aliens reference18:38
alazarevduring IDH plugin development I faced with problem that auth token is expired because of long inactivity. Auth token was only needed to take username from image tags. So, I proposed caching for username in node group.extra (https://review.openstack.org/#/c/65402/).18:38
alazarevSergeyLukjanov: you left a comment that this need to be discussed18:38
jmaron*get away from my template you b****!*18:38
mattfjmaron, lol, i was thinking nuke from orbit18:38
jmaron:)18:39
mattfjspeidel, what on earth do you guys have in your break rooms!?18:39
aignatovxD18:39
SergeyLukjanovjmaron, heh, that's a good option :)18:39
SergeyLukjanovalazarev, my concern is extra field ressurection18:39
alazarevSergeyLukjanov: what wrong with it? extra is good18:40
mattfalazarev, SergeyLukjanov, aignatov, does this become a non-issue w/ heat?18:40
SergeyLukjanovalazarev, it's a kind of necrophilia18:41
SergeyLukjanovmattf, extra field?18:41
* mattf covers eyes18:41
mattfSergeyLukjanov, need storing username on image18:41
mattfneed for*18:41
alazarevmattf: yes, heat removes the issue, but it would be good to get plugin work before full switch to heat18:41
dmitrymemattf, indeed it is not an issue with the heat18:41
mattfalazarev, how long is "long inactivity"?18:41
aignatovSergeyLukjanov: do you know that we already use extra for hadoop keypairs?18:42
mattfand who's inactivity?18:42
mattfwhose*18:42
dmitrymefor those who don't know: all instances provisioned by Heat have ec2-user18:42
dmitrymei.e. static username for all images18:42
alazarevmattf: 30+ mins, savanna waits for manager to install something18:42
mattfdmitryme, we could change that via userdata, right?18:42
mattfalazarev, that's not very long imho18:42
dmitrymemattf: change what? :-)18:42
mattfnot very long -> up priority18:42
mattfdmitryme, os-user vs ec2-user. it's just ec2-user beacuse that's the cloud-init default?18:43
alazarevmattf: I didn't dig why token expires, but it did18:43
SergeyLukjanovaignatov, yup, I remember18:43
dmitrymemattf: it is Heat default18:43
mattfSergeyLukjanov, alazarev, what about letting in alazarev's change and filing a but to remove it once we go to heat?18:43
mattfdmitryme, ahh18:43
mattfeesh bug*18:43
dmitrymeHeat pushes onto instance not only userdata provided by the user, but also some additional scripts18:44
dmitrymeone of them sets up ec2-user18:44
mattfdmitryme, i didn't know that, thanks18:44
aignatovdmitry, thx, with heat we will remove username field from registering image18:44
alazarevand, once again… what wrong with extra? engines could use it whatever they need18:44
dmitrymemattf: no problem, it was a surprise for me actually18:44
mattfalazarev, that's kinda what's wrong with it18:45
mattfdmitryme, i'm sure you just saved me a ton of pain later on when i'd be trying to figure out why things are happening when i didn't explicitly ask for them to happenm18:45
aignatovalazarev: I have nothing against extra18:45
mattfalazarev, i'm flexible, ok w/ adding so long as we record the fact that we should later remove it18:45
*** ndipanov has quit IRC18:46
dmitrymealazarev: I would prefer one more specific field in node group, like 'username', not just 'extra'18:46
SergeyLukjanovalazarev, my concern is that we're resurrecting extra for some objects in different patches instead of thinking about the common way to store additional info for objects18:46
SergeyLukjanovcustom/optional info18:46
alazarevdmitryme: heat doesn't need such field, what's why I used extra18:46
SergeyLukjanovplugin-specific maybe too18:46
SergeyLukjanovheat needs it too18:47
SergeyLukjanovbut it'll be ec2-user18:47
alazarevSergeyLukjanov: extra is a common way, no?18:47
SergeyLukjanovI think that could make it configurable for example18:47
SergeyLukjanovheat guys *18:47
*** amcrn has joined #openstack-meeting-alt18:47
SergeyLukjanovalazarev, not really, we're adding it for each object when we're need it18:48
*** nadya_ has joined #openstack-meeting-alt18:48
dmitrymealazarev: but the plugin does not know which engine is used, Heat or Direct18:48
tmckayhmmm, we have an "extra" in job_binary for EDP.  Maybe I should try to stamp that out too18:49
dmitrymeso it does not know how to get the username in a uniform way18:49
alazarevSergeyLukjanov: exactly! and I don't see problems here, let's extra be18:49
aignatovtmckay: it is specific EDP extra, don't worry about it :)18:49
*** sarob has joined #openstack-meeting-alt18:49
tmckayis "extra" extra good or extra bad?  That is the question18:49
mattf"extra" is a red flag for me, means we missed something in the design18:50
aignatovin EDP it is good18:50
alazarevdmitryme: yes, that's why we have corresponding method in engine. Engine could use extra or don't use18:50
tmckay:)  a Python programmer's best friend18:50
SergeyLukjanovtmckay, yup18:50
dmitrymealazarev: we can simply unconditionally set the username field in node group before passing the cluster to the plug18:51
dmitrymeIMHO that is much simplier18:51
jmarondmitryme:  I think I like that18:51
mattfdmitryme, nice thought18:51
alazarevmattf: if we keep something important in extra - yes, if it is used for caching or passing params - it's Ok for me18:52
*** _ruhe is now known as ruhe18:52
SergeyLukjanovdmitryme, +118:52
alazarevok, will change to username field, extra was used because of heat only18:52
SergeyLukjanovalazarev, yup, username field looks good18:53
aignatovok, agreed with username field18:53
SergeyLukjanovprobably we can add something to the orchestration engines to be able to override get_username behaviour18:53
aignatovbut what should we do with current extra field options in cluster obis?18:54
aignatovhttps://github.com/openstack/savanna/blob/master/savanna/plugins/vanilla/config_helper.py#L222-L23218:54
mattfalazarev, thanks for bring this up during the meeting. it helped me understand what you were after w/ that cr18:54
tmckayso, while we're here...18:55
tmckayI think I have just enough time to do more workflow extensions before Jan 2218:55
tmckaywhat would people like to see?  I know there is a roadmap note somewhere18:55
mattfspark?18:55
tmckayMaybe raw oozie workflows, or streaming18:56
tmckaymattf, I am unaware of oozie/spark integratoin18:56
mattfme too, more a ref to the inbound spark plugin18:56
alazarevaignatov: I vote to move hadoop_private_ssh_key and hadoop_public_ssh_key into fields and remove extra… to be consistent18:56
tmckayalso, there is a shell workflow that might be nice18:57
aignatovtmckay: maybe integration tests support of Java added action, updated rest api docs about new action?18:57
mattfalazarev, btw, what do we need the public part of that key for?18:57
SergeyLukjanovalazarev, it's only used by the vanilla plugin now I think, so, it's not good to make it a field18:57
tmckayaignatov, definitely, I was thinking maybe I have enough time after that for another...18:57
aignatovtmckay: what will be after Jan 22?18:58
tmckayOh, that's just the freeze18:58
SergeyLukjanovtmckay, code freeze for i218:58
dmitrymealazarev: do we really need to store these keys for the Vanilla plugin?18:58
dmitrymeI can't imagine why?18:58
aignatovdmitryme: we need, it simplify hadoop debugging after install18:59
alazarevSergeyLukjanov: this means that plugins could store data in cluster.extra but can't in node group.extra, that looks strange for me18:59
alazarevdmitryme: to put them on machine during scaling I believe19:00
mattfalazarev, you're not wrong19:00
SergeyLukjanovguys, I'd like to ask you to go through the https://launchpad.net/savanna/+milestone/icehouse-2 and decide what you'd like to do in i219:00
SergeyLukjanovwe're out of time19:00
SergeyLukjanovthanks all19:00
aignatovtmckay: another thing I thought in EDP would be nice is to implement multiple workflows19:00
SergeyLukjanov#endmeeting19:00
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"19:00
openstackMeeting ended Thu Jan  9 19:00:55 2014 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)19:00
dmitrymealazarev: got iyt19:00
openstackMinutes:        http://eavesdrop.openstack.org/meetings/savanna/2014/savanna.2014-01-09-18.10.html19:00
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/savanna/2014/savanna.2014-01-09-18.10.txt19:01
openstackLog:            http://eavesdrop.openstack.org/meetings/savanna/2014/savanna.2014-01-09-18.10.log.html19:01
dmitryme*it19:01
aignatovjust more than one action in workflow.xml ^_^19:01
*** hartsocks has left #openstack-meeting-alt19:01
*** jspeidel has left #openstack-meeting-alt19:01
*** mattf has left #openstack-meeting-alt19:01
*** NikitaKonovalov has quit IRC19:02
*** vponomaryov has joined #openstack-meeting-alt19:02
*** bob_nettleton has left #openstack-meeting-alt19:02
*** crobertsrh has left #openstack-meeting-alt19:02
*** nadya_ has quit IRC19:09
*** nadya_ has joined #openstack-meeting-alt19:10
*** SergeyLukjanov has quit IRC19:13
*** rsblendido has quit IRC19:14
*** rossella_s has quit IRC19:14
*** rsblendido has joined #openstack-meeting-alt19:15
*** rossella_s has joined #openstack-meeting-alt19:15
*** rossella_s has quit IRC19:15
*** aignatov has quit IRC19:15
*** eankutse has joined #openstack-meeting-alt19:16
*** tomblank has quit IRC19:20
*** doug_shelley66 has quit IRC19:23
*** doug_shelley66 has joined #openstack-meeting-alt19:24
*** NehaV1 has joined #openstack-meeting-alt19:28
*** doug_shelley66 has quit IRC19:30
*** vgnbkr_1 has quit IRC19:30
*** NehaV has quit IRC19:31
*** rnirmal has quit IRC19:33
*** doug_shelley66 has joined #openstack-meeting-alt19:36
*** rnirmal has joined #openstack-meeting-alt19:39
*** doug_shelley66 has quit IRC19:40
*** IlyaE has joined #openstack-meeting-alt19:40
*** colinmcnamara has joined #openstack-meeting-alt19:40
*** doug_shelley66 has joined #openstack-meeting-alt19:40
*** markmcclain has quit IRC19:42
*** vgnbkr_1 has joined #openstack-meeting-alt19:44
*** ruhe is now known as _ruhe19:44
*** nadya_ has quit IRC19:49
*** sarob has quit IRC19:50
*** sarob has joined #openstack-meeting-alt19:51
*** zhiyan has joined #openstack-meeting-alt19:51
*** sarob has quit IRC19:53
*** sarob has joined #openstack-meeting-alt19:53
*** pballand has quit IRC19:53
*** eshel has quit IRC19:56
*** gokrokve has joined #openstack-meeting-alt19:56
*** markmcclain has joined #openstack-meeting-alt19:56
*** noslzzp has quit IRC19:58
markwashAny glance folks around?20:01
icchahey20:01
rosmaitayo!20:01
zhiyanmarkwash: happy new year markwash, iccha20:01
markwash#startmeeting glance20:02
zhiyanand rosmaita!20:02
openstackMeeting started Thu Jan  9 20:02:06 2014 UTC and is due to finish in 60 minutes.  The chair is markwash. Information about MeetBot at http://wiki.debian.org/MeetBot.20:02
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.20:02
*** openstack changes topic to " (Meeting topic: glance)"20:02
openstackThe meeting name has been set to 'glance'20:02
arnaudhi20:02
markwashgreetings everyone20:02
markwashhappy 201420:02
markwashagenda link20:02
markwash#link https://etherpad.openstack.org/p/glance-team-meeting-agenda20:02
*** nadya_ has joined #openstack-meeting-alt20:03
markwasha lot of boiler plate to go through I think20:03
markwashso I'll go ahead and get started20:03
markwash#topic mini summit20:04
*** openstack changes topic to "mini summit (Meeting topic: glance)"20:04
markwashI hope folks saw my email announcing the details for the mini summit20:04
markwash#link http://lists.openstack.org/pipermail/openstack-dev/2013-December/023153.html20:04
markwashI've kicked off a draft agenda here20:04
markwash#link https://etherpad.openstack.org/p/glance-mini-summit-agenda20:04
arnauddo you have an idea approximately how many people will attend?20:05
markwashit had some initial looks and feedback20:05
markwasharnaud: I think the upper end is around 25 folks20:05
arnaudok sounds good!20:05
markwashprobably somewhere in the high teens20:05
*** vipuls is now known as vipuls-away20:05
*** vipuls-away is now known as vipuls20:05
markwashso we need your help to make this meeting a success, have a look at the agenda, add to it, add your interest20:06
markwashif there is anything that seems missing let me know20:06
markwashI think by next week we should have enough to start actually scheduling so folks know what they need to prepare in terms of discussion notes / slides / etc20:06
icchasounds good20:06
markwashthis is the first time doing a mini summit for. . um. . all of us? so I guess we'll be playing most of the parts by ear :-)20:07
markwashso we'll try to have fun :-)20:07
rosmaitait's just like a regular summit, only mini20:07
markwashany questions about the summit?20:07
*** boris-42 has quit IRC20:08
icchaso will we have separate time apart from these talks for discussions i hope ( i presume yes_20:08
markwashyes, I think so20:08
markwashthere will be some downtime for sure20:09
markwashand meals etc20:09
*** SergeyLukjanov has joined #openstack-meeting-alt20:09
markwashif you like, we can leave open some time for informal lightning talks etc20:09
arnaudfor now, there are ~10 talks, if all of them are 1h, 10h in 2 days, it seems there is time left for discussion20:09
markwashI also thought there might be some room if folks want to do a little hackathon type thing20:10
markwashbut I'm not exactly sure what form that would take, and would like to have a good idea before we devote time to it20:10
markwashanyway, food for thought in case anyone especially likes the idea20:10
markwashmoving on for today20:10
markwash#topic Icehouse 2 is closing soon20:10
*** openstack changes topic to "Icehouse 2 is closing soon (Meeting topic: glance)"20:10
zhiyanmarkwash: is there some plan to allow people "attend" the summit remotely who can't go there? like a remote video will be great20:11
markwashzhiyan: hmm, no plan as yet but maybe we can figure something out? it will probably be a terrible timing for you :-)20:11
arnaud+1 do we plan to at least record the talks?20:11
icchamaybe set up etherpads for notes. or use the same one20:11
*** SergeyLukjanov has quit IRC20:11
markwashzhiyan: but since its a small group it is possible that it would be easier to share e.g. with a google hangout or skype or some other software20:11
zhiyanhumm...i'm ok for the time, if we have way to attend remotely, i will join on that time :)20:12
markwashheh cool20:12
*** jmaron has quit IRC20:12
markwashiccha: perhaps some rackspace video equipment could be commandeered20:12
zhiyanarnaud: good idea20:12
icchamarkwash: fir recording or transmission? will ask around :)20:13
markwashrecording I guess is probably easiest and most important20:13
markwashbut I would love transmission if somebody knows how to do that20:13
zhiyanmarkwash: that will be great, transmission. iccha20:14
markwashwe are only going to have 1 room / 1 track so transmission might be easier than with the regular summits20:14
*** nadya_ has quit IRC20:14
zhiyanmarkwash: indeed20:14
markwashanyway, sometimes this stuff turns into a disaster, not much better than nothing, so let's not sink too much into it unless we feel confident20:15
markwashthis stuff -> trying to support full remote participation20:15
markwashrecording is a clear win, so if that's all we can get so be it20:15
markwashany further mini summit thoughts?20:15
icchawill ask about recording and let u know markwash20:16
markwashcool20:16
markwashOn to Icehouse 220:16
markwashall my thoughts are there on the meeting agenda page20:16
markwash#link https://launchpad.net/glance/+milestone/icehouse-220:16
markwashwe've got less than 2 weeks, since we'll probably want to cut on the 20th20:17
*** boris-42 has joined #openstack-meeting-alt20:17
markwashthe gate has been really rough lately, even without a crunch time20:17
markwashso I'm expecting very bad weather, so to speak20:17
markwashif you want to land something, you probably need to get it into the gate queue by the middle of next week20:17
markwashand reviewers need to be on hand to help with that process20:18
markwashI will note, we have some blueprints that aren't started yet20:18
markwashshould we consider deferring https://blueprints.launchpad.net/glance/+spec/new-download-workflow ?20:18
markwashor is the work just not up to date?20:18
markwashalso, flaper87 was working on https://blueprints.launchpad.net/glance/+spec/split-image-size but I haven't seen a patch yet, am I just missing it?20:19
icchawe do not have import script merged yet. so maybe we will have to jump similar hurdles for export20:19
icchai know nikhil started work on it but not sure where he is at20:19
markwashhmm okay20:21
markwashwell, if I don't hear back by tuesday I'm going to defer those two20:21
*** vipuls is now known as vipuls-away20:21
markwashany other thoughts on icehouse-2? questions?20:21
arnaudI think it would be good at the minisumit to have some time allocated to look at what is done, what was expected, what is left20:22
arnaudfor icehouse20:22
rosmaita+120:22
markwasharnaud: good idea20:22
*** ashwini has joined #openstack-meeting-alt20:23
markwashthat should be a good motivating discussion20:23
icchayeah could tie into the blueprint discussion20:23
markwashand help constrain our wilder plans on some of the other topics20:23
icchaashwini: says videoeqipment is a yes!20:23
markwashhuzzah, thanks ashwini20:24
arnaudnice :)20:24
ashwinisorry joining let but yes i will take care of that20:24
ashwinis/let/late20:24
zhiyanashwini: iccha thanks20:24
markwashokay cool, let's take a look at the review queue, my favorite topic :-P20:24
markwash#topic review backlog20:24
*** openstack changes topic to "review backlog (Meeting topic: glance)"20:24
markwashI posted a bunch of links in the agenda, not going to repost here20:25
markwashbut I think something ameade brought up in the past is still very relevant20:25
markwashI think we're still just trimming our queue with "abandoned due to inactivity"20:25
markwashsad times20:25
*** briancli1e is now known as briancline20:25
markwashwe've had queue growth over the past 3 months20:26
markwashI'm a bit afraid we're only going to recover from this when we figure out how to block out some of the noise20:27
markwashin terms of patches that are more churn than value20:27
markwashhopefully some automation around bugs, blueprints, and patches can help that20:27
markwashAnyone have thoughts on how we can fix our review backlog?20:27
icchais the problem not enough reviews or not enough reviewers or neither or both?20:28
icchaGlance Core team size: 10 (avg 1.0 reviews/day)20:29
icchaNova Core team size: 19 (avg 2.5 reviews/day)20:29
icchafor 90 days20:29
markwashI suppose the glance core team is a bit inflated, we probably have more like 5 active core members20:29
arnaudsome of the core glance are not reviewing code right?20:29
markwashwhich would bring us up to 2.0 reviews/day20:29
*** eharney has quit IRC20:30
*** jmaron has joined #openstack-meeting-alt20:30
markwashthe whole thing needs to be considered against our patch volume as well20:30
markwashwe get about 15 patchsets a day20:31
markwashand we get about 4 patches per change20:31
markwashso that's really only about 4 changes per day20:31
markwashoh, 3.7 per day over the past 90 days20:31
markwashof course, the number of reviews needed is something like patchsets / day + changes / day20:32
iccha  Changes abandoned in the last 90 days: 97 (1.1/day)20:32
markwashso that has us needing 18.5 reviews a day20:32
*** colinmcnamara has quit IRC20:33
markwashI can see a few ways to affect this20:33
markwashmore reviews (more reviewers * more reviews per reviewer)20:33
markwashfewer changes20:33
markwashfewer patchsets per change20:33
arnaudhow can you control fewer changes?20:34
nikhil___hi20:34
icchamore reviews on a given patchset20:34
icchaor more complete reviews20:34
markwasharnaud: I think we can potentially have some automatic -2s that essentially remove changes from consideration20:34
arnaudI see, interesting20:34
markwasharnaud: its essentially figuring out a way to raise the barrier to entry20:34
markwashwhich isn't considered a good thing by many20:35
arnaudyes I see, a queue before the queue :)20:35
markwashhowever, I just don't see how we can have much in the way of sanity if our review queue isn't averaging something close to zero20:35
icchafor example jenkins job fialing20:35
icchaon py27 tests or soemthing20:35
*** ErikB has joined #openstack-meeting-alt20:36
markwashiccha: I do feel like maybe something along the lines of better blueprint triage, like you've been looking into, could allow us to say "auto -2" to things that didn't have approved blueprints20:36
markwashI think better bug triage is another part of that picture20:36
markwashsince if we tightly control only one of blueprints or bugs, then the uncontrolled one becomes a shunt and everyone with an untagged change will just tag it as a bugfix or blueprint, whichever is easiest20:37
markwashwithout really adding any value in terms of up-front consideration20:37
markwashoh well, again more food for thought. . if the 5 active core folks we had just all tried to get 4 reviews per day, I think the queue would gradually go down20:38
icchais there a repo for gerrit or all this automation?20:38
markwashI'm trying to do 10-20 a day to get down to a lower queue level but I burn out kinda fast20:38
zhiyanmarkwash: cool20:39
markwashzhiyan: thanks so much for your help in that, btw!20:39
zhiyanmarkwash: np at all20:39
markwashI love how we seem to trade off timezones and the "Needs One More +2" queue :-)20:39
zhiyanmarkwash: yes, actually that's my first page on the morning20:40
markwashmine too :-)20:40
zhiyan:)20:40
icchaawwww :)20:40
icchasorry could not help it :p20:40
markwashlol20:40
nikhil___do you guys use some kinda of special query for that?20:40
nikhil___sorry jenkins filters dont seem intuitive to me20:40
markwashhttps://review.openstack.org/#/q/status:open+project:%255Eopenstack.*glance.*+branch:master+label:CodeReview%253D2+-label:CodeReview%253D-1+-+label:CodeReview%253D-2+-label:Approved%253D1,n,z20:40
nikhil___ty markwash20:41
zhiyanmarkwash: btw, could you pls share another worth quick-link with me/us? (maybe you can help do that on each meeting)20:41
markwashzhiyan: I don't exactly follow, can you elaborate?20:42
*** tomblank has joined #openstack-meeting-alt20:42
zhiyanmarkwash: oh, another link, just like this "Needs One More +2"20:42
zhiyanmarkwash: which can help me/us accelerate review/landing change20:42
markwashsure, what do you want this other link to point to?20:43
arnaudis there anything reviewers (who are not core), can do to accelerate the review process?20:43
*** spredzy has joined #openstack-meeting-alt20:43
icchareviews from everyone are welcome20:44
markwashwell, we could promote some active non-core folks to core20:44
icchacore or not20:44
arnaud(maybe focus of reviews related to approved bp?)20:44
markwashto help move things along?20:44
zhiyanmarkwash: no particular idea, just want to know your experience20:44
markwashI think -1s are always helpful when needed, also20:44
markwashzhiyan: ah sure thing20:44
markwashzhiyan: I can post all of the ones I use in an email if you like20:46
zhiyanmarkwash: lzy.dev@gmail.com20:46
arnaudthere is something I noticed, is that sometime, reviewers give one review on a patch, and then when the code is updated or whatever, it is harder to get another review.. do you guys have the same feeling?20:46
markwashyeah absolutely20:46
icchamarkwash: maybe share it in meeting etherpad?20:46
zhiyanmarkwash: thanks!20:46
icchaso all of us can have access to it20:46
markwashthat's part of the insanity of having such a long queue20:46
*** radix__ has quit IRC20:46
markwasharnaud: if you tend to feed off the bottom of the queue, then the second review after a fix takes forever to loop back around20:47
markwashI wonder if to respond to that we should try to top-feed off of the queue of reviewable items20:47
markwashbtw, link to reviewable changes:20:47
markwashhttps://review.openstack.org/#/q/-label:CodeReview%253C%253D-1+-label:Verified%253C%253D-1+-label:Approved%253E%253D1++-status:workinprogress+-status:draft+-is:starred+-owner:mark.washenberger%2540markwash.net+project:%255Eopenstack.*glance.*,n,z20:47
*** ViswaV has quit IRC20:47
*** mat-lowery has quit IRC20:47
markwashprobably want to put in your own name to that filter20:47
zhiyanmarkwash: cool20:49
markwashthe problem with that link I just shared is that its hard to find out when someone simply disagrees with a -1 and doesn't push a new patchset20:49
markwashbecause any -1 removes you from the queue20:49
*** pballand has joined #openstack-meeting-alt20:49
markwashokay, I wanna open up for discussion, but we can keep talking about reviews20:49
markwashI don't have any action items for this yet, I just want people to know the scale of the problem20:49
markwash#topic open discussion20:49
*** openstack changes topic to "open discussion (Meeting topic: glance)"20:49
nikhil___about the export script20:50
nikhil___Have started the work on swift store side of things, Fei had mentioned about working on the filesystem one20:50
nikhil___he was waiting on the executor to be pushed up20:50
arnaudreviews out?20:51
icchaThis is an important change and more diverse reviews the better on this one: https://review.openstack.org/#/c/34801/20:51
nikhil___I'm planning to work for next 3-5 days on export and then work on executor20:51
nikhil___markwash: ^^20:51
markwashnikhil___: okay great, daily or semi-daily report emails appreciated, they're great reminders for me20:51
markwashdon't have to be long or formal at all :-)20:52
*** denis_makogon_ has joined #openstack-meeting-alt20:52
*** Duane_ has joined #openstack-meeting-alt20:52
markwashiccha: does that patch do what you guys want it to at RS?20:52
markwashI've been a bit nervous though I look at it in my queue every day20:52
*** denis_makogon has quit IRC20:52
*** denis_makogon_ is now known as denis_makogon20:52
*** dmakogon_ has joined #openstack-meeting-alt20:53
nikhil___markwash: sure will start them back on starting tomorrow. (Have just been distracted by either being sick or having my apartment getting flooded), Focus on reviews and MP would be back on next week onwards.20:53
markwashoh my20:53
markwashwell I hope your health and apartment are returning to working order!20:53
icchamarkwash: it looked like the best temporary solution. it makes me nervous too. thats why not rushing it and would like more eyes on it20:53
*** dprince has quit IRC20:53
nikhil___thank you!20:54
markwashiccha: okay cool I'll stop avoiding it then :-)20:54
arnaudiccha: will look at it too20:55
markwashAny other thoughts? or shall we close out? I can start my lunch ;-)20:55
nikhil___markwash: just one comment20:55
nikhil___I will try to have the tasks demo in the mini summit on RS cloud + swift20:56
markwashoh awesome!20:56
*** Duane has quit IRC20:56
markwashthanks nikhil___20:56
nikhil___not sure if I can have it done on filesystem +devstack though20:56
nikhil___great20:56
markwashthat sounds really good20:56
markwashokay, thanks everyone, have a nice rest of your week and weekend20:56
rosmaitabye!20:56
arnaudbye20:56
icchathanks markwash20:56
markwashthink about what you want out of the mini summit!20:57
zhiyanbye!20:57
markwash#endmeeting20:57
*** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings"20:57
openstackMeeting ended Thu Jan  9 20:57:03 2014 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)20:57
openstackMinutes:        http://eavesdrop.openstack.org/meetings/glance/2014/glance.2014-01-09-20.02.html20:57
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/glance/2014/glance.2014-01-09-20.02.txt20:57
openstackLog:            http://eavesdrop.openstack.org/meetings/glance/2014/glance.2014-01-09-20.02.log.html20:57
*** Barker has quit IRC20:59
*** lblanchard has quit IRC20:59
*** Barker has joined #openstack-meeting-alt20:59
*** ashwini has left #openstack-meeting-alt21:05
*** eharney has joined #openstack-meeting-alt21:05
*** vipuls-away is now known as vipuls21:08
*** dmitryme has quit IRC21:16
*** gokrokve has quit IRC21:21
*** gokrokve has joined #openstack-meeting-alt21:22
*** julim has quit IRC21:22
*** gokrokve has quit IRC21:26
*** colinmcnamara has joined #openstack-meeting-alt21:27
*** jmaron has quit IRC21:28
*** pballand has quit IRC21:29
*** zhiyan has left #openstack-meeting-alt21:35
*** ViswaV has joined #openstack-meeting-alt21:43
*** ViswaV has quit IRC21:44
*** jmaron has joined #openstack-meeting-alt21:44
*** ViswaV has joined #openstack-meeting-alt21:44
*** sc68cal has quit IRC21:46
*** sc68cal has joined #openstack-meeting-alt21:47
*** DennyZhang has joined #openstack-meeting-alt21:47
*** banix has quit IRC21:48
*** banix has joined #openstack-meeting-alt21:49
*** sarob has quit IRC21:50
*** sarob has joined #openstack-meeting-alt21:51
*** jdob has quit IRC21:52
*** DennyZhang has quit IRC21:53
*** sarob_ has joined #openstack-meeting-alt21:53
*** Duane_ has quit IRC21:53
*** BrianB_ has joined #openstack-meeting-alt21:55
*** sarob has quit IRC21:56
*** mat-lowery has joined #openstack-meeting-alt21:56
*** nati_ueno has quit IRC21:56
*** nati_ueno has joined #openstack-meeting-alt21:59
*** pcm_ has joined #openstack-meeting-alt22:01
*** pdmars has quit IRC22:02
*** nati_ueno has quit IRC22:03
*** dane_ has joined #openstack-meeting-alt22:04
*** nati_ueno has joined #openstack-meeting-alt22:04
*** jmontemayor has quit IRC22:06
*** eankutse has quit IRC22:08
*** markwash has quit IRC22:10
*** pcm_ has quit IRC22:11
*** doug_shelley66 has quit IRC22:13
*** gokrokve has joined #openstack-meeting-alt22:14
*** mestery has quit IRC22:16
*** mestery has joined #openstack-meeting-alt22:19
*** jprovazn has quit IRC22:24
*** markwash has joined #openstack-meeting-alt22:24
*** radix_ has joined #openstack-meeting-alt22:27
*** flaper87 is now known as flaper87|afk22:30
*** NehaV has joined #openstack-meeting-alt22:32
*** ijw has joined #openstack-meeting-alt22:33
*** NehaV1 has quit IRC22:34
*** amytron has quit IRC22:35
*** markwash has quit IRC22:35
*** kebray_ has quit IRC22:38
*** pnavarro has quit IRC22:40
*** BrianB_ has quit IRC22:40
*** rwsu has quit IRC22:45
*** doug_shelley66 has joined #openstack-meeting-alt22:46
*** kebray_ has joined #openstack-meeting-alt22:50
*** nati_ueno has quit IRC22:54
*** markmcclain has quit IRC22:54
*** sacharya has quit IRC22:55
*** nati_ueno has joined #openstack-meeting-alt22:56
*** nati_ueno has quit IRC22:57
*** nati_ueno has joined #openstack-meeting-alt22:57
*** Barker has quit IRC22:59
*** sarob_ has quit IRC23:01
*** vgnbkr_1 has quit IRC23:01
*** sarob has joined #openstack-meeting-alt23:01
*** tmckay is now known as _tmckay23:02
*** vponomaryov has left #openstack-meeting-alt23:02
*** jmaron has quit IRC23:02
*** jmaron has joined #openstack-meeting-alt23:04
*** sarob has quit IRC23:06
*** yogesh has quit IRC23:06
*** yogesh has joined #openstack-meeting-alt23:06
*** denis_makogon has quit IRC23:07
*** jecarey has quit IRC23:08
*** NehaV has quit IRC23:11
*** yogesh has quit IRC23:11
*** yamahata has quit IRC23:14
*** jmaron has quit IRC23:17
*** jasonb365 has quit IRC23:20
*** gduan has joined #openstack-meeting-alt23:31
*** garyduan has quit IRC23:33
*** sacharya has joined #openstack-meeting-alt23:36
*** sballe has quit IRC23:36
*** sballe has joined #openstack-meeting-alt23:36
*** mozawa has quit IRC23:39
*** markwash has joined #openstack-meeting-alt23:43
*** vgnbkr_1 has joined #openstack-meeting-alt23:53
*** vipuls is now known as vipuls-away23:56
*** vipuls-away is now known as vipuls23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!