Monday, 2015-06-08

*** sdake_ has joined #openstack-nova00:06
*** sdake has quit IRC00:10
gmannjogo: Please have a look on functional tests merge patches - https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:merge_sample_tests,n,z00:10
*** Glass_saga has joined #openstack-nova00:23
Glass_sagaCan anyone review this? Thanks in advance. https://bugs.launchpad.net/python-novaclient/+bug/124851700:24
openstackLaunchpad bug 1248517 in python-novaclient "Set admin_pass not possible through CLI" [Wishlist,In progress] - Assigned to Masaki Matsushita (mmasaki)00:24
*** markvoelker has joined #openstack-nova00:25
*** markvoelker has quit IRC00:30
*** tonytan4ever has joined #openstack-nova00:31
*** sdake has joined #openstack-nova00:32
*** sdake_ has quit IRC00:35
*** igordcard has quit IRC00:36
*** mitz has joined #openstack-nova00:47
*** otter768 has joined #openstack-nova00:48
*** pixelbeat_ has quit IRC00:50
*** yingjun has joined #openstack-nova00:52
*** otter768 has quit IRC00:52
*** sdake_ has joined #openstack-nova01:06
*** dims__ has quit IRC01:06
*** jamielennox|away is now known as jamielennox01:07
*** sdake__ has joined #openstack-nova01:09
*** sdake has quit IRC01:09
*** sdake__ is now known as sdake01:09
*** mriedem has quit IRC01:11
*** sdake_ has quit IRC01:13
*** dave-mccowan has quit IRC01:24
*** aix has quit IRC01:26
*** eliqiao1 has quit IRC01:34
*** eliqiao has joined #openstack-nova01:37
*** eliqiao has left #openstack-nova01:39
*** heyongli has joined #openstack-nova01:40
heyonglithis patch broken the pci, https://review.openstack.org/#/c/188486/,   this can be avoid by merge this fix:https://review.openstack.org/#/c/131321/,01:42
heyongliso,  we might should review that fix,  to avoid such conner bugs of pci.01:43
*** sdake_ has joined #openstack-nova01:43
*** annashen has joined #openstack-nova01:45
heyongliwait, let me check that log -:001:45
*** dave-mccowan has joined #openstack-nova01:46
*** sdake has quit IRC01:46
*** sdake has joined #openstack-nova01:54
*** sdake_ has quit IRC01:58
*** dims_ has joined #openstack-nova01:58
*** jwcroppe_ has joined #openstack-nova02:03
*** Kennan2 has joined #openstack-nova02:03
*** dims_ has quit IRC02:03
*** Kennan has quit IRC02:04
*** baoli has joined #openstack-nova02:05
*** jwcroppe has quit IRC02:05
*** baoli has quit IRC02:09
openstackgerritheijlong proposed openstack/nova: Merge extended-volume functional tests of v2 and v2.1  https://review.openstack.org/17321602:12
*** park_heijlong has joined #openstack-nova02:12
*** markvoelker has joined #openstack-nova02:14
*** markvoelker has quit IRC02:19
*** tonytan4ever has quit IRC02:22
*** bzhao has joined #openstack-nova02:22
*** sdake_ has joined #openstack-nova02:25
*** bzhao has quit IRC02:29
*** sdake has quit IRC02:29
*** Glaupre has quit IRC02:32
*** davidlenwell has quit IRC02:33
*** sdake has joined #openstack-nova02:44
openstackgerritwangxiyuan proposed openstack/nova: Add security group check when boot with port  https://review.openstack.org/18899302:46
*** sdake_ has quit IRC02:48
*** otter768 has joined #openstack-nova02:48
*** otter768 has quit IRC02:53
*** patrickeast has quit IRC02:58
*** Jeffrey4l has joined #openstack-nova02:58
*** zhenguo has joined #openstack-nova03:03
*** dims_ has joined #openstack-nova03:03
*** aswadr has joined #openstack-nova03:04
*** dims_ has quit IRC03:09
*** annashen has quit IRC03:12
*** liusheng has joined #openstack-nova03:13
*** heyongli has quit IRC03:13
*** heyongli has joined #openstack-nova03:14
*** vilobhmm has joined #openstack-nova03:16
*** annashen has joined #openstack-nova03:18
openstackgerritKen'ichi Ohmichi proposed openstack/nova: Add and use raise_feature_not_supported()  https://review.openstack.org/16369703:18
openstackgerritKen'ichi Ohmichi proposed openstack/nova: Add a hacking rule for consistent HTTP501 message  https://review.openstack.org/16369803:18
openstackgerritKevin Benton proposed openstack/nova: Set default event status to completed  https://review.openstack.org/18917603:22
*** park_heijlong has quit IRC03:23
*** mdbooth has quit IRC03:27
*** pkholkin has quit IRC03:27
*** toure has quit IRC03:27
*** tanee has quit IRC03:27
*** heyongli has quit IRC03:27
*** josecastroleon has quit IRC03:27
*** bradjones|away has quit IRC03:27
*** winston-d has quit IRC03:27
*** mnestratov has quit IRC03:27
*** mestery_afk has quit IRC03:27
*** asselin has quit IRC03:27
*** aluria has quit IRC03:27
*** mikal has quit IRC03:27
*** ondergetekende has quit IRC03:27
*** toure has joined #openstack-nova03:27
*** pkholkin has joined #openstack-nova03:27
*** mdbooth has joined #openstack-nova03:27
*** tanee has joined #openstack-nova03:28
*** mikal has joined #openstack-nova03:28
*** winston-d has joined #openstack-nova03:28
*** aluria has joined #openstack-nova03:28
*** ondergetekende has joined #openstack-nova03:28
*** josecastroleon has joined #openstack-nova03:28
*** mnestratov|3 has joined #openstack-nova03:28
*** bradjones has joined #openstack-nova03:28
*** bradjones has quit IRC03:28
*** bradjones has joined #openstack-nova03:28
*** asselin has joined #openstack-nova03:28
*** mestery has joined #openstack-nova03:28
*** annashen has quit IRC03:31
*** annashen has joined #openstack-nova03:32
*** annashen has quit IRC03:37
*** annashen has joined #openstack-nova03:38
*** annashen has quit IRC03:43
*** coolsvap|afk is now known as coolsvap03:44
*** deepthi has joined #openstack-nova03:45
*** yingjun has quit IRC03:50
*** annashen has joined #openstack-nova03:54
*** davidlenwell has joined #openstack-nova03:55
*** dave-mcc_ has joined #openstack-nova03:55
openstackgerritRui Chen proposed openstack/nova: Refactor network API 'get_instance_nw_info'  https://review.openstack.org/14603603:56
*** dave-mccowan has quit IRC03:57
*** dave-mcc_ has quit IRC03:59
*** armax has joined #openstack-nova03:59
*** armax has quit IRC04:04
*** jang has joined #openstack-nova04:13
*** jwcroppe has joined #openstack-nova04:18
*** jwcroppe_ has quit IRC04:21
*** annashen has quit IRC04:23
*** annashen has joined #openstack-nova04:23
*** annashen has quit IRC04:25
*** annashen has joined #openstack-nova04:25
*** annashen has quit IRC04:26
*** irenab has quit IRC04:26
*** annashen has joined #openstack-nova04:26
*** annashen has quit IRC04:27
*** garyk has quit IRC04:29
*** armax has joined #openstack-nova04:30
*** unicell1 has joined #openstack-nova04:31
*** lpetrut has joined #openstack-nova04:32
*** achanda has joined #openstack-nova04:33
*** unicell has quit IRC04:33
*** annashen has joined #openstack-nova04:33
*** armax has quit IRC04:35
*** otter768 has joined #openstack-nova04:49
*** otter768 has quit IRC04:54
*** achanda has quit IRC04:55
*** Maike has joined #openstack-nova05:02
*** nihilifer_ has joined #openstack-nova05:09
*** annashen has quit IRC05:09
*** achanda has joined #openstack-nova05:13
*** belmoreira has joined #openstack-nova05:20
*** achanda_ has joined #openstack-nova05:22
*** achanda has quit IRC05:23
*** irenab has joined #openstack-nova05:25
openstackgerritAndrey Pavlov proposed openstack/nova: template for disabe_terminate and shutdown_terminate flags  https://review.openstack.org/18911205:25
*** eliqiao has joined #openstack-nova05:27
*** achanda_ has quit IRC05:28
*** oomichi has joined #openstack-nova05:28
*** vilobhmm has quit IRC05:32
*** iamjarvo has quit IRC05:34
*** lsmola has joined #openstack-nova05:36
*** apuimedo has joined #openstack-nova05:37
*** vilobhmm has joined #openstack-nova05:39
*** yingjun has joined #openstack-nova05:40
*** lpetrut has left #openstack-nova05:45
*** Kennan2 has quit IRC05:47
*** arnaud____ has joined #openstack-nova05:47
*** Kennan has joined #openstack-nova05:48
*** markvoelker has joined #openstack-nova05:52
*** sudipto has joined #openstack-nova05:54
*** markvoelker has quit IRC05:56
*** jcoufal has joined #openstack-nova05:57
*** pradipta has joined #openstack-nova05:58
*** destiny has joined #openstack-nova06:02
*** tteggel has quit IRC06:04
*** belmoreira has quit IRC06:06
*** arnaud____ has quit IRC06:13
*** josecastroleon has quit IRC06:19
*** achanda has joined #openstack-nova06:19
*** arnaud____ has joined #openstack-nova06:20
*** moshele has joined #openstack-nova06:36
*** dulek has joined #openstack-nova06:39
openstackgerritRui Chen proposed openstack/nova: Fix resource leaking when consume_from_instance raise exception  https://review.openstack.org/18216506:40
openstackgerritshihanzhang proposed openstack/nova: Optimize validate_networks  https://review.openstack.org/17574206:40
*** tobe has joined #openstack-nova06:45
*** mordred has quit IRC06:46
*** arnaud____ has quit IRC06:47
*** abhishekk has joined #openstack-nova06:49
openstackgerritKevin Benton proposed openstack/nova: Set default event status to completed  https://review.openstack.org/18917606:50
*** heyongli has joined #openstack-nova06:50
*** otter768 has joined #openstack-nova06:50
openstackgerritYongli He proposed openstack/nova: resource tracker style pci resource management  https://review.openstack.org/13132106:51
*** lennyb has joined #openstack-nova06:51
*** garyk has joined #openstack-nova06:51
*** ajayaa has joined #openstack-nova06:51
*** otter768 has quit IRC06:55
*** sahid has joined #openstack-nova06:57
*** vilobhmm has quit IRC07:02
*** achanda has quit IRC07:02
*** lpetrut has joined #openstack-nova07:03
*** tojuvone has joined #openstack-nova07:03
*** achanda has joined #openstack-nova07:04
*** arnaud____ has joined #openstack-nova07:05
garykBobBall: you around? Ci is down.07:09
*** masayukig has quit IRC07:12
*** kiwik-chenrui has quit IRC07:14
*** markus_z has joined #openstack-nova07:16
*** masayukig has joined #openstack-nova07:17
*** achanda has quit IRC07:17
*** RuiChen has joined #openstack-nova07:19
*** lpetrut1 has joined #openstack-nova07:28
*** arnaud____ has quit IRC07:28
rgerganovalex_xu: hi07:28
rgerganovalex_xu: any chance we can get some core attention on https://review.openstack.org/#/c/185844/ ?07:28
*** lpetrut has quit IRC07:31
*** gilliard has joined #openstack-nova07:34
openstackgerritgaryk proposed openstack/nova: VMware: convert driver to use nova.objects.ImageMeta  https://review.openstack.org/18908507:37
*** markvoelker has joined #openstack-nova07:40
*** matrohon has joined #openstack-nova07:40
*** lpetrut1 has quit IRC07:43
*** markvoelker has quit IRC07:45
*** dguitarbite has joined #openstack-nova07:46
*** jlanoux has joined #openstack-nova07:48
*** lpetrut has joined #openstack-nova07:48
*** ian_brown has quit IRC07:50
*** ian_brown_ has joined #openstack-nova07:50
*** romainh has joined #openstack-nova07:52
*** jistr has joined #openstack-nova07:52
gilliardoomichi: are you still there?07:56
gilliardoomichi: I have a question about https://review.openstack.org/#/c/163698/907:56
*** ian_brown_ has quit IRC07:57
*** jlanoux has quit IRC07:57
*** lpetrut1 has joined #openstack-nova07:57
*** jlanoux has joined #openstack-nova07:58
*** pbandzi has joined #openstack-nova07:58
*** lpetrut has quit IRC08:00
*** belmoreira has joined #openstack-nova08:00
*** dguitarbite has quit IRC08:01
*** ZZelle has joined #openstack-nova08:01
*** pixelbeat_ has joined #openstack-nova08:01
*** matrohon has quit IRC08:05
gilliardoomichi: OK I'll just comment on the patch...08:05
*** lucasagomes has joined #openstack-nova08:05
*** davidlenwell has quit IRC08:06
*** afazekas_mtg has joined #openstack-nova08:06
*** davidlenwell has joined #openstack-nova08:09
*** annashen has joined #openstack-nova08:10
*** matrohon has joined #openstack-nova08:11
*** claudiub has joined #openstack-nova08:11
*** claudiub_ has joined #openstack-nova08:13
*** derekh has joined #openstack-nova08:14
*** achanda has joined #openstack-nova08:14
*** yingjun has quit IRC08:14
*** annashen has quit IRC08:14
*** claudiub has quit IRC08:15
*** ndipanov has joined #openstack-nova08:15
*** josecastroleon has joined #openstack-nova08:18
*** yingjun has joined #openstack-nova08:20
*** danpb has joined #openstack-nova08:22
openstackgerritAlex Xu proposed openstack/nova-specs: Remove v3 from nova code tree  https://review.openstack.org/18921808:22
*** exploreshaifali has joined #openstack-nova08:23
*** davidlenwell has quit IRC08:23
*** lxsli has joined #openstack-nova08:24
BobBallthanks garyk - investigating08:25
openstackgerritTimofey Durakov proposed openstack/nova: Split instance resize operation into 2 phases  https://review.openstack.org/18449508:27
*** shihanzhang has joined #openstack-nova08:27
BobBallgaryk: Seems that it's working but it's taking forever to create new nodes so only a very few jobs run at any time and there is a huge backlog...08:27
garykBobBall: thanks08:27
BobBallgaryk: Your change got commented on late last night :)08:27
BobBallI'll fix it today08:28
garykdanpb: you around? i have some questions reqgarding the image_meta props08:28
garykthanks!08:28
*** dims_ has joined #openstack-nova08:28
openstackgerritMh Raies proposed openstack/nova: Enable tenant/user specific instance filtering  https://review.openstack.org/13902508:28
*** hanzhang has quit IRC08:28
*** shz has joined #openstack-nova08:29
*** achanda has quit IRC08:29
*** davidlenwell has joined #openstack-nova08:30
*** achanda has joined #openstack-nova08:30
*** yassine_ has joined #openstack-nova08:30
*** lpetrut1 has quit IRC08:31
*** yassine_ has quit IRC08:31
*** yassine_ has joined #openstack-nova08:32
*** shihanzhang has quit IRC08:33
*** dims_ has quit IRC08:33
*** dguitarbite has joined #openstack-nova08:34
*** achanda has quit IRC08:35
*** liusheng has quit IRC08:36
*** liusheng has joined #openstack-nova08:36
*** aix has joined #openstack-nova08:41
garykdanpb: i have a few issue with the image meta which maybe you can help clarify. in the vmware driver there is a disk_type and a disk_adapter. the possible adapter types are: https://github.com/openstack/nova/blob/master/nova/virt/vmwareapi/constants.py#L50. In the image meta this is https://github.com/openstack/nova/blob/master/nova/objects/image_meta.py#L288 (which I do not think is correct). wnated to hear what you have to say08:45
*** Kevin_Zheng has quit IRC08:47
*** Kevin_Zheng has joined #openstack-nova08:48
*** achanda has joined #openstack-nova08:49
*** lpetrut has joined #openstack-nova08:49
*** eglynn has joined #openstack-nova08:50
*** otter768 has joined #openstack-nova08:51
*** prashant-up has joined #openstack-nova08:51
openstackgerritsahid proposed openstack/nova: libvirt: introduce method to attach device  https://review.openstack.org/18876308:53
openstackgerritsahid proposed openstack/nova: libvirt: introduce method detach_device to Guest object  https://review.openstack.org/18876508:53
openstackgerritsahid proposed openstack/nova: libvirt: remove _get_disk_xml to use get_disk from Guest  https://review.openstack.org/18876408:53
*** claudiub_ has quit IRC08:54
*** lpetrut has quit IRC08:54
*** leopoldj has joined #openstack-nova08:54
*** achanda has quit IRC08:56
*** otter768 has quit IRC08:56
*** dulek has quit IRC08:56
*** achanda has joined #openstack-nova08:57
*** danpb has left #openstack-nova08:58
*** danpb has joined #openstack-nova08:58
*** dulek has joined #openstack-nova08:59
*** ajayaa has quit IRC09:00
*** ociuhandu has quit IRC09:01
*** achanda has quit IRC09:03
*** prashant-up has quit IRC09:05
openstackgerritgaryk proposed openstack/nova: VMware: convert driver to use nova.objects.ImageMeta  https://review.openstack.org/18908509:05
openstackgerritJohn Garbutt proposed openstack/nova-specs: Add liberty priorities  https://review.openstack.org/18727209:05
garykdanpb: not sure if you saw the message above. but i think that for the vmware driver we should be using 'hw_disk_bus' instead of ''hw_scsi_model'09:08
*** lpetrut has joined #openstack-nova09:09
*** varya has joined #openstack-nova09:12
johnthetubaguysuperdan: there is an interesting spec if you get a moment, it relates to some of your evacuate work I think: https://review.openstack.org/#/c/183033/1/specs/liberty/approved/optional-shared-storage-flag-in-evacuate-api.rst,cm09:12
danpbgaryk: in which part ?09:12
danpboh, you mean as a replacement for vmware_adaptertype ?09:13
garykdanpb: yes, correct09:13
garyki started a pacth on https://review.openstack.org/189086 but wanted to chat with you first.09:13
openstackgerritAndrey Pavlov proposed openstack/nova: template for disabe_terminate and shutdown_terminate flags  https://review.openstack.org/18911209:14
*** prashup has joined #openstack-nova09:15
openstackgerritKevin Benton proposed openstack/nova: Set default event status to completed  https://review.openstack.org/18917609:15
danpbgaryk: no, that doesn't really work - i'll reply on the review rather than here09:16
*** ajayaa has joined #openstack-nova09:16
*** haypo has joined #openstack-nova09:18
garykdanok, thanks.09:19
*** Kevin_Zheng has quit IRC09:21
*** Kevin_Zheng has joined #openstack-nova09:21
*** Nisha has joined #openstack-nova09:23
*** dulek has quit IRC09:23
kashyapsahid: Not sure if you've noticed this, seems like you're already working on this area ("libvirt-set-admin-password -- https://bugs.launchpad.net/nova/+bug/146223909:23
openstackLaunchpad bug 1462239 in OpenStack Compute (nova) "libvirt: thrown NotImplementedError when running "nova root-password"" [Undecided,New] - Assigned to javeme (javaloveme)09:23
sahidkashyap: nice i did not notived this09:24
kashyapsahid: Yeah, he might be duplicating the work, so I added that note with a pointer to your in-progress work.09:24
sahidkashyap: thank yyou i also have a spec in progress09:25
sahidbw if you want to review it https://review.openstack.org/#/c/187509/09:25
sahid:)09:25
kashyapThanks, will read. I briefly tested it w/ QMP command and w/ virsh's `qemu-agent-command`.09:26
*** dulek has joined #openstack-nova09:28
*** lpetrut1 has joined #openstack-nova09:29
*** dulek has quit IRC09:29
*** markvoelker has joined #openstack-nova09:29
*** dulek has joined #openstack-nova09:30
*** lpetrut has quit IRC09:31
*** achanda has joined #openstack-nova09:31
openstackgerritMatthew Booth proposed openstack/nova: Implement compare-and-swap for instance update  https://review.openstack.org/14111509:32
*** yingjun has quit IRC09:33
*** alexpilotti has joined #openstack-nova09:33
*** achanda has quit IRC09:33
*** markvoelker has quit IRC09:34
*** achanda has joined #openstack-nova09:34
*** claudiub has joined #openstack-nova09:35
*** gszasz has joined #openstack-nova09:35
claudiubjohnthetubaguy: hello09:37
johnthetubaguyclaudiub: hi09:38
claudiubjohnthetubaguy: so, I've read the nova-liberty-summit-action-items you've created on etherpad, and there are a couple of things09:39
sahidgaryk: i rplied on your comments https://review.openstack.org/#/c/188763/ - not sure if that will clearly respond of them, please let me know09:40
claudiubjohnthetubaguy: 1st of all, the hyper-v cluster spec is here: https://review.openstack.org/18837409:40
*** haigang has joined #openstack-nova09:40
claudiubjohnthetubaguy: secondly, will the instance live-resize bp still be a thing?09:41
garyksahid: thanks! i have changed my score. i was just not clear09:41
claudiubjohnthetubaguy: because I saw it as an item, adding a devref for that09:41
johnthetubaguyclaudiub: in its current form, no, we need to work out how it would look across multiple hypervisors09:41
claudiubjohnthetubaguy: ps: i will have to update tomorrow the hyper-v cluster spec.09:42
johnthetubaguyclaudiub: so I want to refine our scope document to better reflect whats going on with that debate, so we can revisit the concept09:42
claudiubjohnthetubaguy: well, if there is anything I can help on that, let me know.09:43
openstackgerritJohn Garbutt proposed openstack/nova-specs: Remove disable_terminate  https://review.openstack.org/18302309:44
johnthetubaguyclaudiub: thanks, will need a good review when its ready, but right now focusing on spec reviews, given the looming deadlines there09:44
*** kbyrne has quit IRC09:45
openstackgerritgaryk proposed openstack/nova: VMware: convert driver to use nova.objects.ImageMeta  https://review.openstack.org/18908509:45
sahidgaryk: cool :)09:46
eliqiao johnthetubaguy:  hi john, can you help update spec on  https://review.openstack.org/#/c/163274/ https://review.openstack.org/#/c/163275/ ?09:46
johnthetubaguyeliqiao: hello, let me take a look at your comments, and try answer the questions there09:47
eliqiaojohnthetubaguy:  okay, I believe they are only nics..09:48
*** kbyrne has joined #openstack-nova09:48
johnthetubaguyeliqiao: for this one: https://review.openstack.org/#/c/163274/9/specs/liberty/approved/validate-service-state-before-deleting.rst,cm09:48
johnthetubaguyeliqiao: what I mean is, requests that come to the API before your new microversion will get the existing behaviour, right?09:49
*** claudiub has quit IRC09:51
*** achanda_ has joined #openstack-nova09:51
eliqiaojohnthetubaguy:  for API, do you mean compute_api ? then I get you.09:51
*** claudiub has joined #openstack-nova09:51
johnthetubaguyeliqiao: I mean the public REST API09:52
johnthetubaguyeliqiao: your change should only apply to REST requests with a version header that are equal or higher to when you introduced the change09:52
eliqiaojohnthetubaguy:  ah, I get you ;) I will add it more explicitly09:52
johnthetubaguyeliqiao: cool, thanks09:53
eliqiaojohnthetubaguy:  you are nice, I think that is a stupid question. thanks again.09:53
johnthetubaguyeliqiao: yeah, its more that its not totally clear from the current wording (actually it sounds a bit the other way around)09:53
johnthetubaguyeliqiao: its a very good question, no problems at all09:53
*** pbandzi has quit IRC09:53
*** achanda has quit IRC09:53
*** pbandzi has joined #openstack-nova09:55
*** yassine_ has quit IRC09:55
*** prashup has quit IRC09:56
mnestratov|3danpb: Hi09:58
mnestratov|3I have a question about HVSpec object versioning. If I change the number of reported hv_types, should I bump up HVSpec version?09:58
*** mnestratov|3 is now known as mnestratov09:58
*** L33 is now known as lyarwood09:59
*** sdake has quit IRC10:00
*** varya_ has joined #openstack-nova10:02
*** varya has quit IRC10:03
*** boris-42 has joined #openstack-nova10:04
*** claudiub has quit IRC10:06
*** tteggel has joined #openstack-nova10:08
*** openstackgerrit has quit IRC10:09
*** dims_ has joined #openstack-nova10:09
*** openstackgerrit has joined #openstack-nova10:09
johnthetubaguydanpb: ndipanov: if either of you have a moment, I think this spec would benefit from you having a look at it: https://review.openstack.org/#/c/183057/3/specs/liberty/approved/nova-api-hypervsor-cpu-info.rst,cm10:09
ndipanovjohnthetubaguy, hmmm, I thought that was settled :) I guess not10:10
openstackgerritAlvaro Lopez Garcia proposed openstack/nova: scheduler: weight nodes based on their cached images  https://review.openstack.org/17330410:10
openstackgerritAlvaro Lopez Garcia proposed openstack/nova: Add new image cache monitor in compute nodes  https://review.openstack.org/17330310:10
openstackgerritAlvaro Lopez Garcia proposed openstack/nova: vmware: add image_cache_manager property  https://review.openstack.org/18760210:10
openstackgerritAlvaro Lopez Garcia proposed openstack/nova: compute monitors: set update delta from base class  https://review.openstack.org/17398710:10
johnthetubaguyndipanov: did we write down what we agreed somewhere?10:11
ndipanovoh no this is something else10:11
ndipanovso10:11
ndipanovI was under the impression that we want to make this an object10:12
ndipanovactually there is a comment in the code for that10:12
*** tteggel has quit IRC10:12
ndipanovnot really related to exposing it in the API10:12
openstackgerritRui Chen proposed openstack/nova-specs: CreateVM supports subnet specified  https://review.openstack.org/16963810:12
ndipanovhow does this work with microversions johnthetubaguy ?10:13
ndipanovif it's business as usual - add a microversion and that's it - why not just call this a bugfix?10:13
*** tteggel has joined #openstack-nova10:13
johnthetubaguyndipanov: all API changes need a spec, for the moment10:14
ndipanovI see10:14
ndipanovthat is actually probably a good idea10:14
johnthetubaguyndipanov: when we didn't require that, we kept screwing up the API in ways that we can't fix10:14
ndipanovyep completely agree10:14
ndipanovwell10:15
johnthetubaguyI am hoping we will find some simple patterns, eventually, where its just a bug fix10:15
johnthetubaguybut right now, we haven't seen those emerge, I guess10:15
ndipanovso the thing is - it would be really good to objectify this as part of this changer10:15
*** Nisha has quit IRC10:15
johnthetubaguy500-> existing error code is likely to be one10:15
johnthetubaguyndipanov: for the above change, I think it just gets added in a specific microversion, which removes the old method at the same time, which works OK (although none of that is stated in the spec, I added a comment about that).10:16
johnthetubaguyndipanov: good point about the object in the code though, ideally its close to the API we come up with10:17
ndipanovjohnthetubaguy, https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L499810:17
johnthetubaguyI mean, there are good reasons they might be totally different, but it would be nice not to miss stuff10:17
johnthetubaguythe reason why to covert it, is so it means something in the API, and isn't driver specific, and we can share scheduler logic, etc, etc10:18
johnthetubaguybut anyways10:18
ndipanovand then make sure that there is only one way to convert that object to a dict that is used in the API10:18
ndipanovyeah so making it an object would mean it's not driver specific anymore10:18
johnthetubaguyndipanov: +1 and I like that a lot10:19
ndipanov(well unless people stick more json fields on the cpu_info object) :D10:19
johnthetubaguyah, true10:19
*** claudiub has joined #openstack-nova10:19
ndipanovbut let's hope we catch taht in review10:19
ndipanovI can comment10:19
ndipanovI feel bad telling ppl10:19
ndipanovyou need to do this other work we should have done before you can do your stuff10:19
ndipanovbut in this case it's kind of a cleanup anyway10:19
ndipanovso..10:20
ndipanovmight as well do it right10:20
johnthetubaguyndipanov: yeah, its hard, we keep doing that a lot right now, because we have so much technical debt10:20
*** park_heijlong has joined #openstack-nova10:20
johnthetubaguyndipanov: this one is interesting though, I am tempted to let it land with all the things as optional, so drivers slowly push their data out the API in the "official" format10:20
johnthetubaguy... its not clean, but its lets "queued" behind lots of work10:21
johnthetubaguyduno10:21
*** prashup has joined #openstack-nova10:21
danpbjohnthetubaguy: ndipanov we already have an object for modelling CPU model info10:21
ndipanovorly10:21
danpbwe didn't convert the host resources reported data to use the object yet for the sake of back compatibility10:21
johnthetubaguyndipanov: so I am hoping to write down the work that people are queued behind, so they can offer to un-block themselves, even if its some random backlog spec10:22
*** kaisers1 has quit IRC10:22
danpbas & when we object-ify the host resources data itself, then I'd expect the cpu info data to be objectified at the same time10:22
danpbso we can deal with back-compat support in one go10:22
ndipanovdanpb, where is the object for this10:23
ndipanovbut fwiw there is a patch up for objectifying RT10:23
ndipanovso at that point everything should be using the compute node object10:23
*** kaisers has quit IRC10:23
danpbnova/objects/vcpu_model.py10:23
ndipanovjohnthetubaguy, ^^10:23
danpbit was designed so that we use the same object model for representing host and guest CPU model config10:23
*** kaisers has joined #openstack-nova10:24
johnthetubaguynot sure thats quite the same as the host CPU model though, but if its good for both, thats cool10:24
ndipanovso in that case - I think this is pretty clear then10:24
ndipanovwas just about to say10:24
*** kaisers1 has joined #openstack-nova10:24
johnthetubaguyndipanov: danpb: if you can comment on the spec to add these details, that would be awesome10:24
danpblibvirt internally uses the same data structure to represent host & guest CPU models10:25
danpband this was designed to follow the same structure, so I don't forsee any problems10:25
*** oomichi has quit IRC10:25
danpbjust a couple of the attributes will not be set in the host model (eg the "match" and "policy" attributes only make sense for the guest)10:26
openstackgerritMh Raies proposed openstack/python-novaclient: Adding missing nova read only CLI test  https://review.openstack.org/17114810:26
*** RuiChen has quit IRC10:26
*** RuiChen has joined #openstack-nova10:27
*** flwang1 has joined #openstack-nova10:27
*** claudiub has quit IRC10:27
*** achanda_ has quit IRC10:28
*** arnaud____ has joined #openstack-nova10:29
johnthetubaguydanpb: we should work out how to document some of these concepts, eventually, but we have bigger issues in those docs first (like removing the stuff thats just incorrect!)10:30
ndipanovjohnthetubaguy, so a question10:31
johnthetubaguyndipanov: sure10:31
ndipanovdo we keep python novaclient only on 'latest' or do we support all microversions?10:31
kashyapsahid: Added two small comments. Hope that's reasonable.10:31
johnthetubaguyndipanov: not sure we have properly answered that, I think we want it supporting all the latest features via the CLI10:32
johnthetubaguyndipanov: I think the python lib side is still a bit TBC10:32
johnthetubaguyndipanov: so we need all the features to work with servers that support older versions, via the CLI, thats a hard requirement, as far as I see it10:33
johnthetubaguyndipanov: I suspect that will define what the python API looks like10:33
*** arnaud____ has quit IRC10:33
ndipanovok so in this case we can't just remove support we have to keep both in the client10:33
johnthetubaguyndipanov: and in the API, it probably stays longer in the client than the API10:34
*** pradipta has quit IRC10:34
johnthetubaguyndipanov: its not "free", but it gives us more ability to move forward while staying interoperable (ish)10:34
*** lpetrut1 has quit IRC10:35
johnthetubaguyndipanov: honestly, I think we will only start to see the cost of microversions towards the end of M10:35
*** achanda has joined #openstack-nova10:35
*** dulek_ has joined #openstack-nova10:37
*** dulek has quit IRC10:37
*** park_heijlong has quit IRC10:37
johnthetubaguyRuiChen: hi, just wondering about a few little updates on the subnet_id spec10:38
*** dulek___ has joined #openstack-nova10:39
*** dulek_ has quit IRC10:39
*** dulek___ has quit IRC10:40
*** dulek has joined #openstack-nova10:41
*** deepthi has quit IRC10:41
ndipanovjohnthetubaguy, I like how sdague rationalized what we do in his blog where he says we are not a service we are an oss codebase and we decided we want to be interoperable10:42
*** achanda has quit IRC10:42
johnthetubaguylascii: do you have your flavor_class stuff up for review yet? https://review.openstack.org/#/c/182345/3/specs/backlog/approved/flavor-resize-restriction.rst,cm10:42
ndipanovso then it will have a cost of course10:42
johnthetubaguyndipanov: +1 I am really pushing we are better at explaining the *why* behind what we decided, so we remember why we are taking that cost!10:43
johnthetubaguyand so we don't end up doing something thats costly, but doesn't actually achieve the original goal10:43
*** achanda has joined #openstack-nova10:43
*** dulek has quit IRC10:43
johnthetubaguy(for the process stuff, and the code!)10:43
ndipanovso I was thinking about this a bit over the weekend and I think this really aligns with several other themes like cells v210:44
ndipanovwhere we actually kinda have 2 nova dbs that decouple things even further etc10:44
*** achanda has quit IRC10:45
*** ajayaa has quit IRC10:46
ndipanovso definitely makes sense for where we are going... but it's a long road :)10:46
*** achanda has joined #openstack-nova10:46
johnthetubaguyndipanov: +110:46
mnestratovGood day all10:47
johnthetubaguyndipanov: I am wanting to get that clearer in our docs, we have quite a strong vision, but mostly we don't communicate it well, even to each other10:47
mnestratovI have a question10:47
*** coolsvap is now known as coolsvap|afk10:47
ndipanovjohnthetubaguy, also a lot of this stuff is a set of features that only very serious deployers will care about, which I think has been voiced as a concern a lot lately...10:49
ndipanovthat we are moving away from something "the little shop" can get their head around10:49
ndipanovmaybe not10:49
ndipanovthat's what I was thinking anyway10:49
mnestratovA question about HVSpec object versioning. If I change the number of reported hv_types, should I bump up HVSpec object version or just update its hash?10:50
johnthetubaguyndipanov: thats a valid point, it needs to be easy for the little folks too10:52
*** achanda has quit IRC10:52
*** otter768 has joined #openstack-nova10:52
johnthetubaguyndipanov: but we mostly don't describe anything to anyone, which I think is the issue10:52
ndipanovright :)10:52
johnthetubaguyndipanov: little folks will want to add servers, cells v2 makes that easier in many ways, but we don't tell anyone that, because that would be... useful?10:53
johnthetubaguymnestratov: sounds like you might want to bump the version, because there is a downgrade issue that needs fixing somehow10:53
johnthetubaguymnestratov: but I am not the expert in that area, hoping they will be able to answer your question10:54
johnthetubaguymnestratov: AFAIK we added the hash change to make it more obvious when the version likely needs an update10:54
ndipanovyes I see what  you are saying - having a high level overview of the mission will definitely help folks get involved properly even as users alone10:55
mnestratovjohnthetubaguy: ok thank you. I think since don't change interface I don't need to change the version either.10:56
*** otter768 has quit IRC10:57
johnthetubaguyndipanov: so I am going to try take on that task this release, mostly as I hope thats easier to do along side the other PTL stuff compared to coding, but lets see, maybe the opposite is true!10:57
johnthetubaguymnestratov: so you change the type of a field, basically, so I suspect it might need a bump, but I am sorry, I just don't know the details there10:58
*** afazekas_mtg is now known as afazekas10:58
openstackgerritgaryk proposed openstack/nova: VMware: enable a resize of instance with no root disk  https://review.openstack.org/17380210:58
*** ajayaa has joined #openstack-nova10:58
*** ociuhandu has joined #openstack-nova10:59
ndipanovwell I think coding is important for your own sanity :) but yeah having a clear mission and scope will help us when we need to decide which of the features companies/users want to see in Nova actually make sense and also prioritize them10:59
mnestratovjohnthetubaguy: anyway thanks10:59
johnthetubaguyndipanov: +1 to all of that11:02
johnthetubaguythinking of sanity... its time for lunch I think11:02
openstackgerritYusuke Ide proposed openstack/python-novaclient: Add help message for secgroup-add/del-default-rule  https://review.openstack.org/18926311:05
*** wuhg has joined #openstack-nova11:08
*** deepthi has joined #openstack-nova11:09
varya_Hi all. I have a question. as part of creating a new tenant can we perform some custom actions in nova or neutron. For example creating a default network/subnet for every tenant as soon as the tenant is created? Sorry if this is not the right forum to ask this question.11:10
*** varya_ has quit IRC11:12
*** ferest has joined #openstack-nova11:14
openstackgerritMarkus Zoeller (markus_z) proposed openstack/nova: WIP: docs: Add bug handling description to developer reference  https://review.openstack.org/18757111:15
*** ajayaa has quit IRC11:18
*** ferest has quit IRC11:19
*** fesp has joined #openstack-nova11:20
sdaguendipanov: glad you liked the post :)11:22
openstackgerritZhenyu Zheng proposed openstack/nova-specs: Remove disable_terminate  https://review.openstack.org/18302311:22
mkoderersdague: ping11:22
sdaguemkoderer: pong11:22
*** rushiagr_away is now known as rushiagr11:22
mkoderersdague: I am bit confused about https://review.openstack.org/#/c/188687/111:23
mkoderersdague: since I was involed in this... was the actual nova bug fixed already?11:23
sdagueso, it's being unskipped because cirros supports it? Yeh, honestly i'm not sure11:26
sdaguethough it's more of a -qa question11:26
*** tobe has quit IRC11:26
sdagueperhaps dkranz has some background on it11:26
mkoderersdague: yeah your right I just realized that it's not really releated to nova at all11:27
Kevin_ZhengHi, could anyone kindly approve this tiny fix? already alot +1s :-) https://review.openstack.org/#/c/184662/11:28
*** markvoelker has joined #openstack-nova11:30
*** yassine_ has joined #openstack-nova11:34
*** markvoelker has quit IRC11:35
*** claudiub has joined #openstack-nova11:35
*** rpodolyaka has joined #openstack-nova11:36
*** ajayaa has joined #openstack-nova11:37
*** tlbr has joined #openstack-nova11:37
*** haigang has quit IRC11:41
*** haigang has joined #openstack-nova11:42
*** lpetrut has joined #openstack-nova11:43
*** Jeffrey4l has quit IRC11:44
*** lucasagomes is now known as lucas-hungry11:44
*** deepthi has quit IRC11:45
*** claudiub has quit IRC11:45
*** alex_klimov has joined #openstack-nova11:46
openstackgerritNikola Dipanov proposed openstack/nova: libvirt: make default_device_names DRY-er  https://review.openstack.org/18063611:49
openstackgerritNikola Dipanov proposed openstack/nova: virt: add get_device_name_for_instance to the base driver class  https://review.openstack.org/18063711:49
openstackgerritNikola Dipanov proposed openstack/nova: libvirt: implement get_device_name_for_instance  https://review.openstack.org/18063811:49
openstackgerritNikola Dipanov proposed openstack/nova: virt: Move building the block_device_info dict into a method  https://review.openstack.org/18063511:49
*** tojuvone has quit IRC11:56
*** exploreshaifali has quit IRC11:58
openstackgerritAndrey Kurilin proposed openstack/nova-specs: Nova API Microversions support in NovaClient  https://review.openstack.org/18841011:59
*** Jeffrey4l has joined #openstack-nova12:00
openstackgerritTimofey Durakov proposed openstack/nova: Split instance resize operation into 2 phases  https://review.openstack.org/18449512:04
*** prashup has quit IRC12:06
*** ajayaa has quit IRC12:07
*** zhenguo has quit IRC12:07
*** tdurakov has joined #openstack-nova12:09
*** annegentle has joined #openstack-nova12:09
*** raildo has joined #openstack-nova12:11
*** ferest has joined #openstack-nova12:15
*** haigang has quit IRC12:16
*** haigang has joined #openstack-nova12:16
openstackgerritMaxim Nestratov proposed openstack/nova: libvirt: rename parallels driver to virtuozzo  https://review.openstack.org/18431112:16
*** zz_jgrimm is now known as jgrimm12:17
*** haigang has quit IRC12:18
*** artom has joined #openstack-nova12:18
*** aysyanne has joined #openstack-nova12:19
*** ferest has quit IRC12:20
*** sudipto has quit IRC12:24
openstackgerritAndrey Kurilin proposed openstack/nova-specs: Raname header X-OpenStack-Nova-API-Version  https://review.openstack.org/18927812:24
*** fesp is now known as flaper8712:25
*** flaper87 has quit IRC12:25
*** flaper87 has joined #openstack-nova12:25
*** ivasev has joined #openstack-nova12:28
*** nihilifer_ has quit IRC12:28
openstackgerritgaryk proposed openstack/nova: Objects: update missing adapter types  https://review.openstack.org/18908612:29
*** pece has joined #openstack-nova12:29
openstackgerritRodolfo Alonso proposed openstack/nova: Added new scheduler filter: AggregateTypeExtraSpecsAffinityFilter  https://review.openstack.org/18927912:30
garykdanpb: ^12:30
*** rfolco has joined #openstack-nova12:31
*** VW has joined #openstack-nova12:35
*** lpetrut has quit IRC12:37
*** lucas-hungry is now known as lucasagomes12:38
sahidkashyap: thanks for your review, i replied to one of your point12:38
sahidplease let me know if that makes sense for you12:38
sahidhttps://review.openstack.org/#/c/187509/12:38
kashyapsahid: Yep, it does.12:40
kashyapI hesitated briefly whether to write that point (a) or not. Thanks for correcting.12:40
sahidkashyap: np at all thank for reviewing12:40
*** lpetrut has joined #openstack-nova12:41
*** dulek has joined #openstack-nova12:42
*** marun has joined #openstack-nova12:44
*** ociuhandu has quit IRC12:49
*** thiagop has quit IRC12:49
*** raildo has quit IRC12:50
*** gabriel-bezerra has quit IRC12:50
*** tellesnobrega has quit IRC12:50
*** rushiagr is now known as rushiagr_away12:50
*** flwang1 has quit IRC12:51
*** ericksonsantos has quit IRC12:51
*** achanda has joined #openstack-nova12:52
*** ociuhandu has joined #openstack-nova12:52
*** dave-mccowan has joined #openstack-nova12:53
*** otter768 has joined #openstack-nova12:53
*** baoli has joined #openstack-nova12:54
*** pilgrimstack has joined #openstack-nova12:55
mnestratovsahid, danpb, vladik: could you please, as you are libvirt subteam members, consider code corresponding to the following blueprints as "ready for review"?12:56
mnestratovhttps://blueprints.launchpad.net/nova/+spec/virtuozzo-instance-resize-support12:56
mnestratovhttps://blueprints.launchpad.net/nova/+spec/ploop-snapshot-support12:56
mnestratovhttps://blueprints.launchpad.net/nova/+spec/virtuozzo-container-boot-from-volume12:56
*** otter768 has quit IRC12:57
*** yassine__ has joined #openstack-nova12:58
*** Maike_ has joined #openstack-nova12:58
*** yassine_ has quit IRC13:01
openstackgerritEugeniya Kudryashova proposed openstack/python-novaclient: Raise exception when API does't support microversions  https://review.openstack.org/18881613:01
sahidmnestratov: it seems any of these bleuprints has been approved ?13:01
*** Maike has quit IRC13:01
sahiddid you get opportunity to talk about them during nova meeting or mailing liest?13:02
*** irenab has quit IRC13:04
mnestratovsahid: only during summit design session13:04
sahidfrom my point of view the first one do not need spec13:05
*** ericksonsantos has joined #openstack-nova13:06
*** tellesnobrega has joined #openstack-nova13:06
*** raildo has joined #openstack-nova13:06
sahidperhaps you could try to talk about it during meeting to make it approved13:06
*** dane-fichter has joined #openstack-nova13:06
sahidthen that will help core to review it13:06
mnestratovsahid: why specs? the spec for parallels/vz driver was approved for the previous release cycle13:07
*** heyongli has quit IRC13:07
sahidmnestratov: hum... i wanted to say the bp does not need spec yes13:07
mnestratovthese changes are internal for libvirt/parallels driver- they are expanding feature coverage we lack for the moment13:08
openstackgerritgaryk proposed openstack/nova: Objects: update missing adapter types  https://review.openstack.org/18908613:08
*** heyongli has joined #openstack-nova13:08
sahidfrom my point of view, but others people on the community can have questions13:08
*** ferest has joined #openstack-nova13:08
*** gabriel-bezerra has joined #openstack-nova13:08
sahidanyway you should to make them approved if you want to expect coresto reviews it13:08
*** VW has quit IRC13:09
mnestratovok13:09
*** dprince has joined #openstack-nova13:09
mnestratovto make them approved should I add them to the next nova meeting agenda?13:09
sahidmnestratov: yes that should be to way to follow13:10
sahidjohnthetubaguy: ^ can you confirm me?13:10
*** ferest_ has joined #openstack-nova13:11
*** ferest has quit IRC13:13
*** prashup has joined #openstack-nova13:13
mnestratovsahid: can you please take a look at https://review.openstack.org/#/c/186858/ - it is approved13:14
mnestratovsahid: sorry - thois one https://review.openstack.org/#/c/149253/13:14
sahidmnestratov: sure i will do, just would like to finish something before.13:15
mnestratovsahid: thank you13:16
*** markvoelker has joined #openstack-nova13:20
johnthetubaguysahid: mnestratov: yeah put spec-less BPs on the meeting agenda where it mentioned about approving spec-less blueprints13:20
*** achanda has quit IRC13:20
*** ferest_ has quit IRC13:20
*** achanda has joined #openstack-nova13:21
johnthetubaguymnestratov: honestly, that looks a lot like a bug fix... rather than a blueprint, did you want a blueprint for some reason?13:21
openstackgerritAndrey Kurilin proposed openstack/nova-specs: Nova API Microversions support in NovaClient  https://review.openstack.org/18841013:21
johnthetubaguymnestratov: ah, so I see what its a blueprint now, my bad13:22
lxsliedleafe: up yet?13:22
*** varya has joined #openstack-nova13:23
*** markvoelker has quit IRC13:25
*** abhishekk has quit IRC13:26
*** achanda has quit IRC13:26
*** superdan is now known as dansmith13:26
*** thangp has joined #openstack-nova13:28
*** Maike has joined #openstack-nova13:28
*** rook has quit IRC13:29
moshelejohnthetubaguy: hi13:30
*** Maike_ has quit IRC13:30
*** afazekas has quit IRC13:31
openstackgerritBaodong (Robert) Li proposed openstack/nova-specs: Support live migration with macvtap SR-IOV  https://review.openstack.org/13607713:31
*** eharney has quit IRC13:32
*** thangp has quit IRC13:32
*** wverdugo500 has joined #openstack-nova13:32
*** wverdugo500 has left #openstack-nova13:32
*** thorst has joined #openstack-nova13:33
*** rook has joined #openstack-nova13:35
*** dboik has quit IRC13:36
mnestratovjohnthetubaguy: added to the next meeting agenda. thanks13:36
*** thangp has joined #openstack-nova13:37
johnthetubaguymoshele: hi, I am around, fire away13:37
edleafelxsli: yep13:37
*** marun has quit IRC13:37
lxsliedleafe: goood morning13:37
*** mriedem has joined #openstack-nova13:38
lxsliedleafe: has anything been written up about the (eventual) plans to create a scheduler library?13:38
*** vladikr has joined #openstack-nova13:38
*** igordcard_ has joined #openstack-nova13:38
edleafelxsli: not that I'm aware of13:38
moshelejohnthetubaguy:  I add a comment to https://review.openstack.org/#/c/169638/ regarding the general direction on the nova api13:38
edleafeI do remember talking about it in Paris when the idea of jaypipes Resource Objects was being discussed13:39
lxsliedleafe: OK, I'll put it near the end of my todo list. It would be nice if a newcomer to Nova could get a reasonable sense of what's going on by reading specs rather than spending a year talking to people13:39
edleafelxsli: the problem with a separate scheduler service was what you were talking about on Friday13:40
lxsliedleafe: yes I remember being very confused while that discussion was going on!13:40
edleafelxsli: namely how to pass the class info and logic between the scheduled service and the scheduler13:40
*** mtanino has quit IRC13:40
johnthetubaguymoshele: vnic_type is quite different, subnet is something that got missed out of the existing API, vnic_type is a new concept13:40
lxsliedleafe: yep, there is another answer but I'm not sure people will ike it13:41
edleafelxsli: yes, it's unfortunate that side discussions broke out13:41
lxsli*like13:41
* edleafe is waiting to hear it...13:41
*** artom has quit IRC13:41
johnthetubaguymoshele: if vnic_type mapped to some "type" owned by neutron, that looks just like the Cinder volume_type, I would consider including it, although its possible the other driver will disagree with me on that13:41
lxsliedleafe: we could provide a resource provision and matching language, adequate to support all reasonable requirements13:41
*** mpaolino has joined #openstack-nova13:42
*** mpaolino has quit IRC13:42
lxsliedleafe: that way, services can take care of translating their requests into that language and the scheduler is independent13:42
*** amotoki has joined #openstack-nova13:42
lxsliI see no real problem with the scheduler-lib solution though (maybe I just need to think harder)13:43
edleafelxsli: there are two words in that sentence that jump out at me: 'adequate' and 'reasonable'13:43
lxsli:D13:43
moshelejohnthetubaguy: vnic_type tells nova if it need to allocate pci device so it affect nova code flow for launch a vm13:43
edleafelxsli: you know that we'll be forever finding new requirements that no one thought was reasonable at first13:44
*** dpaterson has joined #openstack-nova13:44
*** burt has joined #openstack-nova13:44
lxsliI'm using those in a fairly academic sense, "adequate" -> "fully supporting" and "reasonable" -> "not more than NP-hard"13:44
edleafelxsli: ah, ok13:44
*** htruta has joined #openstack-nova13:44
johnthetubaguymoshele: its way too implementation specific for a concept in the end user facing Nova API, thats my big issue with it13:45
edleafelxsli: now it's just the 'fully' part that is glaring13:45
*** xyang1 has joined #openstack-nova13:46
johnthetubaguymoshele: so the route cause of the issue here is that I need to write up the devref documentation on our architectural direction, and we should actually remove the API we are considering removing, rather than leaving them in limbo13:46
lxsliedleafe: I think you can do an awful lot with relations like "M to N relations between the sets A and B which meet these constraints" for example13:46
*** mpaolino has joined #openstack-nova13:47
lxsliEG NUMA13:47
edleafelxsli: I think you would need at least a POC to serve as an example13:47
*** amotoki has quit IRC13:47
edleafelxsli: so that others can see what a resource would look like13:47
moshelejohnthetubaguy: I have also different proposal like using https://github.com/openstack/python-openstackclient api to build all the required elements in neutron/cinder and then using nova api just to attach specific element like port13:47
johnthetubaguymoshele: I plan to get this all straightened out by the end of Liberty, but honestly, thats probably a little optimistic, I think these API direction things are most likely to get pushed to the next summit, at least to some extent13:47
edleafelxsli: as well as a request and claim13:48
dansmithdims_: how do you feel about my abbreviating o.vo like this? https://review.openstack.org/#/c/187719/3//COMMIT_MSG,cm13:48
dansmithdims_: I'm pretty consistent about it and thus I think it's fine (and helps with wrapping and such).. do you have an opinion/13:48
*** sdake has joined #openstack-nova13:48
edleafedansmith: In general, I'd spell it out once, and abbreviate everywhere else13:48
johnthetubaguymoshele: we will need REST API support for this kind of thing13:49
dansmithedleafe: once per patch you mean? I probably only ever say it once per patch anyway, on average13:49
johnthetubaguymoshele: I am still tempted to -2 the other spec, but I like how it simplifies the API significantly, in a way our users probably want13:49
dansmithedleafe: I feel like I've got a pretty good amount of context going on "o.vo" but maybe that's all in my head13:49
lxsliedleafe: yes I played with this a little while ago http://potassco.sourceforge.net/13:50
dims_dansmith: replied on the review. am good13:50
edleafedansmith: yes, for exactly that reason: it's clear to you, but won't be to someone who might not be living and breathing that stuff13:50
dansmithdims_: ah, cool, thanks13:50
dims_edleafe: if it were a spec, sure. this is ok13:50
lxslidansmith: if this is a straw poll, +1 to spelling it out, sorry13:51
lxsli:ab o.vo oslo_versionedobjects13:51
dansmithit's not about the typing really13:51
*** Maike has quit IRC13:51
lxslithe first time I saw one of your reviews with o.vo I had to come here and ask13:52
dims_lxsli: we've been using o.vo for a while now as a short hand for the project, so i really don't mind13:52
lxsliOK just giving a not-core perspective :)13:52
dansmithlxsli: what if it's defined in the blueprint/spec? (it might actually be, I'd have to check)13:52
dansmithlxsli: what does core have to do with it?13:52
* dims_ tries to find my core hat and does not find any :)13:53
lxslidansmith: well, it's not impossible to work out but if the typing isn't an issue, just do it?13:53
lxslidansmith: just a proxy for participation level13:53
moshelejohnthetubaguy: every additional attribute  will simplifies the api, but I think the question here is what are the guideline for adding new attribute for the api13:53
*** atuvenie has joined #openstack-nova13:53
dansmithlxsli: the reason I like the abbreviation is that it wraps better in comments and commit messages and is easier to read in general I think13:53
*** amotoki has joined #openstack-nova13:54
dims_dansmith: let's add it to the o.vo README :) https://github.com/openstack/oslo.versionedobjects/13:54
lxslisurely if you're reading the o.vo README, you can guess what it means?13:55
dansmithdims_: that way it should be google-able13:55
dims_dansmith: +113:55
lxsliShowing results for ovo.com13:55
dims_lxsli: it was a joke :)13:55
lxsli>.< sorry13:56
dims_:)13:56
*** lascii is now known as alaski13:56
lxslidansmith: anyway I'm not telling you what to do, just saying it confused me briefly one time ^^13:56
dansmithlxsli: what if there was at least one grep'able reference in the nova tree?13:57
*** dboik has joined #openstack-nova13:57
dansmithlike somewhere I said "#NOTE(danms): Inherit from oslo.versionedobjects (o.vo) for the base class"13:58
lxslithat helps I guess13:58
dansmithnova/objects/base.py:    # Temporary until we inherit from o.vo.base.VersionedObject13:58
dansmithnova/objects/base.py:    # NOTE(danms): This is nova-specific, so don't copy this to o.vo13:58
dansmiththose are already there, FWIW13:58
*** rushiagr_away is now known as rushiagr13:58
dansmithI don't want to do something that increases obscurity, I just much prefer the abbreviation, both in conversation and text13:58
*** mpaolino has quit IRC13:59
dansmithjohnthetubaguy: alaski: thoughts on using the abbreviation?13:59
dims_dansmith: +1 to add it to a few places to help with discovery13:59
alaskidansmith: is there a patch in question?14:00
dansmithalaski: there are several,14:00
*** sdake_ has joined #openstack-nova14:00
dansmithalaski: in general, just the question of using o.vo in place of oslo.versionedobjects in things like commit messages14:00
*** VW has joined #openstack-nova14:00
dansmith(and comments)14:00
lxsliyou could build the bikeshed as "oslo.vo"?14:01
*** jaypipes has joined #openstack-nova14:01
dansmithlxsli: I could, although we've been using o.vo for quite some time now, so another shorthand makes it worse I think14:01
openstackgerritDaniel Berrange proposed openstack/nova: libvirt: convert driver to use nova.objects.ImageMeta  https://review.openstack.org/18811914:01
openstackgerritDaniel Berrange proposed openstack/nova: libvirt: make instance compulsory in blockinfo APIs  https://review.openstack.org/18811814:01
openstackgerritDaniel Berrange proposed openstack/nova: objects: add os_require_quiesce image property  https://review.openstack.org/18878714:01
openstackgerritDaniel Berrange proposed openstack/nova: virt: convert hardware module to use nova.objects.ImageMeta  https://review.openstack.org/18878914:01
openstackgerritDaniel Berrange proposed openstack/nova: compute: only use non_inheritable_image_properties if snapshotting  https://review.openstack.org/18725014:01
openstackgerritDaniel Berrange proposed openstack/nova: objects: fix parsing of NUMA cpu/mem properties  https://review.openstack.org/18878814:01
openstackgerritDaniel Berrange proposed openstack/nova: compute: remove get_image_metadata method  https://review.openstack.org/18725114:01
openstackgerritDaniel Berrange proposed openstack/nova: xenapi: convert driver to use nova.objects.ImageMeta  https://review.openstack.org/18879014:01
openstackgerritDaniel Berrange proposed openstack/nova: hyperv: convert driver to use nova.objects.ImageMeta  https://review.openstack.org/18930214:01
lxsliOK, I'm going to let you build it how you want now :)14:01
johnthetubaguydansmith: code and commits are write once read many, which leads me towards avoiding those abbreviations, for clarity14:02
dansmithalrighty14:02
alaskidansmith: in comments I think I would prefer a full name, but it's not a hard preference from me14:02
alaskiin commit messages I would say use once then abbreviate14:02
dansmithdims_ and I will just use it as our secret handshake then14:02
dims_:)14:03
*** eharney has joined #openstack-nova14:03
*** sdake has quit IRC14:04
alaskiI think the context is important.  If you have a comment above a line like "something = ovo.Foo" then using o.vo should be fine14:04
dansmithyeah, the code isn't the question, since it's an import and searchable I think14:04
alaskiyeah, I more meant the comment above it14:05
dansmithah14:05
*** BadCub-Hiding is now known as BadCub14:05
openstackgerritsahid proposed openstack/nova: libvirt: introduce method to get domain XML  https://review.openstack.org/18930714:05
BobBallIn the object-world is it possible for a nova period task to pull an object from the DB before it's fully populated, and then that object is in memory and might cause an issue later on?  https://bugs.launchpad.net/nova/+bug/1463039 is a potential race we're hitting in the XS CI.  Just wondering if my first thought (that the periodic task happens to kick in before the object is fully populated) might be the issue14:06
openstackLaunchpad bug 1463039 in OpenStack Compute (nova) "BandwidthUsage object has no attribute 'instance_uuid'" [Undecided,New]14:06
dims_haypo: welcome back! Victor, managed to get around 30% of unit tests working in py3 with 5 reviews so far (https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:python3-porting,n,z)14:06
dansmithBobBall: no more so that before when we were pulling dicts, I think14:08
haypodims_: oh, i didn't know that you was interested to port nova to python 314:08
dims_haypo: i had some time last week :)14:08
BobBallShame... Was worth a try! :)14:08
mdboothjaypipes: Instance compare-and-swap is good to go: https://review.openstack.org/#/c/141115/14:08
mdboothIt would be good to knock that on the head14:09
mdboothIt had a +1 from zzzeek until I made a trivial update, btw14:09
haypodims_: 30% is a lot, good job14:09
openstackgerritPetrut Lucian proposed openstack/nova: Hyper-V: Fix missing WMI namespace issue on Windows 2008 R2  https://review.openstack.org/18930814:09
haypodims_: i was in holiday during 5 days, and now i'm trying to read all emails... i didn't have time to check my pending patches14:10
dims_haypo: i'll let you catch up :) no worries14:10
openstackgerritDan Smith proposed openstack/nova: Fix an objects layering violation in compute/api  https://review.openstack.org/18811014:10
openstackgerritDan Smith proposed openstack/nova: Replace metaclass registry with explicit opt-in registry from oslo  https://review.openstack.org/18811114:10
openstackgerritDan Smith proposed openstack/nova: Remove assertRemotes() from objects tests  https://review.openstack.org/18810914:10
openstackgerritDan Smith proposed openstack/nova: Convert test objects to new field formats  https://review.openstack.org/18771914:10
openstackgerritDan Smith proposed openstack/nova: Begin the transition to an explicit object registry  https://review.openstack.org/18771814:10
openstackgerritDan Smith proposed openstack/nova: Use fields from oslo.versionedobjects  https://review.openstack.org/18772014:10
openstackgerritDan Smith proposed openstack/nova: Make readonly field tests use exception from o.vo  https://review.openstack.org/18811214:10
dansmithdoh14:10
haypodims_: i saw that the py34 gate of nova was broken because of a setup.py file of a project expected the locale encoding was UTF-8, the issue was worked around in tox.ini14:11
openstackgerritDan Smith proposed openstack/nova: Make readonly field tests use exception from oslo.versionedobjects  https://review.openstack.org/18811214:11
haypodims_: if the gate is stable, I would like to make it voting, that's the next step of the spec14:11
dims_haypo: y and then one more thing broke and was fixed14:11
*** logan2 has quit IRC14:12
*** achanda has joined #openstack-nova14:12
openstackgerritPetrut Lucian proposed openstack/nova: Hyper-V: Fix missing WMI namespace issue on Windows 2008 R2  https://review.openstack.org/18930814:12
*** logan2 has joined #openstack-nova14:13
dims_haypo: for the record it was a jsonschema release - https://github.com/Julian/jsonschema/issues/22814:14
haypodims_: no :) i was rfc3986, i proposed a real fix and it was merged a few minutes later! https://github.com/sigmavirus24/rfc3986/pull/1414:15
*** artom has joined #openstack-nova14:15
haypodims_: oh, this morning i saw a failure with functools32 yes14:15
dims_haypo: y that was the first one, and on friday we hit the jsonschema with bad wheel14:15
dims_biab14:16
haypodims_: so what do you think of making the gate voting?14:16
*** READ10 has joined #openstack-nova14:16
*** jecarey has joined #openstack-nova14:17
*** achanda has quit IRC14:18
*** pbandzi has quit IRC14:18
*** varya has quit IRC14:20
dansmithjohnthetubaguy: threw some comments on that evacuate spec.. I don't think there is any overlap with mine, but I pointed out another big issue I think14:21
*** agireud has joined #openstack-nova14:21
*** IanGovett has joined #openstack-nova14:23
*** prashant__ has joined #openstack-nova14:23
*** prashup has quit IRC14:24
*** _gryf has joined #openstack-nova14:29
*** annegentle has quit IRC14:29
dansmithndipanov: did you seem my question here? https://review.openstack.org/#/c/183354/14:29
_gryfdansmith, hi14:30
dansmithndipanov: I think that the filter/comment in RT addresses the concern enough to proceed, but if not, please let me know what else you think needs doing14:30
dansmith_gryf: hi14:30
openstackgerritJean-Daniel Bonnetot proposed openstack/nova-specs: Workflow to manage unauthorised resizing  https://review.openstack.org/18234514:30
ndipanovdansmith, looking14:30
_gryfdansmith, is this a problem, the implementation will stall for two weeks?14:31
_gryfdansmith, I'm on the vacation right now14:31
*** unicell has joined #openstack-nova14:31
*** unicell1 has quit IRC14:31
dansmith_gryf: no, it's fine.. I need to get back to look at your patches again, I've just had lots of other things to look at14:31
*** dguitarbite has quit IRC14:32
_gryfdansmith, rihgt, nevertheless i didn't push the implementation using microversion yet, since i have some issues with the tests14:32
dansmith_gryf: okay14:32
*** Maike has joined #openstack-nova14:32
openstackgerritRodolfo Alonso proposed openstack/nova: Added new scheduler filter: AggregateTypeExtraSpecsAffinityFilter  https://review.openstack.org/18927914:33
mriedemjaypipes: you were +2 on this on friday, want to take a look again now that i'm +2? https://review.openstack.org/#/c/177084/14:33
ndipanovdansmith, I remember this - well filtering them out is fine, as it will make it exactly as bad as it is now...14:34
jaypipesmriedem: done. thank you sir :)14:35
openstackgerritJean-Daniel Bonnetot proposed openstack/nova-specs: Workflow to manage unauthorised resizing  https://review.openstack.org/18234514:35
*** electrocucaracha has joined #openstack-nova14:35
ndipanovI kinda feel that this kind of stuff ties in very tightly with the convo we started on the RequestSpec bp14:35
dansmithndipanov: right.. "just as sucky" was what I was going for14:35
*** afazekas has joined #openstack-nova14:36
dansmithndipanov: in that the only goal of that patch is to make the movement of the guest visible through the api.. RT enhancements are a different thing14:36
ndipanovso I feel really bad saying that this is A-OK, when I gave bauzas a hard time ... but I will remove the -1 as the direct concern was addressed14:36
*** tjones1 has joined #openstack-nova14:37
dansmithndipanov: okay, not sure I get what the concern is since it doesn't break what is there and the goal is orthogonal to any request or RT stuff14:37
ndipanovhence removing -114:37
dansmithI mean.. whatever lingering guilt you may have, but that's fine :)14:38
*** jamielennox is now known as jamielennox|away14:38
*** jgrimm is now known as zz_jgrimm14:38
*** lpetrut has quit IRC14:38
*** lpetrut has joined #openstack-nova14:39
*** Maike has quit IRC14:39
sahidmarkus_z: hello, please before to unassign me from a bug don't hesistate to ping me on IRC i'm usually always connected14:40
sahidthe bug needs to be addressed prior to this spec https://review.openstack.org/#/c/165838/14:40
sahidi'm currently working on it14:40
*** cbader has joined #openstack-nova14:41
*** armax has joined #openstack-nova14:42
lxslisbauza.beers += 114:42
ndipanovdansmith, https://review.openstack.org/#/c/180637/ - I also replied to you there so check it out when yolu get a chance14:43
*** yingjun has joined #openstack-nova14:43
markus_zsahid: OK, sorry, I try to go through some of the bugs and look what's up. I didn't want to offend you in any way with this.14:43
dansmithlxsli: careful, cfriesen actually paid me a beer in vancouver14:43
dansmithlxsli: so people might start looking to collect on those..14:43
markus_zsahid: Good to hear that you are working on this :)14:43
lxslidansmith: yeah but the beer was free right?14:43
sahidmarkus_z: np at all really14:43
dansmithlxsli: it was free to me, but the one he brought was externally-sourced and funded14:44
*** cfriesen has joined #openstack-nova14:44
lxslidansmith: it'll never catch on14:44
dansmithheh14:44
dansmithndipanov: hmm, so boot doesn't call that reserve method like attach does?14:45
jaypipesI promised a case of beer to the Neutron dev who implemented "get me a network" API.14:45
ndipanovdansmith, nope14:45
ndipanovhow can it - it has to ask the scheduler first14:45
ndipanovwhere do I put this14:45
dansmithah, right14:45
dansmithndipanov: well, tbh, the confusion I see the most is from attach, because on boot nothing is used, so you can't easily have a conflict unless you double up, right?14:46
dansmithndipanov: so it seems like improving the experience for attach is still worthwhile,14:46
dansmithas people tend to attach and detach /dev/sdb over and over and hit the problem14:46
*** pilgrimstack has quit IRC14:47
ndipanovdansmith, yeah it's quite tricky thought - this will very much be visible from the API to a lot of people14:49
danpbarrrgh, having a file  nova/tests/unit/virt/.#test_configdrive.py  saved by emacs breaks python unit test enumeration !14:50
dansmithyeah, I'm sure it will, but it's not good now..14:50
ndipanovif we choose to reject requests with a device name period.14:50
* danpb just wasted half an hour figuring that out14:50
dansmithndipanov: right now, they're using the API wrong and we're lying to them14:51
jaypipes:waq14:51
jaypipesguh...14:51
*** annegentle has joined #openstack-nova14:52
dansmithndipanov: so making it break explicitly or just go ignored both seem like better options than what we have14:52
*** tjones1 has quit IRC14:52
ndipanovdansmith, so completely ignoring it and deciding all of them from scratch is what you would rather see14:53
ndipanovI agree actually14:53
dansmithndipanov: well, if we're on libvirt, I think so yeah14:54
ndipanovI actually have a BP I will propose that will tie into this14:54
edleafejaypipes: it's Monday14:54
*** otter768 has joined #openstack-nova14:54
ndipanovOK that's one more easy patch in libvirt14:54
*** yassine_ has joined #openstack-nova14:54
openstackgerritMarkus Zoeller (markus_z) proposed openstack/nova: WIP: docs: Add bug handling description to developer reference  https://review.openstack.org/18757114:54
ndipanovplus I will sit down and document all of that junk this week14:54
*** sahid has quit IRC14:54
ndipanovcool14:54
dansmithndipanov: just re-reading what you have,14:55
*** sahid has joined #openstack-nova14:55
dansmithndipanov: your libvirt implementation ignores suggested_device_name, right?14:55
ndipanovlatest patch does not14:55
ndipanovthe one you commented on does14:55
dansmithah, that's what I'm looking at14:55
ndipanovbut boot does not as well which is what needs to be fixed too14:55
dansmithright14:55
ndipanovbut that is real easy14:56
ndipanovok will do that now14:56
jaypipesedleafe, bauzas, ndipanov, lxsli: the resource object models patch series is back on track: https://review.openstack.org/#/c/12899214:56
dansmithndipanov: cool, sounds like a plan, thanks14:56
*** achanda has joined #openstack-nova14:56
edleafejaypipes: \o/14:56
edleafejaypipes: I'll go over them a little later14:56
jaypipesedleafe: yeah, worked last night to get it back on track. nicely, the work from sahid on cleaning up the NUMA stuff made the patch more readable.14:57
*** yassine__ has quit IRC14:57
openstackgerritDaniel Berrange proposed openstack/nova: objects: convert config drive to use ImageMeta object  https://review.openstack.org/18932314:58
ndipanovjaypipes, awesome - looking forward to that one14:58
*** otter768 has quit IRC14:58
*** achanda has quit IRC15:02
openstackgerritAndrea Rosa proposed openstack/nova: WIP: adding a volume detach_force call  https://review.openstack.org/18453715:02
*** zzzeek has joined #openstack-nova15:02
*** tonytan4ever has joined #openstack-nova15:04
*** IanGovett has quit IRC15:06
*** belmoreira has quit IRC15:06
*** jcoufal has quit IRC15:08
*** baoli has quit IRC15:08
*** markvoelker has joined #openstack-nova15:08
*** baoli_ has joined #openstack-nova15:10
*** andrearosa has quit IRC15:12
*** markvoelker has quit IRC15:13
BobBallHow/what does the translation from 'uuid' to 'instance_uuid' in BandwidthUsage?  BandwidthUsage.create takes a uuid which seems to be set directly in the DB but _from_db_object seems to expect an instance_uuid field.  It does seem to work sometimes though (I don't always hit https://bugs.launchpad.net/nova/+bug/1463039)15:16
openstackLaunchpad bug 1463039 in OpenStack Compute (nova) "BandwidthUsage object has no attribute 'instance_uuid'" [Undecided,New]15:16
*** dprince has quit IRC15:17
*** andrearosa has joined #openstack-nova15:19
openstackgerritAlexandre Levine proposed openstack/nova-specs: Added a spec for disable-termination and shutdown-termination flags  https://review.openstack.org/18933415:20
*** irenab has joined #openstack-nova15:21
openstackgerritAndrey Pavlov proposed openstack/nova: template for disabe_terminate and shutdown_terminate flags  https://review.openstack.org/18911215:21
*** cbader has quit IRC15:21
*** cbader has joined #openstack-nova15:21
alaskiBobBall: afaik it doesn't happen.  I have code to do it in a review of mine https://review.openstack.org/#/c/172524/3/nova/objects/bandwidth_usage.py,cm15:23
*** Mike_D_laptop has joined #openstack-nova15:26
openstackgerritAndrey Pavlov proposed openstack/nova: template for disabe_terminate and shutdown_terminate flags  https://review.openstack.org/18911215:27
openstackgerritAlexandre Levine proposed openstack/nova-specs: Added a spec for disable-termination and shutdown-termination flags  https://review.openstack.org/18933415:28
BobBallalaski: Yay15:28
BobBallalaski: That might be the cause of my bug then :)15:28
* BobBall looks a little closer15:28
*** Mike_D_laptop has quit IRC15:28
*** markus_z has quit IRC15:29
*** ijuwang has quit IRC15:30
alaskiBobBall: looks like it.  I'll refresh my patch today15:30
*** Mike_D_laptop has joined #openstack-nova15:30
*** tjones1 has joined #openstack-nova15:31
*** leopoldj has quit IRC15:31
BobBallGreat - thanks!15:32
BobBallLet me know if you want me to pull out the fix into a different review or something15:32
*** electrocucaracha has quit IRC15:34
*** raies has joined #openstack-nova15:34
raieslxsli: hi15:35
*** electrocucaracha has joined #openstack-nova15:35
*** electrocucaracha has quit IRC15:35
*** Jeffrey4l has quit IRC15:36
*** aix has quit IRC15:36
lxsliraies: hiya15:36
raieslxsli: I want to discuss regarding patch https://review.openstack.org/#/c/139025/15:37
*** agireud has quit IRC15:37
raieslxsli: lets discuss it point to point15:37
lxslithought so :)15:37
*** mtanino has joined #openstack-nova15:38
*** Sukhdev has joined #openstack-nova15:39
lxsliWant to start?15:40
raieslxsli: https://review.openstack.org/#/c/139025/29/nova/api/openstack/compute/plugins/v3/servers.py #L37415:40
lxsliB64_REGEX?15:41
raieslxsli: what way I should make it sorted15:41
lxslioh, wrong file15:41
raieslxsli: I didn't get B64_REGEX15:41
*** unicell has quit IRC15:41
lxslimy mistake, I see it now15:41
*** sdake_ has quit IRC15:42
lxsliso garyk has a point, OpenStack style is to prefer line continuation with () rather than \15:42
lxslior if you're talking about my comment on L382, it should be possible to not nest four ifs together15:42
raieslxsli: okk thats good, I will amend it in next patch15:43
raiesyes I am talking about yours15:43
lxsliI refactored your code in patch 28, I hoped you'd fix that rather than completely reverting15:43
*** tsekiyama has joined #openstack-nova15:44
raieslxsli: ok I will check it once again, actually I thought you do not have comment on my portion of code15:44
*** Nisha has joined #openstack-nova15:44
raieslxsli: but its ok I will check and amend it15:44
raieslxsli: one more thing in same file15:45
lxsliI had a lot of comments on PS#26 and thought that rather than tear your patch apart, it would be more constructive to show how I thought it could be done better15:45
raieswhether I should remove L#331 onward comments15:45
raies??15:45
lxslimm15:45
johnthetubaguylxsli: did we write that down somewhere, and preferring () over \? I thought in Nova we were saying something like, if the machine doesn't check it, we don't have an opinion. (i am excluding discussions on names, etc, and stuff thats not machine checkable)15:45
*** agireud has joined #openstack-nova15:46
garyklxsli: my preference is the ()15:46
lxslijohnthetubaguy: I think it may have been checked for a bit but maybe it isn't now?15:46
*** matrohon has quit IRC15:46
danpbi believe we've got a policy of using () based on the number of -1's i've had for using \15:47
lxsligaryk: honestly I'm fine with either, but our style seems more like () and I do like consistency15:47
lxsliraies: I think the TODO still needs to be done15:47
*** sdake has joined #openstack-nova15:47
danpbjohnthetubaguy: in general, I always push for an addition to the nova/hacking/checks.py file  for anything code style related15:47
garykmy two cents is that whever possible we should use () and if there is no way around then to use \15:47
johnthetubaguyright local consistency wins here, just doesn't seem worth delaying a patch for, unless we get the machine to check for that, at least I thoughts that what our policy was here15:47
*** pece has quit IRC15:48
johnthetubaguygaryk: can we add a machine check for that?15:48
lxsliraies: you could do it, as you're bumping the microversion anyway now, and remove the TODO - it's trivial15:48
danpbbut sometimes we have to be pragmatic because writing a machine check for somethings is a total PITA15:48
garykjohnthetubaguy: i do not think so. there are so many lines of the db code that has the \15:48
*** electrocucaracha has joined #openstack-nova15:48
*** sdake_ has joined #openstack-nova15:48
lxsliraies: you can drop lines 335-344 I think but I'd keep 346-34815:49
*** afazekas has quit IRC15:49
lxsliraies: I'll put some extra comments15:50
raieslxsli: okk15:50
*** dane-fichter has quit IRC15:50
raieslxsli: So according to you, your lines L#346 covers these ?15:50
lxsliraies: I think the comment at line 346 is still useful15:51
raieslxsli: let me check15:51
johnthetubaguygaryk: danpb: hmm, personally I think we should stop -1 ing for it, or machine check it somehow, as its going to just waste time for folks submitting code and reviewer time. I kinda thought we agreed that at some point (wonders if jogo wrote that down somewhere), either way, we should probably right down what we choose15:51
johnthetubaguyanyways, not going to dig into that right now, more important things need documenting15:52
*** sdake has quit IRC15:52
*** gszasz has quit IRC15:53
*** yingjun has quit IRC15:53
raieslxsli: r u talking about commented lines  at 346 ?15:53
raieslxsli: I do not see any comment near 34615:53
lxsliyes15:53
raieswhich patch you ae talking about15:53
raiesokk15:54
lxslihttps://review.openstack.org/#/c/139025/29/nova/api/openstack/compute/plugins/v3/servers.py15:54
lxsli# If all tenants is passed with 0 or false as the value15:54
raiesokk15:54
raieslxsli: Please confirm,  I think TODO is done in our code. what you say ?15:55
raiesdel search_opts['all_tenants']15:56
*** sdake_ is now known as sdake15:56
mriedemalexpilotti: looks like hyper-v ci is sad on stable/juno http://64.119.130.115/178446/2/Hyper-V_logs/create-environment-c2-r2-u06.openstack.tld.log.gz15:56
raiesI think this removes TODO. what you say I think we should exclude this TODO15:56
raieslxsli: ^^15:57
*** wuhg has quit IRC15:57
alexpilottiociuhandu: ^15:57
ociuhandumriedem: looking now into this15:57
lxsliraies: just reading carefully15:58
*** moshele has quit IRC15:58
*** jlanoux has quit IRC15:59
*** devananda has joined #openstack-nova15:59
*** varya has joined #openstack-nova16:01
*** garyk has quit IRC16:01
lxsliraies: so the TODO is to automatically set all_tenants if tenant_id is passed16:01
lxsliraies: unless the context project id matches the search tenant_id, because then you don't need it16:02
*** tonytan4ever has quit IRC16:02
raieslxsli: yes it seems to me same16:02
*** rfolco has quit IRC16:02
*** tonytan4ever has joined #openstack-nova16:02
lxsliraies: whereas if I read it right, your code allows anyone to query any tenant without checking they have all_tenants?16:02
raieslxsli: in my code one tenant can't se other's16:04
*** yassine_ has quit IRC16:04
raiesfor this purpose get_per_tenant policy is implemented in api.py16:04
*** romainh has left #openstack-nova16:04
lxsliok let me check that16:04
*** rushiagr is now known as rushiagr_away16:04
*** BobBall is now known as BobBall_AWOL16:04
*** whenry has quit IRC16:05
*** annegentle has quit IRC16:06
raieslxsli: https://review.openstack.org/#/c/139025/29/nova/compute/api.py L#195116:07
*** tonytan4ever has quit IRC16:07
*** IanGovett has joined #openstack-nova16:07
lxsliwe want a user from tenant A to be able to query tenant B if they have permission get_all_tenants; or if they have get_per_tenant for tenant B, is that correct?16:07
raieslxsli: let me clarify16:08
*** amotoki has quit IRC16:08
*** amotoki has joined #openstack-nova16:08
raiesonly  a user in admin tenant can see tenant B16:08
raies2. a user in Tenant A can't see Tenant B until unless Tenant A is admin16:09
raies3. nova list ==> gives list in current context16:09
*** jistr has quit IRC16:10
raies4. nova list --tenant <tenant id> ==> gives all servers for all users in tenant with tenant_id16:10
*** sahid has quit IRC16:11
raies5. nova list --all-tenants --tenant <tenant_id> gives all servers for all-tenants in current context16:11
raiesas all-tenants are entertained first16:11
*** patrickeast has joined #openstack-nova16:11
raies6. nova list --tenant <tenant-id> --user <user id> ==> gives all servers for user/tenant combination16:12
*** apuimedo has quit IRC16:12
lxslithis would be helpful in the commit message :)16:12
raies7. nova list --all-users ==> all servers for all users in current context16:13
*** tonytan4ever has joined #openstack-nova16:13
raieslxsli: now any confusion ?16:13
lxslilet me process that16:13
lxsliwhat's get_per_tenant for then?16:13
raieslxsli: one user in Tenant A should be isolated fron another user in Tenant B until unless it is Admin Tenant16:14
*** yamahata has joined #openstack-nova16:15
*** rfolco has joined #openstack-nova16:15
raiesget_per_tenant ===> policy to isolate one tenant from other16:15
lxslimight be clearer as "get_any_user_in_tenant"16:16
*** achanda has joined #openstack-nova16:16
raieslxsli: No it should not be at user level. It should be at teant level16:16
raiesas we are only isolation tenants16:17
raieslxsli: users under tenant will automatically be isolated16:17
*** hemna_ is now known as hemna16:17
raieslxsli: You can run above 7 scenarios and get result16:17
raiesin a tenant any user can see other user in same tenant16:18
raiesbut isolation outer boundary should be Tenant only16:18
lxsliso "one user in Tenant A should be isolated fron another user in Tenant B unless it is Admin Tenant" seems to contradict "in a tenant any user can see other user in same tenant"16:19
lxsliOh wait, I see16:19
raiesTenant A===>(user1, user2, user3)  : any user in tenant A can see each other16:20
lxsliSo can you phrase what having get_per_tenant lets you do?16:20
raiesTenant B===>(user4, user5, user6)  : any user in tenant B can see each other16:20
raiesBut user 1 can't see user 416:20
raiesok I can do this.16:21
raiesActually this is a bit tricky, I had to find hard how to implement above scenarios16:22
raieslxsli: implementation is simple but letting it known to someone is a bit difficult.16:22
raiesSo, I think https://review.openstack.org/#/c/139025/29/nova/api/openstack/compute/plugins/v3/servers.py is clear16:22
raies??16:22
raiesagain any thing else on https://review.openstack.org/#/c/139025/29/nova/compute/api.py ??16:23
lxsliI can't see get_per_tenant mentioned at all in v3/servers.py16:24
raiesservers.py calls get_all of api.py16:24
lxsliit seems that it allows you to query by tenant_id16:24
raiesyes that why I have mentioned it -- You can query like ===> nova list --tenant <tenant-id>16:25
lxslibut, it seems to me that if you have get_all_tenants, you should implicitly have get_per_tenant and vice versa. is that true or can you explain why not?16:25
lxsliin other words, you're admin or not16:26
*** nic has joined #openstack-nova16:26
raiesif you have get_all_tenant16:26
raieslxsli: see  servers.py16:27
raiesyou will go at L#36516:27
*** tonytan4ever has quit IRC16:27
raieslxsli: after that u have only all_tenants in search_opts16:27
raieslxsli: all_tenants is getting deleted in L#38616:28
raieslxsli: now get_all of api.py16:28
raieslxsli: get_per_tenant will not be executed16:29
raiesit means it is going in all_tenants for current context16:29
*** unicell has joined #openstack-nova16:29
raieslxsli: whether it is admin context or non admin context16:29
raieslxsli: are you getting it16:29
lxsliI see that they are both checked16:30
raieslxsli: Thus implementation is correct16:30
lxsliI don't see what benefit having an extra permission provides16:30
raieslxsli: No they both are not checked when passed all-tenants16:30
raiesplease check again16:30
raieslxsli: if all-tenants in servers.py l#36516:31
lxsliraies: please listen for a moment16:31
lxsliraies: the implementation is not at issue right now16:31
raiesok16:31
lxsliraies: what benefit does adding get_per_tenant provide? really?16:31
*** dprince has joined #openstack-nova16:31
*** lpetrut has quit IRC16:31
lxsliraies: if you can see all tenants, you should be able to query them individually and vice versa16:32
raiesisolation one tenant from other. If one tenant tries to see other Policy does not allow error should come16:32
lxsliusers by default are isolated across tenants16:33
raieslxsli: Again get_all_tenant and get_per_tenant are not called simultneously16:33
raiesif all-tenant is in search_opts16:33
raiesthe get_all_tenant will be executed16:33
lxslithe old solution was to require all_tenants if tenant_id is passed; this is a bit clunky from a user POV so the TODO said to implicitly set all_tenants if tenant_id is passed and check that permission16:33
raiesand if not passed then else part at line L#379 will be executed16:34
*** diogogmt has joined #openstack-nova16:34
diogogmtany technical reason why this validation is being applied when a volume is detached from an instance? https://github.com/openstack/nova/blob/master/nova/api/openstack/compute/contrib/volumes.py#L41216:34
raieslxsli: in this case whats happening let me tell you once again16:35
raieslxsli: 1. case1. -all-tenants ==>16:35
lxsliactually lets take a break16:35
raiessearch_opts will have all_tenants16:36
lxsliI need to go home and I think some space to process would help16:36
*** annashen has joined #openstack-nova16:37
*** davideagnello has joined #openstack-nova16:37
raieslxsli: if we have all-tenants then it mean we should give output all servers from all users in all tenants (in case of admin tenant) or we should give output all servers from alll users in CURRENT tenants (In case of non admin)16:38
*** _gryf has quit IRC16:38
raiesthinking this please see16:38
kashyapmriedem: When you get a sec, maybe you're planning to resubmit this by retrying the virt_dom.destroy() call? - https://review.openstack.org/#/c/181781/16:38
raiesall-tenants ==> get_all_tenants permision will executed16:39
*** ijw has joined #openstack-nova16:39
mriedemkashyap: i still have to process danpb's comment16:39
lxsliwhat I'd recommend right now is putting some of this in the commit message and trying to refactor the code to make it clearer that all the cases are covered16:39
mriedemsitting in my email16:39
raiesif not all-tenants ==> per tenant check is required16:39
raieslxsli: hmm good approach16:39
kashyapmriedem: I ask because it's still sitting there in the elastic-recheck page as one of the top bugs.16:39
kashyapmriedem: Thanks.16:40
raiesI will mention all above usecases to verify this16:40
*** ijw has quit IRC16:40
danpbmriedem: which comment ?16:40
mriedemdanpb: the one i haven't parsed yet16:40
kashyap:-)16:40
mriedemon a call, sorry16:40
kashyapdanpb: https://review.openstack.org/#/c/181781/2/nova/virt/libvirt/driver.py16:40
*** varya has quit IRC16:40
kashyapThat one16:40
lxsliraies: it's quite confusing having a mutable dict passed between two places, it might help to try to clarify the responsibilities of server.py vs api.py16:40
*** ijw has joined #openstack-nova16:40
*** achanda has quit IRC16:41
raieslxsli: I will try to capture codes from patch#26 but still if there would be any gap I will chat you over that16:41
danpboh right16:41
openstackgerritDaniel Berrange proposed openstack/nova: objects: convert config drive to use ImageMeta object  https://review.openstack.org/18932316:41
openstackgerritDaniel Berrange proposed openstack/nova: hyperv: convert driver to use nova.objects.ImageMeta  https://review.openstack.org/18930216:41
openstackgerritDaniel Berrange proposed openstack/nova: ironic: convert driver to use nova.objects.ImageMeta  https://review.openstack.org/18936216:41
lxsliraies: sure thing, chat again later16:41
kashyapdanpb: I was checking here, because I see people mention it on other IRC channels, and have triaged atleast 6 bugs related to that.16:41
raieslxsli: in which file you are talking about ?16:42
raiesmutabledict ?16:42
lxslimutable => a thing which can be changed16:42
lxslispecifically, the search_opts16:42
raieslxsli: I know that16:42
raiesI am asking you where you are pointing it in code16:43
lxslibecause it keeps changing, you have to keep track of its current state in your head as you read the code, which is a nightmare16:43
*** belmoreira has joined #openstack-nova16:44
raiesok leave it all, I will upload a next patch which will sort out major problem and confusions16:44
*** rushiagr_away is now known as rushiagr16:44
lxsliraies: ok, I'll have a look when it goes up. Bye for now o/16:44
*** lxsli is now known as lxsli_away16:44
*** achanda has joined #openstack-nova16:44
raieslxsli: okk thanks bye16:44
*** raies has left #openstack-nova16:44
mriedemkashyap: got a few things on my plate today that take priority, but i should be able to fit that in later this afternoon16:44
*** bnemec has quit IRC16:45
kashyapmriedem: Sure, didn't mean imply to attend to it immediately.16:45
mriedemkashyap: fwiw we hit it in our internal CI also but not in a resize case16:45
*** mdrabe has joined #openstack-nova16:45
mriedemwhich reminds me, i got libvirt debug logging enabled on friday to track that down internally....16:45
*** bnemec has joined #openstack-nova16:46
mriedemoh awesome, now that i turned on libvirtd debug logging the problem isn't happening anymore internally :)16:46
kashyap:-)16:48
kashyapmriedem: Yeah, this looks like one of those crazy bugs to find the root cause16:48
mriedemwe are running tempest on a smaller flavor, only 4 VCPUs16:49
*** garyk has joined #openstack-nova16:49
jaypipescfriesen: please take a look at the resource objects implementation here: https://review.openstack.org/#/c/12899216:51
jaypipescfriesen, lxsli_away: so a "resource" is neither an amount nor a usage. A "resource" is a class of quantifiable things that may be requested by a user. An "amount" is the abstract quantity of that resource. A "usage" is an abstract representation of capacity and used amounts of the resource.16:52
*** exploreshaifali has joined #openstack-nova16:53
jaypipescfriesen, lxsli_away: furthermore, you are conflating a resource "provider" -- e.g. a compute node -- with the usage records of individual resources that the provider provides.16:53
*** alex_klimov has quit IRC16:55
*** otter768 has joined #openstack-nova16:55
*** markvoelker has joined #openstack-nova16:57
*** otter768 has quit IRC16:59
*** lucasagomes is now known as lucas-dinner17:01
*** derekh has quit IRC17:01
*** markvoelker has quit IRC17:02
*** vilobhmm has joined #openstack-nova17:03
*** pixelbeat_ has quit IRC17:03
*** amotoki has quit IRC17:04
*** atuvenie has quit IRC17:04
*** jodah has joined #openstack-nova17:06
*** annegentle has joined #openstack-nova17:06
*** dims has joined #openstack-nova17:07
*** vipul has joined #openstack-nova17:08
jaypipeseliqiao: you planning to rebase https://review.openstack.org/#/c/156112/ soon? :)17:08
*** lpetrut has joined #openstack-nova17:09
*** dims_ has quit IRC17:10
openstackgerritAlvaro Lopez Garcia proposed openstack/nova-specs: WIP: Propose to support spot instances  https://review.openstack.org/10488317:10
*** ssurana has joined #openstack-nova17:10
*** bradjones has quit IRC17:10
ericksonsantosjohnthetubaguy, ping about: https://etherpad.openstack.org/p/YVR-nova-liberty-summit-action-items17:11
*** bradjones has joined #openstack-nova17:11
*** bradjones has quit IRC17:11
*** bradjones has joined #openstack-nova17:11
*** annegentle has quit IRC17:12
*** agireud has quit IRC17:14
*** erw has left #openstack-nova17:16
*** IanGovett has quit IRC17:16
*** IanGovett has joined #openstack-nova17:18
*** annegentle has joined #openstack-nova17:20
*** annashen has quit IRC17:21
*** lpetrut has left #openstack-nova17:21
*** sudipto has joined #openstack-nova17:22
*** annashen has joined #openstack-nova17:22
*** Marga_ has joined #openstack-nova17:23
*** atuvenie has joined #openstack-nova17:26
*** Marga_ has quit IRC17:27
*** baoli_ has quit IRC17:27
*** Marga_ has joined #openstack-nova17:27
*** baoli has joined #openstack-nova17:29
*** dsanders has joined #openstack-nova17:30
*** eglynn has quit IRC17:30
*** lsmola has quit IRC17:32
*** rushiagr is now known as rushiagr_away17:33
openstackgerritDave Walker proposed openstack/nova: Removed a non-conditional 'if' statement  https://review.openstack.org/18937717:34
*** Sukhdev has quit IRC17:39
*** Sukhdev has joined #openstack-nova17:40
mriedemjaypipes: i have a mind to just rebase that myself17:40
jaypipesmriedem: feel free... I'm eager to review it.17:41
jaypipessdague: best line from that blog post: "But the moment you start thinking about what the client code would look like to talk to that, you want to throw up a little bit."17:46
*** electrocucaracha has quit IRC17:47
*** annashen has quit IRC17:48
*** gzhai has quit IRC17:51
*** aswadr has quit IRC17:51
*** eliqiao has quit IRC17:51
openstackgerritDave Walker proposed openstack/nova: Removed a non-conditional 'if' statement  https://review.openstack.org/18937717:51
*** xiaohui has quit IRC17:52
*** xiaohui has joined #openstack-nova17:52
*** zz_jgrimm is now known as jgrimm17:53
*** gzhai has joined #openstack-nova17:53
*** ZZelle_ has joined #openstack-nova17:54
sdaguejaypipes: heh, thanks :)17:55
*** annegentle has quit IRC17:55
*** annegentle has joined #openstack-nova17:56
*** marun has joined #openstack-nova17:56
*** eliqiao has joined #openstack-nova17:57
*** ijw_ has joined #openstack-nova17:58
*** achanda_ has joined #openstack-nova17:59
*** dontalton has joined #openstack-nova18:00
*** ijw has quit IRC18:01
*** achanda has quit IRC18:02
mriedemdanpb: what do you think about just calling back into _destroy() again if we hit EBUSY here? https://review.openstack.org/#/c/181781/2/nova/virt/libvirt/driver.py18:02
*** sdake has quit IRC18:02
*** sdake has joined #openstack-nova18:02
*** exploreshaifali has quit IRC18:04
danpbmriedem: we should probably use a loop instead, otherwise the stack could get very deep18:04
mriedemdanpb: well i was thinking about killing it at 318:05
ericksonsantosHi! :)18:06
ericksonsantosDoes someone know how to use keystoneclient from Nova?18:06
ericksonsantosI want to call keystoneclient.projects.get(...), but I don't know the best way to instantiate keystoneclient.18:07
mriedemdanpb: like this http://paste.openstack.org/show/274985/18:07
danpbmriedem: so that'll result it the instance going into ERROR state on the 4th loop ?18:09
*** openstackgerrit has quit IRC18:09
mriedemit would result in whatever happens today when we hit that18:09
*** openstackgerrit has joined #openstack-nova18:09
danpbheh18:09
mriedemdanpb: which is yeah, ERROR state18:11
danpbthats ok then18:11
mriedemok, i'll write up a test and see how this looks18:11
mriedemand recheck it a few times to see if i can recreate that bug18:11
lifelesscfriesen: hi18:15
lifelesscfriesen: on this ChunkedFile thing18:15
lifelesscfriesen: you're using the filesystem backend for glance yeah ?18:16
*** danpb has quit IRC18:16
*** whenry has joined #openstack-nova18:16
lifelesscfriesen: or rather, let me put it another way - how does nova's process end up with a ChunkedFile ?18:16
*** rushiagr_away is now known as rushiagr18:18
*** browne has joined #openstack-nova18:19
*** gary-smith has joined #openstack-nova18:24
*** agireud has joined #openstack-nova18:24
*** pixelbeat_ has joined #openstack-nova18:29
*** IanGovett has quit IRC18:30
*** achanda_ has quit IRC18:32
*** agireud_ has joined #openstack-nova18:33
*** agireud has quit IRC18:34
*** agireud_ is now known as agireud18:34
*** eliqiao has quit IRC18:37
*** Marga_ has quit IRC18:40
*** rushiagr is now known as rushiagr_away18:40
*** Sukhdev has quit IRC18:41
*** achanda has joined #openstack-nova18:41
*** eglynn has joined #openstack-nova18:41
*** eliqiao has joined #openstack-nova18:41
*** achanda has quit IRC18:46
*** markvoelker has joined #openstack-nova18:46
*** Marga_ has joined #openstack-nova18:47
*** electrocucaracha has joined #openstack-nova18:48
*** annashen has joined #openstack-nova18:49
*** agireud has quit IRC18:50
*** markvoelker has quit IRC18:52
*** agireud has joined #openstack-nova18:53
openstackgerritLee Yarwood proposed openstack/nova: Multipath commands with error messages in stdout fail to parse  https://review.openstack.org/17266018:54
*** annashen has quit IRC18:54
openstackgerritAndrew Laski proposed openstack/nova: Return bandwidth usage after updating  https://review.openstack.org/17252418:55
openstackgerritAndrew Laski proposed openstack/nova: Map uuid db field to instance_uuid in BandwidthUsage object  https://review.openstack.org/18939718:55
*** sudipto has quit IRC18:55
*** otter768 has joined #openstack-nova18:56
vilobhmmjaypipes : qq18:56
*** electrocucaracha has quit IRC18:57
*** baoli has quit IRC18:59
*** otter768 has quit IRC19:01
*** annashen has joined #openstack-nova19:01
*** ijw_ has quit IRC19:01
*** ijw has joined #openstack-nova19:02
*** electrocucaracha has joined #openstack-nova19:03
*** eglynn has quit IRC19:06
*** annegentle has quit IRC19:06
*** annegentle has joined #openstack-nova19:06
*** eglynn has joined #openstack-nova19:13
*** FL1SK_ has joined #openstack-nova19:14
*** FL1SK has quit IRC19:15
*** igordcard has joined #openstack-nova19:15
*** BadCub is now known as BadCub-Hiding19:20
*** annashen has quit IRC19:28
vilobhmmbauzas, jaypipes : can we say the same thing about computefilter for stable/icehouse "that its never executed"…(i guess no) say https://github.com/openstack/nova/blob/stable/icehouse/nova/scheduler/filter_scheduler.py#L317 -> https://github.com/openstack/nova/blob/stable/icehouse/nova/scheduler/filter_scheduler.py#L358 -> https://github.com/openstack/nova/blob/stable/icehouse/nova/scheduler/host_manager.py#L44319:38
*** tjones1 has quit IRC19:38
*** electrocucaracha has quit IRC19:38
*** electrocucaracha has joined #openstack-nova19:38
*** dprince has quit IRC19:39
vilobhmmmy bad since this executes before any filter https://github.com/openstack/nova/blob/stable/icehouse/nova/scheduler/driver.py#L111-L117 it should be true…can you please confirm that19:41
*** ociuhandu has quit IRC19:41
openstackgerritEd Leafe proposed openstack/nova-specs: Add liberty priorities  https://review.openstack.org/18727219:43
*** Nisha has quit IRC19:44
*** FL1SK_ is now known as FL1SK19:48
openstackgerritAndrey Pavlov proposed openstack/nova: template for disabe_terminate and shutdown_terminate flags  https://review.openstack.org/18911219:51
*** eharney has quit IRC19:54
openstackgerritMatt Riedemann proposed openstack/nova: libvirt: handle code=38 + sigkill (ebusy) in destroy()  https://review.openstack.org/18178119:55
*** tjones1 has joined #openstack-nova19:55
*** alex_klimov has joined #openstack-nova19:56
mriedemkashyap: ^ happy birthday19:56
*** Marga_ has quit IRC19:57
*** dave-mcc_ has joined #openstack-nova19:59
*** dprince has joined #openstack-nova20:01
*** dave-mccowan has quit IRC20:02
*** dulek has quit IRC20:05
cfriesendoes anyone know why "allow_resize_to_same_host" defaults to False?20:10
cfriesenlifeless: you around? missed you earlier.   I think what's happening is that nova calls out to glance-api, which interally creates the ChunkedFile object and returns a URL that nova can read from to get the image data.   Nova starts reading from that URL, but then hits an exception and then stops.20:12
*** afazekas has joined #openstack-nova20:13
cfriesenlifeless: so then glance-api has this ChunkedFile object sitting there and it's just waiting to be read from but nova won't ever read from it anymore.20:13
lifelesscfriesen: hi20:14
lifelesscfriesen: right, did you see my reply on the thread20:14
lifelesscfriesen: I'm trying to unpick all the way back up20:14
cfriesenlifeless: checking20:14
lifelesscfriesen: if the http connection is closed the api container (whatever it is) will cleanup20:14
lifelessunless thats buggy20:15
lifelesswe'll find the bug and the world will be better20:15
cfriesenlifeless: so you're saying that when nova leaves image.glance.GlanceImageService.download() then image_chunks goes out of scope and that should result in the http connection closing, which should get propagated down (in glance-api) down into the ChunkedFile object being destroyed?20:18
lifelessyes20:19
lifelesstcp can signal close at any point20:19
lifelessin your environment we don't need to worry about firewallsmessing with tcp state either20:19
cfriesenwill that result in self.fp being being closed at the time ChunkedFile is destroyed?  or does ChunkedFile need a destructor that closes the file?20:20
*** Mike_D_laptop has quit IRC20:21
*** dprince has quit IRC20:22
*** exploreshaifali has joined #openstack-nova20:23
jaypipescfriesen: have you done a lsof to see who owns the file descriptors you see as leaking?20:26
cfriesenjaypipes: glance-api20:26
jaypipescfriesen: k. thx, looking something right quick.20:26
cfriesenjaypipes: pretty sure it's the glance_store._drivers.filesystem.ChunkedFile class20:27
jaypipescfriesen: you using v1 or v2 Glance API?20:28
mriedemdansmith: i think you wanted to see this happen https://review.openstack.org/#/c/183711/20:28
*** annashen has joined #openstack-nova20:28
*** eharney has joined #openstack-nova20:28
jaypipescfriesen: pretty sure it's not the ChunkedFile in filesystem driver.20:29
jaypipescfriesen: more likely to be the utils.cooperative_iter(): https://github.com/openstack/glance/blob/master/glance/api/v1/images.py#L49920:29
dansmithmriedem: well, I wanted to see us fail on <5.0, but yes this is better than nothing20:30
lifelessjaypipes: that also uses a clean for loop20:30
lifelessjaypipes: so should be triggering refcount-zero cleanups on exiting scope20:30
*** prashant__ has quit IRC20:31
cfriesenjaypipes: not sure which version actually.  easiest way to check?20:31
jaypipescfriesen: keystone service_catalog, check the version in the image API endpoint URI.20:31
jaypipessorry, keystone catalog20:31
lifelesscfriesen: how is glance-api deployed? mod_wsgi? gunicorn? ... ?20:31
jaypipeslifeless: I don't see https://github.com/openstack/glance/blob/master/glance/common/utils.py#L151 close()'ing the file descriptor it gets passed...20:32
lifelessjaypipes: its not passed an fd, but an iterable20:33
lifelessjaypipes: the ChunkedFile iterable has a try:finally:close:20:33
lifelessjaypipes: when the iterator created from the iterable goes out of the for loop its refcount hits zero and the generator gets an exception thrown from whatever yield it was on, which will hit the finally.20:33
jaypipeslifeless: it's passed an fd, not an iterable.20:33
*** annashen has quit IRC20:34
lifelessjaypipes: cooperative_iter?20:34
jaypipesCooperativeReader.20:34
lifelessjaypipes: its passed the result of _get_from_store()[0]20:34
jaypipesits constructor.20:34
lifelessjaypipes: sorry, I was looking at cooperative_iter, not cooperative_read20:34
*** markvoelker has joined #openstack-nova20:35
cfriesenjaypipes: no version in the url: http://192.168.204.2:929220:35
jaypipeslifeless: hmm, question for you...20:35
*** baoli has joined #openstack-nova20:35
jaypipeslifeless: what if ChunkedFile was never iterated through? ChunkedFile.close() would never be called then?20:36
lifelessjaypipes: yes20:36
jaypipeslifeless: so do we think that's the issue?20:36
lifelessjaypipes: thats a clear bug, it might not be this one.20:36
lifelessit should open at the start of __iter__ IMO20:37
jaypipesagreed.,20:37
jaypipesman, this code is a blast from the past :)20:37
*** baoli has quit IRC20:37
jaypipesI wrote a lot of this shit about 4 years ago.20:37
*** vladikr has quit IRC20:38
*** baoli has joined #openstack-nova20:38
cburgessWhat jaypipes is saying is that its all his fault.20:38
cfriesenlol20:38
jaypipesyup.20:38
cfriesenjaypipes: does anything ever explicitly call ChunkedFile.close()?20:38
jaypipesof course, since glance_store was split out without the git history, there's no mention of me in the git blame... wooohooo! :)20:39
jaypipescfriesen: no, only the __iter__'s finally: block.20:39
jaypipescfriesen: which is why I mention to lifeless above that it may be that the ChunkedFile object is never iterated against, and that is the source of the leak.20:40
*** markvoelker has quit IRC20:40
lifelessjaypipes: it seems like a much narrower race to hit20:40
cfriesenjaypipes: in the success case we don't see the dangling refcounts20:40
cfriesenjaypipes: if I hack nova to keep reading on error the problem goes away20:41
lifelessjaypipes: and - since we have to run out of disk space on nova to trigger it AIUI20:41
lifelessjaypipes: that implies we've read at least one segment, so I think we can rule it out.20:41
jaypipeslifeless: no, not necessarily...20:41
jaypipeslifeless: one sec, grabbing a link..20:41
lifelessk20:41
mriedemgaryk: added some comments in this detach volume change https://review.openstack.org/#/c/169732/10/nova/virt/vmwareapi/driver.py - specifically the thing where the driver has to set a vm_state on the instance for volumeops to work is kind of sad20:42
mriedemgaryk: can't volumeops get the power_state of the vm from vcenter and use that rather than the nova db values on the instance?20:43
mriedemadds tight coupling between the driver and volumeops which is prone to break at some point when someone doesn't know to set the vm_state before calling volumeops.detach_volume20:43
*** annegentle has quit IRC20:44
lifelesshmm the chunkedfile chunk size is a bit small20:45
lifelessfor 10G connections you really want that up at say 4M20:45
lifelessshrug20:45
lifelessone bug at a time20:45
jaypipeslifeless, cfriesen: https://github.com/openstack/glance/blob/master/glance/image_cache/drivers/sqlite.py#L361-L37820:46
jaypipesso, I think this may have to do with the image cache middleware and how it returns a response iterator: https://github.com/openstack/glance/blob/master/glance/api/middleware/cache.py#L306-L30820:47
lifelessjaypipes: that bit of code is fine, its using with to do RAII20:47
lifelessjaypipes: the caller of open_for_read could leak potentially20:47
jaypipeslifeless: https://github.com/openstack/glance/blob/master/glance/image_cache/__init__.py#L228-L24420:48
jaypipeslifeless: the idea behind the caching middleware is to write images to a cache *while they are being streamed to a client*.20:49
*** apuimedo has joined #openstack-nova20:49
jaypipeslifeless: which is why you see the writer and reader iterables happening at the same time there.20:50
*** dave-mccowan has joined #openstack-nova20:50
*** Sukhdev has joined #openstack-nova20:50
lifelessk20:50
cfriesenjaypipes: so if the client never finishes reading the file...20:50
jaypipeslifeless: I have a feeling that cache_tee_iter() needs to have some sort of finally: block20:50
*** thangp has quit IRC20:50
*** dave-mcc_ has quit IRC20:50
jaypipeslifeless: bingo.20:50
*** achanda has joined #openstack-nova20:51
lifelessyou tested something ?20:51
jaypipeslifeless: no, I think you hit the nail on the head.20:51
jaypipescfriesen: an easy way to test this: can you remove (or disable) the image cache middleware and re-run your tests?20:52
openstackgerritDon Dugger proposed openstack/nova-specs: Remove flavor from scheduler request  https://review.openstack.org/18944420:52
lifelessget_from_cache is what triggers open_for_read20:52
jaypipescfriesen: if the tests no longer trigger this leak, we've determined the cause is the caching middleware.20:53
lifelessglance/api/middleware/cache.py line 168 is a problem20:54
*** Marga_ has joined #openstack-nova20:54
lifelessit calls a generator directly20:54
cfriesenjaypipes: just comment out the "paste.filter_factory = glance.api.middleware.cache:CacheFilter.factory" line?20:54
lifelesspotential problem I should say20:54
lifelesswhich will prime the generator and then its passed into method()20:55
lifelessbut exceptions thrown here could keep the thing alive on the stack20:55
lifelessbecause its context is not self-managing like for loops20:55
lifelessjust a possibility20:55
*** belmoreira has quit IRC20:56
*** achanda has quit IRC20:56
jaypipeslifeless: no, it doesn't call a generator directly. it returns the generator in the image_iterator element of the response (https://github.com/openstack/glance/blob/master/glance/api/middleware/cache.py#L214)20:56
*** otter768 has joined #openstack-nova20:57
cfriesenjaypipes: it'll take some time to set up the test...I'll let you know how it goes.20:57
jaypipeslifeless: nm, that's the incoming request, not te resp[onse.20:57
jaypipeslifeless: this is the process of the GET /images/{id} response: https://github.com/openstack/glance/blob/master/glance/api/middleware/cache.py#L306-L30720:58
*** Marga_ has quit IRC20:59
*** ivasev has quit IRC20:59
*** Marga_ has joined #openstack-nova20:59
*** raildo has quit IRC21:00
*** otter768 has quit IRC21:01
*** jdurgin has quit IRC21:03
*** annashen has joined #openstack-nova21:04
*** dave-mcc_ has joined #openstack-nova21:06
*** thorst has quit IRC21:07
lifelessjaypipes: correctme if I'm wrong21:08
jaypipesyou're wrong.21:08
lifelessjaypipes: but isn't caching middleware of file store a unuseful combination?21:08
jaypipeslifeless: it is indeed.21:08
cfriesenjaypipes: so easy workaround if this fixes things.21:08
jaypipeslifeless: but you're still wrong, because, well, it's better that way.21:08
lifelessjaypipes: speaking of21:08
lifelessjaypipes: how should we get this architecture spelunking thing going21:09
lifelesslike21:09
lifelesscan we block out a time slot, pick a project, pick some basic outcomes, whatever...21:09
*** dave-mccowan has quit IRC21:10
jaypipeslifeless: unfortunately, I am way over-committed already to things this cycle, including the API WG. I really don't think I'll be able to contribute much other than the occasional review or opinion :(21:10
lifelessok21:10
jaypipeslifeless: sorry :(21:10
lifelessclear signalling is useful21:10
lifelessnothing to apologise for21:10
*** annegentle has joined #openstack-nova21:11
*** burt has quit IRC21:12
*** afazekas has quit IRC21:13
*** jgrimm is now known as zz_jgrimm21:17
openstackgerritOpenStack Proposal Bot proposed openstack/nova: Updated from global requirements  https://review.openstack.org/18946121:19
*** sdake_ has joined #openstack-nova21:19
*** mriedem is now known as mriedem_away21:20
*** eglynn has quit IRC21:22
*** jdurgin has joined #openstack-nova21:23
*** sdake has quit IRC21:23
*** artom has quit IRC21:25
openstackgerritVladik Romanovsky proposed openstack/nova: virt: introduce libosinfo library to set hardware policy  https://review.openstack.org/14962521:27
openstackgerritVladik Romanovsky proposed openstack/nova: libvirt: use osinfo when configuring network model  https://review.openstack.org/14962721:27
openstackgerritVladik Romanovsky proposed openstack/nova: libvirt: adding libosinfo configuration  https://review.openstack.org/14962621:27
openstackgerritVladik Romanovsky proposed openstack/nova: libvirt: use osinfo when configuring the disk bus  https://review.openstack.org/14962821:27
*** afazekas has joined #openstack-nova21:27
*** eglynn has joined #openstack-nova21:29
*** jdurgin has quit IRC21:30
*** ociuhandu has joined #openstack-nova21:32
*** marun has quit IRC21:33
*** Marga_ has quit IRC21:37
*** lucas-dinner has quit IRC21:37
cfriesenjaypipes: I commented out "paste.filter_factory = glance.api.middleware.cache:CacheFilter.factory" and restarted glance-api.  a failed instance creation following by deleting the image in question results in two separate glance-api processes holding open file descriptors for "/opt/cgcs/glance/images/5222b99f-6fc7-4bab-96d9-de82f7e07287 (deleted)"21:39
jaypipescfriesen: on phone... gimme a few21:40
*** exploreshaifali has quit IRC21:40
*** exploreshaifali has joined #openstack-nova21:41
*** EmilienM is now known as EmilienM|afk21:41
*** VW has quit IRC21:46
*** dboik has quit IRC21:46
*** BadCub-Hiding is now known as BadCub21:47
*** ijw has quit IRC21:47
*** ijw has joined #openstack-nova21:48
*** jdurgin has joined #openstack-nova21:48
*** dprince has joined #openstack-nova21:49
*** agireud has quit IRC21:49
*** lucas-dinner has joined #openstack-nova21:50
*** lucas-dinner has quit IRC21:50
*** achanda has joined #openstack-nova21:51
*** aysyanne has quit IRC21:53
openstackgerritDon Dugger proposed openstack/nova-specs: Remove flavor from scheduler request  https://review.openstack.org/18944421:53
*** baoli has quit IRC21:55
*** achanda has quit IRC21:57
*** achanda has joined #openstack-nova21:59
*** eglynn has quit IRC22:02
*** baoli has joined #openstack-nova22:05
*** exploreshaifali has quit IRC22:05
*** achanda has quit IRC22:08
*** annegentle has quit IRC22:10
*** promulo has joined #openstack-nova22:14
*** annegentle has joined #openstack-nova22:15
*** promulo has quit IRC22:15
*** dave-mccowan has joined #openstack-nova22:15
*** VW has joined #openstack-nova22:16
*** afazekas has quit IRC22:17
*** dave-mcc_ has quit IRC22:18
*** baoli has quit IRC22:20
*** markvoelker has joined #openstack-nova22:21
*** markvoelker has quit IRC22:26
*** baoli has joined #openstack-nova22:27
*** diegows has joined #openstack-nova22:27
*** liusheng has quit IRC22:28
*** ijw has quit IRC22:28
*** liusheng has joined #openstack-nova22:28
*** ijw has joined #openstack-nova22:29
*** ijw has quit IRC22:30
*** penick has joined #openstack-nova22:31
*** VW_ has joined #openstack-nova22:38
*** VW has quit IRC22:38
flwangdansmith: ping22:39
dansmithflwang: ack22:39
flwangdansmith: may i know what kind of actions should be listed for the action-list command?22:39
flwangis there a policy for that?22:40
*** pilgrimstack has joined #openstack-nova22:40
flwangi asked since I found the nova backup action can't be shown with the action-list command22:40
dansmithflwang: I don't think there is any restriction around adding actions22:40
dansmithflwang: ask alaski22:41
*** nic has quit IRC22:41
*** baoli has quit IRC22:41
*** nic has joined #openstack-nova22:41
flwangdansmith: ok, cool, thanks22:41
*** diogogmt has quit IRC22:41
flwangalaski: ^22:42
*** apuimedo has quit IRC22:42
mriedem_awayappears we have a new multinode job failure22:43
openstackgerritNicolas Simonds proposed openstack/nova: imagebackend: Split out resize_image logic from create_image  https://review.openstack.org/18785722:44
openstackgerritNicolas Simonds proposed openstack/nova: Fix/implement revert-resize for RBD-backed images  https://review.openstack.org/18739522:44
mriedem_awayhttp://goo.gl/dpFqTV22:44
openstackgerritNicolas Simonds proposed openstack/nova: libvirt: Make the guest console configurable  https://review.openstack.org/12252322:44
*** ijw has joined #openstack-nova22:44
*** pilgrimstack has quit IRC22:45
*** mdrabe has quit IRC22:48
*** baoli has joined #openstack-nova22:49
*** Sukhdev has quit IRC22:50
cfriesenjaypipes: lifeless:  I was mislead earlier by the fact that it takes some time for the resources to be cleaned up.  With the image cache present it takes about 4 minutes for the file descriptor to be closed.  With the image cache not present it takes about 90 seconds.  In both cases it did eventually close in my testing today.22:52
*** jecarey has quit IRC22:53
lifelesscool22:55
mriedem_awaymultinode resize/migrate fail bug https://bugs.launchpad.net/nova/+bug/146320022:55
openstackLaunchpad bug 1463200 in OpenStack Compute (nova) "check-tempest-dsvm-multinode-full fails due to "Failed to compute_task_migrate_server: No valid host was found"" [Undecided,New]22:55
mriedem_awaylooks like one of the compute host services is being reported as down intermittently22:55
cfriesenjaypipes: lifeless: so I don't know if that's expected behaviour of the GC, or whether we can do better with ensuring that the fd is closed when the http connection is closed by nova.22:56
cfriesenjaypipes: lifeless:  gah!   I may have forgotten to remove our workaround.   one sec, will check and retest if necessary.22:57
*** otter768 has joined #openstack-nova22:57
cfriesenjaypipes: lifeless:  phew.  no workaround present, results are valid22:59
*** VW_ has quit IRC23:00
*** ZZelle_ has quit IRC23:01
*** VW has joined #openstack-nova23:01
*** annegentle has quit IRC23:02
*** otter768 has quit IRC23:02
*** xyang1 has quit IRC23:03
*** baoli has quit IRC23:03
*** jwcroppe_ has joined #openstack-nova23:05
*** VW has quit IRC23:06
*** jwcroppe has quit IRC23:07
*** zzzeek has quit IRC23:11
*** atuvenie has quit IRC23:12
*** jwcroppe has joined #openstack-nova23:13
*** jwcroppe_ has quit IRC23:14
melwittmriedem_away: why is it the else block should be removed here? https://review.openstack.org/#/c/189377/2/nova/virt/libvirt/host.py,cm23:16
mriedem_awaymelwitt: the formatting is weird, but there are 2 else blocks, the one that's left in there replaces it23:17
mriedem_awaymelwitt: it would have been more clear if the outer else was removed and the rest was shifted left23:17
melwittmriedem_away: oh, duh. I see it now, thanks23:18
*** dprince has quit IRC23:18
mriedem_awayyeah it's weird23:18
mriedem_awayi added a comment on that23:18
*** Sukhdev has joined #openstack-nova23:19
*** EmilienM|afk is now known as EmilienM23:20
*** electrocucaracha has quit IRC23:21
*** annegentle has joined #openstack-nova23:22
tonybIsn't it just git diff being too "smart"23:22
*** ijw has quit IRC23:23
*** dave-mcc_ has joined #openstack-nova23:23
*** Maike has joined #openstack-nova23:24
*** kmartin_ is now known as kmartin23:26
*** dave-mccowan has quit IRC23:26
*** flwang has quit IRC23:27
*** alex_klimov has quit IRC23:29
jaypipesedleafe, lxsli_away: If I renamed Usage to Inventory, would you be cool with that?23:31
*** hemna is now known as hemnafk23:32
*** zhenguo has joined #openstack-nova23:35
*** jaypipes has quit IRC23:35
*** thorst has joined #openstack-nova23:36
*** annegentle has quit IRC23:37
*** diogogmt has joined #openstack-nova23:38
*** flwang has joined #openstack-nova23:39
*** thorst has quit IRC23:39
openstackgerritDon Dugger proposed openstack/nova-specs: Remove flavor from scheduler request  https://review.openstack.org/18944423:39
*** cfriesen has quit IRC23:42
openstackgerritOpenStack Proposal Bot proposed openstack/nova: Updated from global requirements  https://review.openstack.org/18946123:44
*** dontalton has quit IRC23:45
*** annegentle has joined #openstack-nova23:51
*** Maike has quit IRC23:53
*** annegentle has quit IRC23:54
*** diogogmt has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!