Friday, 2017-05-19

*** ijw has quit IRC00:00
*** ijw has joined #openstack-nova00:01
*** MVenesio has joined #openstack-nova00:03
*** thorst_afk has joined #openstack-nova00:03
*** ijw has quit IRC00:03
*** ijw has joined #openstack-nova00:05
*** MVenesio has quit IRC00:05
*** ijw has quit IRC00:06
*** ijw has joined #openstack-nova00:06
*** jmlowe has quit IRC00:07
*** marst has quit IRC00:10
*** ijw has quit IRC00:15
melwittdansmith: is it ever possible to change the return type of a remotable method? like is there a way for new code to know old code is calling so the return type can be formatted to what the old code expects?00:15
dansmithmelwitt: nope00:15
dansmithpass a flag or create a new method00:16
dansmithideally the latter00:16
melwittokay. so to change all count() to return a dict instead of an int, I have to do something like that00:16
dansmithyeah00:16
melwittI'm trying to think if it's even possible for old code to call new code count(). it's only called in nova-api00:17
melwittQuotas.count()00:17
dansmithif you change it you should make a new method00:17
dansmithdon't cheat :)00:17
melwitt:(00:18
melwittthe hard part is thinking of a name that isn't dumb00:18
dansmithcount_less_sucky_than_the_first_attempt()00:18
melwittlol, I wish00:18
melwittmaybe count_as_dict since probably peeps will expect an integer00:19
dansmithoh please please call it count_dicts()00:19
melwittI don't get it00:21
*** yamamoto_ has joined #openstack-nova00:22
*** jmlowe has joined #openstack-nova00:22
*** thorst_afk has quit IRC00:23
cfriesenI think that's cause you're too mature00:24
melwittI shall use that excuse :)00:24
*** crushil has quit IRC00:24
dansmithI shall remain immature and unashamed00:26
*** yamamoto_ has quit IRC00:28
*** tbachman has quit IRC00:28
*** Yangyapeng has quit IRC00:30
*** fishbone_ has joined #openstack-nova00:32
fishbone_Hello all, I am having a serious problem. I am performing an upgrade from Newton to Ocata and every time I run the upgrade for nova-compute I receive "ERROR: could not access cell mapping database - has api db been created?"00:33
*** salv-orlando has joined #openstack-nova00:33
*** salv-orlando has quit IRC00:34
*** salv-orlando has joined #openstack-nova00:34
cfriesenfishbone: have you read the nova upgrade notes in the release notes?00:35
fishbone_cfriesen: yes I believe so, it only seemed to mention designate changes00:35
*** ijw has joined #openstack-nova00:36
fishbone_I see all of my nova services except for the compute services are up00:37
fishbone_I have tried creating the cells database manually and also by using the simple_cells command00:37
cfriesenfishbone: I think the section you want begins with "A new nova-manage command has been added which will upgrade a deployment to cells v2..." at https://docs.openstack.org/releasenotes/nova/ocata.html00:38
cfriesendansmith: is this correct? ^00:39
openstackgerritNaichuan Sun proposed openstack/nova master: xenapi: cached images should be cleaned up by time  https://review.openstack.org/46595400:39
fishbone_cfriesen: Thanks for the link, although I tried that method as well. I have my system backed up and was able to retry using that command from scratch. Also the issue only seems to lie with the compute hosts, my controller node can access the api database fine00:42
*** winston-d_ has joined #openstack-nova00:42
openstackgerritNaichuan Sun proposed openstack/nova master: xenapi: cached images should be cleaned up by time  https://review.openstack.org/46595400:42
*** thorst_afk has joined #openstack-nova00:44
*** ijw has quit IRC00:46
*** hongbin has quit IRC00:46
*** thorst_afk has quit IRC00:48
*** takashin has joined #openstack-nova00:49
*** ijw has joined #openstack-nova00:49
*** ericyoung has quit IRC00:50
openstackgerritNaichuan Sun proposed openstack/nova master: xenapi: cached images should be cleaned up by time  https://review.openstack.org/46595400:53
*** dikonoor has joined #openstack-nova00:54
*** rfolco has joined #openstack-nova00:56
*** salv-orlando has quit IRC00:59
*** databus23_1 has joined #openstack-nova01:00
*** phuongnh has joined #openstack-nova01:01
*** tovin07_ has joined #openstack-nova01:02
*** armax has quit IRC01:03
*** tbachman has joined #openstack-nova01:03
*** markmc` has quit IRC01:03
*** ansiwen has quit IRC01:04
*** ltomasbo|away has quit IRC01:04
*** kashyap has quit IRC01:04
*** databus23_ has quit IRC01:04
*** weshay has quit IRC01:04
*** lucas-afk has quit IRC01:04
*** jpena|off has quit IRC01:04
*** mdbooth has quit IRC01:04
*** migi has quit IRC01:04
*** dmellado has quit IRC01:04
*** dave-mccowan has quit IRC01:06
*** kashyap has joined #openstack-nova01:07
*** migi has joined #openstack-nova01:07
*** lucasagomes has joined #openstack-nova01:10
*** dikonoor has quit IRC01:10
*** weshay has joined #openstack-nova01:10
*** seungjin has joined #openstack-nova01:10
*** ansiwen has joined #openstack-nova01:11
*** mdbooth has joined #openstack-nova01:11
*** Sukhdev has quit IRC01:12
*** kaisers has quit IRC01:12
*** jpena|off has joined #openstack-nova01:13
*** ltomasbo|away has joined #openstack-nova01:13
*** seungjin is now known as johnhaan01:14
*** gjayavelu has quit IRC01:14
*** markmc has joined #openstack-nova01:14
*** ijw has quit IRC01:15
*** Shunli has joined #openstack-nova01:16
mriedemfishbone_: "could not access cell mapping database" has nothing to do with the computes01:20
mriedemyou're getting that from running nova-manage db sync right?01:20
mriedemnova.conf on the compute node doesn't need access to the API database (or any database for that matter)01:20
fishbone_mriedem: I didn't think so either, however; I don't get the error when syncing the database, that seems to work with no errors. I get it when upgrading nova-compute on the compute nodes01:22
*** dmellado has joined #openstack-nova01:22
*** Sukhdev has joined #openstack-nova01:22
*** Sukhdev has quit IRC01:22
mriedemwhy are you running nova-manage db sync on the compute nodes?01:22
*** esberglu has joined #openstack-nova01:22
*** esberglu has quit IRC01:23
*** ijw has joined #openstack-nova01:23
mriedemalso fyi https://docs.openstack.org/developer/nova/cells.html#upgrade-minimal01:23
*** ijw has quit IRC01:23
mriedemwhat you're hitting is this https://github.com/openstack/nova/blob/master/nova/cmd/manage.py#L64901:24
mriedemwhen it's trying to automatically sync the nova_cell0 database01:24
*** yamamoto_ has joined #openstack-nova01:24
mriedemanyway, you shouldn't need to sync the db from the compute nodes01:25
*** Yangyapeng has joined #openstack-nova01:27
*** rmk has quit IRC01:27
fishbone_mriedem, are you saying the error can be ignored, I don't think I am able to compete the nova-compute installation because of this error01:28
fishbone_mriedem: Is there a way to suppress that sync process?01:29
mriedemi'm saying you don't need to sync the database from a compute node01:29
mriedemthe compute node doesn't have direct access to the database01:29
mriedemor shouldn't01:29
*** yamamoto_ has quit IRC01:29
*** rmk has joined #openstack-nova01:32
*** rmk has quit IRC01:32
*** rmk has joined #openstack-nova01:32
fishbone_mriedem: Do you know why I may be getting that error on a compute host then?01:33
fishbone_mriedem: I get the error even if I do a fresh install of nova-compute after removing old cofig files01:34
fishbone_config*01:34
*** gcb has joined #openstack-nova01:34
mriedemi assume because the compute host doesn't have direct access to the cell0 database01:34
*** gianpietro has quit IRC01:34
mriedembut it's weird that the sync on the nova (cell) database would not fail in that case01:35
mriedemhttps://docs.openstack.org/ocata/install-guide-ubuntu/nova-compute-install.html doesn't say anything about running db sync from the compute host though01:35
mriedemthat's all done on the controller https://docs.openstack.org/ocata/install-guide-ubuntu/nova-controller-install.html01:35
fishbone_mriedem: Yes it is strange, I get the error at the apt install nova-compute" step01:37
mriedemhmm, so that's something baked into the package then?01:37
mriedemlike a post-install script as part of the package?01:37
mriedemare you using ubuntu packages?01:38
fishbone_mriedem: yes, I am using the ubuntu repositories01:38
openstackgerritJianghua Wang proposed openstack/nova master: Skip policy rules on attach_network for none network allocation  https://review.openstack.org/46590301:39
mriedemfishbone_: ok well those seem wrong, i'd probably report a bug against the ubuntu nova package LP site01:40
*** litao__ has joined #openstack-nova01:40
mriedemfishbone_: on your control node, if you run "nova-manage cell_v2 list_cells" do you see 2 listed?01:41
mriedemhttps://launchpad.net/ubuntu/+source/nova for reporting bugs against ubuntu nova packages btw01:41
mriedemif list_cells shows 2 cells then i think you're good to go01:42
*** baoli has joined #openstack-nova01:43
*** tbachman has quit IRC01:45
fishbone_mriedem: Yes it shows properly, however; the compute nodes are unable to install the appropriate packages01:46
mriedemmdbooth: lyarwood: btw, hooray for completely differnt code paths for attaching a volume during boot and after boot https://review.openstack.org/#/c/443951/18/nova/virt/libvirt/volume/vrtshyperscale.py@4401:47
fishbone_mriedem: they fail with the error01:47
mriedemfishbone_: is there a way to ignore post-install scripts, or force the install? sorry but i haven't heard of this one, definitely sounds like a bug in the assumptions the packages are making01:47
mriedemfishbone_: also https://ask.openstack.org/en/question/103660/ocata-install-nova-error/01:48
*** thorst_afk has joined #openstack-nova01:48
fishbone_mriedem: I haven't tried that, I will, and thanks for all your help, I'll update soon01:49
mriedemfishbone_: see if you have a nova_api_cell0 or nova_cell0 db01:50
mriedemyou can also see that via nova-manage cell_v2 list_cells --verbose01:50
mriedemsounds like some people in that forum thread hit some issues with mismatched db names and the connection URL in the api db01:50
mriedemfor cell001:50
fishbone_mriedem: I saw that article, it didn't seem to work for me, I have the nova_cell0 database01:50
mriedemis that what's in the database_connection for the cell0 cell_mapping in the nova_api database though?01:51
fishbone_mriedem: I followed the docs, which say that it should be named as nova_cell001:51
mriedemi'd check your db :)01:51
fishbone_mriedem: I cross referenced that in those 2 databases and they do match01:51
mriedemok01:51
*** thorst_afk has quit IRC01:53
openstackgerritguang-yee proposed openstack/nova master: make sure to rebuild claim on recreate  https://review.openstack.org/46614301:56
*** thorst_afk has joined #openstack-nova01:58
*** thorst_afk has quit IRC01:58
*** smatzek_ has joined #openstack-nova02:02
*** gjayavelu has joined #openstack-nova02:02
*** gjayavelu has quit IRC02:02
*** coreywright has quit IRC02:02
openstackgerritWang Shilong proposed openstack/nova master: Lustre support  https://review.openstack.org/44628802:03
*** gianpietro has joined #openstack-nova02:04
*** fragatina has quit IRC02:07
*** fragatina has joined #openstack-nova02:08
*** gianpietro has quit IRC02:10
openstackgerritYongfeng Du proposed openstack/nova master: Update the file for IPv4-only or IPv6-only network  https://review.openstack.org/46589102:15
*** markvoelker has joined #openstack-nova02:15
openstackgerritZhenyu Zheng proposed openstack/nova master: Add tags fields for server list detail/show api-ref  https://review.openstack.org/46584202:16
*** baoli has quit IRC02:16
*** yamahata has quit IRC02:18
fishbone_mriedem: it seems to be an issue with the compute hosts themselves, I tried a fresh install with a host that was not already in the nova database and received no errors duing installation02:22
*** coreywright has joined #openstack-nova02:22
fishbone_mriedem: It must be specific to upgrading a pre-integrated hypervisor02:22
*** smatzek_ has quit IRC02:24
*** Apoorva_ has joined #openstack-nova02:25
*** crushil has joined #openstack-nova02:25
*** yamamoto_ has joined #openstack-nova02:26
*** Apoorva_ has quit IRC02:26
*** Apoorva_ has joined #openstack-nova02:27
*** Apoorva_ has quit IRC02:27
*** smatzek has joined #openstack-nova02:28
*** Apoorva has quit IRC02:28
*** gyee has quit IRC02:30
*** yamamoto_ has quit IRC02:31
*** gcb has quit IRC02:33
*** fragatin_ has joined #openstack-nova02:36
*** Sukhdev has joined #openstack-nova02:36
*** fragatina has quit IRC02:39
*** karthiks has quit IRC02:40
*** fragatin_ has quit IRC02:40
fishbone_mriedem: it seems simply adding the database directives in the config files allowed the install to go through, perhaps due to the hypervisors being from prior to the cell creation02:44
*** karthiks has joined #openstack-nova02:45
*** tuanluong has joined #openstack-nova02:46
*** xinliang has quit IRC02:49
*** armax has joined #openstack-nova02:52
*** crushil_ has joined #openstack-nova02:53
openstackgerritNaichuan Sun proposed openstack/nova master: xenapi: cached images should be cleaned up by time  https://review.openstack.org/46595402:54
*** mvk has quit IRC02:54
mriedemfishbone_: hmm, not sure02:55
mriedembut cool that you found a workaround02:55
mriedemstill, i'd open a bug against the ubuntu packagers,02:55
mriedemthe nova-compute package shouldn't be running nova-manage db sync02:55
*** mriedem has quit IRC02:56
openstackgerritZhenyu Zheng proposed openstack/nova master: Should not allow security group from other project pass API layer check when booting  https://review.openstack.org/46616002:57
*** gianpietro has joined #openstack-nova02:57
*** crushil_ has quit IRC02:59
*** thorst_afk has joined #openstack-nova02:59
*** crushil_ has joined #openstack-nova02:59
*** xinliang has joined #openstack-nova03:01
*** rfolco has quit IRC03:02
*** baoli has joined #openstack-nova03:03
*** hongbin has joined #openstack-nova03:03
*** Fdaisuke_ has quit IRC03:05
openstackgerritZhenyu Zheng proposed openstack/nova master: Add tags fields for server list detail/show api-ref  https://review.openstack.org/46584203:08
fishbone_mriedem: yep, it worked after that. I agree with you, I will go and open a bug for this03:09
*** rushiagr has quit IRC03:09
*** nicolasbock has quit IRC03:10
*** markvoelker has quit IRC03:10
*** markvoelker has joined #openstack-nova03:11
openstackgerritfalseuser proposed openstack/nova master: [BugFix] Include the video ram when comparing the difference of two flavors  https://review.openstack.org/46038803:12
*** Kevin_Zheng has joined #openstack-nova03:15
*** smatzek has quit IRC03:15
*** markvoelker has quit IRC03:15
*** fishbone_ has quit IRC03:17
*** thorst_afk has quit IRC03:19
*** owalsh_ has joined #openstack-nova03:19
*** mdrabe has joined #openstack-nova03:22
*** owalsh has quit IRC03:23
*** Daisy has joined #openstack-nova03:25
*** baoli has quit IRC03:26
*** mdrabe_ has joined #openstack-nova03:27
*** yamamoto_ has joined #openstack-nova03:27
*** rushiagr has joined #openstack-nova03:30
openstackgerritTao Li proposed openstack/nova master: Fix the display of updated_at time when using memcache driver.  https://review.openstack.org/41446303:30
*** gianpietro has quit IRC03:30
*** mdrabe has quit IRC03:31
*** fragatina has joined #openstack-nova03:32
*** yamamoto_ has quit IRC03:33
openstackgerritTao Li proposed openstack/nova master: Change log level from ERROR to DEBUG for NotImplemented  https://review.openstack.org/46579703:36
*** fragatina has quit IRC03:38
*** Daisy has quit IRC03:38
*** fragatina has joined #openstack-nova03:38
*** fragatina has quit IRC03:38
*** Daisy has joined #openstack-nova03:38
*** Sukhdev has quit IRC03:40
*** Daisy has quit IRC03:42
*** gianpietro has joined #openstack-nova03:45
*** jamielennox is now known as jamielennox|away03:46
openstackgerritZhenyu Zheng proposed openstack/nova master: Add tags fields for server list detail/show api-ref  https://review.openstack.org/46584203:48
*** gianpietro has quit IRC03:49
*** jamielennox|away is now known as jamielennox03:53
*** hongbin has quit IRC03:53
*** vks1 has joined #openstack-nova03:56
openstackgerritTao Li proposed openstack/nova master: Fix the display of updated_at time when using memcache driver.  https://review.openstack.org/41446303:59
*** Shunli has quit IRC04:02
*** yamamoto_ has joined #openstack-nova04:02
*** crushil_ has quit IRC04:07
*** mamandle has joined #openstack-nova04:09
*** kaisers has joined #openstack-nova04:12
*** fragatina has joined #openstack-nova04:13
*** jamesdenton has joined #openstack-nova04:14
*** fragatina has quit IRC04:15
*** thorst_afk has joined #openstack-nova04:15
*** fragatina has joined #openstack-nova04:15
*** jamesden_ has joined #openstack-nova04:18
*** prateek has joined #openstack-nova04:19
*** jamesdenton has quit IRC04:19
*** thorst_afk has quit IRC04:20
*** dikonoor has joined #openstack-nova04:22
*** mdrabe_ has quit IRC04:25
*** jamesden_ has quit IRC04:27
*** jamesdenton has joined #openstack-nova04:28
*** jamesdenton has quit IRC04:33
*** crushil_ has joined #openstack-nova04:35
*** crushil has quit IRC04:36
*** Daisy has joined #openstack-nova04:41
*** Daisy has quit IRC04:49
*** salv-orlando has joined #openstack-nova04:50
*** Apoorva has joined #openstack-nova04:53
*** Daisy has joined #openstack-nova05:01
*** salv-orlando has quit IRC05:07
*** adisky_ has joined #openstack-nova05:08
openstackgerritJianghua Wang proposed openstack/nova master: xenapi: cached images should be cleaned up by time  https://review.openstack.org/46595405:14
*** gjayavelu has joined #openstack-nova05:16
*** thorst_afk has joined #openstack-nova05:16
*** Apoorva has quit IRC05:17
*** thorst_afk has quit IRC05:20
*** udesale has joined #openstack-nova05:24
*** claudiub has joined #openstack-nova05:25
openstackgerritZhenyu Zheng proposed openstack/nova master: Add tags fields for server list detail/show api-ref  https://review.openstack.org/46584205:26
*** slaweq has joined #openstack-nova05:27
*** slaweq has quit IRC05:28
*** ltomasbo|away is now known as ltomasbo05:37
*** jaosorior_away has quit IRC05:44
openstackgerritArtom Lifshitz proposed openstack/nova master: API support for tagged device attachment  https://review.openstack.org/37602105:47
*** coreywright has quit IRC05:47
*** mkoderer has quit IRC05:47
*** ratailor has joined #openstack-nova05:49
*** armax has quit IRC05:52
*** crushil_ has quit IRC05:54
*** mdnadeem has joined #openstack-nova06:00
*** trungnv has quit IRC06:03
*** coreywright has joined #openstack-nova06:04
*** mamandle has quit IRC06:04
*** Oku_OS-away is now known as Oku_OS06:04
*** mamandle has joined #openstack-nova06:07
*** salv-orlando has joined #openstack-nova06:08
*** psachin has quit IRC06:09
*** dimtruck is now known as zz_dimtruck06:09
*** sree has joined #openstack-nova06:09
*** markus_z has joined #openstack-nova06:11
*** salv-orlando has quit IRC06:13
*** rcernin has joined #openstack-nova06:13
*** diablo_rojo has joined #openstack-nova06:16
*** thorst_afk has joined #openstack-nova06:17
*** thorst_afk has quit IRC06:21
*** psachin has joined #openstack-nova06:24
openstackgerritTakashi NATSUME proposed openstack/nova master: Use PCIAddressField in oslo.versionedobjects  https://review.openstack.org/46620106:29
*** phuongnh has quit IRC06:30
*** phuongnh has joined #openstack-nova06:30
*** diablo_rojo has quit IRC06:31
*** diablo_rojo has joined #openstack-nova06:32
*** pcaruana has joined #openstack-nova06:39
*** pcaruana is now known as pcaruana|tve|06:44
*** pcaruana|tve| is now known as pcaruana|rtve|06:44
openstackgerritHuan Xie proposed openstack/nova master: WIP: XenAPI use os-xenapi v2 in nova  https://review.openstack.org/45349306:46
openstackgerritWang Shilong proposed openstack/nova master: Lustre support  https://review.openstack.org/44628806:50
*** belmoreira has joined #openstack-nova07:01
openstackgerritHuan Xie proposed openstack/nova master: XenAPI: remove hardcode dom0 plugin function mock  https://review.openstack.org/46620707:04
*** mnestratov has joined #openstack-nova07:08
openstackgerritHuan Xie proposed openstack/nova master: XenAPI: remove hardcode dom0 plugin version in unit test  https://review.openstack.org/46620707:08
*** salv-orlando has joined #openstack-nova07:09
*** salv-orlando has quit IRC07:13
*** phuongnh has quit IRC07:13
*** mlakat has joined #openstack-nova07:14
*** phuongnh has joined #openstack-nova07:14
*** thorst_afk has joined #openstack-nova07:17
*** johnhaan has quit IRC07:19
*** thorst_afk has quit IRC07:22
openstackgerritTakashi NATSUME proposed openstack/nova master: List/show all server migration types (2/2)  https://review.openstack.org/45948307:24
openstackgerritTakashi NATSUME proposed openstack/nova master: List/show all server migration types (2/2)  https://review.openstack.org/45948307:32
*** jpena|off is now known as jpena07:38
*** _dpawlik is now known as dpawlik07:48
*** ralonsoh has joined #openstack-nova07:49
openstackgerritDaniel Pawlik proposed openstack/nova master: Added kvm_hidden feature  https://review.openstack.org/45975307:51
dpawlikMorning07:51
*** diablo_rojo has quit IRC07:56
*** gszasz has joined #openstack-nova07:59
*** zzzeek has quit IRC08:00
*** takashin has left #openstack-nova08:00
*** zzzeek has joined #openstack-nova08:02
*** Daisy has quit IRC08:05
openstackgerritRodolfo Alonso Hernandez proposed openstack/nova master: Read Neutron port 'binding_profile' during boot  https://review.openstack.org/44925708:06
openstackgerritRodolfo Alonso Hernandez proposed openstack/nova master: Add Neutron port capabilities to devspec in request  https://review.openstack.org/45177708:08
*** salv-orlando has joined #openstack-nova08:10
*** Kevin_Zheng has quit IRC08:15
*** salv-orlando has quit IRC08:16
*** derekh has joined #openstack-nova08:16
*** Alex____ has joined #openstack-nova08:18
*** thorst_afk has joined #openstack-nova08:18
*** litao__ has quit IRC08:19
*** djohnsto has joined #openstack-nova08:20
*** thorst_afk has quit IRC08:23
*** knikolla has joined #openstack-nova08:24
openstackgerritAlex Szarka proposed openstack/nova master: Transform instance.exists notification  https://review.openstack.org/40366008:24
*** swamireddy has joined #openstack-nova08:24
openstackgerritAlex Szarka proposed openstack/nova master: Transform instance.exists notification  https://review.openstack.org/40366008:26
openstackgerritAlex Szarka proposed openstack/nova master: Transform instance.exists notification  https://review.openstack.org/40366008:26
*** jaosorior has joined #openstack-nova08:29
openstackgerritAlex Szarka proposed openstack/nova master: Refactor init_instance:resume_guests_state  https://review.openstack.org/34958208:32
openstackgerritAlex Szarka proposed openstack/nova master: Transform instance.exists notification  https://review.openstack.org/40366008:38
*** lpetrut has joined #openstack-nova08:39
openstackgerritAlex Szarka proposed openstack/nova master: Refactor instance-exists comment and test  https://review.openstack.org/46273808:43
*** Yangyapeng has quit IRC08:45
sfinucanmdbooth: Seeing as you reviewed the original patch, does this patch follow-up make sense? https://review.openstack.org/#/c/466088/08:47
*** hferenc has quit IRC08:49
*** hferenc has joined #openstack-nova08:54
*** salv-orlando has joined #openstack-nova09:00
*** xinliang has quit IRC09:00
sfinucanralonsoh: You about?09:03
ralonsohsfinucan: hi!09:04
sfinucanralonsoh: On https://review.openstack.org/#/c/449257/ - that usually happens when you accidentally re-upload an old revision09:04
sfinucanI would imagine you've reuploaded PS18 when you reuploaded the following patch09:05
ralonsohsfinucan: hmmm, I'll check that, but I'm pretty sure I didn't do this09:05
ralonsohsfinucan: but thank you for your explanation!09:05
*** salv-orlando has quit IRC09:06
sfinucanfwiw, you can fix it by downloading the last correct PS from the first patch (probably 20, so 'git review -d 449257,20')09:06
ralonsohsfinucan: thanks!09:06
sfinucanralonsoh: np ;)09:06
*** gjayavelu has quit IRC09:07
openstackgerritRodolfo Alonso Hernandez proposed openstack/nova master: Read Neutron port 'binding_profile' during boot  https://review.openstack.org/44925709:07
*** rwmjones has quit IRC09:10
*** xinliang has joined #openstack-nova09:11
*** vks1 has quit IRC09:17
*** gszasz has quit IRC09:19
*** thorst_afk has joined #openstack-nova09:19
*** rwmjones has joined #openstack-nova09:21
openstackgerritsahid proposed openstack/nova master: libvirt: update the logic to configure volume with scsi controller  https://review.openstack.org/45974109:25
openstackgerritsahid proposed openstack/nova master: libvirt: update logic to configure device for scsi controller  https://review.openstack.org/45974009:25
openstackgerritsahid proposed openstack/nova master: libvirt: update LibvirtConfigGuestDeviceAddress to provide XML  https://review.openstack.org/45973709:25
openstackgerritsahid proposed openstack/nova master: libvirt: rearange how scsi controller is defined  https://review.openstack.org/45973909:25
openstackgerritsahid proposed openstack/nova master: libvirt: set full description of the controller used by disk  https://review.openstack.org/45973809:25
*** vks1 has joined #openstack-nova09:31
mdboothsfinucan: Eurgh, that whole situation is a complete pita09:33
sfinucanmdbooth: Yup09:33
*** hshiina has joined #openstack-nova09:33
sfinucanBut it's a rabbit hole I really don't fancy diving down09:34
mdboothIt's a rabbit hole which shouldn't exist09:34
openstackgerritsahid proposed openstack/nova master: libvirt: configure trust mode for vfs  https://review.openstack.org/45851409:36
openstackgerritsahid proposed openstack/nova master: network: update pci request spec to handle trusted tags  https://review.openstack.org/45882009:36
openstackgerritsahid proposed openstack/nova master: network: add command to configure trusted mode for VFs  https://review.openstack.org/45851309:36
*** thorst_afk has quit IRC09:38
*** sambetts|afk is now known as sambetts09:46
mdboothsfinucan: It should have been obvious from the previous bug that EPERM was wrong. I wonder why we didn't pick that up last time.09:53
* mdbooth puts it down to stupid naming09:53
mdbooth[Errno 13] Permission denied09:53
mdbooth13 == EACCES09:53
sfinucanmdbooth: I know :(09:53
sfinucanIsn't EPERM a superset of EACCES though?09:54
mdboothThey're discrete09:54
mdboothThis is the return from a syscall09:54
mdboothIt's an integer09:54
openstackgerritAlex Szarka proposed openstack/nova master: Transform instance.exists notification  https://review.openstack.org/40366009:55
*** openstack has joined #openstack-nova09:58
mdboothmelwitt: KABOOM!09:59
melwittheh, sorry bout that folks09:59
*** owalsh_ is now known as owalsh09:59
*** pjm6 has joined #openstack-nova09:59
*** salv-orlando has joined #openstack-nova10:02
*** salv-orlando has quit IRC10:06
*** tbachman has joined #openstack-nova10:06
*** nicolasbock has joined #openstack-nova10:09
*** yamamoto_ has quit IRC10:10
*** p01nt3r75 has joined #openstack-nova10:13
*** psachin has quit IRC10:20
openstackgerritStephen Finucane proposed openstack/nova master: objects: remove cpuset_reserved from __init__ of InstanceNUMATopology  https://review.openstack.org/46603010:29
openstackgerritStephen Finucane proposed openstack/nova master: objects: remove related pinning from __init__ of InstanceNUMATopology  https://review.openstack.org/40824210:29
openstackgerritStephen Finucane proposed openstack/nova master: objects: remove pagesize from __init__ of InstanceNUMATopology  https://review.openstack.org/40824110:29
openstackgerritStephen Finucane proposed openstack/nova master: Use plain routes list for os-interface endpoint instead of stevedore  https://review.openstack.org/45997910:30
openstackgerritStephen Finucane proposed openstack/nova master: Use plain routes list for server-tags instead of stevedore  https://review.openstack.org/46164510:31
openstackgerritStephen Finucane proposed openstack/nova master: Use plain routes list for server-migrations endpoint instead of stevedore  https://review.openstack.org/46164610:31
*** mkoderer has joined #openstack-nova10:31
*** aarefiev_afk is now known as aarefiev10:34
openstackgerritStephen Finucane proposed openstack/nova master: Remove useless API tests  https://review.openstack.org/46101110:35
*** yamamoto has joined #openstack-nova10:38
*** sdague has joined #openstack-nova10:41
*** tbachman has quit IRC10:44
*** lucasagomes is now known as lucas-brb10:46
*** gszasz has joined #openstack-nova10:50
*** cdent has joined #openstack-nova10:52
*** avolkov has joined #openstack-nova10:55
openstackgerritSylvain Bauza proposed openstack/nova master: Scheduler returning alternatives per destination  https://review.openstack.org/46517510:56
openstackgerritSylvain Bauza proposed openstack/nova master: Delete existing allocations when retrying  https://review.openstack.org/46043310:56
openstackgerritSylvain Bauza proposed openstack/nova master: WIP: Allocate instance by the conductor  https://review.openstack.org/46045510:56
*** tuanluong has quit IRC10:59
cdentbauzas: thanks for expanding the commit message on the retrying change. Can you confirm my understanding: the goal is to delete transient allocations (which aren't currently using physical resources) as soon as we know they are going to be eventually deleted, so that something else can try to consume them sooner.11:00
cdentIs that right?11:00
bauzascdent: the goal is to propose hosts that can be acceptable per filters/weighers in case the original host is not being accepted when the conductor posts the allocations11:01
bauzascdent: given we have placement that verifies allocations, it's fine to propose hosts that are not fulling matching with the *new* situation, but at least have been verified as matching with the other requests11:02
cdentI'm speaking specifically about the allocations that could have been cleared up later at the time NoValidHost happens11:02
*** salv-orlando has joined #openstack-nova11:02
bauzascdent: so, there are 2 cases11:02
bauzascdent: 1/ if the conductor posts an allocation but gets a "sorry" from placement11:03
*** psachin has joined #openstack-nova11:03
*** tovin07_ has quit IRC11:03
bauzascdent: 2/ if the allocation is done correctly, but then the compute exceptionnally has an exception (because of libvirt-ish so else) and then reschedules the instance to the conductor11:03
bauzascdent: if scheduler gives back a NoValidHosts to conductor, then the conductor will behave like the existing11:04
bauzas(unless I misunderstood your problem, which is definitely something possible :D )11:05
bauzascdent: oh , you mean about the need for https://review.openstack.org/#/c/460433/10 ?11:07
bauzas(sorry my bad)11:07
bauzasI thought you were talking of the need for alternatives11:07
cdentI'm talking about my question on ps 8 on https://review.openstack.org/#/c/460433 about why we are deleting allocations early (instead of waiting to handle them on NoValidHost) and trying to confirm my understanding of your adjustments to the commit message there11:07
*** salv-orlando has quit IRC11:07
bauzasok, my bad11:07
bauzasso11:07
bauzasthe problem is with transient allocations like I said11:07
bauzasimagine the scenario11:07
cdentbasically if you can confirm "so that something else can try to consume them sooner" is correct, I'm satisfied11:08
bauzasIronic and 2 concurrent instances11:08
bauzasinstance 1 is scheduled to hostA11:08
bauzasthen the allocation will be made against hostA11:08
bauzasbut then it's rescheduled11:08
bauzasconcurrently, instance2 is scheduled11:08
bauzasgiven allocation is posted against hostA, placement won't provide hostA as a valid target11:09
bauzaswhich is a sad panda, because we know it's being rescheduled11:09
bauzascdent: does that fit with your concerns ?11:09
bauzastbh, I'm not super attached to that patch, I just think it helps some possible race condition11:10
*** jichen has joined #openstack-nova11:10
cdentwhen instance1 tries to go to hostA but then is rescheduled, what does that mean about the current state of hostA as a good target for any allocations?11:11
bauzascdent: FWIW, I'm not trying to focus my efforts on updating https://review.openstack.org/#/c/460455/ now that we have alternatives11:11
bauzascdent: instance being rescheduler doesn't necessarly imply that the host where the instance was set to is necessary bad11:12
bauzascdent: we discussed that at Summit, and we identified (ops too) that most of the time, it's uncorrelated with resource constraints11:12
cdentbut it could be, right?11:12
cdentI guess I take a relatively conservative position on this stuff: I think we can avoid inaccuracies and confusion by holding allocations a bit longer, at the cost of less packing. But it seems that people are more interested in packing?11:14
bauzascdent: that's a good point11:14
bauzascdent: from what I recall from the summit, people wanted to make sure we were not removing some host because of a resource constraint, because they said most of the time it's because of X or Y11:15
bauzascdent: were you at the cells 2 forum session where most of the crux was discussed there ?11:16
*** edmondsw has joined #openstack-nova11:16
bauzascdent: as dan asked whether they were interested in stopping to reschedules11:16
bauzascdent: most of the present folks were horrified by that11:16
bauzasanyway, I need to disappear for a bit11:16
cdenti had to be somewhere else for that one, but i heard a summary later11:17
cdentme too, I'll keep thinking about it. thanks for the info.11:17
*** mamandle has quit IRC11:18
*** jpena is now known as jpena|lunch11:18
*** udesale has quit IRC11:19
bauzasnp11:19
*** phuongnh has quit IRC11:23
*** smatzek has joined #openstack-nova11:24
*** yamamoto has quit IRC11:26
openstackgerritHironori Shiina proposed openstack/nova master: Ironic: Support boot from Cinder volume  https://review.openstack.org/21538511:29
*** yamamoto has joined #openstack-nova11:29
*** brault has joined #openstack-nova11:31
*** hamzy has joined #openstack-nova11:32
*** thorst_afk has joined #openstack-nova11:35
*** pchavva has joined #openstack-nova11:42
openstackgerritStephen Finucane proposed openstack/nova master: docs: Document 'nova-manage db online_data_migrations'  https://review.openstack.org/46463411:44
*** gianpietro has joined #openstack-nova11:48
*** tbachman has joined #openstack-nova11:52
*** pchavva has quit IRC11:53
*** gianpietro has quit IRC11:56
*** ratailor has quit IRC11:59
*** pchavva has joined #openstack-nova12:01
*** Alex____ has quit IRC12:02
*** salv-orlando has joined #openstack-nova12:03
*** faizy has quit IRC12:04
*** tbachman_ has joined #openstack-nova12:05
*** tbachman has quit IRC12:05
*** tbachman_ is now known as tbachman12:05
*** abalutoiu_ has quit IRC12:07
*** abalutoiu has joined #openstack-nova12:07
*** salv-orlando has quit IRC12:08
*** liverpooler has joined #openstack-nova12:11
*** vks1 has quit IRC12:14
*** lucas-brb is now known as lucasagomes12:15
*** jistr is now known as jistr|mtg12:16
*** jpena|lunch is now known as jpena12:17
*** sean-k-mooney has quit IRC12:18
*** dave-mccowan has joined #openstack-nova12:27
*** gianpietro has joined #openstack-nova12:29
*** winston-d_ has quit IRC12:33
*** tbachman has quit IRC12:44
*** catintheroof has joined #openstack-nova12:45
*** psachin has quit IRC12:45
*** gianpietro has quit IRC12:46
*** Guest6334 has quit IRC12:46
*** rfolco has joined #openstack-nova12:47
*** tbachman has joined #openstack-nova12:47
*** zz_dimtruck is now known as dimtruck12:48
*** kylek3h has joined #openstack-nova12:50
*** sree has quit IRC12:52
*** sree has joined #openstack-nova12:52
*** Guest6334 has joined #openstack-nova12:53
*** mdrabe_ has joined #openstack-nova12:56
*** jichen has quit IRC12:56
*** sree_ has joined #openstack-nova12:56
*** sree_ is now known as Guest4838612:56
*** sree has quit IRC12:57
*** mriedem has joined #openstack-nova12:57
mriedemo/12:58
*** gianpietro has joined #openstack-nova12:58
*** salv-orlando has joined #openstack-nova12:59
*** jistr|mtg is now known as jistr12:59
mriedemsdague: this gets the grenade live migration job going again (limited) https://review.openstack.org/#/c/466097/ and this gets the live migration back and forth testing going in that job https://review.openstack.org/#/c/466033/12:59
*** Guest48386 has quit IRC13:01
sdaguemriedem: +A13:01
mriedemthanks13:01
*** gianpietro has quit IRC13:03
dpawlikmriedem: Hi. I changed as you suggest in PS https://review.openstack.org/#/c/45975313:06
bauzasmriedem: I replied on your status email about the claims discussion13:06
bauzasmriedem: AFAIUI, we already had a consensus :)13:06
*** yamamoto has quit IRC13:07
*** jamesdenton has joined #openstack-nova13:07
mriedembauzas: i see that13:09
*** sree has joined #openstack-nova13:10
mriedemdpawlik: ok, it's not a bug though, it's a feature, so it should have a blueprint13:10
*** tbachman has quit IRC13:13
*** edmondsw has quit IRC13:13
*** edmondsw has joined #openstack-nova13:14
*** MVenesio has joined #openstack-nova13:14
*** sree has quit IRC13:15
*** ralonsoh_ has joined #openstack-nova13:15
*** yamahata has joined #openstack-nova13:16
*** salv-orlando has quit IRC13:16
dpawlikmriedem: ack13:16
*** salv-orlando has joined #openstack-nova13:16
*** zzzeek has quit IRC13:17
*** yamamoto has joined #openstack-nova13:17
cdentbauzas, mriedem: I threw my own crazy talk 2c into the mix too because I'm lonely and want to make friends.13:17
*** zzzeek has joined #openstack-nova13:17
*** ralonsoh has quit IRC13:18
*** edmondsw has quit IRC13:18
*** salv-orlando has quit IRC13:21
*** tbachman has joined #openstack-nova13:21
*** yamamoto has quit IRC13:22
*** mdrabe__ has joined #openstack-nova13:22
*** yamamoto has joined #openstack-nova13:23
*** ralonsoh_ is now known as ralonsoh13:23
mdboothmriedem: Do we have a pattern for internal code assertions other than assert() ? We don't seem to have too many assert()s in our code.13:24
*** aarefiev is now known as aarefiev_afk13:24
mdboothmriedem: I ask in the context of https://review.openstack.org/#/c/443951/ where I've recommended he use assert() rather than raise an exception13:24
mriedemmdbooth: not really13:25
*** mdrabe_ has quit IRC13:25
mdboothmriedem: Ok, cool. Was just wary of asking him to fix that, only to have him respin yet again because we do something else.13:26
cdentmdbooth++ for assert in programming error case13:26
dpawlikmriedem: https://blueprints.launchpad.net/nova/+spec/add-kvm-hidden-feature13:27
mriedemmdbooth: did you see my beautiful code dive through attaching a volume during bfv and attach_volume? what a mess.13:27
dpawlikI will change PS commit message soon13:27
mriedemkashyap: are you aware of this kvm hidden feature thing?13:28
mriedem^13:28
mdboothmriedem: I did :) I took a short cut to convincing myself that was correct.13:28
* kashyap reads the scrollback13:28
mriedemmdbooth: at some point i should probably write that up in the devref, but...13:28
kashyapI think I know what it means from the title13:28
openstackgerritAlex Szarka proposed openstack/nova master: Add method for verify multiple notifications  https://review.openstack.org/46552613:28
*** vks1 has joined #openstack-nova13:29
mdboothmriedem: Logically, that method makes no sense unless the volume is connected13:29
mriedemdpawlik: kashyap: I don't know what "It allows to hide the KVM hypervisor signature on the guest.13:29
mriedemThis enables disabling of some paravirualization features in the13:29
mriedemguest as well as allowing certain drivers which test for the13:29
mriedemhypervisor to load." means13:29
mriedemmdbooth: which one? get_config?13:29
mdboothYeah13:29
mriedemmdbooth: yeah it's super tightly coupled,13:29
mdboothIf the connector hasn't connected it, we can't tell libvirt where it's connected13:29
kashyapmriedem: Okay, I'm aware of what it is, it means:13:29
mriedemwe should almost just refactor to have connect_volume always return get_config...13:29
mriedembut we have that live migration case13:29
kashyapmriedem: It just lets one _hide_ the fact that it is a KVM guest13:30
kashyapBut removing the CPUID signature for guest that is running w/ KVM acceleration13:30
kashyapdpawlik: Are you referring to the "-no-kvm" QEMU command-line option, right?13:31
mriedemhide it from what?13:31
*** krtaylor has joined #openstack-nova13:31
kashyapmriedem: Hide it from whatever programs that depend on that output to identify: "Yes, this is a KVM guest"13:31
*** tbachman has quit IRC13:31
mriedemalright13:31
*** mnestratov has quit IRC13:32
kashyapIt is possible via the confusingly-named, QEMU command-line option '-cpu,kvm=off'13:33
kashyapWhich doesn't turn off KVM acceleration itself, merely the *signature* of it13:34
kashyapYou might wonder what exactly the **** is this "signature"?13:34
bauzascdent: FWIW, I'm not disagreeing with you on the long-term direction to see claims closer13:34
mriedemcdent: so reading https://review.openstack.org/#/c/465171/3//COMMIT_MSG@30 i didn't realize that what ed is trying to do is make the nova-scheduler something that other projects are going to use13:34
mriedemi.e. gantt 2.013:34
bauzascdent: I just think it needs to wait scheduler to be a library13:34
mriedemwe all agree that placement is generic and will be used by other projects13:34
cdentbauzas: I've not felt like anyone is disagreeing, merely discussing13:35
kashyapmriedem: The thing that exactly hides is this output that you normally see from the command `cpuid`:13:35
kashyap$ cpuid | grep -i hypervisor_id13:35
kashyap   hypervisor_id = "KVMKVMKVM   "13:35
mriedemkashyap: that's within the guest?13:35
bauzascdent: but I do recall Jay and us being pretty clear on the fact that the scheduler code is not intended mid-term to be generic13:35
kashyapmriedem: Yes13:35
*** esberglu has joined #openstack-nova13:35
cdentmriedem: it's something ed said to me at some point in the conversation about "i don't think of the scheduler as 'nova'" and tickled my brain enough to write down explicitly13:35
bauzascdent: the idea is that placement is cross-project but scheduler is a nova-ism13:35
bauzas(to reuse ed's wording)13:36
dpawlikkashyap: yes (answer for your first question)13:36
cdentbauzas: that may be the idea, but it may be that we don't want to build in things that make it hard to change our minds13:36
bauzasso we could ship the scheduler code into a python module only used by conductors like I said in my reply13:36
kashyapdpawlik: Are you depending exactly on the precise "-no-kvm" option?13:36
kashyapdpawlik: If so, that is being considered for deprecation (in favor of "-cpu,kvm=off")13:37
bauzascdent: but for me, that sounds premature to discuss on your point, at least until we're fully down the path13:37
mriedembauzas: cdent: oh boy, ok, well, splitting nova-scheduler out or making it separate for other services to consume is not something i think most anyone besides maybe ed is thinking about13:37
bauzasmriedem: yup, what I told to ed13:37
cdentmriedem: not splitting out _now_, just ensuring it is not hard to do later13:37
bauzasI think ed had that point13:38
bauzasbut I'm not seeing it strong enough to justify us to have scheduler doing allocations calls13:38
cdentwhich means making the interface generic and not very nova-ish13:38
mriedemhas any other project even expressed interest in re-using nova-scheduler?13:38
*** tbachman has joined #openstack-nova13:38
bauzasmriedem: in YVR, we had a session about gantt13:38
cdentmriedem: I don't know, that's why I made my comment in the form of a question13:39
bauzasmriedem: litterally nobody expressed interest in it13:39
bauzashence why we stepped back from that idea13:39
*** smatzek has quit IRC13:39
mriedemwell, and gantt was completely premature13:39
openstackgerritPavel Gluschak (scsnow) proposed openstack/nova master: VStorage: changed default log path  https://review.openstack.org/45855713:39
bauzasalso, the BM/VM session told about that possible scope13:39
cdentbut also I think a lot of the lack of interest was based on a misunderstanding of what placement is going to be capable of13:39
openstackgerritAlex Szarka proposed openstack/nova master: Transform instance.exists notification  https://review.openstack.org/40366013:39
cdentwhat placement can do it actually quite limited13:39
cdentand any client of it is going to need to pick (somehow) from the results13:40
bauzasand tbc, most of the people expressed usecases in multi-projects affinity, but noone stated the need for placing things other than instances (yet)13:40
bauzasI made that question very explicit13:40
bauzasand I all heard about affinity, not generic placement engine13:40
*** prateek has quit IRC13:41
kashyapmriedem: Will look the change, I see it is https://review.openstack.org/#/c/45975313:41
bauzasso, if you consider the approach step-wise, I think having the conductor workers responsible for doing the allocations is cool if we eventually end up with filter/weigher code owned by them13:41
mriedemkashyap: yeah13:41
mriedemkashyap: we're past any sort of spec freeze, but this doesn't require a spec, and is basic passthrough feature functionality via image meta13:42
*** felipemonteiro has joined #openstack-nova13:42
mriedemthe description of the feature was just not clear to me13:42
kashyapYeah, libvirt has a simple XML mapping:13:42
kashyap  <kvm>13:42
kashyap    <hidden state='on'/>13:42
kashyap  </kvm>13:42
kashyapmriedem: Yeah, hope the CPU ID example shows it13:42
mriedemi see part of it was pulled from the original patch to add this to qemu13:42
mriedemwhich was also confusing to me13:42
mriedemso is the idea that someone won't know if they're talking to a vm or not?13:43
kashyapmriedem: Yeah, it should be reworded and explained in context of Nova13:43
mriedemb/c that's hidden?13:43
*** felipemonteiro_ has joined #openstack-nova13:43
kashyapmriedem: Yeah, I also wonderered, like you, first when I came across this: "What is the use case of this?"13:43
*** tbachman has quit IRC13:44
kashyapApparently, some proprietary nVIDIA drivers can be installed _if_ they don't see this 'hypervisor_id' option under `cpuid`13:44
*** tbachman has joined #openstack-nova13:44
kashyapmriedem: This commit message that actually added the option in upstream QEMU will tell you the reason: http://git.qemu.org/?p=qemu.git;a=commitdiff;h=f522d2a13:45
dpawlikkashyap: exactly13:45
kashyap"The latest Nvidia driver (337.88) specifically checks for KVM as the13:45
kashyaphypervisor and reports Code 43 for the driver in a Windows guest when13:45
kashyapfound.  Removing or changing the KVM signature is sufficient for the13:45
kashyapdriver to load and work."13:45
dpawlikkashyap: ack13:45
*** esberglu has quit IRC13:45
*** eharney has joined #openstack-nova13:46
dpawlikkashyap: should I also add the url for qemu git or its not necessary?13:46
kashyapdpawlik: I'll respond on the review13:46
*** felipemonteiro has quit IRC13:47
*** esberglu has joined #openstack-nova13:47
*** edmondsw has joined #openstack-nova13:47
*** dimtruck is now known as zz_dimtruck13:47
mriedemwhy does the nvidia driver fail to load in that case?13:48
*** mdnadeem has quit IRC13:48
mriedemisn't that a huge workaround?13:48
mriedemso, you can get vgpus on this guest if you hide the fact that it's a guest?13:49
mriedembut why does that nvidia driver care in the first place?13:49
*** ratailor has joined #openstack-nova13:50
dpawlikmriedem: its a good question for nvidia developers. Maybe one of the reason is bitcoin mining13:50
dansmithmriedem: lots of software people have tried to limit running their stuff in a VM, supposedly for licensing reasons13:50
dansmithit's not usually a very fruitful endeavor given that the hypervisor software is easy to change and the whole point of it is to _emulate_ something :)13:51
dpawlikdansmith: +113:51
dansmithkinda like most DRM.. annoying for everyone, but only buys you like 6 months of copy protection until people bust it up13:51
*** burt has joined #openstack-nova13:52
*** salv-orlando has joined #openstack-nova13:54
kashyapmriedem: Let me ask Alex, the QEMU developer who wrote that commit13:55
*** jmlowe has quit IRC13:56
mriedemdpawlik: dansmith: kashyap: ok that makes more sense then, and was kind of what i'm looking for - the commit message and release note were just a bit cryptic13:56
mriedemi wanted something in there about why we'd want to enable this feature, rather than that we just can so let's do it13:57
kashyapmriedem: Yes, the commit message and the rel-note should definitely be improved13:57
dpawlikkashyap, mriedem: working on it13:58
*** smatzek has joined #openstack-nova14:00
kashyapAlso, this should be called, 'kvm_hypervisor_id_hidden' -- maybe a tad too lengthy, but damn clear than "kvm_hidden", which will make people think: "Oh, this will disable KVM completely!"14:00
dansmithI think it should not say kvm at all14:00
*** crushil has joined #openstack-nova14:01
mriedemhide_hypervisor_id14:01
mriedemmaybe14:01
kashyapdansmith: It is hiding the KVM signature -- "KVMKVMKVM\0\0\0"14:02
dansmithkashyap: sure but we don't want to end up with a xen_hide_id flag separate14:02
kashyapI also say mentioning it useful because, there's upstream QEMU work to also add "TCG" disabling, too14:02
*** eharney has quit IRC14:03
kashyapdansmith: Yeah, I see what you mean, at Nova-level, you want a generic conf, that can handle different hypervisors (let they be KVM, TCG, Xen, etc)14:04
dansmithyes14:04
kashyapYou're correct, mriedem's 'hide_hypervisor_id' sounds best to me14:05
*** jmlowe has joined #openstack-nova14:07
*** eharney has joined #openstack-nova14:07
sdagueor secret_agent_mode :)14:07
* cdent sings14:08
kashyapsdague: Heh14:08
kashyapsdague: You mean, enable_backdoor14:09
*** zz_dimtruck is now known as dimtruck14:09
* cdent sings a different song14:09
sfinucanMorning, mriedem. Could you take a shot at [1] again today? https://review.openstack.org/#/q/status:open+project:openstack/nova+topic:bp/move-nova-cmds-to-cliff14:10
openstackgerritArtom Lifshitz proposed openstack/nova master: Plumbing for tagged nic attachment  https://review.openstack.org/41562214:11
openstackgerritArtom Lifshitz proposed openstack/nova master: Delete nic metadata when detaching interface  https://review.openstack.org/43538714:11
mriedemmaybe14:11
openstackgerritArtom Lifshitz proposed openstack/nova master: Delete disk metadata when detaching volume  https://review.openstack.org/43508214:11
openstackgerritArtom Lifshitz proposed openstack/nova master: Plumbing for tagged volume attachment  https://review.openstack.org/39194114:12
openstackgerritArtom Lifshitz proposed openstack/nova master: API support for tagged device attachment  https://review.openstack.org/37602114:12
mriedemsdague: oomichi: mtreinish: i just noticed this bug again https://bugs.launchpad.net/nova/+bug/163466814:12
openstackLaunchpad bug 1634668 in OpenStack Compute (nova) "Compute API Reference - version response doesn't require 'updated'" [Medium,Confirmed]14:12
sfinucanmaybe will do14:12
mriedemabout how tempest checks that 'updated' is in the version response, and that test is part of defcore14:12
mriedemwould it be wrong to remove that from the tempest schema response validation?14:12
kashyapmdbooth: mriedem: An unrelated question: When trying to migrate 50+ guests, will Nova attempt to do them all in parallel?14:13
mdboothkashyap: I know my script explicitly pipelined them. Don't recall any limiting in Nova.14:15
kashyapmdbooth: Which script is this?14:15
openstackgerritAlex Szarka proposed openstack/nova master: Refactor create_delete_server_with_instance_update  https://review.openstack.org/46629614:16
mriedemkashyap: live migration or cold migration, because for live migration https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L52614:16
kashyapLive migration14:17
mriedemkashyap: by default live migrations are restricted to one at a time on a given compute14:17
* kashyap looks at the code14:17
mriedemsee the max_concurrent_live_migrations option14:17
mriedemsdague: johnthetubaguy: dansmith: oh seers of nova lore, do you remember if boot from volume came before volume attach or after?14:18
dansmithafter I'm sure14:18
mriedemthat's what i assumed14:18
*** baoli has joined #openstack-nova14:19
openstackgerritAlex Szarka proposed openstack/nova master: Refactor create_delete_server_with_instance_update  https://review.openstack.org/46629614:21
*** ralonsoh has quit IRC14:21
*** ralonsoh has joined #openstack-nova14:21
kashyapmriedem: Thanks; that's useful14:22
kashyap"(Integer) Maximum number of live migrations to run concurrently. This limit is enforced to avoid outbound live migrations overwhelming the host/network and causing failures. It is not recommended that you change this unless you are very sure that doing so is safe and stable in your environment."14:22
openstackgerritAlex Szarka proposed openstack/nova master: Add method for verify multiple notifications  https://review.openstack.org/46552614:22
*** mlavalle has joined #openstack-nova14:29
*** cdent has quit IRC14:34
*** lpetrut has quit IRC14:36
*** karthiks has quit IRC14:38
dansmithwoot14:40
dansmithlive migration job is passing with multicell too14:40
*** mnestratov has joined #openstack-nova14:41
*** karthiks has joined #openstack-nova14:41
mriedemthat's unpossible14:42
dansmithit's definitely unexpected14:42
*** MVenesio_ has joined #openstack-nova14:44
openstackgerritMatt Riedemann proposed openstack/nova master: Deprecate scheduler trusted filter  https://review.openstack.org/46306514:45
*** yamamoto_ has joined #openstack-nova14:47
*** MVenesio has quit IRC14:47
*** MVenesi__ has joined #openstack-nova14:48
*** dpawlik is now known as _dpawlik14:48
*** gszasz has quit IRC14:48
mriedemif people are happy with this caching thing we should get it in and start backports https://review.openstack.org/#/c/465042/14:48
*** gianpietro has joined #openstack-nova14:49
openstackgerritDaniel Pawlik proposed openstack/nova master: Add hide hypervisor id on guest host  https://review.openstack.org/45975314:50
_dpawlikmriedem, dansmith, kashyap: I made some changes in PS https://review.openstack.org/#/c/459753/ . I must go. If something is bad, I try to fix it later. Thanks for reviewing14:50
*** MVenesio has joined #openstack-nova14:50
_dpawlikhave a nice weekend14:51
*** MVenesio_ has quit IRC14:51
*** yamamoto has quit IRC14:51
*** mriedem is now known as mriedem_afk14:52
*** gianpietro has quit IRC14:53
*** MVenesi__ has quit IRC14:54
*** gouthamr has joined #openstack-nova14:56
*** ratailor has quit IRC14:59
*** dikonoor has quit IRC14:59
*** trungnv has joined #openstack-nova15:00
*** markus_z has quit IRC15:01
*** hongbin has joined #openstack-nova15:01
*** armax has joined #openstack-nova15:02
*** tbachman has quit IRC15:02
*** alezil has quit IRC15:05
*** gmann has quit IRC15:05
*** ekhugen has quit IRC15:05
*** alezil has joined #openstack-nova15:05
*** gmann has joined #openstack-nova15:05
*** Guest26195 has quit IRC15:06
*** patriciadomin_ has quit IRC15:06
*** patriciadomin has joined #openstack-nova15:07
*** ekhugen has joined #openstack-nova15:08
*** egarbade has joined #openstack-nova15:08
*** egarbade is now known as Guest1612215:08
*** salv-orlando has quit IRC15:09
*** salv-orlando has joined #openstack-nova15:10
*** rcernin has quit IRC15:13
*** jaosorior has quit IRC15:13
*** eharney_ has joined #openstack-nova15:13
*** salv-orlando has quit IRC15:14
*** eharney has quit IRC15:15
*** karimb has joined #openstack-nova15:17
*** gouthamr has quit IRC15:19
*** marst_ has joined #openstack-nova15:19
*** eharney_ is now known as eharney15:23
*** gianpietro has joined #openstack-nova15:27
*** gouthamr has joined #openstack-nova15:28
*** tbachman has joined #openstack-nova15:30
*** tbachman_ has joined #openstack-nova15:34
*** tbachman has quit IRC15:34
*** tbachman_ is now known as tbachman15:34
*** salv-orlando has joined #openstack-nova15:36
cfriesenare there any plans to remove the glance proxy in the nova API?15:38
artomcfriesen, it's not already gone?15:40
*** mlakat has quit IRC15:40
*** salv-orlando has quit IRC15:41
artomcfriesen, deprecated, I should say, as of https://docs.openstack.org/developer/nova/api_microversion_history.html#id3315:41
artomcfriesen, but it has to remain in the code for older microversions to work15:41
johnthetubaguymriedem_afk I would have bet on it being after too, I kinda remember alaski attempting to tidy up a bunch of it some time after it landed15:45
alaskitidy up what now?15:47
*** coreywright has quit IRC15:47
*** Oku_OS is now known as Oku_OS-away15:48
*** dikonoor has joined #openstack-nova15:50
cfriesenartom: whoops, missed that.15:51
*** felipemonteiro_ has quit IRC15:52
*** baoli_ has joined #openstack-nova15:53
*** gyee has joined #openstack-nova15:55
*** baoli has quit IRC15:55
*** felipemonteiro has joined #openstack-nova15:56
*** lucasagomes is now known as lucas-afk15:57
*** esberglu has quit IRC15:57
*** esberglu has joined #openstack-nova15:58
dansmithalaski: boot from volume I think15:59
*** coreywright has joined #openstack-nova15:59
*** gianpietro has quit IRC16:00
alaskiahh. Tidy up is being generous. I just made it actually functional for xenserver, and a little more reliable.16:01
*** ralonsoh has quit IRC16:01
*** felipemonteiro_ has joined #openstack-nova16:02
alaskiyou know what would really help, uuids for bdms :)16:02
*** esberglu has quit IRC16:03
*** p01nt3r75 has quit IRC16:03
*** vks1 has quit IRC16:03
*** belmoreira has quit IRC16:04
cfriesenboot from volume definitely came after volume attach/detach16:04
cfriesen(looking at git history)16:04
*** felipemonteiro has quit IRC16:05
*** nic has joined #openstack-nova16:08
*** ericyoung has joined #openstack-nova16:09
*** Apoorva has joined #openstack-nova16:16
*** nicolasbock has quit IRC16:17
*** vks1 has joined #openstack-nova16:17
*** yamamoto_ has quit IRC16:19
*** yamamoto has joined #openstack-nova16:19
*** hshiina has quit IRC16:20
*** ltomasbo is now known as ltomasbo|away16:20
*** gianpietro has joined #openstack-nova16:25
*** ericyoung has quit IRC16:35
*** gouthamr_ has joined #openstack-nova16:35
*** trungnv has quit IRC16:36
*** crushil has quit IRC16:38
*** gouthamr has quit IRC16:38
openstackgerritDan Smith proposed openstack/nova master: De-complicate some of the instance delete path  https://review.openstack.org/45863616:39
openstackgerritDan Smith proposed openstack/nova master: Fix live migration devstack hook for multicell environment  https://review.openstack.org/45853716:39
openstackgerritDan Smith proposed openstack/nova master: Target cell on local delete  https://review.openstack.org/46405916:39
*** pcaruana|rtve| has quit IRC16:42
*** brault has quit IRC16:42
*** trungnv has joined #openstack-nova16:43
*** derekh has quit IRC16:44
*** sambetts is now known as sambetts|afk16:47
*** jwcroppe has quit IRC16:48
*** esberglu has joined #openstack-nova16:49
*** jwcroppe has joined #openstack-nova16:50
*** markvoelker has joined #openstack-nova16:52
*** crushil has joined #openstack-nova16:53
*** salv-orlando has joined #openstack-nova16:57
*** psachin has joined #openstack-nova16:59
*** salv-orlando has quit IRC17:03
*** vks1 has quit IRC17:04
*** tbachman has quit IRC17:07
*** jpena is now known as jpena|off17:09
*** gianpietro has quit IRC17:12
*** mnestratov has quit IRC17:13
*** swebster has quit IRC17:16
*** mkoderer has quit IRC17:24
*** salv-orlando has joined #openstack-nova17:25
*** takedakn has joined #openstack-nova17:27
*** salv-orlando has quit IRC17:28
*** takedakn has quit IRC17:28
*** Apoorva_ has joined #openstack-nova17:31
*** Apoorva has quit IRC17:35
*** vks1 has joined #openstack-nova17:40
*** Swami has joined #openstack-nova17:40
*** vks1 has quit IRC17:41
*** karimb has quit IRC17:43
*** lbragstad has quit IRC17:47
*** lbragstad has joined #openstack-nova17:47
*** lbragstad has quit IRC17:47
*** Sukhdev has joined #openstack-nova17:47
*** gjayavelu has joined #openstack-nova17:47
*** eharney has quit IRC17:51
*** Apoorva_ has quit IRC17:51
*** Apoorva has joined #openstack-nova17:51
*** rfolco has quit IRC17:53
*** gouthamr_ has quit IRC17:55
*** brault has joined #openstack-nova17:59
*** psachin has quit IRC18:03
*** brault has quit IRC18:03
*** eharney has joined #openstack-nova18:05
cfriesendansmith: you around?18:09
*** harlowja has joined #openstack-nova18:13
*** salv-orlando has joined #openstack-nova18:13
dansmithkinda18:13
*** Jeffrey4l has quit IRC18:14
*** gouthamr has joined #openstack-nova18:20
*** Jeffrey4l has joined #openstack-nova18:20
cfriesendansmith: if you remember we were talking about the cost of processing network-changed events.  it turns out the neutron work to process those events during a migration doubled in Newton when commit 5de902a went in.  That was submitted to fix evacuate bugs, but it meant both source and dest compute nodes got the "network-changed" events.18:21
cfriesenI'm writing up a post, but even after mriedem's optimization at https://review.openstack.org/#/c/465787 I'm seeing 4 simultaneous live migrations push neutron up to using 1300% cpu on the controller, with the spike lasting ~45sec18:22
*** JoseMello has joined #openstack-nova18:29
*** tbachman has joined #openstack-nova18:34
dansmith128 neutron api calls peg 13 cores for almost a minute?18:34
*** Jeffrey4l has quit IRC18:36
cfriesenno, more like a few thousand neutron API calls18:37
cfriesenfor each port nova queries the fixed IPs, floating IPs, subnets, etc18:37
dansmithoh I see18:37
*** mriedem_afk is now known as mriedem18:39
*** lbragstad has joined #openstack-nova18:39
mriedemcfriesen: so https://review.openstack.org/#/c/465787 does help?18:40
cfriesenmriedem: yes, hugely.  for one migration it cut down on the number of neutron API calls by a factor of 6 or so18:41
mriedemwow nice18:41
mriedemok so i suppose i need to tidy that up18:42
mriedemi can make it smaller by splitting the refactor part into a separate change18:42
cfriesenmriedem: dansmith: I just posted to the openstack-dev list: "massive overhead processing "network-changed" events during live migration".  Some hard data in there.18:42
cfriesenmriedem: I also included the change I proposed to query just the one port rather than listing all of them.18:43
*** Jeffrey4l has joined #openstack-nova18:43
mriedemok i'm post-alient and post-burrito so i need to get my bearings here18:47
cfriesenmridem: (I'm talking about the optimization I proposed in https://review.openstack.org/#/c/465787....I applied it for my testing)18:50
mriedemoh i haven't seen comments18:50
openstackgerritMatt Riedemann proposed openstack/nova master: libvirt: remove glusterfs volume driver  https://review.openstack.org/46399218:51
openstackgerritMatt Riedemann proposed openstack/nova master: libvirt: remove scality volume driver  https://review.openstack.org/44936418:52
cfriesenmriedem: my one comment about the number of neutron API calls isn't quite accurate, that's actually the number of lines in the neutron API log...but most API calls resulted in one log line so it should be in the ballpark.18:52
*** xyang1 has joined #openstack-nova18:56
*** pchavva has quit IRC18:56
*** smatzek has quit IRC18:58
mriedemcfriesen: does the list_ports thing really change much?19:00
mriedemreplied to your comments19:00
mriedemeither way it's a single API call to neutron19:00
mriedembut if we don't have a nw info cache for the instance, for whatever reason - that shouldn't actually happen, we'd need to go back and pull the entire list of ports to rebuild the entire nw info cache19:00
cfriesenmriedem: that list-ports is getting all the ports in the cloud, right?  or is it scoped to the project?19:01
mriedemsee the search opts19:01
mriedemit's scoped to the ports owned by that tenant associated with that specific instance19:01
mriedemif we just did show_port w/o those filter parameters, it'd be a possible bug19:01
*** fragatina has quit IRC19:02
mriedembecause the port might no longer be associated with that instance19:02
mriedemwhich messes up the logic that comes later19:02
cfriesenmriedem: okay, fair enough.  givien that it's associated with the instance it's probably fine.  I missed that part.19:02
mriedemok19:02
mriedem_build_network_info_model is really used for 3 different cases, so it gets really hairy logic-wise19:03
mriedemat some point i think we could split it apart, so we didn't have kwarg soup19:03
mriedemeverything in here is pretty fragile though, so it get scared touching most of it, especially since it's related to async event handling19:03
cfriesenthe real pain is that we end up getting multiple network-changed events for each port during the live migration.  The fact that until Newton we didn't even get the events on the dest compute node makes me think it's not actually needed there.19:04
*** marst_ has quit IRC19:09
*** itlinux has joined #openstack-nova19:09
*** nic has quit IRC19:09
*** nic has joined #openstack-nova19:10
*** marst_ has joined #openstack-nova19:10
artomcfriesen, there was https://review.openstack.org/#/c/246910/14 that wanted to send events to both source and dest during live-migration19:10
artomThat ended up being re-worked when we merged the other patch19:11
artomBut it shows the need was apparently there19:11
artomI suspect a lot of deployments ran with vif_plugging_fatal = false, which masks the whole thing19:11
*** pchavva has joined #openstack-nova19:11
*** marst_ has quit IRC19:13
*** marst_ has joined #openstack-nova19:13
*** yamahata has quit IRC19:14
mriedemreplied in the ML19:16
mriedemi'm not sure how sending events to the source compute during an evacuation makes any sense,19:17
mriedemisn't the source compute down?19:17
dansmithit might be, but the point is, any move/migrate should be sending them to both sides19:18
mriedemlooking at what artom linked it looked like what was really needed there was the vif plugged/unplugged events, which makes sense19:19
mriedemnetwork-changed is triggered anytime a port is updated - which for us is when it's bound/unbound to a host19:20
mriedemwhich makes sense, but as noted we shotgun our way to refresh the cache b/c we don't know which specific port was updated in that case19:20
mriedemwhich is my series of changes19:20
mriedemalso,19:20
mriedemi'm loathe to decide in the API based on migration type and event type which we should send and which we shouldn't based on how we expect the computes to behave19:21
artomAlso, I thought events the compute didn't specifically set up to listen for got ignored?19:21
mriedemno19:22
artomIs network-changes always processed?19:22
cfriesensure...but can we in nova selectively ignore the events if we know we don't need to care about them?19:22
mriedemartom: yes19:22
mriedemhttps://review.openstack.org/#/c/465792/19:22
mriedemoops19:22
mriedemhttps://github.com/openstack/nova/blob/master/nova/compute/manager.py#L685419:22
mriedemis a flat out, rebuild the entire nw info cache19:22
*** prometheanfire has joined #openstack-nova19:23
mriedemhttps://github.com/openstack/nova/blob/master/nova/compute/manager.py#L6862 for network-vif-deleted is targeted to at least just deallocate the port and remove it from the nw info cache w/o a full rebuild19:23
prometheanfirelooks like the oslo-cache test may be overly specific http://logs.openstack.org/87/465887/4/check/gate-cross-nova-python27-ubuntu-xenial/19a9161/testr_results.html.gz19:23
mriedemartom: else we fall into https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L680019:23
mriedem_event = self.instance_events.pop_instance_event(instance, event) are the things the specific compute is listening for,19:23
mriedemlike vif plugged19:23
artommriedem, OK, I was thinking of https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L30219:23
dansmithmriedem: yes I think the API making that call is bad news.. it's bad news for even compute manager to do it because the virt driver is running the migration19:23
mriedem^ triggers the callback into the virt driver to finish spawn()19:24
artommriedem, oh ok, yeah, your first link shows that network-changed is always processed19:24
mriedembut that's the network-vif-plugged and network-vif-unplugged events19:24
artomRegardless of what the compute prepared for19:24
mriedemright19:24
dansmithalso, when we support cross-cell migrations we'll want network-changed processed on both sides since they're separate databases19:24
dansmithif we don't we'll end up with stupid bugs like info cache is as provided by the source compute until the next periodic refresh19:25
mriedemdansmith: during a cross cell migration, wouldn't we get an InstanceNotFound on the source cell when trying to update it's nw info cache?19:25
cfriesenokay, so can we add more info from neutron to reduce the number of queries nova has to do?19:25
dansmithmriedem: no, if we do cross-cell migrations we'll have to create the instance in the target database before any of the migration stuff starts19:25
mriedemew yeah19:26
artomAlso, am I the only one who finds it completely mental that https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L6856 is on the *compute*?19:26
artomI'd put that somewhere more central, conductor I guess19:26
dansmithartom: why?19:26
prometheanfiremriedem: need a bug for http://logs.openstack.org/87/465887/4/check/gate-cross-nova-python27-ubuntu-xenial/19a9161/testr_results.html.gz ?19:26
dansmithartom: you have more computes than conductors, and instance events don't come to conductor, they come to the compute(s) that are associated with the instances19:26
cfriesendansmith: it's a bit silly that both computes are simultaneously querying the same data from neutron19:27
dansmithanything we can obviously do at the edges (computes) is better19:27
mriedemprometheanfire: probably - without me looking into the actual tests19:27
dansmithcfriesen: not in a cross-cell migration19:27
artomdansmith, I guess I was thinking in the context of this overloading Neutron discussion19:27
*** slaweq has joined #openstack-nova19:27
cfriesendansmith: wouldn't you have separate conductors there too?19:27
artomdansmith, but yeah, I'll shut up now ;)19:27
prometheanfiremriedem: k, fyi, I think this will be blocking reqs updates on dogpile.cache19:27
dansmithcfriesen: sure? but it's still twice the calls19:28
cfriesendansmith: for migrations in a single cell you could have the conductor get the data from neutron and then pass just the changed bits to both compute nodes19:28
mriedemnetwork-changed doesn't really have anything to do with the compute19:29
mriedemso that one could be centralized19:29
dansmithcfriesen: yes, you could have the api guess on all that and make those events different19:29
mriedemnetwork-vif-deleted and the vif plug/unplug ones call the driver so that's why they are on the compute19:29
*** pchavva has quit IRC19:29
*** Apoorva has quit IRC19:30
*** breton has quit IRC19:30
mriedemhandling network-changed is an optimization that could be made at the top probably19:30
mriedembut baby steps probably19:30
dansmithmriedem: all events are handled by the computes now, so if you change that, you need to know which conductor (super or cell) to send events to, and then adding new things becomes a little less clear about where each is handled19:31
dansmithmaking the operations that are happening less insanely heavy will yield much more benefit than cutting a big number in half in some situations19:32
mriedemthe former is what i'm trying to start with now yeah19:32
mriedemby targeting the network-changed event to a single port19:32
mriedemso we don't do the full nw info cache rebuild19:32
dansmithyeah19:32
dansmithI thought at one point we had a partial update thing like that19:33
dansmithdid we lose that or was it different?19:33
mriedemnot sure what you're referring to19:33
cfriesenwould it be reasonable for neutron to add more info about what exactly changed?  (subnet, fixedip, floatingip, etc.)19:33
mriedemcfriesen: maybe19:33
dansmithwe used to rebuild the whole cache every time and arosen did something to try to merge our networkinfo with just one change19:33
dansmithcfriesen: you only get a tag in the event, but you could use that to signal what to refresh, yes, or have a different event like "floatingip-changed"19:34
cfrieseneven something like that could cut the number of neutron GETs down dramatically19:35
mriedemhttps://review.openstack.org/#/q/owner:aaronorosen%2540gmail.com+status:abandoned+project:openstack/nova19:35
melwittdansmith: I put a lock around the cache access in https://review.openstack.org/465042 to address your comment19:35
dansmithmriedem: no, this thing merged and caused a bunch of bugs, but I thought they all got squashed out19:35
dansmithmriedem: anyway, not worth going to find it, it was 2013ish so just move on optimizing what we have now19:35
mriedemdansmith: oh idk then, that would be like 3+ years ago now19:35
dansmithyes19:36
dansmithmelwitt: I know, sorry19:36
melwittk, just in case you hadn't seen19:36
mriedemanywho, i've got some patches to review which i promised (well didn't promise, but said maybe) i'd review, so going to do those first and then can cleanup this patch19:37
*** breton has joined #openstack-nova19:37
*** Sukhdev has quit IRC19:37
*** salv-orlando has quit IRC19:38
cfriesenmriedem: dansmith: oh, and it turns out that once you have mriedem's "update the specific port" change, we don't really have any duplicate events for the same instance anymore19:39
mriedembecause they never were duplicates,19:40
mriedembut nova just didn't know19:40
cfriesenyeah19:40
mriedemright?19:40
cfriesenwhich actually means that the "vanilla" numbers for the neutron utilization would be much worse, since I had duplicate event removal in there.19:42
mriedemdo i get a large beer in denver for this?19:42
mriedems/beer/ginger ale/19:42
cfriesenoh, definitely19:42
melwittI don't understand why I would get "This change depends on a change that failed to merge." on a set where when I rebase it locally, I don't see any merge conflicts or auto-merging19:43
dansmithmelwitt: depends-on?19:43
melwittI don't think I have any but I'm checking again19:44
mriedemmelwitt: there used to be a thing with zuul where if you rebased a large series, it couldn't keep up with the stream of events,19:44
melwittyeah, I don't have any Depends-On. ugh, wtf19:44
mriedemand you'd get a merge conflict, even though there wasn't one19:44
mriedemi saw that happening on artom's series the otherday19:44
mriedemit was fixed for months, but might be back19:45
mriedemin black19:45
melwittokay, I think it's still a thing then. there's 18 patches19:45
*** fragatina has joined #openstack-nova19:45
artommriedem, you mean the tagged attach series?19:45
mriedemartom: is there any other?19:45
artomYeah, anything but the bottom patch gives merge conflict19:45
artommriedem, it's a secret that I'll reveal when I'm ready19:46
melwitthaha19:46
mriedemartom "tagged attach" lifshitz19:46
mriedemis your new name when i give credits in my album19:46
artomYey credits!19:46
mriedemright next to seymour duncan pickups19:47
artomSo I'll be in the 'Tools' section, gotcha19:47
cfriesenmriedem: you play guitar?19:47
mriedemcfriesen: in the long ago19:49
*** kylek3h has quit IRC19:49
mriedemthey sit in cases in a closet in the basement next to a box of books and yankee candles19:49
cfriesenthis guy makes fan-fret basses in my city...I've visited his shop: http://www.dingwallguitars.com/19:49
mriedemlike a true suburbanite19:50
*** kylek3h has joined #openstack-nova19:50
* melwitt begins the recheck extravaganza19:51
nicAre there party hats?19:51
openstackgerritDan Smith proposed openstack/nova master: Fix live migration devstack hook for multicell environment  https://review.openstack.org/45853719:51
openstackgerritDan Smith proposed openstack/nova master: Target cell on local delete  https://review.openstack.org/46405919:51
*** yamahata has joined #openstack-nova19:52
melwitthaha, yup19:52
artomSpeaking of party, we're not doing Hawaiian-nick Friday?19:53
artomNot that I ever did it, personally19:54
*** mriedem is now known as mriderman19:54
*** mriderman is now known as mriedem19:55
*** artom is now known as sanwonkwonsimotr19:56
*** sanwonkwonsimotr is now known as artom19:57
artomDammit, length limit cut off the last letter19:57
* artom was going for a palindrome :(19:57
*** fragatina has quit IRC20:00
*** fragatina has joined #openstack-nova20:00
*** felipemonteiro_ has quit IRC20:01
melwittwear a hawaiian shirt20:01
melwittand jeans20:01
melwittif you want to20:01
mriedemexcept peter20:01
mriedemhe has to come in on saturday20:02
openstackgerritMatt Riedemann proposed openstack/nova master: nova-manage: Deprecate 'log' commands  https://review.openstack.org/45317620:02
openstackgerritMatt Riedemann proposed openstack/nova master: nova-manage: Deprecate 'host' commands  https://review.openstack.org/45317520:02
openstackgerritMatt Riedemann proposed openstack/nova master: nova-manage: Deprecate 'project', 'account' commands  https://review.openstack.org/45317420:02
melwitthah20:02
*** crushil has quit IRC20:04
*** ijw_ has joined #openstack-nova20:05
*** fragatina has quit IRC20:06
*** ijw__ has joined #openstack-nova20:06
openstackgerritMatt Riedemann proposed openstack/nova master: nova-manage: Deprecate 'log' commands  https://review.openstack.org/45317620:07
mriedemhttps://review.openstack.org/#/c/453174/ and up are easy +Ws20:08
*** ijw_ has quit IRC20:10
openstackgerritEric Fried proposed openstack/nova master: Adopts keystoneauth with glance client.  https://review.openstack.org/41263420:11
*** ijw has joined #openstack-nova20:11
*** ijw__ has quit IRC20:13
*** itlinux has quit IRC20:14
melwittmriedem: on the first and last of those, the bp isn't mentioned in the commit message. point being, I wondered if they are part of a bp that explains what's going on and why20:15
melwittthe second one links to a non existing bp20:16
mriedemthe 2nd one's bp is completed20:16
mriedemthe os-hosts removal thing,20:16
mriedemi noted it after that bp was completed20:16
mriedemthe series itself is a precursor to move-nova-cmds-to-cliff in queens20:16
mriedemsfinucan wants to deprecate as much as possible from nova-manage before moving the infra for it over to cliff20:16
mriedemmaking the work he needs to do in queens smaller20:17
mriedemi asked him to remove the bp links for that though since it's not approved for pike, so would have been confusing20:17
*** gianpietro has joined #openstack-nova20:17
melwittoh, I see. thanks20:19
*** eharney has quit IRC20:21
mriedemanother easy one https://review.openstack.org/#/c/463065/20:22
mriedemand https://review.openstack.org/#/c/391060/20:23
mriedem^ is less easy i guess20:23
*** Apoorva has joined #openstack-nova20:24
*** mikal has quit IRC20:25
*** jamesdenton has quit IRC20:25
efriedjohnthetubaguy mriedem Can I get a sense of the scope of remaining work for bp/use-service-tokens-pike?20:26
*** salv-orlando has joined #openstack-nova20:26
efriedIt appears to be at least driving https://review.openstack.org/412634 to completion - but... is that it?20:26
mriedemefried: i haven't looked20:26
mriedemi think using it for glance is the big one20:27
efriedOkay, cause it looks like neutron & cinder are done.20:27
*** mikal has joined #openstack-nova20:27
mriedemyes those were done in ocata20:27
mriedemefried: or just look at the spec :) https://specs.openstack.org/openstack/nova-specs/specs/pike/approved/use-service-tokens.html20:27
mriedemhttps://specs.openstack.org/openstack/nova-specs/specs/pike/approved/use-service-tokens.html#work-items20:28
efriedmriedem Well, yeah, I did that20:28
mriedemeverything in there is done except for the glance one20:28
efriedOkay, just making sure I understood correctly.  Thanks.20:28
*** Guest6334 has quit IRC20:30
*** dave-mccowan has quit IRC20:31
melwittmriedem: hm, that reqspec delete one, the commit message points out that it's okay to delete it even if instance destroy fails. I'm thinking of a case where destroy fails, the user decides to just keep the instance around and then things will fail if they do a resize or something that will invoke the scheduler, right?20:32
melwittbc that reqspec will be gone20:33
mriedemmelwitt: did you see the comment i just put in there?20:33
melwittI just read it a few seconds after I typed in here heh20:34
mriedemb/c i thought about that yesterday or something20:34
mriedembut just remembered to point it out20:34
*** slaweq has quit IRC20:34
mriedemwe can be sure it's gone if we do a local delete,20:34
mriedemwe're less sure if we cast to the compute to delete it20:34
melwittyeah, it feels like a bit more thought should be put into it20:34
*** slaweq has joined #openstack-nova20:34
mriedemremoved my +220:35
mriedemwe could delete the reqspec if we are doing a local delete in the api,20:35
mriedemwe're going to need a periodic or nova-manage CLI to cleanup orphans from the api db for req spec and instance mappings,20:36
*** gianpietro has quit IRC20:36
mriedemso we could leave that to cleanup the req spec in the case of soft delete or when we cast to the compute to delete the req spec20:36
mriedemi don't know where a periodic would run, we don't have periodics in the api or conductor, only scheduler20:36
mriedemreqspecs are for scheduling so cleaning up orphans in a periodic task in the scheduler might be ok, but instance mappings don't fit that as nicely20:37
*** gianpietro has joined #openstack-nova20:37
*** ijw has quit IRC20:37
melwittI was just thinking, as long as the instance has disappeared from the user's perspective (deleted=1) then it's okay to delete the reqspec, since at that point they aren't able to do requests with it anyway (other than listing deleted instance I think)20:38
*** slaweq has quit IRC20:39
mriedembut we don't deleted=1 until we're in the compute in most cases,20:40
mriedemand deleted the reqspec there is an upcall,20:40
melwittI just can't remember where that happens, if it's in compute/api in the case of a cast to compute, or if it's in compute. I guess for the cast it's in compute, which sucks20:40
mriedemwhich we want to avoid20:40
melwittyeah20:40
*** dikonoor has quit IRC20:41
openstackgerritEric Fried proposed openstack/nova master: Add service_token for nova-glance interaction  https://review.openstack.org/41966220:44
*** slaweq has joined #openstack-nova20:45
openstackgerritEric Fried proposed openstack/nova master: DNM: Test service token in Glance  https://review.openstack.org/41966620:45
*** salv-orlando has quit IRC20:49
*** itlinux has joined #openstack-nova20:58
*** lbragstad has quit IRC20:59
*** ssurana has joined #openstack-nova21:00
*** marst_ has quit IRC21:02
*** dimtruck is now known as zz_dimtruck21:03
*** salv-orlando has joined #openstack-nova21:03
*** salv-orlando has quit IRC21:04
*** ssurana has quit IRC21:07
mriedemmordred: what is flavor extra_info? do you mean extra_specs?21:08
*** JoseMello has quit IRC21:08
*** gianpietro has quit IRC21:12
*** edmondsw has quit IRC21:12
*** rcernin has joined #openstack-nova21:13
*** edmondsw has joined #openstack-nova21:13
*** gianpietro has joined #openstack-nova21:13
*** Sukhdev has joined #openstack-nova21:14
*** smatzek has joined #openstack-nova21:14
mordredmriedem: yes. sorry - was typing from memory21:14
mordredmriedem: some clouds have hundreds of flavors - so it gets expensive :)21:15
mriedemok, not totally sure why you'd need extra specs, we don't expose those to non-admins by default21:15
mordredI mean- the call works on all of the clouds ... but I was told it was important to have them at some point21:16
* mordred goes to investigate21:16
mriedemhold the phone21:16
mriedemhttps://github.com/openstack/nova/blob/master/nova/policies/flavor_extra_specs.py#L2521:17
mriedemcreate, update, delete are admin,21:17
mriedemshow is admin or owner21:17
mriedembut...the admin is the owner of the flavor...21:17
*** edmondsw has quit IRC21:17
mordredyah - it quite happily returns a {} everywhereI run it21:18
mordredmriedem: ah - I think we default to fetching them because they used to come in from OS-FLV-WITH-EXT-SPECS:extra_specs21:20
*** esberglu has quit IRC21:20
mriedemhmm, johnthetubaguy or cfriesen might know more,21:21
mriedemcfriesen has been looking at this for embedding the instance flavor in the server GET response body,21:21
mriedemwhich has to hide the flavor extra specs if not an admin i think21:21
mriedemjohnthetubaguy would know why policy could be wonky here21:22
mordredneat. I look forward to learning more!21:23
*** edmondsw has joined #openstack-nova21:23
mordredmriedem: so extra_specs are not intended to be useful to end-users21:24
*** itlinux has quit IRC21:25
mriedemthat's a question or statement?21:25
*** salv-orlando has joined #openstack-nova21:25
*** smatzek has quit IRC21:25
mordredquestoin... just confirming me learning things21:26
dansmithsome people expose them to users21:26
mordredI have never gotten an error fetching them anywhere, fwiw21:27
dansmithmordred: not once? like not one single time?21:27
mriedemflavor extra specs are usually duplicated with image meta21:27
melwittby default, defining flavors and extra_specs on flavors and matching metadata keys on host aggregates is an admin thing21:27
mriedemand users can see image meta21:27
mriedemand assign image meta in horizon21:27
*** zz_dimtruck is now known as dimtruck21:27
mriedemi think anyway21:27
*** edmondsw has quit IRC21:27
dansmithmriedem: pretty sure that cburgess lets his user _see_ the extra specs because it matters for special types of instances21:28
*** slaweq has quit IRC21:28
mordreddansmith: not one single time21:28
mriedemlike, i want the guest watchdog action to do x for this vm21:28
dansmithmordred: daaayum.21:28
mordreddansmith: yah. it's a pretty successful api21:28
*** slaweq has joined #openstack-nova21:28
mordreddansmith: I mean, it's also pretty much always just empty21:28
mordredoh. you know what - I might be TOTALLY lying21:29
melwittmriedem: yeah, I think that's right that image meta is the user controllable way to express things to the scheduler (other than hints)21:29
*** dave-mccowan has joined #openstack-nova21:30
mriedemdansmith: remember that cburgess encourages his users to do live migrations once a minute too :)21:31
mordrednope. not lying. works fine at least with a quick check on vexxhost and citycloud21:31
dansmithmriedem: not saying cburgess makes good decisions, I'm just saying he lets them see extra_specs :P21:31
mordredI was thinking I just hadnt noticed because we also won't fail if the call fails and will return an empty {}21:31
*** slaweq has quit IRC21:32
mriedemmgagne: do you expose flavor extra specs to non-admin users?21:33
mordredalso - fwiw, it works in devstack too: http://logs.openstack.org/72/464772/1/check/gate-shade-dsvm-functional-neutron/f9ee1f6/console.html#_2017-05-15_23_26_48_15136621:34
*** dave-mccowan has quit IRC21:34
mordredthat's operating as the demo user21:34
mordredI'm mostly following up on this because if you think it's supposed to be not exposed and it is it might point to some sort of deeper problem21:35
mriedemso,21:36
mriedemi think it's because we don't target the flavor in the policy check21:36
mriedemi remember something about this when reviewing johnthetubaguy spec on fixing policy scope checks21:36
mriedemi.e. we're not scoping the admin or owner check to the flavor,21:36
mriedemwe're scoping it to the user's request context, and since they are the owner of the request, they have access21:36
mriedemwe don't have a project_id on flavors though to check against...21:37
mriedemso yeah, the policy basically doesn't mean anything :)21:38
mriedemunless you changed it to admin only21:38
*** salv-orlando has quit IRC21:39
*** salv-orlando has joined #openstack-nova21:41
openstackgerritAlex Szarka proposed openstack/nova master: [WIP] Transform instance.live_migration_rollback notification  https://review.openstack.org/40212421:41
*** lbragstad has joined #openstack-nova21:42
*** salv-orlando has quit IRC21:45
melwittmriedem: I'm working on the backports for the caching thing21:45
mriedemmelwitt: cool21:46
*** swebster has joined #openstack-nova21:48
*** ssurana has joined #openstack-nova21:52
*** esberglu has joined #openstack-nova21:53
openstackgerritAlex Szarka proposed openstack/nova master: Transform instance-live_migration_abort notification  https://review.openstack.org/42045321:53
*** karthiks has quit IRC21:55
*** esberglu has quit IRC21:55
*** ijw has joined #openstack-nova21:57
*** ijw_ has joined #openstack-nova21:57
*** baoli_ has quit IRC21:59
*** slaweq has joined #openstack-nova21:59
*** avolkov has quit IRC21:59
*** ijw has quit IRC22:01
*** MVenesio has quit IRC22:02
*** catintheroof has quit IRC22:02
*** slaweq has quit IRC22:02
*** burt has quit IRC22:04
*** salv-orlando has joined #openstack-nova22:04
*** thorst_afk has quit IRC22:06
*** sambetts|afk has quit IRC22:06
*** sambetts_ has joined #openstack-nova22:10
*** harlowja has quit IRC22:12
openstackgerritMatt Riedemann proposed openstack/nova master: Don't warn on expected network-vif-unplugged events  https://review.openstack.org/46579422:16
mordredmriedem: ok. neat! so - I won't worry about it too much then22:17
*** sdague has quit IRC22:18
*** lbragstad has quit IRC22:19
*** thorst_afk has joined #openstack-nova22:19
mriedemi might worry about it22:21
mriedemwell, i'll proxy that worry through johnthetubaguy22:21
*** edmondsw has joined #openstack-nova22:22
mriedemmelwitt: did you also want to give a heads up to the ops/dev list about that caching patch?22:23
mriedemand backport to newton22:23
*** thorst_afk has quit IRC22:23
melwittmriedem: yes to both. working on the newton backport right now and will compose an email for the MLs22:23
*** thorst_afk has joined #openstack-nova22:23
mriedemthanks22:23
*** thorst_afk has quit IRC22:24
mordredmriedem: I believe in johnthetubaguy's ability to worry about it22:24
*** xyang1 has quit IRC22:25
*** edmondsw has quit IRC22:26
*** salv-orlando has quit IRC22:29
*** Apoorva_ has joined #openstack-nova22:32
*** Apoorva has quit IRC22:35
cfriesenmordred:  mriedem: missed the earlier discussion about extra specs.  I think the "admin_or_owner" policy for indexing extra specs means that a regular user is allowed to look at them, just not modify them.  (at least that's the behaviour I see.22:36
openstackgerritMike Perez proposed openstack/nova master: Remove cells topic configuration option  https://review.openstack.org/46321822:36
*** mtanino has joined #openstack-nova22:36
mriedemcfriesen: yeah we sorted it out22:36
mriedemit's actually a semi-busted/fake policy check22:37
cfriesenI kind of like the behaviour, since it lets the user see the details of the flavors22:37
cfriesenbut our users tend to be pretty advanced and closely tied to the admins22:37
*** djohnsto has quit IRC22:42
melwittmriedem: I assume we're going to be looking at releasing newton and ocata asap after the backports merge? (for the email)22:46
*** lbragstad has joined #openstack-nova22:49
mriedemmelwitt: yeah22:51
mriedemwhich is why i also wanted to get https://review.openstack.org/#/c/464088/ backported22:51
melwittmriedem: k. looks like you have a comment to address on that one?22:53
mriedemi guess22:53
mriedemsfinucan!22:53
mriedemi don't really understand it though22:55
mriedemif that's true about rstrip, how is the test not failing?22:55
*** harlowja has joined #openstack-nova22:57
*** jamielennox is now known as jamielennox|away23:00
mriedemdoing what is suggested doesn't work,23:03
mriedemtests fail because stringifying the url encodes the special characters23:03
melwittI don't yet understand it either23:03
*** dimtruck is now known as zz_dimtruck23:04
mriedemhttps://github.com/zzzeek/sqlalchemy/blob/master/lib/sqlalchemy/engine/url.py#L6623:05
mriedemdoes linking to zzzeek code summon the zzzeek?!23:05
openstackgerritchristopher.uhler proposed openstack/nova master: Libvirt volume driver for Veritas HyperScale  https://review.openstack.org/44395123:07
*** Sukhdev has quit IRC23:22
*** thorst_afk has joined #openstack-nova23:24
*** thorst_afk has quit IRC23:29
*** harlowja has quit IRC23:34
*** Swami has quit IRC23:38
*** jamielennox|away is now known as jamielennox23:40
*** mdrabe__ is now known as mdrabe23:41
*** Apoorva_ has quit IRC23:47
*** Apoorva has joined #openstack-nova23:47
*** crushil has joined #openstack-nova23:53
*** lbragstad has quit IRC23:54
*** esberglu has joined #openstack-nova23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!