Wednesday, 2017-03-15

*** gyee has joined #openstack-nova00:02
*** marst has joined #openstack-nova00:04
*** kaisers_ has joined #openstack-nova00:05
*** yingjun has joined #openstack-nova00:06
*** mdrabe has quit IRC00:08
*** armax has quit IRC00:10
*** Sukhdev has quit IRC00:12
*** iceyao has joined #openstack-nova00:14
openstackgerritchristopher.uhler proposed openstack/nova master: Libvirt volume driver for Veritas HyperScale  https://review.openstack.org/44395100:15
*** zz_dimtruck is now known as dimtruck00:20
*** hoonetorg has quit IRC00:22
*** penick has joined #openstack-nova00:23
*** tbachman has quit IRC00:27
*** rmart04 has joined #openstack-nova00:29
*** r-daneel has quit IRC00:30
*** kaisers_ has quit IRC00:31
*** catintheroof has joined #openstack-nova00:32
*** rmart04 has quit IRC00:34
*** hoonetorg has joined #openstack-nova00:35
*** abalutoiu has quit IRC00:40
mriedemedleafe: dansmith: on https://review.openstack.org/#/c/441544/7/nova/objects/fields.py did we decide to not check before adding the CUSTOM_ prefix if it were already in the norm_name?00:40
*** abalutoiu has joined #openstack-nova00:40
mriedemi believe that's come up before00:41
dansmithmriedem: we're depending on the drivers to return legit classes, yes00:42
*** nic has quit IRC00:44
*** ZZelle has quit IRC00:49
*** armax has joined #openstack-nova00:51
*** iceyao has quit IRC00:51
*** iceyao_ has joined #openstack-nova00:51
mriedemso, we could still create CUSTOM_CUSTOM_BAREMETAL_GOLD then00:52
openstackgerritDan Smith proposed openstack/nova master: Teach HostAPI about cells  https://review.openstack.org/44216200:52
openstackgerritDan Smith proposed openstack/nova master: Make scheduler target cells to get compute node instance info  https://review.openstack.org/43989100:52
openstackgerritDan Smith proposed openstack/nova master: Sort CellMappingList.get_all() for safety  https://review.openstack.org/44317400:52
openstackgerritDan Smith proposed openstack/nova master: Add get_by_instance_uuids() to InstanceMappingList  https://review.openstack.org/44329200:52
openstackgerritDan Smith proposed openstack/nova master: Clean up ClientRouter debt  https://review.openstack.org/44448700:52
openstackgerritDan Smith proposed openstack/nova master: Make server_groups determine deleted-ness from InstanceMappingList  https://review.openstack.org/44329300:52
openstackgerritDan Smith proposed openstack/nova master: Remove Mitaka-era service version check  https://review.openstack.org/44286100:52
openstackgerritDan Smith proposed openstack/nova master: Make conductor ask scheduler to limit migrates to same cell  https://review.openstack.org/43802500:52
openstackgerritDan Smith proposed openstack/nova master: Add workaround to disable group policy check upcall  https://review.openstack.org/44273600:52
openstackgerritDan Smith proposed openstack/nova master: Avoid lazy-loading projects during flavor notification  https://review.openstack.org/44569700:52
mriedemand it wouldn't be the drivers fault, it could be the operator set the node.resource_class value to be 'CUSTOM_BAREMETAL_GOLD'00:52
dansmithright, but that's what we should do, IMHO00:53
dansmithotherwise there's this odd ambiguity,00:53
*** zhurong has joined #openstack-nova00:53
*** amotoki has joined #openstack-nova00:53
dansmithand the node resource class is an ironic construct, not specifically "this is (or may be) the exact resource class in placement"00:53
mriedemso ironic's API should then return a 400 if i try to set node.resource_class to anything with the CUSTOM_ prefix?00:54
dansmiththat's up to them, but I'd expect not00:55
dansmithand since they haven't placed those restrictions thus far (any of the ones required to be a resource class in placement),00:55
dansmithwe should just treat that as a thing, prefix with CUSTOM_ and normalize as we need)00:56
dansmithlike, maybe they let the resource class include spaces, they clearly allow lowercase, maybe punctuation, etc00:56
dansmithand that's cool00:56
mriedemok so CUSTOM_CUSTOM_BAREMETAL_GOLD just might be a thing you end up with, and if so, oops, but it doesn't break01:00
dansmithright01:00
mriedemnot sure i want to start thinking about what it would take to unwind that if you wanted to fix it,01:00
mriedemacross both services01:01
dansmithI don't think it's a big deal actually, but,01:01
dansmithwhen they start reporting into placement, they can generate and handle their classes however they want01:01
*** sree has joined #openstack-nova01:02
*** sree has quit IRC01:02
*** sree has joined #openstack-nova01:02
mriedemok01:03
mriedemi've left comments in the code parts, will do tests later01:03
*** phuongnh has joined #openstack-nova01:03
*** xinliang has joined #openstack-nova01:06
*** xinliang has quit IRC01:06
*** xinliang has joined #openstack-nova01:06
*** crushil has joined #openstack-nova01:06
*** iceyao has joined #openstack-nova01:07
*** iceyao_ has quit IRC01:11
*** hoonetorg has quit IRC01:16
*** awaugama has quit IRC01:18
*** kevinz has joined #openstack-nova01:19
*** unicell has quit IRC01:20
*** Shunli has joined #openstack-nova01:21
*** edmondsw has joined #openstack-nova01:21
*** dimtruck is now known as zz_dimtruck01:22
*** catintheroof has quit IRC01:24
*** kaisers_ has joined #openstack-nova01:27
*** iceyao has quit IRC01:28
*** abalutoiu has quit IRC01:28
*** Shunli has quit IRC01:28
*** abalutoiu has joined #openstack-nova01:28
*** Shunli has joined #openstack-nova01:29
*** rmart04 has joined #openstack-nova01:30
*** hoonetorg has joined #openstack-nova01:30
*** catintheroof has joined #openstack-nova01:30
*** catintheroof has quit IRC01:32
*** rmart04 has quit IRC01:34
*** edmondsw has quit IRC01:36
*** yonglihe has joined #openstack-nova01:43
*** fragatin_ has joined #openstack-nova01:44
*** tbachman has joined #openstack-nova01:46
*** mriedem has quit IRC01:48
*** fragatina has quit IRC01:48
*** fragatin_ has quit IRC01:49
*** raunak has quit IRC01:52
*** iceyao has joined #openstack-nova01:53
*** namnh has joined #openstack-nova01:53
openstackgerritDanfly proposed openstack/nova master: Completely remove mox from unit/network/test_linux_net.py  https://review.openstack.org/44550401:57
*** rmart04 has joined #openstack-nova02:00
*** wangqun has joined #openstack-nova02:00
*** rmart04 has quit IRC02:05
*** amotoki has quit IRC02:05
*** amotoki has joined #openstack-nova02:05
*** kaisers__ has joined #openstack-nova02:08
*** yamahata has quit IRC02:08
*** fragatina has joined #openstack-nova02:11
*** kaisers_ has quit IRC02:12
*** zsli_ has joined #openstack-nova02:14
*** tanee is now known as tanee_away02:14
*** tanee_away is now known as tanee02:14
*** gongysh has joined #openstack-nova02:14
*** Shunli has quit IRC02:16
*** fragatina has quit IRC02:16
*** sree has quit IRC02:17
*** zsli__ has joined #openstack-nova02:18
openstackgerritZhenyu Zheng proposed openstack/nova-specs master: Send out notifications when instance tags changed  https://review.openstack.org/42956902:19
*** zsli_ has quit IRC02:20
*** ssurana has joined #openstack-nova02:22
*** ssurana has left #openstack-nova02:24
*** gcb has joined #openstack-nova02:29
*** ijw has quit IRC02:36
*** zz_dimtruck is now known as dimtruck02:37
*** ijw has joined #openstack-nova02:38
*** gouthamr has quit IRC02:39
*** ijw has quit IRC02:42
*** sree has joined #openstack-nova02:42
*** raunak has joined #openstack-nova02:43
openstackgerritWei Cao proposed openstack/nova master: vmware: Change the VM Create spec  https://review.openstack.org/44411902:47
*** kaisers__ has quit IRC02:50
*** Apoorva has quit IRC02:52
*** hongbin has joined #openstack-nova02:56
*** bkopilov has quit IRC02:58
*** sree has quit IRC03:00
*** gyee has quit IRC03:01
*** rmart04 has joined #openstack-nova03:01
*** rmart04 has quit IRC03:06
*** markvoelker has quit IRC03:06
*** antwash has left #openstack-nova03:07
alex_xugmann: johnthetubaguy some test https://review.openstack.org/44536103:09
*** ducnc1 has joined #openstack-nova03:13
*** ducnc has quit IRC03:15
*** ducnc1 is now known as ducnc03:15
*** gyee has joined #openstack-nova03:17
*** browne has quit IRC03:18
*** crushil has quit IRC03:19
*** unicell has joined #openstack-nova03:26
*** Jeffrey4l has quit IRC03:28
*** amotoki has quit IRC03:32
*** tovin07_ has joined #openstack-nova03:33
*** Jeffrey4l has joined #openstack-nova03:41
*** hongbin has quit IRC03:42
*** nicolasbock has quit IRC03:42
*** diga has joined #openstack-nova03:44
*** kaisers_ has joined #openstack-nova03:45
openstackgerritZhenyu Zheng proposed openstack/nova-specs master: Repropose tag-instance-when-boot  https://review.openstack.org/41531503:46
*** amotoki has joined #openstack-nova03:49
*** amotoki has quit IRC03:50
*** amotoki has joined #openstack-nova03:52
*** amotoki has quit IRC03:54
*** links has joined #openstack-nova03:56
*** huangtianhua has quit IRC03:57
*** rmart04 has joined #openstack-nova04:02
*** namnh has quit IRC04:05
*** rmart04 has quit IRC04:07
*** markvoelker has joined #openstack-nova04:07
*** kaisers_ has quit IRC04:09
*** rfolco has quit IRC04:10
*** s1061123_ is now known as s1061123_away04:11
*** s1061123_away is now known as s1061123_afk04:11
*** markvoelker has quit IRC04:13
*** ijw has joined #openstack-nova04:13
*** fragatina has joined #openstack-nova04:15
*** gcb has quit IRC04:15
*** gcb has joined #openstack-nova04:16
*** fragatina has quit IRC04:16
*** fragatina has joined #openstack-nova04:17
*** udesale has joined #openstack-nova04:18
*** psachin has joined #openstack-nova04:20
*** dikonoor has joined #openstack-nova04:21
*** amotoki has joined #openstack-nova04:22
*** fragatina has quit IRC04:26
*** vks1 has joined #openstack-nova04:26
*** adisky_ has joined #openstack-nova04:26
openstackgerritHieu LE proposed openstack/nova master: Completely remove mox from objects/test_instance.py  https://review.openstack.org/34346504:28
*** dikonoor has quit IRC04:28
*** Apoorva has joined #openstack-nova04:35
*** zsli_ has joined #openstack-nova04:38
*** gongysh has quit IRC04:39
*** amotoki has quit IRC04:39
*** zsli__ has quit IRC04:40
*** Apoorva has quit IRC04:45
*** psachin has quit IRC05:00
*** zhurong has quit IRC05:00
*** sree has joined #openstack-nova05:01
*** kaisers_ has joined #openstack-nova05:02
*** rmart04 has joined #openstack-nova05:03
*** kaisers_ has quit IRC05:04
*** david-lyle has quit IRC05:04
*** bkopilov has joined #openstack-nova05:05
*** sree has quit IRC05:06
*** wangqun_ has joined #openstack-nova05:07
*** wangqun has quit IRC05:07
*** josecastroleon has quit IRC05:07
*** rmart04 has quit IRC05:07
openstackgerritWei Cao proposed openstack/nova master: vmware: Change the VM Create spec  https://review.openstack.org/44411905:08
*** wangqun has joined #openstack-nova05:11
*** wangqun_ has quit IRC05:13
openstackgerritOpenStack Proposal Bot proposed openstack/nova master: Updated from global requirements  https://review.openstack.org/44335705:16
*** psachin has joined #openstack-nova05:17
*** ratailor has joined #openstack-nova05:17
*** gongysh has joined #openstack-nova05:17
*** udesale__ has joined #openstack-nova05:17
*** ayogi has joined #openstack-nova05:18
*** wangqun has quit IRC05:18
*** wangqun has joined #openstack-nova05:18
*** dikonoor has joined #openstack-nova05:19
*** udesale has quit IRC05:21
openstackgerritGhanshyam Mann proposed openstack/nova master: Add api-ref for filter/sort whitelist  https://review.openstack.org/42176005:25
*** faizy has joined #openstack-nova05:28
*** dikonoor has quit IRC05:28
*** dikonoor has joined #openstack-nova05:28
*** amotoki has joined #openstack-nova05:30
*** NikhilS has joined #openstack-nova05:30
*** prateek has joined #openstack-nova05:32
*** prateek has quit IRC05:32
*** prateek has joined #openstack-nova05:33
*** udesale has joined #openstack-nova05:35
*** eliqiao has quit IRC05:35
*** udesale__ has quit IRC05:37
*** bmace has quit IRC05:37
*** zsli_ has quit IRC05:39
*** zsli_ has joined #openstack-nova05:40
*** sandanar has joined #openstack-nova05:42
openstackgerritSivasathurappan Radhakrishnan proposed openstack/nova master: Permit Live Migration of Rescued Instances  https://review.openstack.org/30819805:42
*** claudiub has joined #openstack-nova05:44
*** udesale__ has joined #openstack-nova05:44
*** udesale has quit IRC05:46
*** dikonoor has quit IRC05:48
*** psachin has quit IRC05:49
*** lpetrut has joined #openstack-nova05:51
*** gyee has quit IRC05:51
*** fragatina has joined #openstack-nova05:55
*** psachin has joined #openstack-nova05:57
*** yamahata has joined #openstack-nova05:59
*** amotoki has quit IRC06:00
*** rmart04 has joined #openstack-nova06:04
*** kaisers_ has joined #openstack-nova06:04
*** sridharg has joined #openstack-nova06:07
*** zsli_ has quit IRC06:08
*** rmart04 has quit IRC06:08
*** markvoelker has joined #openstack-nova06:09
*** kaisers_ has quit IRC06:09
*** dikonoor has joined #openstack-nova06:11
*** amotoki has joined #openstack-nova06:11
*** haplo37 has quit IRC06:11
*** raunak has quit IRC06:12
*** markvoelker has quit IRC06:13
*** sree has joined #openstack-nova06:18
*** raghav has quit IRC06:18
*** haplo37 has joined #openstack-nova06:20
*** armax has quit IRC06:20
*** unicell1 has joined #openstack-nova06:29
*** unicell has quit IRC06:30
*** nkrinner_afk is now known as nkrinner06:36
*** lpetrut has quit IRC06:40
*** sandanar has quit IRC06:45
*** moshele has joined #openstack-nova06:46
*** namnh has joined #openstack-nova06:48
*** lpetrut has joined #openstack-nova06:49
*** fragatina has quit IRC06:50
*** ekuris has joined #openstack-nova06:52
*** jaosorior has joined #openstack-nova06:52
*** tuanluong has joined #openstack-nova06:54
openstackgerritSergey Nikitin proposed openstack/nova master: Standardization of VM diagnostics info API.  https://review.openstack.org/35554006:55
*** zhurong has joined #openstack-nova06:58
*** satyar has joined #openstack-nova07:01
*** karthiks_afk is now known as karthiks07:01
*** tuanluong_ has joined #openstack-nova07:04
*** lpetrut has quit IRC07:05
*** kaisers_ has joined #openstack-nova07:06
*** lpetrut has joined #openstack-nova07:06
*** andreas_s has joined #openstack-nova07:06
*** tuanluong has quit IRC07:07
*** josecastroleon has joined #openstack-nova07:08
openstackgerritDinesh Bhor proposed openstack/nova master: Use HostAddressOpt for opts that accept IP and hostnames  https://review.openstack.org/44578207:08
*** kaisers_ has quit IRC07:10
openstackgerritSivasathurappan Radhakrishnan proposed openstack/nova-specs master: Live Migration of Rescued Instances  https://review.openstack.org/34716107:11
*** Oku_OS-away is now known as Oku_OS07:12
*** fragatina has joined #openstack-nova07:14
*** unicell1 has quit IRC07:21
*** trinaths has joined #openstack-nova07:30
*** diga has quit IRC07:30
*** gongysh has quit IRC07:34
*** ratailor has quit IRC07:36
*** tesseract has joined #openstack-nova07:44
*** ltomasbo|away is now known as ltomasbo07:45
*** zhangqiankun has quit IRC07:49
*** zhangqiankun has joined #openstack-nova07:49
*** gongysh has joined #openstack-nova07:50
*** tuanluong_ has quit IRC07:52
*** trinaths has quit IRC07:52
*** tuanluong has joined #openstack-nova07:55
*** zzzeek has quit IRC08:00
*** zzzeek has joined #openstack-nova08:00
*** VAhl has joined #openstack-nova08:02
*** pcaruana has joined #openstack-nova08:05
*** kaisers_ has joined #openstack-nova08:06
*** jichen has joined #openstack-nova08:08
jichenalex_xu, hi have time for a quick talk?08:10
*** markvoelker has joined #openstack-nova08:10
alex_xujichen: yea, sure, please08:10
*** ratailor has joined #openstack-nova08:10
jichenhttps://bugs.launchpad.net/nova/+bug/1670978, this need a spec ,right? if any changes might need to be done08:10
openstackLaunchpad bug 1670978 in OpenStack Compute (nova) "most of extended server attributes returned in 2.3 api versions should not require admin role" [Undecided,New] - Assigned to jichenjc (jichenjc)08:10
alex_xujichen: 不需要08:11
alex_xusorry08:11
alex_xujichen: it needn't08:11
jichenwhy ?08:11
*** kaisers_ has quit IRC08:11
jichenAPI changes no spec needed any more ?08:11
alex_xujichen: it is only about change a default value of a policy rule from admin-only to owner_or_admin08:11
jichenum... part of the return value affected ,I thought if we affect output format , this is API change?08:12
*** udesale has joined #openstack-nova08:13
alex_xujichen: yea, that always confuse us, but actually, that can't be resolved by microversion, it should be resolved by capabilities API08:13
alex_xujichen: here is https://review.openstack.org/#/c/386555/08:14
jichenalex_xu: so this bug might need the API-WG discussion on cap talk settle down then continue?08:14
alex_xujichen: i think no...08:14
jichenalex_xu: yeah, I knew this discussion08:14
*** markvoelker has quit IRC08:14
jichenok, I will give another thought and see how to proceed this08:14
alex_xujohnthetubaguy: ^ I think we needn't waiting for cap API, right?08:14
*** udesale__ has quit IRC08:14
alex_xujichen: thanks, if johnthetubaguy also ensure this needn't waiting for cap API, then ping me when the patch ready08:15
jichenok08:15
jichenanother question08:15
alex_xujichen: yea, please08:15
jichenhttps://review.openstack.org/307675, it's abandoned but this seems discussed before and a potential item? any discussion on PTG about it ?08:16
jichenChange subject: Make API errors conform to API-WG schema08:17
alex_xujichen: there is no discussion about this in the PTG08:17
jichenok... I went through the ethpad and didn't find anything....08:17
alex_xujichen: yea, I didn't remember we bring that idea into the api meeting before PTG also08:17
jichenso it might be restore back later after P , Q ... :) ?08:18
alex_xujichen: yea, first ensure someone commit to work on it08:18
jichenI can't remember clearly but seems I saw it's discussed somewhere08:18
alex_xujichen: there is proposal add that into placement API08:18
jichenok, can you point me the link?08:18
alex_xusearching the link08:19
jichenok, thanks~08:19
alex_xujichen: https://review.openstack.org/#/c/418393/08:19
alex_xumaybe co-work with that spec, and migrate the solution into the nova api08:19
jichenalex_xu: great, thanks a lot~08:19
jichenI will take a look :)08:19
alex_xujichen: np :)08:19
*** abalutoiu has quit IRC08:20
*** efoley__ has joined #openstack-nova08:23
*** diga has joined #openstack-nova08:26
*** zhurong has quit IRC08:28
*** yamahata has quit IRC08:31
*** josecastroleon has quit IRC08:33
*** amotoki has quit IRC08:35
*** abalutoiu has joined #openstack-nova08:36
*** amoralej|off is now known as amoralej08:37
*** Shunli has joined #openstack-nova08:39
*** lpetrut has quit IRC08:46
*** jpena|off is now known as jpena08:46
*** Shunli has quit IRC08:53
*** Shunli has joined #openstack-nova08:53
*** ralonsoh has joined #openstack-nova08:55
*** priteau has joined #openstack-nova08:55
*** abalutoiu has quit IRC08:55
*** haplo37 has quit IRC08:58
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: utils.get_disk return the target dev of the root device  https://review.openstack.org/40271609:00
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: Make guest.BlockDevice only use the target dev of a disk  https://review.openstack.org/40216309:00
*** prateek_ has joined #openstack-nova09:02
*** udesale__ has joined #openstack-nova09:04
*** prateek has quit IRC09:04
*** karimb has joined #openstack-nova09:05
*** udesale has quit IRC09:06
*** haplo37 has joined #openstack-nova09:07
*** kaisers_ has joined #openstack-nova09:07
*** VAhl has quit IRC09:08
*** zsli_ has joined #openstack-nova09:08
*** dimtruck is now known as zz_dimtruck09:10
*** Shunli has quit IRC09:11
*** abalutoiu has joined #openstack-nova09:11
*** kaisers_ has quit IRC09:12
*** lucas-afk is now known as lucasagomes09:17
*** liusheng has quit IRC09:18
*** liusheng has joined #openstack-nova09:19
*** priteau has quit IRC09:25
*** zhurong has joined #openstack-nova09:28
*** jaosorior is now known as jaosorior_lunch09:28
*** zioproto has joined #openstack-nova09:31
*** zsli_ has quit IRC09:33
*** zhurong has quit IRC09:38
openstackgerritjichenjc proposed openstack/nova master: WIP: allow owner to retrieve some data by default  https://review.openstack.org/44584409:39
openstackgerritjichenjc proposed openstack/nova master: WIP: allow owner to retrieve some data by default  https://review.openstack.org/44584409:41
*** zhurong has joined #openstack-nova09:42
*** derekh has joined #openstack-nova09:43
openstackgerritMatthew Booth proposed openstack/nova master: Add InstanceList.get_by_instance_mapping_list()  https://review.openstack.org/44514109:44
*** ijw has quit IRC09:45
*** josecastroleon has joined #openstack-nova09:50
*** ijw has joined #openstack-nova09:50
mdboothlyarwood: Morning. Can you point me at your series again?09:51
*** zhurong has quit IRC09:53
lyarwoodmdbooth: https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bug/1489581 & https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bp/cinder-new-attach-apis09:53
*** dmellado has quit IRC09:54
lyarwoodmdbooth: the first two are just nice to have, we've been trying to get a uuid added for bdms for ages09:54
*** amoralej has quit IRC09:54
mdboothlyarwood: K. I'll ask a series of dumb questions throughout the morning in all likelihood09:54
*** ltomasbo has quit IRC09:54
*** jpena has quit IRC09:55
openstackgerritMatthew Booth proposed openstack/nova master: Make server_external_events use an optimal number of db queries  https://review.openstack.org/44514209:55
lyarwoodmdbooth: np and thanks for looking at this09:55
*** ijw has quit IRC09:57
*** yingjun has quit IRC09:57
*** gcb has quit IRC09:59
*** jpena|off has joined #openstack-nova09:59
*** ltomasbo|away has joined #openstack-nova10:00
*** amoralej has joined #openstack-nova10:00
*** ijw has joined #openstack-nova10:01
*** s1061123_afk is now known as tohayash10:01
*** dmellado has joined #openstack-nova10:02
*** edmondsw has joined #openstack-nova10:02
*** satyar has quit IRC10:03
openstackgerritSergey Nikitin proposed openstack/nova-specs master: TinyFix: Changed type of CPU ID from 'String' to 'Integer' in diagnostics spec  https://review.openstack.org/44585510:05
*** tovin07_ has quit IRC10:05
*** wangqun has quit IRC10:06
*** jpena|off is now known as jpena10:06
*** edmondsw has quit IRC10:06
*** kaisers_ has joined #openstack-nova10:08
*** markvoelker has joined #openstack-nova10:10
*** ltomasbo|away is now known as ltomasbo10:12
*** kaisers_ has quit IRC10:13
*** udesale has joined #openstack-nova10:14
*** prateek__ has joined #openstack-nova10:15
*** markvoelker has quit IRC10:15
*** udesale has quit IRC10:16
*** udesale has joined #openstack-nova10:16
*** udesale__ has quit IRC10:17
*** gszasz has joined #openstack-nova10:17
*** prateek_ has quit IRC10:18
*** openstackgerrit has quit IRC10:18
*** kevinz has quit IRC10:18
ildikovlyarwood: hi10:19
*** tuanluong has quit IRC10:19
*** rfolco has joined #openstack-nova10:19
ildikovlyarwood: are the BDM patches ready for review?10:19
lyarwoodildikov: yes, mdbooth is going over them now10:20
ildikovlyarwood: I saw on the priority etherpad that they are still listed under subteam review, but if you fixed Matt's comments, etc then I'll move them to ready10:20
ildikovlyarwood: great, I'll move them on the etherpad too10:20
ildikovlyarwood: tnx10:20
mdboothlyarwood: Do you happen to know why we don't refer to bdms by the primary key (id)?10:21
mdboothWe don't do that anywhere, so this isn't an outlier10:22
mdboothJust wondering if you know why10:22
lyarwoodI wasn't aware that we ever did that so no, if we did I don't know why we stopped10:23
mdboothI suppose the db's primary key isn't universally unique...10:24
lyarwoodyeah, as we are moving towards multiple dbs etc I guess we needed uuids10:24
*** openstackgerrit has joined #openstack-nova10:27
openstackgerritIldiko Vancsa proposed openstack/nova master: Deprecate the Cinder API v2 support  https://review.openstack.org/44425310:27
*** sdague has joined #openstack-nova10:27
openstackgerritjichenjc proposed openstack/nova master: remove keypair server extension  https://review.openstack.org/39661110:27
openstackgerritAlex Xu proposed openstack/nova master: Another poc for removing stevedore for nova api  https://review.openstack.org/44586410:27
*** arslanq has joined #openstack-nova10:28
arslanqhi guys, i am confused about live migration of VMs. What is the requirement of live migration does it require shared storage ?10:29
*** phuongnh has quit IRC10:31
rpodolyakaarslanq: it does not. libvirt can 'block migrate' the storage for you10:32
rpodolyakaarslanq: that being said, shared storage is highly recommended10:32
*** ababich has joined #openstack-nova10:32
*** moshele has quit IRC10:33
MasterofJOKershttps://docs.openstack.org/admin-guide/compute-configuring-migrations.html#block-migration10:33
arslanqrpodolyaka: Thanks, i am facing some errors on block migration. i'll get back to you10:37
*** udesale has quit IRC10:41
*** namnh has quit IRC10:41
*** scottda has quit IRC10:44
*** karimb has quit IRC10:49
openstackgerritBéla Vancsics proposed openstack/nova master: Transform instance.trigger_crash_dump notification  https://review.openstack.org/39622510:50
*** nicolasbock has joined #openstack-nova10:50
*** lpetrut has joined #openstack-nova10:56
*** dikonoor has quit IRC10:58
*** jichen has quit IRC11:00
*** gongysh has quit IRC11:01
openstackgerritArtom Lifshitz proposed openstack/nova master: Plumbing for tagged nic attachment  https://review.openstack.org/41562211:04
openstackgerritArtom Lifshitz proposed openstack/nova master: Delete nic metadata when detaching interface  https://review.openstack.org/43538711:04
openstackgerritArtom Lifshitz proposed openstack/nova master: Libvirt support for tagged volume attachment  https://review.openstack.org/41810011:04
openstackgerritArtom Lifshitz proposed openstack/nova master: Delete disk metadata when detaching volume  https://review.openstack.org/43508211:04
openstackgerritArtom Lifshitz proposed openstack/nova master: Plumbing for tagged volume attachment  https://review.openstack.org/39194111:04
openstackgerritArtom Lifshitz proposed openstack/nova master: API support for tagged device attachment  https://review.openstack.org/37602111:04
openstackgerritArtom Lifshitz proposed openstack/nova master: Libvirt support for tagged nic attachment  https://review.openstack.org/41552011:04
*** liverpooler has quit IRC11:08
*** ayogi has quit IRC11:08
*** kaisers_ has joined #openstack-nova11:09
asettleMorning bauzas and johnthetubaguy - Brian seems to be having issues with his CentOS install (which, he htinks is environment related). Is there anyone in here that could test on CentOS or RHEL for us?11:09
asettleWe're 2/3rds there11:09
*** ayogi has joined #openstack-nova11:10
*** kaisers_ has quit IRC11:13
*** amotoki has joined #openstack-nova11:14
*** karimb has joined #openstack-nova11:15
*** lucasagomes is now known as lucas-pto11:15
*** bvanhav__ has joined #openstack-nova11:15
openstackgerritMaxim Nestratov proposed openstack/nova-specs master: libvirt: reintroduce runtime image type detection  https://review.openstack.org/36354711:17
*** smatzek has joined #openstack-nova11:17
*** cdent has joined #openstack-nova11:17
*** ociuhandu has quit IRC11:21
*** amotoki has quit IRC11:21
*** karimb has quit IRC11:26
mnestratovmdbooth: hi11:26
mnestratovregarding ^^11:27
mdboothmnestratov: Yeah, I don't think I'm ever going to like that :(11:27
mdboothI'm very much in favour of multi-backend support, though.11:28
mnestratovand I repeat what I just aksed in review - how do we change current default behavir?11:28
mdboothJust not with static config.11:28
mnestratov*behavior11:28
*** karimb has joined #openstack-nova11:29
mdbooth2 things: associate the backend in use somehow with the bdm, so it lives with the instance not with the host config11:29
mnestratovI'm fine with it11:29
*** psachin has quit IRC11:30
mdboothSecond: configure a *default* somehow, or pass it in the api in a driver-agnostic way11:30
*** gouthamr has joined #openstack-nova11:30
*** psachin has joined #openstack-nova11:30
mdboothAdvantage of doing the former is that you can change your mind about the latter11:30
mnestratovare we going to ignore images_type config parameter?11:30
mdboothI would love to be able to do that, yes11:30
mdboothIt's a bug11:30
mnestratovme too11:31
mnestratovare we going to do this?11:31
mdboothGiven infinite time I will hopefully get to it eventually  :)11:31
mdboothIf you can get it done now I'll definitely support you in that.11:32
arslanqrpodolyaka: i am running block migration and hitting with this issue: Error LiveMigrateException: Live Migration failed: Migration complete but instance did not change host: compute711:32
mnestratovit doesn't solve my problems11:32
*** ralonsoh has quit IRC11:32
mnestratovbut ok I'll try to figure out how to do this via DBM11:33
rpodolyakaarslanq: are there any additional errors on both source and destination compute nodes? nova-compute / libvirt logs11:33
mnestratovI mean BDM :)11:34
arslanqrpodolyaka: i found this error log in nova logs: Live Migration failure: Operation not supported: qemu does not support drive-mirror command11:35
*** diga has quit IRC11:35
johnthetubaguyasettle: do you have more details on the issue he is hitting at all?11:36
asettlejohnthetubaguy: From Brian this morning "And all the steps work correctly on CentOS, I just have communication problems between the compute and the controller nodes. At this point I’m thinking it is a problem with CentOS packages or perhaps my environment."11:37
asettleI don't have much more than that, unfortunately (as in, no error logs)11:37
*** amotoki has joined #openstack-nova11:38
mdboothmnestratov: Sorry, got disconnected. Scrolling back.11:38
rpodolyakaarslanq: hmm, this sounds similar to https://bugs.launchpad.net/nova/+bug/144105411:39
openstackLaunchpad bug 1441054 in OpenStack Compute (nova) "live-migration --block-migrate fails with default libvirt flags" [Medium,Invalid] - Assigned to Mathieu Rohon (mathieu-rohon)11:39
rpodolyakaarslanq: I remember there were some issues with block migration on some versions of libvirtd11:39
rpodolyakaarslanq: specifically, we could not block migrate instances with block devices attached (e.g. config drives)11:40
mdboothmnestratov: Moving this into the BDM makes it unambiguous. It opens up the possibility of safely having a heterogenous storage config.11:40
*** hshiina has joined #openstack-nova11:40
*** jaypipes has joined #openstack-nova11:40
rpodolyakaarslanq: but, unfortunately,  I do not remember details :(11:40
arslanqrpodolyaka: Note: i don't have shared storage.....11:40
*** yingjun has joined #openstack-nova11:40
mdboothIt means operators can change storage config after deployment without breaking all their existing instances.11:40
rpodolyakaarslanq: anyway, this must have been fixed in the latest versions of libvirt/qemu11:40
mdboothIt means migrating between hosts with different storage becomes unambiguous.11:41
arslanqrpodolyaka: right now i am on openstack newton branch. Can i get some proper document of this issue? It will be very helpful for me.11:41
mdboothmnestratov: There are a bunch of advantages beyond just your use case.11:42
mdboothWhilst also fixing some edge cases where we currently have to skirt around security issues.11:42
mnestratovmdbooth: what would you say if we will not introduce a new config parameter but instead just change the behavior. Like if images_type is none or default then image backend is chosen according to image disk_format metadata and stored in instance' BDM11:43
mdboothmnestratov: The behaviour should be that if it's present in instance BDM, that should always be used. We should only consult a config/whatever if it's not present, and then we should use that to set it in the bdm.11:44
jaypipesmorning folks11:44
mdboothmnestratov: That gets around the issue of changing config/different config between hosts.11:45
mdboothjaypipes: morning11:45
jaypipesalex_xu, melwitt, dansmith, Vek: review bait: https://review.openstack.org/39967911:45
*** abalutoiu has quit IRC11:45
mnestratovmdbooth: it demands changing the way you boot your instances11:45
jaypipesmdbooth: hey, morning. so how's it going with the libvirt storage pools patch series? haven't looked at it in a month or so. Need to get back on that.11:46
arslanqrpodolyaka: i have the following libvirt version: libvirtd (libvirt) 2.0.011:46
mdboothjaypipes: I haven't done anything with it in that time, tbh.11:46
jaypipesmdbooth: you planning to? or other priorities getting in the way?11:46
mdboothjaypipes: I need to make a new start on it. It's still on my list, though.11:46
cdentI'm not coping well with jaypipes being 4 hours off instead of the usual 5. It's making me all confused and discombobulated.11:46
mdboothYeah, just other priorities :(11:46
jaypipesrpodolyaka: so, you finish the placement client plugin in OSC yet? :P11:47
jaypipescdent: :)11:47
*** claudiub has quit IRC11:47
* cdent considers taking PTO until the 26th11:47
*** amotoki has quit IRC11:48
*** ratailor has quit IRC11:53
*** yingjun has quit IRC11:53
*** abalutoiu has joined #openstack-nova11:53
*** karimb has quit IRC11:55
*** karimb has joined #openstack-nova11:56
*** gcb has joined #openstack-nova11:57
*** alexpilo_ has quit IRC11:59
mdboothlyarwood: Patch 1 done. I should hopefully pick up the pace a bit with growing context :)11:59
*** faizy has quit IRC11:59
*** dikonoor has joined #openstack-nova12:00
*** p01nt3r75 has joined #openstack-nova12:01
*** ociuhandu has joined #openstack-nova12:04
*** kevinz has joined #openstack-nova12:06
mnestratovmdbooth: one more concern about ignoring images_type parameter. If we implement multibackend support, then it would be hard to report free disk space to scheduler. Is there a way to report free space for all supported backends?12:07
*** smatzek has quit IRC12:08
*** kornicameister has quit IRC12:09
*** smatzek has joined #openstack-nova12:09
*** kaisers_ has joined #openstack-nova12:09
*** vks1 has quit IRC12:11
*** kevinz has quit IRC12:11
*** markvoelker has joined #openstack-nova12:11
*** tblakes has joined #openstack-nova12:12
*** kevinz has joined #openstack-nova12:12
*** gongysh has joined #openstack-nova12:12
mdboothmnestratov: Free space needs to be reported per backend anyway.12:13
*** kaisers_ has quit IRC12:14
openstackgerritStephen Finucane proposed openstack/nova-specs master: Fix formatting errors and warnings  https://review.openstack.org/40736412:14
openstackgerritStephen Finucane proposed openstack/nova-specs master: Treat doc build warnings as errors  https://review.openstack.org/43988312:14
openstackgerritStephen Finucane proposed openstack/nova-specs master: tox: Build docs with Python 2.7  https://review.openstack.org/44590612:14
sfinucanjohnthetubaguy: mriedem had. I've put them in a series now ^12:15
sfinucanbauzas: Easy +2s for your newfound spec powers above ^ :)12:15
*** markvoelker has quit IRC12:16
johnthetubaguysfinucan: sweet, I want to see jenkins +2 all that first12:17
johnthetubaguysfinucan: did that last patch miss a link it your commit message?12:17
arslanqrpodolyaka: I just tries this manually and i came to know that this happens only when i block migrate. "Live Migration failure: Operation not supported: qemu does not support drive-mirror command"12:18
openstackgerritStephen Finucane proposed openstack/nova-specs master: tox: Build docs with Python 2.7  https://review.openstack.org/44590612:18
sfinucanjohnthetubaguy: Oops. Fixed12:18
arslanqrpodolyaka: when i just use live migration it says that live migration is not possible without shared storage.12:19
*** alexpilotti has joined #openstack-nova12:20
mdboothI've stared at this long enough now that I assume I've just become blind to a typo or something. Could any who's got a second tell me what's causing the TypeError here: http://logs.openstack.org/42/445142/3/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/07e282a/logs/screen-n-api.txt.gz?level=ERROR12:21
mdboothThank you #openstack-nova for helping me spot that typo12:21
mdboothYou can ignore the above12:21
*** jaosorior_lunch is now known as jaosorior12:21
*** karimb has quit IRC12:24
mdboothAlso, mock-- for hiding an incorrect use of an interface12:24
johnthetubaguylyarwood: mdbooth: did you see the discussion over here: https://bugs.launchpad.net/nova/+bug/167262412:24
openstackLaunchpad bug 1672624 in OpenStack Compute (nova) "Ceph volumes attached to local deleted instance could not be correctly handled" [Undecided,New]12:24
*** alexpilotti has quit IRC12:24
mdboothjohnthetubaguy: I didn't. Can look after lunch, though.12:25
*** ayogi has quit IRC12:25
openstackgerritMatthew Booth proposed openstack/nova master: Make server_external_events use an optimal number of db queries  https://review.openstack.org/44514212:26
*** bkopilov has quit IRC12:27
*** R08209 has joined #openstack-nova12:28
mdboothjohnthetubaguy: Do we want to have api punt 'local_delete' to conductor and have it be a bit more thorough?12:28
mnestratovmdbooth: yeah I know, but IFAIK it's impossible now12:28
*** R08209 has quit IRC12:29
mdboothjohnthetubaguy: That's very similar to the evacuate use case where you want to cleanup a volume attachment when the compute host isn't available.12:29
mdboothbiab12:30
*** edmondsw has joined #openstack-nova12:34
*** artom has quit IRC12:34
*** karimb has joined #openstack-nova12:34
*** NightKhaos has quit IRC12:35
*** NightKhaos has joined #openstack-nova12:35
*** baoli has joined #openstack-nova12:36
*** edmondsw has quit IRC12:37
*** edmondsw has joined #openstack-nova12:37
*** markvoelker has joined #openstack-nova12:38
openstackgerritStephen Finucane proposed openstack/nova-specs master: Add extra-specs-image-meta-conflicts spec  https://review.openstack.org/38238212:38
*** baoli has quit IRC12:39
*** vladikr has quit IRC12:39
*** vladikr has joined #openstack-nova12:40
*** baoli has joined #openstack-nova12:40
lyarwoodjohnthetubaguy: just back from lunch, that isn't a bug for me, more of an operator failure tbh. ./me adds a note to the bug12:40
johnthetubaguylyarwood: hmm, curious what you mean by that12:41
*** moshele has joined #openstack-nova12:41
lyarwoodjohnthetubaguy: while the compute service is down the original instance / domain is still active and connected to the backing rbd volume12:42
lyarwoodjohnthetubaguy: so any attempt to remove the volume from the rbd pool is going to fail12:42
johnthetubaguylyarwood: ah, yes, it should do, good point12:42
johnthetubaguylyarwood: you have to wait for clean up on the compute node, which they haven't done12:43
*** karimb has quit IRC12:43
lyarwoodjohnthetubaguy: that or manually fence it12:43
lyarwoodjohnthetubaguy: get it into a known state12:43
*** baoli has quit IRC12:44
johnthetubaguylyarwood: yeah, we might need better tooling for that long term, post cinder API fix ups12:45
alex_xunova api meeting is 15 mins at openstack-meeting-412:45
johnthetubaguyalex_xu: yeah, I should get me some lunch quickly!12:45
*** karimb has joined #openstack-nova12:46
alex_xujohnthetubaguy: :)12:46
*** jaosorior has quit IRC12:46
alex_xujohnthetubaguy: maybe we can move the meeting early 15mins, then you can get a better lunch12:47
*** jaosorior has joined #openstack-nova12:47
johnthetubaguyalex_xu: nah, that just means I am hungry during the meeting12:48
alex_xu:)12:49
alex_xujohnthetubaguy: sdague experiment for removing stevedore https://review.openstack.org/#/c/445864/12:50
*** erhudy has joined #openstack-nova12:52
*** abalutoiu has quit IRC12:52
*** gouthamr has quit IRC12:54
*** efoley_ has joined #openstack-nova12:55
sdaguealex_xu: that looks really neat12:55
*** crushil has joined #openstack-nova12:55
*** faizy has joined #openstack-nova12:56
*** mriedem has joined #openstack-nova12:57
alex_xusdague: thanks, make me have more confidence12:57
sdaguealex_xu: and *so* much more clear12:57
*** efoley__ has quit IRC12:58
alex_xusdague: just follow the placement api pattern, explicitly list the routes12:59
*** catintheroof has joined #openstack-nova12:59
alex_xunova api meeting is running13:00
*** efoley__ has joined #openstack-nova13:01
*** slaweq__ has quit IRC13:01
*** links has quit IRC13:02
*** efoley__ has quit IRC13:02
*** efoley__ has joined #openstack-nova13:03
*** liverpooler has joined #openstack-nova13:03
*** efoley_ has quit IRC13:04
*** efoley__ has quit IRC13:04
*** efoley_ has joined #openstack-nova13:04
*** esberglu has joined #openstack-nova13:04
*** jed56 has joined #openstack-nova13:06
*** jed56 has quit IRC13:06
*** jed56 has joined #openstack-nova13:06
*** felipemonteiro has joined #openstack-nova13:07
*** eharney has joined #openstack-nova13:09
*** kaisers_ has joined #openstack-nova13:10
*** bvanhav_ has joined #openstack-nova13:11
*** mdrabe has joined #openstack-nova13:11
*** liangy has joined #openstack-nova13:11
*** bvanhav__ has quit IRC13:12
openstackgerritMikhail Feoktistov proposed openstack/nova master: Add is_vz_container function  https://review.openstack.org/44594713:12
*** annegentle has joined #openstack-nova13:12
*** baoli has joined #openstack-nova13:13
*** claudiub has joined #openstack-nova13:14
*** kaisers_ has quit IRC13:15
*** annegentle has quit IRC13:17
*** stvnoyes1 has joined #openstack-nova13:17
*** lucasxu has quit IRC13:18
*** abalutoiu has joined #openstack-nova13:18
*** kevinz has quit IRC13:21
*** gouthamr has joined #openstack-nova13:22
*** vks1 has joined #openstack-nova13:22
*** prateek__ has quit IRC13:22
*** tongli has joined #openstack-nova13:23
*** xyang1 has joined #openstack-nova13:23
*** psachin has quit IRC13:24
*** slaweq__ has joined #openstack-nova13:24
openstackgerritRafael Folco proposed openstack/nova master: DELETE all inventory for a resource provider  https://review.openstack.org/41666913:26
openstackgerritRafael Folco proposed openstack/nova master: [placement] Raising http codes on old microversion  https://review.openstack.org/44449713:26
rpodolyakajaypipes: heh, you'll be the first one to know, when the placement client plugin is done ;)13:28
dansmithgibi: can you look at this? https://review.openstack.org/#/c/445697/13:29
*** aysyd has joined #openstack-nova13:29
dansmithgibi: I found another case where we were lazy-loading that from an instance on compute and so I think we probably want to go a little more aggressive on it13:30
*** tbachman has quit IRC13:32
jaypipesrfolco: quick request on https://review.openstack.org/#/c/444497/. if you could handle that, I'll re-review quickly.13:32
jaypipesrfolco: besides that, I think we should be able to merge your two patches in that series today.13:33
rfolcojaypipes.requests --> priority -113:33
cdenti concur, dr pipes13:33
jaypipesrfolco: :)13:33
stvnoyes1i was writing a tempest test for swap disk (update volume attachment). The test runs ok on a running server, but I get a libvirt exception (Domain not found: no domain with matching uuid)  when run against a stopped server.  Is swap not supported on a stopped server? I didn't see anything in the doc about a restriction like that. thanks...13:34
*** amoralej is now known as amoralej|lunch13:34
*** smatzek has quit IRC13:35
*** gcb has quit IRC13:35
mdboothstvnoyes1: It is not supported, no.13:36
jaypipesstvnoyes1: when you say "you get a libvirt error", are you saying that that libvirt error is returned to you as a *user*, or that you see that error in the nova-compute log file?13:36
stvnoyes1in the log13:36
*** abalutoiu has quit IRC13:37
mdboothjohnthetubaguy: ^^^ Incidentally, what stvnoyes1 said is why I was talking about the 'did_copy' response in the swap_volume callback to cinder13:37
*** fandi has joined #openstack-nova13:37
*** abalutoiu has joined #openstack-nova13:38
johnthetubaguymdbooth: ack, makes sense, but we can't fix everything in one go13:38
mdboothjohnthetubaguy: Yep, but if we could stick it in the api then we can fix it later more easily.13:38
mriedemjaypipes: if you haven't seen yet, i had some questions in your ironic get_inventory patch13:38
mriedemonly thing i have left to review there is the RT functional test13:38
jaypipesmriedem: yup, thanks much for your review and questions. answering now.13:38
*** penick has quit IRC13:39
mriedemfwiw dansmith explained a bit of earlier conversations to me last night13:39
jaypipesmriedem: dansmith is good like that. :)13:40
*** satyar has joined #openstack-nova13:41
openstackgerritDan Smith proposed openstack/nova master: Avoid lazy-loading projects during flavor notification  https://review.openstack.org/44569713:43
*** gcb has joined #openstack-nova13:46
mriedemjohnthetubaguy: you were +2 on this before the cleanups https://review.openstack.org/#/c/429569/13:48
*** kylek3h has quit IRC13:49
mriedembauzas: unless you have a reason not to, i'm going to open a bug about the fact that we never delete request_specs when we delete an instance,13:50
mriedemi'm not sure if that's by design13:50
mriedemmaybe i'll start in the ML13:51
mriedemsince we wouldn't want to do this for soft delete13:51
*** rmart04 has joined #openstack-nova13:52
dansmithmriedem: we could also do with a bug to clean up all the conversion back and forth to/from the legacy version that never got cleaned up13:53
stvnoyes1jaypipes: i was interested to see what would happen doing a swap to a stopped vm with the cli. the cli command returned without an error.  The volume status of both vols were unchanged. And there was that Domain not found error in the logs.  I found a similar non-error using the API, the test only failed because the new volume never became 'in-use'.13:53
bauzasmriedem: I have a branch for that13:53
*** markvoelker_ has joined #openstack-nova13:54
bauzasmriedem: that's one of the things I have in my plate and never had time for that in Ocata13:54
mriedemdansmith: yeah bauzas has a blueprint for that from ocata,13:54
mriedemi don't remember seeing anything about actually deleting these things though13:54
bauzasmriedem: hence me planning to fix it by Pike13:54
mriedemi'll brain dump in the ML13:54
bauzasmriedem: https://review.openstack.org/#/c/391060/13:54
bauzasdansmith: ^13:54
mriedemah13:54
bauzasit requires a rebase13:55
jaypipesstvnoyes1: gotcha. would you expect instead to have an "unsupported operation on stopped server" error message return instead of no error?13:55
*** markvoelker has quit IRC13:55
mriedembauzas: left my concern inline, but that potentially cripples a restored soft deleted instance,13:56
bauzasmriedem: cool, thanks13:57
mriedemi'm not sure how we deal with that, since we don't want the compute doing a call back up to the API to delete the request spec when the instance is hard deleted13:57
bauzasmriedem: the problem is that we never agreed on soft-deleting the Spec with alaski13:57
dansmithhe means soft delete of the instance13:57
dansmith(right?)13:57
bauzasyeah13:57
bauzasI understand that13:57
dansmithnot soft delete of the instance db record13:57
bauzassure13:57
bauzasbut if we trigger the Spec hard deletion on an instance soft-delete13:58
*** smatzek has joined #openstack-nova13:58
stvnoyes1jaypipes: agree, it would be better to get some kind of error.  since a server can stop at any time, doing a check in the API code would help a lot but it wouldn't cover all the cases.13:58
*** awaugama has joined #openstack-nova13:58
bauzasthen, how could we restore it if we restore the instance ?13:58
dansmithyou don't restore it,13:58
dansmithyou have to defer deletion of it until the soft-deleted instance is purged somehow13:58
dansmithalthough that happens on the compute node13:58
*** udesale has joined #openstack-nova13:59
bauzasyeah, the trigger is then totally different13:59
bauzaswe could keep the spec record until the instance is hard-deleted13:59
bauzasbut I need to see where we trigger that13:59
dansmithright, so you have to just not delete it in that case, and either leak it (as we do now for everything) or at least delete if you hard-delete13:59
bauzasdansmith: you said we hard-delete on the compute side ?14:00
bauzasa periodic I guess ?14:00
*** alexpilotti has joined #openstack-nova14:00
dansmithcompute is what does the purge yeah, in a periodic14:00
mriedemdansmith: right14:00
mriedemwell, SOFT_DELETED in the API sense14:00
mriedemnot the DB sense14:00
bauzasokay, that would ease my branch :)14:00
bauzasIIRC, we already merged the .delete() method I added in Newton14:01
bauzasthe caller of that .delete() never merged in time in Newton14:01
mriedemwhich delete() method?14:01
bauzasthe Spec one14:01
*** zz_dimtruck is now known as dimtruck14:01
mriedemyes RequestSpec.destroy() exists,14:01
mriedembut nothing calls it14:01
bauzasexactly14:01
bauzasbecause I wrote the destroy()14:01
bauzasit was in the same series14:01
mriedemso i think we're left with leaking request specs for soft-deleted instances for now i guess14:01
bauzasyup14:02
bauzaslemme clarify14:02
bauzasin Newton, I discovered that (because I missed that when I reviewed alaski's persistence series)14:02
mriedemwe could provide a nova-manage command to purge those if you wanted...14:02
bauzasso I wrote a series14:02
bauzas.destroy() as a bottom patch14:02
bauzasthe bottom merged14:02
dansmithmriedem: we have InstanceMappings to purge in that case as well14:02
bauzasbut not the top one14:02
mriedemdansmith: nova-manage api_db purge_zombies14:03
bauzasand in Ocata, I had that in my plate, but the placement things diverted me14:03
bauzasso, we're now in Pike and it's still in my plate :)14:03
mriedemeat faster14:03
*** zhurong_ has joined #openstack-nova14:03
dansmithmriedem: aye14:03
bauzasmriedem: dansmith: I wrote a db online migrations that was creating the spec records for old instances, could we envisage some hack for purging ?14:04
bauzasie. we trigger deletes on the periodic task14:04
bauzasbut we could also write a db online migration script that would do that14:04
*** awaugama has quit IRC14:05
dansmithwe shouldn't abuse online migrations for periodic cleanup14:05
dansmithIMHO14:05
bauzasokay14:05
bauzasfine by me14:05
bauzasI'll revisit that change14:05
*** links has joined #openstack-nova14:05
bauzasif we have a periodic, do we still need a purge command ?14:06
bauzasdansmith: mriedem^14:06
dansmithwe can't have a periodic, IMHO14:06
*** zhurong_ has quit IRC14:06
dansmithhaving all the conductors purging all the time would be bad I think14:06
dansmithapis don't run periodics14:06
mriedemyeah that ^14:06
dansmithand the compute node can't do it14:06
mriedemcomputes can't talk to api14:06
*** tbachman has joined #openstack-nova14:07
mriedemso yeah, it's on-demand purge for now it sounds like14:07
mriedemthe scheduler has periodics...14:07
mriedemand this is related to scheduling stuff14:07
dansmithit's too heavy for scheduler, IMHO,14:07
*** baoli has quit IRC14:07
dansmithrequires hitting cell and api databases,14:07
mriedemtrue14:08
mriedemjust like discover_hosts :)14:08
dansmithand scheduler is supposed to be single-threaded14:08
dansmithyeah, but that is _actually_ scheduling-related and also getting to be nearly zero time :)14:09
dansmithand disabled by default and not required for normal operation14:09
bauzasokay I see14:09
bauzasdansmith: so you propose nova-manage api_db purge_zombies ? fine by me, lemme write it quickly14:09
dansmithand also, remember the suggestion of potentially making the scheduler just a pass-through library call14:09
bauzasyeah I see your point14:10
bauzasand we can't use compute periodic because of the upcall14:10
dansmithit'd be nice if we could just roll this into archive_rows or something14:10
*** baoli has joined #openstack-nova14:10
dansmitharchiving rows in the api db is just deleting them14:10
bauzasdansmith: well, it would require some change in .destroy() but nothing really hard :)14:10
mriedemwe wouldn't use reqspec.destroy() if it were in the archive method14:11
bauzasFWIW, unrelated I have a concern with https://review.openstack.org/#/c/439754/2314:11
bauzasdansmith: ^14:11
mriedemit'd be straight sql14:11
*** abalutoiu has quit IRC14:11
mriedemwell, orm14:11
bauzasmriedem: dansmith: well, do you think it could be turnable by opt ?14:11
*** kaisers_ has joined #openstack-nova14:12
bauzasor by command14:12
bauzaslike "purge --archive"14:12
*** bkopilov has joined #openstack-nova14:12
dansmithbauzas: I know that's a concern, but unless you have a suggestion going forward I don't see what the options are14:12
*** lucasxu has joined #openstack-nova14:12
dansmithbauzas: just make archive_deleted_rows do it.. no need to overthink it14:13
bauzasdansmith: sorry I could be confused14:14
*** irenab_ has joined #openstack-nova14:15
bauzasdansmith: you mean I should amend the archive_deleted_rows subcommand to delete the spec records ?14:16
dansmithyes14:16
bauzasokay14:16
*** kaisers_ has quit IRC14:16
bauzaslemme write that soon, ideally this week14:16
bauzasmriedem: you said you gonna write a bug report for this ?14:16
*** kylek3h has joined #openstack-nova14:17
*** awaugama has joined #openstack-nova14:17
dansmithbauzas: I'd really appreciate quick follow-up on the az thing with concrete suggestions14:17
bauzasdansmith: for https://review.openstack.org/#/c/439754/23/nova/api/metadata/base.py I don't think we need to change this if we consider looking up the host AZ, nope ?14:17
dansmithbauzas: you mean what was being done before?14:18
mriedembauzas: i'm working on something related to it14:18
bauzasdansmith: the logic in that method is that we use the instance.az field to match with the host AZ information14:18
bauzasdansmith: yeah, I don't see why we need to make it cellsv2-aware14:18
bauzasif we fix instance.az14:18
dansmithbauzas: because metadata runs in the cell and can't access the api database to look at az stuff14:18
bauzasorly?14:19
dansmithyarly!14:19
bauzasI thought it was on top14:20
*** kevinz has joined #openstack-nova14:20
dansmithbauzas: no, and definitely not if we're just using it to build configdrive14:20
bauzasI see14:20
bauzaslemme reconsider the problem then14:20
bauzasdansmith: what really blocks us is https://github.com/openstack/nova/blob/67af1eefc5c1cf8cde4b4becb933808850acec2d/nova/availability_zones.py#L19014:21
bauzasdansmith: but conceptually, we need to know where the instance is located, hence why we call the AggregateList object14:22
dansmithwhy are we doing that late instead of just making sure az gets set properly when the instance gets rescheduled or whatever?14:22
dansmithwe're taking this lookup hit every time we build metadata, but we should just make sure that we set the thing properly in the first place right?14:23
*** kevinz has quit IRC14:24
dansmithlike in schedule_and_build() and build_and_run(), we should be able to lookup and fix instance.az once so metadata never has to look again, right?14:25
dansmithsince we know the host it's going to land on each time14:25
*** dane-fichter has joined #openstack-nova14:26
bauzasdansmith: well, it's something I discussed in the past14:27
bauzasnow that we have RequestSpec, I'm in favor of updating instance.az to the right value14:27
*** abalutoiu has joined #openstack-nova14:27
bauzassemantically, we kept that unchanged in the past because we wanted to know what the user originally expressed14:27
bauzasbut now we have the Spec object that targets that14:27
dansmithif the user expressed something, then we would be limiting the scheduling to that az anyway, no?14:28
bauzasdansmith: yup, but we default that field for some unknown reason14:28
bauzaswe set it anyway14:28
dansmithto nova if it was unset, right?14:28
bauzaswell, I actually know14:28
bauzasyeah, if the user didn't ask for an AZ, we set it to a conf opt value14:29
*** amotoki has joined #openstack-nova14:29
bauzasif the user asked for an AZ, then I agree with your statement14:29
dansmithso metadata right now reports the actual az it landed on correct?14:29
dansmithit looks to me like we use instance.az in several other places14:30
bauzasdansmith: for the metadata, yes14:31
dansmithno, for other things too14:31
dansmithnova/network/neutronv2/api.py:        zone = 'compute:%s' % instance.availability_zone14:31
bauzasdansmith: for other places, AFAICT, I think we return that too14:31
dansmithnova/virt/block_device.py:    return instance.availability_zone14:31
dansmithis having instance.az being incorrect not affecting those places as well?14:32
bauzasyup14:32
dansmithlike, shouldn't making it be the actual az the instance is on be better?14:32
bauzasyeah, as I said, I agree, we should update instance.az to the right value14:32
*** vks1 has left #openstack-nova14:32
bauzasand use spec_obj.availability_zone for knowing the original request14:32
dansmithokay14:33
dansmithgrim14:33
dansmithoops14:33
dane-fichtermriedem: could you unblock this change, please? https://review.openstack.org/#/c/351232/14:33
jaypipesmriedem: so, is there anything on the ironic virt driver patch you'd like me to change?14:34
openstackgerritRafael Folco proposed openstack/nova master: DELETE all inventory for a resource provider  https://review.openstack.org/41666914:35
openstackgerritRafael Folco proposed openstack/nova master: [placement] Raising http codes on old microversion  https://review.openstack.org/44449714:35
mriedemdane-fichter: done, left a comment14:35
*** rmart04 has quit IRC14:35
mriedemjaypipes: let me check your replies14:35
*** efoley__ has joined #openstack-nova14:35
*** marst has quit IRC14:36
*** mlavalle has joined #openstack-nova14:36
*** karthiks is now known as karthiks_afk14:36
dansmithbauzas: do I really need elevated context here/ https://github.com/openstack/nova/blob/67af1eefc5c1cf8cde4b4becb933808850acec2d/nova/availability_zones.py#L19014:37
jaypipesmriedem: I can add a code comment about raising an exception if resource class is None in Queens, if you'd like.14:38
*** dave-mccowan has joined #openstack-nova14:38
mriedemjaypipes: let me look first, might be just follow up stuff14:38
mriedemdoing a few things at once14:38
*** fragatina has quit IRC14:39
*** efoley_ has quit IRC14:39
*** fragatina has joined #openstack-nova14:40
bauzasdansmith: I left a proposal in https://review.openstack.org/#/c/439754/23 by saying we could amend instance.az once we schedule a target14:40
bauzasevery time we touch instance.host actually14:40
dansmithbauzas: this is what I'm testing right now: http://pastebin.com/raw/iWBb9wt514:41
dansmithbauzas: for the old and new build operations14:41
*** NikhilS has quit IRC14:41
bauzasdansmith: for the elevated context, I think it's a legacy from the past14:41
dansmithbauzas: okay I thought so too just checking14:41
bauzasdansmith: now we use objects, we don't really need elevated14:41
*** dikonoor has quit IRC14:42
*** links has quit IRC14:42
*** marst has joined #openstack-nova14:42
*** hongbin has joined #openstack-nova14:43
bauzasdansmith: hmmpppfff, instance.host isn't set on the conductor after we schedule14:44
bauzasI thought it was the case but no14:45
bauzasdansmith: we just use that for calling the right compute service14:45
dansmithright, I'll change14:45
bauzasdansmith: AFAICS, instance.host is only set when the instance is spawning14:45
dansmithyeah, yeah14:45
bauzasyeah we unfortunately need to do that change at the same time or we would enter the magical world of race conditions14:45
bauzasbut but14:46
bauzaswait14:46
dansmithhuh?14:46
bauzasif we need to lookup the aggregate for knowing where the host is14:46
*** burt has quit IRC14:46
bauzasand that being in the compute section, it would be an upcall right?14:46
dansmithif we haven't build the instance yet, we can just set it14:47
dansmithwe know where we're intending for it to go, and if it reschedules, we change it again14:47
bauzasI'm not opposed to that, I'm just saying there is an amount of time where we could show a result where the instance is part of an AZ while it's not yet having an host14:48
dansmithyeah, so?14:48
dansmithalso, can we not use this? https://github.com/openstack/nova/blob/master/nova/objects/service.py#L141-L14114:48
dansmiththe host actually knows what AZ it's in right?14:49
*** irenab_ has quit IRC14:50
*** eharney_ has joined #openstack-nova14:50
*** eharney has quit IRC14:50
dansmithhmm, maybe that's different14:51
*** Guest47 has quit IRC14:51
bauzasmmm14:51
*** gongysh has quit IRC14:51
bauzasI just discover that14:51
bauzasoh wait14:52
bauzasyeah that's because the services are within AZs, not the compute nodes14:52
dansmithbut the api hides that az, so it must be different14:52
bauzasso, yeah, service.az should be accurate14:52
*** yassine has joined #openstack-nova14:52
*** yassine is now known as Guest1514314:53
dansmithwould it? I don't actually see where we're setting that on service14:53
bauzasdansmith: lemme rephrase, if binary is nova-compute, then it should be accurate14:53
*** Sukhdev_ has joined #openstack-nova14:55
*** yamahata has joined #openstack-nova14:55
bauzasFWIW, I'm digging that14:56
*** eharney__ has joined #openstack-nova14:57
*** eharney_ has quit IRC14:57
*** eharney__ is now known as eharney14:57
*** kevinz has joined #openstack-nova14:58
bauzasdansmith: so we update the service AZ in the AZ helper module https://github.com/openstack/nova/blob/master/nova/availability_zones.py#L8914:59
bauzaswhich is mostly called in two places15:00
bauzasone when you want to get the Service object15:00
bauzasand one in the nova manage command when you list all the hosts15:01
*** amoralej|lunch is now known as amoralej15:02
bauzasthe only problem that I see is that we don't persist the Service object which is populated when we call the above15:02
bauzasbut if you ServiceList.get_all(), you'll get the right value for the AZ15:03
mriedemjaypipes: replied to the replies, now reviewing the RT tests15:03
*** kevinz has quit IRC15:03
*** kevinz has joined #openstack-nova15:04
dansmithbauzas: that's exactly my point, we can't trust it on Service and we can't get it by get_all() from inside the cell15:06
dansmithbauzas: because it will call out to aggregates15:06
*** READ10 has joined #openstack-nova15:06
*** yingjun has joined #openstack-nova15:08
*** dane-fichter has quit IRC15:08
*** Sukhdev_ has quit IRC15:10
*** Sukhdev_ has joined #openstack-nova15:11
*** nic has joined #openstack-nova15:12
bauzasdansmith: yeah, yet another upcall :(15:12
*** kevinz has quit IRC15:12
dansmithbauzas: it seems to me that this is already partially broken and just making instance.az be correct is the solution15:13
openstackgerritLee Yarwood proposed openstack/nova master: libvirt: guest.BlockDevice should only use the target device of a disk  https://review.openstack.org/40216315:13
*** tongli has quit IRC15:13
*** kevinz has joined #openstack-nova15:13
cfriesenquestion...how is the "task_log" table intended to be pruned?  Is this intended to be managed by the cloud operator?15:15
*** Sukhdev_ has quit IRC15:15
*** lucasxu has quit IRC15:16
*** efried has quit IRC15:17
bauzasdansmith: well, it would certainly require more than what I originally thought15:17
*** ekuris has quit IRC15:17
bauzasdansmith: one way could be to set instance.host in the conductor15:18
dansmithbauzas: right that's what I'm doing15:18
bauzasnot by the compute15:18
dansmithno, not host15:18
dansmithinstance.az15:18
dansmithwe don't need to set host in conductor,15:18
dansmithand that breaks all kinds of stuff15:18
*** sridharg has quit IRC15:19
bauzasdansmith: well, it could work given https://github.com/openstack/nova/blob/master/nova/availability_zones.py#L163-L16915:21
cfriesenanother database question....how is stale information in the API DB supposed to be cleaned up to prevent indefinite DB growth?15:21
dansmithbauzas: I'm not sure what that has to do with it, but setting instance.host in conductor breaks everything (else) so not an option15:22
bauzascfriesen: we just discussed that, and we're trying to identify all stale contents15:22
bauzasdansmith: yeah, lemme rephrase15:22
*** nic has quit IRC15:23
bauzasdansmith: I'm considering the time between when we set instance.az after a schedule, and when we set instance.host as a temporary situation where we return something on the API that could be different15:23
bauzasdansmith: because we only return the "real" AZ where the host is only only when the compute is setting instance.host15:24
*** Jinxing has joined #openstack-nova15:24
bauzasbefore that, we return the original instance.az15:24
bauzasanywaty15:25
bauzaslet's not overthink that15:25
bauzasdo your change and I'll weight it15:25
dansmithit's not wrong in that cast anyway15:25
dansmith*case15:25
dansmithyeah15:25
*** hshiina has quit IRC15:25
*** tpatzig_ has joined #openstack-nova15:26
*** seife_ has joined #openstack-nova15:26
*** dgonzalez_ has joined #openstack-nova15:26
*** david_1 has joined #openstack-nova15:26
*** kevinz has quit IRC15:27
*** tpatzig_ has quit IRC15:27
*** dgonzalez_ has quit IRC15:27
*** seife_ has quit IRC15:27
*** david_1 has quit IRC15:28
dansmithgdi, we have too many tests15:28
*** voelzmo has joined #openstack-nova15:29
*** xyang1 has quit IRC15:29
*** xyang1 has joined #openstack-nova15:29
*** crushil has quit IRC15:30
*** penick has joined #openstack-nova15:31
openstackgerritMikhail Feoktistov proposed openstack/nova master: Add is_vz_container function  https://review.openstack.org/44594715:33
*** amotoki has quit IRC15:33
mriedemjaypipes: jroll: JayF: cdent: edleafe: ok, final comments are in https://review.openstack.org/#/c/441544/15:34
mriedemi'm -1 for several issues in test_resource_tracker15:34
*** moshele has quit IRC15:34
*** fragatina has quit IRC15:35
*** oomichi has quit IRC15:36
*** bvanhav__ has joined #openstack-nova15:37
jrollmriedem: cool, ty15:37
*** armax has joined #openstack-nova15:37
*** unicell has joined #openstack-nova15:37
*** bvanhav_ has quit IRC15:38
*** Jeffrey4l has quit IRC15:38
*** vladikr has quit IRC15:38
*** Jeffrey4l has joined #openstack-nova15:39
*** pabardina has quit IRC15:40
cdentmriedem: since you're in a reviewing state of mind, getting these from edleafe would clear up some lose ends: https://review.openstack.org/#/c/428800/ https://review.openstack.org/#/c/416752/  https://review.openstack.org/#/c/416751/ (related to inventory handling)15:40
*** pabardina has joined #openstack-nova15:41
*** vladikr has joined #openstack-nova15:41
*** sandanar has joined #openstack-nova15:41
*** oomichi has joined #openstack-nova15:41
*** vladikr has quit IRC15:41
*** patriciadomin has quit IRC15:42
mriedemgonna have to queue up15:42
*** vladikr has joined #openstack-nova15:42
*** esberglu has left #openstack-nova15:42
*** esberglu has joined #openstack-nova15:43
* cdent looks to a johnthetubaguy for a use-of-the-word-queue check15:43
*** patriciadomin has joined #openstack-nova15:43
johnthetubaguyheh, you should ask my wife, she is really picky about queues15:43
cdentmy recollection is that the use of "up" there is incorrect and would require a forfeit of some kind. Either running around the quad naked or having to get the next two rounds in, depending on your class.15:45
*** penick has quit IRC15:46
dansmithbauzas: https://github.com/openstack/nova/blob/master/nova/conductor/tasks/migrate.py#L49-L5515:46
dansmithbauzas: that ignores the stored az I think :)15:46
bauzasFWIW, using "queue" in French has a terrible meaning15:46
*** nic has joined #openstack-nova15:47
bauzasdansmith: yet another reason to fix that then15:47
*** patriciadomin has quit IRC15:47
dansmithyeah15:47
*** Jinxing has quit IRC15:47
*** patriciadomin has joined #openstack-nova15:47
bauzasthose AZ issues are so fun15:47
bauzasdansmith: FWIW, the only nova thing which cares about AZs is just the AZ filter15:48
mdboothlyarwood johnthetubaguy: re https://bugs.launchpad.net/nova/+bug/1672624 if this were BZ I'd close it NOTABUG.15:48
openstackLaunchpad bug 1672624 in OpenStack Compute (nova) "Ceph volumes attached to local deleted instance could not be correctly handled" [Undecided,New]15:48
bauzasif you don't use it, that's just a nice but useless metadata15:48
*** litao has quit IRC15:49
*** arslanq has quit IRC15:49
mdboothBut not because it's the operator's fault, just because it's an ephemeral fault outside Nova's control which will eventually resolve itself automatically.15:49
bauzasdansmith: oh wait15:50
bauzasdansmith: we need to keep the original AZ15:50
bauzasfor the Spec object15:50
*** nic has quit IRC15:50
bauzasdansmith: ie. not having the Spec.az mentioning the "real" AZ15:50
*** nic has joined #openstack-nova15:51
*** lucasxu has joined #openstack-nova15:51
dansmithI'm not changing that15:51
bauzasdansmith: but if you boot an instance, it will change instance.az15:51
dansmithand when you finish the cleanup of the spec object usage, you'll get the original az at that point15:51
bauzasyeah, we need to lookup the spec15:52
bauzasnot hydrating from the instance15:52
dansmithbauzas: which is the cleanup step, no?15:52
dansmiththe TODO(bauzas)15:52
bauzasyup15:53
*** nkrinner is now known as nkrinner_afk15:53
*** alexpilotti has quit IRC15:56
*** david-lyle has joined #openstack-nova15:56
*** ssurana has joined #openstack-nova15:57
*** fandi has quit IRC15:57
*** Sukhdev_ has joined #openstack-nova15:58
*** arslanq has joined #openstack-nova15:58
*** yingjun has quit IRC16:00
*** artom has joined #openstack-nova16:00
*** vsaienk0 has quit IRC16:02
*** jaosorior has quit IRC16:02
*** vladikr has quit IRC16:02
*** hongbin has quit IRC16:05
openstackgerritStephen Finucane proposed openstack/nova master: trivial: Remove \r\n line endings from JSON sample  https://review.openstack.org/44604016:06
openstackgerritStephen Finucane proposed openstack/nova master: Duplicate JSON line ending check to pep8  https://review.openstack.org/44604116:06
cdentrfolco: I don't think I'm understanding your question on the DELETE stuff: "Question: Do you think we need a test for 404 and another one for nop (where microversion matches) ?"16:07
sfinucanCould I get someone to look at the above ^ Not possible to build docs locally while things remain this way16:09
*** voelzmo has quit IRC16:09
*** raunak has joined #openstack-nova16:10
dansmithbauzas: explain to me why it makes sense to boot an instance into az foo, land it in az bar, and then resize to foo?16:11
bauzasit's not possible if you specified a AZ16:12
bauzasdansmith: ^16:12
dansmithbauzas: so the reason to preserve the original request is to know if they didn't request one?16:12
bauzasdansmith: the only case where you can be in foo and then bar is when you did *not* specify an AZ16:12
dansmithright, so, I'm thinking..16:12
*** udesale has quit IRC16:12
dansmithif I don't ask, I land in bar,16:12
dansmiththen I look in metadata, see bar, and boot one in foo to make sure I'm different,16:13
*** kaisers_ has joined #openstack-nova16:13
dansmithmaking the first one resize and leave bar would be kinda bad no?16:13
rfolcocdent, I actually was referring to 444497, if we needed to handle all possible/existing status_codes there. So, for this one you mean 409 test on gabbi ?16:13
cdentyeah, inventory.yaml needs a test of the 409 cases when trying to delete inventories16:13
rfolcocdent, gotcha, sorry for mixing things.16:14
cdentno problem, the process is working.16:14
*** karimb has quit IRC16:15
bauzasdansmith: that's why when you nova show the instance, you're getting the original expressed AZ16:15
dansmithbauzas: show from where, the rest api?16:15
bauzasyeah16:15
dansmithbauzas: okay but metadata will disagree16:16
bauzasI wrote a stupid disclaimer explaining how I think AZs are currently broken in Nova https://docs.openstack.org/developer/nova/aggregates.html#availability-zones-azs16:17
*** kaisers_ has quit IRC16:17
dansmithwell, anyway, my point is, if we honor what the instance is currently in, or what was(n't) requested, I think we're fine16:17
bauzaslemme consider that16:18
dansmithI think if I didn't specify anything, then the cloud deciding to keep it in the same az is fine16:18
bauzasas I said, the real nova thing which cares about AZs is the AZfilter16:18
bauzasso, lemme look at the filter code16:18
dansmithright, but presumably it is looking at what is in the reqspec,16:18
dansmithwhich right now comes from instance.az16:18
bauzashttps://github.com/openstack/nova/blob/master/nova/scheduler/filters/availability_zone_filter.py#L4716:18
bauzasforget the specific line16:19
bauzasit takes what's in the spec16:19
dansmithright16:19
bauzasand compares with if the host is in an aggregate16:19
bauzasif not, it defaults to the conf opt16:19
bauzasso16:20
bauzasthere are two things16:20
*** vsaienk0 has joined #openstack-nova16:20
bauzaswhich can make you stuck within a specific AZ16:20
bauzas1/ you specified an AZ in the boot command16:20
*** dtp has joined #openstack-nova16:20
bauzasin that case, we don't care whether instance.az is correct or not16:20
*** andreas_s has quit IRC16:20
bauzasbecause anyway, there is no way to get out of that AZ16:21
bauzasso, I think it's harmless16:21
*** vladikr has joined #openstack-nova16:21
bauzasnow, I'm considering the other option16:21
openstackgerritDan Smith proposed openstack/nova master: Get instance availability_zone without hitting the api db  https://review.openstack.org/43975416:21
openstackgerritDan Smith proposed openstack/nova master: Make conductor ask scheduler to limit migrates to same cell  https://review.openstack.org/43802516:21
openstackgerritDan Smith proposed openstack/nova master: Set instance.availability_zone whenever we schedule  https://review.openstack.org/44605316:21
dansmithbauzas: ^16:21
bauzas2/ you did not specify an AZ but the operator modified default_schedule_zone16:21
bauzasin that case, you're stuck within an AZ16:22
mdboothdansmith: In functional, _do_post seems to create an instance which has an instance mapping with cell_mapping=None. What does that mean?16:22
dansmithbauzas: sure but the default is to schedule into that az anyway right?16:22
bauzasyeah16:22
*** sree has quit IRC16:22
* bauzas trying to sort that out in his mind16:22
*** vladikr has quit IRC16:23
dansmithmdbooth: it means the instance is unscheduled16:23
*** vladikr has joined #openstack-nova16:23
*** sree has joined #openstack-nova16:23
mdboothSo it's not in cell016:23
mdboothIt's just not in any cell at all16:23
mdbooth?16:23
dansmithbeing in cell0 means you were scheduled there16:24
mdboothRight, I thought so16:24
dansmithbeing unscheduled means there is no instance record at all16:24
*** unicell has quit IRC16:27
*** sree has quit IRC16:27
*** clayton has quit IRC16:28
*** crushil has joined #openstack-nova16:29
bauzasdansmith: okay, I'm trying to keep things as simple as I can16:29
bauzasdansmith: I think we're good having instance.az being set in the conductor16:30
bauzasdansmith: but the problem is that we populate the Spec in the migrate method before calling the scheduler16:30
dansmithbauzas: didn't we _just_ discuss why that's okay?16:31
dansmithand the path to get out of that is you finishing your cleanup, if there's some reason for it16:31
mriedemsfinucan: +W on the bottom one, i hit that yesterday16:31
mriedemthanks16:31
bauzasdansmith: well, it would mean that an instance having no AZ would be kept within that AZ16:32
dansmithbauzas: which is by definition the default az anyway16:32
sfinucanmriedem: (y)16:32
bauzasdansmith: well, not exactly16:32
bauzasdansmith: if I have a cloud with 999 nodes not in aggregates and one in one aggregate with metadata AZ foo16:32
*** clayton has joined #openstack-nova16:33
bauzasdansmith: then there are chances that instances can be booted on the single host part of foo16:33
bauzasdansmith: which is okaty16:33
*** mdrabe has quit IRC16:33
bauzasdansmith: but then, a migrate would be only providing this host, compared to previously where it could return other hosts16:34
*** david-lyle_ has joined #openstack-nova16:34
*** david-lyle has quit IRC16:34
*** fragatina has joined #openstack-nova16:34
dansmithbauzas: yeah, but.. again, the fix for that is finishing the reqspec cleanup right?16:34
bauzasyup16:34
*** faizy has quit IRC16:35
bauzasI see your point16:35
* bauzas rolling his sleeves16:35
*** alexpilotti has joined #openstack-nova16:35
dansmithI don't think this is overly harmful if you're going to clean that bit up before the end of pike16:36
*** sandanar has quit IRC16:36
*** annegentle has joined #openstack-nova16:37
*** eharney has quit IRC16:37
*** sandanar has joined #openstack-nova16:37
*** vladikr has quit IRC16:38
bauzasdansmith: anyway, just reviewed your new change, you're updating instance.az after we regenerate the Spec, so it's all good16:39
*** alexpilotti has quit IRC16:39
dansmithbauzas: no because we updated it on boot to the host we got to16:39
dansmithbauzas: so resize will see that az16:39
bauzascorrect16:39
bauzasnevermind the previous comment16:39
dansmithbauzas: for this: https://review.openstack.org/#/c/442163/14/nova/availability_zones.py16:40
bauzasyup ?16:40
dansmithbauzas: I think I just want to make sure that the az thing calls the hostapi for listing services,16:40
dansmithand then make sure I cover that method to ensure it iterates cells, okay?16:40
bauzasyeah, like I said, I'm not opposed to merging this16:40
bauzasI was just thinking of our test very not aware of cells16:41
bauzaswhich could be a problem in the future given it's a DB-backed test case16:41
*** Apoorva has joined #openstack-nova16:41
dansmithI don't think it really needs to be, as long as it's getting the right service list,16:41
dansmithbut converting it is going to be somework16:42
bauzasyeah16:42
bauzasI'm turning my vote to +216:42
bauzasI'm just reviewing the conductor change16:42
dansmitha functional test might be easier for that anyway, since they already have multiple cells16:42
*** mdrabe has joined #openstack-nova16:43
*** kaisers_ has joined #openstack-nova16:43
*** fragatin_ has joined #openstack-nova16:44
*** yamahata has quit IRC16:45
*** lpetrut has quit IRC16:45
*** bmace has joined #openstack-nova16:47
*** fragatina has quit IRC16:47
*** lucasxu has quit IRC16:47
*** lucasxu has joined #openstack-nova16:48
*** Sukhdev_ has quit IRC16:48
*** gyee has joined #openstack-nova16:50
bauzasdansmith: I agree, most of the AZ unittests could be done in the functional tree even16:50
mriedemdansmith: are we doing a cells pow wow in 10 min?16:50
mriedemi hope so because 3 days in working from home and i'm starting to get lonely16:51
dansmithmriedem: oh yeah16:52
bauzasmriedem: dansmith: I won't be able to attend it16:52
dansmithmriedem: man, you're going to have a hard road ahead then :)16:52
dansmithbauzas: ack16:52
* bauzas needs to find a new nanny for his kid16:52
*** tesseract has quit IRC16:53
*** baoli has quit IRC16:56
dansmithbauzas: hmm, the notification sample test is failing because I end up with None for my az instead of 'nova'16:56
*** baoli has joined #openstack-nova16:56
dansmithso I guess I need to replicate that "or the default" logic in there somehwere16:57
*** baoli has quit IRC16:58
dansmither, actually it should be in there already16:58
dansmithguh this is ugly16:59
openstackgerritStephen Finucane proposed openstack/nova-specs master: Fix formatting errors and warnings  https://review.openstack.org/40736417:00
openstackgerritStephen Finucane proposed openstack/nova-specs master: tox: Build docs with Python 2.7  https://review.openstack.org/44590617:00
openstackgerritStephen Finucane proposed openstack/nova-specs master: Treat doc build warnings as errors  https://review.openstack.org/43988317:00
openstackgerritStephen Finucane proposed openstack/nova-specs master: Add .keep files  https://review.openstack.org/44606917:00
openstackgerritMatt Riedemann proposed openstack/nova master: Introduce fast8 tox target  https://review.openstack.org/44607017:02
*** vladikr has joined #openstack-nova17:02
mriedemmelwitt: just for you ^17:02
mriedem(and me)17:02
*** p01nt3r75 has quit IRC17:03
*** raunak has quit IRC17:03
openstackgerritKaitlin Farr proposed openstack/nova master: Parse algorithm from cipher for ephemeral disk encryption  https://review.openstack.org/44607217:04
*** satyar has quit IRC17:04
*** raunak has joined #openstack-nova17:04
melwittmriedem: <317:05
*** unicell has joined #openstack-nova17:05
*** unicell has quit IRC17:05
*** satyar has joined #openstack-nova17:05
melwittfast8, sounds like another fast and the furious movie17:05
mdboothmriedem: -- -HEAD is hardwired into my fingers now17:06
* mdbooth has trouble not typing it when running pep817:06
*** satyar has quit IRC17:06
*** baoli has joined #openstack-nova17:06
mriedemmdbooth: i used to forget it, but yeah i have it like that too now17:07
mriedembut some people didn't even know it existed17:07
mriedemhence this17:07
* mdbooth would definitely use fast8 *a lot*17:07
mriedemmelwitt: let's call it tox -e niccage then17:07
mriedemoh wait, wrong movie17:07
mdboothjason staitham?17:07
melwittyou're probably thinking of xander cage17:08
mdboothhowever you spell that17:08
* mdbooth assumes this is a F&F reference, but he never really got into that series17:08
*** xinliang has quit IRC17:08
sfinucanmdbooth is missing out17:09
sfinucan...and it's a xXx reference (also awesome)17:09
jrolltox -e ludacris, duh17:09
kashyapmdbooth: JSON statham17:09
mdboothkashyap: hehe17:09
jrollboth for the actor in F&F and because ludicrous speed17:09
mdboothsfinucan: Do you like the Transformers movies?17:09
sfinucanmdbooth: Nope. All them robots fighting sounds too much like nightclub music17:10
sfinucan#dubstep4lyf17:10
melwittsame. I like F&F and xXx but not transformers17:10
mdboothsfinucan: Ok, we may have some movie taste in common :)17:10
mdboothPerhaps I'll try it.17:10
openstackgerritMatthew Booth proposed openstack/nova master: Add InstanceMappingList.get_by_instance_uuids  https://review.openstack.org/44513917:11
openstackgerritMatthew Booth proposed openstack/nova master: Make server_external_events use an optimal number of db queries  https://review.openstack.org/44514217:11
openstackgerritMatthew Booth proposed openstack/nova master: Add RequestContext.for_cell()  https://review.openstack.org/44514017:11
openstackgerritMatthew Booth proposed openstack/nova master: Add InstanceList.get_by_instance_mapping_list()  https://review.openstack.org/44514117:11
sfinucanmdbooth: It's all Vin Diesel. He's just ridiculously likeable/charismatic17:11
mdboothThe Groot guy?17:11
* mdbooth has probably seen him in something else17:11
sfinucanThe one and only17:12
*** lucasxu has quit IRC17:12
*** lucasxu has joined #openstack-nova17:13
*** rtheis has joined #openstack-nova17:13
* mriedem goes to make a sandwich and talk to the cat17:14
*** rtheis has quit IRC17:16
*** erlon has joined #openstack-nova17:19
lyarwoodmdbooth: are you reviewing the rest of the bdm db and object change series btw? The UUID changes aren't that important overall, the attachment_id changes are the real priority17:20
*** Swami has joined #openstack-nova17:20
mdboothlyarwood: Yes. However I got distracted by a 5 minute job which took rather longer.17:20
openstackgerritDan Smith proposed openstack/nova master: Get instance availability_zone without hitting the api db  https://review.openstack.org/43975417:20
openstackgerritDan Smith proposed openstack/nova master: Set instance.availability_zone whenever we schedule  https://review.openstack.org/44605317:20
openstackgerritDan Smith proposed openstack/nova master: Make conductor ask scheduler to limit migrates to same cell  https://review.openstack.org/43802517:20
lyarwoodmdbooth: np, just got back in from a walk myself17:21
rfolcocdent, I got stuck on 409 conflict test case for delete all inventory. a fake generation number maybe ?17:21
*** xinliang has joined #openstack-nova17:21
*** xinliang has joined #openstack-nova17:21
*** alexpilotti has joined #openstack-nova17:22
*** browne has joined #openstack-nova17:22
*** yamahata has joined #openstack-nova17:24
*** satyar has joined #openstack-nova17:27
*** pcaruana has quit IRC17:28
*** bvanhav__ is now known as bvanhav17:28
openstackgerritStephen Finucane proposed openstack/nova-specs master: Re-add templates  https://review.openstack.org/44606917:28
openstackgerritStephen Finucane proposed openstack/nova-specs master: Fix formatting errors and warnings  https://review.openstack.org/40736417:28
openstackgerritStephen Finucane proposed openstack/nova-specs master: tox: Build docs with Python 2.7  https://review.openstack.org/44590617:28
openstackgerritStephen Finucane proposed openstack/nova-specs master: Treat doc build warnings as errors  https://review.openstack.org/43988317:28
*** unicell has joined #openstack-nova17:28
*** unicell has quit IRC17:29
cdentrfolco: there are two different cases: one where the generation is wrong (so a fake one would work), one where some of the inventory is in use (make some inventory, make an allocation against that inventory, try to do the DELETE). make sense?17:29
*** iceyao has quit IRC17:30
rfolcocdent, hmm, will try to find the allocation example. thx17:31
*** ltomasbo is now known as ltomasbo|away17:32
cdentrfolco: there are some examples in allocation.yaml and with-allocations.yaml17:32
*** bvanhav_ has joined #openstack-nova17:32
cdentrfolco: in fact you could probably add a DELETE .../inventories in the with-allocations.yaml file and the existing allocations will provide the data for you17:33
*** unicell has joined #openstack-nova17:33
*** bvanhav has quit IRC17:33
rfolcocdent, stop, you're almost writing the test for me :)17:34
cdent:)17:34
*** Sukhdev_ has joined #openstack-nova17:34
mdboothlyarwood: Given that I'm conflicted myself on bdm.uuid naming issue, I'm going to drop that to bikeshed status and leave it up to you.17:35
mdboothEither way it's weird.17:36
*** moshele has joined #openstack-nova17:37
lyarwoodmdbooth: yeah agreed that it's weird, I assume it's a hangover from copying BDMs the ec2 api17:37
lyarwoodfrom the ec2 api even17:38
*** szaher has joined #openstack-nova17:39
*** jed56 has quit IRC17:40
mdboothlyarwood: We're absolutely never going to have more than 1 BDM with the same attachment_id, right? Just confirming that makes absolutely no sense.17:42
lyarwoodmdbooth: right, it's unique to along with the instance_uuid and volume_id iirc, pretty sure the spec calls that out /me checks17:44
mdboothlyarwood: I can't think how it would make sense.17:44
lyarwoodmdbooth: to have >1 bdms with the same attachment_id?17:45
*** rebase has joined #openstack-nova17:45
mdboothlyarwood: Yes17:45
openstackgerritDan Smith proposed openstack/nova master: Get instance availability_zone without hitting the api db  https://review.openstack.org/43975417:45
openstackgerritDan Smith proposed openstack/nova master: Set instance.availability_zone whenever we schedule  https://review.openstack.org/44605317:45
openstackgerritDan Smith proposed openstack/nova master: Make conductor ask scheduler to limit migrates to same cell  https://review.openstack.org/43802517:45
lyarwoodmdbooth: yeah, I can't think of a use case17:46
rebase/que/close17:46
*** rebase has left #openstack-nova17:46
*** derekh has quit IRC17:47
lyarwoodmdbooth: from the spec '* Volume attachment is specific to a host uuid, instance uuid, and volume uuid'17:47
mdboothlyarwood: Cool, so dup attachment_id would definitely be a bug17:48
* mdbooth is asking for a unique constraint on it17:48
lyarwoodmdbooth: yeah mriedem suggested that already but as its nullable some backends might not allow it iirc17:49
lyarwoodmdbooth: but ask away and I can take another look17:49
mdboothlyarwood: ah, good point17:49
mriedemmysql is fine with it a unique constraint over a nullable column17:49
*** lpetrut has joined #openstack-nova17:50
mdboothmriedem: Does it allow more than 1 null?17:50
mriedemi think postgres is too, but i think both can be configured to be more strict17:50
mriedemmdbooth: not sure about that, i'd hope not17:50
mdboothIn that case it wouldn't work here, which is unfortunate17:50
mriedemto be clear, i was thinking of db2 when i said the constraint thing, because of muscle memory, but i know we don't support or care about db217:50
* mdbooth would just generally like to see more constraints in our db schema17:51
*** efried has joined #openstack-nova17:51
mdboothThey make debugging easier17:51
mdboothlyarwood: Incidentally, on the bdm.uuid thing, couldn't we mass populate that with an online migration?17:52
*** unicell has quit IRC17:53
mdboothlyarwood: Same for attachment_id now that I think of it, if cinder gives us an api to create an attachment for a legacy-attached volume.17:55
*** armax has quit IRC17:55
* mdbooth doesn't even know if that's possible, though17:55
lyarwoodmdbooth: I think that did come up for attachment_id but I don't think there's anything for us to call atm17:56
lyarwoodmdbooth: I can't find it at the moment but I'm sure there's also a comment against doing this for uuids btw17:57
* lyarwood will look again after dinner brb17:57
*** smatzek_ has joined #openstack-nova18:00
*** smatzek has quit IRC18:00
*** stvnoyes1 has quit IRC18:00
mriedemjohnthetubaguy: i've reviewed the policy doc spec https://review.openstack.org/#/c/433010/18:02
*** burt has joined #openstack-nova18:02
mriedemjohnthetubaguy: some niggles inline18:02
*** liangy has quit IRC18:03
mriedemsee what i did there, with your word?18:03
johnthetubaguymriedem: looking18:03
johnthetubaguymriedem: I totally did :)18:03
openstackgerritDan Smith proposed openstack/nova master: Get instance availability_zone without hitting the api db  https://review.openstack.org/43975418:03
openstackgerritDan Smith proposed openstack/nova master: Make os-availability-zones know about cells  https://review.openstack.org/44216318:03
openstackgerritDan Smith proposed openstack/nova master: Set instance.availability_zone whenever we schedule  https://review.openstack.org/44605318:03
openstackgerritDan Smith proposed openstack/nova master: Make conductor ask scheduler to limit migrates to same cell  https://review.openstack.org/43802518:03
*** stvnoyes has joined #openstack-nova18:04
*** efoley_ has joined #openstack-nova18:04
*** marst has quit IRC18:05
*** marst has joined #openstack-nova18:05
*** lpetrut has quit IRC18:06
*** Sukhdev_ has quit IRC18:07
*** efoley__ has quit IRC18:08
mdboothlyarwood: Next 3 are the meaty ones. I'll start them in the morning.18:09
*** baoli has quit IRC18:09
*** efoley_ has quit IRC18:09
*** baoli has joined #openstack-nova18:10
*** lucasxu has quit IRC18:13
mriedemcdent: edleafe: has anyone brought up the microversion question in https://review.openstack.org/#/c/433010/ yet?18:14
mriedemor is that restriction already in place in the object code somewhere?18:14
*** baoli has quit IRC18:14
* edleafe reads up on that spec18:15
mriedemsorry wrong link18:15
cdentsorry, mriedem, I'm not sure I've got enough context18:15
mriedemhttps://review.openstack.org/#/c/416752/18:15
cdentoh that one18:15
mriedemnormally changing the request schema validation is a microversion bump18:15
mriedemdoes the object code already enforce this?18:15
*** sandanar has quit IRC18:16
cdentmriedem: this is a case of: if you did it wrong then there would be big failures (of the things won't work at all variety)18:16
cdentso this fix is akin to going from 500 to "actually working"18:16
*** lucasxu has joined #openstack-nova18:16
cdentit just so happens that existing client code doesn't tickle these problems18:16
edleafeyeah, I was thinking it's more like a bug fix rather than a straight behavior change18:17
mriedemi'm legally obligated to ask about microversions you know18:18
mriedemcertified by the great state of minnesota18:18
cdentmriedem: everyone appreciates your assiduousness18:18
*** gyee has quit IRC18:18
edleafeeven non-Minnesotans18:19
* cdent got a nice warm hat in minnesota, once upon a time18:19
*** baoli has joined #openstack-nova18:22
mriedemnext question: do we plan on backporting this fix to ocata?18:22
*** hshiina has joined #openstack-nova18:22
cdentmriedem: I'd say it is a nice to have, probably even a good to have, but not a must have?18:23
cdentwithout these changes it is possible for a careless admin to cause trouble18:23
cdentbut they have try hard18:24
mriedemif we want to backport we should tie these to a bug18:24
*** lpetrut has joined #openstack-nova18:24
*** moshele has quit IRC18:25
cdentweird, I thought it already was, but apparently not18:25
cdentedleafe: I'll make a bug and you can update?18:25
*** krtaylor has quit IRC18:26
edleafecdent: sure thing18:26
*** smatzek_ has quit IRC18:27
*** unicell has joined #openstack-nova18:27
*** gszasz has quit IRC18:27
*** marst has quit IRC18:28
openstackgerritJohn Garbutt proposed openstack/nova-specs master: Add policy-docs spec  https://review.openstack.org/43301018:29
*** armax has joined #openstack-nova18:30
*** READ10 has quit IRC18:30
mriedemcdent: edleafe: i'm also not sure about the default changes in here https://review.openstack.org/#/c/428800/18:30
mriedemthat gets a bit weird with ironic custom resource classes that claim 1 for everything18:30
mriedemhas jaypipes taken a look at that?18:30
johnthetubaguymriedem: added a note about the new oslo thing, and a hacking check to ensure we use the new method that enforces the description is filled18:30
mriedemjohnthetubaguy: ok, looking18:30
jaypipesmriedem: not yet18:31
cdentmriedem: those only come into play if the inventory doesn't specify18:31
mriedemcdent: right, and min_unit/max_unit aren't required,18:31
cdentand in their old form it was possible to say a max_unit of zero, which makes no logical sense18:31
mriedemso a lazy client could just not provide them18:31
mriedemyeah18:32
cdentso max int is correct18:32
mriedemi know i'm overthinking this18:32
cdent(even though you probably wouldn't want it to be set that)18:32
edleafethe old default of max_unit=0 was definitely wrong18:32
mriedemso if we shouldn't be guessing, why is max_unit optional?18:33
*** marst has joined #openstack-nova18:33
mriedemoh well,18:33
edleafemriedem: they should be able to request as much inventory as is available, unless it's been configured to be restricted18:33
mriedemi guess if total is maxint, and stepsize is 1, then by default you can have one unit of maxint18:33
*** karimb has joined #openstack-nova18:33
cdentI'm trying to make sure the bug report covers everything, including some cases  not currently covered in ed's changes18:34
melwittjohnthetubaguy: while you're still around, just a reminder that the quota counting patch is ready for review at your convenience. I think I addressed all of your comments.18:35
jaypipesmriedem: I'm good with that patch.18:35
jaypipesmriedem: though the total should have a minimum, as johnthetubaguy mentioned.18:36
mriedemwhat happens if i don't specify max_unit, and total=1024, then i request an allocation of 2048?18:36
cdentedleafe, jaypipes, mriedem : please review this bug, I _think_ I covered everything (including the thing jay just said): https://bugs.launchpad.net/nova/+bug/167322718:36
openstackLaunchpad bug 1673227 in OpenStack Compute (nova) "placement apis for inventory and allocations use insufficiently robust jsonschema" [Undecided,Triaged]18:36
mriedemwhere does that fail?18:36
cdentmriedem: that will fail at the db layer18:37
mriedemmax_unit will default to maxint, total will be 1024 and i'll request 204818:37
jaypipescdent: ++18:37
*** unicell has quit IRC18:37
cdentsince 2048 > (total - use * allocation.ratio) FAIL18:38
cdentYPMV18:38
mriedemi think also here right? https://github.com/openstack/nova/blob/master/nova/objects/resource_provider.py#L104318:38
*** voelzmo has joined #openstack-nova18:39
cdentmriedem: that's what I'm calling the db layer18:39
*** jpena is now known as jpena|off18:39
cdentmriedem: but that specific line doesn't involve the total18:39
cdentyou want 1062 for that18:39
mriedemand that's handled as a 409 in the PUT /allocations handler18:40
*** eharney has joined #openstack-nova18:40
mriedemok18:40
* cdent nods18:40
*** gcb has quit IRC18:40
*** unicell has joined #openstack-nova18:41
edleafecdent: the bug lgtm18:41
*** bnemec has quit IRC18:41
johnthetubaguymelwitt: ah, thats going to be tomorrow, but I should make sure I hit that again18:41
mriedemheh, "insufficiently robust"18:41
cdentedleafe: I think it add at least one, and maybe two things for your code18:41
*** abalutoiu has quit IRC18:41
edleafecdent: yeah, I'll look into that as soon as I can push the functional stuff18:42
cdent18:42
melwittjohnthetubaguy: it's not urgent, just wanted to remind you about it. thanks :)18:42
mriedemcdent: in the bug report, "* reserved and total need a minimum, probably of 0 and 1 respectively"18:42
mriedemreserved should not be a min of 118:42
mriedemoh wait, i see18:43
mriedem"respectively"18:43
cdentI included that "probably" in there because I wasn't sure if there was a use case for total having a min of 018:43
*** unicell1 has joined #openstack-nova18:44
cdentI think, however, we decided that anything which is inventory total 0 is inventory that should not be reported18:44
mriedemtotal nothingness18:44
*** unicell has quit IRC18:44
mriedemi think once you hit 0 you actually get to nirvana18:44
*** bnemec has joined #openstack-nova18:44
*** liangy has joined #openstack-nova18:45
cdenthowever, now that I think about it: jaypipes: should it be possible to set an existing inventory to 0 capacity for some reason? ("this thing is here but not really")18:45
jaypipescdent: no18:45
cdentstraight answer \o/18:45
jaypipes:)18:45
edleafecdent: I have an inventory of 0 Rolls Royces18:46
cdentomg, so do I!18:46
mriedemdansmith frequently claims to have an inventory of 0 fucks18:47
*** unicell1 has quit IRC18:47
mriedemyou know placement is getting traction when you can use it in casual conversation18:48
mriedemsdague: i'm +2 on johnthetubaguy's policy docs spec now https://review.openstack.org/#/c/433010/18:48
mriedemit's pretty straight-forward18:48
*** catinthe_ has joined #openstack-nova18:48
openstackgerritEd Leafe proposed openstack/nova master: virt: implement get_inventory() for Ironic  https://review.openstack.org/44154418:49
openstackgerritEd Leafe proposed openstack/nova master: Refactor placement fixtures  https://review.openstack.org/44612218:49
openstackgerritEd Leafe proposed openstack/nova master: WIP - add some functional tests for placement  https://review.openstack.org/44612318:49
* cdent decided not to think too hard about allocating or filtering dan's fucks18:49
edleafejaypipes: looks like your ironic inventory patch was rebased18:49
edleafecdent: the last one above ^^ is the attempt at functional tests for placement18:50
*** afazekas_ is now known as afazekas18:50
*** unicell has joined #openstack-nova18:50
cdentlooking edleafe18:50
*** raunak has quit IRC18:51
*** smatzek has joined #openstack-nova18:51
*** catintheroof has quit IRC18:51
*** karimb has quit IRC18:52
*** voelzmo has quit IRC18:53
*** gcb has joined #openstack-nova18:53
*** unicell has quit IRC18:53
*** marst has quit IRC18:54
cdentthe other method you want, for inventory setting, is _update()18:55
*** hshiina has quit IRC18:55
*** marst has joined #openstack-nova18:55
*** unicell has joined #openstack-nova18:56
cdentedleafe: of your could kill two birds with update_usage()18:56
*** annegentle has quit IRC18:58
edleafecdent: stepping into a meeting, but will dig into that after18:59
cdentsorry for your luck18:59
edleafecdent: hey, only 2 today!19:00
cdentgreat success?19:00
*** JoseMello has joined #openstack-nova19:01
*** fragatin_ has quit IRC19:02
*** fragatina has joined #openstack-nova19:02
*** stvnoyes has quit IRC19:08
*** stvnoyes has joined #openstack-nova19:09
*** nic has quit IRC19:14
* cdent waves goodnight19:15
*** cdent has quit IRC19:15
*** krtaylor has joined #openstack-nova19:16
jaypipesedleafe: did you change anything in the patch you just rebased?19:17
*** nic has joined #openstack-nova19:17
*** zhangqiankun has quit IRC19:18
*** amoralej is now known as amoralej|off19:20
*** marst has quit IRC19:22
*** Sukhdev has joined #openstack-nova19:23
*** smatzek has quit IRC19:30
*** stvnoyes has left #openstack-nova19:30
*** zioproto has quit IRC19:31
*** raunak has joined #openstack-nova19:32
*** bvanhav_ has quit IRC19:36
*** ociuhandu has quit IRC19:39
openstackgerritJay Pipes proposed openstack/nova master: virt: implement get_inventory() for Ironic  https://review.openstack.org/44154419:40
jaypipesmriedem: ok, ready for you ^19:40
*** kylek3h has quit IRC19:42
*** tbachman has quit IRC19:42
*** voelzmo has joined #openstack-nova19:42
*** fandi has joined #openstack-nova19:43
edleafejaypipes: nope. Mine just built on yours19:43
*** vgadiraj has quit IRC19:45
*** aunnam has quit IRC19:45
*** dharinic has quit IRC19:45
*** raj_singh has quit IRC19:45
*** pumaranikar has quit IRC19:45
*** sneti has quit IRC19:45
*** manjeets has quit IRC19:45
*** siva_krishnan has quit IRC19:45
*** tbachman has joined #openstack-nova19:48
mriedemjaypipes: you missed one little thing https://review.openstack.org/#/c/441544/919:52
*** whenry has joined #openstack-nova19:55
*** david-lyle_ is now known as david-lyle19:57
*** awaugama has quit IRC20:00
*** Sukhdev has quit IRC20:02
*** voelzmo has quit IRC20:03
openstackgerritMatt Riedemann proposed openstack/nova master: virt: implement get_inventory() for Ironic  https://review.openstack.org/44154420:05
mriedemjaypipes: nvm, i got it, +220:06
mriedemdansmith: ^ it's all yours now20:06
*** gus has quit IRC20:07
dansmithmriedem: k in a sec20:07
*** rdo has quit IRC20:09
*** gus has joined #openstack-nova20:09
*** rdo has joined #openstack-nova20:11
efriedjaypipes Before I try to grok your blueprint and the above change set, does there exist a quick-and-dirty guide entitled "How to convert my compute driver from get_available_resource to get_inventory"?20:12
*** hongbin has joined #openstack-nova20:13
jaypipesmriedem: thx20:16
*** smatzek has joined #openstack-nova20:17
jaypipesefried: hi :) no, there's no guide other than looking at the above patch.20:17
mriedemefried: it's probably easiest to just look at that ironic patch20:18
mriedemfor get_inventory20:18
jaypipesefried: basically just needs to return a dict of inventory information for each resource class the driver understands.20:18
efriedmriedem jaypipes Okay, that's where I was going to go.  Guess you guys will be reviewing the change one way or another, so you'll catch me if I eff it up...20:19
*** marst has joined #openstack-nova20:19
mriedemif you eff it up the resource tracker will probably give you a KeyError20:19
mriedemit's all self testing, like most everything in nova, rock solid20:19
efriedBut of course.20:19
mriedemwtf, why is RequestSpec.forced_hosts a list when you can only provide one value in the API when creating a server?20:25
mriedembauzas: ^?20:25
*** marst_ has joined #openstack-nova20:25
*** smatzek has quit IRC20:25
mriedemplease oh please don't say future proofing20:25
*** marst has quit IRC20:28
bauzasmriedem: because you can provide a list AFAIK20:28
bauzaslemme verify this20:28
melwittyeah, from what I find I think the scheduler hint is force_hosts as a list?20:29
*** dave-mccowan has quit IRC20:29
mriedemhttps://github.com/openstack/nova/blob/master/nova/api/openstack/compute/servers.py#L579 is not a list20:29
mriedemit's a scheduler hint?20:29
bauzasokay, can't find a reasonable answer20:30
melwittI'll wait for bauzas to let us know what's the deal20:30
mriedemit's not a scheduler hint that's checked in any in-tree filters20:31
melwittit seems like it coincides with the scheduler hint, but why it's baked into RequestSpec, I don't know the history on that20:31
bauzasmriedem: melwitt: no, forced_hosts is in the host manager20:31
*** READ10 has joined #openstack-nova20:31
mriedemthe scheduler hint for groups?20:31
melwittyeah, forcing a host isn't part of any specific filter. it happens before filtering and will bypass filtering20:31
bauzasyeah that20:31
mriedemok but there is also this https://docs.openstack.org/admin-guide/cli-nova-specify-host.html20:32
bauzasmriedem: yeah, because it's a terrible UX20:32
mriedemi know it's not part of a filter, but i'm trying to figure out how it becomes a list,20:32
bauzasforced_hosts is set by the AZ flag20:32
mriedembecause the only thing i see that sets forced_hosts in the request spec comes through the REST API using the az parsing in ^20:33
bauzasmriedem: honestly, I don't remember why, lemme verify the change20:33
*** ociuhandu has joined #openstack-nova20:33
mriedemthose docs are also a bit wrong btw, they say "HOST is an optional parameter. In such cases, use the --availability-zone ZONE::NODE." - but they fail to mention that NODE is also an optional parameter20:33
*** sneti has joined #openstack-nova20:34
bauzasnode was added later20:34
bauzasbecause of $ironic :)20:34
openstackgerritEd Leafe proposed openstack/nova master: Add check for invalid inventory amounts  https://review.openstack.org/42880020:34
openstackgerritEd Leafe proposed openstack/nova master: Add check for invalid allocation amounts  https://review.openstack.org/41675220:34
edleafejaypipes: mriedem: updated ^^20:34
jaypipescool20:35
*** crushil has quit IRC20:35
*** crushil has joined #openstack-nova20:36
*** marst_ has quit IRC20:36
bauzasmriedem: so, in between PS7 and PS8, I modified force_hosts to be a list20:37
bauzashttps://review.openstack.org/#/c/145528/8..9/nova/objects/request_spec.py20:37
bauzasI'm trying to remember the context why20:37
mriedem8..9, butok20:37
bauzasmmm20:38
mriedemit's 46 patch sets is hurting my browser20:38
bauzasso, the only reason I see that is because filter_props was having a list20:39
bauzasit's not what I say a reasonable answer, so lemme verify why we have a list for the legacy dict20:40
*** gus has quit IRC20:40
mriedemi smell a rackspace reason here20:40
*** raj_singh has joined #openstack-nova20:41
bauzasat least the host manager waits for a list20:41
bauzasand I haven't changed that20:41
bauzasso somewhere we accepted a list20:41
bauzasyeah... build_filter_properties() in nova.scheduler.utils20:42
bauzasmriedem: ^20:42
*** gus has joined #openstack-nova20:42
*** crushil has quit IRC20:42
mriedemhttps://github.com/openstack/nova/commit/90620a27e0831345864f574256b30bac1ced584320:43
bauzasmriedem: https://github.com/openstack/nova/commit/9998c51f20:43
*** haplo37 has quit IRC20:43
mriedemhttps://github.com/openstack/nova/commit/90620a27e0831345864f574256b30bac1ced5843 goes back to havana,20:43
bauzasmriedem: sure, but both don't explain why we want a list20:43
mriedemand appears to introduce the idea that forced_hosts is a list20:43
mriedemcould have been a mistake if the key was named "force_hosts" so plural20:44
mriedemhttps://github.com/openstack/nova/blob/90620a27e0831345864f574256b30bac1ced5843/nova/compute/api.py#L72720:44
bauzaswe should go back where force_hosts was originally created20:44
mriedemi'm going20:45
bauzasyeah, like I said there are a shit ton of places where we expect a list20:45
bauzasso I shamelessly copied that20:45
*** satyar has quit IRC20:46
bauzasalthough I originally found it was a string like I wrote in my PS820:46
bauzasdefeated by tech debt20:46
mriedemhttps://github.com/openstack/nova/commit/7b34a2d767b60e053ac1f49d1cdd8c853b8d913320:47
mriedemis about as far back as i see20:47
mriedemoh wait it goes further20:48
bauzashttps://github.com/openstack/nova/commit/836ee3f4520:48
jrolldon't you guys know to always blame comstud by now20:49
mriedemhttps://github.com/openstack/nova/commit/16ea348a1623f055809d0d9b7fe9f046515b5dd120:51
melwittI was seeing some stuff from essex20:51
*** voelzmo has joined #openstack-nova20:51
mriedem^ is essex20:51
bauzasyeah I was an diablo op and I don't remember that feature20:52
melwitthah, nice20:52
*** haplo37 has joined #openstack-nova20:52
bauzasI just remember Essex added lots of things like that20:52
bauzasbut it's very old stories at the corner of the fireplace20:52
*** voelzmo has quit IRC20:52
bauzassoooo... to answer mriedem's question, I guess that the terrible answer he was afraid was the correct one20:53
bauzasie. "we planned that for the future"20:53
bauzasjust give me a license to kill that AZ hack, and I'll write a specx20:54
melwittit was maybe mirroring ignore_hosts, which was already there when force_hosts was added20:54
bauzasyeah20:55
*** gouthamr has quit IRC20:55
bauzasanyway, force_hosts is a legacy from the past, and we should get rid of it20:55
mriedemi'm not necessarily saying let's remove it,20:55
bauzasI'm saying it :p20:55
*** dimtruck is now known as zz_dimtruck20:55
mriedembut it sure as shit causes a lot of confusion when you're looking at all of the code that uses it, and the API that provides the value, and you see it's not a list20:55
mriedemand you say, wtf am i missing?20:56
bauzasmriedem: you know that the policy differs for that, right?20:56
mriedemyes20:56
melwittwould have to run that by operators because afaik they use that to test new compute host before making it available for scheduling?20:56
mriedemyou mean "create:forced_host" right?20:56
bauzasyup20:56
mriedemyeah i thought operators were pretty keen on this,20:56
bauzasI was20:56
mriedemand we've baked it into the migration APIs right?20:57
bauzasin Essex, it was terribly necessary20:57
bauzasbut now, we are in a far better place, but at least we should mimic what we merged for the move operations20:57
bauzasie. having a possible target with a force flag20:57
bauzaswhich would then verify the filters if the target is set without force20:58
bauzasor totally bypass the scheduler if force20:58
mriedemso, i'm going to just start with a code comment in the request spec object20:58
mriedemso when i look at this in a year, i won't have to do all of the detective work again20:59
bauzasfine by me20:59
openstackgerritMatt Riedemann proposed openstack/nova master: Add a note about force_hosts only ever having a single value  https://review.openstack.org/44617521:04
mriedemthere you go ^21:04
openstackgerritRoman Dobosz proposed openstack/nova-specs master: Provide detailed error information for placement API  https://review.openstack.org/41839321:04
*** sneti has quit IRC21:05
mriedemok, well, back to figuring out how i can mock the scheduler to send build requests to certain hosts in order21:06
*** hongbin has quit IRC21:06
bauzasmelwitt: https://review.openstack.org/#/c/446175/1 could be worth of interest21:07
bauzasmriedem: what's your concern ?21:07
mriedembauzas: i'm writing a functional test to recreate https://review.openstack.org/#/c/444106/21:08
bauzasmriedem: you want the scheduler to return you a specific destination ?21:08
mriedemi have 2 hosts, i want the scheduler to send them in order21:08
*** zz_dimtruck is now known as dimtruck21:08
*** sdague has quit IRC21:09
mriedemi think i can just use the disk weigher and fake it out21:10
*** vladikr has quit IRC21:11
*** lucasxu has quit IRC21:12
*** lucasxu has joined #openstack-nova21:12
*** lucasxu has quit IRC21:12
mriedemoh now i see a bug in the docs21:13
*** gouthamr has joined #openstack-nova21:13
*** moshele has joined #openstack-nova21:14
*** dave-mccowan has joined #openstack-nova21:14
openstackgerritMatt Riedemann proposed openstack/nova master: Fix the help for the disk_weight_multiplier option  https://review.openstack.org/44617721:15
bauzasmriedem: the scheduler is only returning one host, so 2 calls one after the other ?21:16
mriedembauzas: i need the test to make the scheduler put the server on the hosts in order, where the first host will fail during driver.spawn which would normally trigger a retry to the 2nd host21:17
mriedemi've got 2 hosts in the test21:17
mriedemi want to trick the scheduler into picking the hosts in order21:17
mriedemso i really just need it to pick the bad one first21:17
*** dave-mcc_ has joined #openstack-nova21:17
mriedemi guess maybe it doesn't matter which order as long as i can keep track of the first host that's called21:18
mriedemi'll just do that21:18
bauzasI see21:19
*** dave-mccowan has quit IRC21:19
*** rloo has joined #openstack-nova21:20
bauzasmriedem: tbh, just asks the scheduler for one host, kill the spawn and then the reschedule will put that host in the retry list21:21
bauzasin case retry doesn't work, then you'll get the first node21:22
mriedemthe scheduler will try to send it back to the same host?21:22
bauzasyup, because the claim will be reversed21:22
bauzaswell, there is some random21:23
mriedemok, so i'm going to try and test this in the non-crazy way21:23
mriedemwhich is if i have 2 hosts and the first fails, i expect it to go to the 2nd host21:24
mriedemsee _add_retry_host in the scheduler utils21:24
mriedemthat's why i thought it worked this way21:24
bauzasyou can trick the scheduler21:24
mriedemah RetryFilter21:24
bauzasyeah21:24
*** browne has quit IRC21:25
bauzasthat's why we had NoValidHosts for a spawn issue21:25
bauzasnow, it's a separate exception21:25
bauzasbut yeah, if we retry and we don't have enough computes, then the RetryFilter will return 0 hosts21:25
bauzasas I said, you can trick what the scheduler returns by avoiding random choice if host_subset_size opt is having a 1 value21:26
bauzaswhich is the default21:27
*** krtaylor has quit IRC21:27
bauzasso, that's why the scheduler always returns the same compute21:28
bauzasmriedem: FWIW, I'm tempted to add a section in https://etherpad.openstack.org/p/BOS-Nova-brainstorming saying 'add your name if you want to go to the Summit but still waits for your management" :p21:29
*** sneti has joined #openstack-nova21:30
mriedembauzas: that kind of passive aggressiveness is reserved for midwesterners in the US21:30
mriedemi'm also setting host_subset_size=221:30
mriedemi'm setting all the things21:30
*** moshele has quit IRC21:30
*** sneti has quit IRC21:30
bauzasif so, you'd random between two hosts21:30
mriedembut the RetryFilter, which is enabled by default, should filter out the first failed host21:31
mriedemanyway, i'll just get this going and see21:31
*** tblakes has quit IRC21:33
bauzasmriedem: sure but if we don't have the retry dict, then you could miss the problem21:33
bauzaswhat you want to cover21:34
*** Jeffrey4l_ has joined #openstack-nova21:35
*** Jeffrey4l has quit IRC21:35
*** edmondsw has quit IRC21:36
*** Sukhdev has joined #openstack-nova21:36
*** edmondsw has joined #openstack-nova21:37
*** ijw has quit IRC21:39
*** Sukhdev has quit IRC21:41
*** edmondsw has quit IRC21:41
*** JoseMello has quit IRC21:45
edleafejaypipes: want me to fix the pep8 issue on https://review.openstack.org/441544 ?21:47
jaypipesedleafe: lol, pls do. :)21:47
edleafek21:47
jaypipesedleafe: serves me right for not tox -epep8'ing.21:48
openstackgerritEd Leafe proposed openstack/nova master: virt: implement get_inventory() for Ironic  https://review.openstack.org/44154421:49
edleafejaypipes: fixed ^^21:49
jaypipescheers, I wallaby'd it.21:50
*** hshiina has joined #openstack-nova21:51
*** slaweq_ has joined #openstack-nova21:52
*** slaweq__ has quit IRC21:52
*** baoli has quit IRC21:54
*** erlon has quit IRC21:55
*** jamielennox has quit IRC21:55
*** burt has quit IRC21:57
*** Sukhdev has joined #openstack-nova21:57
*** lpetrut has quit IRC21:58
*** tbachman has quit IRC21:59
*** raj_singh has quit IRC22:00
*** esberglu has quit IRC22:00
*** felipemonteiro has quit IRC22:00
*** raj_singh has joined #openstack-nova22:00
*** esberglu has joined #openstack-nova22:00
openstackgerritRafael Folco proposed openstack/nova master: DELETE all inventory for a resource provider  https://review.openstack.org/41666922:02
*** esberglu has quit IRC22:05
*** mdrabe has quit IRC22:06
jaypipesmriedem, dansmith, melwitt: one of you want some review bait? :) https://review.openstack.org/#/c/444497/22:08
*** dimtruck is now known as zz_dimtruck22:09
*** rloo has left #openstack-nova22:09
*** aysyd has quit IRC22:09
*** Yingxin has quit IRC22:13
*** tbachman has joined #openstack-nova22:13
*** Yingxin has joined #openstack-nova22:14
openstackgerritSujitha proposed openstack/nova master: Add description to policies in admin_password.py  https://review.openstack.org/44395722:14
openstackgerritSujitha proposed openstack/nova master: Add description to policies in agents.py  https://review.openstack.org/44520822:15
openstackgerritSujitha proposed openstack/nova master: Add description to policies in aggregates.py  https://review.openstack.org/44523022:15
*** browne has joined #openstack-nova22:15
*** jamielennox has joined #openstack-nova22:15
openstackgerritSujitha proposed openstack/nova master: Add description to policies in assisted_volume_snapshots.py  https://review.openstack.org/44523822:15
*** mlavalle has quit IRC22:16
*** krtaylor has joined #openstack-nova22:17
*** armax has quit IRC22:19
*** esberglu has joined #openstack-nova22:19
*** hshiina has quit IRC22:21
*** rfolco has quit IRC22:23
*** esberglu has quit IRC22:24
*** slaweq_ has quit IRC22:26
*** slaweq_ has joined #openstack-nova22:29
*** rmart04 has joined #openstack-nova22:31
*** efried has quit IRC22:31
mriedemjaypipes: no more for me today22:32
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Add a functional regression/recreate test for bug 1671648  https://review.openstack.org/44620922:32
openstackbug 1671648 in OpenStack Compute (nova) "Instances are not rescheduled after deploy fails" [High,In progress] https://launchpad.net/bugs/1671648 - Assigned to Shunli Zhou (shunliz)22:32
mriedemmelwitt: here is that functional regression test for the retry bug ^22:32
*** baoli has joined #openstack-nova22:34
melwittmriedem: cool, will check it out22:35
*** gongysh has joined #openstack-nova22:37
*** baoli has quit IRC22:38
*** claudiub has quit IRC22:40
*** zz_dimtruck is now known as dimtruck22:41
*** abalutoiu has joined #openstack-nova22:43
*** hongbin has joined #openstack-nova22:43
*** mriedem1 has joined #openstack-nova22:43
*** mriedem has quit IRC22:44
melwittjaypipes: +W22:45
*** tbachman has quit IRC22:48
*** xyang1 has quit IRC22:49
*** rmart04 has quit IRC22:49
*** browne has quit IRC22:49
*** gyee has joined #openstack-nova22:52
*** zioproto has joined #openstack-nova22:59
*** ijw has joined #openstack-nova23:02
*** timello has quit IRC23:02
*** catinthe_ has quit IRC23:02
*** rfolco has joined #openstack-nova23:04
*** ijw has quit IRC23:07
*** jianghuaw-m has joined #openstack-nova23:09
*** timello has joined #openstack-nova23:09
*** alexpilotti has quit IRC23:11
mriedem1aha, the chance scheduler doesn't set filter limits23:12
mriedem1b/c it doesn't do filtering23:12
*** mriedem1 is now known as mriedem23:12
mriedemand the scheduler filter uses RequestSpec.from_primitives which defaults 'limits' to {}23:12
melwittmriedem: ah, right. need to self.flags for filterscheduler23:13
mriedemi don't want to use the filter scheduler actually,23:13
dansmithmelwitt: were you going to split up the third quota patch at all?23:13
mriedemi started with that and the default enabled filters kicked out my hosts23:13
*** ijw has joined #openstack-nova23:13
dansmithI've just been going back and forth between a real file and a test file for a while,23:13
dansmithand I think it should be easy to cleave off some large related chunks purely by tagging files that go together23:14
dansmithis there any reason to keep this monolithic?23:14
*** rfolco has quit IRC23:14
melwittno, other than I didn't do much thinking about how to logically split it into smaller chunks23:14
melwittI had a hell of a time just getting it to work, so it stayed monolithic23:14
dansmithlemme see if I can split off some chunks that look obvious to me23:15
melwittthanks. suggestions on how to split it would be appreciated23:16
*** avolkov` has joined #openstack-nova23:16
melwittmriedem: I thought I had seen an example of a func test that used filterscheduler but I'm not finding anything so far23:17
melwittoh, I was grepping for the wrong thing "FilterScheduler". it looks like this to configure self.flags(driver='filter_scheduler', group='scheduler')23:17
*** avolkov has quit IRC23:18
melwittand I just read back and saw you don't want the filter scheduler. nevermind23:20
*** dtp has quit IRC23:21
mriedemright, filter scheduler is the default23:23
mriedembut it has a bunch of filters enabled by default, so i'd have to wittle that list of filters down to what works for this test, which might just be the RetryFilter,23:23
mriedemi'm just trying to get the base things working23:23
*** sree has joined #openstack-nova23:24
melwittmriedem: well, you can self.flags the enabled filters too. so maybe just put RetryFilter in there by itself23:24
mriedemyeah i thought about that,23:25
melwittif the bug is about something that RetryFilter needs to populate, I mean23:25
melwittif it's unrelated, then you don't need filter scheduler23:25
mriedemRetryFilter doesn't populate the thing,23:25
mriedemit checks the populated value23:25
mriedemanyway, the functional test is now failing and going back and forth between hosts so i'm doing something else wrong here23:26
mriedemwith the fix i mean23:26
mriedemso it's retrying, but failing23:26
*** dimtruck is now known as zz_dimtruck23:26
*** zz_dimtruck is now known as dimtruck23:26
mriedemeven though i'm using that flag to signal when we should fail and when we shouldn't23:27
melwittso the RetryFilter is what skips hosts that have already been attempted. so it seems like that would be your problem, right?23:27
melwitt(I'm reading in the filter)23:27
*** pumaranikar has joined #openstack-nova23:27
melwittbut that implies it would go on forever otherwise? that doesn't really make sense23:28
*** sree has quit IRC23:28
*** hshiina has joined #openstack-nova23:29
mriedemi can try self.flags(enabled_filters=['RetryFilter'], group='filter_scheduler') and see what happens23:33
*** pumaranikar has quit IRC23:35
*** dimtruck is now known as zz_dimtruck23:36
mriedemyeah that makes it not attempt at all23:36
melwittI have a feeling that RetryFilter is required if scheduler_max_attempts > 1, otherwise it wouldn't know how to skip already tried hosts23:36
melwittand chance scheduler I think can't work with more than one compute host and scheduler_max_attempts > 1 maybe?23:37
mriedemmax_attempts defaults to 323:37
mriedemthrowing the ComputeFilter into the list23:37
*** jianghuaw-m has quit IRC23:37
dansmithmelwitt: so, I just split the third patch into these: http://pastebin.com/raw/SXVqNSZm23:37
mriedemsince that's a pretty dumb one23:37
dansmithwhich takes the top patch down from 49 files touched to 3223:38
melwittdansmith: you're the best23:38
dansmithtotally haven't run unit tests or anything, and there are probably some pieces that I need, like I didn't bring over the object hashes23:38
melwittdansmith: yeah, if you just wanna dump it like that, I can fix whatever blows up23:38
dansmithbut I think it's probably worth trying to pursue that, just to make the last patch (which will be big enough regardless) a little more manageable23:38
* melwitt nods23:39
*** jianghuaw-m has joined #openstack-nova23:39
dansmithlet me see how much blowing up there is before I go dumping, but if it's not terribad I will23:39
melwittk23:39
openstackgerritSamantha Blanco proposed openstack/nova master: [WIP] Make flavor-rxtx policy more granular  https://review.openstack.org/44403623:40
melwittmriedem: yeah, I knew max attempts defaults to > 1 but the vast majority of our tests only use one compute service, so this doesn't come up much23:42
mriedemmelwitt: ah the other thing,23:42
mriedemfilter scheduler uses placement now,23:42
melwittand chance_scheduler is only used in the tests that derive from the integrated_helpers base test class23:42
mriedemand this isn't setup to report into placement23:42
melwitthmm23:42
mriedemso back to chance_scheduler it is23:43
mriedemunless i also stub out the placement stuff23:43
melwittI think chance_scheduler can't retry. you'd have to check23:43
melwittit has to have some other way to skip hosts it already tried23:43
mriedemi can try using the PlacementFixture23:44
melwittI had to use that recently. I can't remember the context23:44
mriedemthis time i got one attempt, so getting further23:48
melwitt /o/23:49
mriedemis that the hey ho thing?23:50
dansmithmelwitt: hmm, yea, so I think you'll have to make some compatible changes to the quota object (and thus the quota driver) at the bottom of the stack, then use them, and remove the old stuff at the top23:52
dansmithI could split this out in front: https://review.openstack.org/#/c/416521/22/nova/objects/quotas.py23:52
dansmithexcept that the changes to the quota driver have to go with it, but I think a lot of that has to go nearish to the end?23:52
melwittmriedem: I was imagining it as cheering you on. I don't know what the hey ho thing is23:53
melwittdansmith: yeah, the check_deltas thing was a suggestion from johnthetubaguy as a way to put count/limit_check together behind an abstraction, in hopes that later on we could do something to make the count/check atomic23:54
melwittso it's just grouping thing really23:54
mriedemmelwitt: https://www.youtube.com/watch?v=vr-klwxKhow23:55
*** zz_dimtruck is now known as dimtruck23:55
melwittand it makes the code look a lot nicer and be more clear at the call sites23:55
dansmithmelwitt: right but it makes all the things that use that interface depend on the changes to the quota driver23:55
dansmithI mean that's obvious, that they depend on them,23:55
dansmithbut it makes it hard to merge any of those things early, which are just setup for the main event at the end23:56
melwittdansmith: yeah23:56
dansmithif instead of modifying the existing quota limit_check thing, you had a new one that did the new behavior, we could merge that and the things that need it,23:56
dansmiththen cut over, then remove the old stuff23:56
melwittoh, okay, I see what you're saying now23:56
dansmithunless the limit check is still usable by old code in it's modified form,23:57
dansmithbut so much change was made and new params and stuff I can't really eyeball it23:57
dansmithlike, with proj_values=None is it still compatible with the way it was before?23:58
melwittlemme see. this has been going on for awhile23:58
melwittI think so. that was what I was thinking, let limit_check work the way it always did, just that you can add project-scoping if you want. which we need for all the new counting stuff23:59
*** jianghuaw-m has quit IRC23:59
melwittprior to this patch, all of the limit_checks were user-scoped only23:59
*** adisky_ has quit IRC23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!