Friday, 2019-02-08

*** sdake has quit IRC00:01
*** wolverineav has joined #openstack-nova00:02
*** elod has quit IRC00:05
*** wolverineav has quit IRC00:06
*** takashin has joined #openstack-nova00:07
*** tbachman has joined #openstack-nova00:10
*** markvoelker has quit IRC00:11
*** wolverineav has joined #openstack-nova00:19
*** tetsuro has joined #openstack-nova00:20
*** elod has joined #openstack-nova00:32
*** wolverineav has quit IRC00:33
*** wolverineav has joined #openstack-nova00:34
*** wolverineav has quit IRC00:39
*** sapd1 has joined #openstack-nova00:43
*** wolverineav has joined #openstack-nova00:44
*** sdake has joined #openstack-nova00:45
*** ade_lee_ has joined #openstack-nova00:46
*** ileixe has joined #openstack-nova00:48
openstackgerritAdam Spiers proposed openstack/os-traits master: Add HW_CPU_AMD_SEV trait  https://review.openstack.org/63560800:49
*** mriedem_afk has quit IRC00:49
*** ade_lee_ has quit IRC00:53
*** ade_lee_ has joined #openstack-nova00:53
*** agopi|pto has joined #openstack-nova01:01
*** sdake has quit IRC01:06
openstackgerritMatt Riedemann proposed openstack/nova master: Transfer port.resource_request to the scheduler  https://review.openstack.org/56726801:07
openstackgerritMatt Riedemann proposed openstack/nova master: Extend RequestGroup object for mapping  https://review.openstack.org/61952701:07
openstackgerritMatt Riedemann proposed openstack/nova master: Calculate RequestGroup resource provider mapping  https://review.openstack.org/61623901:07
openstackgerritMatt Riedemann proposed openstack/nova master: Fill the RequestGroup mapping during schedule  https://review.openstack.org/61952801:07
openstackgerritMatt Riedemann proposed openstack/nova master: Pass resource provider mapping to neutronv2 api  https://review.openstack.org/61624001:07
openstackgerritMatt Riedemann proposed openstack/nova master: Recalculate request group - RP mapping during re-schedule  https://review.openstack.org/61952901:07
openstackgerritMatt Riedemann proposed openstack/nova master: Send RP uuid in the port binding  https://review.openstack.org/56945901:07
openstackgerritMatt Riedemann proposed openstack/nova master: Test boot with more ports with bandwidth request  https://review.openstack.org/57331701:07
openstackgerritMatt Riedemann proposed openstack/nova master: Remove port allocation during detach  https://review.openstack.org/62242101:07
openstackgerritMatt Riedemann proposed openstack/nova master: Record requester in the InstancePCIRequest  https://review.openstack.org/62531001:07
openstackgerritMatt Riedemann proposed openstack/nova master: Add pf_interface_name tag to passthrough_whitelist  https://review.openstack.org/62531101:07
openstackgerritMatt Riedemann proposed openstack/nova master: Ensure that bandwidth and VF are from the same PF  https://review.openstack.org/62354301:07
*** markvoelker has joined #openstack-nova01:09
*** wolverineav has quit IRC01:13
*** wolverineav has joined #openstack-nova01:14
*** agopi|pto has quit IRC01:14
*** agopi|pto has joined #openstack-nova01:14
*** agopi|pto has quit IRC01:16
*** agopi|pto has joined #openstack-nova01:16
*** bhagyashris has joined #openstack-nova01:16
*** agopi|pto has quit IRC01:17
*** agopi|pto has joined #openstack-nova01:17
*** wolverineav has quit IRC01:19
*** tbachman has quit IRC01:25
*** BjoernT has joined #openstack-nova01:30
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Execute CrossCellMigrationTask from MigrationTask  https://review.openstack.org/63566801:39
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Plumb allow_cross_cell_resize into compute API resize()  https://review.openstack.org/63568401:39
*** BjoernT_ has joined #openstack-nova01:40
*** markvoelker has quit IRC01:41
*** BjoernT has quit IRC01:43
*** Dinesh_Bhor has joined #openstack-nova01:43
*** wolverineav has joined #openstack-nova01:44
*** mlavalle has quit IRC01:46
*** mriedem has joined #openstack-nova01:46
mriedemtakashin: stephenfin: oops https://bugs.launchpad.net/nova/+bug/181515301:47
openstackLaunchpad bug 1815153 in OpenStack Compute (nova) "Requested host during cold migrate is ignored if server created before Rocky" [High,Triaged]01:47
*** agopi|pto has quit IRC01:49
*** agopi|pto has joined #openstack-nova01:49
openstackgerritArtom Lifshitz proposed openstack/nova master: [WIP] Add migration param to check_can_live_migrate_destination  https://review.openstack.org/63460501:49
openstackgerritArtom Lifshitz proposed openstack/nova master: [WIP] Introduce live_migration_claim()  https://review.openstack.org/63566901:49
openstackgerritArtom Lifshitz proposed openstack/nova master: [WIP] Use live_migration_claim() to check dest resources  https://review.openstack.org/63460601:49
openstackgerritArtom Lifshitz proposed openstack/nova master: [WIP] New objects to transmit NUMA config from dest to source  https://review.openstack.org/63482701:49
openstackgerritArtom Lifshitz proposed openstack/nova master: [WIP] LM: generate new NUMA XML on the dest and send it to the source  https://review.openstack.org/63482801:49
openstackgerritArtom Lifshitz proposed openstack/nova master: [WIP] LM: update NUMA-related XML on the source  https://review.openstack.org/63522901:49
*** agopi|pto has quit IRC01:56
*** agopi|pto has joined #openstack-nova01:56
*** wolverineav has quit IRC01:57
*** wolverineav has joined #openstack-nova01:57
*** agopi|pto has quit IRC01:58
*** agopi|pto has joined #openstack-nova01:58
*** wolverineav has quit IRC02:02
*** sdake has joined #openstack-nova02:06
*** cfriesen has quit IRC02:07
*** sdake has quit IRC02:13
*** mriedem has quit IRC02:14
*** markvoelker has joined #openstack-nova02:38
*** psachin has joined #openstack-nova02:51
*** udesale has joined #openstack-nova03:11
*** markvoelker has quit IRC03:12
*** dave-mccowan has joined #openstack-nova03:13
*** chhagarw has joined #openstack-nova03:19
*** takashin has left #openstack-nova03:25
*** sapd1 has quit IRC03:32
openstackgerritMerged openstack/python-novaclient master: Remove deprecated novaclient.v2.contrib modules  https://review.openstack.org/63543003:37
*** sapd1 has joined #openstack-nova03:45
openstackgerritJack Ding proposed openstack/nova master: Correct instance port binding for rebuilds  https://review.openstack.org/60384404:00
*** tetsuro has quit IRC04:07
*** markvoelker has joined #openstack-nova04:09
*** tbachman has joined #openstack-nova04:11
*** tetsuro has joined #openstack-nova04:12
*** BjoernT has joined #openstack-nova04:13
*** BjoernT_ has quit IRC04:16
*** whoami-rajat has joined #openstack-nova04:24
*** lbragstad has quit IRC04:35
*** markvoelker has quit IRC04:41
*** tbachman has quit IRC04:42
*** sapd1 has quit IRC05:05
*** dave-mccowan has quit IRC05:08
openstackgerritMerged openstack/nova stable/ocata: Default embedded instance.flavor.is_public attribute  https://review.openstack.org/61936605:09
*** BjoernT has quit IRC05:10
*** ratailor has joined #openstack-nova05:18
*** gyee has quit IRC05:36
*** markvoelker has joined #openstack-nova05:38
openstackgerritMerged openstack/nova master: Fix deprecation warning for threadgroup.add_timer  https://review.openstack.org/63551605:41
*** raghav has joined #openstack-nova06:01
*** janki has joined #openstack-nova06:05
*** tetsuro has quit IRC06:07
*** markvoelker has quit IRC06:12
*** mdbooth_ has joined #openstack-nova06:18
*** mdbooth has quit IRC06:20
*** moshele has joined #openstack-nova06:34
*** moshele has quit IRC06:46
*** tetsuro has joined #openstack-nova06:50
*** Dinesh_Bhor has quit IRC06:57
*** Dinesh_Bhor has joined #openstack-nova07:03
*** Luzi has joined #openstack-nova07:08
*** markvoelker has joined #openstack-nova07:09
*** sridharg has joined #openstack-nova07:12
*** remi_ness has joined #openstack-nova07:15
*** wolverineav has joined #openstack-nova07:22
*** pcaruana has joined #openstack-nova07:23
*** wolverineav has quit IRC07:28
*** wolverineav has joined #openstack-nova07:29
*** markvoelker has quit IRC07:41
*** ccamacho has joined #openstack-nova08:00
*** takamatsu has joined #openstack-nova08:00
*** alex_xu has joined #openstack-nova08:05
*** awalende has joined #openstack-nova08:09
*** yan0s has joined #openstack-nova08:13
*** tkajinam has quit IRC08:14
*** tesseract has joined #openstack-nova08:18
*** markvoelker has joined #openstack-nova08:38
*** _fragatina has joined #openstack-nova08:40
*** xek has joined #openstack-nova08:45
*** yan0s has quit IRC08:51
*** rpittau has joined #openstack-nova08:56
*** ociuhandu has joined #openstack-nova09:07
*** panda|off is now known as panda09:08
*** markvoelker has quit IRC09:12
*** whoami-rajat has quit IRC09:14
*** yan0s has joined #openstack-nova09:17
*** mcgiggler has joined #openstack-nova09:18
*** tssurya has joined #openstack-nova09:25
*** tetsuro has quit IRC09:27
*** whoami-rajat has joined #openstack-nova09:28
*** derekh has joined #openstack-nova09:36
bauzasgood Friday nova09:39
*** bauzas is now known as bauwser09:39
bauwser(heh, that's maybe 3 months I didn't used my Friday suit :) )09:40
*** dtantsur|afk is now known as dtantsur09:40
*** slaweq has joined #openstack-nova09:42
*** bhagyashris has quit IRC09:47
*** david-lyle has joined #openstack-nova09:54
*** manjeets_ has joined #openstack-nova09:55
*** dklyle has quit IRC09:57
*** manjeets has quit IRC09:57
*** remi_ness has quit IRC10:07
*** markvoelker has joined #openstack-nova10:10
*** ociuhandu has quit IRC10:10
*** tssurya has quit IRC10:15
*** Dinesh_Bhor has quit IRC10:21
*** ociuhandu has joined #openstack-nova10:30
*** ociuhandu has quit IRC10:31
*** ociuhandu has joined #openstack-nova10:31
*** markvoelker has quit IRC10:42
*** ratailor has quit IRC10:58
*** tbachman has joined #openstack-nova11:04
*** udesale has quit IRC11:10
*** udesale has joined #openstack-nova11:10
*** erlon has joined #openstack-nova11:11
*** moshele has joined #openstack-nova11:15
*** takamatsu_ has joined #openstack-nova11:20
*** ileixe has quit IRC11:20
*** takamatsu has quit IRC11:20
openstackgerritAndrey Volkov proposed openstack/nova master: Check hosts have no instances for AZ rename  https://review.openstack.org/50920611:21
stephenfinbauwser: Whoops11:27
*** stephenfin is now known as finucannot11:27
*** tssurya has joined #openstack-nova11:29
*** moshele has quit IRC11:31
*** moshele has joined #openstack-nova11:34
*** sdake has joined #openstack-nova11:34
*** markvoelker has joined #openstack-nova11:39
*** dikonoor__ has joined #openstack-nova11:40
*** dikonoor__ has quit IRC11:40
*** sdake has quit IRC11:41
*** tbachman has quit IRC11:45
*** sdake has joined #openstack-nova11:45
*** dikonoor has joined #openstack-nova11:50
*** moshele has quit IRC11:54
*** dikonoor has quit IRC11:56
openstackgerritStephen Finucane proposed openstack/nova master: API: Remove evacuate/live-migrate 'force' parameter  https://review.openstack.org/63460011:58
*** dikonoor has joined #openstack-nova12:04
*** mcgiggler has quit IRC12:11
*** sdake has quit IRC12:11
*** wolverineav has quit IRC12:11
*** cdent has joined #openstack-nova12:11
*** markvoelker has quit IRC12:12
*** sdake has joined #openstack-nova12:12
*** slaweq has quit IRC12:15
*** slaweq has joined #openstack-nova12:18
openstackgerritMerged openstack/nova master: Transfer port.resource_request to the scheduler  https://review.openstack.org/56726812:22
*** whoami-rajat has quit IRC12:24
*** ratailor has joined #openstack-nova12:25
openstackgerritMerged openstack/nova-specs master: AMD SEV: address final feedback received prior to merge  https://review.openstack.org/62825212:25
*** raghav has quit IRC12:27
*** _fragatina has quit IRC12:31
openstackgerritLee Yarwood proposed openstack/nova master: Avoid redundant initialize_connection on source post live migration  https://review.openstack.org/55130212:42
*** whoami-rajat has joined #openstack-nova12:44
openstackgerritSurya Seetharaman proposed openstack/nova master: Plumbing required in servers ViewBuilder to construct partial results  https://review.openstack.org/63514612:46
openstackgerritSurya Seetharaman proposed openstack/nova master: API microversion 2.68: Handles Down Cells  https://review.openstack.org/59165712:46
openstackgerritSurya Seetharaman proposed openstack/nova master: API microversion 2.68: Handles Down Cells Documentation  https://review.openstack.org/63514712:46
*** sdake has quit IRC12:48
*** _fragatina has joined #openstack-nova12:55
*** sridharg has quit IRC12:55
openstackgerritMerged openstack/os-traits master: Add HW_CPU_AMD_SEV trait  https://review.openstack.org/63560812:56
*** Shilpa has quit IRC12:57
*** mcgiggler has joined #openstack-nova12:58
*** agopi|pto has quit IRC13:00
*** ratailor has quit IRC13:01
*** psachin has quit IRC13:03
*** mrjk has quit IRC13:08
*** tbachman has joined #openstack-nova13:08
*** pelement has left #openstack-nova13:08
*** markvoelker has joined #openstack-nova13:09
*** mrjk has joined #openstack-nova13:10
*** sridharg has joined #openstack-nova13:12
*** eharney has joined #openstack-nova13:15
*** tesseract has quit IRC13:15
*** tesseract has joined #openstack-nova13:16
*** gary_perkins has quit IRC13:18
*** obre has quit IRC13:18
*** obre has joined #openstack-nova13:18
*** gary_perkins has joined #openstack-nova13:19
*** cdent has quit IRC13:23
*** lpetrut has joined #openstack-nova13:29
*** moshele has joined #openstack-nova13:31
*** mriedem has joined #openstack-nova13:31
*** _fragatina has quit IRC13:35
*** eharney has quit IRC13:38
*** rpittau has quit IRC13:40
*** rpittau has joined #openstack-nova13:40
*** markvoelker has quit IRC13:42
*** eharney has joined #openstack-nova13:43
*** moshele has quit IRC13:43
*** cdent has joined #openstack-nova13:46
mriedemtssurya: i think we're just missing a unit test on https://review.openstack.org/#/c/635121/ and then i'd be +214:00
*** sridharg has quit IRC14:03
tssuryamriedem: on it thanks14:04
*** mrch_ has quit IRC14:04
mriedemdansmith: another good example of how brittle everything is https://bugs.launchpad.net/nova/+bug/181515314:08
openstackLaunchpad bug 1815153 in OpenStack Compute (nova) "Requested host during cold migrate is ignored if server created before Rocky" [High,In progress] - Assigned to Takashi NATSUME (natsume-takashi)14:08
mriedemtssurya: if you're respinning i had some nits in https://review.openstack.org/#/c/635145/ as well14:09
tssuryamriedem: yea saw them, I'll fix them too14:09
*** _fragatina has joined #openstack-nova14:10
*** BjoernT has joined #openstack-nova14:12
bauwsermriedem: thanks for the detailed bug report on https://bugs.launchpad.net/nova/+bug/181515314:16
openstackLaunchpad bug 1815153 in OpenStack Compute (nova) "Requested host during cold migrate is ignored if server created before Rocky" [High,In progress] - Assigned to Takashi NATSUME (natsume-takashi)14:16
bauwsermriedem: tbc, requested_destination wasn't intended to be persisted14:17
*** sridharg has joined #openstack-nova14:21
*** BjoernT has quit IRC14:22
*** erlon has quit IRC14:23
*** awalende has quit IRC14:24
*** TheJulia is now known as needssleep14:25
*** awalende has joined #openstack-nova14:25
dansmithmriedem: just in general?14:26
mriedemjust another example of how i feel that everything i touch breaks something else somewhere14:26
dansmithah yep14:26
mriedembauwser: sure, we fixed that,14:26
mriedemand in doing so broke something else inadvertently later14:26
*** cfriesen has joined #openstack-nova14:28
*** dave-mccowan has joined #openstack-nova14:29
*** awalende has quit IRC14:29
*** lbragstad has joined #openstack-nova14:31
bauwsermriedem: ergh ok14:32
*** efried is now known as fried_rice14:35
mriedemi'm also not sure why,14:37
mriedembecause of https://github.com/openstack/nova/blob/a6963fa6858289d048e4d27ce8e61637cd023f4c/nova/compute/api.py#L332914:37
*** dtantsur is now known as creepy_owlet14:37
mriedemwe should blow up here https://github.com/openstack/nova/blob/a6963fa6858289d048e4d27ce8e61637cd023f4c/nova/conductor/manager.py#L1009 with an old request spec14:38
mriedembut i modified a functional test that hits that code and it doesn't blow pu14:38
mriedem*up14:38
*** sdake has joined #openstack-nova14:38
mriedemoh i see why14:38
mriedemhttps://github.com/openstack/nova/blob/a6963fa6858289d048e4d27ce8e61637cd023f4c/nova/compute/api.py#L3329 has no effect on save14:39
*** markvoelker has joined #openstack-nova14:39
mriedemhttps://github.com/openstack/nova/blob/a6963fa6858289d048e4d27ce8e61637cd023f4c/nova/objects/request_spec.py#L619.14:40
*** sdake has quit IRC14:42
*** sdake has joined #openstack-nova14:43
*** mchlumsky has joined #openstack-nova14:44
*** sridharg has quit IRC14:44
bauwsermriedem: yeah, most of the problems with the persisted fields in the ReqSpec is because we late call .save() sometimes or not14:46
openstackgerritSurya Seetharaman proposed openstack/nova master: Plumbing for ignoring list_records_by_skipping_down_cells  https://review.openstack.org/63512114:46
openstackgerritSurya Seetharaman proposed openstack/nova master: Plumbing for allowing the all-tenants filter with down cells  https://review.openstack.org/63514514:46
openstackgerritSurya Seetharaman proposed openstack/nova master: Plumbing required in servers ViewBuilder to construct partial results  https://review.openstack.org/63514614:46
openstackgerritSurya Seetharaman proposed openstack/nova master: API microversion 2.68: Handles Down Cells  https://review.openstack.org/59165714:46
openstackgerritSurya Seetharaman proposed openstack/nova master: API microversion 2.68: Handles Down Cells Documentation  https://review.openstack.org/63514714:46
bauwsermriedem: so the only way to make sure to not persist them is to verify if save() does it or not14:47
openstackgerritMohammed Naser proposed openstack/nova master: zuul: add cross-repo jobs for openstack-ansible  https://review.openstack.org/63585214:47
mriedemi would argue the root of our problems with the request spec is its dual nature - it's both a record of the original server create request (and modified on rebuild + new image and resize + new flavor), but also used as a parameter data bag to pass stuff to the scheduler for per-request operatoins like migrations14:47
mriedemand we don't deal with ^ very well14:47
bauwseryeah I agree with you14:48
mriedemif we would have just passed things like requested_destination through to the scheduler as a specific parameter we could have saved some trouble14:48
bauwserwell14:48
bauwsersure14:48
*** sdake has quit IRC14:48
cdentchange it?14:48
bauwserbut we had a consensus about not doing this 2 years ago ;)14:48
bauwserwe preferred to pass o.vo objects rathre :)14:49
mriedemsure, because 2 years ago no one anticipated the shit loads of bugs14:49
mriedemi'm not advocating a big overhaul since that will yield yet more bugs14:49
mriedemi just bemoan blowing off a two every time i try to stitch a finger back on14:49
mriedem*toe14:49
bauwserwell, maybe the analysis could be to say which fields should be persisted once and which ones not14:49
mriedembauwser: we already have that in the request spec14:50
mriedemand have been adding to it over time14:50
bauwserright14:50
mriedemhttps://github.com/openstack/nova/blob/a6963fa6858289d048e4d27ce8e61637cd023f4c/nova/objects/request_spec.py#L58714:50
mriedemhttps://github.com/openstack/nova/blob/a6963fa6858289d048e4d27ce8e61637cd023f4c/nova/objects/request_spec.py#L59314:50
*** janki has quit IRC14:50
mriedemgibi is already handling requested_resources so they aren't overwritten on save https://github.com/openstack/nova/blob/a6963fa6858289d048e4d27ce8e61637cd023f4c/nova/objects/request_spec.py#L51714:50
mriedemwe need to do the same for those other fields probably14:51
bauwserok14:51
bauwseryeah I guess14:51
bauwserlike the flavor14:51
bauwserwhen should we persist it?14:51
bauwserfor example, for resize14:51
mriedemflavor isn't in that list14:51
bauwsershould we persist the new flavor in the original ReqSpec ?14:51
bauwserI know14:51
*** sdake has joined #openstack-nova14:52
mriedemwe already do that here yeah https://github.com/openstack/nova/blob/a6963fa6858289d048e4d27ce8e61637cd023f4c/nova/conductor/manager.py#L36114:52
bauwserI guess so14:52
bauwserso14:52
bauwserwhat I'm trying to explain is that we basically fixed problems by each bug14:52
bauwserand then we modified the object14:52
bauwsermaybe we should just take some time to discuss about *all* the fields14:53
mriedemoh yeah and that flavor thing introduced a bug that was latent for a long time https://github.com/openstack/nova/blob/a6963fa6858289d048e4d27ce8e61637cd023f4c/nova/compute/api.py#L340314:53
bauwserright14:53
bauwserI'm just giving examples14:53
mriedemand i'm just venting14:53
bauwserso, honestly, the more I'm thinking14:53
bauwserthe more I wonder if we should have more than one RequestSpec for an instance :)14:53
bauwserie. the original record for create14:54
bauwserand then a new record for a move14:54
mriedemthe more i think about request spec, the less i want to think about request spec14:54
mriedemi want to get this bug fixed and move on14:54
bauwserhah14:54
bauwseranyway, I need to go to a meeting14:55
bauwser:/14:55
*** gary_perkins has quit IRC14:55
*** gary_perkins has joined #openstack-nova14:56
*** gary_perkins has quit IRC14:56
*** gary_perkins has joined #openstack-nova14:56
*** tbachman has quit IRC15:04
*** whoami-rajat has quit IRC15:04
*** markvoelker has quit IRC15:12
openstackgerritMatt Riedemann proposed openstack/nova master: Trim fake_deserialize_context in test_conductor  https://review.openstack.org/63585915:21
mriedemanother subunit parser thing ^ based on http://logs.openstack.org/27/619527/16/gate/openstack-tox-lower-constraints/cd2889d/job-output.txt.gz#_2019-02-08_12_32_26_10493415:21
mriedemdansmith: so wrt upgrades we just assert that conductor always goes before everything else yeah? and api is last. which is why if we're making changes to both api and conductor at the same time w/o changing rpc method interfaces, but like through fields on the RequestSpec (behavior changes), we aren't doing any strict version checking in the API to make sure conductor is new enough to handle that behavior change15:26
mriedemwe just assume that conductor will be upgraded before api15:26
dansmithmriedem: api isn't last, compute is last15:27
mriedemunlike how the api will check min versions on computes for behavior15:27
dansmithmriedem: we pretty much have to assume that conductor, scheduler, and api all go at the same time15:27
mriedemok but conductor is first15:27
*** remi_ness has joined #openstack-nova15:27
mriedemyeah15:27
mriedemwas just thinking about https://review.openstack.org/#/c/635668/2/nova/conductor/tasks/migrate.py@20015:27
mriedemwhich is changes to conductor based on changes the api will make to the request spec, which is all assumed to be upgraded at the same time15:28
dansmithyeah15:28
mriedemi must be having some sort of existential crisis this morning15:28
dansmithmriedem: go to your happy place15:29
*** Luzi has quit IRC15:29
*** spatel has joined #openstack-nova15:29
spatelsean-k-mooney: morning15:29
*** lpetrut has quit IRC15:29
*** lpetrut has joined #openstack-nova15:30
sean-k-mooneyspatel: o/15:30
spatelopenstack hypervisor stats show  command " count                | 179"   is this number of hypervisor right?15:30
melwittmriedem: looking at https://review.openstack.org/635859, is it that the assertions are constantly failing and being swallowed? is it bad that the assertions were failing?15:31
*** cdent has quit IRC15:31
*** whoami-rajat has joined #openstack-nova15:31
*** pcaruana has quit IRC15:31
spatelwhy hypervisor stats showing count 179  & "openstack hypervisor list" showing 19315:32
spatelwhich one i should consider right?15:32
spatelsean-k-mooney: ^15:32
spatelhttp://paste.openstack.org/show/744746/15:33
*** tbachman has joined #openstack-nova15:33
*** mlavalle has joined #openstack-nova15:36
mriedemmelwitt: yes and idk15:36
mriedemi do'nt know where the 'fake_user' is coming from b/c it's not coming from anything in test_conductor.py that i can tell15:37
mriedemi assume that any test which really cares about the context being serialized/deserialized is checking that explicitly, otherwise we use fake user/project ids all the time15:40
sean-k-mooneyspatel: i know you had that issue in the past but i can rememebr what it was again15:41
melwittmriedem: yeah, fair enough15:42
*** priteau has joined #openstack-nova15:51
*** lpetrut has quit IRC15:51
*** sdake has quit IRC15:52
*** tssurya has quit IRC15:52
*** sdake has joined #openstack-nova15:53
*** jangutter has quit IRC15:54
*** sdake has quit IRC15:56
*** sdake has joined #openstack-nova15:58
*** eharney has quit IRC15:58
spateli think stats output doing something which list not doing.. that is why its difference15:59
*** priteau has quit IRC16:00
*** cdent has joined #openstack-nova16:04
*** tbachman has quit IRC16:07
sean-k-mooneyspatel: the hypervior stats i think only show running vms16:08
*** jangutter has joined #openstack-nova16:08
*** _fragatina has quit IRC16:08
sean-k-mooneynova list will also show shelved instnaces and ones in error or power off state16:08
spatelif that is true then it make sense16:08
*** eharney has joined #openstack-nova16:09
spatellet me drill and see16:09
*** markvoelker has joined #openstack-nova16:09
sean-k-mooneyoh wait you are not asking about nova list16:11
sean-k-mooneyyou are asing about count in openstack hypervisor stats show vs the outpu of openstack hypervior list16:11
spatelyes count16:11
spatelnow you are on same page :)16:11
spatelsean-k-mooney: ^^16:12
*** TxGirlGeek has joined #openstack-nova16:12
sean-k-mooneyspatel: try openstack hypervisor list -c "Host IP" -c "Hypervisor Type" -f value | grep QEMU | sort | uniq | wc -l16:16
spatel19316:17
sean-k-mooneyok i was wondering if you had duplicate entries16:17
openstackgerritMatt Riedemann proposed openstack/nova master: Set the conductor indirection API when running nova-metadata under uwsgi  https://review.openstack.org/63557716:17
spateli verified already basic stuff16:18
*** tbachman has joined #openstack-nova16:18
spateli think openstack hypervisor stats show  ( only showing hypervisor in use )16:18
spatellet me do experiment and see... let me empty or spin up vm and see count change or not16:19
*** erlon has joined #openstack-nova16:21
sean-k-mooneyspatel: well teh api doces say it should the number of hyperviors16:22
sean-k-mooneyhttps://developer.openstack.org/api-ref/compute/?expanded=show-hypervisor-statistics-detail#show-hypervisor-statistics16:22
sean-k-mooneyso if it the number of active or in use hyperviors there is at least a docs bug16:22
spatellet me prove it and open bug16:23
spateldid you try to test these command in your cloud?16:23
mriedemdansmith: melwitt: i'm +2 on the bottom 3 down cell changes in that series now https://review.openstack.org/#/c/635120/16:24
sean-k-mooneyyes and they are the same16:24
mriedemsplitting those out from the big patch was definitely the way to go16:24
sean-k-mooneyill disabel a compute service and see if it changes16:24
sean-k-mooneyspatel: ok i can repoduce16:25
sean-k-mooneyif the comptue node is disabled hypervior stats does not report it16:25
sean-k-mooneyso that is a bug either in the code or in the docs16:26
spateloh!!!16:26
melwittmriedem: ack16:27
*** owalsh_ has joined #openstack-nova16:27
spatelsean-k-mooney: you are right!! i have around 10 or 12 disabled compute node16:28
sean-k-mooneyspatel: what release are you running again?16:28
spatelpike16:28
spatelsorry queens16:28
sean-k-mooneyi am not sure if we changed it in rocky or queens but we used to auto disable compute nodes after 3-5 failed builts without a successful build16:29
sean-k-mooneyif you manually did not disable them that coudl be the cause16:29
spateli didn't remember when and who did disable it.. but at least clear that stats not showing disable16:30
*** owalsh has quit IRC16:30
spatelDo you know how to list disable hypervisor from command line?16:31
*** owalsh_ is now known as owalsh16:32
dansmithmriedem: okay cool, glad to see that, I'll look a bit later16:32
*** tbachman has quit IRC16:35
*** tbachman has joined #openstack-nova16:37
*** gyee has joined #openstack-nova16:38
*** markvoelker has quit IRC16:43
sean-k-mooneyspatel: openstack compute service list16:47
*** hamzy has quit IRC16:47
spatelthanks16:48
*** eharney has quit IRC16:48
spatelsean-k-mooney:  179 + 14 (disable) = 19316:51
spatelI got my answer :) thanks16:52
*** ileixe has joined #openstack-nova16:53
sean-k-mooneyspatel: can you file a bug just so we dont forget16:55
sean-k-mooneyas i said we either should update the docs or the code16:56
*** manjeets_ is now known as manjeets17:00
spateli think we should update code and add one more row ( disabled compute node ) ;)17:02
*** wolverineav has joined #openstack-nova17:02
*** mcgiggler has quit IRC17:06
*** wolverineav has quit IRC17:07
*** dikonoor has quit IRC17:17
*** rpittau has quit IRC17:17
*** jangutter has quit IRC17:17
mriedemew another subunit parser giant log capture http://logs.openstack.org/27/619527/16/check/openstack-tox-py35/ab8a233/job-output.txt.gz#_2019-02-08_14_57_03_41558817:21
mriedemgross that's from o.vo17:21
mriedemso i suppose we need to set log levels to debug for oslo.versionedobjects and oslo.messaging in our test runs17:22
mriedems/debug/warning/17:22
mriedemalthough for oslo.messaging we're tracing exceptions in those conductor unit tests...17:22
sean-k-mooneymriedem: one question do we know what the cause is? i was wondering if it could be a locale issue or something like that17:22
melwittsean-k-mooney: I don't think so. see the comments in this earlier bug for more info https://bugs.launchpad.net/cinder/+bug/172864017:24
openstackLaunchpad bug 1728640 in Cinder "py35 unit test subunit.parser failures" [Critical,Fix released] - Assigned to Sean McGinnis (sean-mcginnis)17:24
mriedemi think the summary is we're sending a shit load of content to the subunit output stream capture which blows it up17:25
sean-k-mooneyya that was the other ting i was wondering but i guess that means we are not mocking out the loggers enough in the unit tests17:25
melwittyeah. from mtreinish: "we may be exceeding the max attachment size in subunit"17:26
melwitt(from a comment in that bug)17:26
sean-k-mooneyon the plus side if we do reduce the log output it will both help with  space on logs.openstack.org and maybe speed up the tests17:27
sean-k-mooneyall that io is proably slowing them down17:27
mriedemwell normally i don't think you get a lot of this output unless a test fails17:34
mriedemor the subunit parser blows up17:34
openstackgerritElod Illes proposed openstack/nova stable/queens: Handle IndexError in _populate_neutron_binding_profile  https://review.openstack.org/63589717:35
*** yan0s has quit IRC17:37
*** tbachman has quit IRC17:37
*** markvoelker has joined #openstack-nova17:40
*** jaypipes is now known as leakypipes17:43
*** creepy_owlet is now known as dtantsur|afk17:43
*** udesale has quit IRC17:44
*** sdake has quit IRC17:47
*** remi_ness has quit IRC17:50
*** ccamacho has quit IRC17:50
*** derekh has quit IRC17:53
*** tbachman has joined #openstack-nova17:56
mnasermriedem, cdent, dansmith: https://review.openstack.org/#/c/635852/ has an openstack ansible cross repo job (which you can see installs from the zuul cloned nova -- http://logs.openstack.org/52/635852/1/check/nova-openstack-ansible-cross-repo/9738be9/logs/ara-report/result/113b6602-4a28-4512-964b-4174593eb507/ "Processing /home/zuul/src/git.openstack.org/openstack/nova")17:59
mnaseri will add another tox env which will run it making sure that we *skip* placement deploy to merge that eventually17:59
mnaserand then the normal functional test will run *with* out-of-repo placement18:00
cdentawesome, thanks18:00
cdentI'll look more closely soon, probably monday18:02
dansmithmriedem: should I not nit out over the presumptive microversion comment? https://review.openstack.org/#/c/635121/418:06
*** ociuhandu_ has joined #openstack-nova18:08
*** jmlowe has quit IRC18:11
*** ociuhandu has quit IRC18:11
*** markvoelker has quit IRC18:13
*** ociuhandu_ has quit IRC18:13
*** hamzy has joined #openstack-nova18:14
*** remi_ness has joined #openstack-nova18:20
*** hamzy has quit IRC18:22
*** wolverineav has joined #openstack-nova18:22
*** ociuhandu has joined #openstack-nova18:23
*** wolverineav has quit IRC18:23
*** wolverineav has joined #openstack-nova18:24
*** hamzy has joined #openstack-nova18:25
*** chhagarw has quit IRC18:25
*** ociuhandu has quit IRC18:27
*** wolverineav has quit IRC18:31
*** wolverineav has joined #openstack-nova18:32
*** mdbooth_ has quit IRC18:33
*** wolverineav has quit IRC18:34
*** wolverineav has joined #openstack-nova18:34
*** whoami-rajat has quit IRC18:34
*** eharney has joined #openstack-nova18:38
*** ociuhandu has joined #openstack-nova18:49
*** hamzy has quit IRC18:50
*** wolverineav has quit IRC18:50
*** ociuhandu has quit IRC18:55
*** hamzy has joined #openstack-nova18:58
*** tesseract has quit IRC19:09
*** markvoelker has joined #openstack-nova19:10
*** hamzy has quit IRC19:10
aspiersis there a reason that the trait string values in this dict are not referenced using os_traits constants? http://git.openstack.org/cgit/openstack/nova/tree/nova/virt/libvirt/utils.py#n4919:10
*** hamzy has joined #openstack-nova19:11
aspierswouldn't it be helpful to have the compile-time checks resulting from using os_traits? or am I misunderstanding something?19:11
*** erlon has quit IRC19:12
cdentaspiers: I think it's a matter of "didn't happen yet"19:13
aspierscdent: so a patch would be gratefully received? :)19:13
cdentask fried_rice or leakypipes to confirm, but I suspect so19:14
aspiersOK thanks19:14
cdentI'm not savvy to that section of the coe19:14
cdentand it is dinner time19:14
* cdent waves19:14
*** cdent has quit IRC19:14
*** wolverineav has joined #openstack-nova19:16
openstackgerritCorey Bryant proposed openstack/nova master: xenapi/agent: Change openssl error handling  https://review.openstack.org/63553319:16
*** ociuhandu has joined #openstack-nova19:18
cfriesenIf I were to request a release of os-traits (in order to make use of the new vTPM traits) would I ask for release 0.10.1 or 0.11.0?19:22
melwittnew traits = "new features" so a minor version bump19:23
aspiersmelwitt: speaking of traits, do you have any thoughts on the above? I can submit a review easily19:23
leakypipesaspiers: no reason other than legacy I think... I'd welcome a cleanup patch.19:25
melwittok, good. I was about to say, I don't know and I'd ask jay19:25
aspiers:)19:25
aspiersleakypipes, melwitt: coming in about 15 seconds ...19:25
cfriesenaspiers: I see you just added some stuff to os-traits...were you planning on requesting a new release?19:25
openstackgerritAdam Spiers proposed openstack/nova master: Convert CPU_TRAITS_MAPPING to use os_traits  https://review.openstack.org/63591919:26
aspierscfriesen: don't need one urgently yet - still working on the code to consume the new trait :)19:26
cfriesenaspiers: I'm in the same boat, just don't want to get caught waiting too long19:26
aspierscfriesen: fair enough19:26
*** mriedem has quit IRC19:27
aspiersleakypipes, melwitt: added you as reviewers19:27
*** mriedem has joined #openstack-nova19:27
mriedemdansmith: yeah good point, that should move19:28
*** sdake has joined #openstack-nova19:28
*** wolverineav has quit IRC19:28
dansmithI shall convert19:28
dansmithI shall wait until you drop your +219:28
melwittaspiers: ack19:28
mriedemdansmith: already done19:28
dansmithmriedem: I shall be already done as well19:28
mriedemdansmith: are you just going to move it to https://review.openstack.org/#/c/591657/ ?19:28
openstackgerritElod Illes proposed openstack/nova stable/pike: Handle IndexError in _populate_neutron_binding_profile  https://review.openstack.org/63592119:29
*** wolverineav has joined #openstack-nova19:29
dansmithmriedem: am I?19:30
aspiersleakypipes: just checking IIUC: is update_provider_tree() the right place to add a call to new code which tests for SEV support and then calls provider_tree.add_traits() if support is found?19:31
aspiersleakypipes: I guess _get_cpu_traits() might be the other candidate, but that seems dependent on the guest CPU mode, which I don't think we want for SEV19:31
mriedemdansmith: i'm not sure what 'convert' meant19:32
mriedemoh -1?19:32
dansmithmriedem: heh yeah, convert my vote19:32
* aspiers reads update-provider-tree.rst in an attempt to understand this properly19:32
mriedemah i see19:32
mriedemsaved my sweet sweet stats sheet19:32
mriedema true gentleman19:33
* dansmith bows19:33
mriedemaspiers: yes upt19:33
mriedemto set inventory/aggregates/traits/etc19:33
aspiersmriedem: thanks!19:33
mriedemaspiers: fried_rice is your captain for upt19:33
aspiersgot it :)19:33
aspiershmm, that nick is making me hungry19:33
*** wolverineav has quit IRC19:34
*** BjoernT has joined #openstack-nova19:35
*** wolverineav has joined #openstack-nova19:35
*** wolverineav has quit IRC19:36
*** wolverineav has joined #openstack-nova19:36
*** hamzy has quit IRC19:37
*** hamzy has joined #openstack-nova19:38
*** BjoernT_ has joined #openstack-nova19:38
*** BjoernT has quit IRC19:40
*** erlon has joined #openstack-nova19:40
*** markvoelker has quit IRC19:44
*** zul has quit IRC19:45
*** BjoernT has joined #openstack-nova19:45
*** BjoernT_ has quit IRC19:47
*** mgoddard has quit IRC19:50
*** mgoddard has joined #openstack-nova19:51
aspiersleakypipes, fried_rice, mriedem: I'm wondering if it makes sense to detect SEV support in get_available_resource(), possibly under data["cpu_info"]19:53
mriedemfor what reason?19:53
aspiersfor one, so it's visible via the API19:54
mriedemit is visible the API,19:54
mriedemthe placement API19:54
mriedemas a trait on the compute node resource provider19:54
aspiersright, but not via "openstack hypervisor show" IIUC?19:55
mriedemwe're not trying to game all new traits into the old hypervisor stats API19:55
mriedemcorrect19:55
mriedemand that's ok19:55
mriedemin the long long future the hypervisor stats/show stuff could be proxied to placement19:55
aspiersah OK, so the idea is to move away from the old API?19:55
aspiersgot it19:55
aspiersthat thought arose because the get_domain_capabilities() I've added sits next to get_capabilities() https://review.openstack.org/#/c/633855/1/nova/virt/libvirt/host.py19:56
aspierswhich is currently called from _get_cpu_info()19:56
mriedembut you can also get that via update_provider_tree yes?19:57
mriedemself.host.get_domain_capabilities()19:57
aspiersyup19:57
mriedemif 'sev' in caps: add_my_trait()19:57
aspiersmakes sense, thanks!19:57
mriedemthe cpu feature flag stuff sort of works like that19:57
*** wolverineav has quit IRC19:58
fried_riceaspiers: Give me a bit, I'm on a call, but - yes, at a glance, it makes sense to me that SEV support would be discovered and the trait injected in update_provider_tree.19:58
*** sdake has quit IRC19:59
aspiersfried_rice: cool, thanks!19:59
aspiersI need to grab some dinner19:59
aspiersback in a bit19:59
*** wolverineav has joined #openstack-nova19:59
fried_riceaspiers: Or, during init_host, add it to the virt driver's capabilities dict.19:59
*** sdake has joined #openstack-nova19:59
fried_ricebut that relies on a) an in-flight patch from mriedem that converts those to traits on the compute RP, and b) making the capabilities dict an instance var on the relevant virt drivers, like PowerVM has.20:00
aspiersinteresting, I'll check that out20:02
fried_riceaspiers: a) is https://review.openstack.org/#/c/538498/20:02
mriedem"in-flight"20:03
mriedemmore like crash landed20:03
aspiersLOL :)20:03
*** eharney has quit IRC20:03
cfriesenmelwitt: fried_rice:  if we're using the "cycle-with-intermediary" library pattern for os-traits, shouldn't there have been a release already after stein-2?20:03
*** wolverineav has quit IRC20:04
fried_riceaspiers: b) is visible in the out-of-tree PowerVM driver where we set a capability depending on which disk driver we're using: https://github.com/openstack/nova-powervm/blob/master/nova_powervm/virt/powervm/driver.py#L175-L18120:04
melwittcfriesen: yes. I had thought the release team was going to propose them but it looked like they didn't20:05
fried_ricecfriesen: I wouldn't expect os-traits releases to be a big deal wrt milestones, but whatevs.20:05
cfriesenfried_rice: not that it's a big deal, but according to http://lists.openstack.org/pipermail/openstack-dev/2018-October/135689.html it was going to be automatic20:05
fried_ricegotcha20:05
melwittthey did a release of os-traits at s-1 but not for s-220:05
aspiersfried_rice: in case you're interested, this is the first step towards detection of SEV support which will be consumed by the code which provides the new trait20:06
aspiershttps://review.openstack.org/#/c/633855/20:06
fried_ricewere there changes between m-1 and m-2?20:06
melwittyeah, I wondered if maybe there weren't20:06
fried_riceaspiers: ack, I've had that spec on my list for yonks. hope to get around to reading it eventually ...20:06
aspiersfried_rice: thanks a lot for all the info, I'll take a look20:06
aspiershehe20:07
aspiersOK, I really REALLY need dinner now. bbl ;-)20:07
cfriesenmelwitt: what was the exact cutoff?  the vTPM stuff went in on Jan 8, and there was a minor change on Jan 520:07
cfriesenanyways, I'll propose a release20:08
melwittnot sure. smcginnis, do you know how the auto release works? we noticed there wasn't an automatic release proposed for os-traits at s-220:08
*** sdake has quit IRC20:09
*** sdake has joined #openstack-nova20:11
*** sdake has quit IRC20:13
*** sdake has joined #openstack-nova20:14
*** BjoernT_ has joined #openstack-nova20:14
*** BjoernT has quit IRC20:16
melwittyeah, I don't find any auto-proposed releases for s-2 like this one from s-1 https://review.openstack.org/61284320:16
*** hongbin has joined #openstack-nova20:19
*** ociuhandu has quit IRC20:20
*** hamzy has quit IRC20:21
*** trident has quit IRC20:21
*** trident has joined #openstack-nova20:22
*** trident has quit IRC20:34
*** trident has joined #openstack-nova20:35
*** _hemna has quit IRC20:36
*** markvoelker has joined #openstack-nova20:40
*** sdake has quit IRC20:44
*** sdake has joined #openstack-nova20:47
*** whoami-rajat has joined #openstack-nova20:48
*** dave-mccowan has quit IRC20:50
*** dave-mccowan has joined #openstack-nova20:53
smcginnismelwitt, cfriesen: Were there more than 1 or 2 non-zuul, functional changes? It's possible it was accidentally skipped if it didn't look like there were really changes to get out.20:58
*** hamzy has joined #openstack-nova20:59
cfriesensmcginnis: one actual change went in on jan 8, so maybe that was it.20:59
smcginnisActually, looks like that didn't merge until the 11th, so it was most likely after we checked.21:00
smcginnishttps://review.openstack.org/#/c/629299/21:00
melwittsmcginnis: there was one functional change, I think. I tried a gerrit search for project:openstack/releases message:"stein milestone-2" and didn't find any other auto-generated releases21:01
melwitt(unless the commit message format changed)21:01
smcginnisI can't remember if we used "stein milestone-2" in the commit messages for those.21:02
melwittok, I was curious if any other project got an auto-proposed release for s-2 but didn't know how to find21:05
melwittit was nice having it for s-1 anyway :)21:06
melwittmriedem: can you sanity check me, is this backward incompatible, the 'only_contrib' removal? it looks to me like it's removed but not backward incompat https://github.com/openstack/python-novaclient/compare/11.1.0...master21:10
*** markvoelker has quit IRC21:12
mriedemno it's not, so a minor version bump at least21:13
mriedemthat warning has been there since pike i think21:14
mriedemi also don't know if that discover_extensions() thing is an external interface on the client at all21:14
mriedemso not backward compatible but also meh21:14
melwittyeah, you know, that is ringing a bell that some project was calling discover_extensions() externally21:16
melwittlooks like lots of stuff actually. heat, cinder, neutron21:18
*** dave-mccowan has quit IRC21:18
melwittkarbor, masakari, osc21:18
*** ociuhandu has joined #openstack-nova21:19
openstackgerritMatt Riedemann proposed openstack/nova master: Add FinishResizeAtDestTask  https://review.openstack.org/63564621:19
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Execute CrossCellMigrationTask from MigrationTask  https://review.openstack.org/63566821:19
openstackgerritMatt Riedemann proposed openstack/nova master: WIP: Plumb allow_cross_cell_resize into compute API resize()  https://review.openstack.org/63568421:19
mriedemyeah i guess http://codesearch.openstack.org/?q=%5C.discover_extensions&i=nope&files=&repos=21:20
mriedemnot sure why, it doesn't do anything anymore as far as i know21:20
mriedemas in novaclient doesn't have 'extensions' anymore21:20
melwittyeah. probably been there forever21:22
mriedemdansmith: if i fix that issue in tssurya's patch quick are you ok with approving any of those bottom changes yet today or just wait for monday?21:22
openstackgerritCorey Bryant proposed openstack/nova master: xenapi/agent: Change openssl error handling  https://review.openstack.org/63553321:22
dansmithmriedem: I stopped when I got to that and asked you about it, then got distracted21:23
dansmithmriedem: but yeah, if you fix that quick I'll hit that one at least and see what the next one looks like21:23
mriedemok21:23
*** ociuhandu has quit IRC21:24
openstackgerritMatt Riedemann proposed openstack/nova master: Plumbing for ignoring list_records_by_skipping_down_cells  https://review.openstack.org/63512121:27
openstackgerritMatt Riedemann proposed openstack/nova master: Plumbing for allowing the all-tenants filter with down cells  https://review.openstack.org/63514521:27
openstackgerritMatt Riedemann proposed openstack/nova master: Plumbing required in servers ViewBuilder to construct partial results  https://review.openstack.org/63514621:27
openstackgerritMatt Riedemann proposed openstack/nova master: API microversion 2.68: Handles Down Cells  https://review.openstack.org/59165721:27
openstackgerritMatt Riedemann proposed openstack/nova master: API microversion 2.68: Handles Down Cells Documentation  https://review.openstack.org/63514721:27
dansmithdamit mriedem21:27
mriedemsheesh21:28
mriedemfull rebasearro21:28
mriedem*rebasearoo21:28
melwittactually I think this should be a major bump because of the removal of those contrib modules. in case anyone was using them?21:29
openstackgerritMatt Riedemann proposed openstack/nova master: Modify InstanceMappingList.get_not_deleted_by_cell_and_project()  https://review.openstack.org/63512021:29
openstackgerritMatt Riedemann proposed openstack/nova master: Plumbing for ignoring list_records_by_skipping_down_cells  https://review.openstack.org/63512121:29
openstackgerritMatt Riedemann proposed openstack/nova master: Plumbing for allowing the all-tenants filter with down cells  https://review.openstack.org/63514521:29
openstackgerritMatt Riedemann proposed openstack/nova master: Plumbing required in servers ViewBuilder to construct partial results  https://review.openstack.org/63514621:29
openstackgerritMatt Riedemann proposed openstack/nova master: API microversion 2.68: Handles Down Cells  https://review.openstack.org/59165721:29
openstackgerritMatt Riedemann proposed openstack/nova master: API microversion 2.68: Handles Down Cells Documentation  https://review.openstack.org/63514721:29
mriedemmelwitt: whatever you want21:29
melwittgoing to play it safe21:29
dansmithmriedem: okay hit the bottom two, have the third up for when I finish something21:30
mriedemcool21:30
mriedemtime for me to start my think friday21:31
*** BjoernT_ has quit IRC21:31
dansmithoh man, forgot about think friday21:32
melwittos-vif has been released a billion times so I don't need to do that21:34
*** sdake has quit IRC21:58
openstackgerritMatt Riedemann proposed openstack/nova master: API: Remove evacuate/live-migrate 'force' parameter  https://review.openstack.org/63460022:09
*** remi_ness has quit IRC22:09
*** markvoelker has joined #openstack-nova22:10
*** TxGirlGeek has quit IRC22:11
dansmithmriedem: okay got N-322:17
dansmiththe actual microversion patch is like half the size now, which is oh so much better22:18
mriedemyeah22:19
mriedemand most of it is samples22:19
*** wolverineav has joined #openstack-nova22:19
dansmithyeah22:20
mriedemwelp it's 4:20, too late to start think friday now22:20
*** wolverineav has quit IRC22:23
*** wolverineav has joined #openstack-nova22:23
*** remi_ness has joined #openstack-nova22:26
*** wolverineav has quit IRC22:28
*** wolverineav has joined #openstack-nova22:32
*** remi_ness has quit IRC22:35
fried_riceo ovo wizards, remind me what the idiom is for getting extra specs out of a flavor obj22:37
fried_riceif 'extra_specs' in flavor:22:38
fried_rice  extra_specs = flavor.extra_specs22:38
fried_rice?22:38
*** hongbin has quit IRC22:38
mriedemanyone want to drop the nova-multiattach job from nova changes? https://review.openstack.org/#/c/606981/22:38
mriedemfried_rice: yes, but i think it's always there22:38
mriedemreturn cls._from_db_object(context, cls(context), db_flavor,22:39
mriedem                                   expected_attrs=['extra_specs'])22:39
fried_riceapparently not, at least in test: http://logs.openstack.org/43/631243/8/check/openstack-tox-py27/e61ba3b/testr_results.html.gz22:39
mriedemunit tests not withstanding22:39
fried_ricemaybe the test is just borked.22:39
mriedemyeah in real runtime code the flavor would have the extra specs loaded on get from the db22:39
fried_ricecan it be None?22:40
mriedemis the field marked as nullable=True?22:40
fried_rice...22:40
mriedem63124322:40
mriedemoops22:40
mriedem'extra_specs': fields.DictOfStringsField(),22:40
mriedemno22:40
mriedemso it's not nullable22:40
mriedemif it's set, it's not None22:40
mriedemand cannot be set to None22:40
fried_rice(Whether it is or not, I've learned not to trust my intuition when it comes to db objs and ovos)22:41
mriedemyou're usually pretty safe unless it's RequestSpec22:41
mriedemthen you're in for a world of pain22:41
fried_riceokay, so it's always legal to say flavor.extra_specs.get('some_key') and not have to dork with checking whether extra_specs is a) present, b) a dict?22:41
mriedemit's alwasy a dict22:41
fried_riceight.22:41
mriedemin runtime code it should be present22:41
*** markvoelker has quit IRC22:42
mriedemyeah this is wonky https://review.openstack.org/#/c/631243/8/nova/objects/flavor.py@23122:43
mriedemthat could just be self.extra_specs.get('accel:device_profile')22:43
fried_riceyeah, that's what I'm ripping on.22:43
openstackgerritAdam Spiers proposed openstack/nova master: Add detection of SEV support from QEMU/AMD-SP/libvirt on AMD hosts  https://review.openstack.org/63385522:43
aspiersfried_rice: thanks for the recheck - is the dsvm-nova gate broken, or is my code? ... or both? X-D22:44
aspiersI can't get through to the NSX CI logs22:44
fried_riceaspiers: hanging on by one rusty hinge22:44
aspiershehe22:45
fried_riceit's not your code22:45
fried_riceif your code were a problem, the whole CI would be red22:45
openstackgerritMatt Riedemann proposed openstack/nova master: neutron: make migrate_instance_finish call setup_instance_network_on_host  https://review.openstack.org/63534322:45
fried_rice(for that patch)22:45
aspiersyeah I guess22:46
openstackgerritMatt Riedemann proposed openstack/nova master: neutron: make migrate_instance_finish call setup_instance_network_on_host  https://review.openstack.org/63534322:46
*** panda has quit IRC22:46
fried_ricemriedem: Um, you said something about RequestSpec being problematic?22:47
fried_riceYou mean if I'm trying to do this on RequestSpec fields themselves, or if I'm trying to pull RequestSpec.flavor.extra_specs.get('something') ?22:48
openstackgerritMatt Riedemann proposed openstack/nova master: Follow up (#2) for the bw resource provider series  https://review.openstack.org/63476722:48
mriedemfried_rice: i'm just be facetious22:48
mriedemsee my request spec rant this morning22:48
fried_riceemphasis on feces.22:49
mriedemHI-O!22:49
fried_riceso this is just using fake_spec_obj, which exists previously https://review.openstack.org/#/c/631243/8/nova/tests/unit/scheduler/test_device_profile.py22:49
*** panda has joined #openstack-nova22:49
fried_ricebut apparently trying to pull extra specs out of that with spec_obj.flavor.get('extra_specs') is blowing up.22:50
fried_rice(in test.)22:50
mriedemreq_obj.flavor = fake_flavor.fake_flavor_obj(ctxt)22:51
mriedemmy guess is there is a problem in how that sets the extra_specs on that fake Flavor object22:52
mriedemyup22:52
mriedem'extra_specs' needs to be in expected_attrs22:52
mriedemhttps://github.com/openstack/nova/blob/master/nova/objects/flavor.py#L25822:53
mriedemextra_specs is a joined column so that fake_flavor_obj code is a bit misleading22:53
fried_riceand that always happens in real life, so that test code ought to be updated accordingly?22:54
mriedemyes22:54
mriedemhttps://github.com/openstack/nova/blob/master/nova/tests/unit/fake_request_spec.py#L7822:54
mriedemshould pass expected_attrs=['extra_specs']22:54
mriedemor fake_flavor_obj should just default to extra_specs if expected_attrs is empty22:54
mriedemb/c that's what the get from db methods in the object do https://github.com/openstack/nova/blob/master/nova/objects/flavor.py#L37822:55
fried_riceyeah, this fixes:22:55
fried_rice--- a/nova/tests/unit/fake_flavor.py22:55
fried_rice+++ b/nova/tests/unit/fake_flavor.py22:55
fried_rice@@ -50,7 +50,7 @@ def fake_db_flavor(**updates):22:55
fried_rice22:55
fried_rice22:55
fried_rice def fake_flavor_obj(context, **updates):22:55
fried_rice-    expected_attrs = updates.pop('expected_attrs', None)22:55
fried_rice+    expected_attrs = updates.pop('expected_attrs', ['extra_specs'])22:55
fried_rice     return objects.Flavor._from_db_object(context,22:55
fried_rice                objects.Flavor(), fake_db_flavor(**updates),22:55
fried_rice                expected_attrs=expected_attrs)22:55
mriedem++22:55
*** wolverineav has quit IRC23:02
*** wolverineav has joined #openstack-nova23:02
*** spatel has quit IRC23:03
openstackgerritMatt Riedemann proposed openstack/nova master: Share snapshot image membership with instance owner  https://review.openstack.org/63076923:06
*** whoami-rajat has quit IRC23:08
*** wolverineav has quit IRC23:09
*** wolverineav has joined #openstack-nova23:11
*** wolverineav has quit IRC23:16
*** wolverineav has joined #openstack-nova23:16
*** wolverineav has quit IRC23:17
mriedemjroll: just a reminder that when https://review.openstack.org/#/c/635006/ is ready to go for wider review to throw it in the runways queue https://etherpad.openstack.org/p/nova-runways-stein23:18
*** wolverineav has joined #openstack-nova23:18
aspiersfried_rice, mriedem: was trying to understand the discussion around https://review.openstack.org/#/c/538498/ and it seems one point of debate was the corner case where a trait might need to be removed from a node, right?23:20
aspiersfried_rice, mriedem: FWIW, that is not too unlikely with SEV23:20
fried_riceaspiers: The basic idea is that there are some traits that are "owned" by compute, and any others are not.23:21
aspiersIt could be triggered by a downgrade of the kernel or QEMU or libvirt, or by disabling the sev option in the kvm_amd kernel module23:21
aspiersfried_rice: yeah I got that, and I presume that the SEV trait would be owned by compute23:21
fried_riceIf a trait is owned by compute, you can't (un)set it as an operator or whatever. Next periodic will restore it to its "proper" (according to compute) value.23:22
aspierssure23:22
fried_riceso if your trait is owned by compute, all you have to worry about is whether it needs to be set or not, and do that.23:22
fried_riceIf you need to be able to do that *without* compute service restarts, then I recommend doing it in update_provider_tree, not via a driver capability.23:22
aspiersMy point is that SEV requires support all the way up the stack, and if one link in the chain vanishes, then the trait would have to be removed. So that code under review does have to correctly handle that case, as you were saying in the discussion23:23
aspiersI don't think it needs to happen without nova-compute restart23:23
aspiersIt's not gonna be a regular occurrence at all23:23
fried_riceoh, you're worried about whether I'm right to -1 mriedem's patch?? Of *course* I am!23:23
fried_riceI've *never* -1'd a mriedem patch and been *wrong* about it!23:24
*** slaweq has quit IRC23:24
fried_riceaspiers: Are you looking to take over that patch and make it go? That would be appreciated, I think, by me & mriedem and others.23:24
aspiershaha23:24
fried_riceyou're referring to https://review.openstack.org/#/c/538498/7/nova/compute/resource_tracker.py@962 ?23:25
aspiersfried_rice: I like the idea in principal, but the reality is that I'm *hopelessly* new to all of this code so I worry it would take me far too long to figure out23:25
*** wolverineav has quit IRC23:25
aspiersyeah that was part of the discussion I was referring to23:26
fried_riceaspiers: you're demonstrating an understanding that's certainly adequate to where you'd be capable of making this patch go. Matt and I would be available to advise if you got stuck.23:26
aspiersfried_rice: maybe I'm just a good bluffer ;-)23:26
fried_riceSo yeah, I'm +2 on this patch if that condition is removed. (And also rebase, and also test fixups, I think)23:27
mriedemthe trick on that thing is really just functional testing the scenarios23:27
mriedem1. compute reports traits via driver capabilities, user removes them externally, run periodic and they come back23:27
mriedem2. user externally sets traits and compute periodic doesn't remove them23:28
mriedem3. driver reports traits in t0, then at t1 doesn't report the trait, so it's removedd23:28
mriedemsomething like that23:28
fried_rice++23:28
fried_ricethe patch already has a start on that stuff.23:28
mriedemonce the functional test scenarios are in place then the code should be pretty straight-forward23:28
aspiersI see23:28
fried_ricehttps://review.openstack.org/#/c/538498/7/nova/tests/functional/test_servers.py23:28
aspiersyeah, looking at that23:29
mriedemwith that it's 5:30 and i need to shove off23:29
fried_riceo/23:29
mriedemi hope y'all will do the same23:29
*** mriedem has quit IRC23:29
aspiersit's 11:30pm here :-/23:29
fried_riceI'm going to rip apart Sundar's PoC a little more.23:29
fried_riceWhere in the build flow do neutron ports get bound?23:30
aspiersit looks like it doesn't yet test the behaviour of a driver-reported trait being removed, right?23:30
fried_riceaspiers: I think it only really tests that capabilities are converted to traits, stuffed onto the compute rp, and new custom ones are vivified in placement.23:32
fried_ricethat would be scenario 0 in mriedem's list above.23:32
aspiersok23:32
fried_riceSo 1, 2, and 3 all still need to be implemented.23:32
aspiersgot it23:33
fried_riceI guess the existing code is mriedem's scenario 1 before the first comma.23:33
*** sdake has joined #openstack-nova23:33
aspiersI see23:36
*** wolverineav has joined #openstack-nova23:44

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!