*** jaypipes has quit IRC | 00:09 | |
*** slaweq has joined #openstack-nova | 00:11 | |
*** takashin has joined #openstack-nova | 00:17 | |
*** hamzy has joined #openstack-nova | 00:20 | |
*** slaweq has quit IRC | 00:24 | |
*** brinzhang has joined #openstack-nova | 00:27 | |
*** dave-mccowan has joined #openstack-nova | 00:32 | |
*** markvoelker has quit IRC | 00:33 | |
*** dave-mccowan has quit IRC | 00:35 | |
*** efried has quit IRC | 00:37 | |
*** ricolin_ has joined #openstack-nova | 00:44 | |
*** efried has joined #openstack-nova | 00:45 | |
*** wwriverrat has quit IRC | 00:48 | |
openstackgerrit | Tony Breeds proposed openstack/nova stable/queens: Delete allocations even if _confirm_resize raises https://review.opendev.org/652153 | 00:50 |
---|---|---|
openstackgerrit | Tony Breeds proposed openstack/nova stable/queens: [stable-only] Delete allocations even if _confirm_resize raises (part 2) https://review.opendev.org/661349 | 00:52 |
openstackgerrit | Tony Breeds proposed openstack/nova stable/queens: Add functional confirm_migration_error test https://review.opendev.org/658136 | 00:54 |
*** itlinux has joined #openstack-nova | 00:55 | |
*** minmin has joined #openstack-nova | 01:07 | |
*** tetsuro has joined #openstack-nova | 01:12 | |
*** slaweq has joined #openstack-nova | 01:16 | |
*** guozijn has joined #openstack-nova | 01:19 | |
openstackgerrit | Yikun Jiang proposed openstack/nova master: Fix the server group "policy" field type in api-ref https://review.opendev.org/661869 | 01:19 |
yikun | ^ mriedem, Yes, I think it's a api-ref bug. And I also saw why it happened: it came from original patch PS31~32 [1], the policy code had been change from "object" to "string", but I forgot to change the api-ref together. | 01:20 |
yikun | [1] https://review.opendev.org/#/c/567534/31..32/doc/api_samples/os-server-groups/v2.64/server-groups-post-req.json | 01:20 |
*** slaweq has quit IRC | 01:24 | |
*** itlinux has quit IRC | 01:37 | |
*** itlinux has joined #openstack-nova | 01:45 | |
*** boxiang has joined #openstack-nova | 01:45 | |
*** hongbin has quit IRC | 01:51 | |
*** itlinux has quit IRC | 01:56 | |
*** Spencer_Yu has joined #openstack-nova | 01:57 | |
*** BjoernT has joined #openstack-nova | 02:08 | |
*** BjoernT has quit IRC | 02:08 | |
*** slaweq has joined #openstack-nova | 02:11 | |
*** BjoernT has joined #openstack-nova | 02:22 | |
*** bbowen has joined #openstack-nova | 02:24 | |
*** slaweq has quit IRC | 02:25 | |
*** itlinux has joined #openstack-nova | 02:25 | |
*** BjoernT_ has joined #openstack-nova | 02:27 | |
*** BjoernT has quit IRC | 02:29 | |
*** markvoelker has joined #openstack-nova | 02:34 | |
*** JamesBenson has joined #openstack-nova | 02:44 | |
*** tetsuro has quit IRC | 02:45 | |
*** cfriesen has quit IRC | 02:47 | |
*** tetsuro has joined #openstack-nova | 02:51 | |
*** tetsuro has quit IRC | 02:55 | |
*** tetsuro has joined #openstack-nova | 02:55 | |
openstackgerrit | Guo Jingyu proposed openstack/nova master: Define and catch QemuGuestAgentNotRunning for set-password failure https://review.opendev.org/661466 | 02:57 |
*** lbragstad has quit IRC | 02:58 | |
*** BjoernT_ has quit IRC | 03:00 | |
*** tetsuro has quit IRC | 03:01 | |
*** panda|ruck has quit IRC | 03:03 | |
*** panda has joined #openstack-nova | 03:03 | |
*** markvoelker has quit IRC | 03:08 | |
*** tetsuro has joined #openstack-nova | 03:09 | |
*** slaweq has joined #openstack-nova | 03:11 | |
*** tetsuro has quit IRC | 03:12 | |
*** tetsuro has joined #openstack-nova | 03:20 | |
*** tetsuro has quit IRC | 03:24 | |
*** slaweq has quit IRC | 03:25 | |
openstackgerrit | guangchao.pan proposed openstack/nova master: Add a name for the automatically created volume https://review.opendev.org/660096 | 03:25 |
*** threestrands has joined #openstack-nova | 03:31 | |
*** igordc has quit IRC | 03:40 | |
*** altlogbot_0 has quit IRC | 03:44 | |
*** altlogbot_3 has joined #openstack-nova | 03:45 | |
*** psachin has joined #openstack-nova | 03:48 | |
*** minmin has quit IRC | 03:49 | |
*** ykarel|away has joined #openstack-nova | 03:53 | |
*** ykarel|away has quit IRC | 03:53 | |
*** ykarel|away has joined #openstack-nova | 03:55 | |
*** ykarel|away has quit IRC | 03:55 | |
openstackgerrit | Merged openstack/nova master: Use run_immediately=True for _cleanup_running_deleted_instances https://review.opendev.org/657132 | 03:56 |
openstackgerrit | Merged openstack/nova master: Remove 'instance_update_from_api' https://review.opendev.org/651302 | 03:56 |
openstackgerrit | Merged openstack/nova master: Stop handling 'update_cells' on 'BandwidthUsage.create' https://review.opendev.org/651303 | 03:56 |
openstackgerrit | Merged openstack/nova master: Stop handling cells v1 for instance naming https://review.opendev.org/651304 | 03:56 |
openstackgerrit | Merged openstack/nova master: Remove cells code https://review.opendev.org/651306 | 03:56 |
openstackgerrit | Merged openstack/nova master: Remove conductor_api and _last_host_check from manager.py https://review.opendev.org/651059 | 03:56 |
openstackgerrit | Merged openstack/nova master: Remove 'etc/nova/cells.json' https://review.opendev.org/660146 | 03:57 |
*** tetsuro has joined #openstack-nova | 03:59 | |
openstackgerrit | Merged openstack/nova master: Reduce logging of host hypervisor capabilities to DEBUG level https://review.opendev.org/661379 | 04:00 |
*** tetsuro has quit IRC | 04:04 | |
*** markvoelker has joined #openstack-nova | 04:05 | |
*** frankwang has quit IRC | 04:06 | |
openstackgerrit | Merged openstack/nova master: Fix live-migration when glance image deleted https://review.opendev.org/659054 | 04:09 |
*** JamesBenson has quit IRC | 04:12 | |
*** slaweq has joined #openstack-nova | 04:16 | |
*** sapd1_x has joined #openstack-nova | 04:17 | |
*** slaweq has quit IRC | 04:24 | |
*** tetsuro has joined #openstack-nova | 04:26 | |
*** whoami-rajat has joined #openstack-nova | 04:31 | |
*** ratailor has joined #openstack-nova | 04:34 | |
*** boxiang has quit IRC | 04:35 | |
*** markvoelker has quit IRC | 04:37 | |
*** ivve has quit IRC | 04:37 | |
*** altlogbot_3 has quit IRC | 04:38 | |
*** trident has quit IRC | 04:39 | |
*** altlogbot_2 has joined #openstack-nova | 04:40 | |
*** altlogbot_2 has quit IRC | 04:40 | |
*** janki has joined #openstack-nova | 04:40 | |
*** trident has joined #openstack-nova | 04:41 | |
*** altlogbot_0 has joined #openstack-nova | 04:41 | |
*** sapd1_x has quit IRC | 05:00 | |
*** slaweq has joined #openstack-nova | 05:11 | |
*** tetsuro has quit IRC | 05:12 | |
*** pcaruana has joined #openstack-nova | 05:15 | |
*** slaweq has quit IRC | 05:18 | |
*** brinzhang has quit IRC | 05:27 | |
*** boxiang has joined #openstack-nova | 05:33 | |
*** psachin has quit IRC | 05:34 | |
*** markvoelker has joined #openstack-nova | 05:34 | |
*** ivve has joined #openstack-nova | 05:41 | |
*** frankwang has joined #openstack-nova | 05:45 | |
*** yaawang has quit IRC | 05:48 | |
*** yaawang has joined #openstack-nova | 05:48 | |
*** boxiang has quit IRC | 05:53 | |
*** cfriesen has joined #openstack-nova | 05:54 | |
*** boxiang has joined #openstack-nova | 05:57 | |
*** dtantsur|afk is now known as dtantsur | 06:00 | |
*** rcernin has quit IRC | 06:01 | |
*** rcernin has joined #openstack-nova | 06:01 | |
*** tetsuro has joined #openstack-nova | 06:02 | |
*** dpawlik has joined #openstack-nova | 06:03 | |
*** tetsuro has quit IRC | 06:07 | |
*** markvoelker has quit IRC | 06:08 | |
*** slaweq has joined #openstack-nova | 06:12 | |
*** brinzhang has joined #openstack-nova | 06:18 | |
*** tetsuro has joined #openstack-nova | 06:19 | |
*** lpetrut has joined #openstack-nova | 06:23 | |
*** brinzhang has quit IRC | 06:32 | |
*** brinzhang has joined #openstack-nova | 06:33 | |
*** maciejjozefczyk has joined #openstack-nova | 06:34 | |
*** maciejjozefczyk has quit IRC | 06:35 | |
*** maciejjozefczyk has joined #openstack-nova | 06:35 | |
*** takamatsu has joined #openstack-nova | 06:48 | |
*** rcernin has quit IRC | 06:52 | |
*** cfriesen has quit IRC | 07:02 | |
*** tesseract has joined #openstack-nova | 07:05 | |
*** markvoelker has joined #openstack-nova | 07:05 | |
openstackgerrit | Yongli He proposed openstack/nova-specs master: add spec "show-server-numa-topology" https://review.opendev.org/658716 | 07:06 |
*** awalende has joined #openstack-nova | 07:13 | |
*** minmin has joined #openstack-nova | 07:14 | |
*** tetsuro has quit IRC | 07:16 | |
*** ralonsoh has joined #openstack-nova | 07:21 | |
*** tetsuro has joined #openstack-nova | 07:22 | |
*** rpittau|afk is now known as rpittau | 07:23 | |
*** helenafm has joined #openstack-nova | 07:31 | |
*** markvoelker has quit IRC | 07:37 | |
*** tetsuro has quit IRC | 07:41 | |
*** itlinux has quit IRC | 07:42 | |
*** tetsuro has joined #openstack-nova | 07:47 | |
*** xek_ has joined #openstack-nova | 07:47 | |
*** takamatsu has quit IRC | 07:52 | |
*** tstrul has joined #openstack-nova | 07:56 | |
*** tetsuro has quit IRC | 07:56 | |
*** takashin has left #openstack-nova | 07:57 | |
*** takamatsu has joined #openstack-nova | 08:00 | |
kashyap | efried: aspiers: Thanks for the review on that os-traits patch. Will address it soon. | 08:00 |
*** ricolin_ has quit IRC | 08:07 | |
*** ricolin has joined #openstack-nova | 08:07 | |
*** tkajinam has quit IRC | 08:10 | |
openstackgerrit | guangchao.pan proposed openstack/nova master: Add a name for the automatically created volume https://review.opendev.org/660096 | 08:15 |
*** panda is now known as panda|ruck | 08:23 | |
*** ociuhandu has quit IRC | 08:31 | |
*** markvoelker has joined #openstack-nova | 08:34 | |
*** ociuhandu has joined #openstack-nova | 08:35 | |
*** derekh has joined #openstack-nova | 08:39 | |
*** takamatsu has quit IRC | 08:52 | |
*** boxiang has quit IRC | 08:59 | |
*** yedongcan has joined #openstack-nova | 09:02 | |
*** cdent has joined #openstack-nova | 09:05 | |
*** markvoelker has quit IRC | 09:08 | |
aspiers | kashyap: cool | 09:12 |
* kashyap goes back to messing with unit tests | 09:17 | |
kashyap | aspiers: Still about? | 09:48 |
aspiers | yep | 09:48 |
kashyap | aspiers: When you get a moment, I'm stuck in "unit test rut", wonder if you can have a gander at this WIP (line 102): http://paste.openstack.org/show/752226/ | 09:48 |
kashyap | aspiers: The code it is testing is also pasted in the pastebin, for convenience. (It is in relation to this patch you reviewed in the past: https://review.opendev.org/#/c/639091/) | 09:49 |
kashyap | Maybe I should just post the WIP, broken unit test, so you could comment in Gerrit itself :D | 09:49 |
kashyap | Let me post it | 09:51 |
*** davidsha has joined #openstack-nova | 09:51 | |
stephenfin | johnthetubaguy++ Thanks for running through those remove-cellsv1 patches | 09:52 |
openstackgerrit | Kashyap Chamarthy proposed openstack/nova master: libvirt: Rework 'EBUSY' (SIGKILL) error handling code path https://review.opendev.org/639091 | 09:52 |
kashyap | aspiers: ^ The "broken" unit test | 09:52 |
zigo | Is there a way to remove an already runningn instance from a server group? | 09:53 |
*** threestrands has quit IRC | 09:54 | |
aspiers | kashyap: oh nice, didn't know it was possible to refer to abbreviated change-ids | 09:55 |
kashyap | aspiers: Yeah, I just tried it, based on commit ID trimming I do | 09:57 |
aspiers | kashyap: what's the FIXME for? | 09:57 |
aspiers | won't that fail flake8 or something? | 09:58 |
kashyap | aspiers: As I felt the test was not 100% accurate, although it "passes" | 09:58 |
aspiers | I think any FIXME needs an explanation | 09:58 |
kashyap | Wanted someone to double-check it; will remove it on next PS (as I need one more test) | 09:58 |
kashyap | Yes, yes. I was not going to put in a "naked FIXME" like that. It won't exist. | 09:58 |
aspiers | Oh, sorry I missed your previous messages | 09:59 |
aspiers | Nevertheless, I think I'm missing (i.e. probably forgot) some context here | 10:00 |
aspiers | How are you stuck? | 10:00 |
kashyap | aspiers: Err, not exactly 'stuck' (bad wording); but just needs a once-over of the test. Is the "mocking" correct, etc | 10:01 |
aspiers | Oh right | 10:01 |
aspiers | OK so this one is for testing the >= 4.7.0 behaviour? | 10:01 |
kashyap | aspiers: Right | 10:02 |
kashyap | aspiers: Both, test with and without MIN_LIBVIRT_BETTER_SIGKILL_HANDLING | 10:03 |
kashyap | aspiers: I.e. hit the warining of _SIGKILL_HANDLING isn't satisfied | 10:03 |
aspiers | I mean the test with the FIXME | 10:03 |
*** markvoelker has joined #openstack-nova | 10:05 | |
kashyap | Yeah, it is "supposed" to :D | 10:05 |
* kashyap bbiab | 10:07 | |
*** frankwang has quit IRC | 10:12 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: DNM:test https://review.opendev.org/661931 | 10:13 |
openstackgerrit | Guo Jingyu proposed openstack/nova master: Define and catch QemuGuestAgentNotRunning for set-password failure https://review.opendev.org/661466 | 10:16 |
*** nowster has left #openstack-nova | 10:16 | |
openstackgerrit | Chris Dent proposed openstack/nova master: Make all functional tests reusable by other projects https://review.opendev.org/657659 | 10:26 |
*** slaweq has quit IRC | 10:30 | |
*** dave-mccowan has joined #openstack-nova | 10:31 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: DNM:test https://review.opendev.org/661931 | 10:34 |
*** dave-mccowan has quit IRC | 10:37 | |
*** markvoelker has quit IRC | 10:37 | |
*** dtantsur is now known as dtantsur|lunch | 10:43 | |
*** bbowen has quit IRC | 10:44 | |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: DNM:test https://review.opendev.org/661931 | 10:48 |
mdbooth | kashyap: Are you going to respin https://review.opendev.org/#/c/639091/ quickly? | 10:51 |
mdbooth | kashyap: Looks like you could fix up the nits in 2 minutes, and not much point wasting CI resources. | 10:51 |
kashyap | mdbooth: Yeah, trying the reg-ex thingie | 10:51 |
mdbooth | kashyap: I proposed a simpler alternative | 10:52 |
kashyap | Ah, let me look | 10:52 |
kashyap | No need to muck with regex'es then | 10:52 |
kashyap | Thanks for the review! | 10:52 |
kashyap | mdbooth: Relatd aside: would you be amenable if I simply do (instead of hard-coding a PID): | 10:53 |
kashyap | str=("Failed to terminate process \d+ with SIGKILL: Device " | 10:53 |
kashyap | "or resource busy") | 10:53 |
*** slaweq has joined #openstack-nova | 10:54 | |
mdbooth | kashyap: Does it matter? | 10:54 |
aspiers | kashyap: then you'd need an exc_template | 10:54 |
kashyap | mdbooth: It doesn't | 10:54 |
mdbooth | kashyap: Surely you could write "Error: abducted by aliens" | 10:54 |
kashyap | Heh | 10:55 |
aspiers | exc_template % random_pid for raising, and exc_template % '\d+' for matching | 10:55 |
openstackgerrit | Guo Jingyu proposed openstack/nova master: Define and catch QemuGuestAgentNotRunning for set-password failure https://review.opendev.org/661466 | 10:55 |
aspiers | The important thing there is not so much the contents of the string, as ensuring that the test case isn't accidentally catching a totally different exception | 10:55 |
mdbooth | Right. We especially don't want to go asserting that libvirt is generating particular error text for us. | 10:56 |
aspiers | assertRaises(fakelibvirt.libvirtError, ...) doesn't guarantee that it's a VIR_ERR_SYSTEM_ERROR | 10:56 |
aspiers | (IIUC) | 10:56 |
aspiers | and also that int1=errno.EBUSY | 10:56 |
aspiers | so six.assertRaisesRegex can function as a substitute for those two checks | 10:57 |
*** jaypipes has joined #openstack-nova | 10:57 | |
mdbooth | aspiers: My suggestion was to assert that the error raised is the identity of the fake error | 10:57 |
mdbooth | i.e. we raised literally the expected error object | 10:57 |
aspiers | mdbooth: yeah, that probably sounds like the best option to me | 10:57 |
aspiers | how do you code that though? | 10:58 |
mdbooth | assertRaises(ex, ...) | 10:58 |
aspiers | oh, that easy :) | 10:58 |
mdbooth | Actually, lemme try something. Would that work if I copied it? | 10:58 |
aspiers | I thought the first parameter had to be the exception _class_ | 10:58 |
aspiers | the docs are kinda unclear on this | 10:58 |
kashyap | mdbooth: Hmm, I tried the assertRaises(ex, ...) it fails with: | 10:59 |
kashyap | TypeError: issubclass() arg 2 must be a class or tuple of classes | 10:59 |
aspiers | right | 10:59 |
aspiers | the prose suggests you can use the exception instance, but the examples suggest otherwise | 10:59 |
mdbooth | kashyap: I only ran it under py37, so maybe. | 10:59 |
mdbooth | I hate python | 10:59 |
aspiers | ;) | 11:00 |
kashyap | Sigh | 11:00 |
aspiers | yeah, Python APIs aren't the best | 11:00 |
aspiers | biab | 11:00 |
openstackgerrit | Balazs Gibizer proposed openstack/nova master: DNM:test https://review.opendev.org/661931 | 11:00 |
kashyap | mdbooth: Do you have a preference given that the above goes bonkers on non-PY37? | 11:01 |
kashyap | s/preference/preference,/ | 11:01 |
mdbooth | kashyap: My test was bogus... | 11:01 |
kashyap | Ah | 11:02 |
aspiers | I figured it out | 11:02 |
kashyap | Please educate | 11:02 |
aspiers | with self.assertRaises(ex) as cm: | 11:02 |
aspiers | ... do assertions on cm.exception ... | 11:02 |
mdbooth | raised = self.assertRaises(fakelibvirt.libvirtError, ...) | 11:02 |
mdbooth | self.assertEqual("Foo", raised.foo) | 11:03 |
aspiers | Oh, context manager only works with >= 3.1 :-/ | 11:03 |
* mdbooth tries ^^^ on my27 | 11:03 | |
mdbooth | py27 | 11:03 |
aspiers | Although IIRC maybe we don't use native py27 unittest? | 11:04 |
mdbooth | I think it inherits at some point | 11:04 |
aspiers | testtools>=2.2.0 | 11:04 |
aspiers | in test-requirements.txt | 11:04 |
* kashyap goes to fiddle | 11:05 | |
aspiers | https://testtools.readthedocs.io/en/latest/for-test-authors.html#improved-assertraises | 11:05 |
aspiers | "Note that this is incompatible with the assertRaises in unittest2 and Python2.7." | 11:05 |
* kashyap wonders if he should try six.assertRaisesRegex()? | 11:06 | |
mdbooth | kashyap: Sec... | 11:06 |
aspiers | I would try the approach in that link | 11:06 |
aspiers | which is basically what mdbooth suggested | 11:06 |
kashyap | mdbooth: Nod | 11:06 |
* mdbooth is just testing against py27 | 11:07 | |
aspiers | I suspect his suggestion only works *because* we are using testtools not native unittest | 11:07 |
aspiers | but yeah, we'll see in a few seconds :) | 11:07 |
mdbooth | ...works | 11:07 |
mdbooth | code is: | 11:07 |
aspiers | \o/ | 11:07 |
* aspiers really goes now, back shortly | 11:07 | |
mdbooth | ~ raised = self.assertRaises(fakelibvirt.libvirtError, drvr._destroy, | 11:08 |
mdbooth | instance) | 11:08 |
mdbooth | + self.assertEqual(fakelibvirt.VIR_ERR_SYSTEM_ERROR, | 11:08 |
mdbooth | + raised.get_error_code()) | 11:08 |
mdbooth | you can add more | 11:08 |
mdbooth | ^^^ tested on py(2|3)7 | 11:08 |
kashyap | mdbooth: Thanks! Let me try | 11:09 |
*** janki has quit IRC | 11:11 | |
kashyap | mdbooth: That get_error_code() needs a mock, no? | 11:12 |
kashyap | @mock.patch.object(fakelibvirt.libvirtError, 'get_error_code') | 11:12 |
mdbooth | kashyap: No | 11:12 |
mdbooth | kashyap: I didn't look, but it must already be implemented by fake libvirtError | 11:12 |
* kashyap checks | 11:13 | |
mdbooth | It certainly works and returns the expected value | 11:13 |
*** guozijn has quit IRC | 11:16 | |
*** ratailor has quit IRC | 11:18 | |
kashyap | mdbooth: You're of course correct | 11:19 |
kashyap | mdbooth: Before I take CI resources, does it look OK to you: http://paste.openstack.org/show/752232/ | 11:27 |
kashyap | aspiers: BTW, on self.assertTrue(mock_warning.called) vs. mock_warning.assert_called_once() -- I went with the former as that seemed to be the "pattern" | 11:30 |
aspiers | OK | 11:30 |
aspiers | I don't really mind much either way | 11:31 |
aspiers | Latter feels a bit more idiomatic to me (after all, presumably they implemented it for a reason) but whatever :) | 11:31 |
kashyap | Yeah, I see what you mean, though. I like the latter less obtuse | 11:31 |
*** jangutter_ has joined #openstack-nova | 11:32 | |
*** markvoelker has joined #openstack-nova | 11:34 | |
*** brinzhang has quit IRC | 11:35 | |
*** brinzhang has joined #openstack-nova | 11:36 | |
*** jangutter has quit IRC | 11:36 | |
*** macza has joined #openstack-nova | 11:38 | |
*** redrobot has quit IRC | 11:39 | |
*** bbowen has joined #openstack-nova | 11:41 | |
*** macza has quit IRC | 11:43 | |
openstackgerrit | Kashyap Chamarthy proposed openstack/nova master: libvirt: Rework 'EBUSY' (SIGKILL) error handling code path https://review.opendev.org/639091 | 11:46 |
*** guozijn has joined #openstack-nova | 11:48 | |
kashyap | aspiers: BTW, I fully share your horror of super-long methods; I just made an elaborate TODO to address it into 3 other refactor commits, based on your remarks. | 11:50 |
*** tbachman has quit IRC | 11:50 | |
*** Spencer_Yu has quit IRC | 11:52 | |
cdent | (super-long {methods,packages,tests,files,documents})-- | 11:52 |
kashyap | cdent: :-) | 11:53 |
cdent | but | 11:53 |
cdent | (super-log emails)++ ;) | 11:53 |
*** tesseract has quit IRC | 11:53 | |
cdent | damn: long! | 11:53 |
*** tesseract has joined #openstack-nova | 11:53 | |
kashyap | mdbooth: Hopefully I addressed "all things", including Adam's nits. Hope that one test suffices? Or do we need _another_ test? (I don't want to add more without a very good reason) | 11:54 |
*** markvoelker has quit IRC | 11:54 | |
* kashyap changes 'office' to library; bbiab | 11:54 | |
*** markvoelker has joined #openstack-nova | 11:54 | |
*** helenafm has quit IRC | 12:05 | |
*** guozijn has quit IRC | 12:10 | |
*** redrobot has joined #openstack-nova | 12:23 | |
*** udesale has joined #openstack-nova | 12:25 | |
*** guozijn has joined #openstack-nova | 12:27 | |
*** Spencer_Yu has joined #openstack-nova | 12:29 | |
*** lbragstad has joined #openstack-nova | 12:32 | |
*** guozijn has quit IRC | 12:32 | |
openstackgerrit | François Palin proposed openstack/nova stable/rocky: Include all network devices in nova diagnostics https://review.opendev.org/661962 | 12:34 |
*** tbachman has joined #openstack-nova | 12:35 | |
*** mtreinish has quit IRC | 12:36 | |
*** mtreinish has joined #openstack-nova | 12:36 | |
*** brinzhang has quit IRC | 12:39 | |
openstackgerrit | Stephen Finucane proposed openstack/nova master: docs: Don't version links to reno docs https://review.opendev.org/661967 | 12:40 |
*** whoami-rajat has quit IRC | 12:51 | |
*** jangutter has joined #openstack-nova | 12:51 | |
openstackgerrit | Kashyap Chamarthy proposed openstack/nova master: libvirt: Rework 'EBUSY' (SIGKILL) error handling code path https://review.opendev.org/639091 | 12:52 |
*** gmann has quit IRC | 12:53 | |
*** jangutter_ has quit IRC | 12:54 | |
*** helenafm has joined #openstack-nova | 12:55 | |
kashyap | mdbooth: Addressed the two nits ^^; can I have my +1 back? :D | 12:55 |
kashyap | (Thanks!) | 12:55 |
artom | sean-k-mooney, tempest-full-py3/nova-multinode all passed on top of https://review.opendev.org/#/c/644881/18 | 12:57 |
artom | Need to fix unit tests now | 12:58 |
artom | Unless mriedem or dansmith want to sanity check the approach to make sure it's acceptable first | 12:58 |
artom | (The revert resize thing) | 12:58 |
*** guozijn has joined #openstack-nova | 12:59 | |
*** kaisers has quit IRC | 13:01 | |
*** kaisers has joined #openstack-nova | 13:02 | |
*** guozijn has quit IRC | 13:04 | |
aspiers | kashyap: great :) | 13:11 |
openstackgerrit | François Palin proposed openstack/nova stable/rocky: Include all network devices in nova diagnostics https://review.opendev.org/661962 | 13:12 |
sean-k-mooney | artom well its a race or was so you might want to do a few rechecks to confirm but cool ill take a look | 13:15 |
*** Spencer_Yu has quit IRC | 13:15 | |
sean-k-mooney | artom: although im also plannign to change how hybrid plug works to fix a different issue... | 13:16 |
sean-k-mooney | i need to get back to working on this https://review.opendev.org/#/c/602432/ but if i end up altering the beahvior i geuss we could revert or update your change if hybrid plug nolonger matters | 13:17 |
sean-k-mooney | this is actully next on my todo list once i get the spec im working on finished | 13:18 |
kashyap | mdbooth: Haha, you caught me sneaking in the \d+ | 13:19 |
mdbooth | kashyap: It makes no difference :) | 13:19 |
*** mriedem has joined #openstack-nova | 13:20 | |
*** eharney has joined #openstack-nova | 13:20 | |
kashyap | Yeah, indeed | 13:20 |
mdbooth | i.e. I don't care if you don't change it | 13:20 |
artom | sean-k-mooney, I don't think it was a race in this case | 13:24 |
artom | We were blocking on the wait before Neutron could ever send us the event | 13:24 |
*** HD|Laptop has joined #openstack-nova | 13:25 | |
artom | When waiting in the compute manager | 13:25 |
HD|Laptop | hello all. I have an ISO image (with drivers) imported with --container-format bare --disk-format iso. | 13:25 |
sean-k-mooney | but only when using a speicic firewall driver | 13:25 |
artom | But yeah, a few rechecks won't harm - they'll happen regardless when I fix the unit tests | 13:25 |
HD|Laptop | Starting from ISOs with server create --image <OS ISO image> works fine and the ISO gets mapped in qemu-kvm as a CDROM drive | 13:25 |
HD|Laptop | but when trying to attach an ISO via volume, it gets mapped as "-device virtio-blk-pci" despite setting hw_cdrom_bus='ide', hw_disk_bus='ide' on both image and volume | 13:26 |
HD|Laptop | how do I force the volume with the driver ISO to be mapped as -device ide-cd? | 13:27 |
*** BjoernT has joined #openstack-nova | 13:34 | |
*** dtantsur|lunch is now known as dtantsur | 13:35 | |
*** BjoernT_ has joined #openstack-nova | 13:39 | |
*** BjoernT has quit IRC | 13:39 | |
*** tbachman has quit IRC | 13:42 | |
*** tbachman has joined #openstack-nova | 13:45 | |
*** aarents has quit IRC | 13:51 | |
*** mmethot_ has joined #openstack-nova | 13:53 | |
*** yedongcan has left #openstack-nova | 13:53 | |
*** awalende has quit IRC | 13:53 | |
*** mmethot has quit IRC | 13:54 | |
*** awalende has joined #openstack-nova | 13:54 | |
*** mlavalle has joined #openstack-nova | 13:56 | |
*** awalende_ has joined #openstack-nova | 13:57 | |
*** Woutifier has quit IRC | 13:58 | |
*** awalende has quit IRC | 13:58 | |
*** liuyulong|away is now known as liuyulong | 14:00 | |
*** awalende_ has quit IRC | 14:02 | |
mriedem | bauzas: can you take a look at this functional regression recreate test patch? https://review.opendev.org/#/c/661822/ | 14:03 |
mriedem | related to your favorite, request spec | 14:03 |
*** whoami-rajat has joined #openstack-nova | 14:03 | |
*** tbachman has quit IRC | 14:06 | |
*** gmann has joined #openstack-nova | 14:10 | |
*** itlinux has joined #openstack-nova | 14:11 | |
*** JamesBenson has joined #openstack-nova | 14:15 | |
stephenfin | mriedem: You think we can push ahead with this now? https://review.opendev.org/#/c/629597/ | 14:17 |
*** JamesBenson has quit IRC | 14:19 | |
*** ricolin has quit IRC | 14:20 | |
stephenfin | efried: Easy docs fix here that'll need to be backported after https://review.opendev.org/661967 | 14:20 |
*** kaisers has quit IRC | 14:20 | |
*** mrch_ has quit IRC | 14:20 | |
*** dkehn has left #openstack-nova | 14:20 | |
*** JamesBenson has joined #openstack-nova | 14:21 | |
*** kaisers has joined #openstack-nova | 14:22 | |
efried | stephenfin: +2 | 14:22 |
*** awalende has joined #openstack-nova | 14:22 | |
mriedem | stephenfin: you will have to decouple it from https://review.opendev.org/#/c/620111/ | 14:23 |
mriedem | which is waiting on how https://review.opendev.org/#/c/637217/ gets sorted out which i'm not actively working on | 14:24 |
stephenfin | okidok | 14:24 |
*** ricolin has joined #openstack-nova | 14:26 | |
*** awalende has quit IRC | 14:27 | |
*** ivve has quit IRC | 14:29 | |
*** lpetrut has quit IRC | 14:30 | |
sean-k-mooney | mriedem: johnthetubaguy when one of ye have time can you look at this backport for os-vif | 14:33 |
sean-k-mooney | we dont use upper constraits on all stable branches so we want to fix that | 14:34 |
sean-k-mooney | it still need more backports but that one is blocking a different backport too | 14:34 |
*** artom has quit IRC | 14:35 | |
*** artom has joined #openstack-nova | 14:35 | |
*** tbachman has joined #openstack-nova | 14:38 | |
mriedem | stephenfin: do you plan on backporting this? https://review.opendev.org/#/c/661967/ | 14:39 |
mriedem | sean-k-mooney: did you intend on pasting a link to a backport? | 14:40 |
stephenfin | mriedem: yeah, once it's merged | 14:40 |
mriedem | stephenfin: ok, then you should have a bug for it | 14:40 |
stephenfin | oh yeah, good point that. I can do that now | 14:40 |
sean-k-mooney | mriedem: yes https://review.opendev.org/#/c/658780/ is the queens backport | 14:41 |
*** itlinux has quit IRC | 14:41 | |
sean-k-mooney | mriedem: of using upper constaints | 14:41 |
sean-k-mooney | there is also the backport of https://review.opendev.org/#/q/topic:bug/1825888+(status:open+OR+status:merged) but that needs to be done on stien and rocky first | 14:42 |
mriedem | sean-k-mooney: https://review.opendev.org/#/c/658780/ looks like it's doing the trick but i can't tell at all from the tox logs, a comment in line if you have the answer | 14:50 |
mriedem | the tox logs make it look like they are installing from master u-c: | 14:50 |
mriedem | http://logs.openstack.org/80/658780/4/check/openstack-tox-py35/b70c01b/tox/py35-1.log | 14:50 |
mriedem | cmd: /home/zuul/src/opendev.org/openstack/os-vif/.tox/py35/bin/pip install -U -c/home/zuul/src/opendev.org/openstack/requirements/upper-constraints.txt -r/home/zuul/src/opendev.org/openstack/os-vif/requirements.txt -r/home/zuul/src/opendev.org/openstack/os-vif/test-requirements.txt | 14:50 |
mriedem | Collecting oslo.versionedobjects===1.31.3 (from -c /home/zuul/src/opendev.org/openstack/requirements/upper-constraints.txt (line 235)) Downloading http://mirror.bhs1.ovh.openstack.org/pypifiles/packages/fc/55/09c89a3c1724732f435b1639640ac58f4ab485f07c26aa5d1e452633040f/oslo.versionedobjects-1.31.3-py2.py3-none-any.whl (74kB) | 14:50 |
sean-k-mooney | hum ill take a closer look again. the tox job should overdie the uppercontarints file use to use teh one it cloned by setting the env varible | 14:51 |
mriedem | it is using the queens constraints, it's just not obvious at all from the logs | 14:52 |
sean-k-mooney | sphix was the package that was breaking the follow up package | 14:52 |
sean-k-mooney | it was previously uncpped v7 or this failed but v8 works after it was rebased on the constraitns patch https://review.opendev.org/#/c/655694/8 | 14:53 |
mriedem | yup i can see http://logs.openstack.org/94/655694/7/check/openstack-tox-py35/c0ad3dc/tox/py35-3.log | 14:54 |
mriedem | ok +W on the queens uc change | 14:55 |
*** artom has quit IRC | 14:55 | |
sean-k-mooney | thanks when you have time it would be good to merge the bugfix backport too but as i said it still need to be backported on stien and rock + we wont be doing a release for a while so it not urgent | 14:57 |
mriedem | yeah i'm looking, creating the missing release series in lp for os-vif first | 14:57 |
mriedem | so i can target the bug | 14:57 |
*** tbachman has quit IRC | 14:58 | |
sean-k-mooney | on a related note im planning to do an intermediate releaseof os-vif before m2 so that any nova features that need the new release can technicall merge before m2 assuming they are ready | 15:01 |
sean-k-mooney | but i dont think there is enough currently to justify a release so it will be at leat another couple of weeks. | 15:03 |
mriedem | sean-k-mooney: ralonsoh: i don't know if this came up in review on the change on master, but we should probably use mock_open here https://review.opendev.org/#/c/655678/3/vif_plug_ovs/tests/unit/test_linux_net.py@83 | 15:03 |
openstackgerrit | Merged openstack/os-vif stable/queens: add upper_constraints support https://review.opendev.org/658780 | 15:05 |
sean-k-mooney | just on a meeting but will look | 15:05 |
sean-k-mooney | after | 15:05 |
sean-k-mooney | mriedem: mock open is python3 only i think | 15:07 |
sean-k-mooney | there was a reason we dont use it in os-vif i think nova has implemented a fallback for py27 | 15:08 |
*** cfriesen has joined #openstack-nova | 15:08 | |
mriedem | we get mock in py27 from the mock library | 15:13 |
ralonsoh | mriedem, but this is what I'm doing (same as the example provided in the link): I'm replacing open with mock_open | 15:13 |
sean-k-mooney | mriedem: we dont in os-vif i think | 15:13 |
sean-k-mooney | e.g. we are not using the lib version | 15:14 |
sean-k-mooney | we could | 15:14 |
ralonsoh | mriedem, with "@mock.patch.object(builtins, 'open')" I'm avoiding the problem between py2 and py3 | 15:14 |
ralonsoh | mriedem, sean-k-mooney mock_open is in both versions | 15:14 |
mriedem | sean-k-mooney: umm, i don't see how py27 tests in os-vif could work then | 15:14 |
sean-k-mooney | ralonsoh: i dont think its in py27 without the mock lib | 15:14 |
mriedem | os-vif isn't directly requiring mock but it's getting it from oslotest https://github.com/openstack/oslotest/blob/master/requirements.txt | 15:14 |
mriedem | as a transitive dependency | 15:15 |
aspiers | sean-k-mooney: we use mock_open in lots of places | 15:15 |
sean-k-mooney | ah ok | 15:15 |
aspiers | see also https://review.opendev.org/#/c/661266/ although I don't think it's useful in this case | 15:15 |
sean-k-mooney | in which case then yes we could replace all of those with mock_open | 15:15 |
sean-k-mooney | aspiers: maybe im still not conviced that is better but that is becasue at least in os-vif i dont think we need it for our current tests | 15:16 |
sean-k-mooney | but yes it might be useful | 15:16 |
aspiers | BTW mock_open does not work in all scenarios | 15:17 |
aspiers | e.g. if the code reading the file uses enumerate() | 15:17 |
sean-k-mooney | aspiers: yes i have noticed it didnt work when i have tried to used it somethimes | 15:17 |
aspiers | see my comment May 24 9:18PM on https://review.opendev.org/#/c/661266/2 | 15:17 |
aspiers | e.g. it does not work when mocking oslo.config files | 15:18 |
openstackgerrit | Kashyap Chamarthy proposed openstack/nova master: libvirt: Rework 'EBUSY' (SIGKILL) error handling code path https://review.opendev.org/639091 | 15:21 |
kashyap | aspiers: Can I get my ACK, now? :D ---^ | 15:22 |
aspiers | probably | 15:22 |
kashyap | aspiers: On addressing the NOTE thing, indeed what MattB said (and what my note itself says) | 15:23 |
aspiers | kashyap: I probably misread it | 15:23 |
kashyap | aspiers: Aw, thought I write clearest phrases | 15:23 |
aspiers | "TODO(kchamart): Rewrite the above note, ..." | 15:23 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: docs: Don't version links to reno docs https://review.opendev.org/661967 | 15:24 |
kashyap | aspiers: (I.e. the TODO will be addresed _once_ the MIN_LIBVIRT_VERSION reaches v4.7.0) | 15:24 |
aspiers | Yes, but you buried that qualifier deep in the sentence :) | 15:24 |
stephenfin | efried, mriedem: Added a bug link to https://review.opendev.org/#/c/661967/ | 15:24 |
aspiers | kashyap: "TODO(kchamart): Once MIN_LIBVIRT_VERSION reaches v4.7.0, rewrite the above note ..." | 15:24 |
kashyap | aspiers: Yeah, darn. I always worry sometimes, whether the qualifier is better at the start or a bit deeper inside | 15:24 |
aspiers | At the start, when it modifies the entire context | 15:24 |
kashyap | aspiers: Fair enough, actually let me do that. It will satisfiy my OCD-ness | 15:25 |
aspiers | :) | 15:25 |
aspiers | mine too | 15:25 |
kashyap | I even vaguely recall starting with the qualifier, but not sure what crack I was smoking, and changed it | 15:25 |
aspiers | No worries :) | 15:26 |
aspiers | kashyap: Once 4.7.0 as min version is reached, it's not just the note which gets rewritten, right? Indeed, I think you already say this but the comma after "above note" slightly obscures that the code needs to be removed too. | 15:27 |
aspiers | When it's reached, it's at least as important to update the code as the note, so I would write it more like: | 15:28 |
kashyap | aspiers: No, not just the note; the "remove the following code" as well | 15:28 |
kashyap | New phrasing coming soon to an IRC window near you | 15:28 |
aspiers | kashyap: "TODO(kchamart): Once MIN_LIBVIRT_VERSION reaches v4.7.0, remove the code [...] and rewrite the above note ..." | 15:28 |
aspiers | i.e. put the code removal first | 15:28 |
aspiers | Unfortunately my pedantry has no "off" button | 15:29 |
kashyap | I enjoy English phrasing pedantry. | 15:31 |
aspiers | Me too, for some reason | 15:32 |
*** gyee has joined #openstack-nova | 15:33 | |
kashyap | aspiers: How about this: | 15:34 |
kashyap | # TODO(kchamart): Once MIN_LIBVIRT_VERSION | 15:34 |
kashyap | # reaches v4.7.0, (a) rewrite the above note, | 15:34 |
kashyap | # and (b) remove the following code that retries | 15:34 |
kashyap | # _destroy() API call (which gives SIGKILL 30 | 15:34 |
kashyap | # seconds to take effect) -- because from v4.7.0 | 15:34 |
kashyap | # onwards, libvirt _automatically_ increases the | 15:34 |
kashyap | # timeout to 30 seconds. This was added in the | 15:34 |
kashyap | # following libvirt commits: | 15:34 |
aspiers | Yeah, that's good | 15:34 |
mriedem | sean-k-mooney: i bet you know the answer to this, is "x in y" where y is a set the same time as if y were a dict? | 15:34 |
aspiers | the (a) and (b) addresses the problem with the comma after "note" | 15:34 |
kashyap | aspiers: Yeah, indeed, it can't be misunderstood even if one tries to. | 15:34 |
*** altlogbot_0 has quit IRC | 15:34 | |
sean-k-mooney | if y is a dict its checking is x in the keys | 15:35 |
aspiers | mriedem: same time as in complexity? or same thing? I think the answer to both is yes | 15:35 |
aspiers | yeah, what sean-k-mooney said | 15:35 |
sean-k-mooney | mriedem: if you want to check the values you need to do x in y.values | 15:35 |
mriedem | sean-k-mooney: yes i realize what it's looking for | 15:35 |
aspiers | both should be O(1) | 15:35 |
mriedem | i'm asking if both are O(1) | 15:36 |
*** irclogbot_3 has quit IRC | 15:36 | |
sean-k-mooney | yes they are both O(1) | 15:36 |
*** altlogbot_3 has joined #openstack-nova | 15:36 | |
*** macza has joined #openstack-nova | 15:37 | |
openstackgerrit | Kashyap Chamarthy proposed openstack/nova master: libvirt: Rework 'EBUSY' (SIGKILL) error handling code path https://review.opendev.org/639091 | 15:37 |
*** irclogbot_3 has joined #openstack-nova | 15:37 | |
kashyap | mdbooth: aspiers ^ Wording in the note rephrased to clearly spell out what's to do. | 15:38 |
aspiers | kashyap: is https://review.opendev.org/#/c/655193/ next on your list? since that's a major blocker for the newer changes on my SEV series | 15:40 |
kashyap | aspiers: Without guessing, is it the 'os_traits' rework? Yes | 15:40 |
aspiers | kashyap: and it sounds like pretty much all you have to do is empty x86.py | 15:40 |
aspiers | OK, cool | 15:40 |
kashyap | aspiers: Tomm is holiday; but today & Friday I'll be working on it, too. | 15:40 |
kashyap | aspiers: Yeah, let me do that right away | 15:40 |
kashyap | aspiers: It's amazing, what that change turned into. I was just a drive-by "observer" of the 'os_traits' repo & the corresponding call in driver.py. Thought I'll make a tiny change | 15:42 |
aspiers | kashyap: oh, and some simple nits from me in amd.py | 15:42 |
kashyap | ... and it turned into a multi-week thing | 15:42 |
kashyap | aspiers: Certainly, saw that. Typo: s/SVM/SEV/ | 15:42 |
kashyap | And others. Reading... | 15:42 |
aspiers | kashyap: that's what happened to me with https://review.opendev.org/#/c/538498/, more or less | 15:44 |
*** tesseract has quit IRC | 15:44 | |
kashyap | aspiers: Ah, I saw this fly by. Thanks for the diagrams! | 15:45 |
aspiers | kashyap: https://docs.openstack.org/nova/latest/reference/update-provider-tree.html#taxonomy-of-traits-and-capabilities | 15:46 |
aspiers | added since then | 15:46 |
* kashyap bbiab; phone | 15:46 | |
*** tstrul has quit IRC | 15:47 | |
*** guozijn has joined #openstack-nova | 15:48 | |
kashyap | aspiers: (While I wait on the almost-human-sounding-bot), what's the source on that neat digram? | 15:48 |
kashyap | s/digram/diagram/ | 15:48 |
* stephenfin notes that he's overtaken cdent for most lines of code changed in nova during Train. Take that, cdent https://www.stackalytics.com/?metric=loc&module=nova-group ;) | 15:48 | |
aspiers | kashyap: it's just SVG | 15:48 |
* cdent shakes fist at stephenfin | 15:48 | |
aspiers | stephenfin: search and replace? ;-p | 15:48 |
kashyap | aspiers: Ah, okay. | 15:49 |
stephenfin | aspiers: Deleting cells v1 | 15:49 |
* cdent deletes vmware virt driver | 15:49 | |
*** helenafm has quit IRC | 15:49 | |
cdent | that'll show you! | 15:49 |
aspiers | ROFL | 15:49 |
stephenfin | :D | 15:49 |
aspiers | WTF, I'm #4 by LoC | 15:50 |
aspiers | How is that possible | 15:50 |
stephenfin | specs? | 15:50 |
cdent | ugh, this is not great: https://www.stackalytics.com/?metric=loc&module=placement-group | 15:50 |
*** dtantsur is now known as dtantsur|afk | 15:51 | |
edleafe | cdent: they have been saying that their numbers have been out of whack for a while | 15:51 |
cdent | edleafe: they reported recently that they fixed it. that looks right | 15:52 |
edleafe | I thought they were still working on it | 15:52 |
*** guozijn has quit IRC | 15:52 | |
cdent | there was a post couple days ago | 15:52 |
cdent | but who knows, I don't think we can ever really fully rely on it | 15:52 |
openstackgerrit | Stephen Finucane proposed openstack/nova stable/stein: docs: Don't version links to reno docs https://review.opendev.org/662025 | 15:52 |
melwitt | mriedem, johnthetubaguy: thanks for the reviews on counting quotas <3 I'm going to add a follow up patch for the nits/notes and then also propose the spec amendment for the deviations from the spec | 15:52 |
edleafe | You mean Eric has only contribute 25 lines of code?? | 15:53 |
aspiers | edleafe: they were missing a whole bunch of commits for nova, but I think that got fixed in the last day or 2 | 15:53 |
cdent | edleafe: of merged stuff in train, yeah, I'd say that's right | 15:54 |
aspiers | edleafe: it says 809 LoC for Eric | 15:54 |
*** itlinux has joined #openstack-nova | 15:54 | |
aspiers | I'm looking at https://www.stackalytics.com/?metric=loc&release=train&module=nova-group | 15:55 |
edleafe | aspiers: for Train? | 15:55 |
edleafe | aspiers: ah, we're looking at placement | 15:55 |
aspiers | ah sorry | 15:55 |
mriedem | melwitt: just posted comments on https://review.opendev.org/#/c/638073/ | 15:56 |
mriedem | melwitt: i'm going to post a DNM patch to test the pg flow | 15:56 |
melwitt | whoa, that is a lot of comments | 15:57 |
*** tbachman has joined #openstack-nova | 15:59 | |
mriedem | only 12, that's nothing | 15:59 |
openstackgerrit | Stephen Finucane proposed openstack/nova stable/queens: Fail to live migration if instance has a NUMA topology https://review.opendev.org/629597 | 16:01 |
openstackgerrit | Stephen Finucane proposed openstack/nova stable/queens: fix up numa-topology live migration hypervisor check https://review.opendev.org/648939 | 16:01 |
*** ivve has joined #openstack-nova | 16:02 | |
*** _erlon_ has joined #openstack-nova | 16:04 | |
*** lpetrut has joined #openstack-nova | 16:06 | |
*** rpittau is now known as rpittau|afk | 16:06 | |
*** artom has joined #openstack-nova | 16:08 | |
openstackgerrit | Matt Riedemann proposed openstack/nova master: DNM: Test count_usage_from_placement=True with postgresql https://review.opendev.org/662028 | 16:09 |
*** phillw has joined #openstack-nova | 16:11 | |
phillw | Hi good people, a quick question if I may. Regarding using GPUs in compute nodes, I managed to find an article from CERN on the subject but nothing else (http://openstack-in-production.blogspot.com/2018/05/introducing-gpus-to-cern-cloud.html) Does anyone know of anything else current;y on-going / in the pipe line for this? | 16:11 |
mriedem | phillw: vGPUs? because that's documented here https://docs.openstack.org/nova/latest/admin/virtual-gpu.html | 16:12 |
phillw | mriedem: thanks :) | 16:13 |
mriedem | physical GPUs can be accessed using pci-passthrough since...juno? | 16:13 |
mriedem | vGPU support in the libvirt and xenapi drivers is since queens | 16:13 |
mriedem | https://docs.openstack.org/nova/latest/admin/pci-passthrough.html for the latter | 16:13 |
mriedem | *er pcpu pci passthrough | 16:13 |
mriedem | *pgpu | 16:14 |
*** lpetrut has quit IRC | 16:14 | |
mriedem | that doc mostly talks about sriov ports though | 16:14 |
sean-k-mooney | you sould also be about to use amds sriov based vgpu "MxGpu" or something like that via pci passthrough from juno or whenever we added that | 16:14 |
sean-k-mooney | i.e. if your gpu support virtualisation via sriov then that will jsut work like any other sriov vf with pci passhtough | 16:15 |
sean-k-mooney | the same we we supprot qat virtualistion via sriov | 16:15 |
phillw | I'll go and have a read up. A colleague of mine wants to use the gpu power for AI learning and I'm at the start of re-learning openstack after a break since 2014 :) | 16:17 |
mriedem | scanning the cern article it looks pretty comprehensive | 16:18 |
mriedem | and says what we just told you anyway :) | 16:18 |
mriedem | i'm not aware of who is using vgpus yet | 16:18 |
sean-k-mooney | the current state is we have dedicated support for the nvida data center gpus( which need a license) and untested support for sriov stuff which shoudl jsut work via pcie passthough | 16:18 |
mriedem | bauzas might know | 16:18 |
phillw | it missed out about deployment :) | 16:18 |
mriedem | phillw: yeah but it linked to those same docs | 16:18 |
mriedem | that's your homework | 16:18 |
sean-k-mooney | phillw: so you your colleage wants to use a consomer gpu they are out of luck unless they do a complte passthough which technicall violates nvidas eula | 16:20 |
phillw | mriedem: it's Tims home work, he wants to add gpu's :) As both our instances are private we'll be using packstack. | 16:20 |
sean-k-mooney | phillw: is packstack still a thing? | 16:20 |
phillw | sean-k-mooney: so not possible with sriov without breaching EULA? | 16:20 |
sean-k-mooney | on the nvida side | 16:21 |
phillw | sean-k-mooney: yeah, it's still hanging on in there :P | 16:21 |
sean-k-mooney | technically if you dont use the binary driver then your fine | 16:21 |
*** wwriverrat has joined #openstack-nova | 16:21 | |
sean-k-mooney | but if you use the opensocrce driver you dont have gpu compute | 16:21 |
sean-k-mooney | so its kind of a catch 22 | 16:21 |
phillw | ah, understood. | 16:21 |
*** cdent has quit IRC | 16:22 | |
sean-k-mooney | nvida really want people bying the datacenter gpus insteadk of ther gaming ones for viutalisation | 16:22 |
mriedem | there is a workaround i believe | 16:23 |
mriedem | https://review.opendev.org/#/c/579897/ | 16:23 |
sean-k-mooney | yes there is | 16:23 |
phillw | yeah, i can understand that. I recall playstation upgrade being done which would prevent USAF using a cluster of them as cloud :) | 16:23 |
sean-k-mooney | you set the hypervior to hidden | 16:23 |
mriedem | ^ is from CERN btw | 16:23 |
sean-k-mooney | yes that is for hyperv i think | 16:23 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: Stop handling 'InstanceUnknownCell' exception https://review.opendev.org/651307 | 16:23 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: Remove unnecessary wrapper https://review.opendev.org/651308 | 16:23 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: db: Remove cell APIs https://review.opendev.org/651309 | 16:23 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: conf: Remove cells v1 options, group https://review.opendev.org/651310 | 16:23 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: Remove 'ComputeManager._reschedule' https://review.opendev.org/660774 | 16:23 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: Remove cells v1 parameter from 'ComputeTaskAPI.resize_instance' https://review.opendev.org/651311 | 16:24 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: Stop passing 'kwargs' to 'rebuild_instance' https://review.opendev.org/651312 | 16:24 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: Stop passing 'delete_type' to 'terminate_instance' https://review.opendev.org/651313 | 16:24 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: filters: Stop handling cells v1 https://review.opendev.org/651314 | 16:24 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: Remove nova.compute.*API() shims https://review.opendev.org/660527 | 16:24 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: Ensure controllers all call super https://review.opendev.org/660950 | 16:24 |
sean-k-mooney | for libvirt it already works | 16:24 |
phillw | that's cool, I'm on nodding terms with libvirt as I use it for my VMs :) | 16:24 |
mriedem | sean-k-mooney: that patch is for making nvidia work with windows guests in libvirt | 16:25 |
mriedem | the existing support is for libvirt guests only | 16:25 |
sean-k-mooney | * linux guests | 16:25 |
* aspiers finally hauls his Python IDE into the 21st century | 16:25 | |
mriedem | i never really understood the opposition to that patch since it's just doing the same thing for windows guests on kvm that we allow for linux guests | 16:26 |
mriedem | i.e. we've already opened pandora's box there | 16:26 |
sean-k-mooney | we nack it however as we did not want to add a feature to specically workaound a driver check that is there to prevent you breaching nvidas eula | 16:26 |
mriedem | *we already do* | 16:26 |
mriedem | https://blueprints.launchpad.net/nova/+spec/hide-hypervisor-id-flavor-extra-spec | 16:26 |
sean-k-mooney | the hypervior hidden flag was not added for that use however | 16:26 |
sean-k-mooney | it was already there | 16:27 |
mriedem | yes it was | 16:27 |
mriedem | https://blueprints.launchpad.net/nova/+spec/add-kvm-hidden-feature | 16:27 |
mriedem | https://review.opendev.org/#/c/459753/18//COMMIT_MSG@14 | 16:27 |
mriedem | so jay was +W on that change, but not this other one to allow the same thing for windows guests | 16:28 |
mriedem | which i don't understand | 16:28 |
sean-k-mooney | huh in that case i guess i dont know why we have not made it work for windows guests | 16:28 |
sean-k-mooney | i had under stood this was not sepcifcally for the nvida case but i guess it was | 16:28 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: Add reno for removed cells v1 policies https://review.opendev.org/662031 | 16:28 |
* phillw will be running C7 and eventually C8 at some point in the future :) | 16:28 | |
mriedem | that said i don't see any cern people around to rev that patch | 16:30 |
mriedem | or ovh people | 16:30 |
mriedem | amorin: you're ovh right? do you guys want to revive this? https://review.opendev.org/#/c/579897/ | 16:31 |
mriedem | looks like Maciej and Piotr cared about it at one point | 16:31 |
phillw | on a not totally dissimilar topic, I was actually paying attention on my last C7 installation and it offers to install a compute instance. Am I correct in my reading that this is a nova instance? | 16:32 |
mriedem | C7 = centos7? | 16:33 |
phillw | yes, sorry | 16:33 |
mriedem | "it offers to install a compute instance. Am I correct in my reading that this is a nova instance?" no idea | 16:33 |
jcosmao | hi mriedem, i'll forward info to my teammate (i work at ovh also) | 16:33 |
mriedem | jcosmao: thanks | 16:33 |
phillw | mriedem: home work for me, then :) | 16:34 |
mriedem | just make tim do it | 16:34 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Refresh instance network info on deletion https://review.opendev.org/660761 | 16:35 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: hacking: Resolve E731 (do not assign a lambda expression, use a def) https://review.opendev.org/651554 | 16:39 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: hacking: Resolve W503 (line break occurred before a binary operator) https://review.opendev.org/651555 | 16:39 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: hacking: Resolve E741 (ambiguous variable name) https://review.opendev.org/652103 | 16:39 |
openstackgerrit | Stephen Finucane proposed openstack/nova master: hacking: Resolve W605 (invalid escape sequence) https://review.opendev.org/652104 | 16:39 |
*** dave-mccowan has joined #openstack-nova | 16:40 | |
aspiers | mriedem: does this look familiar to you? b'/home/zuul/src/opendev.org/openstack/nova/.tox/lower-constraints/lib/python3.6/site-packages/pymysql/cursors.py:167: Warning: (1831, "Duplicate index \'block_device_mapping_instance_uuid_virtual_name_device_name_idx\' defined on the table \'fjisjekoia.block_device_mapping\'. This is deprecated and will be disallowed in a future release.")' | 16:40 |
aspiers | seems completely unrelated to my patch which is failing in the gate | 16:40 |
aspiers | and I think I've seen it a few times in the last 24 hours | 16:40 |
*** ricolin has quit IRC | 16:42 | |
aspiers | oh, that's just a warning | 16:43 |
aspiers | still trying to find the real issue in http://logs.openstack.org/66/661266/4/gate/openstack-tox-lower-constraints/7af4be7/job-output.txt.gz | 16:43 |
aspiers | I see a bunch of timeouts | 16:43 |
openstackgerrit | Merged openstack/os-vif stable/stein: Prevent "qbr" Linux Bridge from replying to ARP messages https://review.opendev.org/655678 | 16:45 |
kashyap | aspiers: Remind me again, in 'os-traits' repo, what to do when 'tox' complains too long lines for a URL? | 16:47 |
aspiers | kashyap: isn't that just a warning? | 16:47 |
aspiers | if not, I guess # noqa or similar | 16:47 |
kashyap | aspiers: It moans an ERROR -- "E501 line too long (108 > 79 characters)" | 16:48 |
kashyap | aspiers: Before I go off shortly, I'm pushing the change. For convenience, I'm including a short "changelog" noting explicitly what I addressed | 16:48 |
kashyap | ... so that if you want to rebase on it tomm. | 16:48 |
aspiers | kashyap: http://flake8.pycqa.org/en/3.1.1/user/ignoring-errors.html#in-line-ignoring-errors | 16:49 |
aspiers | # noqa: E501 | 16:49 |
kashyap | Right, thanks! | 16:49 |
*** davidsha has quit IRC | 16:53 | |
mriedem | aspiers: that duplicate index thing is super old yes | 16:53 |
*** derekh has quit IRC | 16:53 | |
*** kmalloc_away is now known as kmalloc | 16:55 | |
*** lbragstad has quit IRC | 16:59 | |
*** lbragstad has joined #openstack-nova | 17:00 | |
*** phillw has left #openstack-nova | 17:00 | |
aspiers | mriedem: the failures are very similar to https://bugs.launchpad.net/nova/+bug/1823251, but without the InterfaceError | 17:05 |
openstack | Launchpad bug 1823251 in OpenStack Compute (nova) "Spike in TestNovaMigrationsMySQL.test_walk_versions/test_innodb_tables failures since April 1 2019 on limestone-regionone" [High,Confirmed] | 17:05 |
aspiers | I wonder if the InterfaceError is just one symptom of a timeout | 17:06 |
aspiers | My timeouts show stuff like IndexError: tuple index out of range | 17:06 |
aspiers | and 'sqlalchemy.exc.ResourceClosedError: This result object does not return rows. It has been closed automatically.' | 17:06 |
aspiers | ah, that latter one looks similar to https://bugs.launchpad.net/nova/+bug/1793364 | 17:08 |
openstack | Launchpad bug 1793364 in Manila "mysql db opportunistic unit tests timing out intermittently in the gate (bad thread switch?)" [Undecided,In progress] - Assigned to Goutham Pacha Ravi (gouthamr) | 17:08 |
mriedem | right | 17:09 |
mriedem | i've been down that road | 17:09 |
aspiers | I guess elastic recheck will tell me as much when the other gate jobs finish | 17:10 |
openstackgerrit | Kashyap Chamarthy proposed openstack/os-traits master: hw: cpu: Rework the directory layout; add missing traits https://review.opendev.org/655193 | 17:11 |
*** priteau has joined #openstack-nova | 17:11 | |
*** jcosmao has left #openstack-nova | 17:12 | |
kashyap | aspiers: When you get a moment, does the short change log address all things you want --^ | 17:12 |
aspiers | kashyap: already looking at it | 17:12 |
kashyap | Thank you very much, sir. | 17:13 |
* aspiers wonders what the "ref: " is for, but I guess the precedent was already set on that | 17:13 | |
kashyap | aspiers: Yeah, I wondered, too. Just cargo-culted it. | 17:14 |
aspiers | +1 | 17:15 |
kashyap | aspiers: Ah, thanks. My focus was in Gerrit, and I saw the "Update" pop-up (your comment). I was expecting a firm -1 :D | 17:15 |
aspiers | Oh ye of little faith :) | 17:16 |
kashyap | Okay, now I cook food | 17:16 |
aspiers | Good plan | 17:16 |
*** priteau has quit IRC | 17:33 | |
ganso | lyarwood, melwitt, dansmith: Hello! When you have a minute, could you please take a look at those backports that are missing just a final +2? https://review.opendev.org/#/c/652153 , https://review.opendev.org/#/c/658136 and https://review.opendev.org/#/c/661349 ? Thanks in advance! =) | 17:35 |
ganso | tonyb: thanks a lot =D | 17:35 |
*** luksky has joined #openstack-nova | 17:41 | |
*** maciejjozefczyk has quit IRC | 17:41 | |
openstackgerrit | melanie witt proposed openstack/nova master: Follow up for counting quota usage from placement https://review.opendev.org/662056 | 17:49 |
*** awalende has joined #openstack-nova | 17:55 | |
*** ociuhandu has quit IRC | 17:57 | |
*** awalende has quit IRC | 17:59 | |
*** guozijn has joined #openstack-nova | 18:02 | |
*** priteau has joined #openstack-nova | 18:04 | |
*** guozijn has quit IRC | 18:07 | |
*** guozijn has joined #openstack-nova | 18:18 | |
*** guozijn has quit IRC | 18:22 | |
melwitt | mriedem: replied to your comments on https://review.opendev.org/#/c/638073 | 18:24 |
melwitt | and I dunno if you saw, but it looks like https://review.opendev.org/661391 fixes the novnc tests on the multi-cell job | 18:24 |
*** BjoernT_ has quit IRC | 18:33 | |
*** panda|ruck has quit IRC | 18:35 | |
*** priteau has quit IRC | 18:35 | |
*** ralonsoh has quit IRC | 18:35 | |
openstackgerrit | Artom Lifshitz proposed openstack/nova master: Revert resize: wait for events according to hybrid plug https://review.opendev.org/644881 | 18:36 |
openstackgerrit | Artom Lifshitz proposed openstack/nova master: Run revert resize tests in nova-live-migration https://review.opendev.org/653498 | 18:36 |
openstackgerrit | Artom Lifshitz proposed openstack/nova master: [DNM] use iptables in nova-multinode https://review.opendev.org/660782 | 18:36 |
artom | mriedem, ^^ when you get some time, assuming unit tests pass (I've fixed all of them, normally). I think sean-k-mooney and I have finally figured it out. | 18:37 |
*** panda has joined #openstack-nova | 18:37 | |
artom | The DNM patch is... optional? I'm not sure what we want to do upstream, but it's good to have it on top to show that both hybrid and normal plug work | 18:37 |
*** konetzed has joined #openstack-nova | 18:47 | |
sean-k-mooney | the DNM patch change the job to use iptables. if we wanted to merge it we should add a second job that use iptable rather then changing multinode job to use it instead of the defualt contrack driver | 18:47 |
konetzed | will the scheduler honor setting ram_weight_multiplier as extra metadata on a host aggregate? The goal is just to have one host aggregate stack vs spread. | 18:49 |
sean-k-mooney | konetzed: i dont think so https://github.com/openstack/nova/blob/master/nova/scheduler/weights/ram.py | 18:50 |
sean-k-mooney | https://github.com/openstack/nova/blob/master/nova/scheduler/utils.py#L1089 | 18:51 |
melwitt | konetzed: to do that, I think you'd have to set ram_weight_multiplier as desired in the nova.conf of the compute hosts that are a member of the host aggregate you want to stack vs spread | 18:51 |
sean-k-mooney | actully look like it might | 18:51 |
melwitt | ok, I didn't know that :\ | 18:52 |
sean-k-mooney | neither did i i assume we broke that when we broke the allocation ratios | 18:52 |
sean-k-mooney | i guess not | 18:52 |
sean-k-mooney | its proably suppor fragile if the host is in two aggrates with different values | 18:53 |
*** BjoernT has joined #openstack-nova | 18:54 | |
mriedem | you can have per-aggregate weights | 18:54 |
sean-k-mooney | well from the code yes but if a host is in two aggrates and they have differnt values im not sure what we do | 18:55 |
konetzed | melwitt: sean-k-mooney: thanks for the quick answer. | 18:55 |
mriedem | https://docs.openstack.org/nova/latest/user/filter-scheduler.html#weights | 18:55 |
mriedem | "If more than one value is found for a host in aggregate metadata, the minimum value will be used." | 18:56 |
mriedem | depends on the weigher | 18:56 |
mriedem | but the docs are all tehre | 18:56 |
mriedem | *there | 18:56 |
mriedem | per-aggregate weights is new in stein | 18:56 |
mriedem | yikun added it | 18:56 |
melwitt | konetzed ^ updated answer :P sorry | 18:56 |
konetzed | mriedem: thanks. Looks like i need to update from Rocky ;) | 18:57 |
*** BjoernT_ has joined #openstack-nova | 18:59 | |
*** BjoernT has quit IRC | 18:59 | |
*** konetzed has quit IRC | 19:05 | |
*** sapd1_x has joined #openstack-nova | 19:06 | |
*** ociuhandu has joined #openstack-nova | 19:18 | |
*** dklyle has quit IRC | 19:21 | |
mriedem | melwitt: ack i'll get back to it in a bit | 19:26 |
melwitt | thanks | 19:26 |
mriedem | unrelated plug for a question about the first stable stein release for anyone that has input http://lists.openstack.org/pipermail/openstack-discuss/2019-May/006617.html | 19:27 |
mriedem | otherwise i'll probably just punt and un-WIP the release patch | 19:27 |
sean-k-mooney | mriedem: oh ya i ment to reply. i think adding a known issuse release not makes sense | 19:27 |
sean-k-mooney | im just not sure what it shoudl say | 19:28 |
*** dklyle has joined #openstack-nova | 19:29 | |
mriedem | btw is this the heartbeat thing we'd expect to see in the n-api logs for that bug http://logs.openstack.org/28/662028/1/experimental/tempest-pg-full/91f6094/controller/logs/screen-n-api.txt.gz?level=TRACE#_May_29_18_00_29_897709 ? | 19:33 |
mriedem | because it's all over these tempest-pg-full logs | 19:33 |
melwitt | I haven't actually seen that log for this.. when I reproduced it in devstack I only saw the "connection reset" error message from oslo.messaging. and some other messages about retrying/reconnecting | 19:36 |
mriedem | i see lots of "missed heartbeats from client, timeout: 60s" in the rabbit logs | 19:37 |
mriedem | http://logs.openstack.org/28/662028/1/experimental/tempest-pg-full/91f6094/controller/logs/rabbitmq/rabbit@ubuntu-bionic-rax-iad-0006739854_log.txt.gz | 19:37 |
sean-k-mooney | it looks like the tcp connection is also being closed | 19:37 |
*** konetzed has joined #openstack-nova | 19:38 | |
sean-k-mooney | mriedem: ya that is expected | 19:38 |
sean-k-mooney | if we dont disabel monkey patching or disabel the heartbeat then we will have missed heartbeat message in rabbitmq | 19:39 |
mriedem | i guess my point is there was concern about not hitting this in the gate | 19:40 |
mriedem | even though we run with uwsgi in devstack and eventlet monkey-patched | 19:40 |
sean-k-mooney | well in the gate we should see this since we have 1 thread per wsgi process | 19:41 |
sean-k-mooney | but the api sould actuly still work | 19:41 |
melwitt | yeah, the gate is normally too busy with activity to cause the heartbeat interruption where the wsgi app pauses bc of lack of activity | 19:42 |
melwitt | so... I dunno how that's showing up in tempest-pg-full :\ | 19:43 |
zigo | mriedem: Hey matt, thanks again for your patch, it fixed it for us. I've uploaded the fix to Sid, and hopefully it will be part of Buster (currently filling-up an unblock bug to the Debian release team). | 19:43 |
mriedem | zigo: yw. as noted on the review, i'll likely be modifying that patch a bit. | 19:44 |
sean-k-mooney | melwitt: wll its not printing constantly so it posible that ocationally we do time out even in the gate | 19:44 |
melwitt | o | 19:45 |
mriedem | brb | 19:48 |
*** mriedem has quit IRC | 19:48 | |
efried | aspiers, kashyap: Minor tweaks to https://review.opendev.org/#/c/655193/ if either of you is around. | 19:50 |
aspiers | kashyap's gone I think | 19:50 |
aspiers | and of course I'm not here | 19:50 |
efried | okay, nbd | 19:50 |
aspiers | I wouldn't be so crazy as to be working at 9pm | 19:50 |
aspiers | he said, while writing functional tests :-/ | 19:51 |
sean-k-mooney | melwitt: you know one thing people could try is setting the ideal time for the wsgi server to like 300s instead of whatever teh default is | 19:53 |
sean-k-mooney | if you are not reciving at least 1 api request every 5 minutes to keep it alive you proabley dont need the performace boost from moneypatching | 19:54 |
sean-k-mooney | you will endup useing more ram as the wsgi app will be loaded more often but its tradoffs nomater what we do | 19:55 |
melwitt | well... what about in the middle of the night, when no one's using the api potentially? I feels like any deployment, no matter how large or busy, will have some down time at some point during the day | 19:55 |
*** mriedem has joined #openstack-nova | 19:55 | |
*** imacdonn has quit IRC | 19:56 | |
sean-k-mooney | in that case it will suspend after 5 mins and then the next request it recived it will reconnect | 19:56 |
*** imacdonn has joined #openstack-nova | 19:56 | |
melwitt | ok, so you're still talking in the context of threads=1 and just avoiding the scary heartbeat messages more | 19:56 |
sean-k-mooney | but if people want to reduce how often that log message is printed they can tweak how agress the wsgi server is at sleeping | 19:57 |
sean-k-mooney | ya | 19:57 |
melwitt | I thought you were suggesting increasing the idle timeout as a way of allowing threads > 1 to work | 19:57 |
melwitt | ok | 19:57 |
aspiers | efried: I finally found MAX_INT in placement.db.constants, but that's not available from the unit testing testenvs | 19:57 |
efried | aspiers: Swear there was somewhere else we were using that. | 19:57 |
aspiers | using nova.db.constants for now | 19:57 |
aspiers | but that's not really correct | 19:58 |
aspiers | even if they happen to be the same value | 19:58 |
*** ociuhandu has quit IRC | 19:58 | |
aspiers | efried: it's available to functional testenvs, but I need it in one unit test also | 19:58 |
melwitt | mriedem: I can take a stab at the stein reno and then have sean-k-mooney correct me because sean knows more than I do about it at this point | 19:58 |
efried | aspiers: You need it in your code too | 19:58 |
sean-k-mooney | aspiers: you could just use 2**64 or 2**32 | 19:59 |
aspiers | efried: well sure, but presumably it's safe to use placement from nova code? | 19:59 |
efried | not at all | 19:59 |
aspiers | huh | 19:59 |
sean-k-mooney | aspiers: we cant import random parts of placement in nova | 19:59 |
aspiers | OK | 20:00 |
efried | Right. Placement, from nova's perspective, is supposed to be purely a REST interface. Absolutely nothing else. | 20:00 |
efried | I think we're importing a fixture to make some testing easier | 20:00 |
efried | but prod code should be purely REST touchpoints. | 20:00 |
aspiers | Seems totally reasonable to me if it exported constants at least, if nothing else | 20:00 |
*** hongbin has joined #openstack-nova | 20:00 | |
efried | yeah, I could get behind that in theory. | 20:00 |
efried | There has been talk of making a placement | 20:00 |
efried | placement-lib project | 20:01 |
sean-k-mooney | why not just creat the constant in nova | 20:01 |
melwitt | sean-k-mooney: aside, I wonder did we ever get this sorted downstream in the bz's now that we know we should _not_ disable heartbeats | 20:01 |
aspiers | sean-k-mooney: like I said, I'm just using nova.db.constants.MAX_INT | 20:01 |
sean-k-mooney | if its a constant its not going to change often one would hope | 20:01 |
efried | which would contain things like os-traits and os-resource-classes as well as constants and test fixtures. | 20:01 |
artom | Wouldn't test fixtures go into oslo_test? | 20:01 |
efried | not placement test fixtures | 20:01 |
sean-k-mooney | melwitt: i think martin was going to try testing it with heatbeats disabel to see what happens | 20:01 |
aspiers | nova.db.constants.MAX_INT isn't technically correct, but it's so damn close that I think it's good enough | 20:02 |
efried | aspiers: Yeah, was gonna say, as long as you use something you're sure is <= what placement can handle, "arbitrarily large" could be pretty much anything. | 20:02 |
artom | 31337 :D | 20:02 |
efried | You could hard code it to 2000 and that would probably be fine. | 20:02 |
aspiers | efried: actually answering that might breach an NDA ... | 20:03 |
melwitt | sean-k-mooney: hm... well, it will work on the surface but the issues dansmith pointed out were that rabbit will leave stale connections lying around in that case, so overall it's not a good idea to disable. hopefully martin will test that out as part of it | 20:03 |
sean-k-mooney | oh i did not know about the stale connection issue? | 20:03 |
aspiers | artom: probably safer than 1337 ;) | 20:04 |
sean-k-mooney | melwitt: we we ar confident we should not disable heatbeats then we can save martin time and do? | 20:04 |
aspiers | artom: which was one of the codes in one of the Denver escape rooms XD | 20:04 |
artom | Noice. | 20:05 |
sean-k-mooney | nothing? supress log? make ideal time 5 minuets for mod_wsgi? | 20:05 |
sean-k-mooney | i think the current situation is more or less lets figure out how to fix it upstream and then backport that fix upstream and downstream | 20:06 |
melwitt | sean-k-mooney: yes, based on the fact that rabbit will not clean up stale connections in that case, I don't think we should disable it. admittedly I don't understand a ton about this, but the docs recommend against disabling unless tcp keepalives are used in their place https://www.rabbitmq.com/heartbeats.html#disabling | 20:07 |
sean-k-mooney | we do use tcp keepalives | 20:08 |
sean-k-mooney | and we set it to like 1 second intervals | 20:08 |
sean-k-mooney | triplos defalts are pretty agressive in trying to keep the connection alive | 20:08 |
melwitt | the only possible thing we could do with the logging, if oslo.messaging ppl are agreeable, would be to downgrade the "connection reset" message to WARNING and then set our log level to ERROR to hide it | 20:09 |
sean-k-mooney | melwitt: i was looking it python log filters a bit too | 20:09 |
melwitt | and then obviously we have to have threads=1 | 20:09 |
sean-k-mooney | i think we could intall a logfilter that would match on the oslo meesge and drop them too if oslo do not want to change the level | 20:10 |
mriedem | melwitt: ok, i'm torn between waffling over a reno on the issue and figuring out just the right words vs releasing what we have (which is quite a bit unreleased in stable/stein) and just letting the reno happen later if at all | 20:10 |
melwitt | oh, I see | 20:10 |
mriedem | b/c i'm not an authority to review that reno | 20:10 |
melwitt | yeah, that's fair | 20:11 |
melwitt | we don't need to do a release to get the reno out there right? it will just get published to the docs automatically | 20:11 |
sean-k-mooney | mriedem: i dont think the reno is critcal jsut nice to have and sice we are still debating what the best solution is im not sure we should hold up the release for it | 20:11 |
melwitt | sean-k-mooney: ok, well, I guess according to that doc it's maybe probably ok to disable heartbeats if we have tcp keepalives in place https://www.rabbitmq.com/heartbeats.html#tcp-keepalives I think either way we'd want thorough testing of it before we go ahead and put the change out there | 20:15 |
sean-k-mooney | melwitt: this is what triplo configures https://github.com/openstack/tripleo-heat-templates/blob/d90434187315e96d3ebc184866dcd91954c0471d/deployment/kernel/kernel-baremetal-puppet.yaml#L117-L122 | 20:19 |
*** xek_ has quit IRC | 20:21 | |
sean-k-mooney | it looks like that is even more agressive then rabbitmqs suggestions https://www.rabbitmq.com/networking.html#tcp-keepalives | 20:21 |
melwitt | mriedem: ack | 20:22 |
melwitt | oops | 20:22 |
melwitt | sean-k-mooney: ack | 20:22 |
sean-k-mooney | :) | 20:22 |
melwitt | mriedem: I'm fine either way releasing the reno now vs "soon" since AFAIK it doesn't have to be connected with the release, reno gets published independently. I was mostly saying I think we should publish a known issue vs not | 20:25 |
mriedem | i removed the -WIP so the release gods can do as they please | 20:26 |
melwitt | k | 20:26 |
*** maciejjozefczyk has joined #openstack-nova | 20:35 | |
*** ociuhandu has joined #openstack-nova | 20:35 | |
*** sapd1_x has quit IRC | 20:41 | |
*** maciejjozefczyk has quit IRC | 20:44 | |
*** ociuhandu has quit IRC | 20:45 | |
sean-k-mooney | fun fact. resize between flavor with different size hugepages is broken | 20:52 |
sean-k-mooney | mainly becasue the nova.virt.hardware modeuld does not know what a rebuild or resize is and we end up using the page size form the embed instance numa toplogy instead of the new flavor/image | 20:53 |
*** slaweq has quit IRC | 21:03 | |
*** itlinux has quit IRC | 21:05 | |
*** wwriverrat has quit IRC | 21:08 | |
*** slaweq has joined #openstack-nova | 21:11 | |
*** whoami-rajat has quit IRC | 21:13 | |
*** itlinux has joined #openstack-nova | 21:13 | |
melwitt | sean-k-mooney: reading through the full comments on https://bugs.launchpad.net/nova/+bug/1829062 it doesn't look like it's the same issue as the pause/resume rabbit reconnecting thing we were talking about | 21:14 |
openstack | Launchpad bug 1829062 in StarlingX "nova placement api non-responsive due to eventlet error" [Critical,In progress] - Assigned to Gerry Kopec (gerry-kopec) | 21:14 |
mriedem | melwitt: replies to your replies in https://review.opendev.org/#/c/638073/31 but +W - some of the stuff in there could go into your FUP | 21:15 |
melwitt | I would expect their wsgi config is default threads=1 | 21:15 |
melwitt | mriedem: yaaaaaay thanks. will add to the FollowUP | 21:16 |
*** slaweq has quit IRC | 21:16 | |
sean-k-mooney | melwitt: the fact that its complaining about resuming on a different thread implies they have treads!=1 | 21:16 |
sean-k-mooney | but part of the annoyance it that placmeent has never used eventlet and we only started monkeypatching it in stien after extracting placment | 21:17 |
melwitt | sean-k-mooney: o. yeah | 21:18 |
sean-k-mooney | so people running runnign placment under the non extract version are running a config that we really have not tested well at all | 21:18 |
sean-k-mooney | since the gate uses extracted placement | 21:18 |
melwitt | right | 21:19 |
melwitt | ok, I'll throw another comment onto that bug to clarify the wsgi config thing | 21:19 |
melwitt | I'm trying to write the reno also | 21:19 |
sean-k-mooney | placement is written assuming eventlet is not used so there might be dragons there wen run under eventlet in general | 21:19 |
sean-k-mooney | ack | 21:20 |
melwitt | this whole issue makes me :*****( | 21:20 |
melwitt | have two paragraphs so far | 21:21 |
sean-k-mooney | there are too many ways to fix it all of which suck for different reasons | 21:21 |
*** priteau has joined #openstack-nova | 21:22 | |
*** pcaruana has quit IRC | 21:23 | |
mriedem | tonyb: this is all yours https://review.opendev.org/#/c/655692/ | 21:25 |
tonyb[m] | mriedem: Okay I | 21:26 |
tonyb[m] | 'll look after the school run | 21:26 |
*** priteau has quit IRC | 21:26 | |
aspiers | efried: you still around? | 21:27 |
efried | y | 21:27 |
aspiers | turns out that placement's inventory policy hardcodes a minimum of 1, not 0, for resource class inventory :-/ | 21:27 |
aspiers | for MEM_ENCRYPTION_CONTEXT, this is clearly a problem | 21:27 |
efried | why? | 21:28 |
aspiers | there are even explicit tests for this https://opendev.org/openstack/placement/src/branch/master/placement/tests/functional/gabbits/allocations.yaml#L107 | 21:28 |
aspiers | because hosts which can't do SEV need to be inventoried as 0 units | 21:28 |
efried | the test you pointed to is for an *allocation* requesting zero units of a thing. | 21:29 |
aspiers | yes, and it expects a 400 failure | 21:29 |
efried | I don't see the issue here. | 21:29 |
aspiers | the issue is that if I lower the minimum from 1 to 0 then these tests fail | 21:29 |
efried | "lower the minimum" - of what? | 21:30 |
aspiers | in the schema | 21:30 |
efried | argh, in *what* schema? | 21:30 |
aspiers | https://opendev.org/openstack/placement/src/branch/master/placement/schemas/inventory.py#L29 | 21:30 |
aspiers | without that, MEM_ENCRYPTION_CONTEXT can't be inventoried as 0 | 21:30 |
efried | If you can't do SEV, you don't put up any inventory of MEM_ENC_CTX. If you don't want SEV, you don't include MEM_ENC_CTX in your GET /a_c request or consequently in your allocation. | 21:31 |
aspiers | maybe we can tweak the schema to treat this resource class differently | 21:31 |
efried | You never inventory a thing with 0 total | 21:31 |
efried | no | 21:31 |
efried | do not muck with the schema | 21:31 |
aspiers | ohhh I see | 21:31 |
efried | the schema is right | 21:31 |
aspiers | OK, so just don't include it in the inventory | 21:31 |
efried | right | 21:31 |
aspiers | sounds good, I'll try that. thanks! | 21:31 |
efried | ++ | 21:31 |
sean-k-mooney | aspiers: ya you only create an invetory if there is capasity to consume | 21:32 |
sean-k-mooney | so if a host does not support sev dont create an sev inventory on the RP | 21:32 |
openstackgerrit | melanie witt proposed openstack/nova stable/stein: Add reno about nova-api eventlet monkey-patching and rabbitmq https://review.opendev.org/662095 | 21:34 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Fix hard-delete of instance with soft-deleted referential constraints https://review.opendev.org/661398 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Update usage in RT.drop_move_claim during confirm resize https://review.opendev.org/641806 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Robustify attachment tracking in CinderFixtureNewAttachFlow https://review.opendev.org/658904 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add Migration.cross_cell_move and get_by_uuid https://review.opendev.org/614012 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add InstanceAction/Event create() method https://review.opendev.org/614036 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add Instance.hidden field https://review.opendev.org/631123 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add TargetDBSetupTask https://review.opendev.org/627892 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add CrossCellMigrationTask https://review.opendev.org/631581 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Execute TargetDBSetupTask https://review.opendev.org/633853 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add prep_snapshot_based_resize_at_dest compute method https://review.opendev.org/633293 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add PrepResizeAtDestTask https://review.opendev.org/627890 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add prep_snapshot_based_resize_at_source compute method https://review.opendev.org/634832 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add nova.compute.utils.delete_image https://review.opendev.org/637605 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add PrepResizeAtSourceTask https://review.opendev.org/627891 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Refactor ComputeManager.remove_volume_connection https://review.opendev.org/642183 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add power_on kwarg to ComputeDriver.spawn() method https://review.opendev.org/642590 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add finish_snapshot_based_resize_at_dest compute method https://review.opendev.org/635080 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add FinishResizeAtDestTask https://review.opendev.org/635646 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add archive_deleted_rows wrinkle to cross-cell functional test https://review.opendev.org/651650 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add CrossCellWeigher https://review.opendev.org/614353 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add functional test for anti-affinity cross-cell migration https://review.opendev.org/661859 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Support cross-cell moves in external_instance_event https://review.opendev.org/658478 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: Add cross-cell resize policy rule and enable in API https://review.opendev.org/638269 | 21:35 |
openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: Enable cross-cell resize in the nova-multi-cell job https://review.opendev.org/656656 | 21:35 |
*** mriedem has quit IRC | 21:36 | |
openstackgerrit | melanie witt proposed openstack/nova stable/stein: Add reno about nova-api eventlet monkey-patching and rabbitmq https://review.opendev.org/662095 | 21:36 |
openstackgerrit | melanie witt proposed openstack/nova stable/stein: Add reno about nova-api eventlet monkey-patching and rabbitmq https://review.opendev.org/662095 | 21:37 |
*** priteau has joined #openstack-nova | 21:39 | |
*** jaypipes has quit IRC | 21:41 | |
*** udesale has quit IRC | 21:43 | |
openstackgerrit | Merged openstack/nova master: Fix the server group "policy" field type in api-ref https://review.opendev.org/661869 | 21:44 |
openstackgerrit | Merged openstack/nova master: docs: Don't version links to reno docs https://review.opendev.org/661967 | 21:45 |
*** eharney has quit IRC | 21:48 | |
*** efried has quit IRC | 21:49 | |
*** bbowen has quit IRC | 21:49 | |
*** takashin has joined #openstack-nova | 21:49 | |
*** BjoernT_ is now known as BjoernT | 21:51 | |
*** priteau has quit IRC | 21:51 | |
*** efried has joined #openstack-nova | 21:51 | |
*** JamesBenson has quit IRC | 21:53 | |
*** tjgresha has quit IRC | 22:07 | |
*** slaweq has joined #openstack-nova | 22:11 | |
*** slaweq has quit IRC | 22:16 | |
openstackgerrit | Adam Spiers proposed openstack/nova master: WIP: Provide HW_CPU_X86_AMD_SEV trait when SEV is supported https://review.opendev.org/638680 | 22:23 |
openstackgerrit | Adam Spiers proposed openstack/nova master: Track inventory for new MEM_ENCRYPTION_CONTEXT resource class https://review.opendev.org/662105 | 22:24 |
*** mlavalle has quit IRC | 22:32 | |
aspiers | efried: brand new patch added to the top of the SEV series ^^^ | 22:33 |
efried | yup, looking at the series now. | 22:33 |
aspiers | This should be the last of the detection / inventory changes. The remaining ones are all about actually consuming the results of that and booting an SEV guest. | 22:34 |
aspiers | Looking at http://specs.openstack.org/openstack/nova-specs/specs/train/approved/amd-sev-libvirt-support.html#work-items, there are now Gerrit reviews (some merged) for the first 6 out of 11 MVP work items. So halfway ... kinda :) | 22:35 |
aspiers | #7 is gonna be the tough one | 22:36 |
aspiers | The others are mostly polish | 22:36 |
aspiers | Alright, I'm done for today | 22:37 |
openstackgerrit | Merged openstack/nova master: cleanup evacuated instances not on hypervisor https://review.opendev.org/512623 | 22:41 |
*** BjoernT has quit IRC | 22:43 | |
*** tkajinam has joined #openstack-nova | 22:54 | |
*** awalende has joined #openstack-nova | 23:00 | |
*** _erlon_ has quit IRC | 23:03 | |
*** artom has quit IRC | 23:05 | |
*** awalende has quit IRC | 23:05 | |
*** rcernin has joined #openstack-nova | 23:06 | |
*** rcernin has quit IRC | 23:07 | |
*** rcernin has joined #openstack-nova | 23:07 | |
*** macza has quit IRC | 23:09 | |
*** luksky has quit IRC | 23:13 | |
*** lbragstad has quit IRC | 23:34 | |
*** lbragstad has joined #openstack-nova | 23:34 | |
*** artom has joined #openstack-nova | 23:42 | |
*** tbachman has quit IRC | 23:54 | |
*** ccamacho has quit IRC | 23:58 | |
*** tbachman has joined #openstack-nova | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!