| jaypipes | mriedem: thanks matt | 00:00 |
|---|---|---|
| mriedem | newOpenstacker: is this ocata, pike, queens (master)? | 00:00 |
| *** tetsuro has joined #openstack-nova | 00:00 | |
| newOpenstacker | Oh sorry I forgot to mention that. This is on newton currently | 00:01 |
| *** penick has quit IRC | 00:02 | |
| *** felipemonteiro_ has quit IRC | 00:02 | |
| mriedem | what happens if you do the same thing with a straight curl request? i wonder if the the CLIs are trying to "help" somehow | 00:02 |
| newOpenstacker | ok. i'll try that and get back | 00:03 |
| *** penick has joined #openstack-nova | 00:04 | |
| mriedem | i'd point you at https://developer.openstack.org/api-guide/compute/paginated_collections.html but it's more confusing probably because the description and samples are all effed up | 00:06 |
| mriedem | saying it's paging over images but it's clearly servers, and the bottom sample has a self link with the wrong id | 00:06 |
| * mriedem opens bug | 00:06 | |
| mriedem | heh, and the bug link on that page doesn't work | 00:06 |
| mriedem | https://bugs.launchpad.net/nova/+bug/1737854 | 00:10 |
| openstack | Launchpad bug 1737854 in OpenStack Compute (nova) "Wrong content in "paginated collections" API guide page" [High,Confirmed] | 00:10 |
| newOpenstacker | yes, even with curl calls the behavior is the same | 00:11 |
| mriedem | hmm, not sure why with limit=1 and marker=x you'd get back x | 00:12 |
| mriedem | it should be x+1 in the instances table | 00:12 |
| mriedem | sorted on created_at,id in descending order | 00:12 |
| mriedem | i wonder if that instance is a build request or something... | 00:13 |
| mriedem | can you check if that instance is in the nova.instances table or the nova_api.build_requests table? | 00:13 |
| mriedem | based on the instance uuid | 00:13 |
| newOpenstacker | any particular column that is of interest here? | 00:14 |
| newOpenstacker | The instance is in nova.instances with vm_state as building and also present in the build_requests table | 00:15 |
| mriedem | ok that's likely the problem | 00:15 |
| mriedem | did that instance fail to build? | 00:15 |
| newOpenstacker | it got stuck in building state... | 00:15 |
| mriedem | i'm guessing the build request didn't get cleaned up | 00:15 |
| mriedem | the instance failed to build and the build request didn't get cleaned up for some reason | 00:16 |
| newOpenstacker | so if there are instances in building state then paginations don't work? | 00:16 |
| mriedem | do you have all of the latest newton fixes from stable/newton? | 00:16 |
| mriedem | no | 00:16 |
| mriedem | not saying that | 00:16 |
| newOpenstacker | checking the exact version | 00:16 |
| mriedem | but the instance shouldn't be in both the build_requests and instances table permanently | 00:16 |
| mriedem | the entry in build_requests should be temporary until we find a host for the instance during scheduling | 00:17 |
| mriedem | when listing instances, we start with the build_requests table and then move to the instances tables in the nova db | 00:17 |
| newOpenstacker | on newton we are 7 minor releases behind. current tag on nova newton is 14.0.10 while this setup is on 14.0.3. | 00:19 |
| mriedem | ok, definitely might have fixed the problem already where the build request should have been deleted | 00:20 |
| newOpenstacker | I'll have to check why the instance is stuck in building state. Its been that way for couple of days. | 00:20 |
| mriedem | looking at our paging code though, i don't think we're handling the marker properly if we find it in the build_requests table | 00:20 |
| newOpenstacker | Ah ok. I'll see if we can move to the latest on newton | 00:20 |
| newOpenstacker | Is there a bug already for this that I can monitor? | 00:20 |
| mriedem | normally when we find the marker we need to nix it so we don't look for that marker in the instances table if we have more room in our limit, but i don't see that happening | 00:21 |
| mriedem | i've never heard of the marker thing | 00:21 |
| *** hamzy has joined #openstack-nova | 00:21 | |
| mriedem | these are the fixes you're missing btw http://paste.openstack.org/show/628777/ | 00:22 |
| mriedem | 608105a Provide an online data migration to cleanup orphaned build requests | 00:23 |
| mriedem | could be just what you need | 00:23 |
| mriedem | release notes for newton if you're going to upgrade https://docs.openstack.org/releasenotes/nova/newton.html | 00:24 |
| *** brault has joined #openstack-nova | 00:25 | |
| newOpenstacker | OK. Thanks @mriedem I'll try to get those fixes | 00:25 |
| mriedem | i think that will fix the marker issue you're seeing too | 00:26 |
| mriedem | because we should never find the marker in two different places | 00:26 |
| *** sree has joined #openstack-nova | 00:27 | |
| newOpenstacker | Understood. So in this case removing those offending records from the database should fix it as well? | 00:27 |
| mriedem | that's my guess | 00:27 |
| newOpenstacker | Cool. Thanks @mriedem | 00:27 |
| mriedem | yw | 00:27 |
| *** jaypipes has quit IRC | 00:28 | |
| *** yangyapeng has quit IRC | 00:28 | |
| *** yangyapeng has joined #openstack-nova | 00:29 | |
| *** salv-orl_ has quit IRC | 00:29 | |
| mriedem | dansmith: melwitt: something to lose sleep over - shouldn't we set the marker to None if we find the marker in the build_requests table? https://github.com/openstack/nova/blob/master/nova/objects/build_request.py#L447 | 00:30 |
| mriedem | just like here https://github.com/openstack/nova/blob/master/nova/compute/api.py#L2426 | 00:30 |
| *** brault has quit IRC | 00:30 | |
| dansmith | why? | 00:30 |
| dansmith | marker isn't used after that, right? | 00:31 |
| mriedem | yeah after build requests we page into the cells | 00:31 |
| dansmith | back in compute api | 00:31 |
| *** r-daneel has quit IRC | 00:31 | |
| *** sree has quit IRC | 00:31 | |
| mriedem | yeah https://github.com/openstack/nova/blob/master/nova/compute/api.py#L2372-L2378 | 00:32 |
| mriedem | so i realize setting marker=None in the build request code wouldn't fix that, we'd have to pass a marker variable back | 00:32 |
| mriedem | here https://github.com/openstack/nova/blob/master/nova/compute/api.py#L2356 | 00:32 |
| dansmith | if we got anything back from build request list then the marker was in there, yeah? | 00:32 |
| openstackgerrit | Merged openstack/nova master: VMware: fix memory stats https://review.openstack.org/516634 | 00:32 |
| *** openstackgerrit has quit IRC | 00:33 | |
| dansmith | which I guess we don't check | 00:33 |
| mriedem | i don't think so | 00:33 |
| mriedem | https://github.com/openstack/nova/blob/master/nova/objects/build_request.py#L440-L457 | 00:33 |
| mriedem | we happily return what we found | 00:33 |
| mriedem | i.e. we don't raise MarkerNotFound | 00:33 |
| *** mlavalle has quit IRC | 00:33 | |
| *** yangyapeng has quit IRC | 00:33 | |
| dansmith | hmm | 00:34 |
| mriedem | which seems buggish... | 00:34 |
| dansmith | yeah | 00:34 |
| *** chyka_ has quit IRC | 00:34 | |
| *** rocky-shiyan has quit IRC | 00:34 | |
| tetsuro | mriedem: I responsed to your comment in https://review.openstack.org/#/c/465160/ | 00:36 |
| *** zhurong has joined #openstack-nova | 00:37 | |
| mriedem | https://bugs.launchpad.net/nova/+bug/1737856 | 00:38 |
| openstack | Launchpad bug 1737856 in OpenStack Compute (nova) "Listing instances with a marker doesn't nix the marker if it's found in build_requests" [Undecided,Triaged] | 00:38 |
| *** jmlowe has quit IRC | 00:38 | |
| mriedem | alright my eyes are going to fall out if i don't stop staring at this screen so away i go | 00:40 |
| *** jmlowe has joined #openstack-nova | 00:41 | |
| *** mvensky has joined #openstack-nova | 00:42 | |
| *** mvensky has quit IRC | 00:42 | |
| *** andreas_s has joined #openstack-nova | 00:42 | |
| *** openstackgerrit has joined #openstack-nova | 00:43 | |
| openstackgerrit | Ghanshyam Mann proposed openstack/python-novaclient master: Optimize jobs run on novaclient https://review.openstack.org/527550 | 00:43 |
| gmann | mriedem: for your morning ^^ | 00:44 |
| gmann | its re on your comment - https://review.openstack.org/#/c/522099/5/playbooks/legacy/novaclient-dsvm-functional-neutron/run.yaml@2 | 00:44 |
| *** sree has joined #openstack-nova | 00:47 | |
| *** andreas_s has quit IRC | 00:48 | |
| *** sree has quit IRC | 00:51 | |
| *** masuberu has quit IRC | 00:59 | |
| *** Swami has quit IRC | 01:01 | |
| *** newOpenstacker has quit IRC | 01:02 | |
| *** phuongnh has joined #openstack-nova | 01:04 | |
| *** yamahata has joined #openstack-nova | 01:15 | |
| *** yangyapeng has joined #openstack-nova | 01:15 | |
| *** takashin has quit IRC | 01:17 | |
| *** trungnv has joined #openstack-nova | 01:19 | |
| *** jmlowe has quit IRC | 01:24 | |
| *** sree has joined #openstack-nova | 01:28 | |
| *** hshiina has joined #openstack-nova | 01:30 | |
| *** salv-orlando has joined #openstack-nova | 01:30 | |
| *** jmlowe has joined #openstack-nova | 01:31 | |
| *** lei-zh has joined #openstack-nova | 01:31 | |
| *** sree has quit IRC | 01:33 | |
| *** salv-orlando has quit IRC | 01:35 | |
| *** gyee has quit IRC | 01:36 | |
| *** TuanLA has joined #openstack-nova | 01:41 | |
| *** andreas_s has joined #openstack-nova | 01:42 | |
| *** sree has joined #openstack-nova | 01:47 | |
| *** baoli has joined #openstack-nova | 01:48 | |
| *** baoli_ has joined #openstack-nova | 01:49 | |
| *** sree has quit IRC | 01:51 | |
| *** andreas_s has quit IRC | 01:52 | |
| *** baoli has quit IRC | 01:53 | |
| *** yamahata has quit IRC | 01:54 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova stable/pike: Unmap compute nodes when deleting host mapping https://review.openstack.org/527560 | 01:54 |
| *** liuyulong has joined #openstack-nova | 01:54 | |
| *** Apoorva_ has quit IRC | 01:56 | |
| openstackgerrit | Jackie Truong proposed openstack/nova master: Implement certificate_utils https://review.openstack.org/479949 | 01:56 |
| *** Tom-Tom has joined #openstack-nova | 02:01 | |
| *** Tom-Tom has quit IRC | 02:01 | |
| *** Tom-Tom has joined #openstack-nova | 02:01 | |
| *** Tom-Tom has quit IRC | 02:01 | |
| *** takashin has joined #openstack-nova | 02:04 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: [placement] Add sending global request ID in delete https://review.openstack.org/525231 | 02:05 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: [placement] Add sending global request ID in delete (2) https://review.openstack.org/526263 | 02:05 |
| *** _ix has quit IRC | 02:05 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: [placement] Add sending global request ID in delete (3) https://review.openstack.org/526557 | 02:06 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: [placement] Add sending global request ID in post https://review.openstack.org/526823 | 02:06 |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Fix the order of target host checks https://review.openstack.org/526225 | 02:06 |
| *** chyka has joined #openstack-nova | 02:06 | |
| *** gouthamr has joined #openstack-nova | 02:07 | |
| *** annp has joined #openstack-nova | 02:07 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: List/show all server migration types (1/2) https://review.openstack.org/430608 | 02:07 |
| *** sree has joined #openstack-nova | 02:07 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: List/show all server migration types (2/2) https://review.openstack.org/459483 | 02:07 |
| *** jafeha__ has joined #openstack-nova | 02:07 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Add a warning in 'nova-manage cell_v2 delete_cell' https://review.openstack.org/513771 | 02:08 |
| mriedem | gmann: thanks | 02:10 |
| *** jafeha has quit IRC | 02:11 | |
| *** chyka has quit IRC | 02:11 | |
| *** sree has quit IRC | 02:12 | |
| *** rodolof has quit IRC | 02:12 | |
| *** jmlowe has quit IRC | 02:13 | |
| *** jmlowe has joined #openstack-nova | 02:15 | |
| *** zhurong has quit IRC | 02:23 | |
| *** lbragstad has quit IRC | 02:25 | |
| *** masber has joined #openstack-nova | 02:27 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Raise MarkerNotFound if BuildRequestList.get_by_filters doesn't find marker https://review.openstack.org/527564 | 02:32 |
| *** mdnadeem has quit IRC | 02:32 | |
| *** zhurong has joined #openstack-nova | 02:33 | |
| *** lei-zh has quit IRC | 02:35 | |
| *** lei-zh has joined #openstack-nova | 02:35 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: [placement] Add x-openstack-request-id in API ref https://review.openstack.org/523007 | 02:36 |
| *** tbachman has joined #openstack-nova | 02:39 | |
| *** liverpooler has quit IRC | 02:41 | |
| *** liverpooler has joined #openstack-nova | 02:42 | |
| *** hiro-kobayashi has joined #openstack-nova | 02:50 | |
| *** fragatina has quit IRC | 02:54 | |
| openstackgerrit | Merged openstack/nova master: Add quiesce and unquiesce in support matrix https://review.openstack.org/482390 | 02:56 |
| *** moshele has joined #openstack-nova | 02:59 | |
| *** moshele has quit IRC | 03:09 | |
| *** Apoorva has joined #openstack-nova | 03:12 | |
| *** hiro-kobayashi has quit IRC | 03:22 | |
| *** tbachman has quit IRC | 03:22 | |
| mriedem | alex_xu: can you get this in? https://review.openstack.org/#/c/527440/ i'm seeing a lot of failed CI jobs from that. | 03:25 |
| *** mriedem has quit IRC | 03:28 | |
| *** takashin has quit IRC | 03:28 | |
| *** abhishekk has joined #openstack-nova | 03:29 | |
| *** _ix has joined #openstack-nova | 03:30 | |
| *** _ix_ has joined #openstack-nova | 03:34 | |
| *** _ix has quit IRC | 03:35 | |
| *** liuzz has quit IRC | 03:39 | |
| openstackgerrit | Merged openstack/nova master: SchedulerReportClient._get_providers_in_tree https://review.openstack.org/520663 | 03:41 |
| *** hshiina has quit IRC | 03:45 | |
| *** penick has quit IRC | 03:52 | |
| *** baoli_ has quit IRC | 03:53 | |
| *** baoli has joined #openstack-nova | 03:54 | |
| *** penick has joined #openstack-nova | 03:55 | |
| *** armax has quit IRC | 03:57 | |
| *** sdague has quit IRC | 03:59 | |
| *** bkopilov has quit IRC | 04:00 | |
| *** hshiina has joined #openstack-nova | 04:01 | |
| *** baoli has quit IRC | 04:02 | |
| *** tbachman has joined #openstack-nova | 04:05 | |
| *** tbachman has quit IRC | 04:10 | |
| *** tbachman has joined #openstack-nova | 04:11 | |
| *** karthiks has joined #openstack-nova | 04:11 | |
| *** threestrands has joined #openstack-nova | 04:14 | |
| *** threestrands has quit IRC | 04:14 | |
| *** threestrands has joined #openstack-nova | 04:14 | |
| *** jappleii__ has quit IRC | 04:15 | |
| *** threestrands has quit IRC | 04:15 | |
| *** threestrands has joined #openstack-nova | 04:16 | |
| *** threestrands has quit IRC | 04:16 | |
| *** threestrands has joined #openstack-nova | 04:16 | |
| *** udesale has joined #openstack-nova | 04:17 | |
| *** openstackgerrit has quit IRC | 04:18 | |
| *** yamahata has joined #openstack-nova | 04:20 | |
| *** tbachman has quit IRC | 04:20 | |
| *** tbachman has joined #openstack-nova | 04:21 | |
| *** _ix_ has quit IRC | 04:24 | |
| *** dave-mcc_ has quit IRC | 04:25 | |
| *** links has joined #openstack-nova | 04:30 | |
| *** openstackgerrit has joined #openstack-nova | 04:30 | |
| openstackgerrit | Merged openstack/nova stable/pike: Make TestRPC inherit from the base nova TestCase https://review.openstack.org/511842 | 04:31 |
| openstackgerrit | Merged openstack/nova master: api-ref: Fix a description for 'guest_format' https://review.openstack.org/525928 | 04:31 |
| *** links has quit IRC | 04:32 | |
| *** bhagyashri_s is now known as bhagyashris | 04:34 | |
| *** bhagyashris is now known as bhagyashri_s | 04:34 | |
| *** bhagyashri_s is now known as bhagyashris | 04:34 | |
| *** adisky__ has joined #openstack-nova | 04:35 | |
| *** threestrands has quit IRC | 04:36 | |
| *** mdnadeem has joined #openstack-nova | 04:39 | |
| *** threestrands has joined #openstack-nova | 04:43 | |
| *** threestrands has quit IRC | 04:43 | |
| *** threestrands has joined #openstack-nova | 04:43 | |
| *** karthiks has quit IRC | 04:43 | |
| *** threestrands has quit IRC | 04:44 | |
| *** threestrands has joined #openstack-nova | 04:44 | |
| *** threestrands has quit IRC | 04:44 | |
| *** threestrands has joined #openstack-nova | 04:44 | |
| *** threestrands has quit IRC | 04:45 | |
| *** takashin has joined #openstack-nova | 04:45 | |
| *** threestrands has joined #openstack-nova | 04:46 | |
| *** threestrands has quit IRC | 04:46 | |
| *** threestrands has joined #openstack-nova | 04:46 | |
| *** liverpooler has quit IRC | 04:46 | |
| *** threestrands has quit IRC | 04:47 | |
| *** threestrands has joined #openstack-nova | 04:47 | |
| *** threestrands has quit IRC | 04:47 | |
| *** threestrands has joined #openstack-nova | 04:47 | |
| *** sridharg has joined #openstack-nova | 04:51 | |
| *** karthiks has joined #openstack-nova | 04:55 | |
| *** vladikr has quit IRC | 04:58 | |
| *** vladikr has joined #openstack-nova | 04:59 | |
| *** ratailor has joined #openstack-nova | 04:59 | |
| *** jose-phillips has quit IRC | 05:13 | |
| *** jose-phillips has joined #openstack-nova | 05:21 | |
| *** chyka has joined #openstack-nova | 05:23 | |
| *** chyka has quit IRC | 05:27 | |
| *** vladikr has quit IRC | 05:27 | |
| *** vladikr has joined #openstack-nova | 05:28 | |
| openstackgerrit | Merged openstack/nova master: [placement] Add cache headers to placement api requests https://review.openstack.org/521640 | 05:30 |
| *** janki has joined #openstack-nova | 05:32 | |
| openstackgerrit | Merged openstack/nova master: [placement] Add info about last-modified to contrib docs https://review.openstack.org/526084 | 05:35 |
| *** vladikr has quit IRC | 05:36 | |
| *** vladikr has joined #openstack-nova | 05:37 | |
| *** AlexeyAbashkin has joined #openstack-nova | 05:43 | |
| *** andreas_s has joined #openstack-nova | 05:43 | |
| *** fragatina has joined #openstack-nova | 05:49 | |
| *** andreas_s has quit IRC | 05:50 | |
| *** karthiks has quit IRC | 05:51 | |
| openstackgerrit | Takashi NATSUME proposed openstack/nova master: Add a warning in 'nova-manage cell_v2 delete_cell' https://review.openstack.org/513771 | 05:52 |
| *** gongysh has joined #openstack-nova | 05:52 | |
| *** fragatina has quit IRC | 05:53 | |
| *** bkopilov has joined #openstack-nova | 05:54 | |
| *** mdnadeem has quit IRC | 05:58 | |
| *** threestrands has quit IRC | 06:03 | |
| *** Apoorva has quit IRC | 06:05 | |
| *** karthiks has joined #openstack-nova | 06:05 | |
| *** Apoorva has joined #openstack-nova | 06:05 | |
| *** lpetrut has joined #openstack-nova | 06:05 | |
| *** janki has quit IRC | 06:07 | |
| *** lpetrut has quit IRC | 06:08 | |
| *** lpetrut has joined #openstack-nova | 06:09 | |
| *** Apoorva has quit IRC | 06:10 | |
| openstackgerrit | Merged openstack/nova master: Remove the unused request_id filter from api-paste.ini https://review.openstack.org/526001 | 06:17 |
| *** vivsoni_ has joined #openstack-nova | 06:19 | |
| *** vivsoni has quit IRC | 06:19 | |
| *** salv-orlando has joined #openstack-nova | 06:22 | |
| *** liuyulong has quit IRC | 06:24 | |
| *** brault has joined #openstack-nova | 06:26 | |
| *** alex_xu has quit IRC | 06:26 | |
| *** janki has joined #openstack-nova | 06:26 | |
| *** alex_xu has joined #openstack-nova | 06:27 | |
| *** moshele has joined #openstack-nova | 06:29 | |
| *** brault has quit IRC | 06:30 | |
| openstackgerrit | Yikun Jiang (Kero) proposed openstack/nova master: Some nit fix in multi_cell_list https://review.openstack.org/527597 | 06:32 |
| *** mdnadeem has joined #openstack-nova | 06:35 | |
| *** sapcc-bot has quit IRC | 06:40 | |
| *** sapcc-bot4 has joined #openstack-nova | 06:40 | |
| *** lajoskatona has joined #openstack-nova | 06:45 | |
| *** gouthamr has quit IRC | 06:48 | |
| *** lpetrut has quit IRC | 06:52 | |
| *** fragatina has joined #openstack-nova | 06:57 | |
| *** fragatin_ has joined #openstack-nova | 06:57 | |
| *** AlexeyAbashkin has quit IRC | 06:57 | |
| *** udesale__ has joined #openstack-nova | 07:01 | |
| *** fragatina has quit IRC | 07:02 | |
| *** damien_r has joined #openstack-nova | 07:03 | |
| *** udesale has quit IRC | 07:03 | |
| *** sree has joined #openstack-nova | 07:04 | |
| *** udesale has joined #openstack-nova | 07:04 | |
| *** udesale__ has quit IRC | 07:06 | |
| openstackgerrit | Merged openstack/nova master: Refactor placement version check https://review.openstack.org/512497 | 07:11 |
| *** bkopilov has quit IRC | 07:11 | |
| *** josecastroleon has joined #openstack-nova | 07:11 | |
| *** rcernin has quit IRC | 07:12 | |
| *** andreas_s has joined #openstack-nova | 07:12 | |
| *** gongysh has quit IRC | 07:16 | |
| *** edand has joined #openstack-nova | 07:17 | |
| *** Tom-Tom has joined #openstack-nova | 07:17 | |
| openstackgerrit | Merged openstack/nova master: trivial: more suitable log in set_admin_password https://review.openstack.org/526592 | 07:18 |
| *** bkopilov has joined #openstack-nova | 07:29 | |
| *** andreas_s has quit IRC | 07:31 | |
| *** lpetrut has joined #openstack-nova | 07:31 | |
| *** andreas_s has joined #openstack-nova | 07:32 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/nova master: Imported Translations from Zanata https://review.openstack.org/524795 | 07:35 |
| *** andreas_s has quit IRC | 07:37 | |
| *** trungnv has quit IRC | 07:41 | |
| *** phuongnh has quit IRC | 07:41 | |
| *** TuanLA has quit IRC | 07:41 | |
| *** hoangcx has quit IRC | 07:41 | |
| *** Alex_Staf has joined #openstack-nova | 07:41 | |
| *** hiro-kobayashi has joined #openstack-nova | 07:41 | |
| *** trungnv has joined #openstack-nova | 07:41 | |
| *** salv-orlando has quit IRC | 07:41 | |
| *** TuanLA has joined #openstack-nova | 07:41 | |
| *** hoangcx has joined #openstack-nova | 07:41 | |
| *** phuongnh has joined #openstack-nova | 07:41 | |
| *** yamahata has quit IRC | 07:42 | |
| *** udesale__ has joined #openstack-nova | 07:46 | |
| *** udesale has quit IRC | 07:49 | |
| *** salv-orlando has joined #openstack-nova | 07:50 | |
| *** sahid has joined #openstack-nova | 07:50 | |
| *** aloga has quit IRC | 07:50 | |
| *** aloga has joined #openstack-nova | 07:50 | |
| *** lpetrut has quit IRC | 07:53 | |
| *** fragatin_ has quit IRC | 07:53 | |
| *** jmlowe has quit IRC | 07:55 | |
| *** jmlowe has joined #openstack-nova | 07:56 | |
| *** sshwarts has joined #openstack-nova | 08:01 | |
| *** alexchadin has joined #openstack-nova | 08:01 | |
| *** andreas_s has joined #openstack-nova | 08:03 | |
| *** andreas_s has quit IRC | 08:07 | |
| *** takashin has left #openstack-nova | 08:07 | |
| *** jpena|off is now known as jpena | 08:09 | |
| *** jafeha__ has quit IRC | 08:10 | |
| *** damien_r has quit IRC | 08:13 | |
| *** rcernin has joined #openstack-nova | 08:13 | |
| *** ralonsoh has joined #openstack-nova | 08:16 | |
| *** tesseract has joined #openstack-nova | 08:25 | |
| *** AlexeyAbashkin has joined #openstack-nova | 08:27 | |
| *** AlexeyAbashkin has quit IRC | 08:32 | |
| *** salv-orlando has quit IRC | 08:34 | |
| *** xinliang has quit IRC | 08:35 | |
| *** damien_r has joined #openstack-nova | 08:37 | |
| *** AlexeyAbashkin has joined #openstack-nova | 08:37 | |
| *** mdnadeem has quit IRC | 08:37 | |
| openstackgerrit | Tetsuro Nakamura proposed openstack/nova master: [libvirt] Add _set_vcpu_realtime_scheduler() https://review.openstack.org/527630 | 08:40 |
| openstackgerrit | Tetsuro Nakamura proposed openstack/nova master: Add _set_vcpu_pinning() and _set_numa_memory() https://review.openstack.org/527631 | 08:40 |
| *** AlexeyAbashkin has quit IRC | 08:43 | |
| *** annp has quit IRC | 08:46 | |
| *** TuanLA has quit IRC | 08:46 | |
| *** trungnv has quit IRC | 08:46 | |
| *** annp has joined #openstack-nova | 08:46 | |
| *** TuanLA has joined #openstack-nova | 08:46 | |
| *** mdnadeem has joined #openstack-nova | 08:46 | |
| *** trungnv has joined #openstack-nova | 08:47 | |
| *** xinliang has joined #openstack-nova | 08:48 | |
| *** hshiina has quit IRC | 08:50 | |
| *** jafeha__ has joined #openstack-nova | 08:51 | |
| *** salv-orlando has joined #openstack-nova | 08:52 | |
| *** pmannidi has joined #openstack-nova | 08:52 | |
| *** AlexeyAbashkin has joined #openstack-nova | 08:57 | |
| *** jafeha has joined #openstack-nova | 08:59 | |
| *** chyka has joined #openstack-nova | 08:59 | |
| *** jafeha__ has quit IRC | 09:00 | |
| *** links has joined #openstack-nova | 09:00 | |
| *** kumarmn has joined #openstack-nova | 09:03 | |
| *** lpetrut has joined #openstack-nova | 09:03 | |
| openstackgerrit | Tetsuro Nakamura proposed openstack/nova master: Add _set_vcpu_pinning() and _set_numa_memory() https://review.openstack.org/527631 | 09:03 |
| *** tssurya has joined #openstack-nova | 09:03 | |
| *** chyka has quit IRC | 09:03 | |
| *** pmannidi has quit IRC | 09:04 | |
| *** pmannidi has joined #openstack-nova | 09:05 | |
| *** hiro-kobayashi has quit IRC | 09:05 | |
| *** gcb has joined #openstack-nova | 09:06 | |
| *** kumarmn has quit IRC | 09:07 | |
| *** masber has quit IRC | 09:09 | |
| *** fragatina has joined #openstack-nova | 09:12 | |
| *** vivsoni_ has quit IRC | 09:13 | |
| *** vivsoni_ has joined #openstack-nova | 09:13 | |
| mdbooth | mnaser: melwitt Reading back scroll. Yes, a per-backend image cache was part of my plans both times I've submitted patches for a massive refactor of the imagebackend code. | 09:17 |
| mdbooth | You'll hit a few architectural issues getting it landed, though. | 09:18 |
| openstackgerrit | Yikun Jiang (Kero) proposed openstack/nova master: Add pagination and changes-since for instance-actions https://review.openstack.org/326326 | 09:18 |
| *** isq_ has quit IRC | 09:20 | |
| *** dklyle has quit IRC | 09:20 | |
| *** isq_ has joined #openstack-nova | 09:21 | |
| mdbooth | Firstly, the image cache code is unnecessarily and messily embedded implicitly in each individual imagebackend already. All that code needs to be cleaned up. In itself that's not too hard, but the tests are also hugely problematic. Ultimately, fixing the tests to a point where it was possible to refactor the code sunk me twice. There are a huge number of tests in there, and in general the quality is rock bottom. | 09:21 |
| *** tetsuro has quit IRC | 09:22 | |
| mdbooth | However, if you get to the point where you've unpicked the imagecache from the imagebackend code, you still have to handle both layouts. | 09:23 |
| mdbooth | Currently, the only source of truth for the layout of an instance is the config of the compute host is resides on. | 09:23 |
| *** rmart04 has joined #openstack-nova | 09:24 | |
| mdbooth | So if we're to have a transitional period where we're altering the on-disk layout, which is what changing the image cache would amount to, we need to have a per-instance datastore for driver-specific data. | 09:24 |
| mdbooth | Incidentally, my plan was to add this to the BDM so it could actually be per-disk. | 09:25 |
| mdbooth | But if you can get there, yes the current design of the imagecache makes no sense | 09:26 |
| mdbooth | Well, no longer makes any sense | 09:27 |
| mdbooth | It should have been refactored long ago the first time we implemented an alternate backend | 09:27 |
| *** alexchadin has quit IRC | 09:30 | |
| *** lucas-afk is now known as lucasagomes | 09:32 | |
| *** gongysh has joined #openstack-nova | 09:33 | |
| openstackgerrit | Yikun Jiang (Kero) proposed openstack/nova master: Add pagination and changes-since for instance-actions https://review.openstack.org/326326 | 09:36 |
| *** lei-zh has quit IRC | 09:37 | |
| kashyap | mdbooth: You might want to spell that documentation somewhere to whoever that is planning to go that route... | 09:41 |
| kashyap | Maybe you did in all those previous iterations. In that case, disregard me :-) | 09:42 |
| mdbooth | kashyap: I wrote the code :) | 09:42 |
| mdbooth | Then I threw it away. | 09:42 |
| mdbooth | The I wrote it again! | 09:42 |
| kashyap | mdbooth: Whoops | 09:42 |
| mdbooth | Then I threw that away, too. | 09:42 |
| *** janki has quit IRC | 09:42 | |
| kashyap | Hence the "sunk me twice", now that nice expression makes sense | 09:42 |
| kashyap | s/makes sense/makes doubly sense/ | 09:42 |
| mdbooth | Each one took me a couple of months. | 09:43 |
| *** janki has joined #openstack-nova | 09:43 | |
| mdbooth | Throwing away 2 months of effort is good for the soul. | 09:43 |
| kashyap | :-) | 09:43 |
| kashyap | mdbooth: Just out of curiosity, as you meditated on this problem space, how badly does this affect us long-term? | 09:44 |
| * mdbooth dearly wishes that were true. | 09:44 | |
| *** alexchadin has joined #openstack-nova | 09:44 | |
| mdbooth | kashyap: The main issue in imagebackend, and the reason it needs a refactor like either of the ones I already did, is that every time somebody comes along and proposes a design change it's basically infeasible. | 09:45 |
| mdbooth | Right now we have a big tangled ball of string that works. | 09:45 |
| mdbooth | That's great, but you can't easily make it do anything else without untangling it first. | 09:45 |
| mdbooth | So, a new backend which works substantially differently to the existing ones. | 09:46 |
| kashyap | Hmm | 09:46 |
| mdbooth | Changing the on-disk layout | 09:46 |
| gibi | dansmith: I hit https://review.openstack.org/#/c/517119/ but as I see Jay will respin it one more time so I will hit it with a +2 after that | 09:47 |
| mdbooth | e.g. because you want a more efficient imagecache | 09:47 |
| mdbooth | or because you want to use libvirt storage pools | 09:47 |
| kashyap | mdbooth: Changing the on-disk layout to what? | 09:48 |
| kashyap | mdbooth: If I'm asking uproductive questions, ignore me. I'll do some looking up :-) | 09:48 |
| mdbooth | Well the 2 proposals above have both actually been made. | 09:48 |
| kashyap | I know you've written to the list and on changes you proposed with your thoughts on this | 09:48 |
| openstackgerrit | Lee Yarwood proposed openstack/nova master: conf: Do not inherit image signature props with snapshots https://review.openstack.org/527046 | 09:48 |
| mdbooth | Changing the image cache is an on-disk change, because backing images are now in a different place. | 09:48 |
| kashyap | Ah, right. | 09:49 |
| mdbooth | The existing code assumes all sorts of things in obtuse ways. | 09:49 |
| *** janki has quit IRC | 09:49 | |
| kashyap | Will this be brought up at the upcoming PTG? | 09:49 |
| *** janki has joined #openstack-nova | 09:49 | |
| kashyap | Assuming you /others still have the appetite for it... :-) | 09:49 |
| mdbooth | Using libvirt storage pools requires an on-disk change, because we don't layout our disks in a way that's easy to manage with storage pools. | 09:49 |
| mdbooth | It's not specifically on my agenda right now. I rehash it from time to time (like this morning) when somebody else brings it up. | 09:50 |
| mdbooth | I've done the work twice already. | 09:50 |
| kashyap | Nod; thanks for the explanation. | 09:53 |
| *** gongysh has quit IRC | 09:54 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: objects: Add PCI NUMA policy fields https://review.openstack.org/527470 | 10:03 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: trivial: Pass InstanceNUMATopology to consume_request https://review.openstack.org/527471 | 10:03 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Add PCI NUMA policies https://review.openstack.org/527472 | 10:03 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: trivial: Modify signature of _filter_non_requested_pfs https://review.openstack.org/527473 | 10:03 |
| *** annp has quit IRC | 10:05 | |
| *** fragatina has quit IRC | 10:06 | |
| *** yangyapeng has quit IRC | 10:06 | |
| *** yangyapeng has joined #openstack-nova | 10:07 | |
| *** yangyapeng has quit IRC | 10:09 | |
| *** sree has quit IRC | 10:09 | |
| *** sree has joined #openstack-nova | 10:10 | |
| openstackgerrit | Ya Lian Pan proposed openstack/nova master: z/VM Driver: Spawn and destroy function of z/VM driver https://review.openstack.org/527658 | 10:12 |
| *** yamamoto has quit IRC | 10:13 | |
| openstackgerrit | Chason Chan proposed openstack/nova master: Fix the bug report link of API Guide https://review.openstack.org/527660 | 10:13 |
| *** TuanLA has quit IRC | 10:15 | |
| *** sdague has joined #openstack-nova | 10:15 | |
| *** sree has quit IRC | 10:15 | |
| *** salv-orlando has quit IRC | 10:15 | |
| *** Tom-Tom has quit IRC | 10:19 | |
| *** Tom-Tom has joined #openstack-nova | 10:20 | |
| *** alexchadin has quit IRC | 10:23 | |
| *** alexchadin has joined #openstack-nova | 10:24 | |
| *** dosaboy has quit IRC | 10:24 | |
| *** Tom-Tom has quit IRC | 10:24 | |
| *** dosaboy has joined #openstack-nova | 10:25 | |
| *** alexchadin has quit IRC | 10:27 | |
| *** alexchadin has joined #openstack-nova | 10:28 | |
| *** penick has quit IRC | 10:28 | |
| *** sapd_ has quit IRC | 10:28 | |
| *** sapd has joined #openstack-nova | 10:30 | |
| *** dosaboy has quit IRC | 10:31 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: zuul: Move legacy jobs to project https://review.openstack.org/514309 | 10:32 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: zuul: Remove WSGI functional tests https://review.openstack.org/527140 | 10:32 |
| *** dosaboy has joined #openstack-nova | 10:37 | |
| *** zhurong has quit IRC | 10:37 | |
| *** yamamoto has joined #openstack-nova | 10:43 | |
| *** phuongnh has quit IRC | 10:44 | |
| *** janki has quit IRC | 10:46 | |
| *** dtantsur|afk is now known as dtantsur | 10:48 | |
| *** sambetts|afk is now known as sambetts | 10:49 | |
| *** damien_r has quit IRC | 10:57 | |
| *** mvk has quit IRC | 10:58 | |
| *** tssurya has quit IRC | 11:01 | |
| *** edand has quit IRC | 11:04 | |
| *** pmannidi has quit IRC | 11:06 | |
| *** pmannidi has joined #openstack-nova | 11:07 | |
| *** udesale__ has quit IRC | 11:08 | |
| *** janki has joined #openstack-nova | 11:08 | |
| *** hui has quit IRC | 11:09 | |
| *** abhishekk has quit IRC | 11:09 | |
| *** pmannidi has quit IRC | 11:13 | |
| *** r-daneel has joined #openstack-nova | 11:14 | |
| *** edand has joined #openstack-nova | 11:18 | |
| *** claudiub has joined #openstack-nova | 11:21 | |
| *** mvk has joined #openstack-nova | 11:23 | |
| *** gongysh has joined #openstack-nova | 11:36 | |
| *** vladikr has quit IRC | 11:36 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: objects: remove pagesize from __init__ of InstanceNUMATopology https://review.openstack.org/485553 | 11:38 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: objects: remove related pinning from __init__ of InstanceNUMATopology https://review.openstack.org/485554 | 11:38 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: objects: remove cpuset_reserved from __init__ of InstanceNUMATopology https://review.openstack.org/466030 | 11:38 |
| *** salv-orlando has joined #openstack-nova | 11:38 | |
| *** gszasz has joined #openstack-nova | 11:39 | |
| stephenfin | dansmith: When you're about, could you take a punt at https://review.openstack.org/#/q/topic:bug/1636338 Guess you're best placed for them | 11:39 |
| stephenfin | dansmith: Or stick em on your list for the new year. Either-or (they're just there a looong time) | 11:39 |
| *** claudiub has quit IRC | 11:41 | |
| openstackgerrit | Li Xipeng proposed openstack/nova master: Fix bug case by none token context https://review.openstack.org/522112 | 11:43 |
| *** gongysh has quit IRC | 11:45 | |
| *** andreas_s has joined #openstack-nova | 11:45 | |
| *** damien_r has joined #openstack-nova | 11:45 | |
| *** gcb has quit IRC | 11:47 | |
| *** gcb has joined #openstack-nova | 11:48 | |
| *** damien_r has quit IRC | 11:49 | |
| *** cdent has joined #openstack-nova | 11:50 | |
| *** sree has joined #openstack-nova | 11:51 | |
| *** gszasz has quit IRC | 11:51 | |
| *** andreas_s has quit IRC | 11:51 | |
| *** sree has quit IRC | 11:55 | |
| *** sahid has quit IRC | 11:56 | |
| *** tbachman has quit IRC | 11:59 | |
| *** sree has joined #openstack-nova | 12:04 | |
| *** janki has quit IRC | 12:05 | |
| *** alexchadin has quit IRC | 12:06 | |
| *** alexchadin has joined #openstack-nova | 12:06 | |
| *** bkopilov has quit IRC | 12:07 | |
| *** sree_ has joined #openstack-nova | 12:09 | |
| *** sree_ is now known as Guest80176 | 12:09 | |
| openstackgerrit | Lajos Katona proposed openstack/nova master: Extend ServerMovingTests with custom resources https://review.openstack.org/497399 | 12:10 |
| *** sree has quit IRC | 12:12 | |
| *** alexchadin has quit IRC | 12:18 | |
| *** purplerbot has joined #openstack-nova | 12:22 | |
| *** dave-mccowan has joined #openstack-nova | 12:22 | |
| *** lpetrut has quit IRC | 12:22 | |
| *** alexchadin has joined #openstack-nova | 12:23 | |
| *** lpetrut has joined #openstack-nova | 12:23 | |
| *** janki has joined #openstack-nova | 12:31 | |
| *** purplerbot has quit IRC | 12:32 | |
| *** purplerbot has joined #openstack-nova | 12:33 | |
| *** masuberu has joined #openstack-nova | 12:33 | |
| *** lucasagomes is now known as lucas-hungry | 12:35 | |
| *** cleong has joined #openstack-nova | 12:40 | |
| *** tssurya has joined #openstack-nova | 12:40 | |
| *** jamesdenton has joined #openstack-nova | 12:43 | |
| *** BryanS68 has joined #openstack-nova | 12:47 | |
| *** smatzek has joined #openstack-nova | 12:51 | |
| *** Tom-Tom has joined #openstack-nova | 12:51 | |
| *** Guest80176 has quit IRC | 12:53 | |
| *** jpena is now known as jpena|lunch | 12:53 | |
| *** sree has joined #openstack-nova | 12:53 | |
| *** ratailor has quit IRC | 12:54 | |
| openstackgerrit | Chris Dent proposed openstack/nova master: [placement] Enable limiting GET /allocation_candidates https://review.openstack.org/513526 | 12:55 |
| *** sree has quit IRC | 12:58 | |
| gmann | nova api meeting in 2 min.. | 12:58 |
| *** udesale has joined #openstack-nova | 12:58 | |
| *** toabctl has quit IRC | 13:00 | |
| *** salv-orl_ has joined #openstack-nova | 13:02 | |
| *** gszasz has joined #openstack-nova | 13:03 | |
| *** mikal_ has quit IRC | 13:03 | |
| *** damien_r has joined #openstack-nova | 13:03 | |
| *** rcernin has quit IRC | 13:04 | |
| *** mikal has joined #openstack-nova | 13:05 | |
| *** salv-orlando has quit IRC | 13:06 | |
| *** vladikr has joined #openstack-nova | 13:08 | |
| *** sree has joined #openstack-nova | 13:11 | |
| *** tbachman has joined #openstack-nova | 13:12 | |
| *** sree has quit IRC | 13:16 | |
| *** BryanS68 has quit IRC | 13:20 | |
| *** BryanS68 has joined #openstack-nova | 13:24 | |
| *** josecastroleon1 has joined #openstack-nova | 13:26 | |
| *** josecastroleon has quit IRC | 13:26 | |
| *** liverpooler has joined #openstack-nova | 13:26 | |
| *** sree has joined #openstack-nova | 13:28 | |
| *** lucas-hungry is now known as lucasagomes | 13:30 | |
| *** sree has quit IRC | 13:33 | |
| *** claudiub has joined #openstack-nova | 13:34 | |
| *** sapcc-bot4 has quit IRC | 13:36 | |
| *** sapcc-bot has joined #openstack-nova | 13:36 | |
| *** dgonzalez_ has joined #openstack-nova | 13:36 | |
| *** mkoderer_ has joined #openstack-nova | 13:36 | |
| *** tpatzig_ has joined #openstack-nova | 13:36 | |
| *** andreas_s has joined #openstack-nova | 13:36 | |
| *** takedakn has joined #openstack-nova | 13:37 | |
| *** mkoderer_ has quit IRC | 13:38 | |
| *** dgonzalez_ has quit IRC | 13:38 | |
| *** tpatzig_ has quit IRC | 13:38 | |
| *** pchavva has joined #openstack-nova | 13:39 | |
| openstackgerrit | Merged openstack/nova master: Re-use existing ComputeNode on ironic rebalance https://review.openstack.org/508555 | 13:41 |
| *** andreas_s has quit IRC | 13:43 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Transform instance.exists notification https://review.openstack.org/403660 | 13:46 |
| *** sree has joined #openstack-nova | 13:47 | |
| *** takedakn has quit IRC | 13:50 | |
| *** tesseract has quit IRC | 13:51 | |
| *** Tom-Tom_ has joined #openstack-nova | 13:51 | |
| *** sree has quit IRC | 13:52 | |
| *** Tom-Tom has quit IRC | 13:55 | |
| *** mdnadeem_ has joined #openstack-nova | 13:56 | |
| *** mriedem has joined #openstack-nova | 13:56 | |
| *** jaypipes has joined #openstack-nova | 13:57 | |
| *** mdnadeem has quit IRC | 13:58 | |
| *** jpena|lunch is now known as jpena | 13:58 | |
| *** peter-hamilton has joined #openstack-nova | 13:58 | |
| *** links has quit IRC | 13:58 | |
| *** links has joined #openstack-nova | 14:00 | |
| *** xyang1 has joined #openstack-nova | 14:00 | |
| *** lyan has joined #openstack-nova | 14:01 | |
| openstackgerrit | Chen Hanxiao proposed openstack/nova master: libvirt: guest: introduce blockStats instead of domain.blockStats https://review.openstack.org/526833 | 14:01 |
| cdent | edleafe: are you actually asking for changes on that commit message or just pointing out some potential changes if there's another version. On the random stuff I'm not sure that your version is more clear, at least not to me. | 14:02 |
| edleafe | cdent: Well, you *did* push another version :) | 14:02 |
| *** shaner has quit IRC | 14:02 | |
| cdent | yeah, and totally forgot the commit message stuff because I was focused on the merge conflict (and forgot about your suggestions because no vote) | 14:03 |
| *** salv-orlando has joined #openstack-nova | 14:03 | |
| edleafe | cdent: The random comment simply seemed to describe the implementation rather than the effect of changing the settings | 14:03 |
| *** liuyulong has joined #openstack-nova | 14:04 | |
| cdent | right, the commit message is for describing the implementation, the conf help and the reno are for describing why/how someone might use the conf setting | 14:04 |
| *** liusheng has quit IRC | 14:04 | |
| *** links has quit IRC | 14:05 | |
| *** liusheng has joined #openstack-nova | 14:05 | |
| *** BryanS68 has quit IRC | 14:06 | |
| *** salv-orl_ has quit IRC | 14:06 | |
| *** BryanS68 has joined #openstack-nova | 14:07 | |
| *** sree has joined #openstack-nova | 14:07 | |
| *** s1061123 has quit IRC | 14:09 | |
| mriedem | gibi: replied to your questions in https://review.openstack.org/#/c/507473/ | 14:10 |
| *** sree has quit IRC | 14:12 | |
| openstackgerrit | Kashyap Chamarthy proposed openstack/nova master: conf: libvirt: Cleanup CPU modelling related options https://review.openstack.org/527691 | 14:13 |
| stephenfin | kashyap: Per ^, you'll probably like this https://review.openstack.org/#/c/526012/ | 14:16 |
| * kashyap clicks | 14:17 | |
| *** smatzek has quit IRC | 14:19 | |
| kashyap | stephenfin: OCD: If you have to respin, please captialize the proper noun: s/nova/Nova/ :-) | 14:21 |
| stephenfin | kashyap: Ahem https://docs.openstack.org/doc-contrib-guide/writing-style/openstack-components.html | 14:21 |
| stephenfin | My OCD trumps yours | 14:21 |
| kashyap | Haha | 14:22 |
| gibi | mriedem: thanks for the answers, I'm +2 now | 14:22 |
| kashyap | Okay, my brain just feels a twitch when a sentence starts with a smaller case letter. | 14:22 |
| mriedem | gibi: cool. i'm going to update the nits in the last change in the series too just to get that going | 14:22 |
| mnaser | mdbooth: thanks for the informative text. The more I look into this the more I see that it’s too much for me to bite to make that image backend change | 14:23 |
| mdbooth | mnaser: Hopefully that's not true. I'd just say don't underestimate the size of the chunk :) | 14:24 |
| mdbooth | And I completely agree with your initial conclusion. | 14:24 |
| mnaser | mdbooth: the thing is we’re fairly pressed on time and a change like this would probably take a long time to get through | 14:25 |
| kashyap | stephenfin: Nice Olso change in that; Zuul seems to complain for tox-py35, must've noticed it | 14:25 |
| mdbooth | Oh, right. | 14:25 |
| mdbooth | Yeah, this isn't going to be a quick fix. | 14:25 |
| stephenfin | kashyap: I did indeed. I'll be fixing it shortly | 14:25 |
| gibi | mriedem: hit me with the link when you are done and we can push the last patch through as well | 14:25 |
| mnaser | Figuring out how to work with Glance and multiple locations seems far more feasable. I think. | 14:26 |
| mdbooth | mnaser: Although, the current state of that code is the sum of a bunch of quick fixes... | 14:26 |
| kashyap | stephenfin: Thanks for the fast +2 on that change! | 14:26 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add sample test for instance audit https://review.openstack.org/480955 | 14:26 |
| *** baoli has joined #openstack-nova | 14:26 | |
| *** s1061123 has joined #openstack-nova | 14:26 | |
| stephenfin | kashyap: np. Doc fixes like that easy-peasy | 14:26 |
| mnaser | mdbooth: I think the huge challenge would be maintaining those two formats on disk | 14:26 |
| mnaser | Essentially and possibly forever... | 14:27 |
| mdbooth | Reliably, and maintainably | 14:27 |
| mnaser | We can’t assume the instances which are cloned from local cache will eventually disappear because we’d block upgrades. | 14:27 |
| *** sree has joined #openstack-nova | 14:27 | |
| *** amodi has joined #openstack-nova | 14:28 | |
| *** gmann is now known as gmann_afk | 14:28 | |
| *** _ix has joined #openstack-nova | 14:28 | |
| *** gmann_afk is now known as gmann | 14:28 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Add PCI NUMA policies https://review.openstack.org/527472 | 14:29 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: trivial: Modify signature of _filter_non_requested_pfs https://review.openstack.org/527473 | 14:29 |
| kashyap | stephenfin: I'll answer your question on the review | 14:29 |
| *** sree has quit IRC | 14:32 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Wait for live_migration_rollback.end notification https://review.openstack.org/527444 | 14:34 |
| *** _ix has quit IRC | 14:34 | |
| kashyap | stephenfin: Is it just me, or the rendered page looks like full of "alerts" with the red colour -- https://docs.openstack.org/nova/pike/configuration/config.html | 14:35 |
| kashyap | The whole config page looks like an "exceptions" page | 14:35 |
| stephenfin | kashyap: Are you referring to the titles of each options or the 'warning' admonitions? | 14:35 |
| *** openstackstatus has quit IRC | 14:36 | |
| kashyap | The 'warning' admonitions, and every option enumerated in red color | 14:36 |
| stephenfin | The warning options are warranted - we don't want people using those as they're deprecated | 14:36 |
| kashyap | (Looking at that really messing with my briain :-) I'll just stick to looking at the code.) | 14:36 |
| kashyap | The warnings are fine | 14:36 |
| stephenfin | and we've been removing deprecated options at a decent clip, though it's low priority | 14:37 |
| kashyap | But the options should be changed to 'lime green' or something saner | 14:37 |
| stephenfin | The other stuff is the fault of openstackdocstheme, I'm afraid | 14:37 |
| *** lbragstad has joined #openstack-nova | 14:37 | |
| *** openstackstatus_ has joined #openstack-nova | 14:37 | |
| kashyap | Okido; no worries. | 14:37 |
| stephenfin | I'm not sure what colour I _would_ use though, tbh | 14:37 |
| *** openstackstatus_ has quit IRC | 14:37 | |
| *** openstack has quit IRC | 14:39 | |
| *** openstack has joined #openstack-nova | 14:41 | |
| *** ChanServ sets mode: +o openstack | 14:41 | |
| mriedem | at some point i (or someone) should follow the pattern yikun has here for the 2.57 samples and do those for the 2.1 and 2.51 samples | 14:42 |
| mriedem | and use real operations rather than fakes | 14:42 |
| mriedem | i've always hated that we use fakes for the instance action api samples | 14:43 |
| *** openstack has quit IRC | 14:43 | |
| *** openstack has joined #openstack-nova | 14:46 | |
| *** ChanServ sets mode: +o openstack | 14:46 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Remove dead parameter from '_create_domain_and_network' https://review.openstack.org/512352 | 14:46 |
| *** burt has joined #openstack-nova | 14:46 | |
| *** felipemonteiro has joined #openstack-nova | 14:47 | |
| *** sree has joined #openstack-nova | 14:47 | |
| *** felipemonteiro_ has joined #openstack-nova | 14:48 | |
| *** alexchadin has quit IRC | 14:50 | |
| *** kumarmn has joined #openstack-nova | 14:52 | |
| *** felipemonteiro has quit IRC | 14:52 | |
| *** tosky has joined #openstack-nova | 14:52 | |
| *** sree has quit IRC | 14:53 | |
| gibi | mriedem: indeed it looks a lot cleaner now, I approved it | 14:53 |
| mriedem | gibi: cool, thanks | 14:54 |
| mriedem | one more down | 14:54 |
| *** pchavva has joined #openstack-nova | 14:55 | |
| *** awaugama has joined #openstack-nova | 14:55 | |
| *** marst has joined #openstack-nova | 14:56 | |
| *** tbachman has quit IRC | 14:57 | |
| *** armax has joined #openstack-nova | 14:57 | |
| *** tbachman has joined #openstack-nova | 14:58 | |
| *** mlavalle has joined #openstack-nova | 15:01 | |
| *** josecastroleon1 has quit IRC | 15:02 | |
| *** sree has joined #openstack-nova | 15:02 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: DNM: see what else is doing useless migration context stuff https://review.openstack.org/471491 | 15:04 |
| *** janki has quit IRC | 15:04 | |
| *** Tom-Tom_ has quit IRC | 15:05 | |
| *** yamahata has joined #openstack-nova | 15:06 | |
| *** gouthamr has joined #openstack-nova | 15:06 | |
| *** udesale has quit IRC | 15:07 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: Change CONF.my_ip to be IPOpt https://review.openstack.org/498095 | 15:07 |
| *** sshwarts has quit IRC | 15:08 | |
| *** josecastroleon has joined #openstack-nova | 15:08 | |
| *** bkopilov has joined #openstack-nova | 15:12 | |
| niraj_singh | efried_cya_jan: in cinder to nova interaction using service token. I am getting roles': [u'Member'], for service user in nova. | 15:14 |
| niraj_singh | efried_cya_jan: I was logged in as admin. Is there anything need to do to assign role to service user. | 15:15 |
| jaypipes | niraj_singh: Eric is out until January (thus his nick is efried_cya_jan) :) | 15:17 |
| niraj_singh | ooh sorry | 15:17 |
| jaypipes | niraj_singh: not a problem. you will likely need more roles than "Member" for the cinder service user. | 15:17 |
| *** links has joined #openstack-nova | 15:19 | |
| niraj_singh | jaypipes: can i assign role to service user explicitlely? | 15:19 |
| *** smatzek has joined #openstack-nova | 15:20 | |
| *** claudiub has quit IRC | 15:21 | |
| *** salv-orlando has quit IRC | 15:21 | |
| *** edmondsw has joined #openstack-nova | 15:21 | |
| jaypipes | niraj_singh: hmm, I *think* you should be able to do that, yes. via Keystone... | 15:23 |
| jaypipes | niraj_singh: you'll want to restart the nova services after that, though, since the token will be cached in the Nova services. | 15:23 |
| niraj_singh | jaypipes: ok. i will try this. | 15:23 |
| niraj_singh | thanks | 15:23 |
| dansmith | jaypipes: you gonna rev that patch that needs the comment added? | 15:24 |
| dansmith | jaypipes: sounds like modulo those nits gibi and I are ready to send it to heaven | 15:24 |
| *** tidwellr has joined #openstack-nova | 15:25 | |
| *** READ10 has joined #openstack-nova | 15:26 | |
| *** moshele has quit IRC | 15:26 | |
| *** toabctl has joined #openstack-nova | 15:27 | |
| *** dosaboy has quit IRC | 15:28 | |
| mriedem | stephenfin: your comment in https://review.openstack.org/#/c/523919/ - i think the code your pointing at has nothing to do with what i'm removing in that patch | 15:28 |
| *** dosaboy has joined #openstack-nova | 15:28 | |
| *** BryanS68 has quit IRC | 15:29 | |
| *** sapcc-bot has quit IRC | 15:29 | |
| *** dgonzalez_ has joined #openstack-nova | 15:30 | |
| *** tpatzig_ has joined #openstack-nova | 15:30 | |
| *** mkoderer_ has joined #openstack-nova | 15:30 | |
| stephenfin | mriedem: It's quite possible. The thing that put me onto that was that we _were_ storing 'self.extra_info' in the line you're removing, but once that's removed we don't appear to use it anywhere | 15:30 |
| *** sapcc-bot has joined #openstack-nova | 15:30 | |
| stephenfin | ergo, I figure the storing aspect should be removed to | 15:30 |
| stephenfin | Maybe I missed something though. I'm looking at that commit you referenced now | 15:30 |
| mriedem | stephenfin: it's called from PciDevice.create() https://review.openstack.org/#/c/523919/2/nova/objects/pci_device.py@234 | 15:31 |
| *** tbachman has quit IRC | 15:31 | |
| mriedem | which will dirty the extra_info field | 15:31 |
| mriedem | so that it gets save()'d later | 15:31 |
| mriedem | updates = self.obj_get_changes() | 15:31 |
| mriedem | will contain extra_info | 15:31 |
| mriedem | hence this note in update_device: | 15:31 |
| mriedem | # NOTE(yjiang5): extra_info.update does not update | 15:31 |
| mriedem | # obj_what_changed, set it explicitly | 15:31 |
| *** mkoderer_ has quit IRC | 15:31 | |
| *** tpatzig_ has quit IRC | 15:31 | |
| *** dgonzalez_ has quit IRC | 15:31 | |
| *** tbachman has joined #openstack-nova | 15:32 | |
| openstackgerrit | Merged openstack/nova master: Stabilize test_live_migration_abort func test https://review.openstack.org/527440 | 15:32 |
| mriedem | dansmith: melwitt: here is the marker not found fix for the build_requests thing that came up yesterday https://review.openstack.org/#/c/527564/ | 15:34 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Transform instance.exists notification https://review.openstack.org/403660 | 15:35 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add sample test for instance audit https://review.openstack.org/480955 | 15:35 |
| *** edand has quit IRC | 15:36 | |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add regression test for bug 1735407 https://review.openstack.org/526095 | 15:36 |
| openstack | bug 1735407 in OpenStack Compute (nova) "[Nova] Evacuation doesn't respect anti-affinity rules" [Medium,In progress] https://launchpad.net/bugs/1735407 - Assigned to Balazs Gibizer (balazs-gibizer) | 15:36 |
| dansmith | mriedem: ack | 15:36 |
| openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add late server group policy check to rebuild https://review.openstack.org/525242 | 15:36 |
| jaypipes | dansmith: ya, lemme do that right quick. thanks for the reminder | 15:36 |
| mriedem | dansmith: left a comment in there about something i was thinking about last night wrt getting the build request via the marker up front and then being smarter about getting the build requests that come *after* that marker, rather than getting all of the build requests first, filtering them and then throwing out a bunch - which seems really inefficient | 15:37 |
| mriedem | but my brain hasn't quite been able to put together how that could work | 15:37 |
| mriedem | dansmith: also, i wonder if some of this is why the build request stuff didn't play so nice with your new instance_list stuff + paging | 15:38 |
| dansmith | well we have to filter them based on the json property so we kinda have to load them all right? | 15:38 |
| mriedem | we can find the marker up front but i don't know if that helps us | 15:38 |
| dansmith | mriedem: it's because of ^ that it was less easy to add | 15:38 |
| dansmith | it doesn't because we still have to load them all to figure out where to start after the marker | 15:38 |
| mriedem | sure, | 15:38 |
| mriedem | how about this as an optimization though, | 15:39 |
| dansmith | so could be one shortcut we could add maybe, but.. | 15:39 |
| *** sree has quit IRC | 15:39 | |
| *** damien_r has quit IRC | 15:39 | |
| mriedem | if we have a marker, get the build request up front and if not found, bail early | 15:39 |
| mriedem | that would avoid the get_all()) | 15:39 |
| *** _ix has joined #openstack-nova | 15:39 | |
| mriedem | chances are we aren't going to find a marker in the build request in most cases i wouldn't think | 15:39 |
| *** sree has joined #openstack-nova | 15:39 | |
| dansmith | it's more round trips to the db, and getting the marker ahead of time doesn't really help us select a smaller get_all() | 15:40 |
| dansmith | so I'm not sure it's really worth it, TBH, but.. if you think it's better | 15:40 |
| dansmith | so imagine this scenario: | 15:40 |
| dansmith | nova boot --min-instances=100, followed by a paged list of tens of instances per page | 15:40 |
| dansmith | that could be a couple minutes where your markers are in the build requests | 15:40 |
| mriedem | true | 15:41 |
| mriedem | until the public cloud guys tell me in 18 months that we're spending too much time paging over build requests, i'll leave this alone :) | 15:41 |
| dansmith | aye | 15:42 |
| stephenfin | mriedem: OK, I know where I went wrong. Re-reviewed now | 15:42 |
| *** Sukhdev_ has joined #openstack-nova | 15:43 | |
| stephenfin | dansmith: Mind reminding me why we don't do stuff like this with o.vo objects? https://review.openstack.org/#/c/523919/2/nova/objects/pci_device.py@177 | 15:43 |
| mriedem | stephenfin: cool thanks | 15:43 |
| *** yamahata has quit IRC | 15:43 | |
| stephenfin | It was the reason for this whole series https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bug/1636338 | 15:43 |
| *** sree has quit IRC | 15:43 | |
| mriedem | stephenfin: could just be laziness on the part of the consuming code, | 15:44 |
| mriedem | i.e. instead of the calling code checking "if 'extra_info' in pci_device'" | 15:44 |
| dansmith | stephenfin: it means that objects default to something being set that may not match what is in the database. so, if I wanted to do something like this: | 15:44 |
| dansmith | d = objects.PciDevice(id=123, label="new_label"); d.save(), we would overwrite extra_info in the database with an empty dict | 15:45 |
| dansmith | may not apply directly to this situation, but that's the pattern we've got elsewhere and it's super confusing to have some of them work like that, and others have silent defaults for some fields | 15:46 |
| mriedem | stephenfin: also without that self.extra_info = {} in __init__, if you called PciDevice.create(), we'd fail here https://review.openstack.org/#/c/523919/2/nova/objects/pci_device.py@168 | 15:46 |
| stephenfin | mriedem: yeah, you'd have to harden that to include 'if 'extra_info' in self:' or the likes | 15:47 |
| *** armax has quit IRC | 15:47 | |
| mriedem | that should really probably be something like, "if 'extra_info' in self: extra_info = self.extra_info else: extra_info = {}" | 15:48 |
| stephenfin | I'd to do sooo much of that in aforementioned series | 15:48 |
| stephenfin | mriedem: ++ | 15:48 |
| *** brault has joined #openstack-nova | 15:49 | |
| *** edmondsw has quit IRC | 15:50 | |
| stephenfin | Oh, also, thanks for the re-explanation dansmith | 15:50 |
| dansmith | np | 15:50 |
| *** edmondsw has joined #openstack-nova | 15:50 | |
| *** udesale has joined #openstack-nova | 15:51 | |
| *** udesale has quit IRC | 15:51 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: objects: remove related pinning from __init__ of InstanceNUMATopology https://review.openstack.org/485554 | 15:52 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: objects: remove cpuset_reserved from __init__ of InstanceNUMATopology https://review.openstack.org/466030 | 15:52 |
| *** josecastroleon has quit IRC | 15:53 | |
| dansmith | <3 | 15:53 |
| *** edmondsw has quit IRC | 15:54 | |
| openstackgerrit | Jay Pipes proposed openstack/nova master: handle traits with sharing providers https://review.openstack.org/517119 | 15:56 |
| openstackgerrit | Jay Pipes proposed openstack/nova master: Test alloc_cands with non overlapping sharing RPs https://review.openstack.org/519380 | 15:56 |
| openstackgerrit | Jay Pipes proposed openstack/nova master: Test alloc_cands with one RP shared between two RPs https://review.openstack.org/519617 | 15:56 |
| openstackgerrit | Jay Pipes proposed openstack/nova master: Test allocation candidates: multiple aggregates https://review.openstack.org/518633 | 15:56 |
| openstackgerrit | Jay Pipes proposed openstack/nova master: Test helper: validate provider summaries https://review.openstack.org/518982 | 15:56 |
| openstackgerrit | Jay Pipes proposed openstack/nova master: Fix accumulated nits in refactor series https://review.openstack.org/521189 | 15:56 |
| openstackgerrit | Jay Pipes proposed openstack/nova master: Add aggregates check in allocation candidates https://review.openstack.org/522407 | 15:56 |
| openstackgerrit | Jay Pipes proposed openstack/nova master: Fix missing rps in allocation candidates https://review.openstack.org/522409 | 15:56 |
| openstackgerrit | Jay Pipes proposed openstack/nova master: placement: func tests for multiple shared RPs https://review.openstack.org/498737 | 15:56 |
| jaypipes | dansmith, gibi: voila. ^ | 15:56 |
| *** udesale has joined #openstack-nova | 15:58 | |
| *** cdent has quit IRC | 15:58 | |
| *** Sukhdev has joined #openstack-nova | 16:00 | |
| gibi | jaypipes: looking | 16:00 |
| *** Alex_Staf has quit IRC | 16:01 | |
| openstackgerrit | Lajos Katona proposed openstack/nova master: WIP: Add nested resources to server moving tests https://review.openstack.org/527728 | 16:01 |
| *** udesale has quit IRC | 16:01 | |
| *** sapcc-bot has quit IRC | 16:02 | |
| gibi | jaypipes: +2 from me | 16:02 |
| *** tpatzig_ has joined #openstack-nova | 16:02 | |
| *** sapcc-bot has joined #openstack-nova | 16:02 | |
| *** dgonzalez_ has joined #openstack-nova | 16:02 | |
| *** mkoderer_ has joined #openstack-nova | 16:03 | |
| *** rmart04 has quit IRC | 16:04 | |
| *** tpatzig_ has quit IRC | 16:04 | |
| *** dgonzalez_ has quit IRC | 16:04 | |
| *** mkoderer_ has quit IRC | 16:05 | |
| *** Apoorva has joined #openstack-nova | 16:06 | |
| *** tbachman has quit IRC | 16:09 | |
| openstackgerrit | Eric Berglund proposed openstack/nova master: WIP: PowerVM Driver: vSCSI https://review.openstack.org/526094 | 16:10 |
| *** jaypipes is now known as jay_tampa | 16:10 | |
| *** edand has joined #openstack-nova | 16:10 | |
| *** dave-mccowan has quit IRC | 16:11 | |
| dansmith | jay_tampa: +W on the bottom three.. I had a question on Bottom-4 that you didn't answer | 16:14 |
| *** erlon has joined #openstack-nova | 16:17 | |
| *** armax has joined #openstack-nova | 16:18 | |
| *** claudiub has joined #openstack-nova | 16:20 | |
| *** armax has quit IRC | 16:21 | |
| *** dklyle has joined #openstack-nova | 16:21 | |
| *** sree has joined #openstack-nova | 16:27 | |
| *** claudiub has quit IRC | 16:29 | |
| *** artom has quit IRC | 16:31 | |
| *** sree has quit IRC | 16:31 | |
| *** moshele has joined #openstack-nova | 16:36 | |
| *** r-daneel has quit IRC | 16:37 | |
| *** lpetrut has quit IRC | 16:38 | |
| *** tssurya has quit IRC | 16:38 | |
| *** salv-orlando has joined #openstack-nova | 16:40 | |
| *** Sukhdev has quit IRC | 16:40 | |
| stephenfin | moshele: Just the man I'm looking for. What's the possibility that you could take a look at https://review.openstack.org/#/q/status:open+project:openstack/nova+branch:master+topic:bp/share-pci-between-numa-nodes ? | 16:41 |
| *** BryanS68 has joined #openstack-nova | 16:43 | |
| *** klindgren has joined #openstack-nova | 16:44 | |
| *** AlexeyAbashkin has quit IRC | 16:47 | |
| moshele | stephenfin: will do, but tomorrow | 16:47 |
| stephenfin | moshele: No problem. Thanks :) | 16:47 |
| *** tosky has quit IRC | 16:48 | |
| *** moshele has quit IRC | 16:49 | |
| *** fragatina has joined #openstack-nova | 16:49 | |
| klindgren | Hello, Working on setting up a new pike cloud with cellsv2 running on it. and trying to get a list of services that need to be ran at each level. I found https://docs.openstack.org/nova/latest/user/cellsv2-layout.html. But I just want to confirm. So at the Top level API cell. I need to run: nova-api, nova-consoleauth, nova-spicehtml5proxy, nova-conductor, API rabbitmq, API DB, Cell0 DB. Then in each cell I need to r | 16:50 |
| klindgren | un: Cell rabbitmq, nova-conductor, nova-computes (attached to the cell rmq), cell DB. Now in cellv1 we run nova-manage at both the api cell and the child cell level. I assume the same is required with cellsv2? | 16:50 |
| dansmith | klindgren: ye[ | 16:52 |
| dansmith | er yup | 16:52 |
| klindgren | So all thats need in child cells now is nova-conductor | 16:52 |
| dansmith | and compute :) | 16:53 |
| mriedem | scheduler is top level | 16:53 |
| mriedem | didn't see that in your list | 16:53 |
| dansmith | oh yeah | 16:54 |
| dansmith | you will want a scheduler | 16:54 |
| klindgren | and placement | 16:54 |
| *** tbachman has joined #openstack-nova | 16:54 | |
| mriedem | yes | 16:54 |
| mriedem | placement is assumed to be global | 16:54 |
| mriedem | cern is doing it per-cell to start | 16:55 |
| mriedem | i think for perf reasons | 16:55 |
| mriedem | if you're not at cern scale, global is your long-term friend | 16:55 |
| mriedem | imo | 16:55 |
| dansmith | yup | 16:55 |
| cfriesen__ | Is it possible to reset specific individual tenant quotas back to the default value? (by writing -1 to them, maybe?) What about specific user/tenant quotas? (The code there makes it look like you can't set the max to more than the custom tenant quota.) | 16:56 |
| melwitt | except for console proxies, after they move (because they'll need cell database access and don't have instance uuid) | 16:57 |
| mriedem | cfriesen__: once you start overriding default quotas for a tenant, you're stuck | 16:57 |
| mriedem | unless you remove those entries from the db | 16:57 |
| melwitt | cfriesen__: writing -1 will make them unlimited, so that's not what you want either | 16:57 |
| mriedem | remember that the lookup order for quota is (1) per-project quota table (2) global quota_classes table, (3) config | 16:58 |
| mriedem | so you'd have to remove (1) | 16:58 |
| klindgren | do you guys have a blog post or something that explains all the nova-manage commands to run now to setup cellsv2? | 16:58 |
| melwitt | yup, that | 16:58 |
| mriedem | klindgren: https://docs.openstack.org/nova/latest/user/cells.html | 16:58 |
| mriedem | klindgren: there is basic setup stuff in there and in the install guide | 16:59 |
| mriedem | the cellsv1->v2 portion is admittedly light | 16:59 |
| mriedem | klindgren: and you know about https://etherpad.openstack.org/p/cellsv1-to-v2-migration | 16:59 |
| cfriesen__ | mriedem: so we have a way to remove *all* per-tenant quotas, but no way to remove individual ones? | 17:00 |
| klindgren | yea - right now just getting a pike cloud with all the new features enabled on it (cellsv2, network aware placement, neutron routed networks, ect ect). So we can start working on the migration to that. So not currently concerned with cellsv1 -> cellv2 | 17:00 |
| mriedem | cfriesen__: this ?https://developer.openstack.org/api-ref/compute/#revert-quotas-to-defaults | 17:00 |
| mriedem | klindgren: ack | 17:00 |
| cfriesen__ | mriedem: yeah. so you can revert all the quotas for a tenant back to defaults, and you can override specific quotas, but you can't revert specific quotas back to defaults | 17:01 |
| mriedem | cfriesen__: yes correct, https://developer.openstack.org/api-ref/compute/#revert-quotas-to-defaults removes all of the per-tenant quota | 17:01 |
| mriedem | cfriesen__: you'd need like a DELETE /os-quota-sets/{tenant_id}/{quota_key} or something | 17:01 |
| *** chyka has joined #openstack-nova | 17:01 | |
| mriedem | which we don't have | 17:01 |
| cfriesen__ | right. okay, thanks | 17:02 |
| klindgren | mriedem, thanks for the link, I thought I looked at this, but I guess I just didn't scroll down enough :-/ | 17:02 |
| mriedem | klindgren: that reminds me of something sdague posted recently, | 17:04 |
| mriedem | at this point, we should probably move the 'setup of cellsv2 and faqs' to the top of page | 17:04 |
| mriedem | and the cellsv1/v2 manifesto to the bottom of page | 17:04 |
| mriedem | so people don't glaze over the content looking for install instructions | 17:04 |
| *** brault has quit IRC | 17:04 | |
| melwitt | I think that's a good idea | 17:04 |
| *** jdillaman has quit IRC | 17:05 | |
| mriedem | i can take a shot at that re-org in a bit | 17:05 |
| *** Tom-Tom has joined #openstack-nova | 17:05 | |
| openstackgerrit | Merged openstack/python-novaclient master: Optimize jobs run on novaclient https://review.openstack.org/527550 | 17:05 |
| *** Sukhdev has joined #openstack-nova | 17:06 | |
| *** sree has joined #openstack-nova | 17:07 | |
| *** Sukhdev has quit IRC | 17:08 | |
| *** amodi has quit IRC | 17:09 | |
| melwitt | mriedem: I have a question regarding my consoles series. because console proxies run globally in devstack, the top patch in my series fails and then passes on the devstack Depends-On patch https://review.openstack.org/#/c/484973/ that moves proxies per cell (which is expected). would you recommend I instead make the top patch Depends-On the devstack patch to set things up properly? | 17:09 |
| *** yangyapeng has joined #openstack-nova | 17:09 | |
| *** xyang1 has quit IRC | 17:09 | |
| *** Tom-Tom has quit IRC | 17:09 | |
| *** r-daneel has joined #openstack-nova | 17:10 | |
| mriedem | a bit confused, | 17:11 |
| *** Apoorva has quit IRC | 17:11 | |
| mriedem | i'd think we would change devstack to run the console proxy service per-cell if we're in superconductor mode | 17:11 |
| mriedem | else globally for singleconductor? | 17:12 |
| *** Apoorva has joined #openstack-nova | 17:12 | |
| melwitt | yeah, that's what I think I've done in my devstack patch | 17:12 |
| mriedem | but it's a chicken and egg isn't isn't it? | 17:12 |
| melwitt | it's just that the current topology is console proxies at the top. my series will make it so console proxies need to be per cell | 17:12 |
| melwitt | yeah | 17:12 |
| mriedem | the per-cell nova patch can't work if devstack is using global | 17:12 |
| mriedem | so what happens if you changed devstack today to run consoleproxy per cell | 17:12 |
| mriedem | w/o a depends-on | 17:13 |
| mriedem | how does it blow up | 17:13 |
| melwitt | right. the current console stuff *might* probably work if deployed per cell because the storage is global | 17:13 |
| melwitt | well, I'm not sure actually | 17:13 |
| mriedem | so you probably need a 2-step dance | 17:13 |
| *** yangyapeng has quit IRC | 17:13 | |
| melwitt | yeah, let me try that without a depends-on and see what happens | 17:13 |
| mriedem | if it's like one test in tempest that fails, we could maybe disable the test in tempest via config in devstack until we have the thing that makes it all work with the nova patch | 17:14 |
| melwitt | I see. yeah, it is one test, the novnc test | 17:14 |
| stephenfin | cfriesen__: This look like something you'd be interested in reviewing? https://review.openstack.org/#/c/527472/ | 17:15 |
| *** sree has quit IRC | 17:15 | |
| melwitt | mriedem: okay, let me try a run without depends-on in the devstack patch and see what blows up. thanks for the ideas | 17:15 |
| *** tidwellr has quit IRC | 17:16 | |
| cfriesen__ | stephenfin: yep, will take a look | 17:16 |
| *** tidwellr has joined #openstack-nova | 17:16 | |
| *** Apoorva has quit IRC | 17:16 | |
| mriedem | melwitt: ok then you could disable that in devstack/lib/tempest using CONF.compute_feature_enabled.vnc_console=False in tempest.conf | 17:20 |
| mriedem | melwitt: so maybe disable that with a TODO saying if you're running per-cell console proxy, it won't work until the nova patch which a later devstack patch depends on and removes that tempest conf | 17:20 |
| melwitt | aha, cool | 17:20 |
| mriedem | so devstack1->nova->devstack2 | 17:20 |
| mriedem | is the dep order i think | 17:20 |
| mriedem | if that works, you owe me a cream sodda | 17:21 |
| mriedem | *soda | 17:21 |
| melwitt | heh, can do | 17:21 |
| *** jpena is now known as jpena|brb | 17:24 | |
| *** yangyapeng has joined #openstack-nova | 17:24 | |
| *** andreas_s has joined #openstack-nova | 17:28 | |
| *** yangyapeng has quit IRC | 17:28 | |
| *** xyang1 has joined #openstack-nova | 17:29 | |
| *** armax has joined #openstack-nova | 17:30 | |
| *** mvk has quit IRC | 17:34 | |
| *** Apoorva has joined #openstack-nova | 17:36 | |
| *** dtantsur is now known as dtantsur|afk | 17:39 | |
| *** links has quit IRC | 17:40 | |
| *** archit has joined #openstack-nova | 17:40 | |
| *** lajoskatona has quit IRC | 17:40 | |
| *** archit is now known as amodi | 17:40 | |
| *** tbachman has quit IRC | 17:41 | |
| *** andreas_s has quit IRC | 17:43 | |
| *** jpena|brb is now known as jpena | 17:43 | |
| *** shaner has joined #openstack-nova | 17:45 | |
| *** xyang1 has quit IRC | 17:45 | |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: SchedulerReportClient._get_providers_in_aggregates https://review.openstack.org/521097 | 17:48 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Traits ops on ProviderTree https://review.openstack.org/521605 | 17:48 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Move aggregates from report client to ProviderTree https://review.openstack.org/521685 | 17:48 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Track provider traits in report client https://review.openstack.org/521686 | 17:48 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Track associated sharing RPs in report client https://review.openstack.org/526539 | 17:48 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Raise on API errors getting aggregates/traits https://review.openstack.org/526540 | 17:48 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: ProviderTree.populate_from_iterable https://review.openstack.org/520756 | 17:48 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: Track tree-associated providers in report client https://review.openstack.org/526541 | 17:48 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: WIP: Scheduler[Report]Client.get_provider_tree https://review.openstack.org/521098 | 17:48 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: WIP: ComputeDriver.update_provider_tree() https://review.openstack.org/521187 | 17:48 |
| openstackgerrit | Stephen Finucane proposed openstack/nova master: WIP: Use update_provider_tree from resource tracker https://review.openstack.org/520246 | 17:48 |
| cfriesen__ | stephenfin: the added comments are helpful | 17:48 |
| stephenfin | cfriesen__: Good to hear. I got pretty bogged down in it myself yesterday and decided to add what I learned | 17:49 |
| *** cfriesen__ is now known as cfriesen | 17:49 | |
| stephenfin | I also noticed a fair chunk of duplication and the likes going on, e.g. https://github.com/openstack/nova/blob/master/nova/pci/stats.py#L148-L155 vs https://github.com/openstack/nova/blob/master/nova/pci/stats.py#L242-L248 | 17:51 |
| stephenfin | Gonna tackle that once this in in, hopefully | 17:51 |
| *** yumapath has joined #openstack-nova | 17:53 | |
| yumapath | hi all, am trying to launch a instance on devstack (queen's) and am getting the following error | 17:53 |
| yumapath | Error: Failed to perform requested operation on instance "vm2", the instance has an error status: Please try again later [Error: No sql_connection parameter is established]. | 17:54 |
| yumapath | what could be the possible reason | 17:54 |
| *** claudiub has joined #openstack-nova | 17:54 | |
| yumapath | googling did not yeild any useful results | 17:54 |
| yumapath | can someone help | 17:54 |
| *** mdnadeem_ has quit IRC | 17:54 | |
| *** xyang1 has joined #openstack-nova | 17:54 | |
| stephenfin | yumapath: Looks like an oslo.db issue. You'd be better off asking about it on #openstack http://codesearch.openstack.org/?q=No%20sql_connection%20parameter%20is%20established&i=nope&files=&repos= | 17:55 |
| yumapath | ok | 17:56 |
| yumapath | thanks | 17:56 |
| *** yumapath has left #openstack-nova | 17:56 | |
| *** andreas_s has joined #openstack-nova | 17:59 | |
| *** claudiub has quit IRC | 17:59 | |
| *** baoli has quit IRC | 17:59 | |
| *** sree has joined #openstack-nova | 17:59 | |
| *** andreas_s has quit IRC | 17:59 | |
| *** baoli has joined #openstack-nova | 18:00 | |
| *** andreas_s has joined #openstack-nova | 18:00 | |
| *** lucasagomes is now known as lucas-afk | 18:00 | |
| *** lyan has quit IRC | 18:00 | |
| *** _ix has quit IRC | 18:00 | |
| *** lyan has joined #openstack-nova | 18:01 | |
| mriedem | actually that's probably a superconductor issue | 18:03 |
| stephenfin | melwitt: This is odd. What's going on here? https://review.openstack.org/#/c/325381/16/nova/tests/unit/compute/test_compute_mgr.py@279 | 18:03 |
| *** felipemonteiro_ has quit IRC | 18:03 | |
| *** derekh has quit IRC | 18:04 | |
| *** _ix has joined #openstack-nova | 18:04 | |
| *** andreas_s has quit IRC | 18:04 | |
| *** sree has quit IRC | 18:04 | |
| *** yangyapeng has joined #openstack-nova | 18:04 | |
| mriedem | stephenfin: i sent yumapath here https://github.com/openstack-dev/devstack/blob/master/stackrc#L80 | 18:04 |
| mriedem | and here https://docs.openstack.org/nova/latest/user/cellsv2-layout.html | 18:04 |
| mriedem | they are likely failing on a reschedule | 18:05 |
| stephenfin | I just realized I'm not actually on that channel | 18:06 |
| mriedem | i'm not either usually | 18:06 |
| *** ralonsoh has quit IRC | 18:06 | |
| mriedem | unless someone comes here with a problem and we shoo them off and i think i have an answer | 18:06 |
| stephenfin | Heh, fair. I figured it was a lack of a configuration option that oslo.db cared about | 18:07 |
| mriedem | with devstack that's pretty hard to screw up | 18:07 |
| mriedem | unless you messed with stuff | 18:07 |
| *** yangyapeng has quit IRC | 18:09 | |
| *** Swami has joined #openstack-nova | 18:11 | |
| frickler | mriedem: stephenfin: https://bugs.launchpad.net/nova/+bug/1733933 | 18:11 |
| openstack | Launchpad bug 1733933 in OpenStack Compute (nova) "nova-conductor is masking error when rescheduling" [Undecided,Confirmed] | 18:11 |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add nova-status check for ironic flavor migration https://review.openstack.org/527541 | 18:12 |
| mriedem | dtantsur|afk: dansmith: edleafe: ^ now with tests and docsy things | 18:12 |
| mriedem | frickler: replied in the bug | 18:14 |
| mriedem | frickler: if you rely on reschedules, you need to modify devstack | 18:14 |
| *** josecastroleon has joined #openstack-nova | 18:14 | |
| frickler | mriedem: I think that answers it only partially. even if the reschedule doesn't work, I want to see the error from n-cpu on the instance and not have it replaced by "No sql_connection parameter is established" | 18:17 |
| *** AlexeyAbashkin has joined #openstack-nova | 18:17 | |
| *** mvk has joined #openstack-nova | 18:18 | |
| mriedem | frickler: ok fair enough, i re-opened it | 18:18 |
| mriedem | but now i'm off for my pre-holidays haircutting | 18:19 |
| *** AlexeyAbashkin has quit IRC | 18:21 | |
| *** huanxie has quit IRC | 18:23 | |
| *** huanxie has joined #openstack-nova | 18:23 | |
| *** tbachman has joined #openstack-nova | 18:27 | |
| *** sridharg has quit IRC | 18:28 | |
| *** josecastroleon has quit IRC | 18:29 | |
| *** josecastroleon has joined #openstack-nova | 18:30 | |
| *** r-daneel_ has joined #openstack-nova | 18:31 | |
| *** r-daneel has quit IRC | 18:31 | |
| *** r-daneel_ is now known as r-daneel | 18:31 | |
| *** imacdonn_ has quit IRC | 18:35 | |
| *** imacdonn_ has joined #openstack-nova | 18:35 | |
| *** _ix has quit IRC | 18:39 | |
| *** dave-mccowan has joined #openstack-nova | 18:44 | |
| *** catintheroof has joined #openstack-nova | 18:44 | |
| *** yamamoto has quit IRC | 18:45 | |
| *** sree has joined #openstack-nova | 18:46 | |
| *** lpetrut has joined #openstack-nova | 18:49 | |
| *** jpena is now known as jpena|off | 18:49 | |
| *** sree has quit IRC | 18:53 | |
| *** adisky__ has quit IRC | 18:53 | |
| *** smatzek has quit IRC | 18:54 | |
| openstackgerrit | Ildiko Vancsa proposed openstack/nova master: WIP: libvirt: Allow multiple volume attachments https://review.openstack.org/267587 | 18:58 |
| openstackgerrit | Ildiko Vancsa proposed openstack/nova master: WIP: Allow multi-attach in compute api https://review.openstack.org/271047 | 18:58 |
| *** sree has joined #openstack-nova | 18:58 | |
| *** _ix has joined #openstack-nova | 18:59 | |
| *** yamamoto has joined #openstack-nova | 19:01 | |
| *** felipemonteiro has joined #openstack-nova | 19:02 | |
| *** sree has quit IRC | 19:03 | |
| *** felipemonteiro_ has joined #openstack-nova | 19:04 | |
| *** yamamoto has quit IRC | 19:06 | |
| *** sambetts is now known as sambetts|afk | 19:06 | |
| *** edand has quit IRC | 19:07 | |
| *** felipemonteiro has quit IRC | 19:08 | |
| *** edand has joined #openstack-nova | 19:09 | |
| openstackgerrit | Ildiko Vancsa proposed openstack/nova master: WIP: libvirt: Allow multiple volume attachments https://review.openstack.org/267587 | 19:11 |
| openstackgerrit | Ildiko Vancsa proposed openstack/nova master: WIP: Allow multi-attach in compute api https://review.openstack.org/271047 | 19:11 |
| *** lpetrut has quit IRC | 19:11 | |
| *** lajoskatona has joined #openstack-nova | 19:13 | |
| *** artom has joined #openstack-nova | 19:14 | |
| *** r-daneel_ has joined #openstack-nova | 19:15 | |
| *** r-daneel has quit IRC | 19:17 | |
| *** r-daneel_ is now known as r-daneel | 19:17 | |
| *** penick has joined #openstack-nova | 19:17 | |
| *** smatzek has joined #openstack-nova | 19:21 | |
| *** lajoskatona has quit IRC | 19:24 | |
| *** lajoskatona has joined #openstack-nova | 19:25 | |
| *** lpetrut has joined #openstack-nova | 19:25 | |
| *** josecastroleon has quit IRC | 19:26 | |
| *** openstackstatus has quit IRC | 19:27 | |
| openstackgerrit | Merged openstack/nova master: Change RPC for select_destinations() https://review.openstack.org/516707 | 19:27 |
| openstackgerrit | Merged openstack/nova master: Move the claim_resources method to scheduler utils https://review.openstack.org/511357 | 19:27 |
| openstackgerrit | Merged openstack/nova stable/ocata: fix nova accepting invalid availability zone name with ':' https://review.openstack.org/509659 | 19:27 |
| *** josecastroleon has joined #openstack-nova | 19:28 | |
| *** Sukhdev has joined #openstack-nova | 19:28 | |
| *** lpetrut has quit IRC | 19:32 | |
| *** lpetrut has joined #openstack-nova | 19:35 | |
| *** gbarros has joined #openstack-nova | 19:38 | |
| mriedem | TheJulia: would you happen to know if there is an ironic grenade job that runs with resource classes? | 19:41 |
| mriedem | i'd like to run that against https://review.openstack.org/#/c/527541/ | 19:41 |
| TheJulia | I don't believe so... checking | 19:42 |
| *** fragatina has quit IRC | 19:43 | |
| mriedem | hmm, doesn't look like the ironic grenade job runs the nova-status command anyway | 19:43 |
| mriedem | compare http://logs.openstack.org/41/527541/1/check/legacy-grenade-dsvm-neutron-multinode/51ed76a/logs/grenade.sh.txt.gz#_2017-12-13_04_12_18_910 | 19:43 |
| mriedem | to http://logs.openstack.org/75/527075/1/check/ironic-grenade-dsvm-multinode-multitenant/2db59eb/logs/grenade.sh.txt.gz | 19:43 |
| mriedem | i'll push an ironic patch to test things out | 19:43 |
| *** fragatina has joined #openstack-nova | 19:43 | |
| TheJulia | mriedem: looks like we do set/use the resource class | 19:46 |
| *** andreas_s has joined #openstack-nova | 19:46 | |
| TheJulia | but we also set the mem/cpu/etc with a value of 0 for the flavor | 19:46 |
| mriedem | yeah that's fine | 19:47 |
| mriedem | this check would only fail if the node.resource_class isn't set i think | 19:47 |
| mriedem | otherwise we'll migrate that node.resource_class into the instance.flavor.extra_specs | 19:48 |
| TheJulia | we will likely want to publish a release note on ironic to stress that it MUST be set then | 19:49 |
| TheJulia | Well, we've done that before, but now we really really mean it | 19:49 |
| mriedem | you don't have to do that until nova drops the migration code | 19:49 |
| mriedem | and we can't do that until we have at least this nova-status check to tell people if they are done with the migration | 19:50 |
| mriedem | but yeah this is to try and get the ball rolling | 19:50 |
| mriedem | hmm | 19:51 |
| *** yamahata has joined #openstack-nova | 19:51 | |
| mriedem | why doesn't this ironic multinode grenade job upgrade nova? | 19:51 |
| mriedem | http://logs.openstack.org/75/527075/1/check/ironic-grenade-dsvm-multinode-multitenant/2db59eb/logs/grenade.sh.summary.txt.gz | 19:51 |
| mriedem | this other one does http://logs.openstack.org/75/527075/1/check/ironic-grenade-dsvm/41ce7b3/logs/grenade.sh.summary.txt.gz so i guess that's the one i care about | 19:51 |
| mriedem | ok here we go http://logs.openstack.org/75/527075/1/check/ironic-grenade-dsvm/41ce7b3/logs/grenade.sh.txt.gz#_2017-12-11_22_49_15_166 | 19:52 |
| *** andreas_s has quit IRC | 19:52 | |
| mriedem | cool | 19:52 |
| ildikov | mriedem: hi | 19:52 |
| TheJulia | oh, holdover from the old multinode scenario | 19:52 |
| ildikov | mriedem: just wanted to give a heads up that I did some fix up on the libvirt patch for multi-attach | 19:52 |
| TheJulia | one node should be getting upgraded if I remember correctly | 19:52 |
| ildikov | mriedem: I will move up the support-matrix changes in the chain | 19:53 |
| ildikov | mriedem: if you could take a look on that patch and see whether it's on the right track that would be great and then I can look into the locking in a follow patch on top of that one | 19:53 |
| ildikov | mriedem: tnx :) | 19:53 |
| *** edand has quit IRC | 19:53 | |
| *** moshele has joined #openstack-nova | 19:57 | |
| *** shaner has quit IRC | 19:58 | |
| *** shaner has joined #openstack-nova | 20:07 | |
| *** yamamoto has joined #openstack-nova | 20:09 | |
| *** Sukhdev_ has quit IRC | 20:12 | |
| *** liverpooler has quit IRC | 20:17 | |
| *** lajoskatona has quit IRC | 20:18 | |
| *** yamamoto has quit IRC | 20:18 | |
| *** chyka has quit IRC | 20:21 | |
| *** chyka has joined #openstack-nova | 20:21 | |
| *** josecastroleon has quit IRC | 20:24 | |
| mriedem | cfriesen: what can you tell me about https://blueprints.launchpad.net/nova/+spec/numa-node-pinning ? | 20:27 |
| *** openstackstatus has joined #openstack-nova | 20:28 | |
| *** ChanServ sets mode: +v openstackstatus | 20:28 | |
| *** _ix has quit IRC | 20:28 | |
| mriedem | cfriesen: are you guys carrying something for that? | 20:29 |
| mriedem | seems like nested resource providers could help here | 20:29 |
| *** gbarros has quit IRC | 20:31 | |
| *** yamahata has quit IRC | 20:32 | |
| *** vivsoni_ has quit IRC | 20:40 | |
| *** vivsoni_ has joined #openstack-nova | 20:40 | |
| *** amotoki has quit IRC | 20:43 | |
| *** thingee has quit IRC | 20:43 | |
| *** logan- has quit IRC | 20:43 | |
| *** johnthetubaguy has quit IRC | 20:43 | |
| *** logan- has joined #openstack-nova | 20:43 | |
| *** amotoki has joined #openstack-nova | 20:44 | |
| *** thingee has joined #openstack-nova | 20:44 | |
| *** gouthamr has quit IRC | 20:45 | |
| *** johnthetubaguy has joined #openstack-nova | 20:45 | |
| *** ericyoung has quit IRC | 20:45 | |
| *** awaugama has quit IRC | 20:47 | |
| *** gszasz has quit IRC | 20:47 | |
| *** Anticime1 is now known as Anticimex | 20:48 | |
| mriedem | cfriesen: our product team is also interested in the use case in ^ - i copied in what my response was to them in the whiteboard | 20:48 |
| mriedem | sounds like red hat is also interested but i don't have membership in the bugzilla ACL | 20:49 |
| mriedem | https://bugzilla.redhat.com/show_bug.cgi?id=1519621 | 20:49 |
| openstack | mriedem: Error: Error getting bugzilla.redhat.com bug #1519621: NotPermitted | 20:49 |
| *** ericyoung has joined #openstack-nova | 20:50 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Update nova-status and docs for nova-compute requiring placement 1.14 https://review.openstack.org/526505 | 20:53 |
| *** tssurya has joined #openstack-nova | 20:54 | |
| *** penick has quit IRC | 21:00 | |
| *** fragatina has quit IRC | 21:01 | |
| *** sree has joined #openstack-nova | 21:07 | |
| openstackgerrit | Merged openstack/nova master: Deprecate file injection https://review.openstack.org/522027 | 21:08 |
| mriedem | ooo eff yeah | 21:10 |
| *** sree has quit IRC | 21:11 | |
| mriedem | yikes 500 from placement http://logs.openstack.org/64/527564/1/gate/legacy-tempest-dsvm-py35/7db2d64/logs/screen-n-sch.txt.gz#_Dec_13_17_07_40_977103 | 21:12 |
| *** tssurya has quit IRC | 21:13 | |
| mriedem | wth, tracing req-c9d0d841-a466-4b8a-aea1-aae993781b4f we get a NoValidHost, | 21:13 |
| mriedem | http://logs.openstack.org/64/527564/1/gate/legacy-tempest-dsvm-py35/7db2d64/logs/screen-n-super-cond.txt.gz#_Dec_13_17_07_41_007395 | 21:13 |
| mriedem | but looking at that in the scheduler logs, we don't even hit the filters for that request | 21:14 |
| mriedem | http://logs.openstack.org/64/527564/1/gate/legacy-tempest-dsvm-py35/7db2d64/logs/screen-n-sch.txt.gz#_Dec_13_17_07_40_529855 | 21:14 |
| mriedem | right around the time that request is starting to run in the scheduler, another one blows up with a 500 response from placement | 21:14 |
| mriedem | but those should be separate threads yeah? | 21:15 |
| mriedem | edleafe: ^ you see anything suspicious in here? | 21:15 |
| *** catintheroof has quit IRC | 21:15 | |
| *** catintheroof has joined #openstack-nova | 21:15 | |
| mriedem | so uh | 21:16 |
| mriedem | http://logs.openstack.org/64/527564/1/gate/legacy-tempest-dsvm-py35/7db2d64/logs/screen-placement-api.txt.gz#_Dec_13_17_07_40_968321 | 21:16 |
| mriedem | that doesn't look good | 21:16 |
| mriedem | jay_tampa: ^ | 21:16 |
| *** threestrands has joined #openstack-nova | 21:18 | |
| *** threestrands has quit IRC | 21:18 | |
| *** threestrands has joined #openstack-nova | 21:18 | |
| *** catintheroof has quit IRC | 21:19 | |
| *** smatzek has quit IRC | 21:20 | |
| *** smatzek has joined #openstack-nova | 21:20 | |
| *** smatzek has quit IRC | 21:20 | |
| mriedem | sdague: you wanna just push this through? https://review.openstack.org/#/c/519458/ | 21:20 |
| mriedem | it sucks not being able to e-r check placement logs | 21:21 |
| mriedem | oh maybe that's not an issue anymore | 21:21 |
| sdague | it shouldn't impact e-r | 21:22 |
| *** penick has joined #openstack-nova | 21:22 | |
| sdague | oh, actually maybe it does | 21:22 |
| sdague | otherwise you get DEBUG logs, which overload it | 21:22 |
| mriedem | logstash appears to be finding these | 21:23 |
| mriedem | http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22DBDeadlock%5C%22%20AND%20tags%3A%5C%22screen-placement-api.txt%5C%22%20AND%20voting%3A1&from=7d | 21:23 |
| mriedem | i think the logstash problem with placement logs is multiline | 21:24 |
| mriedem | yeah, i can't do message:"DBDeadlock" AND message:"_trait_sync" | 21:24 |
| mriedem | clarkb: can we get https://review.openstack.org/#/c/519458/ in so i can do multiline queries on placement logs? | 21:24 |
| *** pramodrj07 has joined #openstack-nova | 21:24 | |
| mriedem | or maybe ^ doesn't fix that either... | 21:25 |
| clarkb | mriedem: the filename does have screen in it right? | 21:29 |
| clarkb | mriedem: so thats a valid fix regardless? | 21:29 |
| clarkb | mriedem: as for multiline queries I would guess that is more a failing of the logstash parsing rules particularly for multiline events | 21:29 |
| mriedem | clarkb: i definitely don't get the nice log level filters on the placement logs today | 21:30 |
| clarkb | mriedem: ya thats going to be the chagne you linked then | 21:30 |
| mriedem | i'm unable to live without log level filters | 21:30 |
| *** cleong has quit IRC | 21:35 | |
| *** moshele has quit IRC | 21:37 | |
| edleafe | mriedem: no idea what's causing that error | 21:38 |
| mriedem | edleafe: the dbdeadlock error in placement is causing the 500 in the scheduler logs, | 21:39 |
| mriedem | i just can't figure out why that also aborts the other request | 21:39 |
| mriedem | which should be on a different thread | 21:39 |
| mriedem | https://bugs.launchpad.net/nova/+bug/1738083 | 21:39 |
| openstack | Launchpad bug 1738083 in OpenStack Compute (nova) "DBDeadlock when when syncing traits in Placement during list_allocation_candidates" [High,Triaged] | 21:39 |
| edleafe | mriedem: yeah, I meant the deadlock | 21:39 |
| mriedem | traits sync | 21:39 |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: CLI for traits (v1.6) https://review.openstack.org/514643 | 21:41 |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: Resource class set (v1.7) https://review.openstack.org/514644 | 21:41 |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: Usages per project and user (v1.8, v1.9) https://review.openstack.org/514646 | 21:41 |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: CLI allocation candidates (v1.10) https://review.openstack.org/514647 | 21:41 |
| openstackgerrit | Andrey Volkov proposed openstack/osc-placement master: [WIP] Get resource provider by uuid or name https://review.openstack.org/527791 | 21:41 |
| *** penick_ has joined #openstack-nova | 21:41 | |
| *** penick has quit IRC | 21:42 | |
| mriedem | this reminds me, | 21:42 |
| mriedem | we should run multiple scheduler workers (2) in our CI | 21:42 |
| mriedem | because we said we can since pike | 21:42 |
| edleafe | mriedem: since we're only expecting db_exc.DBDuplicateEntry, not a DBDeadlock | 21:42 |
| *** sree has joined #openstack-nova | 21:47 | |
| *** baoli has quit IRC | 21:48 | |
| *** baoli has joined #openstack-nova | 21:48 | |
| *** artom has quit IRC | 21:48 | |
| *** awaugama has joined #openstack-nova | 21:50 | |
| *** sree has quit IRC | 21:51 | |
| *** AlexeyAbashkin has joined #openstack-nova | 21:54 | |
| *** klindgren_ has joined #openstack-nova | 21:54 | |
| *** klindgren has quit IRC | 21:57 | |
| *** pchavva has quit IRC | 21:57 | |
| *** AlexeyAbashkin has quit IRC | 21:58 | |
| *** takashin has joined #openstack-nova | 21:58 | |
| *** rcernin has joined #openstack-nova | 22:00 | |
| *** fragatina has joined #openstack-nova | 22:06 | |
| *** xyang1 has quit IRC | 22:08 | |
| openstackgerrit | Matt Riedemann proposed openstack/nova master: Add nova-status check for ironic flavor migration https://review.openstack.org/527541 | 22:11 |
| *** r-daneel has quit IRC | 22:13 | |
| *** dtruong_ has joined #openstack-nova | 22:14 | |
| *** sapcc-bot has quit IRC | 22:16 | |
| *** tpatzig_ has joined #openstack-nova | 22:16 | |
| *** sapcc-bot has joined #openstack-nova | 22:16 | |
| *** erlon has quit IRC | 22:17 | |
| *** dtruong has quit IRC | 22:17 | |
| *** tpatzig_ has quit IRC | 22:18 | |
| *** BryanS68 has quit IRC | 22:18 | |
| *** BryanS68 has joined #openstack-nova | 22:19 | |
| *** READ10 has quit IRC | 22:21 | |
| *** marst has quit IRC | 22:24 | |
| *** lpetrut has quit IRC | 22:26 | |
| openstackgerrit | Dan Smith proposed openstack/nova master: WIP: Don't persist could-be-stale InstanceGroup fields in RequestSpec https://review.openstack.org/527799 | 22:26 |
| dansmith | mriedem: this is what I'm thinking for the functional change ^ | 22:26 |
| dansmith | except with less obvious bugs | 22:31 |
| mriedem | one question, but seems ok at first glance | 22:31 |
| *** peter-hamilton has quit IRC | 22:37 | |
| *** tidwellr has quit IRC | 22:44 | |
| *** BryanS68 has quit IRC | 22:53 | |
| *** harlowja has quit IRC | 22:54 | |
| *** penick has joined #openstack-nova | 22:54 | |
| *** penick_ has quit IRC | 22:56 | |
| *** felipemonteiro_ has quit IRC | 23:01 | |
| *** baoli has quit IRC | 23:05 | |
| *** baoli has joined #openstack-nova | 23:06 | |
| openstackgerrit | Dan Smith proposed openstack/nova master: Don't persist could-be-stale InstanceGroup fields in RequestSpec https://review.openstack.org/527799 | 23:06 |
| *** takashin has left #openstack-nova | 23:09 | |
| *** lyan has quit IRC | 23:12 | |
| *** baoli has quit IRC | 23:12 | |
| *** takashin has joined #openstack-nova | 23:13 | |
| *** jay_tampa is now known as jaypipes | 23:13 | |
| jaypipes | mriedem: that's odd... looks like multiple threads are all trying to insert the standard traits at the same time. | 23:13 |
| *** burt has quit IRC | 23:15 | |
| *** dave-mccowan has quit IRC | 23:23 | |
| *** mlavalle has quit IRC | 23:24 | |
| *** kumarmn has quit IRC | 23:25 | |
| *** sdague has quit IRC | 23:27 | |
| *** esberglu has quit IRC | 23:30 | |
| *** itlinux has joined #openstack-nova | 23:35 | |
| *** awaugama has quit IRC | 23:35 | |
| *** harlowja has joined #openstack-nova | 23:42 | |
| openstackgerrit | melanie witt proposed openstack/nova master: Optionalize instance_uuid in console_auth_token_get_valid() https://review.openstack.org/481700 | 23:42 |
| openstackgerrit | melanie witt proposed openstack/nova master: Add console connection object https://review.openstack.org/320063 | 23:42 |
| openstackgerrit | melanie witt proposed openstack/nova master: Add periodic task to clean expired console tokens https://review.openstack.org/325381 | 23:42 |
| openstackgerrit | melanie witt proposed openstack/nova master: Use ConsoleConnection object to generate authorizations https://review.openstack.org/325414 | 23:42 |
| openstackgerrit | melanie witt proposed openstack/nova master: Convert websocketproxy to use db for token validation https://review.openstack.org/333990 | 23:42 |
| *** esberglu has joined #openstack-nova | 23:43 | |
| *** armax has quit IRC | 23:44 | |
| melwitt | grr looks like I did something wrong to set the tempest conf option | 23:46 |
| *** esberglu has quit IRC | 23:48 | |
| melwitt | need dashes instead of underscores ... okay | 23:48 |
| *** tetsuro has joined #openstack-nova | 23:49 | |
| *** kumarmn has joined #openstack-nova | 23:51 | |
| *** kumarmn has quit IRC | 23:55 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!