*** AlexeyAbashkin has joined #openstack-operators | 00:01 | |
*** AlexeyAbashkin has quit IRC | 00:05 | |
*** penick has quit IRC | 00:09 | |
klindgren_ | mriedem, how often are compute nodes suppose to check in to the placement API? asking because it seems like every vm check internval it updates placement ip. Every min, with ~5 calls per HV? Seems like that will quickly turn terrible at scale? | 00:13 |
---|---|---|
mriedem | klindgren_: the compute node provider inventory is updated in placement (if the inventory has changed) every time the update_available_resources periodic task runs | 00:39 |
mriedem | same as updating the compute_nodes table in the same periodic | 00:40 |
*** chyka has quit IRC | 00:40 | |
klindgren_ | So its done over rest vs's rpc? | 00:40 |
mriedem | yes | 00:41 |
klindgren_ | Just noticed once I got that working in my cell of 1 compute node, 5+ calls to placement every minute | 00:41 |
mriedem | which release? | 00:41 |
mriedem | ocata? | 00:41 |
klindgren_ | having done something similar for vms to poll into metadata services, to do somethings... that seemed risky. | 00:41 |
klindgren_ | pike | 00:41 |
mriedem | i don't know what all of those 5 calls are without auditing it, but know there would at least be a GET on the resource provider for that compute node, and a GET on the inventories for that provider, and a PUT on the inventories for that provider if inventory changed since the last check | 00:42 |
*** markvoelker has joined #openstack-operators | 00:43 | |
mriedem | placement has to be over rest so it can be it's own service and things external to nova can use it | 00:44 |
mriedem | if it were over rpc, you'd likely have scaling adjustments to make for the increased rpc load right? | 00:44 |
mriedem | i don't doubt there are probably areas that we can optimize, we've mostly been in "get things working" for a few releases now | 00:45 |
*** markvoelker has quit IRC | 00:45 | |
klindgren_ | https://paste.ubuntu.com/26356656/ | 00:47 |
mriedem | we likely don't need to be doing the aggregates ones yet, | 00:48 |
mriedem | those are for shared resource, e.g. storage, providers but that doesn't work yet | 00:48 |
*** markvoelker has joined #openstack-operators | 00:49 | |
mriedem | klindgren_: https://github.com/openstack/nova/blob/stable/pike/nova/scheduler/client/report.py#L490 | 00:49 |
*** markvoelker has quit IRC | 00:50 | |
mriedem | and _provider_aggregate_map isn't used for anything | 00:50 |
mriedem | so likely something we should nix in master and backport until we actually need to use it | 00:50 |
mriedem | or as that note says, put it on a cache with a refresh interval | 00:51 |
klindgren_ | it based upon agent down time? - figured it would have been based upon the report internval? | 00:52 |
mriedem | huh? | 00:56 |
mriedem | klindgren_: you want to report a bug about the useless aggregates GET calls in the report client? | 00:56 |
klindgren_ | no sorry - if I wanted to change the interval from every minute to say 2 minutes | 00:56 |
klindgren_ | how would one go about doing that | 00:57 |
mriedem | it's the update_available_resources periodic in compute | 00:57 |
mriedem | https://github.com/openstack/nova/blob/stable/pike/nova/compute/manager.py#L6717 | 00:57 |
mriedem | "update_resources_interval" config option | 00:57 |
mriedem | note that the RT code is still going to run whenever instances change on the host though, like create/delete/move | 00:58 |
klindgren_ | - I swore I searched for all the internval config options | 00:58 |
mriedem | search *harder*! | 00:58 |
klindgren_ | yea thats fine | 00:58 |
klindgren_ | haha | 00:58 |
*** markvoelker has joined #openstack-operators | 01:08 | |
*** markvoelker has quit IRC | 01:09 | |
*** VW has joined #openstack-operators | 01:09 | |
*** VW has quit IRC | 01:11 | |
*** VW has joined #openstack-operators | 01:12 | |
*** VW has quit IRC | 01:16 | |
*** Apoorva_ has joined #openstack-operators | 01:43 | |
*** d0ugal has quit IRC | 01:43 | |
*** Apoorva has quit IRC | 01:46 | |
*** Apoorva_ has quit IRC | 01:47 | |
*** gfa has joined #openstack-operators | 01:50 | |
*** penick has joined #openstack-operators | 01:56 | |
*** penick_ has joined #openstack-operators | 02:00 | |
*** d0ugal has joined #openstack-operators | 02:01 | |
*** penick has quit IRC | 02:01 | |
*** slaweq has joined #openstack-operators | 02:09 | |
*** liverpooler has joined #openstack-operators | 02:10 | |
*** chyka has joined #openstack-operators | 02:12 | |
*** slaweq has quit IRC | 02:13 | |
*** mriedem has quit IRC | 02:16 | |
*** chyka has quit IRC | 02:17 | |
*** harlowja has quit IRC | 02:24 | |
*** Apoorva has joined #openstack-operators | 02:29 | |
*** penick_ has quit IRC | 02:32 | |
*** JinVan_ has joined #openstack-operators | 02:37 | |
*** liverpooler has quit IRC | 02:47 | |
*** lathiat has quit IRC | 02:51 | |
*** lathiat has joined #openstack-operators | 02:52 | |
*** Apoorva has quit IRC | 02:52 | |
*** khyr0n has quit IRC | 02:55 | |
*** khyr0n has joined #openstack-operators | 02:56 | |
*** tuanla____ has joined #openstack-operators | 02:59 | |
*** khyr0n has quit IRC | 03:01 | |
*** liverpooler has joined #openstack-operators | 03:08 | |
*** VW has joined #openstack-operators | 03:28 | |
*** Apoorva has joined #openstack-operators | 03:30 | |
*** liverpooler has quit IRC | 03:42 | |
*** DinaBelova has quit IRC | 03:44 | |
*** DinaBelova has joined #openstack-operators | 03:46 | |
*** AlexeyAbashkin has joined #openstack-operators | 03:52 | |
*** AlexeyAbashkin has quit IRC | 03:57 | |
*** dmitryme has quit IRC | 03:57 | |
*** dmitryme has joined #openstack-operators | 03:58 | |
*** VW has quit IRC | 04:01 | |
*** VW has joined #openstack-operators | 04:01 | |
*** VW has quit IRC | 04:06 | |
*** AlexeyAbashkin has joined #openstack-operators | 04:25 | |
*** AlexeyAbashkin has quit IRC | 04:29 | |
*** VW has joined #openstack-operators | 04:39 | |
*** Apoorva has quit IRC | 04:58 | |
*** VW has quit IRC | 05:17 | |
*** harlowja has joined #openstack-operators | 05:24 | |
*** chyka has joined #openstack-operators | 05:29 | |
*** admin0 has quit IRC | 05:33 | |
*** chyka has quit IRC | 05:33 | |
*** gyee has quit IRC | 05:36 | |
*** markvoelker has joined #openstack-operators | 05:39 | |
*** admin0 has joined #openstack-operators | 05:47 | |
*** jbadiapa has quit IRC | 06:02 | |
*** lathiat has quit IRC | 06:09 | |
*** mistur has quit IRC | 06:10 | |
*** racedo has joined #openstack-operators | 06:10 | |
*** racedo has quit IRC | 06:10 | |
*** mistur has joined #openstack-operators | 06:12 | |
*** lathiat has joined #openstack-operators | 06:12 | |
*** jbadiapa has joined #openstack-operators | 06:26 | |
*** pcaruana has joined #openstack-operators | 06:27 | |
*** dbecker_ has quit IRC | 06:30 | |
*** jbadiapa has quit IRC | 06:30 | |
*** pcaruana has quit IRC | 06:33 | |
*** pcaruana has joined #openstack-operators | 06:34 | |
*** simon-AS5591 has quit IRC | 06:35 | |
*** simon-AS559 has joined #openstack-operators | 06:35 | |
*** fragatina has quit IRC | 06:36 | |
*** dbecker_ has joined #openstack-operators | 06:43 | |
*** tuanla____ has quit IRC | 07:04 | |
*** tuanla____ has joined #openstack-operators | 07:05 | |
*** masber has quit IRC | 07:08 | |
*** damien_r has joined #openstack-operators | 07:08 | |
*** slaweq has joined #openstack-operators | 07:09 | |
*** slaweq has quit IRC | 07:14 | |
*** rcernin has quit IRC | 07:15 | |
*** jbadiapa has joined #openstack-operators | 07:18 | |
*** kristaps__ has joined #openstack-operators | 07:20 | |
*** kristaps_ has quit IRC | 07:22 | |
*** makowals has joined #openstack-operators | 07:25 | |
*** threestrands has quit IRC | 07:36 | |
*** vijaykc4 has joined #openstack-operators | 07:44 | |
*** harlowja has quit IRC | 07:49 | |
*** vijaykc4 has quit IRC | 07:49 | |
*** vijaykc4 has joined #openstack-operators | 07:49 | |
*** vijaykc4 has quit IRC | 07:53 | |
*** AlexeyAbashkin has joined #openstack-operators | 07:57 | |
*** lathiat has quit IRC | 08:02 | |
*** gkadam has joined #openstack-operators | 08:04 | |
*** lathiat has joined #openstack-operators | 08:04 | |
*** tesseract has joined #openstack-operators | 08:14 | |
*** damien_r has quit IRC | 08:20 | |
*** vijaykc4 has joined #openstack-operators | 08:24 | |
*** simon-AS559 has quit IRC | 08:24 | |
*** simon-AS559 has joined #openstack-operators | 08:37 | |
*** simon-AS5591 has joined #openstack-operators | 08:39 | |
*** yprokule has joined #openstack-operators | 08:40 | |
*** simon-AS559 has quit IRC | 08:41 | |
*** damien_r has joined #openstack-operators | 08:45 | |
*** racedo has joined #openstack-operators | 08:51 | |
*** markvoelker has quit IRC | 09:08 | |
*** arif-ali has quit IRC | 09:10 | |
*** slaweq_ has joined #openstack-operators | 09:11 | |
*** slaweq_ has quit IRC | 09:15 | |
*** vijaykc4 has quit IRC | 09:17 | |
*** arif-ali has joined #openstack-operators | 09:40 | |
*** derekh has joined #openstack-operators | 09:42 | |
*** JinVan_ has quit IRC | 09:54 | |
*** kristaps__ has quit IRC | 10:02 | |
*** threestrands has joined #openstack-operators | 10:21 | |
*** tuanla____ has quit IRC | 10:55 | |
*** markvoelker has joined #openstack-operators | 11:08 | |
*** AlexeyAbashkin has quit IRC | 11:18 | |
*** AlexeyAbashkin has joined #openstack-operators | 11:18 | |
*** d0ugal has quit IRC | 11:39 | |
*** markvoelker has quit IRC | 11:42 | |
*** d0ugal has joined #openstack-operators | 11:57 | |
*** vijaykc4 has joined #openstack-operators | 12:18 | |
*** markvoelker has joined #openstack-operators | 12:39 | |
*** makowals has quit IRC | 12:57 | |
*** makowals has joined #openstack-operators | 12:59 | |
*** kristaps__ has joined #openstack-operators | 13:10 | |
*** markvoelker has quit IRC | 13:12 | |
*** makowals has quit IRC | 13:39 | |
*** makowals has joined #openstack-operators | 13:43 | |
*** simon-AS559 has joined #openstack-operators | 13:46 | |
*** simon-AS5591 has quit IRC | 13:48 | |
*** markvoelker has joined #openstack-operators | 14:10 | |
*** VW has joined #openstack-operators | 14:25 | |
*** VW has quit IRC | 14:25 | |
*** VW has joined #openstack-operators | 14:26 | |
*** mriedem has joined #openstack-operators | 14:38 | |
*** markvoelker has quit IRC | 14:43 | |
*** markvoelker has joined #openstack-operators | 14:51 | |
*** markvoelker has quit IRC | 15:03 | |
mriedem | klindgren_: did you ever report a nova bug about the compute hitting the placement aggregates API unnecessarily? | 15:15 |
*** aluria has quit IRC | 15:22 | |
*** aluria has joined #openstack-operators | 15:22 | |
*** vijaykc4 has quit IRC | 15:30 | |
*** vijaykc4 has joined #openstack-operators | 15:35 | |
*** Apoorva has joined #openstack-operators | 15:37 | |
*** markvoelker has joined #openstack-operators | 15:37 | |
*** kristaps_ has joined #openstack-operators | 15:57 | |
*** kristaps__ has quit IRC | 16:00 | |
*** mfisch` has joined #openstack-operators | 16:06 | |
*** mfisch has quit IRC | 16:10 | |
*** chito_ has joined #openstack-operators | 16:13 | |
*** markvoelker has quit IRC | 16:19 | |
*** markvoelker has joined #openstack-operators | 16:22 | |
*** markvoelker has quit IRC | 16:27 | |
*** chyka has joined #openstack-operators | 16:31 | |
*** d0ugal has quit IRC | 16:46 | |
*** racedo has quit IRC | 16:48 | |
*** gyee has joined #openstack-operators | 16:54 | |
*** AlexeyAbashkin has quit IRC | 16:55 | |
*** liverpooler has joined #openstack-operators | 16:57 | |
*** Apoorva has quit IRC | 17:01 | |
*** yprokule has quit IRC | 17:04 | |
*** damien_r has quit IRC | 17:11 | |
*** pcaruana has quit IRC | 17:11 | |
*** harlowja has joined #openstack-operators | 17:16 | |
*** chyka has quit IRC | 17:18 | |
*** chyka has joined #openstack-operators | 17:19 | |
*** mfisch` has quit IRC | 17:23 | |
klindgren_ | mriedem, I did not - I can though | 17:30 |
*** breton has quit IRC | 17:31 | |
mriedem | i created one | 17:31 |
mriedem | https://bugs.launchpad.net/nova/+bug/1742467 | 17:32 |
openstack | Launchpad bug 1742467 in OpenStack Compute (nova) "Compute unnecessarily gets resource provider aggregates during every update_available_resource run" [Medium,Triaged] | 17:32 |
*** simon-AS559 has quit IRC | 17:37 | |
klindgren_ | Awesome | 17:38 |
*** zerick has joined #openstack-operators | 17:39 | |
*** zerick has quit IRC | 17:41 | |
*** zerick has joined #openstack-operators | 17:42 | |
*** penick has joined #openstack-operators | 17:43 | |
*** zerick has quit IRC | 17:45 | |
*** zerick has joined #openstack-operators | 17:46 | |
*** gkadam has quit IRC | 17:47 | |
*** chito_ has quit IRC | 17:56 | |
*** arif-ali has quit IRC | 17:57 | |
*** derekh has quit IRC | 18:00 | |
*** Apoorva has joined #openstack-operators | 18:00 | |
*** Apoorva has quit IRC | 18:00 | |
*** Apoorva has joined #openstack-operators | 18:01 | |
*** openstack has joined #openstack-operators | 18:31 | |
*** ChanServ sets mode: +o openstack | 18:31 | |
*** AlexeyAbashkin has joined #openstack-operators | 18:31 | |
*** B_Smith has joined #openstack-operators | 18:31 | |
*** B_Smith_ has quit IRC | 18:33 | |
*** AlexeyAbashkin has quit IRC | 18:35 | |
*** tesseract has quit IRC | 18:36 | |
*** harlowja has quit IRC | 18:37 | |
*** TxGirlGeek has joined #openstack-operators | 18:55 | |
*** vijaykc4 has quit IRC | 19:08 | |
*** simon-AS559 has joined #openstack-operators | 19:11 | |
*** vijaykc4 has joined #openstack-operators | 19:12 | |
*** harlowja has joined #openstack-operators | 19:13 | |
*** harlowja_ has joined #openstack-operators | 19:16 | |
*** harlowja has quit IRC | 19:19 | |
*** thingee has quit IRC | 19:23 | |
*** thingee has joined #openstack-operators | 19:28 | |
*** breton has joined #openstack-operators | 19:30 | |
*** Apoorva_ has joined #openstack-operators | 19:32 | |
*** Apoorva has quit IRC | 19:34 | |
*** dbecker_ has quit IRC | 19:38 | |
*** vijaykc4 has quit IRC | 19:42 | |
*** penick has quit IRC | 19:43 | |
*** zerick has quit IRC | 19:51 | |
*** zerick_ has joined #openstack-operators | 19:51 | |
*** chito_ has joined #openstack-operators | 20:08 | |
*** slaweq has joined #openstack-operators | 20:09 | |
*** chito_ has quit IRC | 20:12 | |
klindgren_ | mriedem, just wanted to let you know that I got a pike cellsv2 cloud working. Also with routed network creating segments within nova and placement of those resources working correctly. Right now its a cell of 1 compute node. but.... it works. | 20:38 |
klindgren_ | All without any local patches. | 20:39 |
mriedem | klindgren_: nice! | 20:41 |
mriedem | dansmith: ^ | 20:41 |
dansmith | um | 20:41 |
mriedem | klindgren_: are you doing routed networks with the deferred IP allocation stuff? | 20:41 |
dansmith | one cell of one compute? | 20:41 |
dansmith | or multiple cells with one compute each? | 20:41 |
mriedem | dansmith: yes, it's single node devstack, but... | 20:41 |
klindgren_ | actaully its deploying kolla containers using custom ansible stuff we wrote... | 20:42 |
dansmith | I'm just saying, I'll believe all the networking stuff works when it's multiple cells | 20:42 |
klindgren_ | I have a few more computes to add and going to define another cell. But starting small... | 20:44 |
*** chyka has quit IRC | 20:49 | |
*** chyka has joined #openstack-operators | 20:50 | |
*** chyka has quit IRC | 20:59 | |
*** chyka_ has joined #openstack-operators | 20:59 | |
*** AlexeyAbashkin has joined #openstack-operators | 21:00 | |
*** chito_ has joined #openstack-operators | 21:02 | |
*** AlexeyAbashkin has quit IRC | 21:04 | |
*** Apoorva_ has quit IRC | 21:15 | |
*** Apoorva has joined #openstack-operators | 21:16 | |
klindgren_ | @dansmith is their something specific you would like to see to confirm that it works? | 21:21 |
klindgren_ | argh slack has runied me... | 21:23 |
klindgren_ | dansmith, ^ | 21:23 |
*** pcaruana has joined #openstack-operators | 21:42 | |
*** pcaruana has quit IRC | 21:43 | |
klindgren_ | mriedem, I was noticing that during a cellv2 setup, that if you are using a list of rabbitmq hosts in the transport_url that when it does the cell add stuff (nova-manage cell_v2 create cell) without the transport-url defined on the command line. it only adds one of the rabbitmq servers that are defined in the url? I assume its one that it randomly selects from the list. Is this expected? | 21:49 |
*** threestrands_ has joined #openstack-operators | 21:52 | |
mriedem | i wouldn't say it's expected | 21:53 |
*** threestrands_ has quit IRC | 21:53 | |
*** threestrands_ has joined #openstack-operators | 21:53 | |
mriedem | klindgren_: this is an older bug too that i never was able to figure out https://bugs.launchpad.net/nova/+bug/1717915 | 21:54 |
openstack | Launchpad bug 1717915 in oslo.messaging "nova services and transport_url, cannot connect to vhost if specified" [Undecided,New] | 21:54 |
*** threestrands has quit IRC | 21:54 | |
klindgren_ | we had a related issue in cellsv1 where the rabbitmq host list was set to a 255 character limit. | 21:54 |
klindgren_ | which was awesome when it would just drop anything after 255 characters... | 21:55 |
klindgren_ | only hada few outages due to that one | 21:55 |
mgagne | ouch :-/ | 21:55 |
mriedem | you'll be happy to know you get a TEXT field for the db and mq urls in the cell_mappings table :)_ https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api_models.py#L118 | 21:55 |
*** chyka_ has quit IRC | 21:57 | |
*** chito_ has quit IRC | 21:57 | |
*** chito_ has joined #openstack-operators | 21:57 | |
*** masber has joined #openstack-operators | 22:02 | |
*** jamespd has quit IRC | 22:10 | |
*** jamespd has joined #openstack-operators | 22:11 | |
*** rcernin has joined #openstack-operators | 22:11 | |
*** threestrands_ has quit IRC | 22:41 | |
*** VW_ has joined #openstack-operators | 22:46 | |
*** slaweq has quit IRC | 22:47 | |
*** VW has quit IRC | 22:50 | |
*** VW_ has quit IRC | 22:50 | |
*** threestrands has joined #openstack-operators | 22:55 | |
*** chito_ has quit IRC | 22:56 | |
*** racedo has joined #openstack-operators | 22:59 | |
*** threestrands has quit IRC | 23:11 | |
*** racedo has quit IRC | 23:14 | |
*** threestrands has joined #openstack-operators | 23:20 | |
*** haint has quit IRC | 23:41 | |
*** liverpooler has quit IRC | 23:44 | |
*** ckonstanski has quit IRC | 23:49 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!