Tuesday, 2016-04-19

*** yingjun has joined #openstack-searchlight00:00
*** bpokorny_ has joined #openstack-searchlight00:25
*** bpokorn__ has joined #openstack-searchlight00:26
*** bpokorny_ has quit IRC00:26
*** bpokorny has quit IRC00:29
*** bpokorn__ has quit IRC00:42
*** bpokorny has joined #openstack-searchlight00:43
*** bpokorny_ has joined #openstack-searchlight01:01
*** bpokorny has quit IRC01:05
*** bpokorny_ has quit IRC01:06
*** bpokorny has joined #openstack-searchlight01:30
*** bpokorny has quit IRC01:33
*** bpokorny has joined #openstack-searchlight01:33
*** bpokorny has quit IRC05:35
*** pcaruana has joined #openstack-searchlight07:16
*** pcaruana has quit IRC07:23
*** yingjun has quit IRC09:38
*** yingjun has joined #openstack-searchlight11:21
*** khushbu_ has joined #openstack-searchlight12:55
*** openstackstatus has joined #openstack-searchlight13:38
*** ChanServ sets mode: +v openstackstatus13:38
-openstackstatus- NOTICE: We have recovered one of our cloud providers, but there is a huge backlog of jobs to process. Please have patience until your jobs are processed13:40
*** khushbu_ has quit IRC13:55
*** sigmavirus24_awa is now known as sigmavirus2414:01
*** yingjun has quit IRC14:08
*** yingjun has joined #openstack-searchlight14:09
*** sjmc7_ has quit IRC14:13
*** yingjun has quit IRC14:13
*** sjmc7 has joined #openstack-searchlight14:13
sjmc7TravT: got a sec?15:08
TravTsjmc7 hello15:20
sjmc7i was idly thinking about adding a ‘total’ count to the facet response (which would solve brian’s request in https://blueprints.launchpad.net/searchlight/+spec/count-endpoint) but the /facets endpoint returns a dict {“resource type”: [facets]} which doesn’t lend itself well to that15:21
TravToh interesting... i had opened a BP on this last night.15:22
sjmc7on the fence about a breaking API change versus a new endpoint for it15:22
TravTi forgot about this one.15:22
sjmc7hahaha15:22
TravThttps://blueprints.launchpad.net/searchlight/+spec/resource-summary15:22
TravTi'll close that one.15:23
sjmc7:)15:23
TravTokay, let me think about this for a second...15:23
sjmc7including it in facets seems neat (maybe allow flags to turn off one or the other) but would mean a breaking change to that API15:23
sjmc7could also add a new endpoint that could include the facet payload. or just keep them separate15:24
TravTyeah, including in the full facets output also was something i pondered....15:27
TravTif we really don't want to break that output, there could be a special facet15:28
TravTeg doc_count is just a facet15:28
TravTbut that's kinda weird15:28
sjmc7yeah, that seems nasty15:28
TravTi'm trying out a few requests against API to refresh my memory... just a sec15:29
sjmc7i’d probably vote against adding it to /plugins because that information’s meant to be more static15:31
TravTi don't know if it is magnum, but my devstack is barely responding to me. sorry, just a sec15:31
sjmc7your computer has gremlins15:31
TravTso15:36
TravTunless i'm doing something wrong here15:36
TravTit seems that the current facets aren't limited based on all projects or not?15:37
sjmc7umm… that shouldn’t be the case15:37
TravTlet me re-issue token15:37
TravTand try again15:38
TravTi probably horked it15:38
TravTyep, i did15:39
TravTso, if we left in existing facets15:39
TravT1) break api like you said and maybe go with nested structure15:40
TravT2) add a special facet for count15:41
TravT3) add a "summary" as a peer to the resource types15:41
sjmc7for 1) i’d go with {“rt”: {“facets”: [facets], “count”: 10}15:41
sjmc7for 3) i’d go with something like you had in the dupe BP15:41
sjmc7doing it as part of facets seems like it fits best15:41
TravTthere is a downside to it15:42
TravTall i have to go on is the current interaction i built into the ui.15:42
TravTbut15:42
TravTright now, i can just get plugins15:42
TravTand i don't request facets until a specific one is chosen15:42
sjmc7ah, interesting15:43
TravTif we were to support showing doc count in say the type dropdown15:43
sjmc7in my head i imagined that type was just another facet, but that makes sense15:43
TravTeg. type -> instances (42), images (32), etc15:43
TravTthis requires doing a full facet hit on every single type proactively15:44
sjmc7though perhaps if it were part of /facets you’d request /facets?include_fields=false and then /facets?doc_type=OS::Glance::Image15:44
*** khushbu has joined #openstack-searchlight15:45
TravTin some ways this may negate needing to call the "plugins" endpoint at all15:45
sjmc7yeah, it would in that case15:45
sjmc7although in my head the parent/child type stuff belongs there15:46
sjmc7the more static stuff you could reasonably cache for ages15:46
TravTyeah, that's what happens right now15:46
sjmc7so let’s keep that distinction15:46
sjmc7question i guess is whether a separate ‘summary’ kind of endpoint might include other useful stuff that wouldn’t make sense under ‘facets'15:47
TravTi also keep facets for a specific resource type cached until you completely remove that resource type from the selection.15:47
TravTif you re-select that type, i hit the facets api again15:47
sjmc7yeah, that’s fine. the total doc_count is pretty tied to the facet counts15:47
TravTyeah, that's a good question15:48
sjmc7ideally 2+2 should equal 415:48
TravTa summary endpoint might eventually contain many useful queries...15:49
TravTbut then if they get too customized, just exposing aggregations directly may make sense15:49
TravTbut since we abstract resource types, i'm not too sure about that15:49
sjmc7yeah, i think there’s an argument for that too15:49
sjmc7i still think a total count makes sense in /facets15:49
sjmc7it’s very related15:50
*** lakshmiS has joined #openstack-searchlight15:51
sjmc7if we’re gonna break the API now would be the time to do it :)15:51
TravTwell, we'll have to update the python client and the ui15:51
sjmc7yeah. a halfway option would be to add a flag to use the ‘new’ behavior15:52
sjmc7and deprecate it through this release15:52
TravTor we could use microversions15:52
* TravT shudders15:52
sjmc7:(15:52
*** khushbu has quit IRC15:53
sjmc7mental note: never return flat lists from APIs :)15:53
TravTi could say a summary flag15:53
TravTyeah, alway objectify15:53
TravTs15:53
sjmc7yeah, maybe a flag is the best compromise15:54
sjmc7we can immediately mark it as deprecated15:54
TravTfacets?summary=true&fields=false15:54
TravTso, leave as is15:54
TravTbut when summary is a flag15:54
TravTadd a "summary": {'resource_type': {'count': 29)}15:55
TravTto the top level15:55
TravTor just add a summary to each facet15:55
TravToops15:55
TravTthat would break it to add to each facet15:55
sjmc7{“rt”: {“count”: 29, “facets”: []}}15:55
*** khushbu_ has joined #openstack-searchlight15:56
TravT{“rt”: {"summary": {“count”: 29}, “facets”: []}}15:56
sjmc7maybe call it ?totals, but if either is specified use the object response. it’s a little bit nasty smelling but at least it’s backward compat15:56
*** bpokorny has joined #openstack-searchlight15:57
TravTif we were to just break it. now is the time, but I think we'd want the include_fields=false in any event15:58
TravTi *think* the current way I do it above makes sense for a performance standpoint and data currency standpoint15:59
TravTonly get the full facets for a type when requested.15:59
sjmc7yeah15:59
sjmc7ok. let’s leave the current behavior if no flags are specified just for this release but modify the client and UI to the new behavior; after that we’ll switch to the dictionary response in all cases16:00
TravTi was thinking about horizon overview pane as well and thinking it would be great it searchlight could provide a lot of the summary16:00
sjmc7yep, that’s where brian was coming from16:00
TravTlet's see from the client perspective16:00
TravTopenstack search facet list --summary16:01
TravTthat doesn't ring quite as nice as openstack search summary16:01
sjmc7no. but the new default would be to include it16:03
sjmc7you could specify —no-fields to get the short version16:03
TravTahh, opposite it16:04
sjmc7i guess i’m branding it as a facet count for the type rather than a separate piece of information16:04
TravTit does seem like a piece of metadata16:06
TravTthat seems reasonable.16:06
TravTthere is a "total" piece of metadata on all query requests today16:07
sjmc7ok. let’s go with that16:07
TravTyeah, that works for me.16:07
*** khushbu_ has quit IRC16:24
sjmc7no responses about elasticsearch 2 yet16:58
TravTthis is a tough week.17:01
TravTpeople going to the summit are usually running around with their hair on fire17:01
sjmc7i shall light mine ceremonially on friday17:02
TravTlol.17:02
TravTi'd be happy to do that for you when you arrive, if you'd like17:02
sjmc7oopa!17:02
openstackgerritMerged openstack/searchlight: Fix unicode error when booting instance from volume  https://review.openstack.org/30621717:15
*** bpokorny has quit IRC19:00
*** sigmavirus24 is now known as sigmavirus24_awa19:06
openstackgerritLakshmi N Sampath proposed openstack/searchlight-specs: WIP: Policy driven RBAC  https://review.openstack.org/30801019:34
*** sigmavirus24_awa is now known as sigmavirus2420:06
*** bpokorny has joined #openstack-searchlight20:30
openstackgerritLakshmi N Sampath proposed openstack/searchlight-specs: WIP: Policy driven RBAC  https://review.openstack.org/30801020:58
*** jaimguer has quit IRC21:17
*** lakshmiS has quit IRC21:19
*** sigmavirus24 is now known as sigmavirus24_awa22:02
openstackgerritTravis Tripp proposed openstack/searchlight: Add cleanup in functional tests  https://review.openstack.org/29515622:06
*** yingjun has joined #openstack-searchlight23:05
*** david-lyle_ has joined #openstack-searchlight23:14
*** david-lyle has quit IRC23:14
*** yingjun has quit IRC23:32
*** yingjun has joined #openstack-searchlight23:33
*** yingjun has quit IRC23:37
*** david-lyle_ is now known as david-lyle23:57
*** lakshmiS has joined #openstack-searchlight23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!