Tuesday, 2015-11-10

*** lei-zh has joined #openstack-searchlight01:06
openstackgerritTravis Tripp proposed openstack/searchlight: Zero Downtime Reindexing Proposal  https://review.openstack.org/24338601:55
*** bpokorny_ has joined #openstack-searchlight02:14
*** bpokorny has quit IRC02:17
*** bpokorny_ has quit IRC02:18
*** flwang has quit IRC02:25
*** yingjun has joined #openstack-searchlight03:35
*** david-lyle has joined #openstack-searchlight04:07
*** akanksha_ has joined #openstack-searchlight04:15
*** lei-zh has quit IRC04:40
*** bpokorny has joined #openstack-searchlight05:02
*** bpokorny has quit IRC05:32
*** yingjun has quit IRC05:46
*** yingjun has joined #openstack-searchlight05:46
*** yingjun has quit IRC05:47
*** yingjun has joined #openstack-searchlight05:51
yingjunping TravT05:53
*** ig0r__ has quit IRC06:05
*** ig0r__ has joined #openstack-searchlight06:09
*** lei-zh1 has joined #openstack-searchlight06:19
*** itisha has joined #openstack-searchlight06:57
*** gb21 has quit IRC07:20
*** gb21 has joined #openstack-searchlight07:32
*** openstackgerrit has quit IRC07:46
*** openstackgerrit has joined #openstack-searchlight07:47
*** akanksha_ has quit IRC07:58
*** TravT has quit IRC08:25
*** openstackgerrit has quit IRC08:31
*** openstackgerrit has joined #openstack-searchlight08:32
openstackgerritLi Yingjun proposed openstack/searchlight: OS::Glance::Metadefs to OS::Glance::Metadef  https://review.openstack.org/24345808:45
openstackgerritLi Yingjun proposed openstack/searchlight: Fix Internal Server Error when query isn't specified  https://review.openstack.org/24347809:18
*** yingjun has quit IRC09:35
*** yingjun has joined #openstack-searchlight09:35
*** yingjun_ has joined #openstack-searchlight09:35
*** yingjun has quit IRC09:40
*** yingjun_ has quit IRC09:40
*** lei-zh1 has quit IRC10:04
*** lei-zh has joined #openstack-searchlight10:04
*** TravT has joined #openstack-searchlight10:08
*** nikhil_k has joined #openstack-searchlight10:29
*** nikhil has quit IRC10:30
*** lei-zh has quit IRC10:34
*** ig0r__ has quit IRC10:40
*** itisha has quit IRC11:21
*** vkmc has joined #openstack-searchlight11:41
*** yingjun has joined #openstack-searchlight12:00
*** gb21 has quit IRC12:03
*** gb21 has joined #openstack-searchlight12:36
*** gb21 has quit IRC12:37
*** gb21 has joined #openstack-searchlight12:53
*** gb21 has quit IRC12:53
*** gb21 has joined #openstack-searchlight13:10
*** gb21 has quit IRC13:10
yingjunping TravT14:05
*** tsufiev_ has quit IRC14:26
*** tsufiev has joined #openstack-searchlight14:30
*** sigmavirus24_awa is now known as sigmavirus2414:45
*** lakshmiS has joined #openstack-searchlight14:58
TravTyingjun: hello14:58
*** daddyjoseph97 has joined #openstack-searchlight14:59
yingjunHi, TravT, i’m trying searchlight, and find this Demo video https://youtu.be/eGnGr48E5_4, is there patch available?15:01
lakshmiSbriancline: TravT: sjmc7: ready for the meeting?15:03
sjmc7hey15:03
TravTyingjun: yes15:04
TravThttps://review.openstack.org/#/c/227036/15:04
TravTthat is on master15:04
TravTnot liberty15:04
TravTi do intend on publishing a liberty patch that people can use if needed.15:04
TravTlakshmiS: sjmc7: briancline: i'll be back in about 2 minutes.  just have to grab my cup of coffee15:06
TravTif briancline: arrives, go ahead and start chatting without me.15:06
TravTnikhil_k: FYI we were going to talk swift at this time.15:06
brianclinelakshmiS: yep15:06
TravTbrb15:06
lakshmiShey15:07
yingjunTrait, Okay, thanks15:07
yingjunTravT, Okay, thanks15:07
brianclinemorning15:07
daddyjoseph97morning15:07
lakshmiSbriancline: i started looking at all the possible data that could be stored in searchlight from swift15:08
daddyjoseph97<-- Jason Galyon, works with briancline at SoftLayer on Object Storage (swift)15:08
lakshmiShi daddyjoseph97:15:08
lakshmiSstarting with UserMetaData and SystemMetaData for Account, Container and Objects15:09
lakshmiSwhat else do you think we can index in searchlight?15:09
lakshmiSbriancline: ^15:10
brianclineI'd say content type, account name, container name, object path (within the container), object size, etag, timestamp15:10
brianclineI'm probably forgetting one or two others15:10
daddyjoseph97ACLs15:10
TravTmorning daddyjoseph9715:11
yingjuni uploaded 2 small patches,could any one have a look, thanks! https://review.openstack.org/243458, https://review.openstack.org/24347815:11
TravTyingjun: sure, will take a look later today15:11
lakshmiSdaddyjoseph97: ACL's sound good15:12
yingjunThanks TravT, and is anyone working on this bp: https://blueprints.launchpad.net/searchlight/+spec/openstack-client-search-initial-plugin ?15:12
TravTyingjun: no, i don't think so.15:12
brianclinelakshmiS: daddyjoseph97: also the type of entity.. so an account or container or object15:12
TravTyingjun: if you want to start working on it, that'd be great.15:13
lakshmiSregarding the usermetadata do you think there is any known set of properties that could be predefined?15:13
yingjunI’d like to:)15:13
TravTfirst thing is to come up with some more details on the proposal15:13
brianclinelakshmiS: I'd probably shy away from it -- we've seen a huge range of stuff that folks use, but I'm not sure how much overlap there's been15:14
daddyjoseph97lakshmiS: disabling dynamic type setting in Elasticsearch is important, otherwise that meta tag is doomed to what was initially guessed15:14
sjmc7something that we discussed after the preesntation in tokyo was that for the kinds of use cases being shown it’d be necessary to let deployers specify mappings for the kinds of metadata they knew about in their installation15:15
sjmc7maybe that’s a second step though after the basic information15:15
TravTyingjun: go ahead and assign that BP to yourself.  And then start putting in more details on proposed CLI on the BP.15:16
lakshmiSwithout dynamic type setting, every property has to be predefined15:16
sjmc7right15:16
yingjunTravT, Okay, will have a look first15:16
daddyjoseph97sjmc7: we've discussed that as well, for a range of anticipated meta keys, for example if we knew wanted a type to run aggregations on15:16
daddyjoseph97lakshmiS: yes, when we discussed that initially we settled on strings but then have exceptions as sjmc7 mentioned15:17
sjmc7yeah. and if there’re examples you know about where e-s does a bad job of guessing types, that would be a case for allowing them to be specified15:17
daddyjoseph97^^^ yes, especially WRT date and time data15:18
sjmc7i’d be happy getting something working with just the basics and expanding from there15:18
daddyjoseph97sjmc7: I don't have any use cases currently15:19
daddyjoseph97concur15:19
briancline+115:19
sjmc7and not to derail this, but my bigger concern is that we can’t get notifications at the moment15:19
lakshmiSright15:19
brianclinethat's the really fun part15:19
sjmc7:)15:19
daddyjoseph97briancline enjoys pain15:19
sjmc7i saw the zaqar patch, but it sounded like there was some dissent from cores about it15:19
sjmc7we also weren’t clear if there was still objection to oslo-messaging notifications15:20
brianclineyeah, sam didn't think it was ready, and didn't like affixing everything to tokens15:20
TravTbriancline: what is this about affixing everything to tokens?15:20
sjmc7yeah.. i think using zaqar for that would be tough for several reasons15:20
TravTi don't understand using zaqar as the default at all.15:20
brianclineI brought it up to them in chat last week, john thought it was an interesting question, but didn't get very far. I think it was too early for most everyone else to be around15:21
sjmc7TravT - that posting to a zaqar queue needs a token15:21
TravTright, because it is multi-tenant15:21
sjmc7the one you posted the object to swift with might expire/not be scoped for zaqar15:21
sjmc7so then you get into trusts15:21
TravTso you can't use service accounts?15:22
sjmc7it’s not insurmountable, but it is a different use case than for oslo-messaging15:22
TravTbriancline: daddyjoseph97: was zaqar something that the swift team initially wanted instead of oslo?15:22
brianclineyeah, i think the zaqar use case they're after (but didn't clearly define in the spec) was that the notifications should be tenant-consumable15:22
sjmc7right, that might be a solution. btu it’s more complex than the original patch15:22
TravTbriancline: ah, ok. i understand that use case.15:23
sjmc7yeah.. so that particular patch isn’t useful to our (searchlight)’s case, and actually that use case was discussed more widely since it’s useful for lots of services to do that15:23
brianclineTravT: yes, in vancouver they were thinking more about zaqar, partially wanting to be opinionated about it (in the same way they are about statsd, which I didn't feel like was a very fair comparison)15:23
sjmc7i suppose the question is, if we proposed a swift middleware for oslo notifications, would that just be a no-go from the start? and if so, are there other options?15:24
brianclineTravT: but what's strange is all the use cases we were coming up with (metadata search notifications, notifications to backend pieces for tiering/archiving older objects, etc), were all non-tenant facing15:24
sjmc7briancline - what’s been the position on metering in swift in the past? this was normally the driver for notifications15:24
brianclinesjmc7: they'll probably say the spec needs reworking first because it mentions using Zaqar, though not so much as an all-out requirement if memory serves15:25
lakshmiSbriancline: can you post the link to the spec15:25
brianclinesjmc7: it depends on who you ask, in my experience. some say out of band tools like slogging, others say use the ceilometer middleware to emit those15:25
sjmc7well, maybe a second spec15:25
sjmc7i wouldn’t want to get caught in a war between tenant and non-tenant notifications. there’s possibly a case for both15:26
brianclinelakshmiS: http://specs.openstack.org/openstack/swift-specs/specs/in_progress/notifications.htmlb15:26
brianclinesjmc7: yeah, there definitely is. I could see that being a separate spec15:27
sjmc7yeah, that spec doesn’t really match the patch15:27
brianclineI am quite sure that once you get into it, they'll certainly complain about the dependency chain that oslo.messaging introduces. but a lot of those are already there if someone is using keystone15:27
sjmc7yeah, i saw your comment about that last week - could you elaborate a bit?15:28
TravTbriancline: do you have to original gerrit review, so we can see the comments on it15:28
brianclinesure, one sec15:28
TravTfunny that they'd be okay with hard dependency on zaqar but not oslo messaging which is an abstraction layer15:29
brianclineTravT: https://review.openstack.org/#/c/180914/15:29
TravTthanks... looking15:30
sjmc7given that spec’s approved, and has a patch up, a second one (specifying notifications in the system sense) makes sense to me15:30
brianclinesjmc7: I couldn't speak for most of them, but I've seen it come up before - strong aversion to additional dependencies. and late adopters to much of anything oslo. probably some history there I don't know15:30
sjmc7the problem being… that then has to get approved15:31
brianclineyeah15:31
sjmc7wow - swift’s requirements file is really short!15:31
lakshmiSthere was some mention of batching up of notifications but nothing concrete. that would  be really usefull for performance15:32
daddyjoseph97lakshmiS: I am interested in that, any docs or discussion available?15:33
lakshmiSi was looking at line 35 in the spec which mentions of batch but that was for reading from log files.15:34
lakshmiSbut it would be nice to group the updates when sending notifications as an config option15:34
TravTbriancline: this spec actually seems to have gone through pretty smoothly... not that many comments and revisions.15:34
TravTis that because there were lots of side conversations?15:35
daddyjoseph97concur, we have discussed also the need to be adaptive to rate of write operations (and thus notifications) of a given account or even container or object15:35
lakshmiSsomehow spec didnt capture that but hoping that comes up in the patch15:36
brianclineTravT: yeah, I was a little surprised. had I known how the patch would have turned out, I would have probably been a bit more critical15:37
brianclineTravT: I think it was mostly because there were so few interested parties15:37
lakshmiSso is there a review patch up for code or still being developed?15:37
TravTi'm kinda surprised john dickinson didn't comment15:37
TravThe spoke to me 2 - 3 times in vancouver about doing searching in searchlight15:38
brianclinelakshmiS: https://review.openstack.org/#/c/196755/15:38
brianclineTravT: same here, I had a discussion with him in Tokyo and he mentioned he was going to try to come to the searchlight session that I came to, but must have gotten tied up in a swift discussion15:39
TravTthere's a comment in there basically about accepting lossy messaging.15:40
sjmc7regarding dependencies, it looks like (for instance) keystonemiddleware is installed as an optional component if you want to use it (which i imagine most people do unless they’re running a swift-only install), so adding an oslo-messaging dependency in the same way might be moot - if you want it, install it, if not, don’t15:40
TravTsjmc7: that's what I was thinking as well.15:41
*** gb21 has joined #openstack-searchlight15:41
*** gb21 has quit IRC15:41
brianclinesjmc7: +115:41
TravTbriancline: daddyjoseph97: seeing your patch is helping me to start piece the puzzle together.  thanks for baring with us as we come up to speed on your work so far15:41
daddyjoseph97sjmc7: +115:41
brianclinethat's another reason why I was hoping the notification middleware would be a bit more driver-focused15:42
brianclineno problem. also, I should say this isn't my patch ;)15:42
daddyjoseph97a hearty 'not mine' from me as well15:42
TravTokay...15:43
TravTlooking at https://review.openstack.org/#/c/196755/7/swift/common/middleware/notifications.py15:43
TravTit is kind of funny.15:44
TravTit is a reverse driver15:44
TravT"we define message format and messaging system must conform"15:44
brianclineTravT: yeah :-/  I wasn't too crazy about that15:44
TravTor am i skimming that wrong?15:44
brianclineI would rather have the serialization been pluggable so long as a well structured dict is passed in, then have the transport layer do whatever it needs with that payload15:45
sjmc7it requires that the “driver” accept HTTP requests and understand this format15:45
TravTbriancline: that makes more sense to me.15:45
sjmc7yes, me too. but again, i think the case for using zaqar notificaitons versus system ones is quite different15:45
brianclinesjmc7: yeah, I took more issue with the strict HTTP requirement15:45
sjmc7it’s not just a different backend15:45
brianclinenot that it's a bad thing, but that will add a *lot* of connection churn for really busy swift proxies15:46
lakshmiSthere's one thing on consistency of sending notifications. if there are no free threads notifications are not guaranteed15:46
sjmc7my preference if we were to propose a patch would be to make it specific to oslo15:47
brianclinecould always hold keepalive connections open in each proxy worker, but still15:47
brianclinesjmc7: yeah, same here15:47
TravT+115:47
sjmc7i guess my question is still if we were to propose a patch (maybe under that existing spec) would it stand any chance of acceptance, even as optional?15:47
TravTI think a patch proposed that makes oslo optional makes sense15:48
sjmc7because if the answer to that is no, there’s really little we can do15:48
lakshmiSgoing by the code it doesnt look like a lot to generate notifications for oslo15:48
sjmc7lakshmiS - no, it’s specific to zaqar15:48
TravTi really don't like that patch at all.15:49
sjmc7we could also perhaps request they rename the file in that patch15:49
lakshmiSi guess neeed to understand it more15:49
TravTbriancline: who is the patch author? is he a core or something on swift?15:50
sjmc7the other option is something out of tree that deployers can install if they want it, i guess15:50
brianclineTravT: that's christian schwede from redhat, he's a core15:50
TravTok, good to know.15:51
brianclinesjmc7: yeah, that's been a backup plan I've come to terms with if it needs to go there15:52
TravTi'm open to hosting an external plugin in searchlight if needed.15:52
TravTjust make it part of the integration instructions15:52
brianclineI think it stands some chance, though. I'd certainly get behind it. maybe a good discussion topic during their weekly meeting?15:52
sjmc7yep. that would be step 1, i think. the searchlight side of things is simple, at least for that basic information15:53
sjmc7performance, metadata, initial indexing etc have some wrinkly bits15:53
brianclineright15:55
lakshmiSwe could chat with christian to see if he is interested in author/coauthoring on oslo patch15:56
lakshmiSwhich might lead to discussion on swift weekly meeting15:56
TravThttp://eavesdrop.openstack.org/#Swift_Team_Meeting15:57
*** gb21 has joined #openstack-searchlight15:57
*** gb21 has quit IRC15:57
lakshmiSreally odd timing for me15:58
brianclinein the mean time can we help get some of the specifics documented on fields to index and some of the other stuff we've talked about? maybe in wiki? or somewhere in the repo?15:59
TravTok, maybe we need to summarize things here.16:00
daddyjoseph97+116:00
TravTI think we can start on etherpad, perhaps16:00
TravTso we can all work together16:00
TravThttps://etherpad.openstack.org/p/searchlight-swift-workpad16:00
lakshmiSyeah starting with what we talked about today on data16:00
lakshmiSi will add those items there16:00
TravTRegarding the ability to map data16:01
TravTthe need to allow mapping definitions for user metadata is not exclusive to swift16:01
TravTi think we can have a BP just on that16:01
sjmc7yep16:02
TravTbecause glance images, cinder volumes, instances, etc all also have user metadata16:02
TravTso we should come up with a common way to do that.16:02
daddyjoseph97I am very interested in how you previously handled sysmeta indexing, specifically restricted access to it for tenants16:02
lakshmiSthats the tricky part on RBAC16:03
sjmc7we record the project-id in the index16:03
TravTdaddyjoseph97: https://www.youtube.com/watch?v=0jYXsK4j26s16:03
TravTmaybe watch that later16:03
daddyjoseph97excellent, thanks16:03
TravTthat gives intro16:04
TravTand then we have several BPs this release related to improving admin field searching16:04
lakshmiSi guess next task for me is to get a patch up on initial indexing of data mentioned on the etherpad16:05
lakshmiSusing REST api16:05
*** yingjun has quit IRC16:06
*** yingjun has joined #openstack-searchlight16:06
TravTYeah that wouldn't hurt.16:06
lakshmiSnotifications will slow us down from any real usage of the data though but will be good to have something16:07
TravTWell, we can start looking at some concrete cases16:07
daddyjoseph97what about an option for a notification to actually have payload?16:08
TravTdaddyjoseph97: that is the desired state16:08
lakshmiSso the notifications dont have a payload now for zaqar?16:08
TravTfor incremental updates16:08
daddyjoseph97gotcha16:08
TravTwe have a couple concepts.16:08
TravTinitial indexing takes you from empty ES to and an ES with all the current data16:09
TravTnotifications are for keeping up to date.16:09
TravTand initial indexing is also used to re-index in the case that ES gets out of sync16:09
TravTwe have BP to improve on that this release which we need to work through.16:10
daddyjoseph97TravT, ok, good thing y'all are talking about that (btw, yes I am Texan). Backfilling has been a painful point for us16:10
*** yingjun has quit IRC16:11
TravTwould love your feedback on a BP related to that.16:11
*** yingjun has joined #openstack-searchlight16:11
TravTwe don't have specs repo right now, because we were trying to stay light weight, but launchpad is not good for tracking feedback.16:11
briancline...or much of anything else ;-)16:12
daddyjoseph97lol16:12
sjmc7yeah, i’m leaning heavily towards specs in git now16:12
TravTso this week, i'm toying with trying to do a hybrid model of sorts16:12
daddyjoseph97I held my tongue... (rare)16:12
TravThttps://review.openstack.org/#/c/243386/16:12
TravTthis will be a topic i put on this weeks searchlight agenda16:12
TravTmaybe trying to do a specs repo of sorts in our own documentation in our repo16:13
TravTstill need to bake on that idea a bit more16:13
*** gb21 has joined #openstack-searchlight16:14
TravTok, back to summary16:14
TravTlakshmiS: will put up an initial patch for doing base indexing16:15
TravTdoes somebody want to file a BP on allowing mapping files for user metadata or do you want me to go ahead and do that?16:15
* TravT also has some things to put in there related to glance metadata catalog.16:16
TravTwe need to follow up with swift team relating to OSLO notifications.16:16
daddyjoseph97TravT, I haven't filed a BP before but would be happy to work with you on one16:17
TravTdaddyjoseph97: that'd be great.  Very easy at the moment.16:17
sjmc7i’m happy to follow up about notifications16:17
sjmc7or at least turn up to a swift meeting and provide support16:18
lakshmiSsjmc7: that would be a great since its in the middle of night for me from india16:18
TravTbriancline: daddyjoseph97: how do you want to work together on swift team?16:18
brianclineTravT: I'll get something added to their agenda for tomorrow's meeting to discuss16:19
TravTok, cool. then the rest of us can show up in support16:19
TravTi was considering adding a comment -1 on that current patch16:20
brianclineTravT: unless we want to let some of the details brew for a week and try next week instead. but sounds like we have plenty to work with right now16:20
brianclineyeah, I've got a few comments drafted on it I need to submit along with a -1 as well16:20
TravTI think we might as well get the conversation going16:20
sjmc7no, let’s do it now16:20
brianclineworks for me16:20
TravTit can take awhile to get the wheels rolling in openstack and people rarely agree immediately on things.16:21
TravTso best to just get conversations going.16:21
daddyjoseph97action item: get addresses to send bribes to, check16:21
TravTlol16:21
lakshmiS:)16:21
brianclineagreed16:22
TravTdaddyjoseph97: i can put up initial BP and then you add to it or i can step you through getting one up and i'll add to it?  whichever way you like16:22
TravTfor user metadata data mapping16:23
TravTBTW: this is the BP in searchlight for swift: https://blueprints.launchpad.net/searchlight/+spec/swift-plugin16:25
daddyjoseph97TravT, I'll opt for help with submitting an initial one and you add to it :)16:26
TravTok, super easy.16:26
TravTjust go to here:16:26
TravThttps://blueprints.launchpad.net/searchlight16:26
TravTclick register blueprint16:26
TravTuse this as template16:27
TravThttps://blueprints.launchpad.net/searchlight/+spec/searchlight-blueprint-template16:27
TravTat least until / if we move to spec repo or something else16:27
daddyjoseph97Thanks, TravT16:28
nikhil_kTravT: thanks for the ping. I was however afk for a presentation and totally missed this :/16:29
TravTnikhil_k: only 90 minutes of IRC reading to do16:29
TravT;)16:29
nikhil_kTravT: haha, true16:30
*** bpokorny has joined #openstack-searchlight16:32
brianclinethanks for the discussion guys16:34
TravTyes, thank you! I'm really excited to get to work with everybody on this16:35
brianclinedefinitely excited here too :)16:35
lakshmiSthanks!16:36
daddyjoseph97thank you indeed :)16:41
daddyjoseph97laksmiS have a great sleep!16:41
daddyjoseph97lakshmiS: have a great sleep16:41
sjmc7thanks chaps16:41
*** yingjun has quit IRC16:49
*** lakshmiS has quit IRC16:50
*** itisha has joined #openstack-searchlight16:52
openstackgerritMerged openstack/searchlight: OS::Glance::Metadefs to OS::Glance::Metadef  https://review.openstack.org/24345817:08
*** rosmaita has quit IRC17:37
sigmavirus24sjmc7: did you see github.com/sigmavirus24/openstack-ansible-searchlight ?19:26
sjmc7i have a tab open with it that i got distracted from19:27
sjmc7i’ll take a look, though we don’t use openstack-ansible directly19:27
sjmc7it looks ok from a once-over. if i get some spare time i’ll try getting osa working19:32
sigmavirus24sjmc7: yeah I'd like to make it work without the rest of OSA19:44
sigmavirus24Just haven't had time to make it more self-contained19:44
sjmc7our deployments are ansible based but not OSA, so the tasks and config files’ll be somewhat similar but i don’t know how reusable19:45
*** itisha has quit IRC21:31
*** daddyjoseph97 has quit IRC21:36
*** gb21 has quit IRC22:04
*** gb21 has joined #openstack-searchlight22:19
*** nikhil_k has quit IRC22:33
*** nikhil has joined #openstack-searchlight22:33
*** tsufiev has quit IRC22:34
*** tsufiev has joined #openstack-searchlight22:37
*** bpokorny_ has joined #openstack-searchlight22:59
*** bpokorny has quit IRC23:03
*** sigmavirus24 is now known as sigmavirus24_awa23:29
*** bpokorny_ has quit IRC23:34
*** bpokorny has joined #openstack-searchlight23:35

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!