Tuesday, 2016-03-22

kfox1111interesting... they blocked poppy.00:00
*** toddjohn has quit IRC00:08
*** spzala has quit IRC00:19
*** kzaitsev_mb has quit IRC01:04
docaedoKind of makes sense to me since there's no way to test without 3rd party account01:39
openstackgerritSahdev Zala proposed openstack/app-catalog: TOSCA web changes  https://review.openstack.org/29537602:16
openstackgerritSahdev Zala proposed openstack/app-catalog: TOSCA web changes  https://review.openstack.org/29537602:18
*** kzaitsev_ws has quit IRC06:01
*** kzaitsev_ws has joined #openstack-app-catalog06:01
*** openstackgerrit has quit IRC08:33
*** openstackgerrit has joined #openstack-app-catalog08:34
*** pcaruana has joined #openstack-app-catalog08:40
*** kzaitsev_mb has joined #openstack-app-catalog10:51
*** kzaitsev_mb has quit IRC11:47
*** kzaitsev_mb has joined #openstack-app-catalog12:03
*** toddjohn has joined #openstack-app-catalog12:24
*** toddjohn has quit IRC12:50
*** toddjohn has joined #openstack-app-catalog13:39
*** rhagarty has joined #openstack-app-catalog13:54
*** toddjoh__ has joined #openstack-app-catalog13:55
*** toddjo___ has joined #openstack-app-catalog13:56
*** toddj____ has joined #openstack-app-catalog13:59
*** toddjohn has quit IRC13:59
*** toddjoh__ has quit IRC13:59
*** toddjo___ has quit IRC14:01
*** spzala has joined #openstack-app-catalog14:15
*** openstackgerrit has quit IRC14:33
*** openstackgerrit has joined #openstack-app-catalog14:34
openstackgerritSahdev Zala proposed openstack/app-catalog: TOSCA web changes  https://review.openstack.org/29537615:07
kfox1111yeah. I figured testing the plugin interface alone would probably be good enough, but I can see the argument.15:35
kfox1111I still think they should just come up with a very basic one that uses swift and gate on that. it would be good enough for a lot of use cases, and allow them in the door.15:36
kfox1111what do you guys think about the api suggestion I made a couple of days ago?15:36
openstackgerritSahdev Zala proposed openstack/app-catalog: TOSCA web changes  https://review.openstack.org/29537615:37
*** spzala has quit IRC15:38
*** spzala has joined #openstack-app-catalog15:39
*** spzala has quit IRC15:43
*** spzala has joined #openstack-app-catalog15:44
kfox1111hmmm... looks like every heat/murano asset has a release tag maybe....15:46
*** spzala has quit IRC15:49
*** spzala has joined #openstack-app-catalog15:54
*** spzala has quit IRC15:58
*** spzala has joined #openstack-app-catalog16:00
openstackgerritDmytro Dovbii proposed openstack/app-catalog: Update Docker Interfaces Library murano package  https://review.openstack.org/29592316:00
*** spzala has quit IRC16:04
*** spzala has joined #openstack-app-catalog16:05
*** spzala has quit IRC16:10
*** kzaitsev_mb has quit IRC16:11
*** spzala has joined #openstack-app-catalog16:11
*** kebray has joined #openstack-app-catalog16:14
*** spzala has quit IRC16:16
*** spzala has joined #openstack-app-catalog16:17
*** spzala has quit IRC16:22
*** spzala has joined #openstack-app-catalog16:23
*** toddj____ has quit IRC16:23
openstackgerritDmytro Dovbii proposed openstack/app-catalog: Update info about releases for murano apps and bundles  https://review.openstack.org/29593616:23
openstackgerritDmytro Dovbii proposed openstack/app-catalog: Update info about releases for murano apps and bundles  https://review.openstack.org/29593616:25
*** spzala has quit IRC16:28
*** spzala has joined #openstack-app-catalog16:29
*** spzala_ has joined #openstack-app-catalog16:31
*** spzala has quit IRC16:33
*** spzala_ has quit IRC16:40
*** toddjohn has joined #openstack-app-catalog16:41
*** spzala has joined #openstack-app-catalog16:47
*** pcaruana has quit IRC16:52
*** spzala has quit IRC16:52
docaedokfox1111: regarding your API comment, I think v2 with just straight glare is fine, and if there's a sensible way to including indexing/search16:58
*** kzaitsev_mb has joined #openstack-app-catalog16:58
*** spzala has joined #openstack-app-catalog16:58
docaedooutside glare - should be v3 API because that's going to introduce a bunch of new stuff in addition to everything that will come along with glare16:59
kfox1111so, add search directly to glare?17:00
docaedoI thought glare already had the ability to give back a list of assets matching given params? It can't only dump the entire index right?17:01
kfox1111-1 for adding backwards incompatable versions for no reason.17:01
kfox1111you can "search", but its a relational database search. which are expenisve, restrictive.17:02
kfox1111a nosql type fuzzy search is much more user friendly.17:02
kfox1111but I don't think glare will ever support that.17:02
kfox1111searchlight will, but thats a different project.17:02
kfox1111we enhanced v1 several times additively without having to break compatabilty.17:03
docaedoWill you be around tomorrow morning, same time? mfedosin(sp?) wants to chat with us here tomorrow, about more glare stuff17:03
kfox1111since v2 isn't defined/used anywhere yet, we should make sure we can add things we know we might like to it in the future without having to make a v3.17:03
*** spzala has quit IRC17:03
kfox1111let me check.17:03
kfox1111I've got a job interviewee coming... I might be able to make it, but depends on how long that goes.17:04
kfox1111I'll try.17:04
*** spzala has joined #openstack-app-catalog17:04
docaedocool17:04
docaedoso regarding versions and such, my concern is honestly around throwing so much stuff all in at once - is adding searchlight relatively trivial?17:06
docaedoI get the concerns around adding things later, but we're in exactly zero danger of the database suddenly becoming massive17:06
kfox1111no, I'm not suggesting we add it now. just saying we should leave a spot for it so we can add it later.17:06
docaedoah ok I understand - *that* I can agree to :)17:07
kfox1111if we make the proxy /v2 -> go directly to glare, we can't add searchlight or some other search thingy later.17:07
kfox1111if we have /v2/db target glare, we can add other things in /v2 later.17:07
docaedothat makes sense, sorry I did not catch the nuance earlier17:08
kfox1111no worries. :)17:08
*** spzala has quit IRC17:08
kfox1111while elasticsearch woudl add better scalability, I'm less interested in that for a while. more interested in the faceting and fuzzy search stuff.17:08
kfox1111the same stuff why google17:09
kfox1111's single text box is so awesome.17:09
kfox1111you just start typing and "magic" happens. :)17:09
kfox1111sql db's just don't work well with that sort of ui.17:09
*** spzala has joined #openstack-app-catalog17:10
docaedoyep, I get that, and it'd be cool if the search box on the site and plugin was magical17:10
kfox1111I'm kind of hoping since both glare and searchlight came from the same place, the code to sync between the two is already written.17:11
kfox1111it would be pretty easy for us to repurpose then.17:12
kfox1111if not, it still would be pretty easy for us to just do a mysql dump from glare, and import it to es directly.17:13
docaedothat's true .. I would be surprised if the code to sync is already done (but it would be a happy surprise)17:14
kfox1111they suposedly had syncing from glance done, since searchlight was part of glare when it first came out.17:14
*** spzala has quit IRC17:14
kfox1111not sure if it works with custom glare objects like we have though.17:15
docaedowell even if you can't make it tomorrow I'll be sure to bring it up17:16
kfox1111k. thx.17:16
*** spzala has joined #openstack-app-catalog17:16
*** spzala has quit IRC17:20
*** kebray has quit IRC17:21
*** spzala has joined #openstack-app-catalog17:22
kfox1111docaedo: can you post your standalone glare config file somewhere? (without pw's if there are any)17:23
docaedosure, one sec - I originally got it from kzaitsev_mb, nothing specialy really :) hold for pastebin link...17:23
*** spzala has quit IRC17:26
*** spzala has joined #openstack-app-catalog17:28
docaedoetc/glance-glare.conf without any comments (tiny!) http://paste.openstack.org/show/49148717:29
docaedoand the full file: http://paste.openstack.org/show/49148817:29
kfox1111k. thx.17:30
docaedonp17:30
kfox1111hmm... how does it load the plugins?17:30
docaedooh not sure, I was just using the all-in-one WIP review from kzaitsev_mb I believe, but had not poked at it in at least a week17:31
kfox1111gotta fix the dependencies of all of these reviews.... its impossible to check out a working branch. :/17:32
*** spzala has quit IRC17:33
*** spzala has joined #openstack-app-catalog17:34
kfox1111oh... its a whole other module...17:34
*** kebray has joined #openstack-app-catalog17:37
kfox1111ok. I found kzaitsev_mb's instructions...17:38
*** spzala has quit IRC17:39
*** spzala has joined #openstack-app-catalog17:40
*** rmoe has quit IRC17:41
*** rmoe has joined #openstack-app-catalog17:41
kfox1111oh... the script addition already is based on the plugins...17:42
kfox1111that isn't obvious any more through gerrit. :/17:43
*** spzala has quit IRC17:44
*** pcaruana has joined #openstack-app-catalog17:44
*** spzala has joined #openstack-app-catalog17:45
*** kebray has quit IRC17:47
*** spzala has quit IRC17:50
*** kebray has joined #openstack-app-catalog17:52
openstackgerritKevin Fox proposed openstack/app-catalog: Add script to upload assets to glare  https://review.openstack.org/28160217:57
*** spzala has joined #openstack-app-catalog17:57
openstackgerritKevin Fox proposed openstack/app-catalog: Allow using glare for v1 API call and add v2 proxy  https://review.openstack.org/29093218:00
*** spzala has quit IRC18:02
kfox1111docaedo: the script to pull stuff into glare seems to be downloading the raw data to shove in glare.18:02
kfox1111I don't think we want to do that.18:02
*** kebray has quit IRC18:02
docaedo"raw data" like you mean the binaries?18:03
*** spzala has joined #openstack-app-catalog18:03
docaedo(i.e. glance images entirely, rather than pointers to where to download them from)18:03
kzaitsev_mbkfox1111: it only downloads stuff, that's on storage.app.o.o anyway.18:04
kzaitsev_mbsorry for not resonding earlier, I saw you mentioning me18:04
docaedoIf so, I agree, and I thought I added a comment about that - but I also have not circled back, am spending time doing CI/CD for openstack clouds for $EMPLOYER lately18:04
kzaitsev_mbbut I was on 2 meetings at the same time %)18:04
kfox1111it downloads but not imports?18:04
kzaitsev_mbkfox1111: imports?18:04
kzaitsev_mbkfox1111: it downloads binary data from s.a.o.o and shoves it into glare and glare stores it whenever it is configured to (basically anything glance_store is capable, as far as I understand it)18:05
kzaitsev_mbI only tested it with files backend though =)18:05
kfox1111yeah. I don't think we want to do that.18:06
kzaitsev_mbwhy?18:06
kfox1111then we have to provide storage for everything.18:06
kfox1111right now, its distributed.18:07
docaedowe do want that to some degree18:07
docaedowe'll want glare to handle assets that we store (like the murano stuff, and some glance images)18:07
*** spzala has quit IRC18:07
kfox1111maybe.... but is openstack willing to host litterally everything?18:07
docaedoin production it will be backed by swift, rather than right now where its RAX cloud files18:07
docaedowe can't host everything18:07
kfox1111hmm...18:08
kfox1111that exposes a hole in the glare v1 compatability at very least...18:08
docaedoin fact, we shouldn't even be hosting the murano images with murano agent pre-installed, but Ubuntu hasn't noticed (though they could complain and that would have to change)18:08
kfox1111the asset needs to be downloadble via raw http via a pointer returned in the glare v1 data.18:08
kfox1111so either we have to make v1 have an endpoint that rewrites the url into one fetchable via glare, or proxy the data through.18:09
kfox1111and that raises another issue... I was tweaking the migration script to push locally so we could do it in runserver until we're happy with all the things and merge and get rid of the yaml stuff.18:10
kfox1111but if its downloading everything local, it will take a long time to do, and probably don't want to do that in runserver.18:10
kzaitsev_mbthat can probably be done with a CLI switch18:11
kfox1111yeah. that would work.18:11
kfox1111we can just store the remote url as we always have in that case?18:12
kfox1111the glare plugins will work with that?18:12
kzaitsev_mbthe plugin has optional blob and remote_url18:13
docaedoI would say we want to keep remote URL unchanged for existing assets, but have the ability to store new stuff locally (or update an asset to point to something stored on glare later)18:14
*** spzala has joined #openstack-app-catalog18:14
kzaitsev_mbso yep, it can be as easy as that.18:14
kzaitsev_mbI think, that my v1 compatibility commit doesn't cover that, but it should be pretty easy to set url based on availability of remote one18:15
kfox1111k.18:19
kfox1111we're going to have to consider quota's or something on storage too....18:19
kfox1111and the idea that someone might store video files or something that we may not find desirable.18:19
docaedoyep, thus the default will be to add an asset but it will not be "active", and can only be activated by app-catalog cores18:21
docaedomight need a blacklist in the auth module actually, in case someone tries packing a bunch of garbage in using their openstack id18:22
kfox1111hmm... k.18:24
openstackgerritKevin Fox proposed openstack/app-catalog: Add script to upload assets to glare  https://review.openstack.org/28160218:29
kfox1111ok. I think I got the nodownload flag added.18:30
kfox1111and fixed the lint isue.18:30
openstackgerritKevin Fox proposed openstack/app-catalog: Allow using glare for v1 API call and add v2 proxy  https://review.openstack.org/29093218:30
*** spzala has quit IRC18:34
kfox1111is 9494 the standard glare port?18:34
kzaitsev_mbthe default one, yes18:35
kfox1111k. I'll add a 1 in front then.18:35
kfox1111(I've been moving the runserver ones away from the default so if you have a working openstack on your system, like my laptop)18:35
kfox1111(you won't break the existing one during tests)18:35
kfox1111does glare have a pypi package released?18:42
kzaitsev_mbI think that it's part of glance18:42
kfox1111but they were splitting it out.18:43
kzaitsev_mbthe service is different, but they share code and released by the same setup.py config18:43
kzaitsev_mbthe packagers would probably do it differently18:43
kfox1111hmm... k.18:43
kzaitsev_mblike have a glance-common lib package and glance-api and glance-glare separate packages18:44
kfox1111so we need to add the glance dependency then, not glare.18:44
kzaitsev_mbat least that was my impression from talking to packaging team about the issue18:44
docaedoyeah as far as I know it's just part of glance and it's not going to be pulled from that repo18:44
kfox1111hmmm... k.18:45
kfox1111kind of looks like they don't provide pypi packages for the glance core. :/18:48
kfox1111so you can't just pip install it. :/18:48
kfox1111thats kind of a pain...18:48
*** kebray has joined #openstack-app-catalog19:00
*** kzaitsev_mb has quit IRC19:03
*** kebray has quit IRC19:06
*** kebray has joined #openstack-app-catalog19:06
*** toddjohn has quit IRC19:07
*** kebray has quit IRC19:11
*** kebray has joined #openstack-app-catalog19:13
*** kzaitsev_mb has joined #openstack-app-catalog19:42
*** toddjohn has joined #openstack-app-catalog19:55
*** kebray_ has joined #openstack-app-catalog20:03
*** kebray has quit IRC20:03
*** kzaitsev_mb has quit IRC20:03
*** kebray_ has quit IRC20:07
*** kebray has joined #openstack-app-catalog20:09
*** kzaitsev_mb has joined #openstack-app-catalog20:31
*** openstackgerrit has quit IRC21:48
*** openstackgerrit has joined #openstack-app-catalog21:49
kfox1111ever seen this: http://pastebin.com/imkeTtra22:09
kzaitsev_mbkfox1111: yep that's usually an old pip or tox22:10
kzaitsev_mbtox installs the version of pip with which it was installed itself by default22:10
kzaitsev_mbso just updating pip might not work22:10
*** hogepodge has quit IRC22:12
kfox1111yeah. thanks.22:25
kfox1111so, how did you init the db.22:25
kfox1111its complaining about not able to open the db when I tried.22:25
kzaitsev_mbyou use mysql?22:26
kfox1111sqlite22:26
kfox1111like the README.rst says.22:27
kfox1111trying to fix the runserver.22:27
kzaitsev_mbglance-manage db upgrade worked for me22:28
kfox1111hmm...22:29
kzaitsev_mb(to be honest I miss so much the times when I handn't had to support mysql)22:29
kzaitsev_mbmysql is such a pain22:29
kfox1111its not creating the db file for me... throwing a stack trace it doesn't exist.22:29
kzaitsev_mbthose were the days...22:29
kfox1111heh. I'm having to support mysql clusters these days. :/22:29
kzaitsev_mbthey also have db_sync, but I do not recall using that one22:31
*** rmoe_ has joined #openstack-app-catalog22:33
*** rmoe has quit IRC22:33
kfox1111got it...22:34
kfox1111they use extra slashes....22:34
kfox1111in file:// ,thats relative. a 3rd / is absolute..22:34
kfox1111but for sql://,22:34
kfox11113 is relative, and sqlite://// is aboslute. :/22:35
*** hogepodge has joined #openstack-app-catalog22:39
kfox1111almost there....22:55
*** kzaitsev_mb has quit IRC23:36
kfox1111kzaitsev_ws: took a first stab at runserver support.23:41
openstackgerritKevin Fox proposed openstack/app-catalog: Allow using glare for v1 API call and add v2 proxy  https://review.openstack.org/29093223:41
kfox1111its not very pretty at this point, but enough to run and get a usable v2 server.23:42
*** kzaitsev_mb has joined #openstack-app-catalog23:43
*** kzaitsev_mb has quit IRC23:54

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!