kfox1111 | interesting... they blocked poppy. | 00:00 |
---|---|---|
*** toddjohn has quit IRC | 00:08 | |
*** spzala has quit IRC | 00:19 | |
*** kzaitsev_mb has quit IRC | 01:04 | |
docaedo | Kind of makes sense to me since there's no way to test without 3rd party account | 01:39 |
openstackgerrit | Sahdev Zala proposed openstack/app-catalog: TOSCA web changes https://review.openstack.org/295376 | 02:16 |
openstackgerrit | Sahdev Zala proposed openstack/app-catalog: TOSCA web changes https://review.openstack.org/295376 | 02:18 |
*** kzaitsev_ws has quit IRC | 06:01 | |
*** kzaitsev_ws has joined #openstack-app-catalog | 06:01 | |
*** openstackgerrit has quit IRC | 08:33 | |
*** openstackgerrit has joined #openstack-app-catalog | 08:34 | |
*** pcaruana has joined #openstack-app-catalog | 08:40 | |
*** kzaitsev_mb has joined #openstack-app-catalog | 10:51 | |
*** kzaitsev_mb has quit IRC | 11:47 | |
*** kzaitsev_mb has joined #openstack-app-catalog | 12:03 | |
*** toddjohn has joined #openstack-app-catalog | 12:24 | |
*** toddjohn has quit IRC | 12:50 | |
*** toddjohn has joined #openstack-app-catalog | 13:39 | |
*** rhagarty has joined #openstack-app-catalog | 13:54 | |
*** toddjoh__ has joined #openstack-app-catalog | 13:55 | |
*** toddjo___ has joined #openstack-app-catalog | 13:56 | |
*** toddj____ has joined #openstack-app-catalog | 13:59 | |
*** toddjohn has quit IRC | 13:59 | |
*** toddjoh__ has quit IRC | 13:59 | |
*** toddjo___ has quit IRC | 14:01 | |
*** spzala has joined #openstack-app-catalog | 14:15 | |
*** openstackgerrit has quit IRC | 14:33 | |
*** openstackgerrit has joined #openstack-app-catalog | 14:34 | |
openstackgerrit | Sahdev Zala proposed openstack/app-catalog: TOSCA web changes https://review.openstack.org/295376 | 15:07 |
kfox1111 | yeah. I figured testing the plugin interface alone would probably be good enough, but I can see the argument. | 15:35 |
kfox1111 | I still think they should just come up with a very basic one that uses swift and gate on that. it would be good enough for a lot of use cases, and allow them in the door. | 15:36 |
kfox1111 | what do you guys think about the api suggestion I made a couple of days ago? | 15:36 |
openstackgerrit | Sahdev Zala proposed openstack/app-catalog: TOSCA web changes https://review.openstack.org/295376 | 15:37 |
*** spzala has quit IRC | 15:38 | |
*** spzala has joined #openstack-app-catalog | 15:39 | |
*** spzala has quit IRC | 15:43 | |
*** spzala has joined #openstack-app-catalog | 15:44 | |
kfox1111 | hmmm... looks like every heat/murano asset has a release tag maybe.... | 15:46 |
*** spzala has quit IRC | 15:49 | |
*** spzala has joined #openstack-app-catalog | 15:54 | |
*** spzala has quit IRC | 15:58 | |
*** spzala has joined #openstack-app-catalog | 16:00 | |
openstackgerrit | Dmytro Dovbii proposed openstack/app-catalog: Update Docker Interfaces Library murano package https://review.openstack.org/295923 | 16:00 |
*** spzala has quit IRC | 16:04 | |
*** spzala has joined #openstack-app-catalog | 16:05 | |
*** spzala has quit IRC | 16:10 | |
*** kzaitsev_mb has quit IRC | 16:11 | |
*** spzala has joined #openstack-app-catalog | 16:11 | |
*** kebray has joined #openstack-app-catalog | 16:14 | |
*** spzala has quit IRC | 16:16 | |
*** spzala has joined #openstack-app-catalog | 16:17 | |
*** spzala has quit IRC | 16:22 | |
*** spzala has joined #openstack-app-catalog | 16:23 | |
*** toddj____ has quit IRC | 16:23 | |
openstackgerrit | Dmytro Dovbii proposed openstack/app-catalog: Update info about releases for murano apps and bundles https://review.openstack.org/295936 | 16:23 |
openstackgerrit | Dmytro Dovbii proposed openstack/app-catalog: Update info about releases for murano apps and bundles https://review.openstack.org/295936 | 16:25 |
*** spzala has quit IRC | 16:28 | |
*** spzala has joined #openstack-app-catalog | 16:29 | |
*** spzala_ has joined #openstack-app-catalog | 16:31 | |
*** spzala has quit IRC | 16:33 | |
*** spzala_ has quit IRC | 16:40 | |
*** toddjohn has joined #openstack-app-catalog | 16:41 | |
*** spzala has joined #openstack-app-catalog | 16:47 | |
*** pcaruana has quit IRC | 16:52 | |
*** spzala has quit IRC | 16:52 | |
docaedo | kfox1111: regarding your API comment, I think v2 with just straight glare is fine, and if there's a sensible way to including indexing/search | 16:58 |
*** kzaitsev_mb has joined #openstack-app-catalog | 16:58 | |
*** spzala has joined #openstack-app-catalog | 16:58 | |
docaedo | outside glare - should be v3 API because that's going to introduce a bunch of new stuff in addition to everything that will come along with glare | 16:59 |
kfox1111 | so, add search directly to glare? | 17:00 |
docaedo | I thought glare already had the ability to give back a list of assets matching given params? It can't only dump the entire index right? | 17:01 |
kfox1111 | -1 for adding backwards incompatable versions for no reason. | 17:01 |
kfox1111 | you can "search", but its a relational database search. which are expenisve, restrictive. | 17:02 |
kfox1111 | a nosql type fuzzy search is much more user friendly. | 17:02 |
kfox1111 | but I don't think glare will ever support that. | 17:02 |
kfox1111 | searchlight will, but thats a different project. | 17:02 |
kfox1111 | we enhanced v1 several times additively without having to break compatabilty. | 17:03 |
docaedo | Will you be around tomorrow morning, same time? mfedosin(sp?) wants to chat with us here tomorrow, about more glare stuff | 17:03 |
kfox1111 | since v2 isn't defined/used anywhere yet, we should make sure we can add things we know we might like to it in the future without having to make a v3. | 17:03 |
*** spzala has quit IRC | 17:03 | |
kfox1111 | let me check. | 17:03 |
kfox1111 | I've got a job interviewee coming... I might be able to make it, but depends on how long that goes. | 17:04 |
kfox1111 | I'll try. | 17:04 |
*** spzala has joined #openstack-app-catalog | 17:04 | |
docaedo | cool | 17:04 |
docaedo | so regarding versions and such, my concern is honestly around throwing so much stuff all in at once - is adding searchlight relatively trivial? | 17:06 |
docaedo | I get the concerns around adding things later, but we're in exactly zero danger of the database suddenly becoming massive | 17:06 |
kfox1111 | no, I'm not suggesting we add it now. just saying we should leave a spot for it so we can add it later. | 17:06 |
docaedo | ah ok I understand - *that* I can agree to :) | 17:07 |
kfox1111 | if we make the proxy /v2 -> go directly to glare, we can't add searchlight or some other search thingy later. | 17:07 |
kfox1111 | if we have /v2/db target glare, we can add other things in /v2 later. | 17:07 |
docaedo | that makes sense, sorry I did not catch the nuance earlier | 17:08 |
kfox1111 | no worries. :) | 17:08 |
*** spzala has quit IRC | 17:08 | |
kfox1111 | while elasticsearch woudl add better scalability, I'm less interested in that for a while. more interested in the faceting and fuzzy search stuff. | 17:08 |
kfox1111 | the same stuff why google | 17:09 |
kfox1111 | 's single text box is so awesome. | 17:09 |
kfox1111 | you just start typing and "magic" happens. :) | 17:09 |
kfox1111 | sql db's just don't work well with that sort of ui. | 17:09 |
*** spzala has joined #openstack-app-catalog | 17:10 | |
docaedo | yep, I get that, and it'd be cool if the search box on the site and plugin was magical | 17:10 |
kfox1111 | I'm kind of hoping since both glare and searchlight came from the same place, the code to sync between the two is already written. | 17:11 |
kfox1111 | it would be pretty easy for us to repurpose then. | 17:12 |
kfox1111 | if not, it still would be pretty easy for us to just do a mysql dump from glare, and import it to es directly. | 17:13 |
docaedo | that's true .. I would be surprised if the code to sync is already done (but it would be a happy surprise) | 17:14 |
kfox1111 | they suposedly had syncing from glance done, since searchlight was part of glare when it first came out. | 17:14 |
*** spzala has quit IRC | 17:14 | |
kfox1111 | not sure if it works with custom glare objects like we have though. | 17:15 |
docaedo | well even if you can't make it tomorrow I'll be sure to bring it up | 17:16 |
kfox1111 | k. thx. | 17:16 |
*** spzala has joined #openstack-app-catalog | 17:16 | |
*** spzala has quit IRC | 17:20 | |
*** kebray has quit IRC | 17:21 | |
*** spzala has joined #openstack-app-catalog | 17:22 | |
kfox1111 | docaedo: can you post your standalone glare config file somewhere? (without pw's if there are any) | 17:23 |
docaedo | sure, one sec - I originally got it from kzaitsev_mb, nothing specialy really :) hold for pastebin link... | 17:23 |
*** spzala has quit IRC | 17:26 | |
*** spzala has joined #openstack-app-catalog | 17:28 | |
docaedo | etc/glance-glare.conf without any comments (tiny!) http://paste.openstack.org/show/491487 | 17:29 |
docaedo | and the full file: http://paste.openstack.org/show/491488 | 17:29 |
kfox1111 | k. thx. | 17:30 |
docaedo | np | 17:30 |
kfox1111 | hmm... how does it load the plugins? | 17:30 |
docaedo | oh not sure, I was just using the all-in-one WIP review from kzaitsev_mb I believe, but had not poked at it in at least a week | 17:31 |
kfox1111 | gotta fix the dependencies of all of these reviews.... its impossible to check out a working branch. :/ | 17:32 |
*** spzala has quit IRC | 17:33 | |
*** spzala has joined #openstack-app-catalog | 17:34 | |
kfox1111 | oh... its a whole other module... | 17:34 |
*** kebray has joined #openstack-app-catalog | 17:37 | |
kfox1111 | ok. I found kzaitsev_mb's instructions... | 17:38 |
*** spzala has quit IRC | 17:39 | |
*** spzala has joined #openstack-app-catalog | 17:40 | |
*** rmoe has quit IRC | 17:41 | |
*** rmoe has joined #openstack-app-catalog | 17:41 | |
kfox1111 | oh... the script addition already is based on the plugins... | 17:42 |
kfox1111 | that isn't obvious any more through gerrit. :/ | 17:43 |
*** spzala has quit IRC | 17:44 | |
*** pcaruana has joined #openstack-app-catalog | 17:44 | |
*** spzala has joined #openstack-app-catalog | 17:45 | |
*** kebray has quit IRC | 17:47 | |
*** spzala has quit IRC | 17:50 | |
*** kebray has joined #openstack-app-catalog | 17:52 | |
openstackgerrit | Kevin Fox proposed openstack/app-catalog: Add script to upload assets to glare https://review.openstack.org/281602 | 17:57 |
*** spzala has joined #openstack-app-catalog | 17:57 | |
openstackgerrit | Kevin Fox proposed openstack/app-catalog: Allow using glare for v1 API call and add v2 proxy https://review.openstack.org/290932 | 18:00 |
*** spzala has quit IRC | 18:02 | |
kfox1111 | docaedo: the script to pull stuff into glare seems to be downloading the raw data to shove in glare. | 18:02 |
kfox1111 | I don't think we want to do that. | 18:02 |
*** kebray has quit IRC | 18:02 | |
docaedo | "raw data" like you mean the binaries? | 18:03 |
*** spzala has joined #openstack-app-catalog | 18:03 | |
docaedo | (i.e. glance images entirely, rather than pointers to where to download them from) | 18:03 |
kzaitsev_mb | kfox1111: it only downloads stuff, that's on storage.app.o.o anyway. | 18:04 |
kzaitsev_mb | sorry for not resonding earlier, I saw you mentioning me | 18:04 |
docaedo | If so, I agree, and I thought I added a comment about that - but I also have not circled back, am spending time doing CI/CD for openstack clouds for $EMPLOYER lately | 18:04 |
kzaitsev_mb | but I was on 2 meetings at the same time %) | 18:04 |
kfox1111 | it downloads but not imports? | 18:04 |
kzaitsev_mb | kfox1111: imports? | 18:04 |
kzaitsev_mb | kfox1111: it downloads binary data from s.a.o.o and shoves it into glare and glare stores it whenever it is configured to (basically anything glance_store is capable, as far as I understand it) | 18:05 |
kzaitsev_mb | I only tested it with files backend though =) | 18:05 |
kfox1111 | yeah. I don't think we want to do that. | 18:06 |
kzaitsev_mb | why? | 18:06 |
kfox1111 | then we have to provide storage for everything. | 18:06 |
kfox1111 | right now, its distributed. | 18:07 |
docaedo | we do want that to some degree | 18:07 |
docaedo | we'll want glare to handle assets that we store (like the murano stuff, and some glance images) | 18:07 |
*** spzala has quit IRC | 18:07 | |
kfox1111 | maybe.... but is openstack willing to host litterally everything? | 18:07 |
docaedo | in production it will be backed by swift, rather than right now where its RAX cloud files | 18:07 |
docaedo | we can't host everything | 18:07 |
kfox1111 | hmm... | 18:08 |
kfox1111 | that exposes a hole in the glare v1 compatability at very least... | 18:08 |
docaedo | in fact, we shouldn't even be hosting the murano images with murano agent pre-installed, but Ubuntu hasn't noticed (though they could complain and that would have to change) | 18:08 |
kfox1111 | the asset needs to be downloadble via raw http via a pointer returned in the glare v1 data. | 18:08 |
kfox1111 | so either we have to make v1 have an endpoint that rewrites the url into one fetchable via glare, or proxy the data through. | 18:09 |
kfox1111 | and that raises another issue... I was tweaking the migration script to push locally so we could do it in runserver until we're happy with all the things and merge and get rid of the yaml stuff. | 18:10 |
kfox1111 | but if its downloading everything local, it will take a long time to do, and probably don't want to do that in runserver. | 18:10 |
kzaitsev_mb | that can probably be done with a CLI switch | 18:11 |
kfox1111 | yeah. that would work. | 18:11 |
kfox1111 | we can just store the remote url as we always have in that case? | 18:12 |
kfox1111 | the glare plugins will work with that? | 18:12 |
kzaitsev_mb | the plugin has optional blob and remote_url | 18:13 |
docaedo | I would say we want to keep remote URL unchanged for existing assets, but have the ability to store new stuff locally (or update an asset to point to something stored on glare later) | 18:14 |
*** spzala has joined #openstack-app-catalog | 18:14 | |
kzaitsev_mb | so yep, it can be as easy as that. | 18:14 |
kzaitsev_mb | I think, that my v1 compatibility commit doesn't cover that, but it should be pretty easy to set url based on availability of remote one | 18:15 |
kfox1111 | k. | 18:19 |
kfox1111 | we're going to have to consider quota's or something on storage too.... | 18:19 |
kfox1111 | and the idea that someone might store video files or something that we may not find desirable. | 18:19 |
docaedo | yep, thus the default will be to add an asset but it will not be "active", and can only be activated by app-catalog cores | 18:21 |
docaedo | might need a blacklist in the auth module actually, in case someone tries packing a bunch of garbage in using their openstack id | 18:22 |
kfox1111 | hmm... k. | 18:24 |
openstackgerrit | Kevin Fox proposed openstack/app-catalog: Add script to upload assets to glare https://review.openstack.org/281602 | 18:29 |
kfox1111 | ok. I think I got the nodownload flag added. | 18:30 |
kfox1111 | and fixed the lint isue. | 18:30 |
openstackgerrit | Kevin Fox proposed openstack/app-catalog: Allow using glare for v1 API call and add v2 proxy https://review.openstack.org/290932 | 18:30 |
*** spzala has quit IRC | 18:34 | |
kfox1111 | is 9494 the standard glare port? | 18:34 |
kzaitsev_mb | the default one, yes | 18:35 |
kfox1111 | k. I'll add a 1 in front then. | 18:35 |
kfox1111 | (I've been moving the runserver ones away from the default so if you have a working openstack on your system, like my laptop) | 18:35 |
kfox1111 | (you won't break the existing one during tests) | 18:35 |
kfox1111 | does glare have a pypi package released? | 18:42 |
kzaitsev_mb | I think that it's part of glance | 18:42 |
kfox1111 | but they were splitting it out. | 18:43 |
kzaitsev_mb | the service is different, but they share code and released by the same setup.py config | 18:43 |
kzaitsev_mb | the packagers would probably do it differently | 18:43 |
kfox1111 | hmm... k. | 18:43 |
kzaitsev_mb | like have a glance-common lib package and glance-api and glance-glare separate packages | 18:44 |
kfox1111 | so we need to add the glance dependency then, not glare. | 18:44 |
kzaitsev_mb | at least that was my impression from talking to packaging team about the issue | 18:44 |
docaedo | yeah as far as I know it's just part of glance and it's not going to be pulled from that repo | 18:44 |
kfox1111 | hmmm... k. | 18:45 |
kfox1111 | kind of looks like they don't provide pypi packages for the glance core. :/ | 18:48 |
kfox1111 | so you can't just pip install it. :/ | 18:48 |
kfox1111 | thats kind of a pain... | 18:48 |
*** kebray has joined #openstack-app-catalog | 19:00 | |
*** kzaitsev_mb has quit IRC | 19:03 | |
*** kebray has quit IRC | 19:06 | |
*** kebray has joined #openstack-app-catalog | 19:06 | |
*** toddjohn has quit IRC | 19:07 | |
*** kebray has quit IRC | 19:11 | |
*** kebray has joined #openstack-app-catalog | 19:13 | |
*** kzaitsev_mb has joined #openstack-app-catalog | 19:42 | |
*** toddjohn has joined #openstack-app-catalog | 19:55 | |
*** kebray_ has joined #openstack-app-catalog | 20:03 | |
*** kebray has quit IRC | 20:03 | |
*** kzaitsev_mb has quit IRC | 20:03 | |
*** kebray_ has quit IRC | 20:07 | |
*** kebray has joined #openstack-app-catalog | 20:09 | |
*** kzaitsev_mb has joined #openstack-app-catalog | 20:31 | |
*** openstackgerrit has quit IRC | 21:48 | |
*** openstackgerrit has joined #openstack-app-catalog | 21:49 | |
kfox1111 | ever seen this: http://pastebin.com/imkeTtra | 22:09 |
kzaitsev_mb | kfox1111: yep that's usually an old pip or tox | 22:10 |
kzaitsev_mb | tox installs the version of pip with which it was installed itself by default | 22:10 |
kzaitsev_mb | so just updating pip might not work | 22:10 |
*** hogepodge has quit IRC | 22:12 | |
kfox1111 | yeah. thanks. | 22:25 |
kfox1111 | so, how did you init the db. | 22:25 |
kfox1111 | its complaining about not able to open the db when I tried. | 22:25 |
kzaitsev_mb | you use mysql? | 22:26 |
kfox1111 | sqlite | 22:26 |
kfox1111 | like the README.rst says. | 22:27 |
kfox1111 | trying to fix the runserver. | 22:27 |
kzaitsev_mb | glance-manage db upgrade worked for me | 22:28 |
kfox1111 | hmm... | 22:29 |
kzaitsev_mb | (to be honest I miss so much the times when I handn't had to support mysql) | 22:29 |
kzaitsev_mb | mysql is such a pain | 22:29 |
kfox1111 | its not creating the db file for me... throwing a stack trace it doesn't exist. | 22:29 |
kzaitsev_mb | those were the days... | 22:29 |
kfox1111 | heh. I'm having to support mysql clusters these days. :/ | 22:29 |
kzaitsev_mb | they also have db_sync, but I do not recall using that one | 22:31 |
*** rmoe_ has joined #openstack-app-catalog | 22:33 | |
*** rmoe has quit IRC | 22:33 | |
kfox1111 | got it... | 22:34 |
kfox1111 | they use extra slashes.... | 22:34 |
kfox1111 | in file:// ,thats relative. a 3rd / is absolute.. | 22:34 |
kfox1111 | but for sql://, | 22:34 |
kfox1111 | 3 is relative, and sqlite://// is aboslute. :/ | 22:35 |
*** hogepodge has joined #openstack-app-catalog | 22:39 | |
kfox1111 | almost there.... | 22:55 |
*** kzaitsev_mb has quit IRC | 23:36 | |
kfox1111 | kzaitsev_ws: took a first stab at runserver support. | 23:41 |
openstackgerrit | Kevin Fox proposed openstack/app-catalog: Allow using glare for v1 API call and add v2 proxy https://review.openstack.org/290932 | 23:41 |
kfox1111 | its not very pretty at this point, but enough to run and get a usable v2 server. | 23:42 |
*** kzaitsev_mb has joined #openstack-app-catalog | 23:43 | |
*** kzaitsev_mb has quit IRC | 23:54 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!