Tuesday, 2017-03-07

*** VW has quit IRC00:00
cloudnullsorry was away. fsaad, sigmavirus is right I used cassandra in my POC and it was because I wanted to be able to offload as much as I could elsewhere and cassandra let me do exactly that.00:54
cloudnullI was recently thinking about how i could get craton to use solr instead of trying to build all the search things into the app00:54
cloudnullthough i've not progressed beyond just a thought at this moment00:55
cloudnullhowever i suspect indexing in solr w/ craton should not be too much of a massive lift00:55
cloudnullfor reference http://mysolr.readthedocs.io/en/latest/user/userguide.html01:03
*** Syed__ has quit IRC01:05
*** VW has joined #craton03:00
*** VW has quit IRC03:01
*** VW has joined #craton03:02
*** pwnall1337 is now known as zz_pwnall133703:03
*** Mitschke has quit IRC03:43
*** Mitschke has joined #craton04:28
*** anonymike has quit IRC06:26
*** anonymike has joined #craton06:28
*** tojuvone has quit IRC06:55
*** tojuvone has joined #craton07:26
*** sigmavirus has quit IRC09:23
*** sigmavirus has joined #craton09:30
*** sigmavirus is now known as Guest8135009:30
*** openstackgerrit has quit IRC10:33
*** VW has quit IRC13:21
suloalright here is our final req: https://gist.github.com/sulochan/347e70dabb12e66670590ae003a15dcd13:45
*** VW has joined #craton13:51
thomasemo/13:52
thomasemsulo: yay!13:53
antonymnice, got nested vars working?14:06
tojuvonenice14:06
Guest81350open laptop... forget to log onto IRC... get stuck in quagmire14:08
*** Guest81350 is now known as sigmavirus14:08
*** sigmavirus has quit IRC14:09
*** sigmavirus has joined #craton14:09
*** ChanServ sets mode: +o sigmavirus14:09
sigmavirussulo: well done!14:09
suloheh, thanks but i didnt do much :) the work was already done here: https://github.com/cloudnull/cruton/blob/master/playbooks/populate-data.yml14:31
suloi only modified it  a little bit14:31
suloantonym: no nested search is not working yet14:31
antonymah, looks like you had some nested vars injected in there14:36
suloah injection works fine14:36
suloits only searching those nested vars ... but once we fulfill this last req14:36
suloi am going to put a spec to do it on python side14:36
suloso it might be alittle slow for large vars set14:37
sulobut will have it atleast14:37
sulowell, actually depending on where that bit of work falls in priority list i guess14:38
sigmavirussulo: IOW, we're planning to knowingly create a way for someone to issue several requests against craton that would grind it to a halt?14:39
sulohuh ?14:39
sulosigmavirus: oh for nested var search you mean ?14:40
sigmavirusyes14:40
sulosigmavirus: heh, well i dont think it would be that extreme .. but i ack your point14:41
sulosigmavirus: we need to find some way to do it14:41
sigmavirusI agree we need to find  a way to do it14:42
sigmavirusI'm just wary of introducing potential DoS vectors to the project to support specific behaviour14:42
suloyes, very valid point .. especially if done across tenants etc14:42
suloi guess we can discuss this  once we set out the priority items14:43
sulomabye switch to > mysql5.714:43
suloand use raw query for json search with index14:43
sulosqlalchemy utils with json has no support for json search afaik14:44
sigmavirussulo: I don't have the right answer, and I don't expect us to find that right now, just voicing a concern over what you proposed :)14:45
sulosigmavirus: ack, i am going to propose a spec and discuss etc14:45
tojuvoneI would enhance docker-install.rst. Do I need a bug for it?14:47
git-harrysigmavirus: how is that different from adding the detail and all flags to the client?14:57
git-harryRegarding sulo's suggestion of using the client to search vars.14:57
cloudnullsulo: whats tha t?15:01
sulocloudnull: ?15:01
cloudnull[09:00] <sulo> [14:36:37] heh, thanks but i didnt do much :) the work was already done here: https://github.com/cloudnull/cruton/blob/master/playbooks/populate-data.yml15:02
cloudnull ?15:02
sulooh, i just used that script to populate data to craton15:02
suloso was saying that i didnt do much other than point thing at craton15:03
suloin that script15:03
suloplaybook i shoud say15:03
sigmavirusgit-harry: I expected sulo to be doing all the python searching server-side, not client side15:05
sigmavirusClient-side would be orders of magnitude worse but would not be a DoS vector15:06
sigmavirusgit-harry: so if your sole aim is to make everything worse for the user, then by all means, let's never have bulk import or proper variable search functionality15:06
git-harrysigmavirus: they are separate things and do not necessarily need to be treated the same way. Regarding variable searching, I wasn't suggesting it was ideal, I was simply trying to understand how it is worse than providing 'craton host-list --details --all'15:08
sulohmm .. not sure about bulk import .. i am only talking about variable search15:08
sigmavirusgit-harry: --details --all is a bit of python glue code (if I remember implementation correctly) as opposed to what would likely need to be some recursive searching through dictionaries15:11
cloudnullsulo:  ah . cool15:12
sigmavirus--details --all is not client-side glue code either15:12
sigmavirusSo having recursive search of a large group of variables (on each host) would be kind of awful server-side and even worse client-side15:12
suloare we supposed to have the team sync now ?15:44
thomasemI thought it was in 45 min?15:44
suloah cool. it says 3:30 pm15:45
thomasemOh15:45
sulobut i dont see it on my cal15:45
thomasemMy invite says 10:30AM CST15:45
sigmavirusyeah 45m15:45
thomasemMmm, also DST is coming up. How fun.15:49
sigmavirusthomasem: no15:53
sigmavirusI will not change my clocks15:53
sigmavirusnever agai15:53
thomasem:P15:56
*** Syed__ has joined #craton15:58
*** openstackgerrit has joined #craton16:00
jimbakerthe good thing about DST is that it occurs at different dates. so for our team: mar 12 (US) and mar 26 (UK). enjoy! :)16:00
thomasemLol, yep!16:01
thomasemGotta spread the fun around. Make people wake up at odd times and feel jet lagged for a few days.16:02
jimbakeralso i noticed the calendar invite is wrong for thurs meetings starting next week16:02
jimbakerwe agreed to tie this to US DST, so it coincides with tues time16:02
jimbakeri will adjust accordingly16:02
jimbakermeanwhile our #openstack-meeting-4 is on UTC...16:03
thomasemjimbaker: And we're honoring UTC, correct?16:07
jimbakerye16:07
jimbakeryes16:07
thomasemOkay, good.16:07
jimbakerthat meeting took some work to get scheduled in the first place, because it's an official meeting16:07
jimbakerso basically set in stone16:07
thomasemLol okay16:08
thomasemGotcha16:08
sigmavirusjimbaker: it's not that hard to schedule, but they don't take kindly to moving meetings around16:09
sigmavirusand it'd be easier if we picked friday as a meeting day instead of Monday16:09
sigmavirusthat said16:09
sigmavirusI like it sticking to UTC (like every other openstack team)16:09
jimbakeryeah... we are not moving the monday meeting16:10
sigmavirusIt at least gives us teh appearance of trying to participate in good faith in the big tent16:10
jimbakerand we will do a better job of that participation over time16:10
jimbakerlooks like i will be late to our meeting in 8 min. be there asap16:21
* sigmavirus ran into problems with our testing plan16:28
sigmavirushttps://review.openstack.org/#/c/442516/16:28
sigmavirushttps://review.openstack.org/#/c/442536/16:28
sigmavirushopefully those will be fixed/released today16:28
fsaadsulo / jimbaker are you able to join the slightly earlier scheduled meeting? :)16:32
git-harryfsaad: sulo is afk16:34
fsaadthanks git-harry16:34
*** zz_pwnall1337 is now known as pwnall133716:42
pwnall1337how do we feel about importing ansible vars with key/value in this format so it can be parsed by ansible if included in a playbook? https://gist.github.com/pwnall1337/0c1389b07258e24bad155437242285d516:49
pwnall1337then on top of those host vars, the craton client can parse cpu information16:49
pwnall1337fsaad: ^16:50
pwnall1337"ansible_processor "16:50
pwnall1337"ansible_virtualization_type"16:51
sigmaviruspwnall1337: having those up one level makes sense16:59
pwnall1337cool ill update the code here https://github.com/osic/ops-generic/tree/master/tools/osa_import_for_craton17:00
fsaadroom #craton-recordable17:01
openstackgerritIan Cordasco proposed openstack/python-cratonclient master: Add Betamax for testing  https://review.openstack.org/44216517:07
openstackgerritSyed Ahsan Shamim Zaidi proposed openstack/python-cratonclient master: Add Betamax for testing  https://review.openstack.org/44216517:52
*** david-lyle_ has joined #craton17:52
*** david-lyle has quit IRC17:54
*** david-lyle_ is now known as david-lyle17:55
*** david-lyle has quit IRC18:04
*** david-lyle has joined #craton18:05
*** david-lyle has quit IRC18:23
*** david-lyle has joined #craton18:25
*** david-lyle has quit IRC18:29
*** david-lyle has joined #craton18:36
*** david-lyle has quit IRC19:04
*** david-lyle has joined #craton19:06
cloudnullwhen do we think https://github.com/openstack/craton/blob/master/tools/docker_run.sh#L38-L46 will be rolled into the inital db-sync?19:14
cloudnullsulo: jimbaker: ?19:15
cloudnullor maybe something we could add as an additional cli command to create those users?19:17
pwnall1337created a bug report, for host show failing after importing vars https://bugs.launchpad.net/craton/+bug/167080219:25
openstackLaunchpad bug 1670802 in craton "host show fails after importing variables to host" [Undecided,New]19:25
cloudnullfsaad: RE: db mungery we talked about earlier.19:35
antonympwnall1337: yeah, once you run those few commands from the docker image, it corrects that19:46
cloudnullpwnall1337: ++19:46
pwnall1337?19:48
pwnall1337sorry i just uninstalled craton, pulled code and re installed and restarted the api19:49
pwnall1337what am i missing :)19:49
pwnall1337i upgraded db too*19:49
pwnall1337sorry19:49
antonympwnall1337: see update to bug19:50
fsaadpwnall1337: https://github.com/openstack/craton/blob/master/tools/docker_run.sh19:51
fsaadoh, thanks antonym :) brb foods19:51
antonymnp, figured it might be good to put it there in case someone else runs across that19:51
pwnall1337ill test it out, but if it does fix my issue, any plans to include that into the bootstrap upgrade command?19:52
pwnall1337wait19:52
pwnall1337i already have projects and users19:53
pwnall1337i created them as part of my reset-db script19:53
pwnall1337and i create region and cloud19:53
pwnall1337ill re read ,maybe im missing something19:53
pwnall1337antonym:  that fixed my issue20:03
pwnall1337should be part of craton docs imo20:03
antonymor abstracted away if it's required20:03
pwnall1337^20:03
antonymseems pretty critical to not ending up with a broken deployment20:04
pwnall1337https://github.com/osic/ops-generic/tree/master/tools/osa_import_for_craton  has been updated for the craton demo requirements20:06
cloudnullantonym: pwnall1337: +1 i too ran into that, and have been ranting about it. sadly its been radio silence.20:08
cloudnullI've posted that in here a few times now.20:09
sigmavirusjimbaker: see above conversation20:57
jimbakercloudnull, i opened a bug for this: https://bugs.launchpad.net/craton/+bug/167056121:17
jimbakerthomasem, ^^^ note the integration with craton-dbsync21:17
openstackLaunchpad bug 1670561 in craton "Create bootstrap user and project only via SQLAlchemy models" [Undecided,New]21:17
cloudnull^ when will then be now ?21:17
thomasemThanks, jimbaker21:26
jimbakerwell, i suppose ASAP is the ask? right now it has not been prioritized. more importantly it has not been discussed yet in terms of whether this specific approach is the right one21:26
jimbakerbut assuming it's the right way to do this, it could be done very quickly. implementation is certainly very small - it's comparable to what is done in the cited test21:28
jimbakersigmavirus, sulo, thomasem, so what do you think of this bug ( https://bugs.launchpad.net/craton/+bug/1670561), so we can get bootstrap construction moved out of sql?21:34
openstackLaunchpad bug 1670561 in craton "Create bootstrap user and project only via SQLAlchemy models" [Undecided,New]21:34
thomasemjimbaker: This is referring to our discussion over the past week or so regarding moving bootstrapping into the migrations?21:38
thomasemAlthough this suggests parameterizing it, which makes sense.21:39
jimbakerthomasem, it's not strictly speaking a migration step21:39
jimbakerbut dbsync is for db setup21:40
thomasemRight, it could be out-of-band, given the parameterization.21:40
jimbakerexactly'21:40
thomasemAnd just adhere to HEAD as the version it assumes.21:40
jimbakeryou need to create a new bootstrap user/project (for some reason? hard to know why)21:40
jimbakerthomasem, correct, because it uses model code21:40
jimbakerwhich makes sense, because it's not a schema change, it's just an object construction in the db21:41
thomasemI think that makes good sense and has the added flexibility that deployers will probably want.21:41
thomasemAnd then they won't have to go through the whole "delete the original root after you make your own" thing.21:41
jimbakeryeah, if you want to do so, you can21:41
jimbakerbut more importantly, because we will get it a crypto strong secret, it doesn't matter21:42
jimbakerup to the point of being able to read/write the db. wait, if you can do that, it doesn't matter :)21:42
jimbakerat all21:42
thomasemOkay, I'm burnt for the day. Have a lovely evening, everyone!22:59
jimbakerthomasem, enjoy, and do come back refreshed! thanks!23:00
*** VW has quit IRC23:37

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!