Monday, 2015-05-11

« Sunday, 2015-05-10 Index Tuesday, 2015-05-12 »
openstackgerritli,chen proposed openstack/sahara-image-elements: Sahara-image-elements can only build hdp with centos  https://review.openstack.org/18131800:31
openstackgerritli,chen proposed openstack/sahara-image-elements: Sahara-image-elements can only build spark with ubuntu  https://review.openstack.org/18131400:36
*** hdd has quit IRC00:40
*** hdd has joined #openstack-sahara01:50
*** mahito has quit IRC01:57
*** mahito has joined #openstack-sahara02:06
*** mahito has quit IRC03:16
*** tobe has joined #openstack-sahara03:20
*** mahito has joined #openstack-sahara03:24
*** mahito has quit IRC03:29
*** mahito has joined #openstack-sahara03:30
*** hdd has quit IRC03:49
*** sgotliv_ has quit IRC04:23
*** sgotliv has joined #openstack-sahara04:23
*** coolsvap|afk is now known as coolsvap04:23
*** tobe has quit IRC05:03
*** chlong has quit IRC05:09
*** nkrinner has joined #openstack-sahara05:10
*** Nikolay_St has quit IRC05:32
*** sgotliv has quit IRC05:57
*** mahito has quit IRC05:58
*** Longgeek_ has joined #openstack-sahara05:59
*** tnovacik has joined #openstack-sahara06:01
*** Longgeek has quit IRC06:03
*** mahito_ has joined #openstack-sahara06:04
openstackgerritMerged openstack/sahara-image-elements: Always enable TRACE in gate for building images  https://review.openstack.org/17547606:36
*** stanchan has joined #openstack-sahara07:06
*** mahito_ has quit IRC07:38
*** pino|work has joined #openstack-sahara07:40
*** tobe has joined #openstack-sahara07:42
*** Nikolay_St has joined #openstack-sahara07:44
*** mahito has joined #openstack-sahara07:46
*** Nikolay_St has quit IRC07:56
*** sgotliv has joined #openstack-sahara08:04
*** Nikolay_St has joined #openstack-sahara08:09
*** witlessb has joined #openstack-sahara08:13
openstackgerritSergey Reshetnyak proposed openstack/sahara: Improve compatible with python3  https://review.openstack.org/18175708:40
openstackgerritPino Toscano proposed openstack/sahara-image-elements: Use the 'base' element implicitly everywhere  https://review.openstack.org/18184009:20
*** Nikolay_St has quit IRC09:41
*** Nikolay_St has joined #openstack-sahara09:41
*** sgotliv has quit IRC10:02
*** sgotliv has joined #openstack-sahara10:18
*** sgotliv has quit IRC10:35
*** mahito has quit IRC10:36
*** mahito has joined #openstack-sahara10:36
*** mahito has quit IRC10:44
*** coolsvap is now known as coolsvap|afk10:48
*** sgotliv has joined #openstack-sahara10:53
*** tnovacik has quit IRC10:57
*** Nikolay_St has quit IRC11:33
*** Nikolay_St has joined #openstack-sahara11:34
*** tobe has quit IRC11:53
*** Nikolay_St has quit IRC12:03
*** Nikolay_St has joined #openstack-sahara12:05
*** Nikolay_St has quit IRC12:15
*** raildo has joined #openstack-sahara12:19
*** htruta has joined #openstack-sahara12:19
openstackgerritlu huichun proposed openstack/sahara-specs: Add scheduling and recurring oozie workflow to EDP jobs  https://review.openstack.org/17571912:29
*** Nikolay_St has joined #openstack-sahara12:31
openstackgerritlu huichun proposed openstack/sahara-specs: Add scheduling and recurring oozie workflow to EDP jobs  https://review.openstack.org/17571912:37
openstackgerritlu huichun proposed openstack/sahara-specs: Add scheduling and recurring oozie workflow to EDP jobs  https://review.openstack.org/17571912:42
*** Longgeek_ has quit IRC12:48
*** Longgeek has joined #openstack-sahara12:49
*** tmckay has joined #openstack-sahara13:09
*** Longgeek has quit IRC13:15
*** Longgeek has joined #openstack-sahara13:16
*** chlong has joined #openstack-sahara13:22
*** tosky has joined #openstack-sahara13:54
*** Longgeek has quit IRC14:00
*** Longgeek has joined #openstack-sahara14:01
openstackgerritTrevor McKay proposed openstack/sahara: Add "null" for fields in cluster and node group template JSON schemas  https://review.openstack.org/18147714:03
*** Longgeek_ has joined #openstack-sahara14:03
*** Longgeek has quit IRC14:04
openstackgerritOpenStack Proposal Bot proposed openstack/sahara-image-elements: Updated from global requirements  https://review.openstack.org/18124614:04
*** openstackgerrit has quit IRC14:06
*** openstackgerrit has joined #openstack-sahara14:06
*** egafford has joined #openstack-sahara14:13
*** openstack has joined #openstack-sahara14:19
*** nkrinner has quit IRC14:40
*** stanchan has quit IRC14:45
tellesnobregaelmiko, hey, we got a14:46
tellesnobregasaharaclient.api.base.APIException: Failed to parse response from Sahara. Check if service catalog configured properly.14:46
tellesnobregawe have juno installed14:46
tellesnobregais this because of the change from data_processing to data-processing?14:46
elmikotellesnobrega: sounds like it14:46
elmikotellesnobrega: you could manually add both to the service catalog and see if that eliminates the error14:47
htrutaelmiko, tellesnobrega: it must be it14:47
htrutaI could use sahara CLI with --bypass-url parameter14:47
elmikoif possible, the service catalog should be updated14:48
htrutaI'm checking that14:48
tellesnobregathanks14:49
elmikohtruta: but yea, using the --bypass-url would work for an cli usage14:49
*** hdd has joined #openstack-sahara15:33
openstackgerritChad Roberts proposed openstack/python-saharaclient: Adding node group template editing to CLI  https://review.openstack.org/18146615:41
*** Nikolay_St has quit IRC15:48
*** sgotliv_ has joined #openstack-sahara15:59
*** sgotliv has quit IRC16:00
htrutaelmiko: changing service/endpoint resolved for the CLI, but not for python API16:07
htrutaI no longer need the --bypass-url16:07
*** tosky has quit IRC16:32
*** tosky has joined #openstack-sahara16:33
htrutaelmiko: solved it. I think it is a bug16:45
htrutaI was Instantiating the client with (sahara_url="sahara:8386/v1.1", project_id="x", input_auth_token=token)16:46
htrutabut it only worked with (sahara_url="sahara:8386/v1.1/x", project_id="x", input_auth_token=token)16:46
*** tnovacik has joined #openstack-sahara16:47
htrutaactually, the project_id parameter seems useless16:47
elmikohtruta: interesting...17:00
elmikohtruta: in the service catalog, the url should be "ip:port/v1.1/%(tenant_id)s", so i can see the sahara_url using the project id but it shouldn't be needed in the url17:01
htrutaelmiko: it is17:02
*** tosky has quit IRC17:02
htrutathat's why I can use the CLI17:02
htrutabut the python API is only working as I told you17:02
elmikoweird17:03
htrutaI'm using the auth check method: http://docs.openstack.org/developer/python-saharaclient/api.html#authentication-check17:03
*** tosky has joined #openstack-sahara17:03
htrutabut with project_id in the url17:03
*** Networkn3rd has joined #openstack-sahara17:03
elmikohmm, maybe something worth checking17:05
elmikoi usually use the form with the project_name parameter, and i don't need the id in the url17:05
openstackgerritMerged openstack/sahara-image-elements: Updated from global requirements  https://review.openstack.org/18124617:09
elmikohtruta: here is an example of how i use the python client, https://elmiko.github.io/2014/09/25/configuring-sahara-cluster-templates-with-python.html17:09
htrutaI see17:10
htrutanice post, btw... it's gonna be helpful17:11
elmikothanks =)17:11
htrutaanyway, I made it passing the token... I'll move my stuff on, and maybe I can check on that later17:11
htrutathanks for your help17:11
elmikonp, glad you got it working17:12
*** stanchan has joined #openstack-sahara17:15
elmiko_crobertsrh: i'm testing out the node group template update patch, and i have an updated sahara, is there something else i need?17:39
_crobertsrhpython-saharaclient17:39
-openstackstatus- NOTICE: We have discovered post-upgrade issues with Gerrit affecting nova (and potentially other projects). Some changes will not appear and some actions, such as queries, may return an error. We are continuing to investigate.17:39
*** ChanServ changes topic to "We have discovered post-upgrade issues with Gerrit affecting nova (and potentially other projects). Some changes will not appear and some actions, such as queries, may return an error. We are continuing to investigate."17:39
elmikoyea, i updated that with the patch. this is what i see http://paste.openstack.org/show/220043/17:40
elmikoand i produced the json by doing a `sahara node-group-template-show`17:40
_crobertsrhMake sure you're actually using the right client lib...can be tricky if you have multiple envs lurking.17:40
_crobertsrhdoes the help text show you the option for node-group-template-update?17:41
_crobertsrhif not, it's probably grabbing something older17:41
elmikoyea, it does show update17:41
_crobertsrhah, ok, should be good to go then, I'd think17:41
_crobertsrhbut, of course, you wouldn't have asked if everything was working17:41
elmikolol17:42
elmikoi just figured i'd actualy *test* the change ;)17:42
_crobertsrhNice touch :)17:42
elmikoi'm gonna upgrade everything and try again17:43
_crobertsrhheh, ok17:43
_crobertsrhI have one small tweak to make on it that I just discovered.17:43
_crobertsrhA free -1 if you can spot it quickly17:43
openstackgerritChad Roberts proposed openstack/python-saharaclient: Adding cluster template editing to CLI  https://review.openstack.org/18199617:44
elmikonot quick enough17:45
openstackgerritChad Roberts proposed openstack/python-saharaclient: Adding node group template editing to CLI  https://review.openstack.org/18146617:45
_crobertsrhoh no...that was a new CR (cluster templates)17:45
_crobertsrhnow you're too late :)17:45
elmikooh, interesting. so the update did take on the sahara controller but the cli reported all those warnings and an error17:46
_crobertsrhHmm17:46
elmikoball's in your court now... ;)17:47
elmikoj/k17:47
elmiko_crobertsrh: i think we're getting bit by None/null/0 values not get set in the template ngt that is getting created17:51
_crobertsrhI think I see what I may have done17:51
elmikoto explain the warnings that is17:51
_crobertsrhYeah.  Sort of.  I was trying to figure out what fields might be valid at update-time by looking at the actual node group template object.17:52
_crobertsrhIt looks like things might not be present at all (as opposed to None)17:52
elmikoright17:52
_crobertsrhwhich makes my update code think it isn't valid at all....and discard those fields17:52
elmikoi think this is related to what tmckay was looking at for null fields17:53
elmikoright17:53
elmikowhy the error though?17:53
tmckayelmiko, croberts, care to summarize or should I read back?17:53
elmikotmckay: i'm testing out the node group template update from cli, and there is a comparison of field keys that is happening17:54
_crobertsrhNot sure on the error bit.  I have not seen that.17:54
elmikosome of the fields, i think, aren't present because the server doesn't create keys for None fields17:54
elmiko_crobertsrh: is that do_node_group_template_update function supposed to return anything?17:55
_crobertsrhIt's probably along the lines of, "I've out clevered myself into incorrectness"17:55
elmikolol17:55
*** _crobertsrh is now known as crobertsrh17:55
tmckayah.  I was poking at that. crobertsrh, did you see the _filter_call_args method?17:55
crobertsrhI don't believe so.  nothing else seems to return anything17:55
tmckayI am not sure exactly how it works, but it looks like it tosses args that are not legal for the client call17:55
elmikocrobertsrh: ack17:55
crobertsrhtmckay:  I did see it, but like you, I was unsure of how it's supposed to work.  I could poke more at it.17:55
tmckaycrobertsrh, I was wondering if the comparison stuff for update can be replaced with that -- that would solve the issue17:56
tmckayI was going to give it a try, just for grins :)17:56
tmckaycrobertsrh, I think ultimately there is no need to look up keys in the template.  If fields are bogus, then validation should catch it.17:57
tmckaybut it looks like there is a precendent in the filter_call_args thing17:57
tmckaycrobertsrh, I was going to verify before I opened my mouth, but you guys happen to be touching the same thing :-D17:58
crobertsrhYeah.  Fine idea.  I appreciate it.  I'll play with the _filter_call_args bit.  It does seem promising.17:58
tmckaylooks like a very simple call, I bet it works17:59
elmikocrobertsrh: i think i found the error17:59
elmikocrobertsrh: looks like the server might not be wrapping the node group template object correctly when it returns from an PUT17:59
elmikocrobertsrh: check that out http://paste.openstack.org/show/220053/18:00
crobertsrhI thought I just made a change to fix that.18:00
elmikook, maybe just my controller doesn't have that fix18:00
elmikoi updated like last wednesday or so18:00
*** sgotliv_ has quit IRC18:01
tmckaycrobertsrh, I just tried it, I'll pastebin and you can verify18:01
tmckaysomeone wrote some good code18:01
*** Networkn3rd has quit IRC18:01
elmikocrobertsrh: checking again18:02
tmckaycrobertsrh, this is what I slapped in there http://fpaste.org/220763/13673451/18:02
crobertsrhI suspect that won't quite work (if you leave out some of the other unnamed params)18:03
crobertsrhbut it is promising18:03
elmikocrobertsrh: ok, yep. pebkac18:03
elmikook, added my comment18:08
elmikoand confirmed that it's dropping values18:08
crobertsrhIt does look like _filter....is the right answer.18:09
*** Networkn3rd has joined #openstack-sahara18:12
crobertsrhcrap...runs into problems with the mixed named/unnamed params18:12
elmikodoh =(18:13
tmckayelmiko, care to look at https://review.openstack.org/#/c/180372/?18:13
tmckaysimple fix, we should push it through18:13
tmckaycrobertsrh, what's the named/unnamed issue?  Something that can be fixed in the client code?18:14
elmikotmckay: ack18:14
crobertsrhI suspect it's just me having a Monday18:14
tmckaylol18:14
tmckayIt's Monday here too18:14
crobertsrhIf I specify an update without something like "plugin_name".....the call fails.18:15
elmikotmckay: ok, +workflow on that fix18:15
tmckaythanks18:15
crobertsrhMight need to specify some sort of default map to the filter function18:15
crobertsrhbut the create method does it without such magic18:16
crobertsrhoh...18:16
crobertsrhbecause they are required for a "create"18:16
* tmckay brb18:16
elmikotoo bad there is not an easy way for the saharaclient to access the json validation info from sahara18:24
openstackgerritChad Roberts proposed openstack/python-saharaclient: Adding node group template editing to CLI  https://review.openstack.org/18146618:26
crobertsrhOk, try that one, elmiko18:26
*** htruta has quit IRC18:26
crobertsrhI filter and then force the positional params to be present if they are not given.18:27
*** htruta has joined #openstack-sahara18:27
crobertsrhI suppose it might be a good bug fix to go back and make all the params named args.18:27
elmikook, trying now18:29
elmikobetter, i'm still getting a couple warnings but they might be totally valid18:31
elmikocrobertsrh: should i be able to update volume_mount_prefix and is_default?18:31
crobertsrhI think I see one more tweak18:31
crobertsrhelmiko: They are not currently in the update code at all.  I suspect they were added after the original update func maybe??18:32
elmikomaybe18:32
crobertsrhEither way, a bug that they are not yet in there.18:32
elmikoyea18:33
elmikoand i'm guessing it's a no-no to try and update the tenant_id?18:33
crobertsrhYeah, that shouldn't work, I don't think.18:33
elmikook, looks good to me then. aside from the new keys, but i don't think those are directly from this patch.18:34
crobertsrhDoh, one more tweak required18:36
openstackgerritChad Roberts proposed openstack/python-saharaclient: Adding cluster template editing to CLI  https://review.openstack.org/18199618:37
openstackgerritChad Roberts proposed openstack/python-saharaclient: Adding node group template editing to CLI  https://review.openstack.org/18146618:39
*** pino|work has quit IRC18:42
elmikocrobertsrh: i like the change to **update_template as well, nice tough19:11
elmiko*touch19:11
crobertsrhYeah, way cleaner19:12
elmikoagreed19:12
crobertsrhI can get rid of the other forced params after I switch the whole method to use named params.19:12
crobertsrhbut that's a separate bug, I suppose19:12
elmikomakes sense19:13
openstackgerritMerged openstack/sahara: Updated from global requirements  https://review.openstack.org/18195219:13
openstackgerritChad Roberts proposed openstack/python-saharaclient: Adding cluster template editing to CLI  https://review.openstack.org/18199619:32
crobertsrhgood catch tmckay.  Thanks.19:32
tmckaynp, looks great19:33
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara: Implementation of Storm scaling  https://review.openstack.org/17883719:36
openstackgerritMerged openstack/sahara-extra: Updated from global requirements  https://review.openstack.org/18124519:42
openstackgerritMerged openstack/sahara-dashboard: Updated from global requirements  https://review.openstack.org/18124419:42
openstackgerritMerged openstack/sahara: Fix logging_context_format_string input for sahara  https://review.openstack.org/18037219:53
openstackgerritMerged openstack/sahara-image-elements: Use the 'base' element implicitly everywhere  https://review.openstack.org/18184019:59
tellesnobregaelmiko, tmckay, alazarev can you take a look at https://review.openstack.org/#/c/178837/20:22
openstackgerritChad Roberts proposed openstack/python-saharaclient: Adding cluster template editing to CLI  https://review.openstack.org/18199620:22
elmikotellesnobrega: ack20:22
tellesnobregathanks20:22
openstackgerritMerged openstack/sahara: Added support of Pig 0.14 to MapR plugin  https://review.openstack.org/18023820:22
openstackgerritMerged openstack/sahara: Fixed logging issues with missing ids  https://review.openstack.org/18016720:23
openstackgerritChad Roberts proposed openstack/python-saharaclient: Adding node group template editing to CLI  https://review.openstack.org/18146620:24
alazarevtellesnobrega, done20:25
tellesnobregaalazarev, thanks20:25
SergeyLukjanovelmiko, congrats with API WG core ;)20:27
elmikoSergeyLukjanov: hehe, thanks =)20:27
tmckaytellesnobrega, looking20:29
tellesnobregatmckay, thanks20:29
openstackgerritMerged openstack/sahara: Improve compatible with python3  https://review.openstack.org/18175720:31
openstackgerritMerged openstack/sahara: Add support of Mapr FS to scenario tests  https://review.openstack.org/18107120:31
openstackgerritMerged openstack/sahara: Use keystone session in new integration tests  https://review.openstack.org/16929520:31
*** tosky has quit IRC20:32
*** tosky has joined #openstack-sahara20:33
*** openstackgerrit_ has joined #openstack-sahara20:43
*** sgotliv has joined #openstack-sahara20:54
*** tnovacik has quit IRC20:55
openstackgerritMerged openstack/sahara: Merge tag '2015.1.0'  https://review.openstack.org/17929320:57
openstackgerritMerged openstack/sahara: Remove sqlalchemy-migrate from test-requirements  https://review.openstack.org/17629720:59
*** htruta has quit IRC21:00
*** tmckay has quit IRC21:00
*** htruta has joined #openstack-sahara21:01
*** crobertsrh is now known as _crobertsrh21:13
openstackgerritMerged openstack/sahara: Increase edp module test coverage  https://review.openstack.org/18012121:37
openstackgerritMerged openstack/sahara: Make configurable timeouts in scenario tests  https://review.openstack.org/17718121:37
openstackgerritMerged openstack/sahara: Improved coverage for workflow_creator  https://review.openstack.org/17907421:37
openstackgerritMerged openstack/sahara: Added unit tests for service/api module  https://review.openstack.org/17820521:38
openstackgerritMerged openstack/sahara: Session usage improved in sqlalchemy api  https://review.openstack.org/17903821:39
SergeyLukjanovfolks, I've ensured that all threads created and added them to https://wiki.openstack.org/wiki/Summit/Liberty/Etherpads#Sahara and http://libertydesignsummit.sched.org/type/design+summit/Sahara , session drivers, please, fill the etherpads with info22:00
SergeyLukjanovtmckay, crobertsrh, elmiko ^^22:01
*** sgotliv has quit IRC22:06
*** egafford has quit IRC22:08
*** Networkn3rd has quit IRC22:20
*** Networkn3rd has joined #openstack-sahara22:28
elmikoSergeyLukjanov: ack22:31
*** Longgeek_ has quit IRC23:20
*** witlessb has quit IRC23:23
*** stanchan has quit IRC23:27
*** tosky has quit IRC23:49
-openstackstatus- NOTICE: Gerrit is going offline while we perform an emergency downgrade to version 2.8.23:55
*** ChanServ changes topic to "Gerrit is going offline while we perform an emergency downgrade to version 2.8."23:55
« Sunday, 2015-05-10 Index Tuesday, 2015-05-12 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!