Tuesday, 2014-08-05

*** julienvey has joined #openstack-sahara00:05
*** julienvey has quit IRC00:10
*** ViswaV has joined #openstack-sahara00:36
*** shakamunyi has quit IRC00:43
*** xianghui has quit IRC00:53
*** xianghui has joined #openstack-sahara00:54
*** xianghui has quit IRC00:54
openstackgerritA change was merged to openstack/sahara: Fixed a ValueError on provisioning cluster  https://review.openstack.org/11148200:54
*** xianghui has joined #openstack-sahara00:54
*** xianghui has quit IRC00:54
*** xianghui has joined #openstack-sahara00:55
*** xianghui has quit IRC00:55
*** xianghui has joined #openstack-sahara00:55
*** xianghui has quit IRC00:55
*** xianghui has joined #openstack-sahara00:56
*** xianghui has quit IRC00:56
*** xianghui has joined #openstack-sahara00:56
*** xianghui has quit IRC00:56
*** xianghui has joined #openstack-sahara00:57
*** xianghui has quit IRC00:57
*** xianghui has joined #openstack-sahara01:05
*** julienvey has joined #openstack-sahara01:06
*** julienvey has quit IRC01:10
*** julienvey has joined #openstack-sahara01:21
*** ViswaV has quit IRC01:21
*** julienvey has quit IRC01:25
*** shakamunyi has joined #openstack-sahara01:54
*** shakamunyi has quit IRC02:07
*** julienvey has joined #openstack-sahara02:21
*** shakamunyi has joined #openstack-sahara02:22
*** palar has quit IRC02:26
*** julienvey has quit IRC02:26
*** Networkn3rd has joined #openstack-sahara02:40
*** Networkn3rd has quit IRC02:49
*** julienvey has joined #openstack-sahara03:22
*** julienvey has quit IRC03:27
openstackgerritDexter Fryar proposed a change to openstack/sahara: Removed a duplicate directive  https://review.openstack.org/11189303:50
*** palar has joined #openstack-sahara04:10
*** palar has quit IRC04:14
*** julienvey has joined #openstack-sahara04:23
*** julienvey has quit IRC04:27
*** k4n0 has joined #openstack-sahara04:43
*** tnovacik has joined #openstack-sahara04:54
*** julienvey has joined #openstack-sahara05:24
*** julienvey has quit IRC05:28
*** Longgeek has joined #openstack-sahara05:33
*** tnovacik has quit IRC05:42
*** shakamunyi has quit IRC05:42
*** palar has joined #openstack-sahara05:58
*** palar has quit IRC06:03
*** shakamunyi has joined #openstack-sahara06:09
openstackgerritOpenStack Proposal Bot proposed a change to openstack/sahara: Imported Translations from Transifex  https://review.openstack.org/11192606:10
*** shakamunyi has quit IRC06:24
*** ViswaV has joined #openstack-sahara06:24
*** julienvey has joined #openstack-sahara06:24
*** Longgeek has quit IRC06:28
*** Longgeek has joined #openstack-sahara06:28
*** ViswaV has quit IRC06:28
*** Longgeek has quit IRC06:29
*** Longgeek_ has joined #openstack-sahara06:29
*** julienvey has quit IRC06:29
*** Longgeek_ has quit IRC06:31
*** tnovacik has joined #openstack-sahara06:38
*** Longgeek has joined #openstack-sahara06:42
*** shakamunyi has joined #openstack-sahara06:50
*** shakamunyi has quit IRC06:58
*** witlessb has joined #openstack-sahara07:18
*** julienvey has joined #openstack-sahara07:25
*** julienvey has quit IRC07:29
*** IvanBerezovskiy1 has joined #openstack-sahara07:32
*** palar has joined #openstack-sahara07:47
*** palar has quit IRC07:51
*** shakamunyi has joined #openstack-sahara07:55
openstackgerritA change was merged to stackforge/sahara-ci-config: Prepare DIB repository in nodepool image  https://review.openstack.org/11171708:08
*** shakamunyi has quit IRC08:10
*** julienvey has joined #openstack-sahara08:10
openstackgerritA change was merged to openstack/sahara: Imported Translations from Transifex  https://review.openstack.org/11192608:21
openstackgerritIvan Berezovskiy proposed a change to stackforge/sahara-ci-config: Set correct rights on DIB directory  https://review.openstack.org/11195208:32
openstackgerritIvan Berezovskiy proposed a change to stackforge/sahara-ci-config: Use jenkins home as directory to store DIB  https://review.openstack.org/11195208:48
*** Timotey has joined #openstack-sahara08:53
openstackgerritA change was merged to openstack/sahara: Removed a duplicate directive  https://review.openstack.org/11189309:04
openstackgerritA change was merged to openstack/sahara: Add test for storing data in DB for 007 migration  https://review.openstack.org/11064509:04
openstackgerritVitaly Gridnev proposed a change to openstack/sahara: Add notifications to Sahara  https://review.openstack.org/10898209:05
openstackgerritA change was merged to openstack/python-saharaclient: Updated from global requirements  https://review.openstack.org/11168909:09
openstackgerritA change was merged to stackforge/sahara-ci-config: Use jenkins home as directory to store DIB  https://review.openstack.org/11195209:12
*** Longgeek has quit IRC09:14
*** Longgeek has joined #openstack-sahara09:22
*** palar has joined #openstack-sahara09:35
*** tosky has joined #openstack-sahara09:37
*** palar has quit IRC09:40
*** skolekonov has joined #openstack-sahara09:50
*** shakamunyi has joined #openstack-sahara09:57
*** palar has joined #openstack-sahara10:00
*** shakamunyi has quit IRC10:01
*** tosky has quit IRC10:04
*** Longgeek has quit IRC10:41
*** Longgeek has joined #openstack-sahara10:42
*** Longgeek has quit IRC10:44
*** Longgeek has joined #openstack-sahara10:46
*** tosky has joined #openstack-sahara10:52
openstackgerritSergey Reshetnyak proposed a change to openstack/sahara: [WIP] Parallel testing EDP jobs  https://review.openstack.org/11096911:29
*** palar_ has joined #openstack-sahara11:31
*** palar has quit IRC11:34
*** palar_ has quit IRC11:35
openstackgerritAndrey Pavlov proposed a change to openstack/sahara: Add test for DB schema comparison  https://review.openstack.org/11198711:38
*** vrovachev has joined #openstack-sahara11:47
*** ylobankov has joined #openstack-sahara11:47
*** shakamunyi has joined #openstack-sahara11:47
openstackgerritIvan Berezovskiy proposed a change to stackforge/sahara-ci-config: Use git clone instead of downloading tarball  https://review.openstack.org/11199111:49
*** tosky has quit IRC11:55
*** shakamunyi has quit IRC11:58
*** tnovacik has quit IRC12:05
openstackgerritAndrey Pavlov proposed a change to openstack/sahara: Add translation support to plugin modules  https://review.openstack.org/10771812:16
*** palar has joined #openstack-sahara12:18
*** tnovacik has joined #openstack-sahara12:20
openstackgerritAndrey Pavlov proposed a change to openstack/sahara: Add translation support to plugin modules  https://review.openstack.org/10771812:20
*** miqui has joined #openstack-sahara12:42
*** tnovacik has quit IRC12:44
*** _crobertsrh is now known as crobertsrh12:46
openstackgerritAndrey Pavlov proposed a change to openstack/sahara: Add test for DB schema comparison  https://review.openstack.org/11198712:47
*** k4n0 has quit IRC12:50
*** _mattf is now known as mattf12:51
*** skolekonov has quit IRC12:54
*** tnovacik has joined #openstack-sahara12:59
*** _elmiko is now known as elmiko13:02
*** AndreyPavlov has joined #openstack-sahara13:04
*** AndreyPavlov has quit IRC13:10
*** AndreyPavlov has joined #openstack-sahara13:12
*** vrovachev has quit IRC13:14
*** crobertsrh has quit IRC13:14
*** vrovachev has joined #openstack-sahara13:15
*** crobertsrh has joined #openstack-sahara13:15
*** tmckay has joined #openstack-sahara13:29
openstackgerritDenis Egorenko proposed a change to stackforge/sahara-ci-config: Refactoring of CI scripts  https://review.openstack.org/11121613:37
openstackgerritSergey Lukjanov proposed a change to openstack/sahara: Move middleware package to api package  https://review.openstack.org/10727613:38
openstackgerritSergey Lukjanov proposed a change to openstack/sahara: Use oslo.middleware instead if copy-pasted  https://review.openstack.org/11201713:38
*** shakamunyi has joined #openstack-sahara13:41
*** shakamunyi has quit IRC13:49
openstackgerritA change was merged to openstack/sahara-dashboard: Updated from global requirements  https://review.openstack.org/11169014:11
*** shakamunyi has joined #openstack-sahara14:11
*** shakamunyi has quit IRC14:32
*** Longgeek has quit IRC14:41
openstackgerritA change was merged to stackforge/sahara-ci-config: Use git clone instead of downloading tarball  https://review.openstack.org/11199114:43
*** bradd1 has joined #openstack-sahara14:55
openstackgerritSergey Lukjanov proposed a change to openstack/sahara: Updated from global requirements  https://review.openstack.org/11204115:00
openstackgerritSergey Lukjanov proposed a change to openstack/sahara: Update oslo.config to the alpha/juno version  https://review.openstack.org/11204215:00
openstackgerritSergey Lukjanov proposed a change to openstack/sahara: Update oslo.messaging to alpha/juno version  https://review.openstack.org/11204315:00
*** tosky has joined #openstack-sahara15:07
*** shakamunyi has joined #openstack-sahara15:12
*** IvanBerezovskiy1 has left #openstack-sahara15:14
*** ylobankov has quit IRC15:20
*** DenisEgorenko1 has quit IRC15:20
*** vrovachev has quit IRC15:20
*** sreshetn1ak has quit IRC15:20
*** ylobankov has joined #openstack-sahara15:20
*** sreshetnyak has joined #openstack-sahara15:21
*** DenisEgorenko has joined #openstack-sahara15:22
*** shakamunyi has quit IRC15:28
*** ylobankov has quit IRC15:35
*** sreshetnyak has quit IRC15:35
*** AndreyPavlov has quit IRC15:35
*** DenisEgorenko has quit IRC15:35
*** ylobankov has joined #openstack-sahara15:35
*** AndreyPavlov has joined #openstack-sahara15:35
*** sreshetnyak has joined #openstack-sahara15:35
*** DenisEgorenko has joined #openstack-sahara15:37
*** Timotey has quit IRC15:46
openstackgerritA change was merged to openstack/sahara: Group tests by class  https://review.openstack.org/11168715:51
*** bradd1 has quit IRC15:52
*** bradd1 has joined #openstack-sahara15:52
*** DenisEgorenko has left #openstack-sahara16:03
*** openstackstatus has quit IRC16:17
*** openstack has joined #openstack-sahara16:17
*** openstackstatus has joined #openstack-sahara16:18
*** ChanServ sets mode: +v openstackstatus16:18
*** bradd1 has quit IRC16:25
*** bradd1 has joined #openstack-sahara16:26
*** ViswaV has joined #openstack-sahara16:29
*** ViswaV_ has joined #openstack-sahara16:30
*** tmckay has quit IRC16:30
*** ViswaV has quit IRC16:34
*** tmckay has joined #openstack-sahara16:37
*** ViswaV_ has quit IRC16:46
*** ViswaV has joined #openstack-sahara16:50
openstackgerritOpenStack Proposal Bot proposed a change to openstack/sahara: Updated from global requirements  https://review.openstack.org/11207816:55
*** ylobankov has quit IRC16:59
*** Networkn3rd has joined #openstack-sahara17:31
openstackgerritA change was merged to openstack/sahara: Updated from global requirements  https://review.openstack.org/11204117:35
openstackgerritA change was merged to openstack/sahara: Update oslo.config to the alpha/juno version  https://review.openstack.org/11204217:59
openstackgerritA change was merged to openstack/sahara: Update oslo.messaging to alpha/juno version  https://review.openstack.org/11204317:59
*** Networkn3rd has quit IRC18:00
*** julienvey has quit IRC18:26
*** ViswaV has quit IRC18:27
*** ViswaV has joined #openstack-sahara18:27
*** IlyaE has joined #openstack-sahara18:41
*** ViswaV has quit IRC18:42
*** tosky has quit IRC18:55
*** tellesnobrega_ has joined #openstack-sahara18:57
tellesnobrega_hi, storm image is ready and i’m starting to test the plugin itself. I started a devstack with my code but when i call sahara plugin-list storm is not there18:58
tellesnobrega_do i need to register it someplace, maybe add it to db18:59
tellesnobrega_tmckay: ping19:05
elmikotellesnobrega_: i don't think the plugins are stored in the db19:05
tmckaytellesnobrega_, hi19:06
tmckaythere is a config for enabled plugins ... let me find it19:06
tellesnobrega_thanks19:06
tmckayyes, sahara.plugins.base sets up the 'plugins' config19:07
tellesnobrega_hm, i will take a look19:08
tmckayI think you can just add that to the DEFAULT section in your sahara config19:09
tmckaytellesnobrega_, or what I do, just add it to the default value in plugins.base for testing :)19:09
tmckayI had to do that to enable the spark plugin while I was working on spark EDP19:10
*** tnovacik has quit IRC19:11
tellesnobrega_i did that19:12
tellesnobrega_but it failed to start19:12
tellesnobrega_i need to find out the root of the problem19:12
*** julienvey has joined #openstack-sahara19:13
elmikoyou can always `import pdb; pdb.set_trace()`, i know tmckay likes that option :)19:13
elmikoit's the fast route to the source of the problem19:13
tmckayheh, yeah.  tellesnobrega_, hmm, it might be getting an import failure I suppose.19:14
tmckayI would try to do what elmiko says here in the module load stuff.  iirc, it can get a little murky with the decorators but I think you can find it19:14
*** tnovacik has joined #openstack-sahara19:14
tmckayyou did remember the __init__.py file in the directory, right? :)19:15
tellesnobrega_yes, its the same as in spark19:15
tellesnobrega_an empty file19:15
tmckayyou can also use pdb to make sure the conf value for plugins is right when it goes to load19:15
tmckayI would *guess* some error in the code that causes the load to fail for that plugin19:16
tmckaybut that's just a guess19:16
tellesnobrega_thats what im guessing as well19:17
tellesnobrega_are there obrigatory methods that need to exist even with just a pass?19:18
*** julienvey has quit IRC19:20
*** ViswaV has joined #openstack-sahara19:22
*** julienvey has joined #openstack-sahara19:22
elmikosreshetnyak: do we need to add the CDH json files to the MANIFEST.in file?19:24
tmckaytellesnobrega_, not sure, I would think those would be marked with the decorators19:31
tellesnobrega_tmckay: i tried inserting the import pdb; pdb.set_trace() in the beginning of the plugin.py but it fails before it stops,19:31
elmikotellesnobrega_: are you getting an exception trace in the logs?19:32
tellesnobrega_yes19:32
tmckaymaybe try to put the break where it dynamically loads the plugin.  I can't help much there ...., I think I've poked at it a few times but I don't have a clear answer19:32
elmikoshare the exception trace on paste.openstack.org?19:33
tellesnobrega_sure19:33
tellesnobrega_http://paste.openstack.org/show/90673/19:33
* elmiko takes a look19:34
elmikotellesnobrega_: maybe put the pdb.set_trace in that _load_cluster_plugins method and see what CONF.plugins contains?19:36
tellesnobrega_thats what i’m doing right now19:37
tellesnobrega_thanks19:37
elmikolol, ok19:37
tellesnobrega_looks like the extension_manager.extensions does not contain storm extension in it19:55
elmikomakes sense given the error you posted, i'm not sure how you get the plugin into that manager19:56
tellesnobrega_pdb is awesome19:56
tellesnobrega_hadnt use it before19:57
elmikoyes, very helpful19:57
tellesnobrega_i used python in the first semester at university, but from the point on was mostly java19:57
tellesnobrega_it comes the ExtensionManager is part of stevedore.enabled20:01
tellesnobrega_cant find this in the code20:01
elmikoyea stevedore is an external package we use20:01
elmikohttp://stevedore.readthedocs.org/en/latest/20:01
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Fixed concurrent job execution with external hdfs  https://review.openstack.org/11212620:02
elmikolooks like it uses that check_func to look for package names to import20:02
*** ViswaV has quit IRC20:03
crobertsrhelmiko:  I bet you're already all over this, but just to confirm....the removal of username/pass for swift will also apply to the job-binaries bits as well, right?20:04
elmikocrobertsrh: yes20:04
elmikocrobertsrh: ideally we will remove the need for username/pass from all swift sources20:04
crobertsrhOk, just working on the UI part and wanted to double check with you.  Thanks.20:04
elmikocool, thanks20:05
crobertsrhRight20:05
tellesnobrega_elmiko: http://paste.openstack.org/show/90688/, it should be loaded here, but i think that it fails to load for some reason20:06
* elmiko looks20:07
*** palar_ has joined #openstack-sahara20:07
elmikotellesnobrega_: my guess is that check_func creates the names that are appended to the value of namespace, and then it attempts to import from that20:08
elmikoso, double check that storm is in config_plugins, and then double check that you can import sahara.cluster.plugins.storm20:09
elmikohttp://stevedore.readthedocs.org/en/latest/managers.html#stevedore.enabled.EnabledExtensionManager20:09
tellesnobrega_storm is in the config_plugins20:09
tellesnobrega_but i will check the import part20:10
*** palar has quit IRC20:10
*** tellesnobrega_ has quit IRC20:10
*** palar_ has quit IRC20:12
*** tmckay has quit IRC20:18
*** ViswaV has joined #openstack-sahara20:25
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Fixed concurrent job execution with external hdfs  https://review.openstack.org/11212620:32
*** ViswaV has quit IRC20:36
*** tnovacik has quit IRC20:36
*** julienvey has quit IRC20:49
elmikocrobertsrh: i saw you marked the workflow on the username/password thing, i think we might need to talk during the thursday meeting about how we implement that change21:04
elmikocrobertsrh: i'm concerned about the timing and whatnot21:04
crobertsrhSure thing.21:04
crobertsrhMy plan was to take a whack at my best guess on the changes pre-baby.  Hopefully, someone can run with it if it isn't ready until after I'm gone.21:04
elmikosounds good. i'm sure i can take a chainsaw to some html if needed :)21:05
crobertsrhtiming is a much bigger issue now that the UI lives in horizon21:05
elmikoyea21:05
crobertsrhReally, the changes should all be removing code and possibly tweaking an api call.21:05
elmikoyea21:06
crobertsrhMUCH easier than the service portion :)21:06
elmikooh hells yea21:06
openstackgerritMichael McCune proposed a change to openstack/sahara: Adding configuration options for Swift proxy user  https://review.openstack.org/11214221:11
*** crobertsrh is now known as _crobertsrh21:15
*** tnovacik has joined #openstack-sahara21:15
*** openstackgerrit has quit IRC21:16
*** openstackgerrit has joined #openstack-sahara21:16
*** tellesnobrega_ has joined #openstack-sahara21:36
*** IlyaE has quit IRC21:39
*** julienvey has joined #openstack-sahara21:50
*** tnovacik has quit IRC21:52
*** julienvey has quit IRC21:54
*** tellesnobrega_ has quit IRC21:56
*** IlyaE has joined #openstack-sahara22:12
*** tellesnobrega_ has joined #openstack-sahara22:12
*** tellesnobrega_ has quit IRC22:20
openstackgerritAndrew Lazarev proposed a change to openstack/sahara: Fixed anti-affinity for HEAT engine  https://review.openstack.org/11215922:20
*** julienvey has joined #openstack-sahara22:22
*** julienvey has quit IRC22:27
*** witlessb has quit IRC22:45
*** palar has joined #openstack-sahara23:09
*** palar has quit IRC23:10
*** palar has joined #openstack-sahara23:10
*** palar has quit IRC23:10
*** palar has joined #openstack-sahara23:11
openstackgerritMichael McCune proposed a change to openstack/sahara: Adding configuration options for Swift proxy user  https://review.openstack.org/11214223:15
*** julienvey has joined #openstack-sahara23:23
*** julienvey has quit IRC23:28
*** elmiko is now known as _elmiko23:32
*** bandarji has joined #openstack-sahara23:43
*** tellesnobrega_ has joined #openstack-sahara23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!