Monday, 2015-01-26

*** macjack has joined #openstack-sahara01:26
*** Networkn3rd has joined #openstack-sahara02:08
*** Networkn3rd has quit IRC02:22
*** witlessb has quit IRC02:38
*** witlessb has joined #openstack-sahara02:56
*** witlessb has quit IRC03:00
*** elmiko_ is now known as elmiko03:26
*** hdd has joined #openstack-sahara03:59
*** Longgeek has joined #openstack-sahara04:24
*** akuznetsov has joined #openstack-sahara04:44
*** akuznetsov has quit IRC04:47
*** Longgeek_ has joined #openstack-sahara04:47
*** Longgeek has quit IRC04:50
*** macjack_ has joined #openstack-sahara05:20
*** Networkn3rd has joined #openstack-sahara05:23
*** Networkn3rd has quit IRC05:27
*** hdd has quit IRC05:32
*** oikawa has joined #openstack-sahara05:32
*** sgotliv_ has joined #openstack-sahara05:56
*** macjack_ has quit IRC06:04
*** sgotliv_ has quit IRC07:42
*** witlessb has joined #openstack-sahara08:01
openstackgerritVitaly Gridnev proposed openstack/sahara: Migrate to oslo.log  https://review.openstack.org/14886108:16
openstackgerritVitaly Gridnev proposed openstack/sahara: Migrate to oslo.log  https://review.openstack.org/14886108:16
openstackgerritKazuki OIKAWA proposed openstack/sahara: Add edp.java.adapt_for_oozie config for Java Action  https://review.openstack.org/11588408:17
*** DenisEgorenko has joined #openstack-sahara08:24
*** Longgeek has joined #openstack-sahara09:30
*** Longgeek_ has quit IRC09:33
*** IvanBerezovskiy has joined #openstack-sahara09:35
openstackgerritAndrey Pavlov proposed openstack/sahara: Using oslo_* instead of oslo.*  https://review.openstack.org/14853009:42
*** vgridnev has joined #openstack-sahara09:58
openstackgerritSergey Reshetnyak proposed openstack/sahara-image-elements: Remove ability to building vanilla 2.3 and 2.4 images  https://review.openstack.org/14997110:29
openstackgerritVitaly Gridnev proposed openstack/sahara: [WIP] Apply event-log feature for vanilla plugin  https://review.openstack.org/14997210:31
openstackgerritOpenStack Proposal Bot proposed openstack/python-saharaclient: Updated from global requirements  https://review.openstack.org/14948910:34
openstackgerritOpenStack Proposal Bot proposed openstack/sahara: Updated from global requirements  https://review.openstack.org/14971610:34
openstackgerritOpenStack Proposal Bot proposed openstack/sahara-dashboard: Updated from global requirements  https://review.openstack.org/14998310:34
*** tosky has joined #openstack-sahara10:45
*** sgotliv_ has joined #openstack-sahara10:48
*** sgotliv_ has quit IRC10:55
*** tellesnobrega has joined #openstack-sahara11:02
openstackgerritPierre Padrixe (stannie) proposed openstack/python-saharaclient: Add cluster-delete by multiple names or ids  https://review.openstack.org/14982111:08
*** sgotliv_ has joined #openstack-sahara11:10
openstackgerritlu huichun proposed openstack/sahara: Add CDH configuration in itest.conf.sample-full  https://review.openstack.org/14971411:20
*** vgridnev has quit IRC11:24
*** tellesnobrega_ has joined #openstack-sahara11:54
*** akuznetsov has joined #openstack-sahara12:07
*** ylobankov has joined #openstack-sahara12:13
*** akuznetsov has quit IRC12:20
openstackgerritMerged openstack/sahara-specs: Refactor MapR plugin code  https://review.openstack.org/14858512:29
*** tellesnobrega_ has quit IRC12:43
openstackgerritMerged openstack/sahara: Fix getting heat stack in Sahara  https://review.openstack.org/14988912:43
*** NikitaKonovalov has quit IRC12:51
*** SergeyLukjanov has quit IRC12:51
*** SergeyLukjanov has joined #openstack-sahara12:52
*** NikitaKonovalov has joined #openstack-sahara12:53
*** akuznetsov has joined #openstack-sahara13:01
*** sgotliv_ has quit IRC13:21
*** sgotliv has joined #openstack-sahara13:21
openstackgerritSergey Reshetnyak proposed openstack/sahara-image-elements: Remove ability to building vanilla 2.3 and 2.4 images  https://review.openstack.org/14997113:30
*** tellesnobrega_ has joined #openstack-sahara13:34
*** vgridnev has joined #openstack-sahara13:45
SergeyLukjanovhey sahara folks13:50
*** weiting has joined #openstack-sahara13:53
*** AndreyPavlov has joined #openstack-sahara13:57
vgridnevhey13:57
AndreyPavlovhi)13:58
SergeyLukjanovlet's wait for some more time13:59
elmikomornin from the east coast usa =)14:00
sreshetnyakhello14:00
weitinghi14:01
toskyhi14:02
SergeyLukjanovhey folks14:03
SergeyLukjanovso, IMO we should start with the bugs from kilo-214:03
SergeyLukjanovhttps://bugs.launchpad.net/sahara/+milestone/kilo-214:03
SergeyLukjanovso, we need assignments for all the bugs14:04
SergeyLukjanovor move them to k3 / sometime if we aren't going to fix them now14:04
elmikosounds good14:04
openstackgerritSergey Lukjanov proposed openstack/sahara-image-elements: Remove ability to building vanilla 2.3 and 2.4 images  https://review.openstack.org/14997114:05
openstackgerritMerged openstack/sahara: Add integration test for Hive on vanilla2  https://review.openstack.org/14395014:06
SergeyLukjanovso, let's just all take a look on a bugs and write here if you'd like to take some14:06
* SergeyLukjanov taking https://bugs.launchpad.net/sahara/+bug/1385385 it's time to close this boring issue\14:07
*** _crobertsrh is now known as crobertsrh14:07
vgridnevI would like to take this bug https://bugs.launchpad.net/sahara/+bug/1319079 but it's not targeted for some milestone. Reason: I am working with applying event-log for hdp, I would be nice to fix this bug also.14:11
*** tellesnobrega_ has quit IRC14:11
SergeyLukjanovvgridnev, ack, I've assigned it to you14:13
SergeyLukjanovvgridnev, do you have an understanding of how it could be fixed?14:13
elmikoi'm gonna take a look at https://bugs.launchpad.net/sahara/+bug/139169414:14
*** tellesnobrega_ has joined #openstack-sahara14:14
vgridnevYes, I've readed most part of hdp plugin and seems that I understand how It should be fixed14:15
AndreyPavlovI'll take this one: https://bugs.launchpad.net/sahara/+bug/141292914:15
openstackgerritSergey Reshetnyak proposed openstack/sahara: New integration tests - part 1  https://review.openstack.org/14849114:15
SergeyLukjanovAndreyPavlov, yeah, good idea14:16
vgridnevHow this bug https://bugs.launchpad.net/sahara/+bug/1376228 should be fixed? It seems that it require big changes14:17
openstackgerritSergey Reshetnyak proposed openstack/sahara: New integration tests - part 2  https://review.openstack.org/14893514:17
SergeyLukjanovvgridnev, as a temp solution IMO we should add more strict validation to disallow such scaling for this plugin14:21
SergeyLukjanovelmiko, ^^14:21
*** tmckay has joined #openstack-sahara14:21
* elmiko looks14:21
*** tellesnobrega_ has quit IRC14:21
*** tellesnobrega_ has joined #openstack-sahara14:21
elmikoSergeyLukjanov: that seems like a reasonable first step14:22
SergeyLukjanovelmiko, tmckay, tellesnobrega, what's the status of https://bugs.launchpad.net/sahara/+bug/1356053 ?14:26
elmikoSergeyLukjanov: good question14:27
* tmckay looking14:27
elmikotellesnobrega_: ^^14:27
tellesnobrega_hey, im waiting for the tempest to be updated, so we can fix devstack14:28
tellesnobrega_i think horizon is waiting for the others to be fixed so they can authorize the fix14:29
openstackgerritlu huichun proposed openstack/sahara: Add HBase service test in cdh plugin integration test  https://review.openstack.org/14884714:29
tmckaytellesnobrega_, are the specific reviews that we can approve/comment on?14:29
tellesnobrega_let me look14:30
SergeyLukjanovtellesnobrega_, I think it's https://review.openstack.org/#/q/topic:bug/1356053,n,z14:31
tellesnobrega_https://review.openstack.org/#/c/135489/14:32
tellesnobrega_here is the tempest problem14:32
vgridnevAlso it would be nice to review this patch: https://review.openstack.org/#/c/136005/14:32
tmckaySergeyLukjanov, I meant ones for tempest and horizon :)14:32
tellesnobrega_it fails the jenkins test since devstack isn't fixed and devstack won't pass because tempest isn't fixed14:33
tellesnobrega_we have a bit of a deadlock14:33
tellesnobrega_https://review.openstack.org/#/c/135454/14:34
*** huichun has joined #openstack-sahara14:34
*** huichun has left #openstack-sahara14:35
*** huichun has joined #openstack-sahara14:35
elmikoSergeyLukjanov: is there any special proceedure i should know about for syncing oslo-incubator?14:37
SergeyLukjanovelmiko, it should be done by mattf :)14:38
SergeyLukjanovelmiko, if you'd like to do it, take a look on how it was done by mattf14:38
elmikoSergeyLukjanov: lol, ok14:38
SergeyLukjanovelmiko, like commit per changed file14:38
tellesnobrega_elmiko, what should i do to speed this thing up?14:38
elmikotellesnobrega_: probably start pinging the devstack folks14:39
elmikotellesnobrega_: i'm not sure when they having meetings, but i'd start poking around in openstack-dev14:39
elmikoSergeyLukjanov: ok, i'll talk to mattf and let him do it. looks like i assigned to quickly ;)14:40
tellesnobrega_ok. I friend of mine had a similar problem, but the solution was to remove tempest test, then fix devstack, and put tempest back14:41
tellesnobrega_but SergeyLukjanov told me that meant removing all tempest test for sahara, so it may not be a good way to do it.14:42
tellesnobrega_I will try to figure out in openstack-dev, see what i can do14:42
openstackgerritSergey Reshetnyak proposed openstack/sahara: New integration tests - part 3  https://review.openstack.org/15004214:45
elmikoSergeyLukjanov: whats the proper validation for this https://bugs.launchpad.net/sahara/+bug/1376784 ?14:45
*** egafford has joined #openstack-sahara14:46
SergeyLukjanovelmiko, probably we could allow leading numbers14:46
elmikoSergeyLukjanov: ok, should i just follow alazarev's suggestion then?14:46
SergeyLukjanovelmiko, IMO yup14:47
tmckayoh, wait, is this bug day?  I forgot14:47
elmikoSergeyLukjanov: ack, thanks14:47
elmikotmckay: yea =)14:47
tmckaythat ruins my plan14:47
* tmckay goes to look for bugs14:47
elmikotmckay: https://bugs.launchpad.net/sahara/+milestone/kilo-2 look for unassigned14:47
tmckayelmiko, thanks, I had my head in swift/spark and coordinating with the far eastern folks on EDP development14:48
elmikotmckay: no worries =)14:48
* tmckay searches for good bug fixing music14:49
toskytmckay: https://www.youtube.com/watch?v=XRU1AJsXN1g ?14:53
tmckaytosky, heh14:53
tmckayI wonder if my son can place this on the banjo14:54
vgridnevWhat about two Incomplete bugs which we have?14:55
openstackgerritMerged openstack/sahara-image-elements: Add different version builders support for Cloudera plugin  https://review.openstack.org/14811014:57
*** Networkn3rd has joined #openstack-sahara14:58
openstackgerritKen Chen proposed openstack/sahara: Separate the codes of CDH5 and CDH5.3.0  https://review.openstack.org/14793314:58
openstackgerritMerged openstack/sahara-dashboard: Updated from global requirements  https://review.openstack.org/14998314:59
openstackgerritMerged openstack/sahara: Add cleanup in the integration test gating file  https://review.openstack.org/14973215:01
*** tellesnobrega_ has quit IRC15:03
openstackgerritKen Chen proposed openstack/sahara: Change CDH plugin Processes Show_names  https://review.openstack.org/14924615:06
tmckaySergeyLukjanov, on cleanup -- I changed https://bugs.launchpad.net/sahara/+bug/1324582 to "Fix released".  The change to image elements was made last summer and appears in Juno.  Not sure why the CR said "Partial bug"15:07
tmckayI don't think there was anything else to do there15:08
SergeyLukjanovtmckay, okay15:09
*** tellesnobrega_ has joined #openstack-sahara15:09
openstackgerritSergey Reshetnyak proposed openstack/sahara: New integration tests - part 3  https://review.openstack.org/15004215:11
*** Longgeek has quit IRC15:13
elmikoSergeyLukjanov: we fixed https://bugs.launchpad.net/sahara/+bug/1391694 in commit f638946f459b81aa96c1cc341c0ee2e9f2afce1a15:20
*** tellesnobrega_ has quit IRC15:20
elmikoSergeyLukjanov: do i just change that to fix released then?15:20
elmikoSergeyLukjanov: or should i add a link to the commit in the bug comments as well?15:21
*** vgridnev has quit IRC15:24
*** huichun has quit IRC15:25
openstackgerritTrevor McKay proposed openstack/sahara: Add Swift integration with Spark  https://review.openstack.org/14665915:26
tmckaydon't worry, I'm still working on bugs :) ^^ going to make that one dependent on the command order issue15:27
elmikosure sure....15:27
elmiko;)15:27
tmckayI don't want to get open-slapped ;-)15:28
openstackgerritSergey Reshetnyak proposed openstack/sahara: Fix getting not registered images  https://review.openstack.org/15005915:29
openstackgerritSergey Reshetnyak proposed openstack/sahara: Fix getting not registered images  https://review.openstack.org/15005915:32
openstackgerritMerged openstack/python-saharaclient: Updated from global requirements  https://review.openstack.org/14948915:33
*** weiting has quit IRC15:34
openstackgerritMerged openstack/sahara: Updated from global requirements  https://review.openstack.org/14971615:50
elmikoSergeyLukjanov: ping15:51
*** tellesnobrega_ has joined #openstack-sahara16:09
*** sgotliv has quit IRC16:13
openstackgerritSergey Reshetnyak proposed openstack/sahara: Add ability to search images by name  https://review.openstack.org/15008316:18
elmikoany chance i could get some love on https://review.openstack.org/#/c/145960/ ?16:45
*** IvanBerezovskiy has left #openstack-sahara17:00
elmikosreshetnyak: ping17:05
openstackgerritSergey Reshetnyak proposed openstack/sahara: New integration tests - part 3  https://review.openstack.org/15004217:08
SergeyLukjanovelmiko, move to fix released + link to comit where it was actually fixed17:09
elmikoSergeyLukjanov: ack, that's what i did =)17:09
elmikoSergeyLukjanov: also, looking at the bad naming thing, do you think we should just allow numbers anywhere in the name for job binaries? (if so, what about data sources and jobs)17:10
SergeyLukjanovelmiko, it sounds ok for them17:20
tmckayelmiko, imho, if it's a legal filename, I don't see why not.  The names of job binaries are used in the oozie stuff as the name of the file17:20
tmckayas long as that works ....17:21
*** sgotliv has joined #openstack-sahara17:23
elmikotmckay: ack, thanks. i'm trying to figure out a sensible validator for these17:27
elmikonot sure that we should make it wide open, but i can't find any evidence against that.17:28
elmikoi'm gonna check to see how others are doing it17:28
*** hdd has joined #openstack-sahara17:28
tmckayelmiko, ack.  I think standard unix filename validation would be okay17:28
elmikotmckay: cool, that's pretty wide-open though17:29
tmckay:)17:29
elmikoi just wanna make sure we're not violating some sort of global naming policy in openstack17:29
tmckaygood idea17:29
openstackgerritTrevor McKay proposed openstack/sahara: Follow the argument order specified in spark-submit help  https://review.openstack.org/15010117:47
*** tellesnobrega_ has quit IRC17:51
openstackgerritSergey Reshetnyak proposed openstack/sahara: Add indirect VMs access implementation  https://review.openstack.org/13359017:59
*** DenisEgorenko has left #openstack-sahara18:11
*** amcrn has joined #openstack-sahara18:20
*** zhiyan has quit IRC18:40
*** zhiyan has joined #openstack-sahara18:41
openstackgerritEthan Gafford proposed openstack/sahara: Spark Temporary Job Data Retention and Cleanup  https://review.openstack.org/15011719:06
*** hdd has quit IRC19:08
*** tosky has quit IRC19:28
*** hdd has joined #openstack-sahara19:43
openstackgerritSergey Kolekonov proposed stackforge/sahara-ci-config: Revert "Use general cleanup for Heat jobs"  https://review.openstack.org/15012419:45
openstackgerritSergey Kolekonov proposed stackforge/sahara-ci-config: Improve Heat stacks cleanup mechanism  https://review.openstack.org/15012519:45
openstackgerritSergey Kolekonov proposed stackforge/sahara-ci-config: Improve Heat stacks cleanup mechanism  https://review.openstack.org/15012519:54
openstackgerritAndrew Lazarev proposed openstack/sahara: Removed EXTRA_OPTS tuning from devstack configuration  https://review.openstack.org/15013520:15
*** akuznetsov has quit IRC20:18
openstackgerritSergey Kolekonov proposed stackforge/sahara-ci-config: Improve Heat stacks cleanup mechanism  https://review.openstack.org/15012520:19
*** hdd has quit IRC20:28
*** tellesnobrega_ has joined #openstack-sahara20:35
*** tellesnobrega_ has quit IRC20:44
*** hdd has joined #openstack-sahara20:46
openstackgerritAndrew Lazarev proposed openstack/sahara-specs: Clean up clusters that are in non-final state for a log time  https://review.openstack.org/15014120:57
openstackgerritAndrew Lazarev proposed openstack/sahara-specs: Clean up clusters that are in non-final state for a long time  https://review.openstack.org/15014120:58
*** hdd has quit IRC21:03
*** tellesnobrega has quit IRC21:07
*** tellesnobrega has joined #openstack-sahara21:15
*** crobertsrh is now known as _crobertsrh21:52
*** tmckay has quit IRC22:36
openstackgerritMerged openstack/sahara-specs: Enable Spark jobs to access Swift URLs  https://review.openstack.org/14794922:49
*** tellesnobrega_ has joined #openstack-sahara23:29
*** hdd has joined #openstack-sahara23:33
*** egafford has quit IRC23:44
*** jamielennox has joined #openstack-sahara23:47
jamielennoxdoes the Sahara Hadoop Cluster CI check normally pass?  https://review.openstack.org/#/c/147773/ has been failing it consistently whilst passing regular jenkins runs23:48
jamielennoxi've not done any sahara work before but i can't see enough information in the logging output of those jobs to help me figure out the issue to see if it's my fault23:49
*** chlong has joined #openstack-sahara23:55
openstackgerritMerged openstack/python-saharaclient: Fix output of supported api versions  https://review.openstack.org/14785023:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!