Thursday, 2017-12-07

*** ltosky[m] has joined #openstack-sahara00:04
*** tosky has quit IRC00:44
*** shuyingya has joined #openstack-sahara00:51
*** shuyingya has quit IRC00:56
*** shuyingya has joined #openstack-sahara01:20
*** caowei has joined #openstack-sahara01:36
*** rcernin has quit IRC02:12
*** rcernin has joined #openstack-sahara02:20
*** dave-mccowan has quit IRC04:17
*** pgadiya has joined #openstack-sahara04:21
*** links has joined #openstack-sahara04:25
*** ukaynar has joined #openstack-sahara04:37
*** caowei has quit IRC05:12
*** caowei has joined #openstack-sahara05:39
*** caowei has quit IRC06:57
*** caowei has joined #openstack-sahara06:57
*** shuyingy_ has joined #openstack-sahara07:06
*** shuyingya has quit IRC07:09
*** rcernin has quit IRC07:11
*** esikachev has joined #openstack-sahara07:20
*** ukaynar has quit IRC07:34
openstackgerritOpenStack Proposal Bot proposed openstack/sahara-dashboard master: Imported Translations from Zanata  https://review.openstack.org/52630107:45
*** esikachev has quit IRC07:45
*** shuyingya has joined #openstack-sahara07:45
*** shuyingy_ has quit IRC07:49
*** caowei has quit IRC08:09
*** caowei has joined #openstack-sahara08:09
*** tesseract has joined #openstack-sahara08:15
*** rcernin has joined #openstack-sahara08:19
*** ukaynar has joined #openstack-sahara09:35
*** ukaynar has quit IRC09:40
*** tosky has joined #openstack-sahara10:11
*** rcernin has quit IRC10:21
*** raissa has quit IRC10:22
*** pgadiya has quit IRC10:47
*** esikachev has joined #openstack-sahara11:28
*** ukaynar has joined #openstack-sahara11:35
*** ukaynar has quit IRC11:40
*** caowei has quit IRC12:00
openstackgerritLuigi Toscano proposed openstack/sahara-image-elements master: Image builder: better default path to the source code  https://review.openstack.org/51483612:01
*** esikachev has quit IRC12:27
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara-image-elements master: Adding generation of Storm 1.1.1  https://review.openstack.org/52636112:48
openstackgerritMerged openstack/sahara-dashboard master: Imported Translations from Zanata  https://review.openstack.org/52630112:56
*** shuyingya has quit IRC13:01
*** raissa has joined #openstack-sahara13:11
*** dave-mccowan has joined #openstack-sahara13:18
*** shuyingya has joined #openstack-sahara13:35
tellesnobregatosky, got it working with devstack13:47
toskytellesnobrega: good to hear13:48
openstackgerritOpenStack Proposal Bot proposed openstack/sahara master: Updated from global requirements  https://review.openstack.org/52639213:48
*** raissa has quit IRC13:48
openstackgerritMerged openstack/sahara master: Image generation for CDH 5.11.0  https://review.openstack.org/51336313:53
*** links has quit IRC14:01
*** ukaynar has joined #openstack-sahara14:04
*** ukaynar has quit IRC14:29
*** ukaynar has joined #openstack-sahara14:30
*** openstackgerrit has quit IRC14:48
*** afazekas has quit IRC14:48
*** DuncanT has quit IRC14:48
*** ltosky[m] has quit IRC14:48
*** masber has quit IRC14:48
*** hoonetorg has quit IRC14:48
*** zigo has quit IRC14:48
*** knikolla has quit IRC14:48
*** dave-mccowan has quit IRC14:48
*** vkmc has quit IRC14:48
*** NikitaKonovalov has quit IRC14:48
*** remix_tj has quit IRC14:48
*** brad[] has quit IRC14:48
*** SergeyLukjanov has quit IRC14:48
*** ruhe has quit IRC14:48
*** aignatov has quit IRC14:48
*** dmitryme has quit IRC14:48
*** DuncanT has joined #openstack-sahara14:54
*** afazekas has joined #openstack-sahara14:55
*** openstackgerrit has joined #openstack-sahara14:55
*** dave-mccowan has joined #openstack-sahara14:55
*** knikolla has joined #openstack-sahara14:55
*** masber has joined #openstack-sahara14:55
*** hoonetorg has joined #openstack-sahara14:55
*** zigo has joined #openstack-sahara14:55
*** NikitaKonovalov has joined #openstack-sahara14:55
*** vkmc has joined #openstack-sahara14:55
*** brad[] has joined #openstack-sahara14:55
*** SergeyLukjanov has joined #openstack-sahara14:55
*** ruhe has joined #openstack-sahara14:55
*** aignatov has joined #openstack-sahara14:55
*** dmitryme has joined #openstack-sahara14:55
*** ukaynar has quit IRC14:56
*** ukaynar has joined #openstack-sahara15:02
*** ukaynar has quit IRC15:04
*** ukaynar has joined #openstack-sahara15:04
*** ukaynar has quit IRC15:06
*** ukaynar has joined #openstack-sahara15:06
*** shuyingya has quit IRC15:07
*** ukaynar has quit IRC15:11
*** links has joined #openstack-sahara15:25
*** ltosky[m] has joined #openstack-sahara15:34
toskyshould we kill the "sahara-all" entrypoint?15:45
*** links has quit IRC15:59
*** ukaynar has joined #openstack-sahara16:03
*** tosky has quit IRC16:03
openstackgerritMerged openstack/sahara master: Updated from global requirements  https://review.openstack.org/52639216:06
*** tosky has joined #openstack-sahara16:10
*** ukaynar has quit IRC16:31
*** ukaynar has joined #openstack-sahara16:39
*** ltosky[m] has quit IRC16:39
*** ukaynar has quit IRC16:50
openstackgerritMerged openstack/sahara master: [APIv2]Nix custom OpenStack-Project-ID header  https://review.openstack.org/52493217:05
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara master: Decommission of a specific node  https://review.openstack.org/52398117:08
tellesnobregatosky, ^ can you take a look at this please17:09
*** jeremyfreudberg has joined #openstack-sahara17:31
jeremyfreudbergtosky, we can deprecate sahara-all this cycle17:32
jeremyfreudberg(i am lazy so i use that entrypoint in one of my deployments but I'll survive the change)17:33
tellesnobregajeremyfreudberg, can you take a look at the decommission patch I just sent?17:34
tellesnobregashould be finished17:34
tellesnobregaand the spark/storm upgrade plugin patches17:35
*** remix_tj has joined #openstack-sahara17:37
jeremyfreudbergtellesnobrega, sure, I will look at it soon. would you say that the decomission patch is the most important one to get merged for Q-2?17:37
tellesnobregaplugins upgrades are more important17:38
tellesnobregabut they should be very simple17:38
jeremyfreudbergyep, spark storm upgrade is easy enough to review, I can definitely do those. just wanted to make sure that in terms of big patches you want to prioritize decomission. sounds like the answer is yes17:39
tellesnobregaI think it is the only big one we have now17:39
jeremyfreudbergthat's true17:40
*** ltosky[m] has joined #openstack-sahara17:53
*** ukaynar has joined #openstack-sahara17:56
*** ltosky[m] has quit IRC18:05
toskyuhm uhm, I wonder how we can deprecate an entry point18:07
tosky(sahara-all)18:07
toskyjust a deprecation note?18:08
jeremyfreudbergi mean, the entry point corresponds to some python function, it's not hard to add some log there as well18:08
jeremyfreudbergbut yes, reno18:08
*** tesseract has quit IRC18:13
*** jeremyfreudberg has quit IRC18:19
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara master: Upgrading Spark to version 2.2  https://review.openstack.org/52613618:22
*** jeremyfreudberg has joined #openstack-sahara18:25
jeremyfreudbergtellesnobrega, you need to update those unit tests to reflect spark 2.2 instead of 2.2.0 as well18:25
tellesnobregayeah18:25
tellesnobregaI'm not sure what is the problem with xenial part18:26
tellesnobregawe already had that18:26
jeremyfreudberglet me look more carefully18:26
jeremyfreudberghttps://github.com/openstack/sahara-image-elements/blob/5e46a5f0ee4ef1b4dbb2512d4bfb0fc625be6c36/diskimage-create/diskimage-create.sh#L57518:28
jeremyfreudberghttps://github.com/openstack/sahara-image-elements/blob/master/elements/hadoop-cloudera/pre-install.d/10-add-mirror#L918:28
jeremyfreudbergspark plugin right now asks for cloudera 5.5 hdfs packages18:28
jeremyfreudbergthat uses trusty repos18:28
jeremyfreudbergxenial does exist, though, we just have to switch to it:18:29
jeremyfreudberghttps://github.com/openstack/sahara-image-elements/blob/master/elements/hadoop-cloudera/pre-install.d/10-add-mirror#L23418:29
jeremyfreudbergtellesnobrega, of course really we ought to find out if we can stop using cloudera packages on spark plugin entirely18:29
jeremyfreudbergsome guy came on the channel over the summer and we talked about it, i forget what we discovered18:29
tellesnobregaI see18:30
tellesnobregajeremyfreudberg, basically we need to update to cdh 5.11?18:31
jeremyfreudbergyeah, that's my idea, that Spark plugin on 2.2 should use Cdh 5.11 packages18:32
tellesnobregalets try that18:32
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara master: Upgrading Spark to version 2.2  https://review.openstack.org/52613618:32
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara-image-elements master: Adding Spark 2.2  https://review.openstack.org/52613518:36
*** ltosky[m] has joined #openstack-sahara18:37
jeremyfreudbergtellesnobrega, the choice of trusty/xenial Line 583 should also be wrapped in spark version if-else18:37
jeremyfreudbergi think18:37
tellesnobregayou are right, I saw and forgot to add it there18:37
*** ukaynar has quit IRC18:42
*** jeremyfreudberg has quit IRC18:44
*** tosky has quit IRC18:47
*** tosky has joined #openstack-sahara19:12
*** ukaynar has joined #openstack-sahara19:22
*** ukaynar has quit IRC19:26
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara master: Decommission of a specific node  https://review.openstack.org/52398119:27
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara-image-elements master: Adding Spark 2.2  https://review.openstack.org/52613519:27
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara master: Upgrading Spark to version 2.2  https://review.openstack.org/52613619:28
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara master: [WIP] S3 job binary and binary retriever  https://review.openstack.org/52030619:28
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara master: [APIv2]Add ability to export templates to APIv2  https://review.openstack.org/52493319:29
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara master: Fix scaling validation error  https://review.openstack.org/52609819:29
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara master: Mostly stop abusing [keystone_authtoken]  https://review.openstack.org/52493619:29
toskyuhm, a lot of rebase patches?19:30
*** ltosky[m] has quit IRC19:33
openstackgerritTelles Mota Vidal Nóbrega proposed openstack/sahara-image-elements master: Adding Spark 2.2.0  https://review.openstack.org/52613519:35
tellesnobregatosky, got a lot of messages of merge failed19:43
tellesnobregatosky, https://review.openstack.org/#/c/523981/ can you check this?19:44
tellesnobregatosky, is this ready to merge https://review.openstack.org/#/c/510631/?19:47
*** ukaynar has joined #openstack-sahara20:02
toskytellesnobrega: no, it does not still solve the failure20:02
* tosky starts putting -w to his patches20:03
openstackgerritMerged openstack/sahara master: Add ZooKeeper support in Vanilla cluster  https://review.openstack.org/51849820:54
*** ukaynar has quit IRC21:31
*** ukaynar has joined #openstack-sahara21:31
*** ukaynar has quit IRC21:32
*** ukaynar has joined #openstack-sahara21:32
*** ukaynar has quit IRC21:32
*** ukaynar has joined #openstack-sahara21:33
*** ukaynar has quit IRC21:37
*** Jeffrey4l has quit IRC21:45
*** Jeffrey4l has joined #openstack-sahara21:48
*** openstackgerrit has quit IRC21:48
*** openstackgerrit has joined #openstack-sahara21:55
openstackgerritMerged openstack/sahara master: [APIv2]Add ability to export templates to APIv2  https://review.openstack.org/52493321:55
openstackgerritMerged openstack/sahara master: Upgrading Spark to version 2.2  https://review.openstack.org/52613621:57
*** rcernin has joined #openstack-sahara22:09
*** rcernin has quit IRC22:09
*** rcernin has joined #openstack-sahara22:09
*** ukaynar has joined #openstack-sahara22:12
*** ukaynar has quit IRC22:36
*** rcernin has quit IRC22:36
*** ukaynar has joined #openstack-sahara22:42
*** rcernin has joined #openstack-sahara22:42
*** ukaynar has quit IRC23:06
*** ukaynar has joined #openstack-sahara23:07
*** ukaynar has quit IRC23:31
openstackgerritMerged openstack/sahara master: Fix scaling validation error  https://review.openstack.org/52609823:36
*** ukaynar has joined #openstack-sahara23:59

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!