| *** tosky has quit IRC | 00:07 | |
| *** witlessb has joined #openstack-sahara | 00:35 | |
| *** hdd has quit IRC | 00:38 | |
| *** zhidong has joined #openstack-sahara | 00:48 | |
| openstackgerrit | Ken Chen proposed openstack/sahara: Enable 5.3 version choice in cdh plugin https://review.openstack.org/144452 | 01:42 |
|---|---|---|
| *** Longgeek has joined #openstack-sahara | 03:56 | |
| *** Longgeek has quit IRC | 03:57 | |
| *** Longgeek has joined #openstack-sahara | 04:03 | |
| oikawa | tmckay: enabled swiftfs element for hadoop2 image https://github.com/openstack/sahara-image-elements/commit/7a59589e22f634f4a9a50023fcc1f81b43fdf34f | 04:18 |
| oikawa | tmckay: disabled for hadoop2(because swiftfs included in hadoop): https://github.com/openstack/sahara-image-elements/commit/8020b1b4fbfc7399f136079b59268ca82245ab69 | 04:18 |
| oikawa | tmckay: The hadoop-swift-integration java code there is in two repository and not synced | 04:19 |
| oikawa | tmckay: http://eavesdrop.openstack.org/meetings/sahara/2014/sahara.2014-08-14-18.00.log.html hmm... | 04:19 |
| oikawa | Maybe, I looked this meeting log, I posted a patch that supports proxy-user to sahara-extra only | 04:22 |
| *** Poornima has joined #openstack-sahara | 04:40 | |
| *** k4n0 has joined #openstack-sahara | 05:24 | |
| *** k4n0 has quit IRC | 05:25 | |
| *** Longgeek has quit IRC | 05:51 | |
| *** Longgeek has joined #openstack-sahara | 06:09 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/sahara: Imported Translations from Transifex https://review.openstack.org/144830 | 06:13 |
| *** chlong has quit IRC | 07:49 | |
| *** chlong has joined #openstack-sahara | 07:49 | |
| *** chlong has quit IRC | 07:51 | |
| *** chlong has joined #openstack-sahara | 07:53 | |
| *** zhidong has quit IRC | 09:21 | |
| *** tosky has joined #openstack-sahara | 10:11 | |
| *** Longgeek has quit IRC | 10:51 | |
| *** Longgeek has joined #openstack-sahara | 10:51 | |
| *** Poornima has quit IRC | 10:54 | |
| *** Poornima has joined #openstack-sahara | 11:05 | |
| *** Poornima has quit IRC | 11:11 | |
| *** Poornima has joined #openstack-sahara | 11:12 | |
| *** Poornima has quit IRC | 11:16 | |
| *** Poornima has joined #openstack-sahara | 11:59 | |
| *** Poornima has quit IRC | 12:44 | |
| *** _crobertsrh is now known as crobertsrh | 13:54 | |
| *** Longgeek has quit IRC | 14:04 | |
| *** Longgeek has joined #openstack-sahara | 14:05 | |
| *** Longgeek has quit IRC | 14:06 | |
| *** Longgeek has joined #openstack-sahara | 14:07 | |
| *** Longgeek has quit IRC | 14:09 | |
| *** Longgeek_ has joined #openstack-sahara | 14:09 | |
| *** tmckay has joined #openstack-sahara | 14:11 | |
| *** Longgeek_ has quit IRC | 14:11 | |
| *** Longgeek has joined #openstack-sahara | 14:12 | |
| *** Longgeek has quit IRC | 14:13 | |
| *** Longgeek has joined #openstack-sahara | 14:14 | |
| tmckay | oikawa, thanks, saw your IRC messages from last night (my time :) ). Yes, I think we're on the same page. Summary: the hadoop swift support exists in two places, the official hadoop sources (released in 2.3 I believe) and sahara-extra (which is newer). Hadoop 1 images in DIB use the jar hosted by mirantis from sahara-extra, Hadoop 2 images use whatever is bundled with hadoop currently. | 14:35 |
| tmckay | So, Hadoop 1 images from DIB will pick up new features, while Hadoop 2 will not :) Hadoop 1 is newer ;-) | 14:35 |
| *** Longgeek has quit IRC | 14:36 | |
| tmckay | oikawa, SergeyLukjanov, dmitryme, elmiko, alazarev, sreshetnyak, I think we need to revisit this on the meeting this week, we haven't talked about it for a while | 14:37 |
| elmiko | tmckay: +1 | 14:37 |
| *** egafford has joined #openstack-sahara | 14:40 | |
| tmckay | elmiko, hmm, looks like CDH 5 uses Hadoop 2.3, so the hadoop-openstack jar should be available there. Maybe I can change DIB for Spark to use CDH 5 packages and pick up the jar without adding image elements | 14:42 |
| tmckay | ultimately, we should allow spark images to be built with something other than CDH. But for now ... | 14:42 |
| elmiko | hmm | 14:43 |
| tmckay | It solves the problem for spark I think without introducing more elements tied to the open question of what we do with hadoop-openstack support | 14:43 |
| elmiko | i think that only works as an extremely temporary solution | 14:44 |
| tmckay | I don't want to pile more code on top of something that we're already scratching our heads about :) | 14:44 |
| tmckay | ack | 14:44 |
| elmiko | i think we need an element for the hadoop-openstack jar | 14:44 |
| elmiko | my concern is that using the CDH base will make life difficult for consumers | 14:45 |
| tmckay | Unless we decide to go with the hadoop eco solution and make a determined effort to push to hadoop when necessary | 14:45 |
| tmckay | elmiko, we're already doing it, status quo | 14:45 |
| tmckay | I'm just talking about bumping the version for spark from 4 to 5 | 14:45 |
| tmckay | version of CDH that is | 14:45 |
| tmckay | I agree, long term it needs to be different. But we want spark with swift in the current cycle | 14:46 |
| elmiko | sticky wicket | 14:46 |
| tmckay | yeah | 14:46 |
| tmckay | time to relocate. Back in a bit | 14:46 |
| *** Longgeek has joined #openstack-sahara | 14:56 | |
| *** tmckay has quit IRC | 14:57 | |
| *** tmckay has joined #openstack-sahara | 15:21 | |
| *** mriedem has joined #openstack-sahara | 15:32 | |
| mriedem | does anyone know how this got fixed in the last 24 hours? http://goo.gl/CZY6TI | 15:33 |
| mriedem | i don't see anything in the sahara commits from yesterday that look related | 15:33 |
| * elmiko looks | 15:37 | |
| elmiko | mriedem: at a guess, the sahara.conf.sample was regenerated by the automated script and got pushed. honestly, i'm a little confused as to why we keep having issues with that file. | 15:38 |
| mriedem | elmiko: so something is automatically updating that file and pushing directly to refs/heads? | 15:39 |
| mriedem | i think most other projects that maintain a conf.sample are doing it manually, and it usually breaks when a dependent oslo library is released with new / changed config options | 15:40 |
| elmiko | mriedem: no i don't think it gets automagically pushed | 15:41 |
| elmiko | but we did change how the file gets generated, i think it was supposed to help with this, but i'm not sure how it got fixed | 15:41 |
| elmiko | mriedem: honestly, it's one of the build areas i'm a little hazy on. sorry :/ | 15:42 |
| mriedem | ok, magic is an acceptable answer | 15:42 |
| elmiko | we used to have a shell script that generated the conf.sample, then we moved to using an oslo util(i think) to have it generated during the build process. | 15:42 |
| elmiko | i think there is still a gap wherein "bad" versions get checked in occasionally | 15:43 |
| elmiko | which causes the whole cascade of pep8 errors | 15:43 |
| elmiko | mriedem: yea, awhile ago we removed the tools script to generate the conf.sample and moved it into the tox config. | 15:46 |
| mriedem | yeah https://github.com/openstack/sahara/blob/master/tox.ini#L61 | 15:46 |
| elmiko | lol, i was just about to link that! | 15:46 |
| elmiko | unfortunately this still does not answer your original question :/ | 15:47 |
| *** barra204_ has joined #openstack-sahara | 15:51 | |
| *** barra204_ is now known as shakamunyi | 15:53 | |
| *** tmckay has quit IRC | 16:50 | |
| *** tmckay has joined #openstack-sahara | 16:58 | |
| *** Networkn_ has joined #openstack-sahara | 17:01 | |
| *** Networkn_ has quit IRC | 17:01 | |
| *** Networkn_ has joined #openstack-sahara | 17:02 | |
| *** mriedem has left #openstack-sahara | 17:06 | |
| *** Longgeek has quit IRC | 17:19 | |
| *** Longgeek has joined #openstack-sahara | 17:25 | |
| tellesnobrega | elmiko, hey | 17:43 |
| tellesnobrega | i got an email, seems like there is a problem to load storm plugin. i will look it up asap | 17:43 |
| elmiko | tellesnobrega: is it related to this? https://review.openstack.org/#/c/144775/ | 17:50 |
| tellesnobrega | im not sure | 17:50 |
| tellesnobrega | i havent looked into it yet | 17:50 |
| tellesnobrega | but it may be | 17:50 |
| elmiko | ok, there is a missing entry in the setup.cfg that causes stevedore not to recognize the storm plugin | 17:51 |
| tellesnobrega | looks good | 17:51 |
| tellesnobrega | happy new year by the way | 17:52 |
| elmiko | thanks, happy new year to you as well =) | 17:52 |
| tellesnobrega | thanks | 17:53 |
| *** Longgeek has quit IRC | 17:56 | |
| *** Longgeek has joined #openstack-sahara | 17:57 | |
| openstackgerrit | Andrew Lazarev proposed openstack/sahara: Fixed pep8 after oslo update (01/06/2015) https://review.openstack.org/145285 | 18:01 |
| alazarev | mriedem, elmiko, https://review.openstack.org/#/c/145285/ | 18:02 |
| elmiko | alazarev: thanks, as soon as it passes i can workflow+ | 18:03 |
| *** Networkn_ has quit IRC | 18:03 | |
| alazarev | elmiko, I'm more and more think that dropping config check was a good idea | 18:04 |
| *** Networkn3rd has joined #openstack-sahara | 18:04 | |
| elmiko | alazarev: +1, it seems to just cause issues every time oslo gets updated | 18:05 |
| alazarev | elmiko, actually check is good, I think we should just remove it from pep8 and make non-voting for Jenkins | 18:05 |
| elmiko | alazarev: that's a solid idea | 18:06 |
| *** amcrn has joined #openstack-sahara | 18:11 | |
| *** amcrn has quit IRC | 18:14 | |
| elmiko | alazarev: does that file not trigger ci, i'm not seeing any jenkins notifications? | 18:18 |
| alazarev | elmiko, here is the answer ;) | 18:20 |
| alazarev | elmiko, also FYI: https://bugs.launchpad.net/sahara/+bug/1408053 | 18:20 |
| uvirtbot | Launchpad bug 1408053 in sahara "pep8 is broken after each oslo update" [Undecided,New] | 18:20 |
| elmiko | alazarev: lol, nice | 18:21 |
| elmiko | alazarev: should i just +workflow 145285 then? | 18:21 |
| alazarev | elmiko, I think yes | 18:22 |
| elmiko | alazarev: ok, now the ci is showing up | 18:24 |
| elmiko | i guess i didn't hit f5 enough times ;) | 18:24 |
| *** Longgeek_ has joined #openstack-sahara | 18:27 | |
| tmckay | elmiko, do you happen to know if there is a way to do a restart on a failed DIB build if the tmp dir is still there? | 18:29 |
| tmckay | wondering if there is a time save there, fix and repeat | 18:30 |
| elmiko | tmckay: don't think there is a resume, you could restart but it would still download everything afaik | 18:30 |
| *** Longgeek has quit IRC | 18:30 | |
| tmckay | and skip all the downloads :) | 18:30 |
| tmckay | doh | 18:30 |
| tmckay | gravy CR | 18:30 |
| tellesnobrega | that would be good thing to have | 18:31 |
| tellesnobrega | would save some time | 18:31 |
| openstackgerrit | Andrew Lazarev proposed openstack/sahara: Fixed topology parameters help in config https://review.openstack.org/145288 | 18:31 |
| elmiko | i suppose if it already downloaded all the elements stuff, then you could run the acutal dib command within the tmp dir | 18:31 |
| elmiko | tmckay: i've done stuff like that, but it usually doesn't save me much time | 18:31 |
| tmckay | yeah, it would be great. Give it a starting dir as an option and have it check for the downloads and skip over | 18:31 |
| tellesnobrega | cant we make the main script check the download folder if there is stuff there? | 18:32 |
| elmiko | i think a problem is going to be handling the transition between diskimage-create.sh and diskimage-builder | 18:32 |
| elmiko | doable, i just think you might need to dip into diskimage-builder stuff to make it work well | 18:34 |
| tmckay | yeah, probably not worth the effort. At home with a slower connection it seems like a really great idea ;-) | 18:36 |
| tellesnobrega | i thought that the diskimage-create.sh downloaded the files | 18:36 |
| elmiko | it sounds cool, i just think the real work will be in dib | 18:36 |
| tellesnobrega | agree with elmiko | 18:37 |
| elmiko | tellesnobrega: it downloads some stuff, but we also pass off elements to dib for installation | 18:37 |
| elmiko | and iirc, dib downloads things in it's elements | 18:37 |
| *** tmckay is now known as _tmckay | 18:47 | |
| openstackgerrit | Andrew Lazarev proposed openstack/sahara: Extracted config check from pep8 to separate env https://review.openstack.org/145300 | 19:00 |
| *** Longgeek_ has quit IRC | 19:01 | |
| *** Longgeek has joined #openstack-sahara | 19:04 | |
| *** shakamunyi has quit IRC | 19:07 | |
| *** shakamunyi has joined #openstack-sahara | 19:51 | |
| *** barra204_ has joined #openstack-sahara | 19:54 | |
| *** shakamunyi has quit IRC | 19:58 | |
| *** _tmckay is now known as tmckay | 19:59 | |
| openstackgerrit | Andrew Lazarev proposed openstack/sahara: Cleaned up config generator settings https://review.openstack.org/145325 | 20:21 |
| *** tellesnobrega has quit IRC | 20:28 | |
| *** tellesnobrega has joined #openstack-sahara | 20:41 | |
| *** pcaruana is now known as pcaruana|afk| | 20:45 | |
| openstackgerrit | Andrew Lazarev proposed openstack/sahara: Added ability to use other services via HTTPS https://review.openstack.org/145336 | 20:54 |
| openstackgerrit | Andrew Lazarev proposed openstack/sahara: Added ability to use other services via HTTPS https://review.openstack.org/145336 | 20:55 |
| openstackgerrit | Merged openstack/sahara: Fixed pep8 after oslo update (01/06/2015) https://review.openstack.org/145285 | 21:13 |
| elmiko | finally... | 21:13 |
| *** Longgeek has quit IRC | 21:18 | |
| openstackgerrit | Michael McCune proposed openstack/sahara: Adding Storm entry point to setup.cfg https://review.openstack.org/144775 | 21:18 |
| *** russellb has joined #openstack-sahara | 21:27 | |
| *** arborism has joined #openstack-sahara | 21:33 | |
| *** barra204_ has quit IRC | 21:39 | |
| *** barra204_ has joined #openstack-sahara | 21:39 | |
| crobertsrh | Hmm, my initial "wizard" approach is not panning out very well.....time to get creative :) | 21:50 |
| elmiko | +1 for creativity =) | 21:51 |
| crobertsrh | We'll see how that pans out :) | 21:51 |
| crobertsrh | Maybe I'll just add some <blink> tags and see how that works. | 21:51 |
| elmiko | LOL | 21:52 |
| *** russellb has left #openstack-sahara | 21:52 | |
| *** crobertsrh is now known as _crobertsrh | 21:53 | |
| *** barra204_ has quit IRC | 22:12 | |
| *** barra204 has joined #openstack-sahara | 22:13 | |
| *** tmckay is now known as _tmckay | 22:22 | |
| *** arborism has quit IRC | 22:35 | |
| *** egafford has quit IRC | 22:35 | |
| *** Networkn3rd has quit IRC | 22:42 | |
| openstackgerrit | Andrew Lazarev proposed openstack/sahara-specs: HTTPS support for sahara-api https://review.openstack.org/145369 | 22:50 |
| openstackgerrit | Andrew Lazarev proposed openstack/sahara-specs: HTTPS support for sahara-api https://review.openstack.org/145369 | 23:04 |
| *** _tmckay has quit IRC | 23:20 | |
| *** miqui has quit IRC | 23:20 | |
| *** rharwood has quit IRC | 23:21 | |
| *** jodah has quit IRC | 23:21 | |
| *** sgotliv has quit IRC | 23:21 | |
| *** _crobertsrh has quit IRC | 23:21 | |
| *** aignatov has quit IRC | 23:21 | |
| *** SergeyLukjanov has quit IRC | 23:21 | |
| *** ekarlso- has quit IRC | 23:21 | |
| *** tmckay has joined #openstack-sahara | 23:21 | |
| *** rharwood has joined #openstack-sahara | 23:22 | |
| *** jodah has joined #openstack-sahara | 23:22 | |
| *** sgotliv has joined #openstack-sahara | 23:22 | |
| *** _crobertsrh has joined #openstack-sahara | 23:22 | |
| *** aignatov has joined #openstack-sahara | 23:22 | |
| *** SergeyLukjanov has joined #openstack-sahara | 23:22 | |
| *** ekarlso- has joined #openstack-sahara | 23:22 | |
| *** miqui has joined #openstack-sahara | 23:25 | |
| openstackgerrit | Andrew Lazarev proposed openstack/sahara: Added ability to listen HTTPS port https://review.openstack.org/145380 | 23:38 |
| openstackgerrit | Andrew Lazarev proposed openstack/sahara: Added ability to listen HTTPS port https://review.openstack.org/145380 | 23:40 |
| openstackgerrit | Andrew Lazarev proposed openstack/python-saharaclient: Added SSL-related parameters to the client https://review.openstack.org/145382 | 23:42 |
| *** barra204 has quit IRC | 23:43 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!